KR20150095541A - User terminal device and method for displaying thereof - Google Patents

Abstract

A user terminal and a display method thereof are provided. A method of displaying a user terminal device includes a display unit for displaying an image, a bezel unit for housing the display unit, a first touch sensing unit for sensing a user touch input to the display unit, a second touch sensing a user touch input to the bezel unit, And a controller for performing a function of a type of the touch interaction and a function of the user terminal corresponding to at least two sides touched when the touch interaction is detected by touching at least two sides of the bezel through the sensing unit and the second touch sensing unit.

Description

[0001] USER TERMINAL DEVICE AND METHOD FOR DISPLAYING THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user terminal and a display method thereof, and more particularly to a user terminal capable of inputting a user's touch on a bezel housing a display unit as well as a display unit and a display method thereof.

Various types of user terminal devices have been developed and popularized by the development of electronic technology. In recent years, the size of a user terminal has been minimized, and the functions thereof have been further diversified, and the demand thereof is increasing more and more.

The user terminal device can provide various contents such as multimedia contents, application screens, and the like at the request of the user. The user can select a function to use by using a button or a touch screen provided in the user terminal. The user terminal device can selectively execute the program according to the interaction with the user and display the execution result.

On the other hand, as the functions that can be provided by the user terminal device are gradually diversified, a variety of needs have arisen for a method of displaying contents or a user interaction method. That is, since the method of displaying contents changes and the types and functions of contents greatly increase, the conventional interaction method of simply selecting a button or touching a touch screen is not sufficient to perform various functions of the user terminal May occur.

Accordingly, there is a need for a user interaction technique that allows a user to use a user terminal device in a more convenient manner.

An object of the present invention is to provide a user terminal and a display method thereof that can provide various functions according to a touch interaction sensed by at least one of a display unit and a bezel unit.

It is another object of the present invention to provide a user terminal and a display method thereof that can provide various functions according to a touch-touch interaction in which at least two sides of a bezel are touched.

According to an aspect of the present invention, there is provided a user terminal including: a display unit for displaying an image; A bezel portion for housing the display portion; A first touch sensing unit for sensing a user touch input to the display unit; A second touch sensing unit that senses a user touch input to the bezel unit; And a controller for performing a function of the type of the touch interaction and the function of the user terminal corresponding to the touched at least two sides when a touch interaction in which at least two sides of the bezel are touched is detected through the second touch sensing unit. .

When the touch interaction is detected to simultaneously touch the first side of the bezel and the second side adjacent to the first side while the image content is being displayed, the controller controls the first side and the second side to touch The display unit may be controlled to display information on the image content in a corner area between one point.

When the touch interaction is sensed by simultaneously touching the first side of the bezel and the second side adjacent to the first side, the control unit controls the corner area between the first side and the second side touching the second side, The control unit may control the display unit to display notification information of the user terminal.

When the touch interaction is simultaneously detected by touching the first side of the bezel and the third side located on the opposite side of the first side while the first application is being executed, The display unit may be divided into two regions, the execution region of the first application may be displayed in the first region, and the display region of the second application may be displayed in the second region.

The control unit zooms in on the photograph content when dragging is continuously dragged from the first side of the bezel to the second side adjacent to the first side while the photo content is being displayed, When the drag interaction is continuously detected from the first side to the third side adjacent to the first side, the display unit can be controlled to zoom out the photographic content.

The control unit may include a drag interaction for simultaneously dragging the first side of the bezel and the second side opposite to the first side while the photographic content is being displayed, and then dragging the two sides from the two touched points in opposite directions If so, the display unit can be controlled to rotate the photographic content.

When the swipe interaction for simultaneously sweeping the first side of the bezel and the second side adjacent to the first side is detected while the first application is being executed, The control unit may control the display unit to display an execution screen of the second application in the first area of the execution screen of the one application.

The controller touches a first side of the bezel which is in contact with the first area while the first application is executed in the first area and the second application is executed in the second area, The control unit may control the display unit to display the execution screen of the third application in the second area when the touch interaction to drag the second side abutted on the second area is detected.

According to another aspect of the present invention, there is provided a method of displaying a user terminal on a display unit and a bezel unit housing the display unit, ; And performing a function of the type of the touch interaction and the user terminal device corresponding to the touched at least two sides when a touch interaction that touches at least two sides of the bezel is sensed.

In the case where a touch interaction is simultaneously detected by touching a first side of the bezel and a second side adjacent to the first side while the image content is being displayed, the first side and the second side The information about the image contents can be displayed in the corner area between the points where the user touches the image.

In addition, the performing may include: when a touch interaction is detected that simultaneously touches a first side of the bezel and a second side adjacent to the first side, The notification information of the user terminal device can be displayed in the corner area.

The performing step may include a step of, when a touch interaction is detected that simultaneously touches a first side of the bezel and a third side opposite to the first side while the first application is being executed, The display unit may be divided into two areas according to the sides to display the execution screen of the first application in the first area and the execution screen of the second application in the second area.

The performing step may include zooming in on the photo content when a drag interaction is continuously detected from the first side of the bezel to the second side adjacent to the first side while the photo content is being displayed, When the drag interaction is continuously detected from the first side of the bezel to the third side adjacent to the first side, the photo content can be zoomed out.

The performing of the dragging may include dragging a first side of the bezel and a second side opposite to the first side at the same time while the photo content is being displayed, If an interaction is detected, the photo content can be rotated.

In addition, the performing may include: when a swipe interaction is simultaneously detected by swiping the first side of the bezel and the second side adjacent to the first side during the execution of the first application, The execution screen of the second application can be displayed in the first area of the execution screen of the first application.

The step of performing the step may include touching a first side of the bezel, which is in contact with the first area, while the first application is executed in the first area and the second application is being executed in the second area, And if the touch interaction for dragging the second side abutting on the second area is detected, the execution screen of the second application can be removed in the second area, and the execution screen of the third application can be displayed.

According to another aspect of the present invention, there is provided a user terminal comprising: a display unit for displaying an image; A bezel portion for housing the display portion; A first touch sensing unit for sensing a user touch input to the display unit; A second touch sensing unit that senses a user touch input to the bezel unit; And a second touch sensing unit that performs a first function of the user terminal when a first touch interaction for touching the display unit is detected through the first touch sensing unit and the first touch that touches the bezel unit through the second touch sensing unit, And a controller for performing a second function of the user terminal device when a second type of touch interaction of the same type as the interaction is detected.

When the drag interaction is detected through the first touch sensing unit during the execution of the gallery application, the control unit switches the screen on a file unit basis. When the drag interaction is detected through the second touch sensing unit, The display unit can be controlled to switch the screen.

When the drag interaction is detected through the first touch sensing unit while the e-book application is being executed, the control unit switches the screen in units of pages, and the drag interaction It is possible to control the display unit to switch the screen in units of chapters.

The controller scrolls the execution screen of the first application when a drag interaction is detected through the first touch sensing unit while the first application is being executed, and when the drag interaction is detected through the second touch sensing unit , It is possible to remove at least a part of the execution screen of the first application from the display screen and to control the display unit to display at least a part of the execution screen of the second application.

The control unit may zoom out the photo content when a pinch-in interaction in which the distance between two points touched through the first touch sensing unit is detected while the photo content is being displayed is detected, When the pinch-in interaction is detected through the sensing unit, the display unit can be controlled to display the folder list.

According to another aspect of the present invention, there is provided a method of displaying a user terminal on a display unit and a bezel unit housing the display unit, ; When a first touch interaction for touching the display unit is detected and a second touch interaction of the same type as the first touch interaction for touching the bezel unit is sensed, And performing a second function of the user terminal device.

If the dragging interaction is detected on the display unit while the gallery application is being executed, the performing of the dragging and dropping may switch the screen on a file unit basis. If dragging interaction is detected on the bezel unit, can do.

In addition, the step of performing the switching may include switching a screen in units of pages when a drag interaction is detected on the display unit while the e-book application is executed, and when a drag interaction is detected in the bezel unit , The screen can be switched in chapters.

If the dragging interaction is detected while the first application is being executed, the executing step scrolls the execution screen of the first application. If the dragging interaction is detected in the bezel, At least a part of the execution screen of the one application can be removed from the display screen and at least a part of the execution screen of the second application can be displayed.

In addition, the performing step may include zooming-out the photo content when a pinch-in interaction in which the distance between two points touched on the display unit is detected while the photo content is displayed, If a pinch-in interaction is detected, a folder list can be displayed.

According to various embodiments of the present invention as described above, the user can perform various functions of the user terminal by touching at least one of the display unit and the bezel unit.

1 is a block diagram schematically illustrating a configuration of a user terminal according to an embodiment of the present invention;
2 is a block diagram illustrating a detailed configuration of a user terminal according to an exemplary embodiment of the present invention.
3A to 3E are diagrams for explaining a user terminal device including a bezel portion capable of sensing a touch interaction according to an embodiment of the present invention;
4 is a diagram for explaining a configuration of software stored in a storage unit according to an embodiment of the present invention;
FIGS. 5A-B illustrate embodiments for performing various functions of a user terminal according to a touch interaction of touching one side of a bezel, according to various embodiments of the present invention;
15A-30 illustrate embodiments for performing various functions of a user terminal in accordance with a touch interaction that touches at least two sides of a bezel, according to various embodiments of the present invention;
FIGS. 31A and 31B are diagrams for explaining an embodiment of performing a function of a user terminal according to a touch interaction of touching a bezel when the user terminal is fully folded, according to an embodiment of the present invention;
32 to 35 are diagrams for explaining an embodiment in which a function mapped to a bezel is controlled when a user terminal is rotated according to an embodiment of the present invention,
36 and 37 are flowcharts illustrating a display method of a user terminal according to various embodiments of the present invention.

These embodiments are capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the disclosure disclosed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the claims. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise", "comprising" and the like are used to specify that there is a stated feature, number, step, operation, element, component, or combination thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In the embodiment, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which need to be implemented by specific hardware, and implemented by at least one processor (not shown) .

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. 1 is a block diagram briefly showing a configuration of a user terminal device 100 according to an embodiment of the present invention. 1, the user terminal 100 includes a display unit 110, a bezel 120, a first touch sensing unit 130, a second touch sensing unit 140, and a controller 150 . At this time, the user terminal device 100 may be implemented as various types of devices such as a TV, a PC, a laptop PC, a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, In the case of being implemented as a mobile type device such as a mobile phone, a tablet PC, a PDA, an MP3 player, a laptop PC, or the like, the mobile terminal may be referred to as a mobile terminal.

The display unit 110 displays various image data and a UI. In particular, the display unit 110 may be implemented as a touch screen in combination with the first touch sensing unit 130. [ In addition, the display unit 110 may be bent by bending lines corresponding to the plurality of hinge parts 120.

The bezel 120 is positioned at the edge of the display unit 110 to house the display unit 110. In particular, the bezel unit 120 may include a second touch sensing unit 140.

The first touch sensing unit 130 senses a touch interaction of the user input on the display unit 110. [ The second touch sensing unit 140 senses a touch interaction of a user input on the bezel 120. FIG.

The controller 150 controls the overall operation of the user terminal 100 according to the touch interaction sensed through the first touch sensing unit 130 and the second touch sensing unit 140. In particular, when a first touch interaction is sensed by touching the display unit 110 through the first touch sensing unit 130, the controller 150 performs a first function of the user terminal 100. When the second touch interaction of the same type as that of the first touch interaction that touches the bezel part 120 through the second touch sensing part 140 is detected, the control part 150 controls the operation of the user terminal 100 2 function can be performed. That is, the controller 150 can perform different functions according to the area where the touch interaction is sensed even if the same type of touch interaction is detected.

Specifically, when the drag interaction is detected through the second touch sensing unit 140, the controller 150 can switch the screen in a higher level than when the drag interaction is detected through the first touch sensing unit 130 have.

In one embodiment of the present invention, when a drag interaction is detected through the first touch sensing unit 130 during the execution of the gallery application, the control unit 150 controls the display unit 110 to switch the display screen in units of files Can be controlled. However, if a drag interaction is detected through the second touch sensing unit 140, the controller 150 may control the display unit 110 to switch the display screen in units of folders.

When the drag operation is detected through the first touch sensing unit 130 while the e-book application is being executed, the controller 150 controls the display unit 110 to switch the display screen in units of pages, Can be controlled. In addition, when the drag interaction is detected through the second touch sensing unit 140, the control unit 150 may control the display unit 110 to switch the screen in units of chapters.

In addition, when the drag interaction is detected through the first touch sensing unit 130, the control unit 140 can switch the screen within the application. However, when the drag interaction is detected through the second touch sensing unit 140 , The execution screen can be switched between a plurality of applications.

For example, when a drag interaction is detected through the first touch sensing unit 130 during the execution of the first application, the controller 150 controls the display unit 110 to scroll the execution screen of the first application . When the drag interaction is detected through the second touch sensing unit 140, the control unit 150 removes at least a part of the execution screen of the first application from the display screen and displays at least a part of the execution screen of the second application It is possible to control the display unit 110 to display it.

In addition, when a pinch-in interaction in which the distance between the two points touched through the first touch sensing unit 130 is detected while the photo content is being displayed, the controller 150 zooms out the photo content, When the pinch-in interaction is detected through the touch sensing unit 140, the control unit 150 may control the display unit 110 to display the folder list.

When a touch interaction is sensed by touching at least two sides of the bezel 120 with the second touch sensing unit 140, the controller 150 determines the type of the touch interaction, And can perform the function of the terminal device 100. [

Specifically, when a touch interaction is detected that simultaneously touches the first side of the bezel portion 120 and the second side adjacent to the first side while the image content is being displayed, the controller 150 controls the first side and the second side The display unit 110 may be controlled to display information on the image content in a corner area between points where the user touches the touch screen.

In addition, when a touch interaction is detected that simultaneously touches the first side of the bezel portion 120 and the second side adjacent to the first side, the controller 150 controls the corner between the first side and the second side, (E.g., received message information, missed call information, update information, and the like) of the user terminal device in the area.

When a touch interaction is detected that simultaneously touches the first side of the bezel 120 and the third side located on the opposite side of the first side while the first application is being executed, The display unit 110 is divided into two areas according to the sides connecting the first area and the second area, and an execution screen of the first application is displayed in the first area and an execution screen of the second application different from the first application is displayed in the second area The display unit 110 can be controlled. At this time, the second application may be an application related to the first application. For example, if the first application is a phone application, the second application may be a memo application or a calendar application associated with the phone application.

When the dragging interaction is continuously detected from the first side of the bezel 120 to the second side adjacent to the first side while the photographic content is being displayed, the controller 150 zooms in the photographic content, The control unit 150 may control the display unit 110 to zoom out the photographic content when a dragging interaction is continuously detected from the first side of the first part 120 to the third side adjacent to the first side. At this time, the amount of the zoom-in and zoom-out may be determined according to the number of sides of the bezel part 120 in which the drag interaction is detected or the length of the drag interaction.

Also, while the photo content is being displayed, a drag interaction is detected in which the first side of the bezel portion 120 and the second side located on the opposite side of the first side are touched simultaneously, and then the opposite direction is dragged from the two touched points The control unit 150 may control the display unit 110 to rotate the photographic content. At this time, the rotation direction of the photographic content can be determined according to the direction of the drag interaction.

When a swipe interaction is simultaneously detected by swiping the first side and the second side adjacent to the first side of the bezel 120 while the first application is being executed, The display unit 110 may be controlled to display an execution screen of the second application in the first area of the execution screen of the first application.

In addition, the display screen is divided so that the first application is executed in the first area, the first side of the bezel part 120 touching the first area is touched while the second application is executed in the second area, The controller 150 controls the display unit 110 to display the execution screen of the third application in the second area, and to display the execution screen of the third application in the second area, if the touch interaction is detected can do.

According to various embodiments of the present invention as described above, the user can receive various functions of the user terminal device 100 according to the touch interaction sensed by the bezel part 120. [

Hereinafter, the present invention will be described in more detail with reference to FIG. 2 to FIG. FIG. 2 is a block diagram illustrating a detailed configuration of a user terminal 200 according to an embodiment of the present invention. 2, the user terminal 200 includes an image receiving unit 210, an image processing unit 220, a display unit 230, a bezel unit 235, a communication unit 240, a storage unit 250, An audio processing unit 260, a speaker unit 270, a sensing unit 280, and a control unit 290.

FIG. 2 is a view illustrating various components in a case where the user terminal 200 is a device having various functions such as a content providing function, a display function, and the like. Therefore, depending on the embodiment, some of the components shown in Fig. 2 may be omitted or changed, and other components may be further added.

The image receiving unit 210 receives image data through various sources. For example, the image receiving unit 210 can receive broadcast data from an external broadcasting station, receive VOD data in real time from an external server, and receive image data from an external device.

The image processing unit 220 is a component that performs processing on the image data received by the image receiving unit 210. The image processor 220 can perform various image processes such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on image data.

The display unit 230 displays at least one of a video frame processed by the image processing unit 220 and various screens generated by the graphic processing unit 293. In one embodiment of the present invention, the display portion 230 may be embodied as a flexible display that can be folded, but this is merely an example and can be implemented with other displays.

The bezel portion 235 is located at the edge of the display portion 230 to house the display portion 230. In particular, the bezel portion 235 may be positioned at the four edges of the display portion 230, as shown in FIG. 3A. The display unit 230 and the bezel unit 235 may be folded by the folding line 310, as shown in FIG. At this time, the folding line 310 may be a line folded by the hinge part.

The communication unit 240 is configured to perform communication with various types of external devices according to various types of communication methods. The communication unit 240 includes a Wi-Fi chip 241, a Bluetooth chip 242, a wireless communication chip 243, and an NFC chip 244. The control unit 290 communicates with various external devices using the communication unit 240. [

In particular, the Wi-Fi chip 241 and the Bluetooth chip 242 perform communication using the WiFi method and the Bluetooth method, respectively. When the WiFi chip 241 or the Bluetooth chip 242 is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip 243 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution) The NFC chip 244 is a chip operating in an NFC (Near Field Communication) mode using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, 2.45 GHz,

The storage unit 250 may store various programs and data necessary for the operation of the user terminal device 200. More specifically, the storage unit 250 is provided with a main area and

Programs and data for configuring various screens to be displayed in the sub area can be stored. Hereinafter, the structure of the software stored in the user terminal 200 will be described with reference to FIG. 4, software including the OS 410, the kernel 420, the middleware 430, and the application 440 may be stored in the storage unit 250.

An operating system (OS) 410 functions to control and manage the overall operation of the hardware. That is, the OS 410 is a layer that performs basic functions such as hardware management, memory, and security.

The kernel 420 serves as a channel for transmitting various signals including the touch signal detected by the display unit 230 to the middleware 430.

The middleware 430 includes various software modules for controlling the operation of the user terminal device 200. 4, the middleware 430 includes an X11 module 430-1, an APP manager 430-2, a connection manager 430-3, a security module 430-4, a system manager 430-5, A multimedia framework 430-6, a UI framework 430-7, a window manager 430-8, and a handwriting recognition module 430-9.

The X11 module 430-1 is a module for receiving various event signals from various hardware provided in the user terminal device 200. [ Here, an event can be variously set, such as an event in which a user gesture is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 430-2 is a module for managing the execution state of various applications 440 installed in the storage unit 250. [ When an application execution event is detected from the X11 module 430-1, the APP manager 430-2 calls and executes an application corresponding to the event.

The connection manager 430-3 is a module for supporting a wired or wireless network connection. The connection manager 430-3 may include various detailed modules such as a DNET module, a UPnP module, and the like.

The security module 430-4 is a module that supports certification for hardware, permission permission, and secure storage.

The system manager 430-5 monitors the status of each component in the user terminal device 200 and provides the monitoring result to the other modules. For example, when a remaining battery level is low, an error occurs, a communication connection state is lost, or the like, the system manager 430-5 transmits the monitoring result to the main UI framework 430-7 or the sub UI frame Work 430-9 to output a notification message or a notification sound.

The multimedia framework 430-6 is a module for reproducing the multimedia contents stored in the user terminal 200 or provided from an external source. The multimedia framework 430-6 may include a player module, a camcorder module, a sound processing module, and the like. Accordingly, various multimedia contents can be reproduced to generate and reproduce a screen and sound.

The main UI framework 430-7 is a module for providing various UIs to be displayed in the main area of the display unit 230. The sub UI framework 430-9 provides various UIs to be displayed in the sub area . The main UI framework 430-7 and the sub UI framework 430-9 include an image composer module for composing various objects, a coordinate synthesizer for calculating coordinates to be displayed on the object, A 2D / 3D UI toolkit that provides a tool for constructing a UI in 2D or 3D form, and the like.

The window manager 430-8 can detect touch events or other input events using the user's body or pen. When this event is detected, the window manager 430-8 delivers an event signal to the main UI framework 430-7 or the sub UI framework 430-9 to perform an operation corresponding to the event.

In addition, when the user touches and drags the screen, the pitch angle, the roll angle, and the yaw angle are calculated based on the handwriting module for drawing the line according to the drag trajectory or the sensor value sensed by the motion sensing portion 282 Various program modules such as an angle calculation module for controlling the angle of view and the like may be stored.

The application module 440 includes applications 440-1 to 440-n for supporting various functions. For example, a program module for providing various services such as a navigation program module, a game module, an e-book module, a calendar module, an alarm management module, and the like. These applications may be installed by default or may be installed and used arbitrarily by the user during use. When the object is selected, the main CPU 294 can execute the application corresponding to the selected object using the application module 440. [

The software structure shown in Fig. 4 is merely an example, and is not necessarily limited to this. Therefore, it goes without saying that parts may be omitted, modified, or added as necessary. For example, the storage unit 250 may include a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, an SMS (Short Message Service) & MMS (Multimedia Message Service) program, an e-mail program, (Call Info Aggregator) program module, a VoIP module, a web browser module, and the like may be additionally provided.

Referring again to FIG. 2, the audio processing unit 260 is a component that performs processing on audio data of image contents. In the audio processing unit 260, various processes such as decoding and amplification of audio data, noise filtering, and the like may be performed. The audio data processed by the audio processing unit 260 may be output to the audio output unit 270.

The audio output unit 270 outputs various kinds of audio data, such as decoding, amplification, and noise filtering, as well as various kinds of notification sounds and voice messages, by the audio processing unit 260. In particular, the audio output unit 270 may be implemented as a speaker, but it may be implemented as an output terminal capable of outputting audio data, which is only an example.

The sensing unit 280 senses various user interactions. 2, the sensing unit 280 includes a first touch sensing unit 281, a second touch sensing unit 282, a motion sensing unit 283, and a bending sensing unit 284 .

Specifically, the first touch sensing unit 281 may sense a touch interaction of a user using a touch panel attached to the back of the display panel. The second touch sensing unit 282 may be located at the bezel unit 235 to sense the touch interaction of the user. At this time, the first touch sensing unit 281 may be implemented by a touch sensor of an electrostatic or a voltage reduction type, and the second touch sensing unit 282 may be implemented by a proximity touch sensor. However, the first touch sensing unit 281 and the second touch sensing unit 282 may be implemented with various touch sensors.

Meanwhile, the second touch sensing unit 282 may be disposed in the entire area of the bezel unit 235, but it may be disposed in only a part of the area (for example, the corner area).

The second touch sensing unit 282 may be disposed only on the bezel unit 235 as shown in FIG. 3B. However, as shown in FIG. 3C, the bezel unit 235 And may be disposed over the bezel portion 235 and the display portion 230 as shown in FIG. 3D. In addition, when the display unit 230 is a flexible display, the second touch sensing unit 282 may be disposed in a region having a step with the display unit 230, as shown in FIG.

The motion sensing unit 283 may sense at least one of an acceleration sensor, a geomagnetic sensor, and a gyro sensor to detect motion (e.g., rotational motion) of the user terminal device 200. The bending sensing unit 284 may sense at least one of whether the user terminal 200 is folded and the folded angle based on the bending line using a bending sensor, an illuminance sensor, or the like. At this time, the bending sensing unit 283 may be positioned on the folding line.

The control unit 290 controls the overall operation of the user terminal 200 using various programs stored in the storage unit 250.

2, the control unit 290 includes a RAM 291, a ROM 292, a graphics processing unit 293, a main CPU 294, first through n interfaces 295-1 through 295-n, Bus 296. < / RTI > At this time, the RAM 291, the ROM 292, the graphic processor 293, the main CPU 294, the first through n interfaces 295-1 through 295-n, etc. may be connected to each other via the bus 296 .

The ROM 292 stores a command set for booting the system and the like. When the turn-on command is input and power is supplied, the main CPU 294 copies the O / S stored in the storage unit 250 to the RAM 291 according to the instruction stored in the ROM 292, To boot the system. When the booting is completed, the main CPU 294 copies various application programs stored in the storage unit 250 to the RAM 291, executes the application program copied to the RAM 291, and performs various operations.

The graphic processing unit 293 generates a screen including various objects such as an item, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The arithmetic unit calculates an attribute value such as a coordinate value, a shape, a size, and a color to be displayed for each object according to the layout of the screen using the control command received from the sensing unit 280. [ The rendering unit generates screens of various layouts including the objects based on the attribute values calculated by the operation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 230.

The main CPU 294 accesses the storage unit 250 and performs booting using the O / S stored in the storage unit 250. [ The main CPU 294 performs various operations using various programs, contents, data stored in the storage unit 250, and the like.

The first to n-th interfaces 295-1 to 295-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

In particular, the controller 290 controls the overall operation of the user terminal 200 according to the user's touch interaction sensed through the second touch sensing unit 282.

< The display unit 230  Touch Interaction  And The bezel portion 235  Touch Of the interaction  Distinction>

The controller 290 may perform a different function depending on the area of the bezel 235 in which the touch interaction is sensed when the touch interaction is detected by touching the bezel 235 through the second touch sensing unit 282 have.

5A, when the tab interaction 510 that taps the base of the bezel portion 235 is detected while the gallery application for displaying the photo content is being executed, The display unit 230 may be controlled to display the home menu 520 in the lower right area of the display unit 230 as shown in the right side of FIG. 5A according to the interaction 510. In this case, when the user terminal device 200 is in the form of a square, the base of the bezel 235 may refer to the base of the image content displayed on the display 230. The home menu 520 displayed on the lower right side of the display unit 230 may include a home icon, a back icon, another window view icon, and the like.

5B, when the tab interaction 530 that taps the right side of the bezel portion 235 is detected while the gallery application for displaying the photo content is being executed, The display unit 230 may be controlled to display an edit menu 340 for editing the photo content in the right area of the display unit 230 as shown in the right side of FIG. 5B according to the interaction 530.

5A and 5B, the controller 290 may control the display unit 230 to display a menu that performs a different function according to a region to be touched by the bezel 235.

The control unit 290 controls the bezel unit 235 when the first tab interaction for tapping the display unit 230 is detected through the first touch sensing unit 281 and the second tab interaction is detected through the second touch sensing unit 232 If a tapping second tap interaction is detected, each can perform a different function.

Specifically, when the tab interaction 610 is tapped on the first item while the screen 600 including a plurality of items is displayed, as shown on the left side of FIG. 6A, the control unit 290 controls the tab interaction The display unit 230 may be controlled to display the display screen 620 corresponding to the first item, as shown on the right side of FIG.

6B, when a tab interaction 630 that taps the right side of the bezel portion 235 is detected while the screen 600 including a plurality of items is displayed, the controller 290 May control the display unit 230 to display a screen 600 'in which the screen 600 is rotated 90 degrees counterclockwise as shown in the right side of FIG. 6B according to the tap interaction 630 .

6C, when a tab interaction 640 that taps the right side of the bezel 235 twice consecutively while a screen 600 including a plurality of items is displayed is detected, The control unit 290 displays an execution screen 650 of the application associated with the currently executed application and a screen in which the screen 600 is rotated by 90 degrees counterclockwise as shown in the right side of FIG. 6C according to the tap interaction 640 The display unit 230 may be controlled to simultaneously display the display unit 600 '.

When a user interaction that touches a plurality of points of the bezel unit 235 is detected while a specific application is being executed, the controller 290 can perform a quick access function frequently used according to an application. For example, as shown in the left side of FIG. 7, a user interaction that simultaneously taps two points 710-1 and 710-2 on the left side of the bezel portion 235 while the execution screen 700 of the gallery application is displayed If it is detected, the controller 290 displays a window 720 for performing the SNS sharing function, as shown in the right side of FIG. 7, in order to perform a function frequently used by the user in the gallery application, The display unit 230 can be controlled.

When a drag interaction is detected in the bezel unit 235 through the second touch sensing unit 282, the controller 290 controls the display unit 230 to display a drag event in an upper depth unit (for example, , A folder unit).

8, when the first photo content 810 stored in the first folder is displayed in the gallery application, the second touch information is displayed on the bottom of the bezel part 235 through the second touch sensing part 282, The control unit 290 displays a UI 830 on which a thumbnail image is displayed on a folder basis, as shown in the center of FIG. 8, when a drag interaction 820 is detected, The display unit 230 can be controlled. 8, the control unit 290 may control the display unit 230 to display the second photo content 840 stored in the second folder, which is different from the first folder.

As another example, as shown in FIG. 9A, one point of the display unit 230 is touched through the first touch sensing unit 281 while the e-book application is executed, and then dragged to the left direction When the drag interaction 910 is detected, the control unit 290 can control the display unit 230 to display the next page according to the drag interaction 910. [ That is, when a drag interaction 910 is detected on the display unit 230, the control unit 290 can switch the screen of the e-Book contents in units of pages.

However, as shown in FIG. 9B, during the execution of the e-Book application, a drag interaction in which one point of the bezel portion 235 is touched through the second touch sensing portion 282 and then dragged in the left direction, The control unit 290 displays the UI 930 for guiding the chapter of the e-Book content according to the drag interaction 910 and displays the first page of the next chapter on the display unit 230, Can be controlled. That is, when the drag interaction 920 is detected in the bezel unit 235, the control unit 290 can switch the screen of the e-Book contents in chapters having a higher depth than the page unit.

The control unit 290 detects a dragging interaction with the bezel unit 235 through the second touch sensing unit 282 and a dragging interaction with the display unit 230 through the first touch sensing unit 281 It is possible to perform different functions.

Specifically, as shown in FIG. 10A, a drag interaction 1010 for touching one point of the display unit 230 through the first touch sensing unit 281 while dragging the upward direction is performed while the news content is displayed The control unit 290 may control the display unit 230 to scroll the news content downward in the same news content according to the drag interaction 1010. [

When a drag interaction 1020 is detected by touching one side of the base of the bezel 235 through the second touch sensing unit 282 while dragging the left side of the bezel unit 235 while the news content is being displayed, May control the display unit 230 to display the history UI 1030 that includes the web page that the user has recently visited, as shown in FIG. 10B, according to the drag interaction 1020. At this time, if one of the plurality of web pages included in the history UI 1030 is selected, the controller 290 can control the display unit 230 to display the selected web page on the full screen.

When the drag interaction 1040 for touching one side of the right side of the bezel part 235 through the second touch sensing part 282 and dragging the right side of the bezel part 235 in the upward direction is detected while the news content is being displayed, May control the display unit 230 to display a browsing UI 1050 that can browse currently executed applications, as shown in Figure 10C, according to the drag interaction 1040. [ At this time, when one of a plurality of applications included in the browsing UI 1050 is selected, the controller 290 can control the display unit 230 to display the execution screen of the selected application on the full screen.

In another embodiment, as shown in the right side of FIG. 11A, one point of the display unit 230 is flicked upward in the upward direction through the first touch sensing unit 281 while the execution image of the news application is being displayed The control unit 290 can control the display unit 230 to scroll the execution screen of the same news application downward according to the drag interaction 1110. [

However, as shown in the upper left portion of FIG. 11B, while the execution image of the news application is being displayed through the first application, one point of the right side of the bezel portion 235 is moved upwards through the second touch sensing portion 282 When the flicking flick interaction 1120 is detected, the control unit 290 controls the display unit 230 to display an execution screen of the music application, which is the third application, as shown in the upper right part of FIG. 11B in accordance with the flick interaction 1120 Can be controlled. That is, the control unit 290 can switch the execution screen between currently running applications through the flick interaction 1120.

In addition, a drag interaction 1130 that touches one side of the right side of the bezel part 235 through the second touch sensing part 282 and drags it downward while the execution screen of the music application as the third application is displayed The control unit 290 moves the execution screen of the music application downward as shown in the lower right part of FIG. 11B according to the drag interaction 1130 to display the execution screen of the news application together with the display unit 230 Can be controlled. While a part of the execution screen of the news application and a part of the execution screen of the music application are displayed together, one point on the base of the bezel part 235 is touched through the second touch sensing part 282, The control unit 290 displays a part of the execution screen of the music application and a part of the execution screen of the news application as shown in the lower left part of FIG. 11B according to the drag interaction 1140 The user can control the display unit 230 to display a part of the execution screen of the SNS application as the second application and a part of the execution screen of the memo application as the fourth application. That is, the control unit 290 moves the screen according to the drag amount of the drag interactions 1130 and 1140 through the drag interactions 1130 and 1140, displays an execution screen for a plurality of applications, . &Lt; / RTI &gt;

If a pinch interaction is detected in the bezel 235 through the second touch sensing unit 282, the control unit 290 detects a pinch interaction through the first touch sensing unit 281 on the display unit 230 And performs a different function than the case of

In general, during the display of the photographic content, the first touch sensing unit 281 touches two points of the display unit 230 and then touches the two touch points, If an out-of-interaction is detected, the control unit 290 can zoom-in or zoom-out the photo content according to a pinch-in or pinch-out interaction.

However, as shown in the upper part of FIG. 12, when two points of the bezel part 235 are touched through the second touch sensing part 282 while the picture contents 1210 are displayed, The control unit 290 may control the display unit 230 to display the folder screen 1220 including the photographic content as shown in the lower part of FIG. 12, when touching two points of the bezel part 235 through the second touch sensing part 282 while the folder screen 1220 is being displayed, When the pinch-out interaction is detected, the control unit 290 may control the display unit 230 to display the photo content 1210, as shown at the top of FIG.

Also, the controller 290 may touch at least one point of the bezel 235 to select or fix a portion of the display 230.

Specifically, as shown at the top of FIG. 13A, the first point 1310 of the bezel portion 235 is touched while the first to ninth thumbnail images 1310-1 to 1310-9 are displayed The control unit 290 controls the display unit 230 to move to the first position 1310 as shown in the lower part of FIG. 13A when the dragging interaction 1320 that touches one area of the display unit 230 and drags downward is detected The first thumbnail image 1310-1, the fourth thumbnail image 1310-4, and the seventh thumbnail image 1310-7 included in the corresponding first column are fixed, and a plurality 1310-2, 1310-5, 1310-6, 1310-8, and 1310-9 of the thumbnail images 1320-1 to 1320-6 can be changed to other thumbnail images 1320-1 to 1320-6. That is, when a drag interaction is sensed after touching one point 1310 of the bezel 235 corresponding to the first column, the controller 290 fixes the thumbnail image displayed in the first column and displays thumbnails displayed in other columns You can change the image to another thumbnail image.

While the editing screen for editing the photographic content is being displayed, as shown at the top of FIG. 13B, the two points 1330-1 and 1330-2 of the bezel 235 are touched, The control unit 290 controls the display unit 1340 to display the first dragged image 1340 selected by the two points 1330-1 and 1330-2, as shown in the lower part of FIG. 13B, The area 1350 may process the second area 1360 by applying another set value to the second area 1360 except for the first area 1350 while displaying the existing set value as it is, (230).

14A, while touching one point 1410 of the third application while touching the right side of the bezel 235 while the first application to the fourth application are simultaneously displayed, The control unit 290 can control the display unit 230 to fix the first application, the second application, and the fourth application and to scroll the third application in the upward direction when the dragging interaction 1420 to be dragged is detected have.

While the web page is displayed, as shown at the top of FIG. 14B, the two points 1430-1 and 1430-2 of the bezel 235 are touched, the bottom area of the web page is touched, The controller 290 determines that the first area 1450 selected by the two points 1430-1 and 1430-2 is the same as the drag area 1440 While controlling the display unit 230 to scroll the second areas 1460-1 and 1460-2 except for the first area 1450 to other areas according to the drag interaction 1440. [

< The bezel portion 235  Multi-touch input on multiple sides Interaction >

When two points of the bezel unit 290 are touched, the control unit 290 divides the display screen into a plurality of areas using two touched points to display different images in a plurality of areas, Can be controlled.

15A, the first point 1510-1 of the base of the bezel portion 235 and the second point 1510-2 of the right side of the bezel portion 235 are rotated In this case, the control unit 290 guides detailed information of the photographic content 1500 to a corner area defined by the first point 1510-1 and the second point 1510-2 The display unit 230 may be controlled to display the UI 1520. [ 15A, the control unit 290 collapses the picture contents 1500 by the touch interaction that touches the first point 1510-1 and the second point 1510-2, The display unit 230 may be controlled to display a UI 1520 that displays detailed information on the display unit 1500.

15B, the first point 1530-1 of the upper side of the bezel part 235 and the second point 1530-2 of the lower side may be connected to each other while the picture contents 1500 are being displayed, In the case of the touch interaction in which the user touches the set time, the controller 290 divides the display screen into two by the first point 1530-1 and the second point 1530-2 as shown in the lower part of FIG. 15B The display unit 230 may be controlled to display a portion 1510 'of the photographic content in the first region and an execution screen of the memo application in the second region related to the photographic content. That is, the controller 290 may enter the multi-tasking mode through the touch interaction that touches a plurality of points of the bezel 235.

16, the touch interaction in which the two points 1610 and 1620 of the bezel portion 235 are touched for a preset time through the second touch sensing portion 282 while the display screen is turned off If it is detected, the controller 290 can control the display unit 230 to turn on the display screen, as shown in the lower part of FIG. That is, power control of the display unit 230 can be performed through the multi-touch of the bezel unit 235.

17, the first point 1710 of the left side of the bezel portion 235 and the second point 1720 of the right side of the bezel portion 235 are touched for a preset time while the map application 1730 is displayed In the case of the touch interaction, the control unit 290 divides the display screen into two by the first point 170 and the second point 1720 as shown in the lower part of FIG. 17, The display unit 230 may display the web page 1730 'in the first area and the web page 1740 in the second area. At this time, the web page 1740 may be an application executed before the map application 1730 is executed. That is, the control unit 290 can divide the screen through the touch interaction that touches a plurality of points of the bezel unit 235.

Also, the controller 290 may enlarge or reduce the screen currently displayed through a drag interaction in which a plurality of sides of the bezel 235 are dragged.

18, when a drag interaction for dragging in a clockwise direction is sensed after touching one point on the left side of the bezel 235, as shown in the upper part of FIG. 18, when the photo content 1810 is displayed, The control unit 290 can control the display unit 230 to display the photographic contents 1810 'and 1810' 'in accordance with the drag interaction, as shown in the middle and bottom of FIG.

When a drag interrupting flash is detected by touching a point on the bezel 235 while the photo content 1810 is being displayed, the control unit 290 reduces the drag operation according to the drag interaction, And may control the display unit 290 to display the content.

The control unit 290 can adjust the number of images displayed on the display unit 230 through a drag interaction in which a plurality of sides of the bezel unit 235 are dragged.

19, when a screen 1910 including nine images is touched at one point on the left side of the bezel 235 and then clockwise to the upper side of the bezel 235 The control unit 290 can control the display unit 230 to display the screen 1920 including four images out of the nine images as shown in the middle of Fig. 19 have. When the dragging interaction is continued to the right side of the bezel part 235, the control part 290 displays the screen 1930 including one image of the four images, as shown in the lower part of Fig. The control unit 230 can be controlled. In contrast, the control unit 290 may increase the number of images displayed on the display unit 230 according to the counterclockwise dragging interaction with the bezel unit 235.

In addition, the controller 290 can turn on the display unit 230 according to the dragging interaction inputted to two or more sides of the bezel 235. [

20, when touching one point on the right side of the bezel 235 in the power off state 2010 of the display unit 230 and then moving the bezel unit 235 in the clockwise direction, The controller 290 controls the display unit 2030 to display time information in the first area 2020 of the display screen according to the drag interaction, as shown in the upper right part of FIG. 20 230). When the dragging interaction is continued to the left side of the bezel part 235, the controller 290 displays time information and frequently used applications in the second area 2030 of the display screen, as shown in the bottom right of FIG. The display unit 230 may be controlled to display the shortcut icons together. When the dragging interaction is continued to the right side of the bezel 235, the controller 290 can control the display unit 230 to turn on the entire screen as shown in the lower left of FIG. That is, the control unit 290 can gradually turn on the display unit 230 through the drag interaction inputted to two or more sides of the bezel unit 235.

In addition, the controller 290 can search for a plurality of images through a drag interaction in which a point on each of two sides of the bezel 235 is touched and dragged at the same time.

21, touching one side of the right side and the base of the bezel part 235 through the second touch sensing part 282 while the first image 2110 is being displayed When the drag interactions 2120-1 and 2120-2 for dragging the two touch points are detected, the controller 290 controls the second image 2110 'in addition to the first image 2110' The display unit 230 may be controlled to display the image 2130. [ The control unit 290 displays the first image 2110 '', the second image 2130 ', and the second image 2130', as shown in the lower part of FIG. 21, And the third image 2140 of the display unit 230 at the same time. At this time, the first image 2110, the second image 2130, and the third image 2140 may be photographs having similar colors, photographs of the same person, or photographs taken on the same date.

Also, the controller 290 may rotate the screen using a drag interaction that simultaneously touches one side of opposite sides of the bezel 235 and then drags the opposite direction.

More specifically, as shown in the upper part of FIG. 22, while a picture content 2200 is being displayed, a point on the left side of the bezel part 235 is touched through the second touch sensing part 282, When the first drag interaction 2210-1 touching one side of the right side of the bezel part 235 and the second drag interaction 2210-2 dragging in the downward direction are simultaneously detected, the control unit 290 The display unit 230 can be controlled to display the photo content 2200 'rotated 90 degrees in the clockwise direction in accordance with the first drag interaction 2210-1 and the second drag interaction 2210-2.

In addition, the controller 290 may perform various functions of the user terminal through the swipe interaction that simultaneously sweeps the first side of the bezel 235 and the second side adjacent to the first side.

23, while touching one side of the right side and the base of the bezel part 235 through the second touch sensing part 282 while the gallery application 2310 is being displayed, When the swipe interaction 2310-1 or 2310-2 is swiped to approach one or two points, the control unit 290 may display the Internet application 210 in addition to the gallery application 2310 ' The controller 230 may control the display unit 230 to display the display unit 2320. The controller 290 divides the display screen into the gallery application 2130 &quot; and the Internet 2130 &quot;, as shown in the lower part of Fig. 21, The display unit 230 may be controlled to simultaneously display the application 2320 '. Thereby, the control unit 290 can enter a multitasking mode in which a plurality of applications can be used simultaneously.

24A, while touching one side of the right side and the bottom side of the bezel part 235 through the second touch sensing part 282 while the photo content 2410 is being displayed, When a swipe interaction is detected such that the two points are close to each other, the control unit 290 displays the picture contents 2410 as a plurality of areas 2410-1 to 2410-5 And may control the display unit 230 to display and apply different image setting values to the plurality of areas 2410-1 to 2410-5.

As shown in the left side of FIG. 24B, while the UI 2420 in which the photo contents are sorted by day is displayed, the second touch detection unit 282 detects the right side of the bezel unit 235, The controller 290 displays a UI 2430 in which the photo contents are arranged in a monthly basis, as shown in the center of FIG. 24B, when a swapping swipe interaction is detected such that two points touched are touched The display unit 230 can be controlled. Touches one side of the right side and the bottom side of the bezel part 235 through the second touch sensing part 282 while the UI 2430 in which the photo contents are arranged on a monthly basis is displayed, When a swipe swipe interaction is detected, the control unit 290 may control the display unit 230 to display the UI 2440 in which the photo contents are arranged year by year, as shown in the right side of FIG. 24C.

24B, while the weather application is being executed and the screen 2450 for guiding the current weather is displayed, the right side of the bezel 235 through the second touch sensing unit 282, The controller 290 divides the display screen into three areas, as shown in the upper right part of FIG. 24C, when a swipe interaction is detected such that two points touched are touched after touching one point of the base The user can control the display unit 230 to display a screen 2460 that guides the morning, lunch, and evening weather. 24B, while the screen 2460 for navigating the morning, lunch, and evening is displayed, the right and left sides of the bezel portion 235 through the second touch sensing portion 282, The controller 290 divides the display screen into four areas, as shown in the bottom right of FIG. 24C, and displays the sweep area of the display screen for four days The display unit 230 may be controlled to display a screen 2470 for guiding the weather. 24B, while the screen 2470 for guiding the weather for four days is displayed, one point of the right side and the base of the bezel portion 235 is detected through the second touch sensing portion 282 When a swipe interaction is detected such that the two points touched after the touch are touched, the controller 290 divides the display screen into seven areas, as shown in the lower left part of FIG. 24C, And may control the display unit 230 to display the guidance screen 2470.

Meanwhile, in the above-described embodiment, a function performed when a swipe interaction is detected such that two points touched are touched after touching one point on the right and bottom sides of the bezel 235, When a swipe interaction is detected such that two points touched are touched after touching one point on the right side and the bottom of the bezel 235, the technical idea of the present invention can also be applied have. In this case, when a swipe interaction to sweep the touched two points away from the bezel portion 235 is detected after touching one side of the right side and the base of the bezel portion 235, the controller 290 controls the right side of the bezel portion 235 And touching one point of the base and then performing a function opposite to that performed when a swipe interaction is detected such that the two points touched are close to each other.

When a swipe interaction is detected such that two points touched are touched by touching one point on the right side and the base of the bezel 235, the controller 290 displays notification information (E.g., a message reception notification, a missed call notification, an update notification, and the like).

Specifically, as shown in FIG. 25, while the moving image application 2500 is being displayed, one point on the right side and the bottom side of the bezel portion 235 is touched, and a swipe interaction The controller 290 displays the text message notification information in the corner area 2520 at the bottom right corner where the swipe interaction 2510-1 and 2510-2 are sensed The display unit 230 can be controlled. At this time, the size of the lower right corner area 2520 where the text message notification information is displayed may be changed according to the swipe amount of the swipe interaction 2510-1 and 2510-2.

In addition, the controller 290 can perform a scroll function at a different speed using various drag interactions input to the bezel 235. [

As shown in FIG. 26A, while a web page is being displayed, a drag interaction 2610 for touching a right side of the right side of the bezel part 235 through the second touch sensing part 282 and dragging the point in the upward direction is detected The control unit 290 may control the display unit 2330 to scroll the web page at the first speed.

26B, while touching one point of the base of the bezel 235 through the second touch sensing unit 282 while the web page is being displayed, one point of the right side of the bezel 235 The controller 290 may control the display unit 2330 to scroll the web page at a second rate twice as fast as the first rate if the drag interaction 2620 is detected .

26B, while touching one side of the right side and the bottom side of the bezel part 235 through the second touch sensing part 282 while the web page is being displayed, When the drag interaction 2630 to be dragged is detected, the controller 290 can control the display unit 2330 to scroll the web page at a third speed four times faster than the first speed.

The controller 290 can provide a multitasking function through a case where a swiping interaction for swiping after touching two sides touching each other is detected.

Specifically, as shown in the upper part of FIG. 27A, while the first application 2710 is being displayed, one point of the bottom side and the right side of the bezel part 235 are touched through the second touch sensing part 282, respectively When the swipe interactions 2720-1 and 2720-2 are swiped to approach each other, the control unit 290 detects the swipe interaction 2720-1 and 2720-2 as shown in the lower part of Fig. 27A according to the swipe interaction 2720-1 and 2720-2 Likewise, the size of the first application 2710 'may be reduced and the display unit 230 may be controlled to display the second application 2730. The size of the reduced first application 2710 'may be changed to correspond to the swipe interaction.

As shown in the upper part of FIG. 27B, while the third application 2740 is being displayed, one point of the bottom side and the right side of the bezel part 235 are touched through the second touch sensing part 282, When the swipe interactions 2750-1 and 2750-2 for swiping away are detected, the control unit 290 controls the swipe interaction as shown in the lower part of FIG. 27B according to the swipe interaction 2720-1 and 2720-2 , And control the display unit 230 to enlarge and display the fourth application 2760 on the third application 2740 '. The size of the enlarged fourth application 2760 may be changed to correspond to the swipe interaction.

The controller 290 can provide a multitasking function through a drag interaction that simultaneously touches opposite sides and then drags in the same direction.

28A, while touching the left side and the right side of the bezel part 235 through the second touch sensing part 282 while the map application 2810 is being displayed, The controller 290 causes the gallery application 2830 to come down from the top of the display screen in accordance with the drag interactions 2820-1 and 2820-2. The user can control the display unit 230 to simultaneously display the map application 2810 'and the gallery application 2830 as shown at the bottom of FIG. 28A.

28B, the display screen is divided into two areas, the map application 2840 is displayed on the left area, and the second touch sensing part 2850 is displayed on the right area while the gallery application 2850 is displayed (2860-1) of one side of the left side of the bezel part (235) through the touch panel (282), and when a drag interaction 2860-2 for touching one side of the right side and dragging in the upward direction is sensed, 290 controls the display unit 230 so that the Internet application 2870 comes from the bottom of the display screen in accordance with the drag interaction 2860-2 so that the gallery application 2850 'and the Internet application 2870 at the same time.

29, a first drag interaction 2910 for dragging one point of each of the upper and left sides of the bezel portion 235 while the application screen 2900 is displayed, -1) and the second drag interaction 2910-2, which touches one point of each of the base side and the right side of the bezel part 235 and is dragged to be close to each other, are simultaneously detected, As shown in the middle, a tweaking image effect is provided to the application screen 2900 according to the first drag interaction 2910-1 and the second drag interaction 2910-2, As shown, application screen 2900 can be captured after returning to application screen 2900. At this time, the display unit 230 may be controlled to display the UI 2920 indicating that the application screen 2900 is stored in the returned application screen 2900.

30, the display screen is divided into two areas, the gallery application 3010 is displayed in the left area, and the second touch sensing part 3010 is displayed in the right area while the memo application 3020 is displayed When a dragging interaction 3030-2 for touching one side of the left side of the bezel part 235 and touching one side of the right side is dragged in the upward direction, 290 may control the display unit 230 to display the map application 3010 displayed on the right area and display the map application 3040 on the left area as shown on the right side of FIG. At this time, the map application 3040 may be the most recently executed application before the gallery application 3010 and the memo application 3020 are executed. Accordingly, the control unit 290 can switch the application displayed in one area of the display unit 230 to another application through the touch interaction 3030-1 and the drag interaction 3030-2.

<Other Bezel Interaction >

The control unit 290 may control the speaker unit 270 to output a telephone reception tone when a telephone call request is received from the outside while folding the user terminal apparatus 200 in a square form . 31A, when the tab interaction for tapping the bezel 235 is detected, the control unit 290 receives the telephone call and controls the speaker unit 270 to output the telephone call sound. In this case, can do. When a drag interaction is detected in which a long side is touched and dragged in the upward direction as shown in the middle of FIG. 31A, the controller 290 increases the volume of the telephone call sound The speaker unit 270 can be controlled.

In another embodiment, when a text message is received from the outside while folding the user terminal device 200 in a square form, the control unit 290 controls the speaker unit 270 to output a notification that a message is received Can be controlled. 31B, when a tab interaction for tapping one area of the bezel 235 is detected, the controller 290 performs a TTS (TEXT-TO-SPEECH) conversion on the received text message It is possible to control the speaker unit 270 to output the audio through the speaker unit 270. [ 31B, when a drag interaction is detected in which a long side is touched and dragged in an upward direction, the control unit 290 controls the display unit to display a text message It is possible to control the speaker unit 270 to increase the volume of the corresponding audio.

When the user terminal device 200 has a square shape, the controller 290 can maintain the main control area at the base, which is easy for the user to access even if the user terminal device 200 is rotated.

32A, the second touch sensing unit 282 of the user terminal 200 may include a right lower end region 3210 and a left upper end region 3220 of the bezel unit 235. In this case, As shown in FIG. At this time, if a touch interaction is detected in the lower right end area 3210, the controller 290 can perform a main control function (for example, a home menu call, an application control menu call, and the like). If the touch interaction is detected in the upper left area 3220, the controller 290 may perform a sub control function (for example, an additional function of the currently executed application).

32B, when the second touch sensing unit 282 is disposed in the right lower end region 3210 and the left upper end region 3220, the user terminal device 200 is rotated clockwise 90 The control unit 290 performs a main control function when the touch interaction is detected in the left lower region 3210. When the touch interaction is detected in the upper right region 3220, Function can be performed.

In another embodiment, the second touch sensing portion 282 of the user terminal 200 may be disposed in the entire region of the bezel portion 235. At this time, when the touch interaction is detected in the lower right area 3230, the control unit 290 can perform a main control function (for example, a home menu call, an application control menu call, and the like). When the touch interaction is detected in the upper left area 3240, the control unit 290 can perform a sub control function (for example, an additional function of the currently executed application).

When the user interaction device 200 is rotated 90 degrees clockwise as shown in FIG. 32C, and the touch interaction is detected in the right lower region 3230 ', the controller 290 controls the main control When the touch interaction is detected in the upper left area 3240 ', the controller 290 can perform a sub control function.

According to the embodiment described above, even if the user terminal device 200 rotates, the touch area for controlling the main control function can be continuously positioned at the base.

When a touch interaction is sensed by touching the bezel 235 through the second touch sensing unit 282 and a shake interaction is sensed by the movement sensing unit 283 to shake the user terminal 200, The controller 290 may perform a different function from the case where only the touch interlocking touching the bezel part 235 is detected through the second touch sensing part 282. [

Specifically, as shown in the left side of FIG. 33A, when the tap interaction 3310 is tapped to tap the base of the bezel portion 235 while the gallery application is being displayed, The display unit 230 can be controlled to switch the current screen to the home screen, as shown on the right side.

However, as shown in the upper part of FIG. 33B, while the gallery application is being executed, the tab interaction 3320 that taps the base of the bezel 235 is sensed and the user terminal 200 The control unit 290 displays a home menu 3330 including at least one icon in the corner area in which the tab interaction 3320 is detected as shown in the lower part of FIG. 33B The display unit 230 can be controlled. At this time, the home menu 3330 may include a home screen moving icon, a back home icon, another window viewing icon, a setting icon, and the like, as shown at the bottom of FIG. 33B.

In another embodiment, when a tab interaction 3410 is detected that taps the top of the left side of the bezel portion 235 while the gallery application is being displayed, as shown in the upper portion of Fig. 34A, the controller 290 May control the display unit 230 to display a plurality of images 3420 to which different attribute values are applied to the photo contents currently displayed at the lower end of the display unit 230, as shown in the lower part of FIG. 34A.

However, as shown in the upper part of FIG. 34B, while the gallery application is being executed, the tab interaction 3430 that taps the base of the bezel 235 is sensed and the user terminal 200 The control unit 290 displays a context including at least one icon for controlling the gallery application in the corner area where the tab interaction 3430 is detected, as shown in the lower part of FIG. 34B, The display unit 230 may be controlled to display the menu 3440. [ At this time, the home menu 3440 may include a previous photo content view icon, a next photo content view icon, an edit icon, a delete icon, and the like, as shown at the bottom of FIG. 34B.

35, while the first application 3500 is being displayed, the left side and the right side of the bezel part 235 are touched, and at the same time, the user terminal device The control unit 290 shrinks the first application 3500 as shown in the second part of FIG. 35, and the other application displays the screen 3510, which is stacked like a card, The display unit 230 can be controlled. 35, when the reduced first application and other applications touch the left side and the right side of the bezel part 235 while the screen 3510 on which the card is stacked like a card is displayed, The control unit 290 displays a screen 3520 in which the second application is located at the uppermost position, as shown in the third part of FIG. 35, when a shake interaction that confuses the user terminal device 200 is detected through the control unit 290. [ As shown in the third diagram of FIG. 35, the left side and the right side of the bezel portion 235 are displayed while the screen 3520 with the second application positioned at the uppermost position is displayed, When the user releases the touch on the right side, the control unit 290 displays the screen 3530 on which the second application is enlarged to the full screen, as shown in the fourth column of FIG. It is possible to control this part 230.

Hereinafter, a display method of the user terminal 200 according to an embodiment of the present invention will be described with reference to FIGS. 36 and 37. FIG. FIG. 36 is a flowchart illustrating an example of performing a different function when a touch interaction is detected on the display unit 230 and the bezel unit 235, respectively, according to an embodiment of the present invention.

First, the user terminal device 200 displays an image (S3610).

Then, the user terminal device 200 senses the touch interaction with the display unit 230 or the bezel unit 235 (S3620). At this time, the touch interaction may include at least one of a tap interaction, a drag interaction, a swipe interaction, and a pinch interaction.

When the touch interaction is detected in the display unit 230, the user terminal device 200 performs the first function (S3630). When the touch interaction is detected in the bezel unit 235, the user terminal device 200 And performs the second function (S3640). That is, the user terminal device 200 can perform different functions depending on whether the touch interaction is input to the display unit 230 or the bezel unit 235, even though the same type of touch interaction is input.

37 is a flowchart illustrating an embodiment for performing a function of the user terminal device 200 when a touch interaction is detected on a plurality of sides of the bezel portion 235 according to an embodiment of the present invention.

First, the user terminal device 200 displays an image (S3710).

Then, the user terminal device 200 determines whether a touch interaction for touching at least two sides of the bezel 235 is detected (S3720).

If a touch interaction is detected to touch at least two sides of the bezel part 235 (S3720-Y), the user terminal device 200 performs a function corresponding to the type of touch interaction and two sides touched (S3730) .

According to various embodiments of the present invention as described above, the user can perform various functions of the user terminal 200 by touching at least one of the display unit 230 and the bezel unit 235.

In addition, the display method of the user terminal according to the above-described various embodiments may be implemented as a program and provided to the user terminal. Specifically, a non-transitory computer readable medium may be provided in which a program including a control method of a user terminal apparatus is stored.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

110, 230: display unit 120, 235:
130: first touch sensing unit 140: second touch sensing unit
150, 290: control unit 210: image receiving unit
220: image processor 240: communication
250: storage unit 260: audio processing unit
270: Audio output unit 280:

Claims (26)

In a user terminal,
A display unit for displaying an image;
A bezel portion for housing the display portion;
A first touch sensing unit for sensing a user touch input to the display unit;
A second touch sensing unit that senses a user touch input to the bezel unit; And
And a controller for performing a function of the type of the touch interaction and the functions of the user terminal device corresponding to the touched at least two sides when a touch interaction is detected by touching at least two sides of the bezel through the second touch sensing part The user terminal device comprising: The method according to claim 1,
Wherein,
When a touch interaction that simultaneously touches the first side of the bezel portion and the second side adjacent to the first side is detected while the image content is displayed, a corner region between the first side and the second side touches the second side, Wherein the control unit controls the display unit to display information on the image content. The method according to claim 1,
Wherein,
When a touch interaction in which a first side of the bezel portion and a second side adjacent to the first side are simultaneously touched is detected in a corner region between the first side and the second side, And controls the display unit to display the notification information. The method according to claim 1,
Wherein,
When a touch interaction that simultaneously touches a first side of the bezel and a third side located on the opposite side of the first side is detected while the first application is being executed, And displays the execution screen of the first application in the first area and controls the display unit to display the execution screen of the second application in the second area. The method according to claim 1,
Wherein,
Zooming in on the photo content when a drag interaction is continuously detected from the first side of the bezel portion to the second side adjacent to the first side while the photo content is being displayed,
Wherein the control unit controls the display unit to zoom out the photographic content when a drag interaction is continuously detected from a first side of the bezel to a third side adjacent to the first side. The method according to claim 1,
Wherein,
When a drag interaction for dragging from the two touched points in opposite directions is sensed after simultaneously touching the first side of the bezel and the second side located opposite the first side while the photo content is being displayed, And controls the display unit to rotate the content. The method according to claim 1,
Wherein,
When a swipe interaction for simultaneously sweeping a first side of the bezel and a second side adjacent to the first side during the execution of the first application is detected, And controls the display unit to display an execution screen of the second application in the first area. The method according to claim 1,
Wherein,
The display screen is divided so that the first application is executed in the first area and the first side of the bezel which is in contact with the first area is touched while the second application is executed in the second area, And controls the display unit to display an execution screen of the third application in a case where a touch interaction for dragging the second side is detected by removing the execution screen of the second application in the second area. A display method of a user terminal capable of inputting a user's touch on a display unit and a bezel unit housing the display unit,
Displaying an image on the display unit; And
And performing a function of the type of the touch interaction and the user terminal device corresponding to the touched at least two sides when a touch interaction that touches at least two sides of the bezel is sensed. 10. The method of claim 9,
Wherein the performing comprises:
When a touch interaction that simultaneously touches the first side of the bezel portion and the second side adjacent to the first side is detected while the image content is displayed, a corner region between the first side and the second side touches the second side, Wherein the information about the image content is displayed on the display unit. 10. The method of claim 9,
Wherein the performing comprises:
When a touch interaction in which a first side of the bezel portion and a second side adjacent to the first side are simultaneously touched is detected in a corner region between the first side and the second side, And displaying the notification information. 10. The method of claim 9,
Wherein the performing comprises:
When a touch interaction that simultaneously touches a first side of the bezel and a third side located on the opposite side of the first side is detected while the first application is being executed, And displays an execution screen of the first application in the first area and an execution screen of the second application in the second area. 10. The method of claim 9,
Wherein the performing comprises:
Zooming in on the photo content when a drag interaction is continuously detected from the first side of the bezel portion to the second side adjacent to the first side while the photo content is being displayed,
And zooming out the photo content when a drag interaction is continuously detected from a first side of the bezel to a third side adjacent to the first side. 10. The method of claim 9,
Wherein the performing comprises:
When a drag interaction for dragging from the two touched points in opposite directions is sensed after simultaneously touching the first side of the bezel and the second side located opposite the first side while the photo content is being displayed, And rotating the content. 10. The method of claim 9,
Wherein the performing comprises:
When a swipe interaction for simultaneously sweeping a first side of the bezel and a second side adjacent to the first side during the execution of the first application is detected, And displays an execution screen of the second application in the first area. 10. The method of claim 9,
Wherein the performing comprises:
The display screen is divided so that the first application is executed in the first area and the first side of the bezel which is in contact with the first area is touched while the second application is executed in the second area, And when the touch interaction for dragging the second side is detected, the execution screen of the second application is removed in the second area, and the execution screen of the third application is displayed. In a user terminal,
A display unit for displaying an image;
A bezel portion for housing the display portion;
A first touch sensing unit for sensing a user touch input to the display unit;
A second touch sensing unit that senses a user touch input to the bezel unit; And
Wherein the first touch interaction unit performs a first function of the user terminal unit when a first touch interaction for touching the display unit through the first touch sensing unit is detected and the first touch interaction unit touches the bezel unit through the second touch sensing unit, And a controller for performing a second function of the user terminal when a second type of touch interaction of the same type as the first touch interaction is detected. 18. The method of claim 17,
Wherein,
When the drag interaction is detected through the first touch sensing unit during the execution of the gallery application, when the drag interaction is detected through the second touch sensing unit, And controls the display unit. 18. The method of claim 17,
Wherein,
When a drag interaction is detected through the first touch sensing unit while an e-book application is being executed, the screen is switched on a page basis. When a drag interaction is detected through the second touch sensing unit, Wherein the control unit controls the display unit to switch the screen in units of the display unit. 18. The method of claim 17,
Wherein,
When the drag interaction is detected through the first touch sensing unit during the execution of the first application, scrolling the execution screen of the first application, and when the drag interaction is detected through the second touch sensing unit, And controls the display unit to display at least a part of the execution screen of the second application on the display screen. 18. The method of claim 17,
Wherein,
When the pinch-in interaction in which the distance between the two points touched through the first touch sensing unit is detected while the photo content is being displayed, the photo content is zoomed out, and the pinch- And controls the display unit to display a folder list when an in-interaction is detected. A display method of a user terminal capable of inputting a user's touch on a display unit and a bezel unit housing the display unit,
Displaying an image on the display unit;
When a first touch interaction for touching the display unit is detected and a second touch interaction of the same type as the first touch interaction for touching the bezel unit is sensed, And performing a second function of the user terminal device. 23. The method of claim 22,
Wherein the performing comprises:
Wherein when the dragging interaction is detected on the display unit while the gallery application is being executed, the display unit switches the screen on a file unit basis, and when the dragging interaction is detected on the bezel unit, the screen is switched on a folder unit basis. 23. The method of claim 22,
Wherein the performing comprises:
When a drag interaction is detected on the display unit while the e-book application is executed, the screen is switched on a page basis. When a drag interaction is detected on the bezel unit, the screen is switched on a chapter-by-chapter basis &Lt; / RTI &gt; 23. The method of claim 22,
Wherein the performing comprises:
Wherein when a drag interaction is detected on the display unit during execution of the first application, the execution screen of the first application is scrolled, and when a drag interaction is detected in the bezel unit, Is removed from the display screen, and at least a part of the execution screen of the second application is displayed. 23. The method of claim 22,
Wherein the performing comprises:
When a pinch-in interaction in which the distance between two points touched on the display unit is detected while the photographic content is being displayed, the photographic content is zoomed out, and when the pinch-in interaction is detected in the bezel unit , And displays a folder list.

Images