KR20170022074A - Method of providing a user interfave and display apparatus according to thereof - Google Patents

Abstract

Provided is a method for providing a UI of a display apparatus which arranges based on a relative position of a display apparatus and an external apparatus. The method for providing a UI of a display apparatus comprises the steps of: displaying a UI including at least one UI element related to at least one external apparatus; determining a position of the at least one external apparatus on the display apparatus when a rearrangement command of the UI element is received; and rearranging and displaying the at least one UI element related to the at least one external apparatus based on the determined position.

Description

Technical Field [0001] The present invention relates to a UI providing method and a display device using the UI,

The present invention relates to a UI providing method and a display apparatus using the same, and more particularly, to a UI providing method for determining a position of at least one external device and arranging UI elements based on the determined position, and a display device .

Recently, as the Internet of Thing technology rapidly develops, various applications related to IoT devices are being developed. In addition, a variety of applications have been used in various display devices such as smart phones and tablet PCs, and dozens of applications are installed in one display device.

However, there are not many ways to sort a large number of applications. For example, the method is limited to a method of arranging in the order in which the display devices are installed, a method of sorting the applications in the order of names, and a method of sorting in order of the recently used applications.

As described above, the method of arranging the application can not intuitively search the application desired by the user of the display device, and the user of the display device inconveniently consumes some time to search for the application related to the IoT device .

SUMMARY OF THE INVENTION The present invention has been conceived to solve the above-described problems, and it is an object of the present invention to provide a UI providing method of arranging a UI element related to an external device close to a display device based on a relative position of a display device and an external device And a display device using the same.

According to an aspect of the present invention, there is provided a method of providing a UI of a display device, the method comprising: displaying a UI including at least one UI element associated with at least one external device; Determining a position of the at least one external device with respect to the display device when a relocation instruction of the UI element is input; And a second display step of rearranging and displaying the at least one UI element related to the at least one external device based on the determined position.

In the second display step, the first UI element may be disposed such that the distance between the first external device and the first UI element corresponding to the first external device is the shortest distance.

In addition, the UI element corresponding to the external device may be an application icon for controlling the external device.

The determining may include obtaining a distance between the display device and each of the plurality of external devices when a plurality of external devices are located in the same direction; And

And determining only the position of one external device closest to the display device among the plurality of external devices.

In addition, the position of the at least one external device can be determined based on the position of the display device when the UI element rearrangement command is input.

In the second display step, when a plurality of external devices are located in the same direction, UI elements associated with external devices that are far from the display device may be displayed on the edge of the display screen.

In addition, in the second display step, when one UI element is related to a plurality of external devices, the one UI element may be arranged and displayed in the average direction of the plurality of external devices.

If the plurality of UI elements are related to one external device, the second display step may display the plurality of UI elements on a side of the external device in a line.

According to another aspect of the present invention, there is provided a display device including: a display unit for displaying a UI including at least one UI element associated with at least one external device; And a UI element rearrangement instruction is input, the control unit determines the position of the at least one external device with respect to the display device, and based on the determined position, the at least one UI device associated with the at least one external device And controlling the display unit to rearrange and display the display unit.

The controller may control the display unit to arrange and display the first UI element so that the first UI element corresponding to the first external device and the first UI element corresponding to the first external device have the shortest distance.

In addition, the UI element corresponding to the external device may be an application icon for controlling the external device.

When the plurality of external devices are located in the same direction, the control unit obtains the distance between the display device and each of the plurality of external devices, and acquires the distance between each of the plurality of external devices and one of the external devices It is possible to determine only the position of

Also, the controller may determine the position of the at least one external device based on the position of the display device when the UI element rearrangement command is input.

When the plurality of external devices are located in the same direction, the control unit may control the display unit to display the UI elements related to the external device, which are far from the display device, at the edge of the display screen.

The control unit may control the display unit to display and display the one UI element in an average direction of the plurality of external devices when one UI element is related to a plurality of external devices.

The control unit may control the display unit to display the plurality of UI elements arranged in a line on a side of a direction in which the external device is located, when the plurality of UI elements are related to one external device.

As described above, according to various embodiments of the present invention, a user can be provided with a UI for placing a UI element related to an external device closer to the display device more intuitively.

1 is a block diagram schematically showing a configuration of a display device according to an embodiment of the present invention;
FIG. 2 is a block diagram showing a detailed configuration of a display device according to an embodiment of the present invention;
FIGS. 3-7 illustrate various embodiments for arranging UI elements associated with one or more external devices according to the location of one or more external devices, according to various embodiments of the present invention,
FIG. 8 is a flowchart illustrating a UI providing method of a display apparatus, according to an embodiment of the present invention.

The terms used in the embodiments of the present invention will be briefly described, and these embodiments will be described in detail.

Although the terms used in the embodiments of the present invention have been selected in consideration of the functions of the present invention, the present invention is not limited thereto and can be varied depending on the intention or the precedent of the artisan skilled in the art, . Also, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, the meaning thereof will be described in detail in the description of the corresponding embodiments. Therefore, the terms used in the embodiments should be defined based on the meaning of the term, not on the name of a simple term, and on the contents of the embodiments throughout.

In an embodiment of the present invention, terms including ordinal numbers such as first, second, etc. may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

Further, in the embodiments of the present invention, the singular expressions include plural expressions unless the context clearly indicates otherwise.

Furthermore, in the embodiments of the present invention, terms such as "comprises" or "having ", etc. are intended to specify the presence of stated features, integers, steps, operations, elements, parts, or combinations thereof, Steps, operations, elements, components, or combinations of elements, numbers, steps, operations, components, parts, or combinations thereof.

Also, in the embodiments of the present invention, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which needs to be implemented by specific hardware, and may be implemented by at least one processor.

Further, in the embodiment of the present invention, when a part is referred to as being "connected" with another part, it is not limited to a case where it is " directly connected " And the like.

Also, in an embodiment of the present invention, the user input may include at least one of a touch input, a bending input, a voice input, a button input, and a multimodal input, but is not limited thereto.

Further, in the embodiment of the present invention, " application " refers to a set of computer programs designed to perform a specific task. In an embodiment of the invention, the application may be varied. But are not limited to, a gaming application, a video playback application, a map application, a memo application, a calendar application, a phonebook application, a broadcast application, a motion support application, a payment application, and a photo folder application.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, the present invention will be described with reference to the drawings. 1 is a diagram showing the configuration of a display device 100 according to an embodiment of the present invention. As shown in FIG. 1, the display device 100 includes a display unit 110 and a control unit 120. Meanwhile, the display device 100 according to an exemplary embodiment of the present invention can be implemented by various display devices such as a smart phone, a smart watch, a smart glass, a tablet PC, a notebook PC, and the like.

The display unit 110 outputs image data. In particular, the display unit 110 may display a UI including at least one UI element associated with at least one external device. At this time, at least one UI element related to the external device may be an application icon related to the external device. At least one UI element associated with an external device is an application icon associated with an external device is merely an example, and may be a widget icon or the like. In addition, the UI element can be represented by text, image, or the like, and can be displayed on the idle screen of the display device 100. [ In response to the UI element rearrangement command, the display unit 110 may relocate at least one UI element to correspond to a position of an associated external device.

The control unit 120 controls the overall operation of the display device 100. In particular, when the UI element rearrangement command is input, the control unit 120 can determine the position of at least one external device with respect to the display device 100. [ The control unit 120 may control the display unit 110 to rearrange and display at least one UI element related to at least one external device based on the determined position.

Specifically, the control unit 120 may control the display unit 110 to display a UI including at least one UI element related to at least one external device. At this time, at least one UI element may be an application icon associated with at least one external device. At least one UI element associated with an external device is an application icon associated with an external device, and the UI element may be a widget icon or the like. UI elements can be represented by text, images, etc., as well as icons. An application related to an external device may be an application used for controlling an external device, a recommended application for obtaining information necessary for using an external device, or an application having a record used when a user uses an external device. Alternatively, an application required for each user may differ depending on the characteristics of the external device, so that the application related to the external device may be an application designated by the user as an application related to the external device.

When the UI element rearrangement command is input, the controller 120 can determine the position of at least one external device with respect to the display device. Specifically, the controller 120 can determine the position of at least one external device based on the position of the display device 100 when the UI element rearrangement command is input. At this time, the position of the at least one external device may be a relative direction and a distance at which the external device is positioned based on the position of the display device 100. [

The control unit 120 may control the display unit 110 to relocate at least one UI element related to the external device based on the location of the at least one external device. Specifically, the control unit 120 may control the display unit 110 to rearrange the UI elements so that the UI elements related to the external device and the external device have the shortest distance. For example, when the first external device is disposed on the left side of the display device 100, the control unit 120 controls the display unit 110 to place the first UI element associated with the first external device on the left side of the display screen The control unit 120 can obtain the distance between the display device 100 and each of the plurality of external devices when a plurality of external devices are located in the same direction. The control unit 120 can determine only the position of one external device closest to the display device 100 among a plurality of external devices located in the same direction. The control unit 120 may control the display unit 110 to rearrange and display at least one UI element related to at least one external device based on the position of the closest one external device. For example, if it is determined that the first external device and the second external device exist in the left direction and that the first external device is closer to the display device 100 than the second external device, It is possible to control the display unit 110 to relocate only the UI elements corresponding to the UI elements to the left area of the display unit 110. [

When the first external device and the second external device are located in the same direction and the distance between the display device 100 and the first external device is longer than the distance between the display device 100 and the second external device, The display unit 120 displays the first UI element related to the first external device, which is distant from the display device 100, on the edge of the display screen rather than the second UI element related to the second external device, Can be controlled.

When one UI element is associated with the first external device and the second external device, the control unit 120 controls the display unit 110 to display one UI element in the average direction of the first external device and the second external device, (110).

When the first UI element and the second UI element are related to the first external device, the control unit 120 displays the first UI element and the second UI on the side of the display screen corresponding to the direction in which the first external device is located, It is possible to control the display unit 110 to display elements arranged in a line.

With the display device 100 as described above, the user can intuitively find the UI element related to one or more external devices.

Hereinafter, various embodiments of the present invention will be described with reference to FIGS. 2 to 7. FIG. 2 is a block diagram showing the configuration of the display device 100 in detail, according to an embodiment of the present invention. 2, the display device 100 includes a display unit 210, an audio output unit 220, a communication unit 230, a storage unit 240, a sensing unit 250, an input unit 260, (Not shown).

2 is a block diagram illustrating various components in the case where the display device 100 is a device having various functions such as a user command input function, a display function, and the like. Therefore, depending on the embodiment, some of the components shown in Fig. 2 may be omitted or changed, and other components may be further added.

The display unit 210 displays at least one of a video frame processed by the image processing unit (not shown) and various screens generated by the graphic processing unit 273, from the image data received from the image receiving unit (not shown). In particular, the display unit 210 may display a UI including at least one UI element associated with at least one external device. Also, the display unit 210 can rearrange and display at least one UI element related to at least one external device on the basis of the position determined by the controller 270.

The audio output unit 220 is configured to output various types of audio data as well as various kinds of notification sounds and voice messages in which various processing operations such as decoding, amplification, and noise filtering are performed by an audio processing unit (not shown). In particular, the audio output unit 220 may be implemented as a speaker, but it may be implemented as an output terminal capable of outputting audio data, which is only an example.

The communication unit 230 is configured to perform communication with various types of external devices according to various types of communication methods. The communication unit 230 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, an NFC chip, and a wireless communication chip. At this time, the Wi-Fi chip, the Bluetooth chip, and the NFC chip communicate with each other using the WiFi method, the Bluetooth method, and the NFC method. Among these, the NFC chip refers to a chip operating in an NFC (Near Field Communication) system using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz and 2.45 GHz. When a Wi-Fi chip or a Bluetooth chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), LTE (Long Term Evolution)

In particular, the communication unit 230 can perform communication with an external device. Specifically, it communicates with external devices using wired and wireless communication technologies such as local area communication technology (WPAN, WLAN, etc.), mobile communication technology (2G, 3G, etc.) and wired communication technology (Ethernet, BcN, etc.) Thereby determining the position of the external device.

The storage unit 240 stores various modules for driving the display device 100. For example, the storage unit 240 may store software including a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module. In this case, the base module is a base module that processes a signal transmitted from each hardware included in the display device 100 and transmits the signal to an upper layer module. The sensing module is a module for collecting information from various sensors and analyzing and managing the collected information, and may include a face recognition module, a voice recognition module, a motion recognition module, and an NFC recognition module. The display device 100 can determine the location of the external device using the information collected from the sensors through the sensing module. The presentation module is a module for constructing a display screen, and may include a multimedia module for reproducing and outputting multimedia contents, a UI, and a UI rendering module for performing graphics processing. The communication module is a module for performing communication with the outside. The display device 100 communicates with an external device through the communication module and can determine its own position and the location of the external device using the surrounding AP. A web browser module refers to a module that accesses a web server by performing web browsing. A service module is a module including various applications for providing various services.

As described above, the storage unit 240 may include various program modules, but it is needless to say that the various program modules may be omitted, modified or added depending on the type and characteristics of the display device 100. For example, when the display device 100 is implemented as a tablet PC, the base module may further include a position determination module for determining a GPS-based position, and the sensing module may further include a sensing module can do.

In an exemplary embodiment of the present invention, the storage unit 240 may include a ROM 272, a RAM 271, or a memory card (not shown) mounted on the display device 100 , micro SD card, memory stick).

The sensing unit 250 senses the surroundings of the display device 100. In particular, the sensing unit 250 may include a GPS sensor capable of sensing position information, a motion sensing sensor (e.g., a gyro sensor, an acceleration sensor, etc.) capable of sensing the motion of the display device 100, Sensors, and the like. The sensing unit 250 may sense a direction in which the image sensing unit (not shown) of the display device 100 illuminates by using a gyro sensor or the like, and may determine a position with respect to at least one external device located within the angle of view range.

In particular, the sensing unit 250 may calculate the position of the display device 100 using a GPS sensor, a position sensor, or the like. The sensing unit 250 can determine the position of the external device using the direction measuring sensor. Specifically, the sensing unit 250 can determine the distance between the display device 100 and the external device by measuring the time until the signal is received after transmitting the signal to the external device.

The input unit 260 receives a user command for controlling the display device 100. In particular, the input unit 260 may include various input devices such as a touch input unit, a button, a voice input unit, a motion input unit, a keyboard, and a mouse to receive a user command.

The control unit 270 controls the overall operation of the display device 100 using various programs stored in the storage unit 240.

2, the control unit 270 includes a RAM 271, a ROM 272, a graphics processing unit 273, a main CPU 274, first to n interfaces 275-1 to 275-n, Bus 276. < / RTI > At this time, the RAM 271, the ROM 272, the graphic processor 273, the main CPU 274, the first through n interfaces 275-1 through 275-n, etc. may be connected to each other via the bus 276 .

A ROM 272 stores a command set for booting the system and the like. The main CPU 274 copies the O / S stored in the storage unit 240 to the RAM 271 according to the instruction stored in the ROM 272, and executes the O / S To boot the system. When the booting is completed, the main CPU 274 copies various application programs stored in the storage unit 240 to the RAM 271, executes the application program copied to the RAM 271, and performs various operations.

The graphic processing unit 273 generates a screen including various objects such as a pointer, an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The operation unit calculates an attribute value such as a coordinate value, a shape, a size, a color, and the like to be displayed by each object according to the layout of the screen using the control command received from the input unit. The rendering unit generates screens of various layouts including the objects based on the attribute values calculated by the operation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 210.

The main CPU 274 accesses the storage unit 240 and performs booting using the O / S stored in the storage unit 240. [ The main CPU 274 performs various operations using various programs stored in the storage unit 240, contents, data, and the like.

The first to n-th interfaces 275-1 to 275-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network. In particular, one of the interfaces may be an IoT service interface.

The bus 276 may enable communication and data transmission between the display device 100 and an external device. The bus 120 may be configured using a high-speed serial bus, a parallel bus, a storage area network (SAN), and / or other suitable communication technology.

In particular, the control unit 270 controls the display unit 210 to display a UI including at least one UI element associated with at least one external device. When the UI element rearrangement command is input, the controller 270 determines a relative position between the display device and at least one external device. The control unit 270 controls the display unit 210 to display and display at least one UI element related to at least one external device based on the determined position.

At this time, the external device can be not only household appliances and electronic devices that can share information by connecting objects in various fields, but also healthcare, remote meter reading, smart home, smart car, and the like.

Specifically, the control unit 270 may calculate the current position of the display device 100 through the sensing unit 250. As a method of calculating the position of the display device 100, the controller 270 receives position information using a GPS module and transmits RTK (Real Reference) such as VRS (Virtual Reference Station) and FKP (Flat Korrect Parameter) Time Kinematic) method.

The control unit 270 can determine the location of the external device through the communication unit 230. [ According to an embodiment of the present invention, the control unit 270 may control the communication unit 230 to transmit the position of the display device 100 to the server. When the server searches for an external device close to the display device 100 and transmits the location information of the external devices, the controller 270 may control the communication unit 230 to receive the location information of the external devices. The control unit 270 can determine the relative position of the external device with respect to the display device 100 by completing the virtual coordinates of the surrounding external devices with the position of the display device 100 as a reference point. That is, the controller 270 can determine the relative position of the external device with respect to the display device 100 using the position of the display device 100 and the position of the external device. It is possible to determine the position of the external device based on the information received through the relay device such as the server and the base station. However, according to another embodiment of the present invention, The position of the external device can be determined by communication.

When the UI element rearrangement command is input, the controller 270 controls the display unit 210 to rearrange and display at least one UI element related to at least one external device based on the determined location of the external device have. At this time, the control unit 270 may control the display unit 210 to rearrange and display the UI elements by various methods.

A method of relocating at least one UI element associated with at least one external device based on the location of the external device will be described with reference to FIGS. 3 through 7, according to various embodiments of the present invention. Hereinafter, the distance between the display device 100 and the external device in the drawings does not mean an absolute distance.

3, the control unit 270 displays UI elements related to the external device on the side corresponding to the direction in which the external device is positioned on the display screen based on the display device 100, The control unit 210 can be controlled. If the first external device is located in the right direction of the display device 100, the controller 270 disposes the first UI element associated with the first external device in the right area of the display screen, The display unit 210 can be controlled. For example, when the air conditioner 310 is located on the right side of the display device 100, the controller 270 arranges the weather information application 320 icon, which is an application related to the air conditioner 310, on the right side of the display screen It is possible to control the display unit 210 to display it.

At this time, the UI element related to the external device may be an application icon related to the external device. For example, if the external device is a smart TV, the application related to the external device may be a video playback application, a remote control application that can control the smart TV, and the like. In addition, an application related to an external device may be set as an application related to a specific external device by user setting, or may be a recommendation application or the like.

According to an embodiment of the present invention, when the first external device and the second external device are located in the same direction, the controller 270 determines the distance between the first external device and the display device, And the display device 100, respectively. 4A, when the distance between the first external device and the display device 100 is shorter than the distance between the second external device and the display device 100, the controller 270 controls the display device 100 The first UI element related to the first external device 410 close to the first UI element 440 may be disposed at the center of the display screen rather than the second UI element 440 associated with the second external device to control the display unit 210 . For example, when the speaker 410 and the smart TV 420 are positioned in the right direction of the display device 100, the controller 270 controls the speaker 410 and the display device 100, And the distance between the smart TV 420 and the display device 100, respectively. When the distance between the speaker 410 and the display device 100 is shorter than the distance between the smart TV 420 and the display device 100, the controller 270 controls the speaker 410, The display unit 210 can be controlled so that the music application 430 associated with the smart TV is arranged at the center of the display screen rather than the moving image playback application 440 associated with the smart TV.

According to another embodiment, when the first external device 410 and the second external device 420 are positioned in the same direction, the controller 270 controls the first external device 410 and the second external device 420, The distance between the second external device 420 and the display device 100 can be determined. If the distance between the first external device 410 and the display device 100 is shorter than the distance between the second external device 420 and the display device 100, Only the position of the first external device 410 closest to the first external device 410 can be determined.

4B, the controller 270 controls the display unit 210 to display UI elements related to an external device closer to the display device and to display UI elements related to other external devices, Can be controlled. For example, when the distance between the first external device 450 and the display device 100 is shorter than the distance between the second external device 460 and the display device 100, The first UI element 470 associated with the second external device 460 may be arranged to be larger than the second UI element 480 associated with the second external device 460 and the display unit 210 may be controlled. By recognizing the size of the UI elements 470 and 480, the user can more easily search the UI elements of the external device that are more intuitively close to each other.

5, according to an embodiment of the present invention, when the UI element 530 associated with the first external device 510 and the UI element 530 associated with the second external device 520 are the same, The controller 270 may control the display unit 210 to display and display the UI element 530 in the average direction of the first external device 510 and the second external device 520. [ Specifically, the first external device 510 is located at 9 o'clock, and the second external device 520 is located at 3 o'clock. When the specific UI element 530 is associated with the first external device 510 and the second external device 520, the controller 270 controls the first external device 510 and the second external device 520 The display unit 210 can be controlled to display the UI element 530 in the center area which is the average direction. For example, the refrigerator 510 is located at 9 o'clock, and the air conditioner 520 is located at 3 o'clock. When the weather information application 530 is related to the refrigerator 510 and the air conditioner 520, the controller 270 displays the weather information application 530 in the center area which is the average direction of the refrigerator 510 and the air conditioner 520, The display unit 210 may be controlled so as to display the image.

According to another embodiment of the present invention, when a specific UI element is associated with the first external device 510 and the second external device 520, the control unit 270 may repeatedly arrange and display specific UI elements The display unit 210 can be controlled. For example, the first external device 510 is located at 9 o'clock, and the second external device 520 is located at 3 o'clock. When a specific UI element is associated with the first external device 510 and the second external device 520, the control unit 270 determines whether or not a specific UI element is specified in the left direction of the display screen corresponding to the direction of the first external device 510 The UI element may be displayed and the display unit 210 may be controlled to display and display a specific UI element in the right direction of the display screen corresponding to the direction of the second external device 520. [

6, when a plurality of UI elements 620 related to the first external device 610 exist, the controller 270 controls the first external device 610 and the first external device 610, It is possible to control the display unit 210 to arrange and display a plurality of UI elements 620 in a line in an area corresponding to the position of the UI element 620. [ Specifically, when the first external device 610 is located on the upper side of the display device 100 and the UI element 620 associated with the first external device 610 is three, the controller 270 controls the first external device 610 The display unit 210 may be controlled to display and display three UI elements 620 related to the first external device 610 in a line on the upper region of the display screen corresponding to the positions of the first UI elements 610 and 610. For example, when a smart TV 610 is located on the upper side of the display device 100 and a camera application, a recording application, and a memo application related to the smart TV 610 exist, the control unit 270 controls the smart TV 610, A recording application, and a memo application 620, which are related to the smart TV 610, in an upper area of the display screen corresponding to the position of the smart TV 610. [ At this time, the controller 270 displays the camera application, the recording application, and the memo application on the display unit 210 to sort and display the camera application, the recording application, and the memo application in order of relevance to the smart TV 610, Can be controlled.

6, the UI element is displayed in a 3 by 5 matrix on the display screen. However, this is merely an example, and the controller 270 may perform various methods (for example, a 5 by 7 matrix display, A random display without a matrix, etc.).

7, the control unit 270 may include a display unit 210 for displaying a plurality of UI elements 750, 760 and 770 associated with a plurality of external devices 710, 720 and 730, respectively, Can be controlled. For example, there are three UI elements 750 associated with the first external device 710, two UI elements 760 associated with the second external device 720, and the third external device 730 The control unit 270 displays the UI element 750 related to the first external device 710 as a frame with a red dotted line and displays the UI element 750 related to the second external device 720 The UI element 760 related to the third external device 730 may be displayed as a frame with a blue dotted line and the display unit 210 may be controlled to display the UI element 770 related to the third external device 730 as a frame with a green dotted line. have. That is, a clear distinction can be made between UI element groups related to different external devices.

According to another embodiment of the present invention, when a UI element rearrangement command is inputted through the UI element rearrangement button 780, the control unit 270 displays the rearrangement order of the display device 100 and at least one The relative position of the external device can be determined. It is only one embodiment that the UI element rearrangement command is inputted through the UI element rearrangement button. The control unit 270 may display the UI element rearrangement command in a variety of ways such as shaking the display device 100, It can be determined that the UI element rearrangement command is input.

Also, the controller 270 can determine the position of only the external devices 710, 720, and 730 located within a predetermined distance from the display device 100. For example, if the predetermined distance is 10M and the distance between the display device 100 and the fourth external device 740 is 15M, the controller 270 does not determine the position of the fourth external device 740 , And the position of only the first to third external devices 710, 720 and 730 can be determined.

In another embodiment of the present invention, when there is no UI element related to an external device, the control unit 210 may control the display unit 210 to display a message for guiding installation of a recommended UI element related to an external device have. For example, if the air conditioner is located at a short distance from the display device 100 and an application related to the air conditioner is not installed in the display device 100, the control unit 270 may receive a list of recommended applications related to the air conditioner ? &Quot;. < / RTI > The control unit 270 can receive the user command for selecting the recommended application list and install the selected application.

Hereinafter, a UI providing method of the display apparatus 100 according to an embodiment of the present invention will be described with reference to FIG.

First, the display external device 100 displays a UI including at least one UI element associated with at least one external device (S810). At this time, the UI element corresponding to the external device may be an application icon related to the external device.

When the UI element rearrangement command is input, the display apparatus 100 determines at least the position of the next device with respect to the display device 100 (S820). Specifically, the display device 100 can determine the relative direction and distance of the at least one external device with respect to the display device 100.

Then, the display device 100 displays a UI that relocates at least one UI element related to at least one external device based on at least one determined location of the external device (S830). Specifically, the display device 100 may display UI elements related to the external device in a direction in which the external device is positioned so that the relative position of the external device with respect to the display device 100 is displayed.

According to various embodiments of the present invention as described above, a user can intuitively search UI elements related to an external device through minimum UI element search.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, disclosure methods should be considered from an illustrative point of view, not from a restrictive point of view. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

100: display device
110 and 210:
120, and 270:
220: Audio output section
230:
240:
250:
260: Input unit

Claims (16)

A method of providing a UI of a display device,
A first display step of displaying a UI including at least one UI element associated with at least one external device;
Determining a position of the at least one external device with respect to the display device when a UI element rearrangement command is input;
And a second display step of rearranging and displaying the at least one UI element related to the at least one external device based on the determined position. The method according to claim 1,
Wherein the second display step comprises:
Wherein the first UI element is disposed such that a distance between a first external device and a first UI element corresponding to the first external device is the shortest distance. The method according to claim 1,
Wherein the at least one UI element corresponding to the at least one external device comprises:
And an application icon associated with the at least one external device. The method according to claim 1,
Wherein the determining step comprises:
Obtaining a distance between the display device and each of the plurality of external devices when a plurality of external devices are located in the same direction; And
And determining only the position of one external device closest to the display device among the plurality of external devices. The method according to claim 1,
Wherein the determining step comprises:
Wherein the position of the at least one external device is determined based on a position of the display device when the UI element rearrangement command is input. The method according to claim 1,
Wherein the second display step comprises:
Wherein when a plurality of external devices are located in the same direction, a UI element related to an external device that is distant from the display device is disposed at an edge of the display screen for display. The method according to claim 1,
Wherein the second display step comprises:
Wherein when one UI element is related to a plurality of external devices, the one UI element is arranged and displayed in an average direction of the plurality of external devices. The method according to claim 1,
Wherein the second display step comprises:
Wherein when a plurality of UI elements are related to one external device, the plurality of UI elements are arranged in a line on a side of a direction in which the external device is located, and displayed. In the display device,
A display unit for displaying a UI including at least one UI element associated with at least one external device; And
A UI element rearrangement command is input to determine the position of the at least one external device with respect to the display device and relocate the at least one UI element associated with the at least one external device based on the determined position, And a control unit for controlling the display unit. 10. The method of claim 9,
Wherein,
And controls the display unit to display and display the first UI element so that a distance between the first external device and the first UI element corresponding to the first external device is the shortest distance. 10. The method of claim 9,
Wherein the at least one UI element corresponding to the at least one external device comprises:
And an application icon associated with the at least one external device. 10. The method of claim 9,
Wherein,
Acquiring distances between the display device and each of the plurality of external devices when a plurality of external devices are located in the same direction,
Wherein the controller determines only the position of one external device closest to the display device among the plurality of external devices. 10. The method of claim 9,
Wherein,
Wherein the controller determines the position of the at least one external device based on a position of the display device when the UI element rearrangement command is input. 10. The method of claim 9,
Wherein,
Wherein the control unit controls the display unit to display the plurality of UI elements related to the external device, which are distant from the display device, on the edge of the display screen when a plurality of external devices are located in the same direction. 10. The method of claim 9,
Wherein,
And controls the display unit to display and display the one UI element in an average direction of the plurality of external devices when one UI element is related to a plurality of external devices. 10. The method of claim 9,
Wherein,
Wherein the control unit controls the display unit to arrange and display the plurality of UI elements on a side of a direction in which the external device is located when a plurality of UI elements are related to one external device.

Images