WO2017030285A1

WO2017030285A1 - Ui providing method and display device applying same

Info

Publication number: WO2017030285A1
Application number: PCT/KR2016/007213
Authority: WO
Inventors: 신은옥; 박은찬
Original assignee: 삼성전자 주식회사
Priority date: 2015-08-19
Filing date: 2016-07-05
Publication date: 2017-02-23
Also published as: KR102464911B1; KR20170022074A

Abstract

A UI providing method of a display device is provided. The UI providing method of the display device comprises: displaying a UI including at least one UI element related to at least one external device; determining a position of the at least one external device for the display device when an instruction for re-arranging UI elements is input; and re-arranging and displaying the at least one UI element related to the at least one external device on the basis of the determined position.

Description

UI provision method and applied display device

The present invention relates to a UI providing method and a display device to which the same is applied. More particularly, the present invention relates to a UI providing method for determining a location of at least one external device and to arrange a UI element based on the determined location. It is about.

Recently, with the rapid development of the Internet of Thing technology, various applications related to IoT devices have been developed. In addition, recently, various applications are used in various display devices, such as smart phones and tablet PCs, and many dozens of applications are installed in one display device.

However, there are many ways to align numerous applications. For example, the method is limited to a method of sorting in the order installed in the display device, a method of sorting in the order of the names of applications, a method of sorting in the order of recently used applications, and the like.

As such, the method of arranging applications cannot intuitively search for an application that a user of a display device wants to use, and the user of the display device has to incur some inconvenience to search for an application related to an IoT device. .

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and an object of the present invention is to provide a UI element for arranging a UI element related to an external device in proximity to a display device, based on a relative position of the display device and the external device. And to provide a display device applying the same.

According to one or more exemplary embodiments, a method of providing a UI of a display apparatus includes: a first display step of displaying a UI including at least one UI element associated with at least one external device; Determining a position of the at least one external device with respect to the display device when a relocation command of a UI element is input; And a second display step of rearranging and displaying the at least one UI element related to the at least one external device based on the determined position.

In the second display step, the first UI element may be disposed such that a distance between a first external device and a first UI element corresponding to the first external device is the shortest distance.

In addition, the UI element corresponding to the external device may be an application icon for controlling the external device.

The determining may include obtaining distances between the display device and each of the plurality of external devices when the plurality of external devices are located in the same direction. And

And determining only a location of one external device closest to the display device among the plurality of external devices.

In addition, the position of the at least one external device may be determined based on the position of the display device when a UI element rearrangement command is input.

In the second display step, when a plurality of external devices are located in the same direction, UI elements related to external devices that are far from the display device may be disposed on the edge of the display screen and displayed.

The second display step may include displaying one UI element in an average direction of the plurality of external devices when one UI element is associated with a plurality of external devices.

In the second display step, when the plurality of UI elements are related to one external device, the plurality of UI elements may be arranged in a line on the side of the direction in which the external device is located.

On the other hand, the display device according to an embodiment of the present invention for achieving the above object, a display unit for displaying a UI including at least one UI element associated with at least one external device; And when a rearrangement command of a UI element is input, determine a position of the at least one external device with respect to the display device, and determine the at least one UI element associated with the at least one external device based on the determined position. And a controller for controlling the display unit to rearrange and display the same.

The controller may control the display unit to arrange and display the first UI element such that the distance between the first external device and the first UI element corresponding to the first external device is the shortest distance.

When the plurality of external devices are located in the same direction, the controller acquires a distance between each of the display device and the plurality of external devices, and the one external device closest to the display device among the plurality of external devices. Only the position of can be determined.

The controller may determine the location of the at least one external device based on the location of the display device when a UI element rearrangement command is input.

When the plurality of external devices are located in the same direction, the controller may control the display unit to display the UI elements related to the external devices that are far from the display device at the edges of the display screen.

The controller may control the display unit to arrange and display one UI element in an average direction of the plurality of external devices when one UI element is associated with a plurality of external devices.

When the plurality of UI elements are related to one external device, the controller may control the display unit to arrange and display the plurality of UI elements in a line in a side of the direction in which the external device is located.

As described above, according to various embodiments of the present disclosure, the user may be more intuitively provided with a UI for arranging UI elements related to an external device close to the display device.

1 is a block diagram schematically illustrating a configuration of a display apparatus according to an embodiment of the present disclosure;

2 is a block diagram illustrating in detail a configuration of a display apparatus according to an exemplary embodiment.

3 to 7 are diagrams for describing various embodiments of arranging UI elements related to one or more external devices according to positions of one or more external devices according to various embodiments of the present disclosure.

8 is a flowchart illustrating a UI providing method of a display apparatus according to an embodiment of the present disclosure.

Terms used in the embodiments of the present invention will be briefly described, and the embodiments will be described in detail.

The terminology used in the embodiments of the present invention was selected as widely used as possible terms in consideration of functions in the present invention, but may vary according to the intention or precedent of a person skilled in the art, the emergence of new technologies, etc. . In addition, in certain cases, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding embodiments. Therefore, the terms used in the present exemplary embodiments should be defined based on the meanings of the terms and the contents throughout the present exemplary embodiments, rather than simply names of the terms.

In an embodiment of the present invention, terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

In addition, in the embodiments of the present invention, the singular forms "a", "an" and "the" include plural forms unless the context clearly indicates otherwise.

In addition, in the embodiments of the present invention, the terms "comprise" or "have" are intended to designate that there exists a feature, number, step, operation, component, part, or a combination thereof described in the specification. Or other features or numbers, steps, operations, components, parts or combinations thereof in any way should not be excluded in advance.

In addition, in an embodiment of the present invention, the module or unit performs at least one function or operation, and may be implemented in hardware or software, or in a combination of hardware and software. In addition, the plurality of modules or the units may be integrated into at least one module except for the modules or units that need to be implemented with specific hardware, and may be implemented as at least one processor.

In addition, in an embodiment of the present invention, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element in between. This includes any case.

Also, in an embodiment of the present disclosure, the user input may include at least one of a touch input, a bending input, a voice input, a button input, and a multimodal input, but is not limited thereto.

In addition, in an embodiment of the present invention, an "application" refers to a set of computer programs designed to perform a specific task. In an embodiment of the present invention, the application may vary. For example, there may be a game application, a video playback application, a map application, a memo application, a calendar application, a phone book application, a broadcast application, an exercise support application, a payment application, a photo folder application, but is not limited thereto.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and are not construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, the present invention will be described with reference to the drawings. 1 is a diagram illustrating a configuration of a display apparatus 100 according to an exemplary embodiment. As shown in FIG. 1, the display apparatus 100 includes a display 110 and a controller 120. On the other hand, the display device 100 according to an embodiment of the present invention may be implemented by various display devices such as a smart phone, smart watch, smart glass, tablet PC, notebook PC.

The display 110 outputs image data. In particular, the display 110 may display a UI including at least one UI element related to at least one external device. In this case, the at least one UI element related to the external device may be an application icon related to the external device. At least one UI element related to the external device is an application icon related to the external device, but only an embodiment may be a widget icon. In addition, the UI element may be represented by text, an image, or the like, and may be displayed on the standby screen of the display apparatus 100. In addition, the display 110 may reposition the at least one UI element to correspond to the position of the associated external device in response to the UI element relocation command.

The controller 120 controls the overall operation of the display apparatus 100. In particular, when a UI element relocation command is input, the controller 120 may determine the location of at least one external device with respect to the display apparatus 100. The controller 120 may control the display 110 to rearrange and display at least one UI element related to the at least one external device based on the determined position.

In detail, the controller 120 may control the display 110 to display a UI including at least one UI element related to at least one external device. In this case, the at least one UI element may be an application icon related to at least one external device. At least one UI element related to the external device is only an application icon related to the external device, and the UI element may be a widget icon. UI elements may be represented not only by icons but also by text and images. The application related to the external device may be an application used to control the external device, a recommendation application for obtaining information necessary for using the external device, or an application having a record used when the user uses the external device. Alternatively, since an application required for each user may be different according to the characteristics of the external device, an application related to the external device may be an application designated by the user as an application related to the external device.

When the UI element relocation command is input, the controller 120 may determine the location of at least one external device with respect to the display device. In detail, the controller 120 may determine the location of at least one external device based on the location of the display apparatus 100 when the UI element relocation command is input. In this case, the location of the at least one external device may be a relative direction and a distance where the external device is located based on the location of the display apparatus 100.

The controller 120 may control the display 110 to rearrange at least one UI element related to the external device based on the location of the at least one external device. In detail, the controller 120 may control the display 110 to rearrange the UI elements such that the UI elements related to the external device and the external device become the shortest distance. For example, when the first external device is disposed on the left side of the display apparatus 100, the controller 120 may arrange the display 110 to arrange the first UI element related to the first external device on the left side of the display screen. In addition, when a plurality of external devices are located in the same direction, the controller 120 may obtain a distance between the display apparatus 100 and each of the plurality of external devices. The controller 120 may determine only the location of one external device closest to the display apparatus 100 among a plurality of external devices located in the same direction. In addition, the controller 120 may control the display 110 to rearrange and display at least one UI element related to the at least one external device based on the position of the closest one external device. For example, when it is determined that the first external device and the second external device exist in the left direction, and the first external device is closer to the display apparatus 100 than the second external device, the controller 120 may determine the first external device. The display 110 may be controlled to rearrange only UI elements corresponding to the left side of the display 110.

When the first external device and the second external device are located in the same direction, and the distance between the display device 100 and the first external device is farther than the distance between the display device 100 and the second external device, the controller The display unit 110 displays the first UI element related to the first external device that is far from the display apparatus 100 at the edge of the display screen than the second UI element related to the second external device. Can be controlled.

In addition, when one UI element is associated with the first external device and the second external device, the control unit 120 may arrange and display one UI element in an average direction of the first external device and the second external device. 110 may be controlled.

In addition, when the first UI element and the second UI element are related to the first external device, the controller 120 may have the first UI element and the second UI on the side of the display screen corresponding to the direction in which the first external device is located. The display 110 may be controlled to display elements by arranging the elements in a line.

By the display apparatus 100 as described above, the user can intuitively find UI elements related to one or more external devices.

Hereinafter, various embodiments of the present disclosure will be described with reference to FIGS. 2 to 7. 2 is a block diagram illustrating in detail the configuration of the display apparatus 100 according to an exemplary embodiment. As shown in FIG. 2, the display apparatus 100 includes a display unit 210, an audio output unit 220, a communication unit 230, a storage unit 240, a detector 250, an input unit 260, and a controller. 270.

Meanwhile, FIG. 2 is a diagram illustrating various components, for example, when the display apparatus 100 is a device having various functions such as a user command input function and a display function. Therefore, according to an embodiment, some of the components shown in FIG. 2 may be omitted or changed, and other components may be further added.

The display 210 displays at least one of a video frame processed by the image processor (not shown) and the various screens generated by the graphic processor 273. In particular, the display 210 may display a UI including at least one UI element related to at least one external device. In addition, the display 210 may rearrange and display at least one UI element related to at least one external device based on the position determined by the controller 270.

The audio output unit 220 outputs various notification sounds or voice messages as well as various audio data on which various processing operations such as decoding, amplification, and noise filtering are performed by the audio processor (not shown). In particular, the audio output unit 220 may be implemented as a speaker, but this is only an example and may be implemented as an output terminal capable of outputting audio data.

The communication unit 230 is a component that performs communication with various types of external devices according to various types of communication methods. The communication unit 230 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, an NFC chip, a wireless communication chip, and the like. At this time, the WiFi chip, the Bluetooth chip, and the NFC chip communicate with each other via WiFi, Bluetooth, and NFC. Among these, the NFC chip refers to a chip that operates in a near field communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, and 2.45 GHz. In the case of using a Wi-Fi chip or a Bluetooth chip, various connection information such as SSID and session key may be transmitted and received first, and then various communication information may be transmitted and received by using the same. The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), and the like.

In particular, the communication unit 230 may communicate with an external device. Specifically, communication with external devices is performed using wired / wireless communication and network technologies such as near field communication technology (WPAN, WLAN, etc.), mobile communication technology (2G, 3G, etc.) and wired communication technology (Ethernet, BcN, etc.). As a result, the position of the external device can be determined.

The storage unit 240 stores various modules for driving the display apparatus 100. For example, the storage unit 240 may store software including a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module. In this case, the base module is a basic module that processes a signal transmitted from each hardware included in the display apparatus 100 and transmits the signal to an upper layer module. The sensing module collects information from various sensors and analyzes and manages the collected information. The sensing module may include a face recognition module, a voice recognition module, a motion recognition module, an NFC recognition module, and the like. The display apparatus 100 may determine the location of the external device using the information collected from the sensors through the sensing module. The presentation module is a module for constructing a display screen, and may include a multimedia module for reproducing and outputting multimedia content, and a UI rendering module for performing UI and graphic processing. The communication module is a module for performing communication with the outside. The display apparatus 100 may communicate with an external device through a communication module, and determine its own location and the location of the external device using a nearby AP. The web browser module refers to a module that performs web browsing to access a web server. The service module is a module including various applications for providing various services.

As described above, the storage unit 240 may include various program modules, but various program modules may be partially omitted, modified, or added according to the type and characteristics of the display apparatus 100. For example, when the display apparatus 100 described above is implemented as a tablet PC, the base module further includes a position determination module for determining a GPS-based position, and the sensing module further includes a sensing module for detecting a user's motion. can do.

Meanwhile, in an embodiment of the present disclosure, the storage unit 240 may include a memory card (not shown) mounted in the ROM 272, the RAM 271, or the display apparatus 100 in the controller 270 (for example, , micro SD card, memory stick).

The detector 250 detects a surrounding environment of the display apparatus 100. In particular, the detector 250 may include a GPS sensor capable of detecting location information, a motion sensor capable of detecting movement of the display apparatus 100 (eg, a gyro sensor, an acceleration sensor, etc.), a pressure sensor, and noise. And various sensors such as sensors. The sensing unit 250 may detect a direction reflected by an image capturing unit (not shown) of the display apparatus 100 using a gyro sensor, or the like, and determine a position of at least one external device located within an angle of view.

In particular, the detector 250 may calculate the position of the current display apparatus 100 using a GPS sensor, a position sensor, or the like. In addition, the detector 250 may determine the location of the external device using the direction measurement sensor. In detail, the detector 250 may determine the distance between the display apparatus 100 and the external device by measuring a time until the signal is received again after transmitting the signal to the external device.

The input unit 260 receives a user command for controlling the display apparatus 100. In particular, the input unit 260 may include various input devices such as a touch input unit, a button, a voice input unit, a motion input unit, a keyboard, and a mouse to receive a user command.

The controller 270 controls the overall operation of the display apparatus 100 using various programs stored in the storage 240.

As shown in FIG. 2, the controller 270 includes a RAM 271, a ROM 272, a graphics processor 273, a main CPU 274, first to n-interfaces 275-1 to 275-n, Bus 276. In this case, the RAM 271, the ROM 272, the graphic processor 273, the main CPU 274, and the first to n-th interfaces 275-1 to 275-n may be connected to each other through the bus 276. .

The ROM 272 stores a command set for system booting. When the turn on command is input and the power is supplied, the main CPU 274 copies the O / S stored in the storage unit 240 to the RAM 271 according to the command stored in the ROM 272 and executes O / S. Boot the system. When the booting is completed, the main CPU 274 copies various application programs stored in the storage unit 240 to the RAM 271, and executes the application programs copied to the RAM 271 to perform various operations.

The graphic processor 273 generates a screen including various objects such as a pointer, an icon, an image, and a text by using a calculator (not shown) and a renderer (not shown). The calculator calculates attribute values such as coordinates, shapes, sizes, colors, and the like in which each object is to be displayed according to the layout of the screen using the control command received from the input unit. The renderer generates screens of various layouts including objects based on the attribute values calculated by the calculator. The screen generated by the renderer is displayed in the display area of the display 210.

The main CPU 274 accesses the storage 240 and performs booting using the operating system stored in the storage 240. The main CPU 274 performs various operations using various programs, contents, data, and the like stored in the storage 240.

The first to n interfaces 275-1 to 275-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network. In particular, one of the interfaces may be an IoT service interface.

The bus 276 may enable communication and data transmission between the display apparatus 100 and an external device. The bus 120 may be configured using a high-speed serial bus, a parallel bus, a storage area network and / or other suitable communication technology.

In particular, the controller 270 controls the display 210 to display a UI including at least one UI element related to at least one external device. When the UI element relocation command is input, the controller 270 determines a relative position of the display device and at least one external device. The controller 270 controls the display 210 to arrange and display at least one UI element related to at least one external device based on the determined position.

In this case, the external device may be a home appliance, an electronic device that can share information by connecting things in a network in various fields, as well as healthcare, remote meter reading, smart home, and smart car.

In detail, the controller 270 may calculate the current position of the display apparatus 100 through the detector 250. As a method of calculating the position of the display apparatus 100 by the control unit 270, a GPS module is used to receive the location information, and in order to increase the accuracy, a real reference station (VRS) and a flat Korrect parameter (FKP) such as RTK (Real) are used. Time Kinematic) can be used.

The controller 270 may determine the location of the external device through the communication unit 230. According to an embodiment of the present disclosure, the controller 270 may control the communicator 230 to transmit the position of the display apparatus 100 to the server. When the server searches for an external device close to the display apparatus 100 and transmits location information of the external devices, the controller 270 may control the communication unit 230 to receive location information of the external devices. The controller 270 may determine the relative position of the external device with respect to the display device 100 by completing the virtual coordinates of the peripheral external devices based on the position of the display device 100 as a reference point. That is, the controller 270 may determine the relative position of the external device with respect to the display device 100 by using the location of the display device 100 and the location of the external device. It is only one embodiment to determine the location of an external device based on information received through a relay device such as a server or a base station. According to another embodiment of the present invention, the display device 100 and the external device directly The location of the external device may be determined by communicating.

When the UI element relocation command is input, the controller 270 may control the display unit 210 to rearrange and display at least one UI element related to the at least one external device based on the determined position of the external device. have. In this case, the controller 270 may control the display 210 to rearrange and display the UI elements in various ways.

According to various embodiments of the present disclosure, a method of rearranging at least one UI element associated with at least one external device based on the location of the external device will be described with reference to FIGS. 3 to 7. Hereinafter, the distance between the display apparatus 100 and an external device does not mean an absolute distance in the drawing.

In detail, as illustrated in FIG. 3, the controller 270 displays the UI element related to the external device on a side of the display screen 100 corresponding to the direction in which the external device is positioned to display the display. The unit 210 may be controlled. According to an embodiment of the present invention, when the first external device is located in the right direction of the display apparatus 100, the controller 270 displays the first UI element related to the first external device in the right area of the display screen. The display unit 210 may be controlled to control the display unit 210. For example, when the air conditioner 310 is located on the right side of the display apparatus 100, the controller 270 may arrange the weather information application 320 icon, which is an application related to the air conditioner 310, on the right side of the display screen. The display unit 210 may be controlled to display.

In this case, the UI element related to the external device may be an application icon related to the external device. For example, if the external device is a smart TV, the application related to the external device may be an image reproducing application, a remote control application capable of controlling the smart TV, and the like. In addition, an application related to an external device may be set as an application related to a specific external device by a user setting, or may be a recommended application.

According to an embodiment of the present disclosure, when the first external device and the second external device are located in the same direction, the controller 270 may determine the distance between the first external device and the display device and the second external device located in the same direction. And the distance between the display apparatus 100 may be determined. As shown in FIG. 4A, when the distance between the first external device and the display device 100 is closer than the distance between the second external device and the display device 100, the controller 270 may display the display device 100. ) May control the display unit 210 to display the first UI element associated with the first external device 410 in the center of the display screen rather than the second UI element 440 associated with the second external device. . For example, when the speaker 410 and the smart TV 420 are positioned in the right direction of the display apparatus 100, the controller 270 may be configured to between the speaker 410 and the display apparatus 100 positioned in the right direction. The distance and the distance between the smart TV 420 and the display apparatus 100 may be respectively determined. If the distance between the speaker 410 and the display device 100 is closer than the distance between the smart TV 420 and the display device 100, the controller 270 may close the speaker 410 close to the display device 100. The display unit 210 may be controlled to display the music application 430 related to the video display application 440 related to the smart TV in the center of the display screen.

According to another embodiment, when the first external device 410 and the second external device 420 are located in the same direction, the control unit 270 is the first external device 410 and the display device located in the same direction. The distance of 100 and the distance between the second external device 420 and the display device 100 may be determined, respectively. When the distance between the first external device 410 and the display device 100 is closer than the distance between the second external device 420 and the display device 100, the controller 270 may be connected to the display device 100. Only the location of the closest first external device 410 may be determined.

According to another embodiment, as shown in FIG. 4B, the controller 270 displays the UI element related to the external device closer to the display device to display the UI element larger than the UI element related to the other external device. Can be controlled. For example, when the distance between the first external device 450 and the display device 100 is closer than the distance between the second external device 460 and the display device 100, the controller 270 may control the first external device. The display unit 210 may be controlled to display the first UI element 470 associated with the 450 larger than the second UI element 480 associated with the second external device 460. By recognizing the sizes of the

UI elements

470 and 480, the user can more easily search for UI elements of an external device that is more intuitive.

As illustrated in FIG. 5, when the UI element 530 associated with the first external device 510 and the UI element 530 associated with the second external device 520 are the same, The controller 270 may control the display 210 to arrange and display the UI element 530 in the average direction of the first external device 510 and the second external device 520. In detail, the first external device 510 is located at 9 o'clock, and the second external device 520 is located at 3 o'clock. In addition, when the specific UI element 530 is related to the first external device 510 and the second external device 520, the controller 270 is configured to control the first external device 510 and the second external device 520. The display unit 210 may be controlled to display the UI element 530 in the center area in the average direction. For example, the refrigerator 510 is positioned at 9 o'clock, and the air conditioner 520 is positioned at 3 o'clock. In addition, when the weather information application 530 is related to the refrigerator 510 and the air conditioner 520, the controller 270 may adjust the weather information application 530 in a central area that is an average direction of the refrigerator 510 and the air conditioner 520. The display unit 210 may be controlled to display the display unit 210.

According to another embodiment of the present disclosure, when a specific UI element is associated with the first external device 510 and the second external device 520, the controller 270 may arrange and display the specific UI element in duplicate. The display unit 210 may be controlled. For example, the first external device 510 is located at 9 o'clock, and the second external device 520 is located at 3 o'clock. In addition, when a specific UI element is associated with the first external device 510 and the second external device 520, the controller 270 may identify the left direction of the display screen corresponding to the direction of the first external device 510. The display unit 210 may be controlled to display the UI element and to display the UI element by overlapping the specific UI element in the right direction of the display screen corresponding to the direction of the second external device 520.

According to an embodiment of the present disclosure, when there are a plurality of UI elements 620 related to the first external device 610, as illustrated in FIG. 6, the controller 270 may control the first external device 610. The display unit 210 may be controlled to display a plurality of UI elements 620 arranged in a line in an area corresponding to the position of. In detail, when the first external device 610 is positioned above the display apparatus 100 and there are three UI elements 620 associated with the first external device 610, the controller 270 may control the first external device ( The display unit 210 may be controlled to display three UI elements 620 related to the first external device 610 in a line in an upper region of the display screen corresponding to the position of the 610. For example, when the smart TV 610 is located above the display apparatus 100, and there are a camera application, a recording application, and a memo application related to the smart TV 610, the controller 270 may control the smart TV 610. The display unit 210 may be controlled to arrange and display a camera application, a recording application, and a memo application 620 related to the smart TV 610 in an upper region of the display screen corresponding to the position of the display. In this case, the controller 270 displays the camera application, the recording application, and the memo application so that the display is arranged in order of high order, high frequency of use, recently executed application, and installed order of the smart TV 610. ) Can be controlled.

In addition, although FIG. 6 illustrates that the UI elements are displayed in a 3 by 5 matrix on the display screen, this is only an exemplary embodiment, and the controller 270 may display a variety of methods (for example, a 5 by 7 matrix, The display unit 210 may be controlled to display at random without a matrix.

According to an embodiment of the present disclosure, as shown in FIG. 7, the controller 270 displays the display 210 to display a plurality of

UI elements

750, 760, and 770 that are respectively associated with the plurality of

external devices

710, 720, and 730. Can be controlled. For example, there are three UI elements 750 related to the first external device 710, two UI elements 760 related to the second external device 720, and a third external device 730. If there is one UI element 770 related to the), the controller 270 displays the UI element 750 related to the first external device 710 with a red dotted line as a border, and the second external device 720. Control the display unit 210 to display the UI element 760 associated with the blue dotted line as a border and display the UI element 770 related to the third external device 730 with the green dotted line as a border. have. That is, it is possible to make a clear distinction between groups of UI elements related to different external devices.

According to another embodiment of the present disclosure, when a UI element relocation command is input through the UI element relocation button 780, the controller 270 may be configured with at least one of the display apparatus 100 based on when the relocation command is input. The relative position of the external device can be determined. The UI element relocation command is input only through the UI element relocation button, but the control unit 270 may shake the display apparatus 100, execute an application, reach a preset period, or the like. In this case, it may be determined that the UI element relocation command is input.

In addition, the controller 270 may determine the location of only the

external devices

710, 720, and 730 located within a predetermined distance from the display apparatus 100. For example, when the preset distance is 10M and the distance between the display apparatus 100 and the fourth external device 740 is 15M, the controller 270 does not determine the position of the fourth external device 740. The location of only the first to third

external devices

710, 720, and 730 may be determined.

In another embodiment of the present invention, when there is no UI element related to the external device, the controller 210 may control the display unit 210 to display a guide phrase for guiding installation of the recommended UI element related to the external device. have. For example, when the air conditioner is located in close proximity to the display apparatus 100 and the application related to the air conditioner is not installed in the display apparatus 100, the controller 270 receives a list of recommended applications related to the air conditioner. The display unit 210 may be controlled to display the guidance text '?'. The controller 270 may receive a user command for selecting a recommended application list and install the selected application.

Hereinafter, a method of providing a UI of the display apparatus 100 according to an exemplary embodiment will be described with reference to FIG. 8.

First, the external device 100 of the display displays a UI including at least one UI element associated with at least one external device (S810). In this case, the UI element corresponding to the external device may be an application icon related to the external device.

When the UI element relocation command is input, the display apparatus 100 determines at least the following position with respect to the display apparatus 100 (S820). In detail, the display apparatus 100 may determine a direction and distance relative to the display apparatus 100 of at least one external device.

In operation S830, the display apparatus 100 displays a UI in which at least one UI element associated with the at least one external device is rearranged based on the determined position of the at least one external device. In detail, the display apparatus 100 may arrange and display a UI element related to the external device in a direction in which the external device is located so that the relative position of the external device with respect to the display device 100 is displayed.

According to various embodiments of the present disclosure as described above, a user may intuitively search for UI elements related to an external device through minimal UI element search.

Those skilled in the art will appreciate that the present invention may be embodied in a modified form without departing from the essential characteristics of the above-described substrate. Therefore, the disclosed methods should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims

In the UI providing method of the display device,

Displaying a UI including at least one UI element associated with at least one external device;

Determining a position of the at least one external device with respect to the display device when a UI element relocation command is input;

And a second display step of rearranging and displaying the at least one UI element related to the at least one external device based on the determined position.
The method of claim 1,

The second display step,

And providing the first UI element such that a distance between a first external device and a first UI element corresponding to the first external device is the shortest distance.
The method of claim 1,

The at least one UI element corresponding to the at least one external device,

UI providing method characterized in that the application icon associated with the at least one external device.
The method of claim 1,

The determining step,

When the plurality of external devices are located in the same direction, obtaining a distance between each of the display device and the plurality of external devices; And

And determining only a location of one external device closest to the display device among the plurality of external devices.
The method of claim 1,

The determining step,

And determining the location of the at least one external device based on the location of the display device when the UI element relocation command is input.
The method of claim 1,

The second display step,

And when the plurality of external devices are located in the same direction, UI elements related to the external device that are far from the display device are disposed on the edge of the display screen and displayed.
The method of claim 1,

The second display step,

When one UI element is related to a plurality of external devices, the UI providing method, characterized in that the one UI element arranged to display in the average direction of the plurality of external devices.
The method of claim 1,

The second display step,

And when the plurality of UI elements are related to one external device, displaying the plurality of UI elements in a line on the side of the direction in which the external device is located.
In the display device,

A display unit configured to display a UI including at least one UI element associated with at least one external device; And

When a UI element relocation command is input, the position of the at least one external device with respect to the display device is determined, and the at least one UI element associated with the at least one external device is rearranged and displayed based on the determined position. And a control unit controlling the display unit to control the display unit.
The method of claim 9,

The control unit,

And the display unit is arranged to display and arrange the first UI element such that a distance between a first external device and a first UI element corresponding to the first external device is the shortest distance.
The method of claim 9,

The at least one UI element corresponding to the at least one external device,

And an application icon for associated with the at least one external device.
The method of claim 9,

The control unit,

When a plurality of external devices are located in the same direction, a distance between each of the display device and the plurality of external devices is obtained.

And determining only a position of one external device closest to the display device among the plurality of external devices.
The method of claim 9,

The control unit,

And determining the location of the at least one external device based on the location of the display device when the UI element relocation command is input.
The method of claim 9,

The control unit,

And when the plurality of external devices are located in the same direction, the display unit controls to display the UI elements related to the external devices that are far from the display device at the edge of the display screen.
The method of claim 9,

The control unit,

And when one UI element relates to a plurality of external devices, the display unit controls the display unit to arrange and display the one UI element in an average direction of the plurality of external devices.