KR20170125004A - Display apparatus and user interface screen providing method thereof - Google Patents

Abstract

A display apparatus is disclosed. The display apparatus includes a display unit for displaying a UI screen composed of a plurality of spatial elements constituting a 3D space, a user interface unit for receiving a user interaction with the UI screen, and a controller for controlling the display unit to provide a UI screen corresponding to a main space if at least one spatial element among the plurality of spatial elements is displayed in the main space according to the user interaction. Accordingly, the present invention can improve the convenience of a user by receiving various information or services with only the simple interaction.

Description

[0001] DISPLAY APPARATUS AND USER INTERFACE SCREEN PROVIDING METHOD THEREOF [0002]

The present invention relates to a display device and a UI screen providing method thereof, and more particularly, to a display device providing a three-dimensional UI screen and a method of providing the UI screen.

Various types of display devices are being developed due to the development of electronic technology. In particular, display devices such as TVs, PCs, laptop computers, tablet PCs, mobile phones, MP3 players and the like are widely used in most households.

In recent years, efforts have been made to develop display devices in a more new form in order to meet the needs of users who want more new and various functions. For example, interfaces for controlling a display device have been proposed in various forms.

In this respect, there is a need to provide an interface screen that is convenient for the user to manipulate while intuitively providing various information.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned needs, and it is an object of the present invention to provide a display device for displaying different information or services by a simple user interaction on a three-dimensional UI screen and a method of providing the UI screen.

According to an aspect of the present invention, there is provided a display apparatus including a display unit for displaying a UI screen including a plurality of spatial elements constituting a three-dimensional space, a user interface for interacting with the UI screen, And a controller for controlling the display unit to provide a UI screen corresponding to the main space when at least one spatial element of the plurality of spatial elements is displayed in the main space according to the user interaction.

Here, the plurality of spatial elements include a ceiling, a wall, and a floor, and a UI screen corresponding to the main space may include information corresponding to spatial elements displayed in the main space, Functions and / or services.

The control unit may control the display unit to display a UI screen for providing an information service when the sealing unit is displayed in the main space according to the user interaction.

In this case, the information service may include a weather information providing service.

In addition, the controller may control to display a UI screen that provides a commerce service when the month portion is displayed in the main space according to the user interaction.

In this case, the commerce service can provide a service in which virtual product purchase and actual product purchase are interlocked.

In addition, the controller may control to display a UI screen providing a control service when the floor portion is displayed in the main space according to the user interaction.

In this case, it may include at least one of a home device control service and a home security control service.

In addition, the user interface unit receives a user interaction according to a head direction of the user, and when the head portion of the user's interaction is received while the wall portion is displayed in the main space, When the user's head down interaction is received, the floor portion can be controlled to be displayed in the main space.

In addition, the user interface unit receives a remote control signal according to the motion of the remote control device, and the control unit controls the remote control unit such that when the wall portion is displayed in the main space, When the remote control signal corresponding to the motion in which the wall portion is moved to the main space and the remote control device moves in the downward direction is received when the signal is received, the floor portion can be controlled to be displayed in the main space.

Also, the control unit may control to display a background element based on at least one of the external environment information and the content type.

According to another aspect of the present invention, there is provided a method of providing a UI screen of a display device, the method comprising: displaying a UI screen including a plurality of spatial elements constituting a three-dimensional space; And providing a UI screen corresponding to the main space when at least one spatial element of the plurality of spatial elements is displayed in the main space according to the user interaction.

Here, the plurality of spatial elements include a ceiling, a wall, and a floor, and a UI screen corresponding to the main space may include information corresponding to spatial elements displayed in the main space, Functions and / or services.

The step of providing a UI screen corresponding to the main space may display a UI screen for providing an information service when the sealing part is displayed in the main space according to the user interaction.

In this case, the information service may include a weather information providing service.

In addition, providing the UI screen corresponding to the main space may display a UI screen for providing a commerce service when the month portion is displayed in the main space according to the user interaction.

In addition, the step of providing the UI screen corresponding to the main space may display the UI screen providing the control service when the floor part is displayed in the main space according to the user interaction.

In this case, the control service may include at least one of a home device control service and a home security control service.

Also, with the month portion displayed in the main space, the user interaction for displaying the ceiling portion into the main space is a head up interaction of the user, and the user interaction for displaying the floor portion into the main space is the user's It can be a head down interaction.

The method may further include displaying a background element based on at least one of the external environment information and the content type.

According to the various embodiments of the present invention described above, various information or services can be provided only by simple interactions, thereby improving user's convenience.

1 is a view for explaining a display system according to an embodiment of the present invention.
2 is a block diagram showing a configuration of a display device according to an embodiment of the present invention.
3 is a diagram for explaining various software modules stored in a storage unit according to an embodiment of the present invention.
4 and 5 are views showing a UI screen according to an embodiment of the present invention.
6 is a view showing a UI screen according to another embodiment of the present invention.
7 is a view for explaining a UI screen provided in a sealing space according to various embodiments of the present invention.
8 is a view for explaining a UI screen provided in a floor space according to various embodiments of the present invention.
9 is a view for explaining a UI screen provided in a wall space according to various embodiments of the present invention.
10 and 11 are views for explaining a background screen provided in a wall space according to various embodiments of the present invention.
12 is a view for explaining functions or information that can be provided in a sealing space according to various embodiments of the present invention.
13 is a diagram for explaining functions or information that can be provided in a floor space according to various embodiments of the present invention.
14 is a flowchart for explaining a UI providing method according to an embodiment of the present invention.
15 is a flowchart illustrating a UI screen providing method according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a display system according to an embodiment of the present invention.

Referring to FIG. 1, a display system according to an embodiment of the present invention includes a display device 100 and a remote control device 200.

The display device 100 may be implemented as a digital TV as shown in FIG. 1, but is not limited thereto and may be implemented as various types of devices having a display function such as a PC, a mobile phone, a tablet PC, a PMP, a PDA, . Meanwhile, when the display device 100 is implemented as a portable device, the touch screen is built in and can be implemented to execute a program using a finger or a pen (for example, a stylus pen). Hereinafter, it is assumed that the display device 100 is implemented as a digital TV for convenience of explanation.

When the display device 100 is implemented as a digital TV, the display device 100 can be controlled by the user's motion or remote control device 200. [ In this case, the remote control apparatus 200 is an apparatus for remotely controlling the display apparatus 100, and can transmit a control signal corresponding to the user command inputted to the user command to the display apparatus 100. For example, the remote control apparatus 200 senses the motion of the remote control apparatus 200, transmits a signal corresponding to the motion, recognizes the sound, transmits a signal corresponding to the recognized sound, And may be implemented in various forms such as transmitting corresponding signals. In this case, the remote control apparatus 200 may include an optical joystick (OJ) sensor, a physical button (for example, a tact switch), a display screen , A microphone, and the like. Here, the OJ sensor (optical joystick) is an image sensor that detects the user's operation through the OJ, and behaves as if the optical mouse is turned upside down. That is, when the user touches the OJ with a finger, the OJ sensor can analyze the optical signal.

The display apparatus 100 may provide a variety of three-dimensional UI (User Interface) screens according to a user command input through the remote control apparatus 200. [

In particular, the display device 100 may provide a UI screen for displaying one of a plurality of spaces providing different services according to a user interaction as a main space. Hereinafter, a specific configuration of the display device 100 Various embodiments of the present invention will be described with reference to the block diagrams.

2 is a block diagram showing a configuration of a display device according to an embodiment of the present invention.

2 (a), the display device 100 includes a display unit 110, a user interface unit 120, and a control unit 130. [

The display unit 110 displays a screen. Here, the screen may include various content playback screens such as an image, a moving picture, a text, a music, etc., an application execution screen including various contents, a web browser screen, a GUI (Graphic User Interface) screen,

Here, the display unit 110 may be implemented as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), or the like, but is not limited thereto. In addition, the display unit 110 may be implemented as a flexible display, a transparent display, or the like as the case may be.

≪ UI including plural spatial elements >

In particular, the display unit 110 may provide a UI screen including a plurality of spatial elements according to a predetermined event. Here, the plurality of spatial elements may include spatial elements of ceiling, wall, and floor.

That is, the UI screen may include a ceiling space such as a room, three walls supporting a ceiling space, and a floor space located under three walls. One month may be a space where the user is located and may provide a time when the user views the room at a location of one month that is not displayed.

In this case, the UI screen providing the three-dimensional space can be provided in the form of a 2D screen or a 3D screen. In other words, the display unit 110 may implement a 3D image by time-divisionally displaying the left eye image and the right eye image in an alternate manner. In this case, a depth sense may be expressed by a disparity between the left eye image and the right eye image . Accordingly, the user can acquire the depth information of the various objects included in the UI screen and feel the three-dimensional feeling. However, in the case of a 2D image, a three-dimensional space can be expressed by perspective processing on an object in the UI screen.

<Service (or function) or information provided by each spatial element>

On the other hand, each spatial element constituting the three-dimensional space can provide UI screens of different types, that is, UI screens that provide different services (or functions) or different information. Specifically, according to an embodiment of the present invention, an information service may be provided in a sealing space, a commerce service may be provided in a monthly space, and a control service may be provided in a floor space. Herein, the information service refers to a service that provides various information, while the commerce service refers to a service that provides a function to control an electronic commerce service such as the Internet, and a control service to control various devices.

According to another embodiment of the present invention, the first type information may be provided in the sealing space, the second type information may be provided in the wall space, and the third type information may be provided in the floor space. For example, each type information may be, but is not limited to, information for simply notifying the user, information capable of interacting with the user, and the like.

According to another embodiment of the present invention, the first function in the sealing space, the second function in the wall space, and the third function in the floor space can be provided. For example, each function may be a content playback function, a telephone function, and the like, but is not limited thereto.

However, the above-described services, functions, and information may be provided in a mixed manner. That is, the first type information may be provided in one space, and the second type function may be provided in another space.

On the other hand, different information or services may be provided for each user according to the user authentication procedure. For example, the UI according to the present invention may be implemented such that different UI screens are provided for each of a plurality of users through user authentication. In other words, since the behavior pattern and the preference may be different from each other even in the family, when the authentication process such as log-in is performed, a UI screen corresponding to the behavior pattern, preference or setting state of the user may be provided.

<UI background element>

The UI screen according to an embodiment of the present invention may include background elements.

Specifically, the background reflecting the environmental element may be displayed, or the background corresponding to the content type may be displayed. In some cases, it is also possible to display the background selected by the user. Here, the environmental factor may be an external weather factor such as rain, snow, thunder, fog, wind, and a time factor such as day / night, and the content type may be determined by various factors such as a content genre, a content performer, have.

For example, a background may be provided with a rainy background if the current rain is down, and a background containing a UFO may be provided if content representing SF movie content is selected.

This background may provide a variety of animation effects. For example, an animated image may be provided in which snow accumulates or a UFO pulls things up. In this case, the background based on the content type may be provided based on the metadata information included in the content. For example, background elements corresponding to various metadata information may be mapped and stored.

It is also possible that the background element is provided while the spatial elements of the ceiling, wall, and floor remain intact, but the corresponding space disappears and only the background element is displayed.

On the other hand, the background element does not necessarily display another image, but may be provided so as to adjust only the color / brightness and the like.

<Cubic GUI provided in the monthly space>

On the other hand, a polyhedral GUI can be provided in a room space of three months. Here, the polyhedron can be a cube, and in this case, the corresponding GUI is called a cubic GUI. However, this is merely an example, and the polyhedron can be implemented in various forms such as a triangular column, a hexagonal column, and a rectangular parallelepiped. Hereinafter, for convenience of explanation, it is assumed that a polygonal GUI is a cubic-type GUI.

The cubic GUI displayed in the room space is a display element in a hexahedral form, and the cubic GUI can be implemented to represent a predetermined object. For example, a cubic GUI may represent various objects such as content, a content provider, and a service provider.

In addition, at least one surface constituting the cubic GUI can function as an information surface for providing predetermined information to the user. At least one surface constituting the cubic GUI can provide various information according to objects represented by the cubic GUI. For example, at least one surface constituting the cubic GUI includes various information such as content provider information, content information, service provider information, service information, application execution information, content execution information, and user information according to a menu depth according to a user command Can be displayed. In addition, the displayed information may include various elements such as text, a file, an image, a moving picture, an icon, a button, a menu, and a stereoscopic icon. For example, the content provider information may be provided in the form of an icon, a logo, or the like symbolizing the content provider, and the content information may be provided in the form of a thumbnail. Also, the user information may be provided as a profile image of each user. In the case of a thumbnail, the additional information provided from the original content may be decoded and converted into a thumbnail size, or in the absence of additional information, the original content may be decoded and converted into a thumbnail size to extract and provide a reduced thumbnail image. Here, the original content may be a still image or a moving image. In case the original content is a moving image, a thumbnail image in the form of an animation image composed of a plurality of still images may be generated.

<Room space where cubic GUI is provided>

On the other hand, the cubic GUI can be displayed in a floating form on a room space.

Specifically, the display unit 110 may display a cubic GUI floating on a three-dimensional space formed by three walls arranged along the X axis on the screen and having a predetermined depth in the Z axis . Specifically, the display unit 110 displays a plurality of cubic GUIs floating in a room space in which a first wall of the three walls forms a left side, a second wall forms a rear side, and a third wall forms a right side It is possible to display the UI screen in the form of the UI screen.

In this case, the plurality of cubic GUIs have a predetermined interval and can be displayed so as to be arranged in a matrix form of the n * m array, but the present invention is not limited thereto, and it can be arranged in various forms such as radial and linear. In addition, the cubic GUI can be provided in 2D or 3D. Here, the 2D method is a method in which only one face of the cubic GUI is displayed and the other faces are displayed on the screen in a hidden form. The 3D method is a method in which cubic GUI is displayed on the screen in a three- .

On the other hand, the cubic GUI to be displayed next to at least one of the three months may be displayed to have predetermined transparency. Specifically, when a cubic GUI on the first cubic list belonging to a cubic room corresponding to a specific category is displayed, a cubic GUI belonging to the second cubic list has a predetermined transparency (for example, semi-transparent) on the right wall, Can be displayed. In other words, it can guide the cubic GUI to be displayed next in a preview form on the wall constituting the cubic room. In this case, a cubic GUI belonging to a cubic list arranged in the corresponding direction on the left wall can be displayed in a translucent manner. For example, when there are first to fifth cubic lists belonging to cubic rooms, cubic GUIs belonging to the fifth cubic list can be displayed on the left wall in a translucent manner. In this case, it is also possible to display another cubic list on the wall according to the user interaction with the wall. For example, if there is a preset user interaction with the left wall pointing, you can display the third cubic list on the left wall.

In addition, a ceiling space may be displayed at the top of three walls, and a floor space may be displayed at the bottom. However, in the basic state that the room space is displayed as main, only a part of the sealing space and the floor space can be displayed.

<Stellar structure composed of multiple room spaces>

On the other hand, a plurality of three-dimensional spaces including the cubic GUI may be provided and a new three-dimensional space may be displayed along with the rotation. Specifically, a three-dimensional space in the form of a cuboid, which is connected to each other through the passage area and the passage area disposed at the center and is spaced apart from each other and surrounding the passage area, may be disposed. That is, the entire shape can be implemented as a star-like structure (hereinafter referred to as a stellar structure). Each three-dimensional space represents different categories, and objects belonging to each category can be displayed through cubic GUI. Here, the categories can be classified into various types, and can be classified into, for example, a real-time TV viewing category, a VOD content-based category, an SNS content sharing-based category, an application- However, it should be understood that this is merely an embodiment, and that categories can be classified according to various criteria. In this case, it is needless to say that existing ceilings, walls, and floors constituting the three-dimensional space according to the rotation of the three-dimensional space can be replaced with new ceilings, walls, and floors.

Specific examples of the service or information provided in each spatial element will be described later with reference to the drawings.

The user interface unit 120 receives various user interactions. Here, the user interface unit 120 may be implemented in various forms according to an embodiment of the display device 100. [ When the display device 100 is implemented as a digital TV, the user interface unit 120 is implemented with a remote control receiver for receiving a remote control signal from the remote control device 200, a camera for detecting user motion, and a microphone for receiving user voice It is possible. In addition, when the display device 100 is implemented as a touch-based portable terminal, the user interface unit 120 may be implemented as a touch screen having a mutual layer structure with the touch pad. In this case, the user interface unit 120 can be used as the display unit 110 described above.

<Users for 3D space Interaction  >

In particular, the user interface unit 120 may sense various user interactions with the 3D UI according to an exemplary embodiment of the present invention.

Specifically, the user interface unit 120 detects a user interaction for displaying each space element, i.e., a ceiling, a wall, and a floor space as a main space, and a variety of user interactions in a state where each space element is displayed as a main space .

The user interaction for displaying each spatial element in the main space can be in various forms.

I) User interaction according to user motion

The user interaction can be entered by the user's motion.

For example, a head up motion in which the user's head is lifted up can be a user interaction for displaying the ceiling space to the main space, and a head down motion And may be a user interaction for displaying this floor space as a main space. Accordingly, the user interface unit 120 may include a camera for capturing a user's head-up / down operation.

However, the present invention is not limited thereto, and the user's motion can be implemented in various forms such as a motion for up / downing the hand, a motion for up / downing the pupil, and the like.

Ii) user interaction according to the motion of the remote control device

Further, the user interaction can be input by the pointing motion of the remote control device 200. [

For example, a pointing up motion for moving the remote control device 200 in the upward direction may be a user interaction for displaying the sealing space into the main space, and the remote control device 200 may be moved downward A pointing down motion to move may be a user interaction for displaying the floor space to the main space. Accordingly, the remote control device 200 may include at least one of a geomagnetic sensor (for example, a 9-axis geomagnetic sensor) for sensing motion, an acceleration sensor, and a gyro sensor.

In this case, the OJ sensor provided in the remote control device 200 can be implemented to perform a trigger function. That is, if an interaction that presses the OJ sensor for a preset time or longer is input, the display device 100 determines that the input is a trigger command to start determining the motion of the remote control device 200, An indicator for guiding the movement of the remote control device 200 can be displayed. A detailed description thereof will be given later with reference to the drawings. On the other hand, in the case of an interaction in which the OJ sensor is depressed for less than a preset time, the OJ sensor performs an enter function, for example, a function for selecting a corresponding cubic GUI and playing it on the screen while a specific cubic GUI is pointed .

However, the present invention is not limited to this, and it is also possible that the gesture motion of the remote control device is input as a user interaction. For example, a particular gesture (arrows in the up / down direction) may be entered as a gesture for displaying the ceiling or floor space.

Iii) User interaction by detecting OJ sensor of remote control device

Further, the user interaction can be inputted through the operation on the OJ sensor provided in the remote control device 200. [

For example, the upper directional operation on the OJ sensor provided in the remote control device 200 may be a user interaction for displaying the sealing space as the main space, and the downward operation on the OJ sensor may move the floor space to the main space Lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt; The OJ sensor (optical joystick) is an image sensor that detects the user's operation through the OJ. It acts as if the optical mouse is turned upside down. That is, when the user touches the OJ with a finger, the OJ sensor can analyze the optical signal.

 Iv) user interaction according to the button input of the remote control device

Further, the user interaction can be inputted by a button operation of the remote control device 200. [

For example, the pressing operation of the first button provided on the remote control device 200 may be a user interaction for displaying the sealing space to the main space, Lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt;

V) user interaction with the touch panel operation of the remote control device

In addition, the user interaction can be inputted through an operation on the touch panel provided in the remote control device 200. [

For example, the upward direction dragging operation on the touch panel provided in the remote controller 200 may be a user interaction for displaying the sealing space to the main space, and the downward dragging operation on the touch panel may be a floor space And may be a user interaction for display in the main space. Here, the touch panel may include a pressure sensitive or electrostatic touch sensor, so that coordinates of a point touched by the user can be sensed. However, the present invention is not limited to this case, and there may be a case where text for identifying a corresponding space such as sealing on the touch panel, UP (up), floor, DOWM (down)

Vi) User interaction by voice recognition

Further, the user interaction may be input through a microphone provided in the remote control apparatus 200, or a voice recognition in a separately provided microphone.

For example, a user speech recognition of "UP" may be a user interaction for displaying the sealing space to the main space and a user speech recognition of "DOWN " may be a user interaction for displaying the floor space to the main space . However, the voice command is not limited thereto and may be various forms such as "up / down ".

Meanwhile, when the monthly space is displayed as the main space, the user interface unit 120 may detect a user interaction on the cubic GUI displayed in a floating form in cubic room space consisting of three months.

For example, a user interaction for selecting a cubic GUI, a user interaction for rotating a cubic GUI, a user interaction for changing a display angle of a cubic GUI, a user interaction for slicing a cubic GUI, User interaction for scrolling one side of the GUI, user interaction for rubbing one side of a cubic GUI, user interaction for a single cubic GUI, and user interaction for a group cubic GUI Various user interactions can be detected.

Other user interactions to switch cubic GUI lists, user interactions to convert display angles of cubic rooms, user interactions to convert displayed cubic rooms to other cubic rooms, main display spaces of cubic rooms (for example, ceiling , a user interaction for switching between wall and floor).

The control unit 130 controls the overall operation of the display device 100.

<User In an interaction  Main space display>

The control unit 130 may display one spatial element as a main space according to a user interaction sensed through the user interface unit 120. [

For example, when the head-up motion of the user is detected while the wall space is displayed as the main space, the controller 130 displays the ceiling space as a main space and displays the floor space as a main space when the head-down motion is detected . Here, displaying in the main space may be a form in which the space occupies more than a predetermined ratio of the entire screen. In some cases, however, the user interaction may include a form in which the user interaction is perceived as an interaction with the space. That is, when displaying only information in the main space, the main space may be displayed only in a form occupying more than a predetermined ratio of the entire screen, but only when the main space needs to be controlled according to the user interaction, It can be in the form of being perceived as an interaction with the main space.

Meanwhile, the controller 130 may display the non-visible space in a pointing manner or a full manner. For example, when the remote control device 200 is pointed upward, the ceiling space can be displayed in a cue manner, and when the remote control device 200 is pulled upward, the ceiling space is smooth Can be displayed.

&Lt; Various embodiments related to services provided in each spatial element >

When the specific space element is displayed as the main space, the control unit 130 can provide a UI screen corresponding to the corresponding space. Here, the UI screen corresponding to the space may be a screen providing at least one of information, function, and service corresponding to each space.

Specifically, when the sealing part is displayed in the main space according to the user interaction, the controller 130 can control to display a UI screen for providing information service. Here, the information service may be, for example, a weather information providing service, but is not limited thereto. In other words, it can provide various information such as stock information, sports schedule, and TV schedule table. The information provided in the sealing space may be set to default, but may be changed according to the user's preference. For example, even if it is set to provide weather information by default, if the user wants to receive stock information, the stock information can be provided in the sealing space. Of course, it is also possible to set two or more different information to be provided.

In addition, the controller 130 may control the display of the UI screen that provides the commerce service when the month portion is displayed in the main space according to the user interaction. Here, the commerce service may be, for example, a commodity purchase related service, but is not limited thereto. That is, as another example, various commerce services such as contents purchase and application purchase can be provided.

On the other hand, the commerce service provided in the monthly space can be a service for purchasing a virtual commodity for decorating the monthly space. Accordingly, the commodity purchased through the commerce service can be arranged in a month. Here, the product may include not only interior accessories that can be placed on the wall such as a frame, a lamp, a mirror, etc., but also wallpaper. For example, if a user purchases a virtual lamp, the lamp purchased by the user may be placed at a default location in the monthly space or at a location designated by the user. In addition, the corresponding lamp can be turned ON / OFF like a real lamp, thereby providing a function of providing illumination to a cubic room. As another example, if a mirror is selected and the mirror is selected according to the user interaction, it may also be possible for the screen of the display device 100 to perform a mirror function.

In addition, the commerce service is interlocked with the purchase of actual goods, and when a user purchases an actual commodity, a virtual commodity may be arranged in a month. When the virtual goods are placed in the month and the actual goods are placed in the grooves, the virtual goods can operate in conjunction with the actual goods placed in the grooves. For example, if the user turns on / off the lamp of the actual product, the virtual lamp can operate in the same manner. On the contrary, it goes without saying that the user can control the operation of the actual lamp through the virtual lamp control.

On the other hand, the virtual product described above can be a graphical version of a product that is difficult to actually purchase. That is, the actual product is so expensive that it is difficult for the user to purchase, and the user can purchase the virtual graphic product and place it in the UI screen, thereby satisfying the user's compensation hearing.

In the above-described embodiment, the case where the purchased virtual merchandise is arranged in the month has been described. However, the present invention is not limited to this, and it is also possible that the arrangement product in the room such as a couch is arranged in the cubic room.

Meanwhile, the commerce service provided in the monthly space can be performed through the specific commodity seller provided in the monthly space. For example, various merchandise merchandise information is displayed within a month, and when the merchandise merchandise information is selected, various merchandise information sold by the merchandise seller is displayed, and purchase can be made. In this case, the cubic GUI displayed in the cubic room may temporarily disappear on the screen. However, in some cases, various purchase screens providing purchase services may be provided on a display screen provided in the remote control device 200. [ For example, when a user desires to use a commerce service with a multi-task, a purchase screen may be transmitted to the remote control apparatus 200 to prevent the screen from being disturbed.

In addition, when the floor part is displayed in the main space according to the user interaction, the control unit 130 can control to display a UI screen for providing a control service. Here, the control service may be, for example, a home device control service, but is not limited thereto. In other words, there may be various types of control services, such as office control services and specific device control services.

Specifically, the control unit 130 may display a virtual 2D or 3D spatial arrangement diagram connected to the home network, and may receive a control signal based on the spatial arrangement diagram displayed to control the corresponding home device. That is, the spatial arrangement may include information about at least one home device connected to the home network, and the information may include identification information of the home device in a text (e.g., a home device name) or an image An appearance image, or an icon). The control unit 130 can control the home device according to the received control signal when the control signal is received from the remote control device 200 while the specific home device is pointing. In this case, the display apparatus 100 can operate as a home network server, but when the home network server is separately implemented, the display apparatus 100 can transmit the received control signal to the home network server.

On the other hand, the space layout can be generated based on the location information and the device type of each of the home devices. Specifically, a virtual space layout diagram is generated based on the location information and the device type of each home device connected to the home network, and the location information input whenever the existing home device is disconnected or the new home device is connected to the home network The spatial layout can be updated on the basis of the result.

If a specific home device is selected as a control object, the control unit 130 may display a control screen for controlling the home device or a state providing screen indicating a state of the home device. For example, when the air conditioner is selected, a control screen for controlling the operation of the air conditioner may be displayed.

As another example, when a refrigerator is selected, a state providing screen for scanning and displaying an item currently included in the refrigerator can be displayed. The image displayed on the state providing screen can be obtained through a camera provided in the refrigerator. In this case, the user can check the necessary items without having to open the refrigerator directly and order them online immediately. In this case, it is a matter of course that the commerce service provided in the monthly space can be used.

Also, when the floor part is displayed in the main space according to the user interaction, the control unit 130 may provide a home security control service or a baby care. In some cases, when an error occurs in the home security, the floor portion is automatically displayed in the main space, and a home security related screen can be provided. For example, if an abnormal state is detected from a sensor installed in a home, the corresponding space can be displayed so that the user can check the space. In particular, if the CCTV is installed in the corresponding space, it is also possible to provide a video shot at the time of the abnormality detection. Or when the bell rings on the doorway, the floor part can be automatically displayed in the main space and the door security camera image can be displayed on the door lock camera.

It is also possible to provide a user's office control service or the like in the floor space. For example, a control service may be provided for controlling devices in a user's office, such as a computer, air conditioner, heater, and the like. In this case, the display apparatus 100 can communicate with the display apparatus 100 through a cloud server (not shown). In particular, remote control of a user's office computer enables the user to control the office within the home by enabling the user to search for files stored in the computer and open the file.

&Lt; Various embodiments relating to services provided in each spatial element according to a category &

On the other hand, as described above, since a plurality of three-dimensional spaces including a ceiling, a wall, and a floor are provided and different three-dimensional spaces can be displayed according to the rotation, the UI screen types provided by the respective space elements may vary It is also possible.

For example, the type of information, function, or service provided in a ceiling, a wall, and a floor may vary depending on a category type corresponding to a cubic room, that is, a cubic room.

As an example, if the displayed cubic room corresponds to an application category, it can provide application-related commerce services in a month. As another example, if a cubic room represents an SNS category, it is possible to provide a video call image with a plurality of users represented by a plurality of cubic GUIs selected in a cubic room in a sealing part.

&Lt; Various embodiments relating to information or function provided in each spatial element >

In some cases, it is also possible to provide a cubic GUI that represents a favorite item of the user, regardless of the category represented by the displayed cubic room, rather than the control service in the floor space. That is, even if a cubic GUI corresponding to a specific category is provided in a cubic room, a cubic GUI belonging to various categories may be provided in the floor space.

As another example, it is also possible that the video call function is provided by default in the sealing space.

As another example, if the ceiling space is displayed in the main space according to the user interaction in a state where the corresponding advertisement information is displayed on one side of one of the plurality of cubic bikes included in the displayed cubic bikes or on the displayed full cubic bikini GUI, It is also possible that an advertisement reproduction screen is provided.

2 (b) is a block diagram showing a detailed configuration of a display device 100 according to another embodiment of the present invention. 2B, the display apparatus 100 includes an image receiving unit 105, a display unit 110, a user interface unit 120, a control unit 130, a storage unit 140, a communication unit 150, A video processing unit 170, a speaker 180, a button 181, a camera 182, and a microphone 183, as shown in FIG. Details of the components shown in FIG. 2 that overlap with the components shown in FIG. 1 will be omitted.

The image receiving unit 105 receives image data through various sources. For example, the image receiving unit 105 can receive broadcast data from an external broadcasting station, can receive image data from an external device (e.g., a DVD, a BD player, etc.) It is possible to receive the stored image data. In particular, the image receiving unit 105 may include a plurality of image receiving modules for receiving a plurality of images to display a plurality of screens, respectively, of a plurality of contents selected by the cubic GUI according to the present invention. For example, the image receiving unit 105 may include a plurality of tuners for simultaneously displaying a plurality of broadcast channels.

The controller 130 controls the overall operation of the display device 100 using various programs stored in the storage unit 140.

Specifically, the control unit 130 includes a RAM 131, a ROM 132, a main CPU 133, a graphics processing unit 134, first through n interfaces 135-1 through 135-n, .

The RAM 131, the ROM 132, the main CPU 133, the graphics processor 134, the first through n interfaces 135-1 through 145-n, and the like may be connected to each other via the bus 136. [

The first to n-th interfaces 135-1 to 135-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

The main CPU 133 accesses the storage unit 140 and performs booting using the O / S stored in the storage unit 140. [ Various operations are performed using various programs, contents, data, and the like stored in the storage unit 140.

The ROM 132 stores a command set for booting the system and the like. When the turn-on command is input and power is supplied, the main CPU 133 copies the O / S stored in the storage unit 140 to the RAM 131 according to the instruction stored in the ROM 132, executes O / S Boot the system. When the booting is completed, the main CPU 133 copies various application programs stored in the storage unit 140 to the RAM 131, executes the application program copied to the RAM 131, and performs various operations.

The graphic processing unit 134 generates a screen including various objects such as an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates an attribute value such as a coordinate value, a shape, a size, and a color to be displayed by each object according to the layout of the screen based on the received control command. The rendering unit (not shown) creates screens of various layouts including the objects based on the attribute values calculated by the operation unit (not shown). The screen generated in the rendering unit (not shown) is displayed in the display area of the display unit 110.

Meanwhile, the operation of the control unit 130 may be performed by a program stored in the storage unit 140.

The storage unit 140 stores various data such as an operating system (O / S) software module for driving the display device 100, various multimedia contents, various applications, and various contents inputted or set during execution of the application.

In particular, the storage unit 140 may store data for constructing various UI screens including the cubic GUI provided by the display unit 110 according to an embodiment of the present invention.

In addition, the storage unit 140 may store data on various types of user interaction, functions corresponding thereto, information provided, and the like.

In addition, various software modules stored in the storage unit 140 will be described with reference to FIG.

3, the storage unit 140 includes a base module 141, a sensing module 142, a communication module 143, a presentation module 144, a web browser module 145, and a service module 146 Can be stored.

The base module 141 refers to a base module that processes a signal transmitted from each hardware included in the display device 100 and transmits the processed signal to an upper layer module. The base module 141 includes a storage module 141-1, a security module 141-2, and a network module 141-3. The storage module 141-1 is a program module for managing a database (DB) or a registry. The main CPU 133 accesses the database in the storage unit 140 using the storage module 141-1 and can read various data. The security module 141-2 is a program module that supports certification for hardware, permission permission, and secure storage. The network module 141-3 is a module for supporting network connection Module, DNET module, and UPnP module.

The sensing module 142 is a module for collecting information from various sensors and analyzing and managing the collected information. The sensing module 142 may include a head direction recognition module, a face recognition module, a voice recognition module, a motion recognition module, an NFC recognition module, and the like.

The communication module 143 is a module for performing communication with the outside. The communication module 143 includes a messaging module 143-1 such as a messenger program, a Short Message Service (SMS) and a Multimedia Message Service (MMS) program, an e-mail program, a program module for a Call Info Aggregator, And a telephone module 133-2 including a telephone line.

The presentation module 144 is a module for constituting a display screen. The presentation module 144 includes a multimedia module 144-1 for reproducing and outputting multimedia contents, a UI, and a UI rendering module 144-2 for performing graphics processing. The multimedia module 144-1 may include a player module, a camcorder module, a sound processing module, and the like. Accordingly, various multimedia contents are reproduced, and a screen and sound are generated and reproduced. The UI rendering module 144-2 includes an image compositor module for combining images, a coordinate combination module for generating coordinates by combining coordinates on a screen for displaying an image, an X11 module for receiving various events from hardware, A 2D / 3D UI toolkit that provides a tool for constructing a UI of the form, and the like.

The web browser module 145 is a module for accessing a web server by performing web browsing. The web browser module 145 may include various modules such as a web view module for configuring a web page, a download agent module for downloading, a bookmark module, a Webkit module, and the like.

The service module 146 is a module including various applications for providing various services. Specifically, the service module 146 may include various program modules such as an SNS program, a content playback program, a game program, an e-book program, a calendar program, an alarm management program,

Although various program modules are shown in FIG. 3, it should be understood that some of the illustrated program modules may be omitted, modified or added depending on the type and characteristics of the display device 100. For example, a location-based module supporting location-based services in cooperation with hardware such as a GPS chip.

The communication unit 150 can perform communication with an external device according to various types of communication methods.

The communication unit 150 includes various communication chips such as a Wi-Fi chip 151, a Bluetooth chip 152, and a wireless communication chip 153. The Wi-Fi chip 151 and the Bluetooth chip 152 communicate with each other using WiFi or Bluetooth. When the WiFi chip 151 or the Bluetooth chip 152 is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip 153 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution) In addition, the communication unit 150 may further include an NFC chip operating in a NFC (Near Field Communication) mode using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, .

In particular, the communication unit 150 communicates with a content or a service providing server (not shown) and various information providing servers (not shown) to receive various information for determining the size and arrangement state of the cubic GUI. For example, a plurality of pieces of user information (for example, profile photographs) represented by each cubic GUI may be provided on the SNS service providing screen, or information on the relationship between the users for determining the size and arrangement of the cubic GUI may be provided And can communicate with an SNS server (not shown). As another example, in order to provide the content information represented by each cubic GUI or the relationship information between the respective contents on the content providing screen, communication with the content providing server (not shown) may be performed.

The audio processing unit 160 is a component that performs processing on audio data. In the audio processing unit 170, various processes such as decoding and amplification of audio data, noise filtering, and the like may be performed.

In particular, the audio processing unit 160 may process the audio data to provide a sound corresponding to the user's moving speed when the cubic GUI is rotated according to the user's movement according to an embodiment of the present invention. For example, a feedback sound corresponding to the user's movement speed can be generated and provided.

The video processing unit 170 is a component that performs processing on video data. The video processing unit 170 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data.

The speaker 180 is a component for outputting various kinds of audio data processed by the audio processing unit 160, as well as various kinds of notification sounds and voice messages.

The button 181 may be various types of buttons such as a mechanical button, a touch pad, a wheel, and the like formed in an arbitrary area such as a front surface portion, a side surface portion, and a back surface portion of the outer surface of the main body of the display device 100. For example, a button for turning on / off the power of the display device 100 may be provided.

The camera 182 is a structure for capturing a still image or a moving image under the control of the user. In particular, the camera 182 can capture various user motions for controlling the display device 100. [

The microphone 183 is a configuration for receiving a user voice or other sound and converting it into audio data. The control unit 130 may use the user voice input through the microphone 183 in a call process or convert the user voice into audio data and store the voice data in the storage unit 140. Meanwhile, the camera 182 and the microphone 183 may be a configuration of the user interface unit 120 according to the functions thereof.

When the camera 182 and the microphone 183 are provided, the control unit 130 may perform a control operation according to a user voice input through the microphone 183 or a user motion recognized by the camera 184. [ That is, the display apparatus 100 can operate in a motion control mode or a voice control mode. When operating in the motion control mode, the control unit 130 activates the camera 182 to pick up the user, tracks the motion change of the user, and performs a corresponding control operation. When operating in the voice control mode, the control unit 130 may operate in a voice recognition mode for analyzing a user voice input through a microphone and performing a control operation according to the analyzed user voice.

When operating in the motion control mode, the controller 130 may control the display of the sealing space or the floor space to the main space according to the head up / down motion of the user. Specifically, the head-up / down motion can be detected by at least one of the size of the face region of the user, the eye position of the user, the neck length of the user, and the head region of the user.

For example, the controller 130 may determine the head up / down motion based on the position and the width of the face region, determine the head up / down motion based on the eye position of the user, .

Specifically, the controller 130 identifies an eye image from a user image captured by the camera 182 through a face modeling technique. At this time, the facial modeling technique is an analysis process of converting the facial image acquired by the photographing unit into digital information for processing and transmission, and one of the ASM (Active Shape Modeling) technique and the AAM (Active Appearance Modeling) technique is used . Then, the controller 130 may determine the movement of the eyeball using the identified eyeball image, and determine the head up / down motion using the eyeball movement. For example, after a captured image of a user is scanned in units of pixels to detect a pixel coordinate value corresponding to a user's left eye position and a pixel coordinate value corresponding to a user's right eye position, Can be determined. An eye position detecting method for detecting a user's eye position by pixel coordinates by scanning an image of a user photographed by a camera in pixel units can be implemented using various widely known image analysis techniques, A detailed description will be omitted. As a method for detecting the eye position of the user, an infrared (IR) sensor or the like may be used in place of the camera.

Alternatively, the controller 130 may identify the face image and the neck image from the user photographed image, and determine the head up / down motion based on the ratio of the face length and the neck length. For example, the ratio of the face length and the neck length may be calculated and stored according to the experimental data, and the controller 130 may compare the pre-stored data with the user data to determine the head up / down motion.

In addition, various external input ports for connecting with various external terminals such as a headset, a mouse, a LAN, and the like may be further included.

Meanwhile, although not shown in the figure, the display device 100 may further include a feedback providing unit (not shown). The feedback providing unit (not shown) functions to provide various feedbacks (for example, audio feedback, graphic feedback, haptic feedback, etc.) according to the displayed UI screen. Specifically, audio feedback may be provided to ventilate the user's surroundings, such as when a ceiling or floor space is displayed.

2 (b) shows an example of a detailed configuration included in the display device 100. In some embodiments, some of the components shown in FIG. 2 (b) may be omitted or changed , Other components may be added. A GPS receiver (not shown) for calculating the current position of the display device 100 by receiving GPS signals from a GPS (Global Positioning System) satellite when the display device 100 is implemented as a mobile phone, a DMB And a DMB receiving unit (not shown) for receiving and processing a Multimedia Broadcasting (DMB) signal.

4 is a diagram illustrating a UI screen according to an embodiment of the present invention.

4A, the UI screen according to an exemplary embodiment of the present invention includes a room-type three-dimensional space 410 to 450, that is, cubic rooms 410 to 450, and provides a rotatable GUI can do. Specifically, cubic rooms 410 to 450 are provided at the edges of each space divided into N equally in the form of a roulette wheel, and each cubic room may correspond to different categories.

On the other hand, the category information corresponding to the cubic room can be displayed. For example, icons 411 to 451 representing each category and simple text information 412 to 452 for each category may be displayed. As shown in the figure, the categories are "ON TV" for real-time TV viewing, "Movies & TV Shows" category for providing VOD contents, "Social" category for sharing SNS contents, "application" , And "Music, Photos & Clips" category for providing personal contents. However, it should be understood that this is merely an embodiment, and that categories can be classified according to various criteria.

In addition, when a specific cubic room is pointed, information 412 indicating the cubic room is highlighted and displayed to indicate that the cubic room is pointed.

Meanwhile, as shown in FIG. 4B, the cubic room can be rotated and displayed according to the user interaction. In other words, the cubic room located at the center is pointed according to the rotation. In the state where the cubic room is pointed, the corresponding cubic room is selected and displayed on the full screen according to the predetermined event, and the cubic- .

5A shows a case where a specific cubic room is selected according to a user interaction in the UI screen shown in FIG.

When a specific cubic room is selected as shown in FIG. 5A, a plurality of cubic GUIs 511 to 519 may be displayed floating in a three-dimensional space according to an embodiment of the present invention. Here, the three-dimensional space is arranged along the X-axis on the screen as shown in the drawing, and the three-dimensional space is formed by three walls 541 to 543, ceiling 520 and floor 530 having a predetermined depth in the Z- Space (cubic room).

Meanwhile, as shown, the plurality of cubic GUIs 511 to 519 may represent a predetermined object. Specifically, the plurality of cubic GUIs 511 to 519 can represent various objects belonging to the category corresponding to the corresponding cubic room. For example, if the cubic room corresponds to a VOD content-based category, the plurality of cubic GUIs 511 to 519 may represent various content providers that provide VOD contents. However, this is an embodiment only, and a plurality of cubic GUIs may represent contents (for example, specific VOD contents) provided by each content provider according to the menu depth that is progressed according to a user command.

The plurality of cubic GUIs 511 to 519 can be displayed so that their sizes and arrangement states are different as shown. The sizes and arrangement states of the cubic GUIs 511 to 519 may be changed according to a priority set according to at least one of a user behavior pattern and an attribute of an object. Specifically, a cubic GUI 511 representing a content provider with a high priority, for example, a user's preference as a criterion, can be displayed at the center of the screen to have a depth larger than that of another cubic GUI . That is, the plurality of cubic GUIs 511 to 519 are displayed to reflect the preference of the user for the object, thereby providing an effect of increasing the recognition rate of the cubic GUI 511 by the user. On the other hand, other cubic GUIs 512 to 519 may also be displayed to have a size, position, and depth according to the corresponding preferences.

On the other hand, different UI screens may be provided for each user according to the user authentication procedure. For example, the UI according to the present invention may be implemented such that different UI screens are provided for each of a plurality of users through user authentication. In other words, since the behavior pattern and the preference may be different from each other even in the family, when the authentication process such as log-in is performed, a UI screen corresponding to the behavior pattern, preference or setting state of the user may be provided.

In addition, as shown in Fig. 5B, the pointing GUI 10 can be arranged and displayed on the cubic GUI 511 representing the high priority object. Here, the pointing GUI 10 may be provided in the form of a highlight pointer, as shown by the function for selecting a cubic GUI according to a user command. However, this is merely an embodiment, and the pointing GUI can be changed into various forms such as an arrow pointer, a hand pointer, and the like.

On the other hand, the pointing GUI 10 can be moved according to various types of user commands. For example, the pointing GUI 10 may include a motion command in the pointing mode of the remote control device 200, a motion command in the gesture mode, a voice command, a direction key operation command provided in the remote control device 200, Eye tracking) can be moved to another cubic GUI according to various user commands.

6 is a view showing a UI screen according to another embodiment of the present invention.

As shown in FIGS. 6A and 6B, when a wall space, that is, a cubic room is displayed as a main display, a graphic representing current weather or a current time zone may be displayed in the ceiling space 610. Further, in the floor space 620, information indicating the category of the currently displayed cubic room can be displayed.

For example, as shown in FIG. 6A, when the current time zone is the low time zone, a graphic representing the day time zone may be displayed in the sealing space 610.

In addition, as shown in FIG. 6B, when the current time zone is night time zone, a graphic representing the night time zone may be displayed in the ceiling space 620. FIG.

7 is a view for explaining a UI screen provided in a sealing space according to various embodiments of the present invention.

6A and 6B, when the head-up interaction of the user is detected while the wall space is displayed as main, the ceiling space 710 is displayed as main as shown in FIG. 7A, and weather information 711 ) May be provided. In this case, the weather information may be weather information of the area where the user lives.

7B, when the user's head is tilted to the left or the leftward rotating interaction is detected, the ceiling space is rotated to display the new ceiling space 720, and weather information 721 in the other region is displayed Can be provided. Here, the other area may be an area pre-selected by the user. For example, the user can select an area where his / her family resides and set the weather information in advance as an area for receiving weather information.

On the other hand, as shown in FIG. 7C, when a user's right or left rotating interaction is detected, the sealing space is rotated to display a new sealing space 730 and stock information may be displayed.

When a new sealing space is displayed according to the user's interaction with the sealing space displayed as shown in FIGS. 7A to 7C, new information of the same type is provided (FIG. 7B), or different types of new information are provided 7c.

8 is a view for explaining a UI screen provided in a floor space according to various embodiments of the present invention.

6A and 6B, when the user's head-down interaction is detected while the wall space is displayed as main, the floor space 810 is displayed as main, as shown in FIG. 8A, Can be provided. For example, a space layout including icons 811 to 814 representing the home device as shown can be displayed.

In this case, the user can control the operation of the home device through the control screen or the control menu displayed when the specific home device icon is pointed.

Alternatively, as shown in FIG. 8B, the home device may be located in a virtual position corresponding to the actual position on the space layout diagram, and the device appearance may be displayed in a stereoscopic manner.

On the other hand, as shown in FIG. 8C, when the user rotates the head to the right or the rotation to the right is detected, the floor space is rotated to display a new floor space 830, and a new control screen can be provided. For example, a control screen for controlling the user's office devices 831, 832 may be provided. In this case, the user can remotely control the office device at his / her home.

9 is a view for explaining a UI screen provided in a wall space according to various embodiments of the present invention.

As shown in FIG. 9A, when the wall space is displayed as main, cubic rooms consisting of three walls 911 to 913 can be provided. In the cubic room, the cubic GUI may be displayed in a floating form, which has been described above, so a detailed description thereof will be omitted.

On the other hand, at least one of the three months (911, 913) may be arranged with a virtual item purchased by the user. For example, as shown, a plurality of lamps 921, 922 may be disposed on the right and left walls 911, 913, respectively.

Also, the props provided on the walls 911 and 913 can be implemented so as to be controllable by the user. For example, as shown in FIGS. 9A and 9B, the plurality of lamps 921 and 922 may be turned ON / OFF according to a user interaction to provide illumination in a cubic room. FIG. 9A shows a screen when a plurality of lamps 921 and 922 are turned off, and FIG. 9B shows a screen when a plurality of lamps 921 and 922 are turned on.

On the other hand, the purchase of the props may be performed through a commerce service provided on at least one of three months, but in some cases, through a commerce service provided through one of the cubic GUIs displayed in the cubic room.

According to another embodiment of the present invention, the commerce service is interlocked with actual purchase of a small commodity, and the commodity may be disposed in the month as the user purchases the actual commodity. When these virtual props are arranged in the wall and the actual props are placed in the grooves, the virtual props can operate in conjunction with the actual props placed in the grooves. For example, if the user turned on / off the lamp of the actual props, the virtual lamp could also operate the same. On the contrary, it goes without saying that the user can control the operation of the actual lamp through the virtual lamp control.

10 and 11 are views for explaining a background screen provided in a wall space according to various embodiments of the present invention.

10A and 10B, when a cubic room is displayed as a main display, a graphic effect in which current weather information is reflected may be provided in the background. For example, if it is presently raining, a rainy graphical effect is provided as shown in FIG. 10A, and a snowy graphical effect as shown in FIG. 10B can be provided. In this case, as shown in FIG. 10A, raindrops may be formed on a wall or a floor, or the rain may be actually rained or snowy as shown in FIG. 10B. Such a graphic effect may be displayed in the form of an OSD having transparency, but in some cases it may be possible to newly render and display the image.

On the other hand, when the cubic room is displayed as a main display as shown in FIGS. 11A and 11B, the wall space disappears and various background screens can be provided.

Specifically, the background corresponding to the attribute of the cubic GUI selected by the user can be displayed as shown in FIGS. 11A and 11B. For example, if the content of the SF genre is selected, a background corresponding to the genre may be provided. In this case, the displayed background may provide various animation effects.

In some cases, the background may be provided automatically when a preset event occurs in the display device 100. [ For example, if there is no user interaction over a preset time, the background may be displayed.

12 is a view for explaining functions or information that can be provided in a sealing space according to various embodiments of the present invention.

As shown in FIG. 12, when a ceiling space is displayed to the main according to a head-up interaction of a user, a function related to a category corresponding to a cubic room can be provided in the corresponding ceiling space.

In one example, as shown in FIG. 12A, the displayed cubic room corresponds to the SNS category, and at least one cubic GUI 1211, 1212 is displayed in a state where the cubic GUIs 1211 to 1219 in the cubic room represent a plurality of users After selection, when a user interaction for selecting a sealing space is received, a video call image with other selected users in the sealing space 1220 may be provided. As shown in the figure, multi-screens 1221 to 1223 may be displayed to provide other users (User 1, User 2) corresponding to the cubic GUI and user images of the display device 100, respectively.

In this case, the user interaction may be input according to the motion interaction of the remote control device 200. [

Specifically, when the time for pressing the OJ sensor provided in the remote control device 200 is longer than a preset time, the input is detected as a trigger command and the motion of the remote control device 200 is detected using the 9-axis sensor do. Also, the signal corresponding to the depressing operation is transmitted to the display device 100, and the display device 100 can display an indicator () for guiding the movement of the remote control device 200. [ In this case, the indicator may include a first indicator () indicating the movement of the remote control device 200 in each of the up, down, left, and right directions, and a second indicator () indicating the movement threshold value of the remote control device 200.

The first indicator () can change the length L according to the movement of the remote control device 200. [ For example, when the remote control device 200 moves upward after the trigger command is input, the first indicator () corresponding to the movement of the remote control device 50 among the plurality of first indicators () The length L can be changed according to the movement of the remote control device 50 moving to the remote control device 50.

In particular, when the first indicator () moves and contacts the second indicator () according to the movement of the remote control device 200, the screen of the display device 100 is switched according to the direction of movement of the remote control device 200 Command to the display device 100. [0050]

Accordingly, the screen can be switched to the sealing space 1220 and displayed.

As another example, when the displayed cubic room corresponds to the VOD category and at least one cubic GUI 1231 is selected when the cubic GUIs 1231 to 1239 in the cubic room represent content providers or contents, as shown in Fig. 12B After the user's head-up interaction is input, a screen 1241 may be displayed in the ceiling space 1240 to provide preview images, advertisement images, etc. of the contents corresponding to the cubic GUI 1231 selected.

As another example, if the displayed cubic room corresponds to the broadcast channel category and the cubic-sized GUIs 1251 to 1259 in the cubic room represent broadcast channels, if the user's head-up interaction is input, The TV schedule table 1261 can be displayed in the space 1260. Alternatively, if a head-up interaction of a user is input while a specific cubic GUI is selected, it is also possible that the schedule table of the broadcast channel indicated by the cubic GUI is displayed.

13 is a diagram for explaining functions or information that can be provided in a floor space according to various embodiments of the present invention.

13A and 13B, when a floor space is displayed as a main display according to a head-up interaction of a user, a function related to a category corresponding to a cubic room may be provided in the corresponding floor space.

For example, when the displayed cubic room corresponds to the SNS category and the cubic GUI in the cubic room represents a plurality of users, as shown in FIG. 13A, when the user interaction is input, the corresponding SNS server A music reproduction screen 1311 for controlling the music reproduction provided in the music reproduction screen 1311 may be provided. However, in some cases, the music reproduction screen may be provided in the floor area regardless of the category according to the user setting. In this case, the user interaction may be input according to the motion interaction of the remote control device 200. [ The concrete method of the motion interaction is the same as that described with reference to FIG. 12A, so a detailed description will be omitted.

13B, when the displayed cubic room corresponds to a broadcast channel category, and when a user's head-down interaction is input while a cubic GUI in a cubic room represents a broadcast channel, a floor space 1320 Cubic GUIs 1321 to 1324 indicating broadcast channels registered by the user as favorites can be displayed.

On the other hand, as shown in FIG. 13C, cubic GUIs 1331 to 1334 are displayed in the floor space 1330 displayed in the main display according to the user's head-down interaction, regardless of the category of the cubic room, It is also possible. For example, the cubic GUI 1331 belonging to the broadcast channel category, the cubic GUI 1332 belonging to the SNS category, the cubic GUI 1333 belonging to the communication category, and the cubic GUI 1334 belonging to the application category are stored in the floor space 1330, Lt; / RTI &gt;

14 is a flowchart for explaining a UI providing method according to an embodiment of the present invention.

According to the UI screen providing method of the display apparatus shown in Fig. 14, first, a UI screen composed of a plurality of spatial elements constituting a three-dimensional space is displayed (S1410).

Then, a user interaction with the UI screen is received (S1420).

Thereafter, if at least one spatial element of the plurality of spatial elements is displayed in the main space according to the received user interaction, the UI screen corresponding to the main space is provided (S1430).

Here, the plurality of spatial elements may include a ceiling, a wall, and a floor.

Also, the UI screen corresponding to the main space may provide at least one of information, functions, and services corresponding to spatial elements displayed in the main space.

Also, when the sealing part is displayed in the main space according to the user interaction, a UI screen for providing information service can be displayed. In this case, the information service may include a weather information providing service.

Also, if the month portion is displayed in the main space according to the user interaction, the UI screen providing the commerce service can be displayed.

Also, when the floor part is displayed in the main space according to the user interaction, the UI screen providing the control service can be displayed. In this case, the control service may include at least one of a home device control service and a home security control service.

On the other hand, with the month portion displayed as the main space, the user interaction for displaying the ceiling portion into the main space is the head up interaction of the user, and the user interaction for displaying the floor portion into the main space, It can be a head down interaction.

Also, it is possible to display the background information of the space element by reflecting the external environment information.

15 is a flowchart illustrating a UI screen providing method according to another embodiment of the present invention.

According to the UI screen providing method shown in FIG. 15, the user interaction is received while the wall space is displayed as the main space (S1510). Here, the wall space may be a space of three months, that is, the cubic room space described above.

Then, it is determined whether the received user interaction is a head-up interaction (S1520).

If it is determined in step S1520 that the head-up interaction is determined (Y in step S1520), the sealing part displays the main space and provides the corresponding service (or information).

If it is determined in step S1520 that it is not a head-up interaction (S1520: N), it is determined whether the head-down interaction is a head-down interaction (S1540).

If it is determined in step S1540 that the head-down interaction is determined (Y in step S1540), the floor part is displayed in the main space and provided with the corresponding service (or information) (step S1550).

According to an embodiment of the present invention, when a sealing part is displayed in a main space, an information service is provided, a floor part is displayed in a main space, a control service is provided, and a monthly service is provided in a wall part. But is not limited thereto.

That is, according to another embodiment of the present invention, it is also possible to display a content playback screen such as a video call function, a video playback function, and the like in a sealing portion.

However, this is merely an example, and it may be a pointing up motion for pointing the remote controller, which is a user interaction for displaying the sealing portion into the main space, and the floor portion may be a user interaction for displaying the main space, Pointing down motion.

 Meanwhile, the stellar GUI according to an embodiment of the present invention can be implemented in the form of an application, which is software that is directly used by a user on an OS. In addition, the application may be provided in the form of an icon interface on the screen of the display device 100, but is not limited thereto.

INDUSTRIAL APPLICABILITY As described above, according to the present invention, different information, functions or services can be provided only by a simple user interaction, thereby improving user's convenience.

Meanwhile, the method of controlling a display device according to various embodiments of the present invention described above may be embodied in computer-executable program code to be executed by a processor in a state stored in various non-transitory computer readable media. And may be provided to each server or devices.

For example, a user interaction on a three-dimensional UI screen composed of a plurality of spatial elements constituting a three-dimensional space is received, and when at least one spatial element is displayed in the main space according to the received user interaction, A non-transitory computer readable medium may be provided in which a program for performing a step of creating a UI screen corresponding to a non-transitory computer readable medium is stored.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

110: display unit 120: user interface unit
130: control unit 140:

Claims (19)

A storage unit for storing a plurality of regions mapped to a plurality of user's eyes;
A display unit;
A user interface unit for receiving a user interaction; And
A control unit for displaying a first area corresponding to a user's viewpoint among the plurality of areas as a main area and controlling the display unit to display a part of the second area around the main area; Lt; / RTI &gt;
Wherein,
When the user viewpoint is changed according to the user interaction while the first area is displayed in the main area, the second area is displayed as a main area according to the changed user time point, and the service mapped to the second area Controls the display to automatically display a UI screen associated with one of the UI screens,
Wherein one of the services is executed by information received from an external service providing server. The method according to claim 1,
Wherein the plurality of regions include:
A ceiling, a wall and a floor,
The UI screen includes:
And provides at least one of information, functions, and services corresponding to the second area. 3. The method of claim 2,
Wherein,
And controls to display a UI screen for providing an information service when the sealing portion is displayed in the main area according to the user interaction. The method of claim 3,
Wherein the information service includes a weather information providing service. 3. The method of claim 2,
Wherein,
And controls to display a UI screen for providing a commerce service when the month portion is displayed in the main area according to the user interaction. 6. The method of claim 5,
The commerce service,
And the virtual goods purchase and the actual product purchase are interlocked with each other. 3. The method of claim 2,
Wherein,
And controls to display a UI screen providing a control service when the floor portion is displayed in the main area according to the user interaction. 8. The method of claim 7,
The control service,
A home device control service, and a home security control service. 3. The method of claim 2,
The user interface unit,
Receiving a user interaction along a head direction of the user,
Wherein,
With the month portion displayed as the main area, when the user's head up interaction is received, the ceiling portion is displayed as the main area, and when the user's head down interaction is received, the floor portion is displayed as the main area And controls the display device. The method according to claim 1,
Wherein,
The external environment information, and the content type based on at least one of the external environment information and the content type. A method of providing a UI screen of a display device,
Storing a plurality of regions mapped to a plurality of user's eyes;
Receiving a user interaction;
Displaying a first area corresponding to a user's viewpoint among the plurality of areas in the main area and displaying a part of the second area around the main area; And
If the user viewpoint is changed according to the user interaction while the first area is displayed in the main area, displaying the second area as a main area according to the changed user time point, Automatically displaying a UI screen associated with one of the services; Lt; / RTI &gt;
Wherein one of the services is executed by information received from an external service providing server. 12. The method of claim 11,
Wherein the plurality of regions include:
A ceiling, a wall and a floor,
The UI screen includes:
And providing at least one of information, functions, and services corresponding to the second area. 13. The method of claim 12,
And displaying a UI screen for providing an information service when the sealing part is displayed as a main area according to the user interaction. 14. The method of claim 13,
Wherein the information service includes a weather information providing service. 13. The method of claim 12,
Wherein the providing of the UI screen corresponding to the main area comprises:
And displaying a UI screen for providing a commerce service when the month portion is displayed in the main area according to the user interaction. 13. The method of claim 12,
Wherein the providing of the UI screen corresponding to the main area comprises:
Wherein when the floor portion is displayed in the main area according to the user interaction, a UI screen providing a control service is displayed. 17. The method of claim 16,
The control service,
A home device control service, and a home security control service. 13. The method of claim 12,
The user interaction for displaying the ceiling portion as a main area is a head up interaction of the user and the user interaction for displaying the floor portion as a main area is a user's head down and a head down interaction. 12. The method of claim 11,
And displaying background elements based on at least one of the external environment information and the content type.

Images