Hereinafter, the present invention will be described in more detail with reference to the drawings. 1 is a block diagram briefly showing a configuration of a display device 100 according to an embodiment of the present invention. 1, the display device 100 includes a first display unit 110, a second display unit 120, an input unit 130, and a control unit 140.
The first display unit 110 outputs image data under the control of the control unit 140. In particular, the first display unit 110 may display image content as a main display. For example, the first display unit 110 may display image contents such as broadcast contents, VOD contents, and the like.
Particularly, the first display unit 110 may be implemented as a liquid crystal display (LCD), but it is not limited to a CRT (Cathode-Ray Tube), a PDP (plasma display panel), an OLED Emitting Diode) type display.
The second display unit 120 is located outside the first display unit 110 and outputs image data. In particular, the second display unit 120 may display a UI for controlling the display device 100. [ For example, the second display unit 120 may display a content search UI for content search and a setting change UI for changing settings of the display device 100. [
In particular, the second display unit 120 may be implemented as a projector display for displaying an image on the outer periphery of the first display unit 110, as shown in FIG. 2. However, Display, and the like.
The input unit 130 receives a user command for controlling the display device 100. In particular, the input unit 130 may include a user command for displaying a UI for controlling the display device 100 on the second display unit 120, a user command for moving the pointer, a user command for selecting a display item, Input can be received.
The input unit 130 may be implemented as a motion input unit for sensing a hand motion of a user. However, the input unit 130 may be implemented by various input devices such as a remote controller having a touch panel or a button, a pointing device, a mouse, .
The control unit 140 controls the display device 100 according to a user command input through the input unit 130. [ In particular, when a user command is inputted through the input unit 130 while contents are displayed on the first display unit 110, the controller 140 controls the second display unit 120 to display a UI for controlling the display device 100 The second display unit 120 may be controlled to display the second display unit 120. [
The control unit 140 controls the display unit 100 to search for content in the upper area of the first display unit 100. In this case, The second display unit 130 may be controlled to display the UI.
At this time, the content search UI may include at least one display item corresponding to the first content type. For example, the content search UI may include at least one display item corresponding to broadcast content.
When a specific user command is input through the input unit 130 while at least one display item corresponding to the first content type is displayed, the controller 140 displays at least one display item corresponding to the second content type in the content search UI The second display unit 120 may be controlled to display the second display unit 120. [ For example, when at least one display item corresponding to the broadcast content is displayed in the content search UI, when a specific user command is input through the input unit 130, the control unit 140 displays at least one display item corresponding to the VOD content The second display unit 120 may be controlled to display the second display unit 120. [
In addition, when a specific user command is input through the input unit 130 while the content search UI is being displayed, the control unit 140 displays a highlight on one of the at least one display items displayed in the content search UI, The second display unit 120 may be controlled to display information on the content corresponding to the highlighted display item. For example, when an OK button is selected while the content search UI is displayed, the control unit 140 displays a highlight on a display item corresponding to the "A" broadcast program among at least one display item included in the content search UI, The second display unit 120 can be controlled to display summary information (e.g., title, channel, broadcast time, etc.) for the "A" broadcast program at the bottom of the highlighted display item.
If one of the at least one display items included in the content search UI displayed on the second display unit 120 is selected through the input unit 130, the control unit 140 displays the content list corresponding to the selected display item The first display unit 110 can be controlled. For example, when a display item corresponding to the "latest movie" among the display items included in the content search UI displayed on the second display unit 120 is selected, the control unit 140 controls the first display The control unit 110 can control the display unit.
If one of the plurality of contents displayed in the contents list is selected, the control unit 140 displays a screen corresponding to the selected contents on the first display unit 110, and displays a screen corresponding to a part of the non- Can be displayed on the display unit 120. For example, when the first movie content among a plurality of movie content displayed on the latest movie list is selected, the control unit 140 displays the guide screen on the first movie content on the first display unit 110, The guide screen for the second movie content can be displayed in the left area of the second display unit 120 and the guide screen for the third movie content can be displayed in the right area of the second display unit 120. [
A screen corresponding to the selected content is displayed on the first display unit 110. While a screen corresponding to a part of the unselected contents is displayed on the second display unit 120, The control unit 140 moves the screen corresponding to one of the contents displayed on the second display unit 120 to the first display unit 110 and displays the content displayed on the first display unit 110 It is possible to move the corresponding screen to the second display unit 120. For example, a guide screen for the first movie content is displayed on the first display unit 110, a guide screen for the second movie content is displayed on the left area of the second display unit 120, The control unit 140 controls the first display unit 110 to display the first movie content displayed on the first display unit 110 in response to a movement instruction to the left while the guide screen for the third movie content is displayed in the right area of the first display unit 110, The guide screen is moved to the left area of the second display unit 120 and the guide screen for the third movie content displayed in the right area of the second display unit 120 is displayed on the first display unit 110, The guide screen for the new fourth movie content can be displayed on the right area of the second display unit 120. [
That is, as described above, the first display unit 110 and the second display unit 120 can operate in cooperation with each other by a user command.
When a user command is input through the input unit 130 while the broadcast content is being displayed on the first display unit 110, the control unit 140 controls the left and right sides of the first display unit 110, It is possible to control the second display unit 120 to display a channel search UI for searching another channel in the region.
At this time, the channel search UI includes at least one display item corresponding to at least one channel, and the control unit 140 controls the second display unit 120 to display a broadcast program corresponding to each of the at least one display item in real- Can be controlled.
In addition, when a specific user command is input through the input unit 130 while contents are displayed on the first display unit 110, the controller 140 displays a pointer on the display screen. When a user command for moving the pointer to the second display unit 120 is inputted through the input unit 130, the controller 140 displays only the area where the pointer is located among the UIs for controlling the display device 100 A preview function can be provided.
Specifically, the second display unit 120 does not display an image while contents are displayed on the first display unit 110. In this case, when a user command for creating a pointer is input, the controller 140 may display a pointer on an arbitrary area of the display screen including the first display unit 110 and the second display unit 120. [ When a user command for moving the pointer to the second display unit 120 is input through the input unit 140, the controller 140 moves the pointer to the second display unit 120. [ At this time, the control unit 140 may control the second display unit 120 to display a UI for controlling the display device 100 only in the area where the pointer is moved. That is, the control unit 140 can display a preview image only in a region where the pointer is located, thereby providing a preview function for the UI for controlling the display device 100 to the user.
When a preset user command (e.g., a command for selecting an OK button) is input while the preview function is performed using the pointer, the controller 140 controls the display device 100 The second display unit 120 may be controlled to display a UI for controlling the second display unit 120. [
When a user command is input through the input unit 130 while contents are displayed on the first display unit 110, the controller 140 controls the display unit 100 to change the setting of the display device 100 The second display unit 120 may be controlled to display the setting change UI. For example, the control unit 140 may control the second display unit 120 to display a UI for changing the audio volume setting of the display device 100 on the second display unit 120. For example,
The control unit 140 may control the content of the first display unit 110 according to a user command input through the UI for controlling the display device 100. [ For example, the control unit 140 may change the content of the first display unit 110 to another content using the content search UI. Also, the control unit 140 can change the setting of the content of the first display unit 110 using the setting change UI.
With the above-described electronic device, the user can continue to watch the content currently being watched, retrieve the content, or change settings of the display device.
Hereinafter, the display device 100 will be described in more detail with reference to FIGS. 3 to 18C.
3 is a block diagram showing the configuration of the display device 100 in detail, according to an embodiment of the present invention. 3, the display apparatus 100 includes a sensing unit 105, a broadcast receiving unit 150, a communication unit 160, a first display unit 110, a second display unit 120, A terminal 170, a storage unit 180, a power supply unit 190, and an input unit 130.
FIG. 3 is a schematic view illustrating various components in the case where the display device 100 is a device having various functions such as a content providing function, a user recognizing function, a display function, and the like. Therefore, depending on the embodiment, some of the components shown in Fig. 3 may be omitted or changed, and other components may be further added.
The sensing unit 110 senses whether or not the user is approaching the display device 100. Specifically, the sensing unit 110 may photograph a predetermined area around the display device 100 using a camera. If a person is detected during the photographing of the predetermined area, the sensing unit 110 may determine that the user is in proximity to the display device 100.
Meanwhile, it is only one embodiment that the sensing unit 110 determines whether the user is close to the display device 100 by using the camera. By using at least one of the local communication module, the infrared sensor, and the audio sensor, It is possible to judge whether the display device 100 is close to the display device 100 or not.
The control unit 140 controls the second display unit 120 to display at least a display item for controlling the display device 100 in a case where the display device 100 determines that the user is approaching through the sensing unit 110 The second display unit 120 can be controlled.
The broadcast receiver 150 can receive broadcast content from an external broadcast station in real time. In particular, the broadcast receiver 150 may select a broadcast channel selected by the user and receive a broadcast program of the selected broadcast channel.
The communication unit 160 is configured to perform communication with various types of external devices according to various types of communication methods. The communication unit 160 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, an NFC chip, a wireless communication chip, and the like. At this time, the Wi-Fi chip, the Bluetooth chip, and the NFC chip communicate with each other using the WiFi method, the Bluetooth method, and the NFC method. Among these, the NFC chip refers to a chip operating in an NFC (Near Field Communication) system using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz and 2.45 GHz. When a Wi-Fi chip or a Bluetooth chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), LTE (Long Term Evolution)
The first display unit 110 outputs image data under the control of the controller 140. In particular, the first display unit 110 may display image contents received from the broadcast receiver 150, the communication unit 160, and the external device input terminal 170.
The second display unit 120 may display image data on the outer periphery of the first display unit 110. In particular, the second display unit 110 may display a UI for controlling the display device 100, such as a setting change UI for changing the setting of the display device 100, a content search UI for searching for the content, .
Particularly, the first display unit 110 and the second display unit 120 can distinguish display areas as shown in FIG. The first display unit 110 may be divided into a main content viewing area 440 and an upper area of the second display unit 120 may include a main menu control area 410, a second display unit 120, The left area of the second display part 120 is the sub control area 420-2 and the lower area of the second display part 120 is the information display area 430 ).
Particularly, the first display unit 110 may be implemented as a liquid crystal display (LCD), but it is not limited to a CRT (Cathode-Ray Tube), a PDP (plasma display panel), an OLED The second display unit 120 may be implemented as a projector display for displaying an image on the outer periphery of the first display unit 110 as shown in FIG. 2 , Which can be implemented in various display devices such as a transparent display and the like, and only one embodiment.
The external device input terminal 170 is connected to an external device and receives image contents from the external device. Also, the external device input terminal 170 can transmit a user command input through the input unit 130 to an external device.
The storage unit 180 stores various modules for driving the display device 100. For example, the storage unit 180 may store software including a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module. In this case, the base module is a base module that processes a signal transmitted from each hardware included in the display device 100 and transmits the signal to an upper layer module. The sensing module is a module for collecting information from various sensors and analyzing and managing the collected information, and may include a face recognition module, a voice recognition module, a motion recognition module, and an NFC recognition module. The presentation module is a module for constructing a display screen, and may include a multimedia module for reproducing and outputting multimedia contents, a UI, and a UI rendering module for performing graphics processing. The communication module is a module for performing communication with the outside. A web browser module refers to a module that accesses a web server by performing web browsing. A service module is a module including various applications for providing various services.
As described above, the storage unit 180 may include various program modules, but it is needless to say that the various program modules may be omitted, modified or added depending on the type and characteristics of the display device 100. For example, when the display device 100 is implemented as a smartphone, the base module may further include a position determination module for determining a GPS-based position, and the sensing module may further include a sensing module can do.
The power supply unit 190 supplies power to the configuration of the display device 100. Particularly, while the display device 100 maintains the standby mode, the power supply unit 190 supplies power only to the sensing unit 110, and may not supply power to the remaining components. When the user is sensed through the sensing unit 110, the power supply unit 190 may supply power to the control unit 140 to activate the control unit 140. The power supply unit 190 may supply power to the overall configuration of the display device 100 during the normal mode in which the display device operates normally.
The input unit 130 receives a user command for controlling the display device 100. In particular, the input unit 130 may be implemented as a motion input unit that inputs a user command using a user's hand gesture.
In particular, the input unit 130 may display an image (e.g., a continuous frame) corresponding to a user's motion input through the camera with a surrounding background using a motion recognition module (e.g., And holding the fist), and can recognize the movement of the consecutive hands.
Specifically, when the user motion is photographed, the input unit 130 senses an object (e.g., a user's hand) that is an object of the user's motion using the received image. The input unit 130 detects at least one of the shape, color, and motion of the object included in the frame to detect the object. The input unit 130 can track the movement of the detected object using the positions of the respective objects included in the plurality of frames.
The input unit 130 determines the motion according to the shape and motion of the tracked object. For example, the input unit 130 determines the motion of the user using at least one of a change in shape, speed, position, and orientation of the object. The user's motion includes a grab that is a motion of a hand, a pointing movement that is a motion that moves a displayed cursor by hand, a slap that is a motion that moves the hand in one direction beyond a certain speed, A shake that is a motion that swings up / down or up / down, and a rotation that is a motion of rotating the hand. The technical idea of the present invention can be applied to motions other than the above-described embodiments. For example, a spread motion that stretches a hand may be further included.
The input unit 130 determines whether the object is out of the determined area (for example, a square of 40 cm x 40 cm) within a predetermined time (for example, 800 ms) to determine whether the motion of the user is a pointing movement or a slap . If the object does not deviate from the determined area within the determined time, the input unit 130 may determine the user's motion as a pointing movement. If the object is out of the determined area within the determined time, the input unit 130 may determine the motion of the user as a slab. In another example, when it is determined that the velocity of the object is equal to or less than a predetermined velocity (for example, 30 cm / s), the input unit 130 determines the motion of the user as a pointing movement. If it is determined that the speed of the object is higher than the predetermined speed, the input unit 130 determines the motion of the user as a slab. The input unit 130 performs the function or task of the display device 100 using the recognized hand gesture as described above.
5A is a diagram for explaining a function of a display device according to a hand gesture according to an embodiment of the present invention. As shown in FIG. 5A, a hand gesture that moves after a hand moves a pointer to a desired position, and a hand gesture that grips a fist can select an item and moves up or down with the fist held , A hand gesture that moves left or right while holding a fist vertically can perform a scroll function. In addition, the hand gesture for rotating the hand can be moved to the previous menu.
However, as described above, the input unit 130 inputs a user command using a hand gesture of a user, and is not limited to a specific embodiment. Various input devices such as a pointing device, a voice recognition device, a mouse, a touch panel, Can be used to input a user command. 5B, the input unit 130 can receive various user commands using the touch panel provided on the remote controller. Also, as shown in FIG. 5C, the input unit 130 can receive various user commands using a plurality of buttons provided on the remote controller.
Also, the input unit 130 receives a user command for moving the pointer. At this time, the controller 140 may place the pointer on one of the first display unit 110 and the second display unit 120 according to a user command inputted through the input unit 130. [ A method of displaying the pointer by the control unit 140 will be described with reference to FIGS. 6A and 6B.
First, the control unit 140 determines whether the user motion is recognized (S610). At this time, the user motion may be a user's hand gesture (e.g., a hand gesture in which the user shakes his / her hand three or more times to generate a pointer).
If the user motion is recognized (S610-Y), the control unit 140 generates a pointer on the display screen (S620). At this time, the controller 140 may display a pointer on one of the first display unit 110 and the second display unit 120. [
Then, the controller 140 determines whether a pointer movement command is input (S630). At this time, the pointer movement command may be a hand gesture for moving the hand.
If the pointer movement command is inputted (S630-Y), the controller 140 determines whether the pointer position according to the pointer movement command is located on the first display 110 (S640).
If the pointer is located on the first display unit 110 (S640-Y), the controller 140 displays the pointer on the first display unit 110 (S650). Specifically, the control unit 140 may control the first display unit 110 to display a pointer at a position (2) in FIG. 6B.
If the pointer is not positioned on the first display unit 110 (S640-N), the controller 140 determines whether the pointer is positioned on the second display unit 110 (S660).
If the pointer is located on the second display unit 110 (S660-Y), the controller 140 displays the pointer on the second display unit 120 (S670). Specifically, the control unit 140 may control the second display unit to display the pointer at the position of (1) in FIG. 6B.
However, if the pointer is not positioned on the second display unit 120 (S660-N), the control unit controls the first display unit 110 and the second display unit 120 to display the pointer on the boundaries of the first display unit 110 and the second display unit 120, The first display unit 110 and the second display unit 120 can be controlled. Specifically, the control unit 140 may control the first display unit 110 and the second display unit 120 to display a pointer at a position (3) in FIG. 6B. At this time, the controller 140 may control the ratio of the pointer displayed on the first display unit 110 and the displayed pointer on the second display unit 120 to different from each other according to a user command.
The display apparatus 100 can position the pointer on one of the first display unit 110 and the second display unit 120 by the pointer positioning method as described above.
The control unit 140 controls the overall operation of the display device 100 according to a user command input through the input unit 130. [ In particular, when a user command is input through the input unit 130, the controller 140 controls the second display unit 120 to display a UI for controlling the display device 100 on the second display unit 120 .
7A, when the user inputs a UI generation command through the input unit 130 while displaying the image content on the first display unit 110, the controller 140 displays the UI content The user can control the second display unit 120 to display the content search UI 700 for content search in the upper area of the second display unit 120 as shown in FIG.
At this time, the content search UI 700 can be categorized according to the content type. 7B, the control unit 140 controls the second display unit 120 to categorize and display the plurality of display items 710-1 to 710-15 corresponding to the broadcast contents, for example, can do. At this time, as shown in FIG. 7B, a plurality of broadcast contents can be displayed by being sorted by time zone. Specifically, in the first column, display items 710-1 to 710-5 corresponding to broadcast contents currently broadcasted are displayed. In the second column, display items 710-6 (corresponding to broadcast contents broadcasted at 9:00 pm) 710-10) and display items 710-11 to 710-15 corresponding to the broadcast contents broadcasted at 10:00 pm may be displayed in the third column.
The control unit 140 may control the second display unit 120 to display icons 720 and 730 for displaying the display items corresponding to different content types. For example, the control unit 140 can control the second display unit 120 to display the icon 720 corresponding to the SNS content and the icon 730 corresponding to the movie content, as shown in FIG. 7B have.
In addition, when a specific user command is input, the controller 140 removes at least one display item corresponding to the first content type, and displays at least one display item corresponding to the second content type in the content search UI 700 The second display unit 120 may be controlled to display the second display unit 120. [ For example, when the icon 730 corresponding to the movie content is selected, the controller 140 displays a plurality of display items 730-1 through 730-11 corresponding to the movie content, as shown in FIG. 7C, The second display unit 120 can be controlled. 7B, the controller 1430 displays the icon 710 corresponding to the broadcast content and the icon 740 corresponding to the My content stored by the user on the second display unit 120 Can be controlled. 7D, when the icon 740 corresponding to the content is selected, the controller 140 displays a plurality of display items 740-1 to 740-0 corresponding to the content, 2 display unit 120 can be controlled. 7D, when the icon 730 corresponding to the movie content is selected while the content search UI 700 is displayed, the control unit 140 displays the content search UI 700 (FIG. 7C) ) Of the second display unit. 7C, when the icon 710 corresponding to the broadcast content is selected while the content search UI 700 is displayed, the control unit 140 displays the content search UI 700 (FIG. 7B) ) Of the second display unit.
In addition, when a specific user command is input through the input unit 130 while the content search UI is being displayed, the control unit 140 displays a highlight on one of the at least one display items displayed in the content search UI 700, The second display unit 120 may be controlled to display information on the content corresponding to the highlighted display item in the vicinity of the displayed display item. For example, as shown in FIG. 7E, when a user command for selecting an OK button of the remote controller is input while the content search UI 700 is displayed, as shown in FIG. 7F, 1 display item 710-1 and information about broadcast contents corresponding to the first display item 710-1 at the lower end of the first display item 710-1 (E.g., name, broadcast time, etc.) 711 of the second display unit 120. 7F, when the up-shift command (for example, the command for selecting the upper button of the remote controller) is input while the content search UI 700 is displayed, As shown, a highlight is displayed on the sixth display item 710-6, and information on broadcast contents corresponding to the sixth display item 710-6 on the lower side of the sixth display item 710-6 The second display unit 120 may be controlled to display the first display unit 712. At this time, the display items 710-1 to 710-5 corresponding to the broadcast contents currently being broadcast are removed, and the display items 710-16 to 710-20 corresponding to broadcast contents broadcasted at 11:00 pm And may be displayed on the second display unit 120. 7 (g), when the right movement instruction (for example, a command in which the right button of the remote control is selected, etc.) is input while the content search UI 700 is displayed, As shown, a highlight is displayed on the seventh display item 710-7, and information on broadcast contents corresponding to the seventh display item 710-7 is displayed on the lower side of the seventh display item 710-7 The second display unit 120 may be controlled so as to display the first display unit 713. When a selection command (for example, a command for selecting an OK button of the remote controller, a hand gesture for grabbing a user's hand, etc.) is input while the content search UI 700 shown in FIG. 7H is displayed, the controller 140 (E.g., a channel name, a program name, a broadcast time, a plot, and the like) for the seventh display item 710-7, an icon for reserved viewing, The second display unit 120 may be controlled to display the guide display item 714 including the icon. 7 (i), when the right movement command (for example, a command in which the right button of the remote controller is selected, etc.) is input while the content search UI 700 is being displayed, As shown, a guide including detailed information (e.g., channel name, program name, broadcast time, plot, etc.) for the eighth display item 710-8, an icon for reservation viewing, The second display unit 120 may be controlled to display the display item 715. When a previous command (for example, a command for selecting a previous button of the remote controller, a hand gesture for rotating the user's hand, etc.) is input while the content search UI 700 shown in FIG. 7J is displayed, the controller 140 Displays a highlight on the eighth display item 710-8 as shown in FIG. 7K, and a highlight on the eighth display item 710-8 on the bottom of the eighth display item 710-8, The second display unit 120 may be controlled to display information 716 on the content.
When a specific user command is input through the input unit 130 while the broadcast content is displayed on the first display unit 110, the controller 140 controls the other channel to the left or right area of the second display unit 120 The second display unit 120 may be controlled to display a channel search UI for searching. For example, as shown in FIG. 8A, when a channel search command (for example, a command to select a channel search button of a remote controller) is input through the input unit 130 while the broadcast content is displayed on the first display unit 110, The control unit 140 controls the second display unit 120 to display a channel search UI 800 for channel search in the right area of the second display unit 120 as shown in FIG. can do. At this time, the channel search UI 800 may include first to third display items 810, 820 and 830 corresponding to a plurality of channels. 8B, when two up-shift commands (for example, a command in which the upper button of the remote controller is selected twice) are input while the channel search UI 800 is displayed, the controller 140 may control the second display portion 120 to display the first, fourth, and fifth display items 810, 840, 850, as shown in Figure 8C. 8C, when a selection command (for example, a command for selecting an OK button of a button) is input while the channel search UI 800 is displayed, the controller 140, as shown in FIG. 8D, The first display unit 110 may be controlled to display a broadcast channel corresponding to the fourth display item 840 in which the highlight is displayed.
If one of the at least one display items displayed in the content search UI is selected through the input unit 130, the control unit 140 controls the first display unit 110 to display the content list corresponding to the selected display item can do. For example, when a selection command (e.g., a command for selecting an OK button of the remote controller) is input while the content search UI 900 is displayed as shown in FIG. 9A, As shown, a highlight is displayed on the first display item 910-1, and information corresponding to the first display item 910-1 (for example, The number of files, and the like). 9B, when a selection command (for example, a command for selecting an OK button of the remote controller) is input while the content search UI 900 is displayed, The first display unit 110 may be controlled to display the latest movie list 940 including the latest movie content corresponding to the first display item 910-1. At this time, the latest movie list 940 includes the first to tenth movie items 940-1 to 940-10, and a highlight can be displayed on the first movie item 940-1. 9C, when the right movement command (for example, a command in which the right button of the remote control is selected, etc.) is input while the latest movie list 940 is displayed, the control unit 140 As shown in FIG. 9D, the first display unit 110 may be controlled such that the highlight is moved to the second movie item 940-2.
If one of the plurality of contents displayed in the contents list is selected, the control unit 140 displays a screen corresponding to the selected contents on the first display unit 110, and displays a screen corresponding to a part of the non- And to display it on the second display unit 120. For example, when a selection command (e.g., a command for selecting an OK button of the remote controller) is input while the latest movie list 940 as shown in FIG. 9D is displayed, , The first display unit 110 is controlled to display a detailed information screen corresponding to the selected second movie item 940-2 and the first movie item 940-1 To display on the left side of the second display unit 120 and a screen corresponding to the third movie item 940-3 on the right side of the second display unit 120 120). At this time, the screens corresponding to the first movie item 940-1 and the third movie item 940-3 may be poster screens of the first and third new movies, but this is only an example, And may be a detailed information screen as displayed on the first display unit 110. [ 9E, when the right movement instruction (for example, a command for selecting the right button of the remote control) is input, the control unit 140 displays the third movie Controls the first display unit 110 to display a detailed information screen corresponding to the item 940-3 and displays a screen corresponding to the second movie item 940-2 on the left side of the second display unit 120 And controls the second display unit 120 to display a screen corresponding to the fourth movie item 940-4 on the right side of the second display unit 120. [ That is, the control unit 140 can display the contents by interlocking the first display unit 110 and the second display unit 120 in searching contents. 9F, when the playback command (for example, when the playback icon is selected) is input, the controller 140 displays the playback screen 950 of the third latest movie, as shown in FIG. 9G, The first display unit 110 may be controlled to display the first display unit 110. [ 9G, when a rightward movement command (for example, a command for selecting the right button of the remote controller) is input while the playback screen 950 of the third latest movie is displayed, The controller 140 controls the first display unit 110 to display the fourth latest movie playback screen 960 and the screen corresponding to the third movie item 940-3 as shown in FIG. It is possible to control the second display unit 120 to display on the left side of the second display unit 120 and display the screen corresponding to the fifth movie item 940-5 on the right side of the second display unit 120 have. 9H, when a return command (for example, a command for selecting a previous button of the remote controller, etc.) is input while the playback screen 960 of the fourth latest movie is displayed, the controller 140 displays, The first display unit 110 may be controlled to display the detailed information screen 940-4 corresponding to the fourth latest movie, as shown in FIG. 9I.
10A, the image content is displayed on the first display unit 110, while the content search UI 1000 is displayed on the second display unit 120, The control unit 140 controls the second display unit 120 to display a highlight on the first display item 1010-1, as shown in FIG. 10B, Can be controlled. 10B, when a selection command (for example, a command for selecting an OK button of the remote controller) is input while the content search UI 1000 is being displayed, The first display unit 110 may be controlled to display the latest content list 1040 including the latest content corresponding to the first display item 1010-1. At this time, the latest content list 1040 includes first to eighth content items 1040-1 to 1040-8, and a highlight can be displayed on the first content item 1040-1. When a selection command (for example, a command for selecting an OK button of the remote controller) is input while the latest contents list 1040 as shown in FIG. 10C is displayed, the controller 140 displays The first display unit 110 controls the first display unit 110 to display a screen corresponding to the selected first content item 1040-1 and the second display unit 110 corresponding to the 23rd content item 1040-23 among the unselected content items The second display unit 120 is controlled to display a screen on the left side of the second display unit 120 and a screen corresponding to the second content item 1040-2 on the right side of the second display unit 120 can do. At this time, information such as title, creation date and time of the content can be displayed on the lower part of the screen corresponding to the second content item 1040-2 and the 23rd content item 1040-23. 10D, when the right movement command (for example, a command for selecting the right button of the remote controller) is input, the controller 140 displays the second content Controls the first display unit 110 to display a screen corresponding to the item 1040-2 and displays a screen corresponding to the first content item 1040-1 on the left side of the second display unit 120 The second display unit 120 may be controlled to display a screen corresponding to the third content item 1040-3 on the right side of the second display unit 120. [ That is, the control unit 140 can display the contents by interlocking the first display unit 110 and the second display unit 120 in searching contents.
In addition, when a specific user command is input through the input unit 130 while contents are displayed on the first display unit 110, the controller 140 can display a pointer on the display screen. When a user command for moving the pointer to the second display unit 120 is inputted through the input unit 130, the controller 140 displays only the area where the pointer is located among the UIs for controlling the display device 100 A preview function can be provided. For example, as shown in FIG. 11A, when a predetermined user command (for example, a hand gesture that shakes the user's hand in left and right directions) is input while the image content is displayed on the first display unit 110 , The control unit 140 may control the second display unit 120 to display the pointer 1110, as shown in FIG. 11B. At this time, the pointer 1110 is displayed on the second display unit 120 only in an embodiment, and may be displayed in any one of the first display unit 110 and the second display unit 120. 11B, when a predetermined command of the user (e.g., a hand gesture hand held by the user) is input while the pointer 1110 is displayed on the second display unit 120, The control unit 140 may control the second display unit 120 to display only the area where the pointer 1110 is located in the channel search UI, as shown in FIG. 11C. The control unit 140 controls the second display unit 120 to display only the area where the pointer 1110 is located according to the position of the pointer 1110. In this case, can do. 11C, a selection command (for example, a hand gesture that the user grasps and re-grasps) is displayed while only the area of the second display unit 120 where the pointer 1110 is located is displayed The control unit 140 may control the second display unit 120 to display the channel search UI 1130 on the right area of the second display unit 120 as shown in FIG. 11D, when a user command to move the pointer 1110 to the upper area of the second display unit 120 is input while the channel search UI 1130 is displayed, the controller 140 The second display unit 120 may be controlled to display the pointer 1110 in the upper area of the second display unit 120 according to a user command, as shown in FIG. 11E. 11E, when the user's predetermined command (e.g., a hand gesture that the user grasps) is displayed while the pointer 1110 is displayed in the upper area of the second display portion 120, The control unit 140 may control the second display unit 120 to display only the area where the pointer 1110 is located in the content search UI, as shown in FIG. 11F. As shown in FIG. 11F, during the display of only the area where the pointer 1110 is positioned in the upper area of the second display unit 120, a selection instruction (for example, a hand gesture The control unit 140 controls the second display unit 120 to display the content search UI 1140 in the upper area of the second display unit 120 as shown in FIG. .
When a predetermined user command is input while the image content is being displayed on the first display unit 110, the controller 140 displays the image content related to the image content displayed on the first display unit 110 , Previous sequential image content, and the like). For example, when a pre-set command of the user (for example, a command for selecting a re-view button provided on the remote controller, etc.) is input while nine image contents of "winter" are displayed on the first display unit 110 12A, the control unit 140 displays the previous sequential image contents 1200-1 to 1200-4 of the "winter" image content currently displayed in the upper area of the second display unit 120 And displays broadcast information 1210 capable of viewing image content related to the "winter" image content currently displayed in the right area of the second display unit 120. The second display unit 120 Can be controlled. When a selection command (for example, a command for selecting an OK button of the remote controller) is input while a highlight is displayed on the first last-rotation image content 1200-1, The first display unit 110 may be controlled to display an inquiry message 1220 inquiring whether or not to record the currently displayed image content. If a user command is input through the inquiry message 1220, the control unit 140 may control the first display unit 110 to display the selected first last-turn image content 1200-1. Meanwhile, in the above-described embodiment, a UI capable of searching for image content related to the currently displayed image content is displayed. However, this is merely an example, and a UI for searching for content recorded by a user Embodiments for displaying may also be included in the technical idea of the present invention.
In addition, the control unit 140 may control the first display unit 120 to recognize the user and provide a content search UI corresponding to the user. For example, when the first user (Jessie) and the second user (Mike) are recognized by the camera, the control unit 140 displays the display items 1310-1 to 1310- 1310-5 corresponding to the first user, the display items 1310-6 through 1310-10 corresponding to the first user, and the display items 1310-11 through 1310-15 corresponding to the second user, 120).
In addition, the controller 140 may control the second display unit 120 to display a recommendation list in which the broadcast contents in the same time zone are arranged in the order of highest ratings. For example, as shown in FIG. 13B, the control unit 140 displays a recommendation list 1340 in which broadcast contents of the same time zone are arranged in order of highest ratings, on the top of the second display unit 120, The second display unit 120 may be controlled to display the UI 1350 including the search term associated with the selected first broadcast content 1340-1 in the right area of the second display unit 120. [
13C, the controller 140 may display the plurality of display items 1360-1 to 1360-12 corresponding to the channel currently being broadcast on the entire area of the second display unit 120, 2 display unit 120 can be controlled.
As described above, the display apparatus 100 displays the content search UI through the second display unit 120, so that the user can view the new content without disturbing the viewing of the image content currently viewed through the first display unit 110 So that it can be retrieved.
When a user command is inputted through the input unit 130 while contents are displayed on the first display unit 110, the controller 140 controls the display unit 100 to display a setting change UI for changing the setting of the display device 100 2 display unit 120 can be controlled.
14A, when an image setting change command is inputted while the image contents are displayed on the first display unit 110, The second display unit 120 displays the image setting change UI 1410 including the display items 1410-1 through 1410-4 corresponding to the plurality of image modes at the upper end of the second display unit 120, Can be controlled. If the current display mode of the display device 100 is the standard mode, the controller 140 controls the display device 1410-1 to display a highlight on the display item 1410-1 corresponding to the standard mode, The control unit 120 can control the display unit. 14B, when the rightward movement instruction is inputted twice while the image setting change UI 1410 is being displayed, the controller 140 displays the display item corresponding to the concert mode, as shown in FIG. 14C, The first display unit 110 may be controlled to control the second display unit 120 to display a highlight on the display unit 1410-3 and process the currently displayed image content in a concert mode. 14C, when a selection command is input while the video mode setting UI 1410 is being displayed, the controller 140 controls the first display unit 110 to display the video content processed in the concert mode And can control the second display unit 120 to remove the video mode setting UI 1410 displayed on the second display unit 120. [
15A, when the volume control command is input while the image contents are being displayed, the controller 140 controls the sound control UI 1500 as shown in FIG. 15B And the second display unit 120 may be controlled to display the left and right images on the left display unit of the second display unit 120. [
In another embodiment of the present invention, as shown in FIG. 16A, when a capture command is input while image content is being displayed, the controller 140 determines whether a capture command is input A capture screen UI 1610 including a plurality of captured images 1610-1 to 1610-5 stored in a buffer (not shown) at a predetermined interval from the beginning is displayed on the upper area of the second display unit 120, The second display unit 120 may be controlled to display the captured image storage list 1620 including the previously stored captured image in the left area of the second display unit 120. [ 16B, when a selection command is input while a highlight is displayed on the fifth captured image 1610-5, the controller 140 displays the fifth captured image 1610-5 as a captured image list (Fig. 16B) 1620 and stores the fifth captured image 1610-5 displayed on the capture screen UI 1610 in a captured image storage list 1620 as shown in Fig. 16C The second display unit 120 can be controlled. Accordingly, the user can check the previously stored captured image through the first display unit 110 through the captured image storage list 1620 as a large image.
In another embodiment of the present invention, as shown in FIG. 17A, while the image content is being displayed on the first display unit 110, the user may leave the place for watching the display device 100, The control unit 140 may start automatic recording and may control the second display unit 120 to display the automatic recording UI 1710 as shown in FIG. 17B. The control unit 140 may automatically record the image content until the user senses the user through the sensing unit 105. [ When the user returns to the position for viewing the display device 100 and the sensing unit 105 senses the user, the control unit 140 may automatically display a thumbnail image at a predetermined interval, The recording UI 1710 is displayed on the upper area of the second display unit 120 and a setting UI 1720 for storing, playing back and deleting the recorded image is displayed on the right area of the second display unit 120 , And controls the second display unit 120 to display the information of the recorded image on the left area of the second display unit 10. [ At this time, if the storage icon is selected while a highlight is displayed in one of the plurality of thumbnail images, the controller 140 stores the image in the storage unit 180 from the next time of the selected thumbnail image, and can stop the automatic recording. In addition, when the play icon is selected while a highlight is displayed on one of the plurality of thumbnail images, the control unit 140 may control the first display unit 110 to reproduce the recorded image from the selected image. In addition, when the delete icon is selected, the control unit 140 can delete the automatically recorded image content.
In another embodiment of the present invention, the control unit 140 may control the first display unit 110 to reproduce the recorded content according to a user command. 18A, the control unit 140 may include a plurality of thumbnail images 1810-1 to 1810-6 at predetermined time intervals in the upper area of the second display unit 120, The first display unit 1810 and the second display unit 120 may be controlled to display the information 1820 of the recorded image content in the left area of the second display unit 120. [ At this time, the user can search for the recorded image content using the recorded image UI 1810. 18B, the control unit 140 may control the first display unit 110 to display the image content recorded from the selected thumbnail image using the highlight. In addition, the controller 140 may control the first display unit 110 to display the image content recorded from the selected point in time using the progress bar 1830, as shown in FIG. 18C.
The display device 100 as described above allows the user to continuously view the content currently being watched and display various functions of the display device 100 through the second display part 120 Change, etc.).
Hereinafter, a control method of the display apparatus 100 will be described with reference to FIG.
First, the display apparatus 100 displays the content on the first display unit 110 (S1910). In this case, the first display unit 110 may be a general stand type display device such as an LCD, an OLED, and a PDP.
Then, the display device 100 determines whether a user command is input (S1920). At this time, the user command may be a user command for generating a UI for controlling the display device 100. [
If a user command is input (S1920-Y), the display apparatus 100 displays a UI for controlling the display apparatus 100 on the second display unit 120 (S1930). At this time, the second display unit 120 displays an image on an outer area of the first display unit 110, and may be a projection display device such as a projector display. In addition, the UI for controlling the display device 100 may be a content search UI or a configuration change UI, but this is merely an embodiment, and other UIs may also be applied to the technical idea of the present invention.
The display apparatus 100 controls the contents of the first display unit 110 according to the user command inputted through the UI for controlling the display apparatus 100 (S1940). For example, the display apparatus 100 may change the content of the first display unit 110 to another content using the content search UI. Also, the display apparatus 100 can change the setting of the contents of the first display unit 110 using the setting change UI.
20A to 20F are views for explaining the position of a projector apparatus implementing the second display unit 120 according to various embodiments of the present invention. In one embodiment, the projector apparatus may be located at a remote ceiling from the first display unit 110, as shown in FIG. 20A. In another embodiment, the projector apparatus may be located on a remote table from the first display unit 110, as shown in Figure 20B. In another embodiment, the projector apparatus may be located on the near wall of the first display unit 110, as shown in FIG. 20C. In another embodiment, the projector apparatus may be located in a local table of the first display unit 110, as shown in FIG. 20D. In another embodiment, the projector apparatus may be located in an accessory (e.g., a speaker, etc.) of the display apparatus 100, as shown in Figure 20E. In another embodiment, the projector apparatus can be integrally attached to the back surface of the display apparatus 100, as shown in Fig. 20F. Meanwhile, in the above-described embodiment, the projector apparatus may be connected to the display apparatus 100 by wire or wirelessly, and may be controlled by the control unit 140 of the display apparatus 100.
In the above-described embodiment, the second display unit 120 is a projector display. However, if the second display unit 120 is a display for displaying an image on the outside of the first display unit 110, the technical idea of the present invention can be applied have. For example, the second display unit 120 may be implemented as at least one transparent display panel disposed at the outer periphery of the first display unit 110, and may include at least one Display sub-display panel. If the display is an ultra-wide display, the display device 100 operates the middle area of the display as the first display part 110 and the side area except the middle area of the display as the second display part 120 . In addition, when the display is implemented as a multi-LED array, the display device 100 operates the center area of the display as the first display part 110 and the outer area of the display except for the center area is displayed on the second display part 120, .
Hereinafter, an embodiment of providing content stored in at least one portable terminal connected to a display device, which is another embodiment of the present invention, using the second display unit will be described with reference to FIGS. 21 to 24B.
As shown in FIG. 21, the display apparatus 100 performs communication with the first portable terminal 2100-1, the second portable terminal 2100-2, and the third portable terminal 2100-3 . 21, the first to third portable terminals 2100-1 to 2100-3 may be a smart phone or a tablet PC, but the present invention is not limited thereto. For example, a notebook PC, a PDA, a smart And can be implemented in various portable terminals such as a watch.
At this time, the display apparatus 100 may provide various contents provided by the portable terminals through the first display unit 110 and the second display unit 120. [ In particular, when the display device 100 is connected to at least one portable terminal while displaying image contents through the first display part 110, the display device 100 is connected to the second display part 120 It is possible to provide various contents stored in at least one portable terminal.
Specifically, when the first to third portable terminals 2100-1 to 2100-3 are connected to the display apparatus 100 while the display apparatus 100 displays the image contents through the first display unit 110, The control unit 140 may include a second display unit (not shown) to display a plurality of portable terminal icons 2210 to 2230 corresponding to the first to third portable terminals 2100-1 to 2100-3 120). At this time, the portable terminal icons 2210 to 2230 may include images corresponding to the type of the corresponding portable terminal, but it may include various information such as user information of the corresponding portable terminal have.
When a user command for selecting the first portable terminal icon 2210 among the plurality of portable terminal icons 2210 to 2230 is input through the input unit 130, the controller 140 controls the first portable terminal 2100-1 , And controls the communication unit 160 to receive image content information (e.g., thumbnail image information, etc.) in response to the request signal. Based on the received image content information, the controller 140 displays the first portable terminal icon 2210 on the side of the second display unit 120 as shown in FIG. 22B, The second display unit 120 may be controlled to display the thumbnail images 2250-1 to 2250-6 of the image content stored in the first portable terminal 2100-1 corresponding to the icon 2210. [
A user command for selecting the first thumbnail image 2250-1 of the thumbnail images 2250-1 through 2250-6 of the image content stored in the first portable terminal 2100-1 through the input unit 130 is input The control unit 140 controls the first display unit 110 to display the first thumbnail image 2250-1 on the first display unit 110 as shown in FIG. The second display unit 120 may be controlled to display the display item 2260 including the My Content folder at the top of the first display unit 120. [
When one portable terminal 2100-1 is connected to the display device 100 while the display device 100 displays the image content through the first display unit 110, As shown in the figure, the second display unit 120 may be controlled to display the portable terminal icon 2310 corresponding to the first portable terminal 2100-1. At this time, the portable terminal icon 2310 may include an image corresponding to the corresponding type of the first portable terminal, but it may include various information such as user information of the first portable terminal, have.
When the user command for selecting the first portable terminal icon 2310 is input through the input unit 130, the controller 140 transmits a request signal for requesting the first portable terminal 2100-1 to the first portable terminal 2100-1 And controls the communication unit 160 to receive image content information (for example, thumbnail image information, etc.) in response to the request signal. Based on the received image content information, the controller 140 displays the first portable terminal icon 2310 on the side of the second display unit 120, as shown in FIG. 23B, The second display unit 120 may be controlled to display the thumbnail images 2320-1 to 2320-6 of the image content stored in the first portable terminal 2100-1 corresponding to the icon 2310. [
The user command for selecting the first thumbnail image 2320-1 among the thumbnail images 2320-1 through 2320-6 of the image content stored in the first portable terminal 2100-1 through the input unit 130 is input The control unit 140 controls the first display unit 110 to display the first thumbnail image 2320-1 on the first display unit 110 as shown in Figure 23C, The user can control the second display unit 120 to display the display item 2330 including the My Content folder at the top of the first display unit 120. [
In the above-described embodiment, the image content stored in the portable terminal is provided. However, the display device 100 may display various contents stored in the portable terminal through the second display unit 120, Content can be provided.
For example, when a plurality of music contents are stored in the connected portable terminal, the controller 140 may display a plurality of music icons 2420-1 to 2420-6 The second display unit 120 may be controlled to display the second display unit 120. [ As another example, when a plurality of SNS messages are received in the connected mobile terminal, the controller 140 may include a plurality of music icons 2440-1 to 2440-6 corresponding to the received SNS contents, The second display unit 120 may be controlled to display the second display unit 120. [
The user can more easily receive the content stored in the external portable terminal while the display device 100 displays the image content.
Meanwhile, the control method of the display device according to the above-described various embodiments may be implemented as a program and provided to a display device. At this time, the program including the control method of the display device may be provided through a non-transitory computer readable medium.
A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.
