KR20180124260A - Display apparatus and Method for displaying contents thereof - Google Patents

Abstract

Provided are an electronic apparatus and a display method thereof. The electronic apparatus comprises: a display; and a processor controlling the display, wherein the processor displays a content screen including a background image layer including a rear background image of the electronic apparatus and an object layer including a graphic object on the display when the electronic apparatus is in a first operation mode, and reduces resolution of the content screen displayed on the display and adds and displays a content layer including content image gradually enlarged and displayed from one area of the content screen when a switch command for switching the mode to a second operation mode.

Description

[0001] The present invention relates to an electronic apparatus and a display method thereof,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an electronic device and a display method thereof, and more particularly, to an electronic device and a display method thereof that selectively display a background image and a content image according to an operation mode of the electronic device.

In recent years, functions for providing various user experiences using electronic devices have been developed. By way of example, as shown in FIG. 1, the electronic device 100 may display its back background image, thereby providing the user with a visual effect, such as viewing a transparent window. The background background image may be implemented as a live view in which the electronic device 100 is acquired by a camera disposed rearward, or may be implemented as a still image or a moving image already stored in the electronic device 100.

Furthermore, the electronic device 100 may display various graphic objects together with a background image. Thereby allowing the electronic device 100 to provide an aesthetic effect to the user. At this time, the electronic device 100 may not only display a background image, but may also reproduce various content images.

However, when the image displayed on the electronic device 100 is changed, the processing speed of the processor may be slowed down. Accordingly, there is a need for a technique capable of efficiently performing display even when the operation mode of the electronic device is changed.

It is an object of the present invention to provide an electronic device and a display method thereof that can effectively display various images according to a change of an operation mode.

According to an aspect of the present invention, there is provided an electronic device including: a display; And a processor for controlling the display; Wherein when the electronic device is in a first mode of operation, a content screen including an object layer including a background image layer and a graphic object including a background image of the back side of the electronic device is displayed on the display When a switching command for switching to the second operation mode is input, a resolution of the content screen displayed on the display is reduced, and a content layer including a content image gradually enlarged from one area of the content screen And the content is displayed on the content screen.

At this time, if the content image included in the content layer is enlarged to the same size as the content screen, the processor removes the content screen displayed on the display, and another content screen including the expanded content image Display on the display.

At this time, the resolution of the other content screen may be higher than the reduced resolution of the content screen.

At this time, when the switching command for switching to the first operation mode is inputted, the processor can reduce the resolution of the object layer among the layers included in the content screen.

In this case, the content screen further includes a shadow layer, and the processor can remove the shadow layer when a switching command for switching to the first operation mode is input.

In this case, when the electronic device is in the second operation mode, the processor causes the other content screen including the content layer to be displayed on the display, and when a switching command for switching to the first operation mode is inputted, The resolution of the other content screen displayed on the display is reduced and the content screen is progressively enlarged from one area in the other content screen.

In this case, the other contents screen further includes an object layer, and when the switching command for switching from the second operation mode to the first operation mode is inputted, the object layer of the other contents screen is removed can do.

According to another aspect of the present invention, there is provided a method of displaying an electronic device, the method comprising the steps of: during a first mode of operation of the electronic device, Displaying a content screen including an object layer including a graphic object; And when the first operation mode is switched to the second operation mode, decreasing the resolution of the content screen and adding a content layer including a content image progressively enlarged from one area of the content screen to the content screen Displaying; .

Removing the content screen and displaying another content screen including the enlarged content image when the content image included in the content layer is enlarged to the same size as the content screen; As shown in FIG.

At this time, the resolution of the other content screen may be higher than the reduced resolution of the content screen.

At this time, the resolution of the content screen may be reduced by adjusting the resolution of the object layer.

At this time, the content screen further includes a shadow layer, and the display method further comprises: removing the shadow layer when the first operation mode is switched to the second operation mode; As shown in FIG.

Displaying the other content screen including the content layer while the electronic device is operating in the second operation mode; And decreasing the resolution of the other content screen when the second operation mode is switched to the first operation mode and progressively enlarging the content screen from one area in the other content screen; As shown in FIG.

At this time, the other content screen further includes an object layer, and the display method further includes the steps of: when the second operation mode is switched to the first operation mode, removing the object layer of the other content screen; As shown in FIG.

Meanwhile, in a computer-readable recording medium including a program for executing an electronic device according to an embodiment of the present disclosure, a display operation of the electronic device is performed such that, while the electronic device is operating in the first operation mode, Displaying a content screen including a background image layer including a background background image of the apparatus and an object layer including a graphic object; And when a switching command for switching from the first operation mode to the second operation mode is inputted, a resolution of the content screen is reduced, and a content layer including a content image gradually enlarged from one area of the content screen Adding and displaying the content screen; .

As described above, according to the various embodiments of the present disclosure, it is possible to efficiently display various images according to the change of the operation mode. As a result, the processing speed of the electronic device can be improved, and the user satisfaction can also be improved.

1 is a diagram for illustrating an embodiment in which the display provides an image effect such as a transparent window made according to an embodiment of the present disclosure;
2 is a block diagram illustrating a simplified configuration of an electronic device, in accordance with one embodiment of the present disclosure;
3 is a block diagram illustrating a specific configuration of an electronic device according to an embodiment of the present disclosure;
4A and 4B are diagrams for explaining a second operation mode (normal mode or content mode) and a first operation mode (background mode) of the electronic device according to an embodiment of the present disclosure
5A-D are illustrations illustrating various layers created by a processor, in accordance with one embodiment of the present disclosure.
6A and 6B are diagrams for explaining user interaction according to an embodiment of the present disclosure.
FIGS. 7A and 9B are diagrams for explaining various embodiments in which a graphic object is changed corresponding to a user interaction.
10 is a flow chart for explaining a control method of an electronic device according to an embodiment of the present disclosure;
Figs. 11A to 11D are exemplary diagrams illustrating a process of changing a display when changing from a first operation mode to a second operation mode, according to an embodiment of the present disclosure.
12A to 12C are diagrams for explaining a method of displaying a content screen corresponding to a post-change operation mode upon switching an operation mode according to an embodiment of the present disclosure.
13A to 13C are exemplary diagrams illustrating a method of changing a display upon switching of an operation mode according to an embodiment of the present disclosure;
14A to 14D are exemplary diagrams illustrating a process of changing a display when the mode is changed from the second operation mode to the first operation mode, according to an embodiment of the present disclosure.
15 is a diagram for explaining a remote control system according to an embodiment of the present disclosure.
16 is a diagram for explaining a screen of a remote control apparatus according to an embodiment of the present disclosure.
17 is a block diagram for explaining a remote control apparatus according to an embodiment of the present disclosure;
FIG. 18 is a diagram for explaining a method in which a remote control apparatus according to an embodiment of the present disclosure changes and displays a third UI screen.
19 is a diagram for explaining an operation when a remote control device according to an embodiment of the present disclosure selects an external electronic device through a third UI screen.
20 is a view for explaining the operation of the remote control device when the input source of the electronic device according to the embodiment of the present disclosure is switched.
21 is a detailed block diagram for explaining a remote control apparatus according to an embodiment of the present disclosure;
22 is a flowchart for explaining a control method of the remote control apparatus according to an embodiment of the present disclosure;
23 is a flowchart for explaining a control method of the electronic device 100 according to an embodiment of the present disclosure.

These embodiments are capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the disclosure disclosed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the claims. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the term " includes " Or " configured. &Quot; , Etc. are intended to designate the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, may be combined with one or more other features, steps, operations, components, It should be understood that they do not preclude the presence or addition of combinations thereof.

In the embodiment, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which need to be implemented by specific hardware, and implemented by at least one processor (not shown) .

Meanwhile, the present disclosure describes a method of displaying various content screens including a display, but is not limited thereto. That is, the electronic device 100 may be configured as a settop-box or an OTT device (Over the Top device). In this case, the electronic device 100 may transmit an image signal to the external display device, and the external display device receiving the image signal may display various content screens. Hereinafter, although the present disclosure describes the case where the electronic device 100 includes a display for convenience and understanding of the description, even when the electronic device 100 does not include a display, as described above, It goes without saying that ideas can be applied.

In the following, the present disclosure will be described in detail with reference to the accompanying drawings.

The electronic device 100 according to one embodiment of the present disclosure has a plurality of modes of operation. The second operation mode, which is one of the plurality of operation modes, is a mode for displaying general images. Specifically, the second operation mode is a mode for displaying contents previously stored in the electronic device 100 or broadcast received from the outside using the full screen of the electronic device. For convenience of description, the second operation mode is named as the normal operation mode. Alternatively, the second operation mode may be referred to as a normal mode or a content mode. Hereinafter, this mode is referred to as a normal mode.

On the other hand, in the second operation mode, not only a general image but also specific content objects can be displayed together. Here, the specific content object may be an object including information on a general image, and may be an object including information on a viewable channel.

The first mode of operation which is another mode of operation of the electronic device 100 is to display the content screen including the background background image (hereinafter referred to as " background image ") of the electronic device 100, Quot; means a mode providing a visual effect such as a window. Here, the content screen includes a background image behind which the electronic device 100 is located, and may include at least one object and a shadow of at least one object. Like the second operation mode, the first operation mode may be referred to as a background image mode, a background mode, or the like for convenience of explanation. Hereinafter, it is referred to as background mode in this specification.

When displayed in the first mode of operation, the electronic device 100 displays the background area behind the electronic device 100 as a background image, which allows the user to receive an illusion that the electronic device 100 has become a transparent window have.

On the other hand, in the first operation mode, not only the background screen but also specific graphic objects can be displayed together. Here, a specific graphic object may be a clock object or a vine object, but various graphic objects (for example, pictures, photographs, fisheries, memos, etc.) may be displayed if they can be attached to a general wall.

In addition, in the first operation mode, it is possible to display an interaction object as well as a background screen and a graphic object. Here, the interaction object may be an object that matches or corresponds to a user interaction.

Hereinafter, in order to distinguish the content screen displayed in the second operation mode and the first operation mode, a content screen displayed in the second operation mode is referred to as a second content screen, a content screen displayed in the first operation mode is referred to as a first content screen do.

Hereinafter, a display method of an electronic device in the second operation mode and the first operation mode will be described in this disclosure. However, it goes without saying that there are various operation modes other than the second operation mode and the first operation mode described above.

Hereinafter, the above-described operation will be described in detail using specific configurations of the electronic device 100. FIG.

2 is a block diagram illustrating a simplified configuration of an electronic device 100 according to one embodiment of the present disclosure. 2, the electronic device 100 may include a communication unit 110, a display 120, a memory 130, and a processor 140.

The communication unit 110 receives various information from the outside. A communication unit according to an embodiment of the present disclosure may receive a user command. At this time, the user command received from the outside may be a signal for changing the operation mode.

According to another embodiment of the present disclosure, the communication unit 110 may receive a user command for controlling an external electronic device connected to the electronic device 100 from a remote control device. A detailed description thereof will be described later.

The communication unit 110 according to another embodiment of the present disclosure can receive a user interaction from the outside. In addition, the communication unit 110 can receive weather information from the outside. The received weather information can be applied to the background screen.

The display 120 displays image data. Particularly, while the electronic device 100 is operating in the second mode of operation, the display 120 may display the image content obtained from an external source (e.g., a broadcast station, a server, a DVD, etc.) 2 contents screen can be displayed. Also, while operating in the first operation mode, the display 120 may display a first content screen including a previously stored background image. At this time, the first content screen may include at least one graphic object on the background image and a shadow for at least one graphic object.

The memory 130 may store programs and data for controlling the electronic device 100. In particular, the memory 130 may store data for a background image behind the electronic device 100. At this time, the data for the background image may be obtained from an external device (e.g., a smart phone or the like), but this may be obtained from a camera connected to the electronic device 100 only by way of example.

In addition, the memory 130 may store data about changes in at least one graphical object corresponding to a user interaction. For example, the memory 130 may store data set to increase the number of graphic objects when the first user interaction is input, and may store data set to increase the number of graphic objects when the second user interaction is input. That is, the memory 130 may store a result (change of object) corresponding to a predetermined user interaction.

Processor 140 controls the overall operation of electronic device 100. In particular, the processor 140 generates a first content screen on the basis of the data on the background image stored in the memory 130 and the user interaction received through the communication unit 110 in the first operation mode, So that the display can be controlled. At this time, the first content screen may include at least one graphic object on the background image and a shadow corresponding to at least one graphic object.

In addition, the processor 140 may generate a content screen based on the data of the background image stored in the memory 130 and the sensing data obtained by the sensor, and control the display screen to display the content screen. At this time, the content screen may include at least one graphic object on the background image and a shadow corresponding to at least one graphic object. At this time, at least one of the position and the shadow of the shadow is changed corresponding to the change of the sensed data .

In addition, when the edge of the electronic device 100 includes an outer frame that covers the bezel and the bezel, the processor 140 displays the outer frame shadow on the edge of the first content screen, 120). At this time, the processor 140 may generate an object layer including at least one graphic object, a shadow layer including a shadow, and a background image layer including a background image to create a first content screen. The shadow layer may be generated based on the object layer, and the background image layer may be generated from data on the background image stored in the memory 130 have. On the other hand, a plurality of object layers or background image layers can be generated. Further, an outer frame shadow layer including an outer frame shadow can be further generated.

In particular, the processor 140 may control the display 120 to be displayed in the order of the object layer, the shadow layer, and the background image layer. In addition, when an outer frame shadow layer is generated, the processor 140 may control the display 120 to be displayed in front of the object layer.

At this time, the processor 140 may further generate an interaction layer. The interaction layer can display interaction objects created based on user interaction. That is, the processor 140 may generate the interaction layer to display the interaction object corresponding to the user interaction.

However, the present invention is not limited to the above-described example, and the processor 140 can display the interaction object corresponding to the user interaction on the object layer. For example, when the user's first interaction is input, the processor 140 may display the first interaction object corresponding to the first interaction on the object layer. That is, when the interaction object is displayed on the object layer, the graphic object may include an interaction object, and when the interaction object is displayed on the interaction layer, the graphic object and the interaction object may be different objects.

Meanwhile, the processor 140 may control the display 120 to change at least one of the size, number, position, color, and brightness of the graphic object in response to the user interaction. At this time, when the graphic object is changed, the processor 140 may change the shadow corresponding to the changed graphic object.

That is, the processor 140 can generate the interaction object corresponding to the user interaction, and can change the graphic object corresponding to the user interaction. However, the present invention is not limited to this, and it goes without saying that the processor 140 may generate the interaction object corresponding to the user interaction and change the graphic object corresponding to the interaction object.

Meanwhile, when a user command for changing the operation mode is input, the processor 140 may control the display 120 to display a content screen corresponding to the changed operation mode.

Specifically, the processor 140 may control the display 120 to display a first content screen corresponding to the first mode of operation. In this case, when a user command for changing the first operation mode to the second operation mode is inputted, the processor 140 reduces the resolution of the first content screen and displays a content layer The display 120 may be controlled.

At this time, the processor 140 may reduce the resolution of at least one of the object layer, the background image layer, and the shadow layer included in the second content screen. However, it goes without saying that the processor 140 may remove a specific layer as well as reduce the resolution. For example, at this time, if a user command to change the first operation mode to the second operation mode is input, the processor 140 removes the shadow layer and reduces the resolution of at least one of the object layer and the background image layer .

The processor 140 may control the display 120 to enlarge the size of the content image displayed on the content layer. When the content image is enlarged to the same size as the first content screen, the processor 140 removes the first content screen and controls the display 120 to display a second content screen including the enlarged content image . At this time, the second content screen may further include a content object layer as well as a content layer.

At this time, the resolution of the second content screen may be higher than the reduced resolution of the first content screen. That is, when a user command for displaying the second content screen is inputted, the processor 140 may improve the processing speed by reducing the resolution of the first content screen.

Meanwhile, the processor 140 may control the display 120 to display a first content screen corresponding to the second mode of operation. In this case, when a user command for changing the second operation mode to the first operation mode is input, the processor 140 reduces the resolution of the second content screen and displays an object layer The display 120 may be controlled.

At this time, the processor 140 may reduce the resolution of at least one of the content layer and the content object layer included in the first content screen. However, as described above, when a user command for changing the second operation mode to the first operation mode is input, the processor 140 can remove the content object layer and reduce the resolution of the content layer.

The processor 140 may control the display 120 to enlarge the size of the content image displayed on the content layer. When the content image is enlarged to the same size as the first content screen, the processor 140 removes the first content screen and controls the display 120 to display a second content screen including the enlarged content image . At this time, the second content screen may further include a content object layer as well as a content layer.

At this time, the resolution of the second content screen may be higher than the reduced resolution of the first content screen. That is, when a user command for displaying the second content screen is inputted, the processor 140 may improve the processing speed by reducing the resolution of the first content screen.

3 is a block diagram illustrating a specific configuration of an electronic device according to an embodiment of the present disclosure; 3, the electronic device 100 according to the present embodiment includes a communication unit 110, a display 120, a memory 130, a processor 140, a broadcast receiver 150, a signal separator 155, An A / V processing unit 160, an audio output unit 165, a video signal generating unit 170, a sensor 175, and an operation unit 180.

However, the present invention is not limited to the above-described configuration, and some configurations may be added, omitted, or merged as necessary. For example, the processor 140 may include a signal separating unit 155, an A / V processing unit 160, and a video signal generating unit 170. In this case, the processor 140 may perform the functions and operations of the A / V processing unit 160 and the video signal generating unit 170, which will be described later. The communication unit 110 may include various types of external And performs communication with the device. The communication unit 110 may include a Wi-Fi chip and a Bluetooth chip. The processor 140 can communicate with various external devices using the communication unit 110. [ Specifically, the communication unit 110 may receive a control command or a user interaction from a control terminal device (for example, a smart phone or a remote control) capable of controlling the electronic device 100. [

At this time, the user interaction can be input by the external device. For example, user interaction may be entered via an external electronic device such as a smart phone.

That is, an external device may sense the user interaction and send data for the detected user interaction to the electronic device 100. However, the present invention is not limited to this, and it goes without saying that the electronic device 100 can directly sense the user interaction. At this time, the user interaction has various forms and can be detected by various methods. For example, the user interaction may be a graffiti interaction. A graffiti interaction is an interaction in which a user draws a picture on a paint board. However, it is not limited to the term graffiti, but may be expressed in various ways such as a painting interaction and a handwriting interaction. In another embodiment, the user interaction may be a motion of the user. The external electronic device or electronic device 100 can recognize the user's motion through a camera sensor or the like. In another embodiment, the user interaction may be a voice command. The external electronic device or electronic device 100 can recognize the user's voice through the microphone. As described above, the user interaction may be in various forms, but in the present disclosure, the case where the user interaction is the graffiti interaction will be limited. However, it is needless to say that the technical idea of the present disclosure can be applied even when the user interaction is various interactions other than the graffiti interaction.

 The electronic device 100 generates an interaction object corresponding to the user interaction, and can change the graphic object. At this time, the interaction object may be a graffiti image as shown in FIG. 7B, FIG. 8B, FIG. 9B, and the like.

In addition, the communication unit 110 can acquire weather information through communication with an external server. The processor 140 may generate a background image using the weather information acquired through the communication unit 110. [

2, the communication unit 110 may include a USB port to which a USB connector can be connected, various external input ports for connecting to various external terminals such as a headset, a mouse, a LAN, and the like, A DMB chip for receiving and processing a DMB (Digital Multimedia Broadcasting) signal, and the like.

The display 120 displays an image. The display 120 may be implemented as various types of displays such as a liquid crystal display (LCD), a plasma display panel (PDP), and the like. The display 120 may include a driving circuit, a backlight unit, and the like that may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, an OTFT (organic TFT) Meanwhile, the display 120 may be implemented as a touch screen in combination with a touch sensing sensor.

Display 120 includes a backlight. The backlight is a point light source composed of a plurality of light sources and supports local dimming.

Here, the light source constituting the backlight may be composed of a cold cathode fluorescent lamp (CCFL) or a light emitting diode (LED). Hereinafter, the backlight is illustrated as being composed of a light emitting diode and a light emitting diode driving circuit, but may be implemented in other configurations than the LED in the implementation. The plurality of light sources constituting the backlight may be arranged in various forms, and various local dimming techniques may be applied. For example, the backlight may be a direct type backlight in which a plurality of light sources are arranged in a matrix form and are uniformly arranged over the entire liquid crystal screen. In this case, the backlight can operate with full-array local dimming or direct local dimming. Here, the full-array local dimming is a dimming method in which the light source is uniformly disposed as a whole behind the LCD screen and the brightness of each light source is adjusted. Direct local dimming is similar to the full-array local dimming method, but it is a dimming method that controls the luminance of each light source with a smaller number of light sources.

In addition, the backlight may be an edge type backlight in which a plurality of light sources are disposed only at the edge of the LCD. In this case, the backlight can operate with Edge-lit local dimming. In the edge-lit local dimming, a plurality of light sources are disposed only on the edge of the panel, and may be arranged only on the left / right side, only on the upper / lower side, or on the left / right / upper / lower sides.

In particular, the display 120 may display a first content screen including a background image. At this time, the first content screen may include an object layer including at least one graphics object, a shadow layer including a shadow for at least one graphic object, and a background image layer including a background image.

In addition, the display 120 may drive the display 120 at a first frequency (e.g., 120 Hz or 240 Hz) while operating in a second mode of operation, And drive the display 120 at a low second frequency (e.g., 60 Hz). That is, by driving the display 120 at a low frequency while operating in the first mode of operation, power consumption can be minimized.

The broadcast receiving unit 150 receives and demodulates broadcasts from a broadcasting station or satellite by wire or wirelessly. Specifically, the broadcast receiver 150 may receive and demodulate the transport stream through an antenna or a cable to output a digital transport stream signal.

The signal separator 155 separates the transport stream signal provided from the broadcast receiver 150 into a video signal, an audio signal, and an additional information signal. The signal separation unit 155 transmits the video signal and the audio signal to the A / V processing unit 160.

The A / V processing unit 160 performs signal processing such as video decoding, video scaling, and audio decoding on the video signals and audio signals input from the broadcast receiving unit 150 and the memory 130. The A / V processing unit 160 outputs the video signal to the video signal generating unit 170 and the audio signal to the audio output unit 165. At this time, the image output through the image signal generating unit 170 may be a content image according to the second operation mode (i.e., the normal mode).

On the other hand, when the received video and audio signals are stored in the memory 130, the A / V processing unit 160 can output the video and audio to the memory 130 in a compressed form.

The audio output unit 165 converts the audio signal output from the A / V processing unit 160 into sound and outputs the sound through a speaker (not shown) or an external device connected through an external output terminal (not shown) .

The video signal generator 170 generates a GUI (Graphic User Interface) for providing to the user. Then, the image signal generator 170 adds the generated GUI to the image output from the A / V processor 160. The video signal generation unit 170 provides the display 120 with a video signal corresponding to the video to which the GUI is added. Accordingly, the display 120 displays various information provided by the electronic device 100 and an image transmitted from the image signal generating unit 170.

The video signal generator 170 may process the content screen generated by the processor 140 and output the content screen. Specifically, the video signal generator 170 may output a plurality of layers as they are, or may synthesize (or merge) a plurality of layers and provide them to the display 120.

The memory 130 stores various data and programs for controlling the electronic device 100. The memory 130 can receive and store video and audio compressed image contents from the A / V processing unit 160 and can store the stored image contents under the control of the processor 140 to the A / V processing unit 160 Can be output. In particular, the memory 130 may store data for a background image.

Meanwhile, the memory 130 may be implemented as a hard disk, a nonvolatile memory, a volatile memory, or the like.

The operation unit 180 is implemented by a touch screen, a touch pad, a key button, a keypad, or the like, and provides a user operation of the electronic device 100. The control unit 180 may receive the user's operation from the external control device (for example, a remote control) have.

The sensor 175 may sense user interaction. That is, the user interaction may not only be received from an external device as described above, but may also be sensed by the sensor 175.

Specifically, in one embodiment of the present disclosure, the sensor 175 may be a camera sensor for sensing the motion of the user. When the motion of the user is detected through the camera sensor, the processor 140 can generate an interaction object corresponding to the detected user motion, and change the graphic object.

As another embodiment of the present disclosure, the sensor 175 may be a touch sensor that senses the user's touch input. As described above, the touch sensor can be combined with the display 120 to configure a touch panel. When a user interaction is input through the touch panel, the processor 140 can generate an interaction object corresponding to the sensed user interaction, and change the graphic object.

The sensor 175 may generate sensing data for at least one of the direction and the intensity of the external light projected from the external light source disposed in the periphery of the display 120 to the display 120 .

In particular, the sensors 175 may comprise a plurality of sensors disposed at mutually spaced locations on the display device. In an implementation, the sensor 175 may be comprised of two sensors, or more than four. Here, the sensor may be an illuminance sensor that detects the illuminance, or may be a color sensor capable of sensing the color temperature as well as illuminance, a camera capable of shooting an image, and the like. Meanwhile, the above-described sensors may be embedded in the outer frame of the display device 120 so as not to be affected by the light emitted from the display 120. When the sensor 175 is composed of two sensors, it may be constituted of one illumination sensor and one color sensor, or two illumination sensors or two color sensors.

In addition, the sensor 175 may further include various sensors such as an IR sensor, an ultrasonic sensor, an RF sensor, and the like. At this time, at least one sensor 110 may detect the position of an external user or object through various sensors.

Processor 140 controls the overall operation of electronic device 100. Specifically, the processor 140 may control the video signal generator 170 and the display 120 to display an image according to the control command input through the operation unit 180 in the second operation mode.

The processor 140 may be implemented as a system on chip (SoC) including a ROM 141, a RAM 142, a GPU (Graphic Processing Unit) 143, a CPU 134 and a bus. In this case, the ROM 141, the RAM 142, the GPU (Graphic Processing Unit) 143, the CPU 144, and the like may be connected to each other via a bus.

The CPU 144 accesses the memory 130 and performs booting using an operating system (O / S) stored in the memory 130. The CPU 144 can perform various operations using various programs, contents, data stored in the memory 130, and the like.

The ROM 141 stores a command set for booting the system and the like. The CPU 144 copies the O / S stored in the memory 130 to the RAM 142 in accordance with the command stored in the ROM 141, executes the O / S, Boot up. When the booting is completed, the CPU 144 copies various programs stored in the memory 130 to the RAM 142, executes the program copied to the RAM 142, and performs various operations.

When the booting of the electronic device 100 is completed, the GPU 143 can generate a screen including various objects such as an icon, an image, a text, and the like. In particular, when the electronic device 100 is operating in the first mode of operation, the GPU 143 may generate a first content screen including graphics object and shadow of the graphics object in the background image. At this time, the screen including various objects generated by the GPU 143 as described above may be outputted through the video signal generation unit 170. FIG.

The GPU configuration may be a separate configuration such as the video signal generation unit 170 or may be implemented in a configuration such as SoC combined with a CPU in the processor 140. [

In addition, the processor 140 may be implemented as a separate component different from a ROM, a RAM, a GPU, or the like, and may be interworked with other processors and memories.

In particular, the processor 140 generates a first content screen based on the data of the background image stored in the memory 130 and the sensed data acquired by the sensor 175 while operating in the first operation mode, As shown in FIG. At this time, the first content screen may include at least one graphics object on the background image and a shadow corresponding to the at least one graphic object. At least one of the shadow position and the shadow may correspond to the change of the sensed data can be changed.

The processor 140 generates a first content screen based on the data of the background image stored in the memory 130 and the user interaction received through the communication unit 110 during the operation in the first operation mode, As shown in FIG.

In addition, the processor 140 may receive the operation mode change command and may control the display 120 to display a content screen corresponding to the changed operation mode. At this time, the processor 140 may improve the processing speed by reducing or eliminating the resolution of the changed content screen.

Figs. 4A and 4B are exemplary diagrams showing the electronic device 100 when operating in the second operation mode and the second operation mode.

Specifically, while operating in the second mode of operation (i.e., the normal mode), the processor 140 may cause the display 120 to display a second content screen including externally received video content or pre- The processor 140 may control the display 120 to display the broadcast content 410 received via the tuner, as shown in FIG. 4A.

A predetermined user command (for example, a command for selecting a specific button on the remote controller) is input while operating in the normal mode, or a predetermined event (for example, an event for detecting the user with the display 120 turned off) The processor 140 may switch the operating mode of the electronic device 100 from the second operating mode to the first operating mode (i.e., the background mode).

During the operation in the first operation mode, the processor 140 displays the first content screen including the background image based on the data on the pre-stored background image and the user interaction received through the communication unit 110, Can be controlled. 4B, the first content screen may include a shadow corresponding to the vine object and the vine object, a shadow object 430 corresponding to the shadow object, a shadow 440 corresponding to the clock object 430, . ≪ / RTI > However, the present invention is not limited to this, and it goes without saying that the background image 420 may include various objects such as a tree object, a fishery object, a memo object, and corresponding shadows.

5A-D are illustrations illustrating various layers created by a processor, in accordance with one embodiment of the present disclosure.

Specifically, the processor 140 may generate a background image layer 510, a shadow layer 520, and an object layer 530. At this time, the processor 140 may control the display 120 to display the background image layer 510, the shadow layer 520, and the object layer 530 in the forward order as shown in FIG. 5A.

5A, one object layer 530 and one shadow layer 520 are generated. However, this is only an example, and a plurality of object layers and a plurality of shadow layers may be generated .

For example, the processor 130 may generate an object layer including a clock object and an object layer including a vine object, and may generate shadow layers corresponding to each object. When a plurality of object layers are generated, the processor 130 may control the display 120 to arrange and display an object layer including an object to be displayed earlier. For example, when an object layer including a clock object and an object layer including a vine object are generated, the processor 130 arranges the object layer including the clock object in front of the object layer including the vine object, The display 120 can be controlled.

Similarly, as shown in FIG. 5B, the processor 140 may further generate an interaction layer 540. FIG. In the interaction layer 540, as shown in FIG. 5B, an interaction object 450 corresponding to a user interaction may be displayed. At this time, the processor 140 may control the display 120 to arrange the interaction layer 540 in front of the object layer 530 to display the interaction object 450 ahead of the clock object and the vine object. Of course, this is only an example, and the interaction layer 540 may be generated behind the object layer 530. [

However, it goes without saying that the interaction object may be displayed in one object layer. That is, as shown in FIG. 5C, the object layer may include both a vine object, a clock object, and an interaction object.

In this case, the layers described in FIGS. 5A to 5C may be a layer that is mainly displayed in the first operation mode. 5D, the processor 140 may further include a content layer 550 and a content object layer 560 displayed in a second operation mode.

Meanwhile, when the electronic device 100 includes a bezel and an outer frame disposed at the edge of the display 120, the processor 140 may further include an outer frame shadow layer for the shadow for the outer frame.

[First embodiment: first content screen corresponding to user interaction when operating in the first operation mode]

6A to 9B, the operation of the processor 140 will be described in detail when the user interaction is received through the communication unit while the electronic device 100 is operating in the first operation mode.

6A and 6B are diagrams for explaining user interaction according to an embodiment of the present disclosure.

As shown in Fig. 6A, a vine object may be displayed on the object layer of the electronic device 100. Fig. The electronic device 100 may receive a user interaction from the remote control device 200 remote control device 200.

Specifically, when the remote control apparatus 200 is a smart phone, the remote control apparatus 200 can receive information on the content image 620 displayed by the electronic apparatus 100. [ The remote control device 200 receiving the content image 620 can display the same content image 610 as the electronic device 100. [

The electronic device 100 may receive the user interaction sensed through the external electronic device 610. For example, the user can graffitize the content image 610 displayed on the remote control device 200 as if drawing a picture 612. At this time, the user interaction may be a graffiti interaction. The external electronic device 610 can display the interaction object 612 corresponding to the received user interaction on the display and transmit the data corresponding to the interaction object 612 to the electronic device 100. [ The electronic device 100 can display the interaction object 622 corresponding to the data received from the remote control device 200 on the display 120. [ At this time, the electronic device 100 may generate an interaction layer including the interaction object 620, but this is merely an example, and the interaction object 620 can be generated in the object layer.

Meanwhile, as shown in FIG. 6B, the user interaction may be input through the remote controller 200-1. At this time, the remote controller 605 is implemented as a pointing device, and the electronic device 100 can receive a user interaction by detecting a point where the remote controller 605 points. Then, the electronic device 100 can display the interaction object 622 corresponding to the user interaction using the remote controller 200-1 on the interaction layer.

In the above-described embodiment, a method of displaying an interaction object using the smartphone or the remote controller 200-1 has been described, but the present invention is not limited thereto. That is, as described above, the user interaction can be sensed in the electronic device 100 in a variety of ways. For example, the user interaction may be sensed by a touch panel provided on the electronic device 100, or may be sensed by the various sensors described above.

The remote control device 200 can perform various functions in addition to the above-described embodiments. A detailed description thereof will be described later with reference to FIG. 15 to FIG.

FIGS. 7A and 9B are diagrams for explaining various embodiments in which a graphic object is changed corresponding to a user interaction.

7A to 7C are diagrams for explaining a change of a vine object corresponding to a user interaction when a vine object is displayed on the electronic device 100. Fig.

As shown in Fig. 7A, a vine object may be displayed in the object layer of the electronic device 100. Fig. When the user interaction is received, the electronic device 100 can display the interaction object corresponding to the user interaction on the interaction layer. Specifically, as shown in FIG. 7B, the interaction object may be in the form of a river.

On the other hand, the electronic device 100 can change the object of the object layer corresponding to the user interaction. Specifically, as shown in FIG. 7C, a plurality of raindrop objects may be added to the object layer to display the effect of rain on the display 120, as the interaction objects displayed on the electronic device 100 disappear. At this time, the electronic device 100 can control the display 120 such that a plurality of raindrop objects are added and the interaction objects disappear. However, the present invention is not limited to this, and a plurality of raindrop objects and interaction objects can be simultaneously displayed. In addition, a plurality of raindrop images may be displayed after the interaction object disappears first and a predetermined time elapses.

Figs. 8A to 8C are diagrams for explaining a change of a plurality of fish objects corresponding to a user interaction when a plurality of fish objects are displayed on the electronic device 100. Fig.

As shown in FIG. 8A, a plurality of objects can be displayed in the object layer of the electronic device 100. FIG. When receiving the user interaction, the electronic device 100 can display the interaction object corresponding to the user interaction on the interaction layer. Specifically, as shown in FIG. 8B, the interaction object may be a heart-shaped graffiti.

The electronic device 100 can change the object of the object layer in response to the user interaction. Specifically, as shown in FIG. 8C, as the interaction objects displayed on the electronic device 100 disappear, a plurality of young fish can be added to the object layer to express that a plurality of fish give birth to a young fish.

Meanwhile, in the above-described embodiment, the case where the object is added in response to the user interaction has been described, but it goes without saying that the object may be deleted, changed, or moved. In another embodiment, at least one of the size, number, position, color, and brightness of the object may be changed corresponding to the user interaction.

On the other hand, the change of the object corresponding to the user interaction may be already programmed and stored in the memory 130. That is, when a first user interaction is detected on a first content screen displaying a vine object, a plurality of raindrop objects are additionally displayed, and when a second user interaction is detected on a first content screen displaying a fish object, Features that add and display an object can be pre-programmed and stored. However, the present invention is not limited to this, and it is needless to say that the change of the object for the interaction detected through various machine learning can be determined. An artificial intelligence algorithm such as deep learning can be used for this purpose.

For example, if the second user interaction is a graffiti interaction that draws a heart, the shape of the heart may be different depending on the user. That is, even if the user intends to perform heart-shaped graffiti, the electronic device 100 may not recognize the user's graffiti as a heart. In this case, the electronic device 100 can determine the user's graffiti through learning. For example, if the first user draws the heart to be curved and open, the electronic device 100 may not recognize the graffiti, which is a round, closed curve, as a heart. Alternatively, when the second user draws the heart to be round and closed, the electronic device 100 may not recognize the curved, open-faced graffiti as a heart. Consequently, the electronic device 100 can determine a user's intended graffiti (e. G., Heart or star) through machine learning.

9 is an exemplary diagram for explaining a case where it is impossible to change an object corresponding to a user interaction according to an embodiment of the present disclosure.

If the function corresponding to the user interaction is not stored in the memory 130, the electronic device may not change the object image. For example, as shown in FIGS. 9A and 9B, when a user interaction is input while a vine object is displayed on an object layer, the electronic device 100 can display an interaction object corresponding to a user interaction on an interaction layer have. At this time, if the command corresponding to the user interaction is not stored, the electronic device 100 can maintain the layer displayed on the object layer. At this time, the interaction object may disappear after a predetermined time elapses. However, the present invention is not limited to this, and it goes without saying that it may be canceled corresponding to a user command for destroying an interaction object.

10 is a flow chart for explaining a control method of an electronic device according to an embodiment of the present disclosure;

First, the electronic device 100 may store data for display on a background image layer (S1010). At this time, the background image may be a background image behind the electronic device 100.

Next, the electronic device 100 may generate a content screen including an object layer including at least one graphic object and a background image layer including a background image (S1020). That is, the electronic device 100 can display a background image in a background image layer and a graphic object in an object layer. At this time, the generated content screen may be displayed on the display 120 or may be transmitted to an external display device.

Next, the electronic device 100 can receive a signal corresponding to user interaction around the display 120 through the communication unit (S1030). As described above, the user interaction may be obtained from an external electronic device such as a smart phone or a remote control, and may be obtained by sensing user motion through a camera sensor.

When the user interaction is received, the electronic device can generate a content screen by adding an interaction layer including an interaction object corresponding to the user interaction (S1040).

[Embodiment 2: Embodiment of Layer Conversion Included in Contents Screen at Switching of Operation Mode]

11A to 14D, a description will be given of the layer conversion included in each content screen when the operation mode is changed.

11A to 11D are diagrams illustrating a change in the display 120 when a user command for switching from the first operation mode to the second operation mode is input.

As shown in FIG. 11A, a user command for changing the operation mode can be inputted while the first content screen is displayed. At this time, the user command can be inputted through the remote control device 200 shown in Fig.

 When the user command is input, the electronic device 100 can reduce or eliminate the resolution of at least one of the object layer, the background image layer, and the shadow layer included in the first content screen, as shown in FIG. 11B have. For example, when a user command is input while the object layer of the first content screen is displayed at the first resolution, the resolution of the object layer is processed to the second resolution, and the shadow layer is removed. At this time, the background image layer may maintain the resolution, and the first resolution may be higher than the second resolution. The first resolution and the second resolution may be appropriately determined according to the display size of the electronic device 100. [ For example, if the electronic device 100 includes a 60 inch display, the first resolution may be 2560 * 1440, the second resolution may be 1280 * 720, and the electronic device 100 may include a 24 inch monitor , The first resolution may be 1920 * 1080 and the second resolution may be 960 * 540. However, the present invention is not limited to the above example, and the first resolution and the second resolution may be 1366 * 768, 3840 * 2160, or the like.

In another embodiment according to the present disclosure, when a user command for changing the operation mode is input, the electronic device 100 may remove all of the object layer, background image layer, and shadow layer. Alternatively, the electronic device 100 may remove two layers of the object layer, the background image layer, and the shadow layer, and reduce the resolution of the remaining one layer. Alternatively, the electronic device 100 may remove one of the object layer, the background image layer, and the shadow layer, and reduce the resolution of the remaining two layers. Alternatively, the electronic device 100 may reduce the resolution of both the object layer, the background image layer, and the shadow layer. When the user command for changing the operation mode is input through the above-described method, the electronic device 100 can reduce the resolution of the first content screen (including the case where the first content screen is removed).

The processor 140 may control the display 120 to display the content layer in one area 1110 of the first content screen while reducing the resolution of the second content screen. Specifically, as shown in FIG. 11C, the processor 140 may control the display 120 to display a content layer including a content image in a central area of the first content screen. At this time, the content object layer may be created after all the second content screen is removed. However, the present invention is not limited to this, and it goes without saying that the processor 140 can display both the content layer and the object layer in one area 1110 of the first content screen.

At this time, the content layer displayed in one area 1110 of the first content screen may be a part of the content image displayed on the second content screen. For example, as shown in FIG. 12A, only a portion corresponding to one area 1110 of the first content screen in the content layer second content screen displayed in one area 1110 of the first content screen is displayed . Alternatively, as shown in FIG. 12B, the content layer displayed in one area 1110 of the first content screen may be an image obtained by reducing the second content screen to fit the size of the one area 1110. FIG. Alternatively, as shown in FIG. 11C, the content layer displayed in one area 1110 of the first content screen may be a black screen or a white screen. 12C, when one area 1110 of the first content screen is enlarged and becomes the same size as the display 120, the first content screen may be displayed.

11D, when one area 1110 of the first content screen is enlarged to be equal to the size of the display 120, the electronic device 100 removes the first content screen, Can be displayed. However, the present invention is not limited to this, and when one area 1110 of the first content screen is enlarged to a predetermined size, the electronic device 100 may remove the second content screen.

Meanwhile, while one area 1110 of the first content screen increases, the resolution of at least one of the object layer, the background image layer, and the shadow layer included in the first content screen may gradually decrease. That is, the electronic device 100 can change the resolution of the second content screen and the first content screen according to the ratio of the first content screen and the first content screen occupied on the display 120. [

11A to 12C, one region 1110 of the first content screen is generated in the central region of the display 120 and enlarged in the vertical and horizontal directions as shown in FIG. 13A. However, the present invention is not limited thereto .

That is, as shown in FIG. 13B, one area 1110 of the first content screen may be generated at the upper left of the display 120 and enlarged in the lower right direction. In the same manner, one area 1110 of the first content screen may be generated at the lower left of the display 120 and enlarged to the upper right direction, and one area 1110 of the first content screen may be enlarged The first area 1110 of the first content screen may be generated at the upper right of the display 120 and enlarged to the lower left direction.

Also, as shown in FIG. 13C, one area 1110 of the first content screen may be generated from the edge of the display 120 to reduce the first content screen 1020. However, it should be understood that one area 1110 of the first content screen may be created and enlarged in various ways at various locations as well as in a case where it is constructed and expanded by the above-described method.

14A to 14D are diagrams for explaining the change of the display 120 when an operation mode change command is inputted while the second content screen is displayed.

14A, when a user command for changing the operation mode is input while the second content screen is displayed, as shown in FIG. 14B, the electronic device 100 displays the second content screen It is possible to reduce the resolution of the content layer and remove the content object layer. However, it goes without saying that the resolution can be selectively reduced or eliminated for at least one of the content layer and the content object layer, which is an embodiment only.

The processor 140 may control the display 120 to display a background image layer in one area 1410 of the second content screen while reducing the resolution of the first content screen. Specifically, as shown in FIG. 14C, the processor 140 may control the display 120 to display a background image layer in the central area of the second content screen. At this time, the object layer light shadow layer may be generated after all the first content images are removed. However, the present invention is not limited thereto, and the processor 140 may display at least one of a background image layer, an object layer, and a shadow layer in one area 1410 of the second content screen.

When one area 1410 of the second content screen is enlarged to be equal to the size of the display 120, the electronic device 100 removes the second content screen as shown in FIG. 14D, Can be displayed. However, the present invention is not limited to this, and when one area 1410 of the second content screen is enlarged to a predetermined size, the electronic device 100 can remove the first content screen.

Meanwhile, while one area 1410 of the second content screen increases, the resolution of at least one of the content layer and the content object layer included in the second content screen may gradually decrease. That is, the electronic device 100 can change the resolution of the second content screen and the first content screen according to the ratio of the first content screen and the first content screen occupied on the display 120. [

13A to 13C, one area 1410 of the second content screen may be created and enlarged at various locations in various ways.

[Third embodiment: remote control system including electronic device]

The electronic device 100 according to the first and second embodiments may be connected to the remote control device 200 and the external electronic device 300 to configure the remote control system 1000.

15 to 22, the remote control system 1000 including the electronic device 100 will be described.

15 is a diagram for explaining a remote control system according to an embodiment of the present disclosure;

15A, a remote control system 1000 according to an embodiment of the present disclosure includes an electronic device 100, a remote control device 200, and an external electronic device 300. [

The electronic device 100 may be implemented as a display device having two operation modes, as described above. However, the present invention is not limited to this, and the electronic device 100 may be a general TV, or a variety of devices capable of displaying images such as a smart TV, a smart phone, a tablet PC, and a projector.

Then, the electronic device 100 is connected to the external electronic device 300. For example, the electronic device 100 may be connected to the external electronic device 300 through a variety of wired cables such as an HDMI cable, an optical cable, and the like. However, the present invention is not limited thereto, and the electronic device 100 may be connected to the external electronic device 300 through wireless communication. For example, the electronic device 100 can be connected to the external electronic device 300 using various wireless communication methods such as a Bluetooth method, a Wi-Fi method, and the like.

Accordingly, the electronic device 100 can transmit and receive various data to and from the external electronic device 300. For example, the electronic device 100 can receive image data provided by the external electronic device 300 from the external electronic device 300, and output an image based on the received image data. The electronic device 100 can also transmit a remote control signal to the external electronic device 300 for controlling the external electronic device 300 received from the remote control device 200. [ A detailed description related thereto will be described later.

The external electronic device 300 performing such a function may be implemented as a set-top box. However, the external electronic device 300 may be implemented by various devices such as a DVD player, a Blu-ray player, a PC, a game player, a home theater, an audio player, and the like.

15A, one external electronic device 100 is shown connected to the electronic device 100, but a plurality of external electronic devices 300 may be connected to the electronic device 100. FIG.

The remote control device 200 can control the electronic device 100. [ Specifically, as described above with reference to FIGS. 6A and 6B, the remote control device 200 can receive the user interaction and transmit it to the electronic device 100. However, the present invention is not limited thereto, and the remote control apparatus 200 can control the operation mode change, turn-on / turn-off, channel, volume, and the like of the electronic device 100.

To this end, the remote control device 200 may transmit a remote control signal for controlling the electronic device 100 to the electronic device 100. [ For example, the remote control device 200 may transmit a remote control signal to the electronic device 100 in an infrared fashion. In this case, when the infrared signal is transmitted to the electronic device 100, the electronic device 100 can search for and execute a code set matching the infrared signal received from the previously stored IR code set, Can be performed on the electronic device 100 of the present invention.

However, the present invention is not limited to this, and the remote control device 200 may communicate with the electronic device 100 through the wireless communication method such as Bluetooth or Wi-Fi to transmit the remote control signal to the electronic device 100 . In this case, when the remote control signal is transmitted to the electronic device 100, the electronic device 100 can search for and execute the control code matching the remote control signal among the previously stored control code sets, Can be performed on the electronic device 100 of the present invention.

On the other hand, the remote control device 200 can also control the external electronic device 300. Specifically, the remote control device 200 can control the turn-on / turn-off, channel, volume, and the like of the external electronic device 300.

To this end, the remote control device 200 may transmit a remote control signal to the electronic device 100 to control the external electronic device 300. [

Specifically, the remote control device 200 can transmit a remote control signal to the electronic device 100 in an infrared manner. In this case, the electronic device 100 can transmit the infrared signal received from the remote control device 200 to the external electronic device 300.

More specifically, the electronic device 100 can search an IR code matched with the received infrared signal among a plurality of IR code sets stored separately for each external electronic device 300. Then, the electronic device 100 can transmit the infrared signal to the external electronic device 300 controlled by the searched IR code, so that the control of the external electronic device 300 of the remote control device 200 is performed .

Also, the remote control device 200 may communicate with the electronic device 100 through the Bluetooth method and transmit the remote control signal to the electronic device 100. [ In this case, the electronic device 100 can search for the IR code corresponding to the remote control signal received from the remote control device 200 in the pre-stored IR code set in the electronic device 100 and transmit it to the external electronic device 300 So that control over the external electronic device 300 can be performed.

However, the present invention is not limited thereto, and the electronic device 100 may transmit the remote control signal received from the remote control device 200 via the Bluetooth method to the external electronic device 300 through a wireless communication method such as a Bluetooth method or a Wi-Fi method It is possible. In this case, the external electronic device 300 can search for and execute the control code corresponding to the remote control signal among the pre-stored control code sets, and accordingly, the control of the external electronic device 300 of the remote control device 200 .

On the other hand, the remote control device 200 can display a list of the external electronic devices 300 connected to the electronic device 100. Specifically, the remote control apparatus 200 receives external device connection information of the electronic device 100, that is, information on the external electronic device 300 connected to the electronic device 100, and transmits at least one external device connection information A list to be displayed can be displayed.

Here, the remote control device 200 can receive external device connection information from at least one of the electronic device 100 and the external electronic device 300. [

Specifically, the remote control device 200 communicates with the electronic device 100 through the Bluetooth method to receive external device connection information from the electronic device 100, or wirelessly communicate with the external electronic device 300, And may receive external device connection information from the external electronic device 300 by performing communication through a communication method.

The remote control device 200 can receive external device connection information from at least one of the electronic device 100 and the external electronic device 300 through various communication methods, Of course.

The external device connection information includes information related to the external electronic device 300 itself such as the type and name of the external electronic device 300 connected to the electronic device 100, And < / RTI >

For example, the external device connection information may include information that a set-top box is connected to the HDMI port 1 of the electronic device 100 and a DVD player is connected to the HDMI port 2.

16, the remote control device 200 displays a first UI screen for controlling the electronic device 100 in the first area 211 of the display, a first UI screen for controlling the electronic device 100 in the second area 212, The second UI screen for controlling the device 300 and the third UI screen including the list of the external device connection information, i.e., the external electronic device 300, in the third area 213 .

However, the remote control apparatus 200 displays the first UI screen, the second UI screen, and the third UI screen together as described above. For example, when the external electronic device 300 is not connected to the electronic device 100, the remote control device 200 may display the first UI screen as a whole without displaying the second UI screen and the third UI screen It can also be displayed on the screen. In this case, the first UI area for controlling the electronic device 100 may be displayed in the first area 211, and the second area 212 and the third area 213 may be displayed as empty areas. In this case, a first UI screen for controlling the electronic device 100 is displayed in the first area 211, a second area 212 is displayed as a blank area, and a third area 213 is previously displayed And may display a list of external electronic devices 300 that have been connected to the electronic device 100. Accordingly, the user can recognize what external electronic device 300 is connectable to the electronic device 100. [

In the above description, the remote control system 1000 includes the electronic device 100, the remote control device 200, and the external electronic device 300. However, the remote control system 1000 according to an embodiment of the present disclosure 1000 may further include an external device 100-1 connected to the electronic device 100, as shown in Fig. 15B.

In this case, the electronic device 100 can act as a relay in transmitting and receiving data to / from the remote control device 300 and the external device 100-1 while operating the display function as a main function.

First, the external device 100-1 may be connected to the electronic device 100 and the external electronic device 300, as shown in FIG. 15B. For example, the external device 100-1 can be connected to the electronic device 100 and the external electronic device 300 through various wired cables such as an HDMI cable, an optical cable, and the like.

However, the present invention is not limited to this, and the external device 100-1 may be connected to the electronic device 100 and the external electronic device 300 through wireless communication. For example, the external device 100-1 can be connected to the electronic device 100 and the external electronic device 300 using various wireless communication methods such as a Bluetooth method, a Wi-Fi method, and the like.

Accordingly, the external device 100-1 can exchange various data with the electronic device 100 and the external electronic device 300. [ For example, the external device 100-1 may receive the image data provided by the external electronic device 300 from the external electronic device 300. For example, Then, the external device 100-1 can transmit the received image data to the electronic device 100, and accordingly, the electronic device 100 can output the image based on the received image data. The external device 100-1 may transmit a remote control signal for controlling the external electronic device 300 received from the electronic device 100 to the external electronic device 300. [ A detailed description related thereto will be described later.

The external device 100-1 performing the same function may be implemented as a one-connect box or the like. The external device 100-1 may be connected to the electronic device 100 and the external electronic device 300 and may transmit and receive data between the electronic device 100 and the external electronic device 300 The present invention can be implemented by various electronic devices capable of playing a role of relay.

15B, one external electronic device 100 is shown connected to the external device 100-1, but a plurality of external electronic devices 300 may be connected to the external device 100-1 Of course.

The remote control device 200 can control the electronic device 100 and the external electronic device 300 as described above. Here, the method of controlling the electronic device 100 has been described with reference to FIG. 15A, and thus will not be described here.

The remote control device 200 may transmit a remote control signal to the electronic device 100 to control the external electronic device 300 to control the external electronic device 300. [

For example, the remote control device 200 may transmit a remote control signal to the electronic device 100 in an infrared fashion. In this case, the electronic device 100 can transmit the infrared signal received from the remote control device 200 to the external device 100-1.

Thereafter, the external device 100-1 can search for an IR code matched with the infrared signal received among a plurality of IR code sets stored separately for each external electronic device 300. [ The external device 100-1 can transmit the infrared signal to the external electronic device 300 controlled by the searched IR code so that the control of the external electronic device 300 of the remote control device 200 .

Also, the remote control device 200 may communicate with the electronic device 100 through the Bluetooth method and transmit the remote control signal to the electronic device 100. [ In this case, the electronic device 100 can transmit the received remote control signal to the external device 100-1.

Thereafter, the external device 100-1 searches for an IR code corresponding to the remote control signal received from the electronic device 100 in the IR code set previously stored in the external device 100-1, and transmits the IR code to the external electronic device 300 So that control over the external electronic device 300 can be performed.

The external device 100-1 may transmit the remote control signal received from the remote control device 200 to the external electronic device 300 through a wireless communication method such as a Bluetooth method or a Wi-Fi method have. In this case, the external electronic device 300 can search for and execute the control code corresponding to the remote control signal among the pre-stored control code sets, and accordingly, the control of the external electronic device 300 of the remote control device 200 .

Also, the remote control device 200 can display a list of the external electronic devices 300 connected to the external device 100-1. More specifically, the remote control apparatus 200 receives external device connection information of the electronic device 100, that is, information on the external electronic device 300 connected to the external device 100-1, A list displaying information can be displayed.

Here, the remote control device 200 can receive the external device connection information from at least one of the electronic device 100, the external device 100-1, and the external electronic device 300. [

Specifically, the remote control apparatus 200 communicates with the electronic device 100 via the Bluetooth method to receive external device connection information from the electronic device 100, or to receive external device connection information from the external device 100-1, The wireless communication unit 300 may communicate with at least one of the plurality of wireless devices 300 through a wireless communication method such as Wi-Fi to receive external device connection information of the electronic device 100. [

The remote control device 200 is connected to at least one of the electronic device 100, the external device 100-1 and the external electronic device 300 via the various communication methods, It is of course possible to receive the connection information.

Then, the remote control device 200 can display the first to third UI screens as described above.

As such, according to the various embodiments of the present disclosure, since a remote control device 200 capable of controlling not only the electronic device 100 but also the external electronic device 300 connected to the electronic device 100 is provided, The convenience of the apparatus can be improved.

The remote control device 200 according to the present disclosure can control the external electronic device 300 through the electronic device 100 in a situation where the external electronic device 300 can not directly transmit an infrared signal or the like The user-friendliness can be improved.

Hereinafter, for the sake of convenience of explanation, the external electronic device 300 is directly connected to the electronic device 100 as shown in FIG. 15A.

17 is a block diagram for explaining a remote control device 200 according to an embodiment of the present disclosure.

17, the remote control apparatus 200 includes a display 210, a first communication unit 220, a second communication unit 230, and a processor 240.

The display 210 displays various screens. In particular, the display 210 displays a first UI screen for controlling the electronic device 100 in the first area of the display and a second UI screen for controlling the external electronic device 300 in the second area can do. In addition, the third area may display a third UI screen including information on the external device connection information of the electronic device 100, that is, information on the external electronic device 300 connected to the electronic device 100.

The display 210 may be implemented as various types of displays such as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), an LCoS (Liquid Crystal on Silicon), a DLP (Digital Light Processing) In addition, a driving circuit, a backlight unit, and the like that can be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, an OTFT (organic TFT)

The first communication unit 220 may be implemented as a unidirectional communication interface, and the second communication unit 230 may be implemented by a bidirectional communication interface.

Specifically, the first communication unit 220 can transmit the remote control signal to the electronic device 100 in one direction for controlling one of the electronic device 100 and the external electronic device 300. For example, the first communication unit 220 may select a graphic object for controlling the electronic device 100 through the first UI screen or a graphic object for controlling the external electronic device 300 through the second UI screen The infrared signal corresponding to the selected graphic object can be transmitted to the electronic device 100 in one direction.

To this end, the first communication unit 220 may include an infrared signal generator and an infrared signal generator.

The second communication unit 230 can communicate with one of the electronic device 100 and the external electronic device 300 in a bidirectional manner to transmit / receive various data.

Specifically, the second communication unit 230 may wirelessly communicate with one of the electronic device 100 and the external electronic device 300, such as a Bluetooth method or a Wi-Fi method, to transmit and receive various data in both directions.

For example, the second communication unit 230 may receive external device connection information from one of the electronic device 100 and the external electronic device 300. [ In addition, as will be described later, when the second communication unit 230 receives a selection command for selecting another external electronic device connected to the electronic device 100 in addition to the external electronic device 300 through the third UI screen, (100).

For this, the second communication unit 230 may include a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, and the like.

Meanwhile, the first communication unit 220 and the second communication unit 230 may be implemented with bidirectional communication interfaces of different standards.

In detail, the first communication unit 220 performs wireless communication with the electronic device 100 via the Bluetooth system to transmit / receive various data bidirectionally. For example, when the electronic device 100 and the remote control device 200 are paired, the first communication unit 220 transmits a remote control signal for controlling one of the electronic device 100 and the external electronic device 300 to the electronic device 100 To the device (100).

To this end, the first communication unit 220 may include a Bluetooth chip or the like.

The second communication unit 230 may perform wireless communication with the electronic device 100 or the external electronic device 300 via the wireless communication so as to transmit and receive various data bidirectionally. For example, the second communication unit 230 may receive external device connection information from the electronic device 100 or the external electronic device 300. [ The second communication unit 230 receives a selection command for selecting another external electronic device connected to the electronic device 100 in addition to the external electronic device 300 through the third UI screen, Lt; / RTI >

To this end, the second communication unit 230 may include a Wi-Fi chip, a wireless communication, and the like.

The processor 240 controls the overall operation of the remote control device 200. For example, the processor 240 may operate an operating system or an application program to control hardware or software components connected to the processor 240, and may perform various data processing and operations. In addition, the processor 240 may load and process instructions or data received from at least one of the other components into volatile memory and store the various data in non-volatile memory.

To this end, the processor 240 may be a generic-purpose processor capable of performing the corresponding operations by executing one or more software programs stored in a memory device or a dedicated processor (e.g., an embedded processor) (E.g., a CPU or an application processor).

First, the processor 240 may control the display 210 to display a first UI screen for controlling the electronic device 100. For example, the processor 240 may display a first UI screen for controlling the electronic device 100 when the remote control device 200 is turned on or an application previously stored in the remote control device is executed .

Here, a graphic object to which the key data for controlling the electronic device 100 is mapped may be included in the first UI screen. The key data refers to data including an instruction for controlling the electronic device 100 to perform an operation such as turn-on / turn-off.

To this end, the remote control device 200 may be storing graphics objects to which the key data for controlling the electronic device 100 are mapped. Specifically, the processor 240 may display a first UI screen including a graphic object for controlling the electronic device 100 based on the graphic object data stored in the storage unit. However, the present invention is not limited thereto, and the processor 240 may receive and display the graphic object to which the key data for controlling the electronic device 100 is mapped from the external server.

On the other hand, the graphical object may vary depending on the characteristics of the electronic device 100. For example, when the electronic device 100 is implemented as a TV, the first UI screen includes a graphic corresponding to an operation mode change key, a turn on / turn off key, a channel control key, and a volume control key, Objects may be included. In addition, the first UI screen may further include an input key for inputting a user interaction such as a graffiti interaction.

The processor 240 may control the first communication unit 220 to transmit the remote control signal to the electronic device 100 to perform the function of the electronic device 100. [

Specifically, when a user command for selecting a graphic object included in the first UI screen is inputted, the processor 240 controls the first communication unit 220 to transmit the key data mapped to the selected object to the electronic device 100 can do.

Here, the processor 240 can control the electronic device 100 by transmitting a remote control signal in an infrared manner. In particular, when the processor 240 transmits an infrared signal to the electronic device 100, the electronic device 100 can search for and execute a code set that matches the received infrared signal among the pre-stored IR code sets, Control of the electronic device 100 of the remote control device 200 can be performed.

In addition, the processor 240 may control the electronic device 100 by transmitting a remote control signal through a Bluetooth communication method. Specifically, when the processor 240 transmits a remote control signal via the Bluetooth communication method, the electronic device 100 can search for and execute a control code matching the remote control signal among the pre-stored control code sets, Control of the electronic device 100 of the device 200 can be performed.

The processor 240 may then control the display 210 to display a second UI screen for controlling the external electronic device 300. For example, the processor 240 can display a second UI screen for controlling the external electronic device 300 when the remote control device 200 is turned on or when an application previously stored in the remote control device is executed have.

Here, when the plurality of external electronic devices are connected to the electronic device 100, the processor 240 displays a second UI screen for controlling the external electronic device corresponding to the input source of the current electronic device 100 can do. For example, if a set-top box and a DVD player are connected to the interface of the electronic device 100 and the electronic device 100 is currently displaying an image provided by the set-top box, A second UI screen for controlling the set-top box.

To this end, the processor 240 may receive information about the current input source from the electronic device 100. [

Meanwhile, the second UI screen may include a graphic object to which the key data for controlling the external electronic device 300 is mapped. The key data is data including an instruction for controlling the external electronic device 300 to perform an operation such as turn on / off.

To this end, the remote control device 200 may be storing graphics objects to which the key data for controlling the electronic device 100 are mapped. Specifically, the processor 240 may display a second UI screen including a graphic object for controlling the external electronic device 300 based on the graphic object stored in the storage unit. However, the present invention is not limited thereto, and the processor 240 may receive and display the graphic object to which the key data for controlling the external electronic device 300 is mapped from the external server.

On the other hand, the graphic object may vary depending on the characteristics of the external electronic device 300. For example, when the external electronic device 300 is implemented as a set-top box, the second UI screen may be specifically used in addition to a turn-on / turn-off key, a channel control key, and a volume control key, which are universal keys commonly used in a set- A graphical object corresponding to a key-in TV replay, a TV schedule key, and the like may be included.

The processor 240 may control the first communication unit 220 to transmit a remote control signal to the electronic device 100 to perform a TV replay of the external electronic device 300, a TV program schedule, and the like. The processor 240 controls the first communication unit 220 to transmit the key data mapped to the selected object to the electronic device 100 when a user command for selecting the graphic object included in the second UI screen is inputted, can do.

Here, the processor 240 may control the external electronic device 100 by transmitting a remote control signal to the electronic device 100 in an infrared manner. In more detail, when the processor 240 transmits an infrared signal to the electronic device 100, the electronic device 100 transmits an infrared (IR) signal corresponding to the infrared signal received among the plurality of IR code sets You can explore the code. Then, the electronic device 100 can transmit the infrared signal to the external electronic device 300 controlled by the searched IR code, so that the control of the external electronic device 300 of the remote control device 200 is performed .

In addition, the processor 240 may control the external electronic device 300 by transmitting a remote control signal to the electronic device 100 in a Bluetooth communication manner. Specifically, when the processor 240 transmits a remote control signal to the electronic device 100 in a Bluetooth manner, the electronic device 100 transmits an IR code corresponding to the remote control signal received from the remote control device 200 to the electronic device 100. [ The IR code set stored in the IR code set 100 may be searched and transmitted to the external electronic device 300 so that the control of the external electronic device 300 can be performed.

When the processor 240 transmits the remote control signal to the electronic device 100 through the Bluetooth communication method, the electronic device 100 transmits the remote control signal received from the remote control device 200 to the Bluetooth Or may be transmitted to the external electronic device 300 through a wireless communication method. In this case, the external electronic device 300 can search for and execute the control code corresponding to the remote control signal among the pre-stored control code sets, and accordingly, the control of the external electronic device 300 of the remote control device 200 .

The processor 240 displays a first UI screen for controlling the electronic device 100 in the first area of the display 210 and a second UI screen for controlling the second electronic device 300 in the second area. A third UI screen including a list of the external electronic devices 300 may be displayed in the third area.

Here, the list for the external electronic device 300 includes external device connection information, i.e., information about the external electronic device 300 connected to the electronic device 100. More specifically, the external device connection information may include information related to the external electronic device 300 itself such as the type and name of the external electronic device 300 connected to the electronic device 100, 100 may be further included.

To this end, the processor 240 may receive external device connection information from at least one of the electronic device 100 and the external electronic device 300.

The processor 240 communicates with the electronic device 100 through the Bluetooth method and receives external device connection information from the electronic device 100 or transmits the external device connection information to the external electronic device 300 through a wireless communication method such as Wi- And may receive external device connection information of the electronic device 100 from the external electronic device 300. [

The processor 240 selects the second external electronic device through the second communication unit 230 when another external electronic device, for example, the second external electronic device, is selected based on the external device connection information via the third UI screen To the electronic device 100. [0034]

Hereinafter, for convenience of explanation, an external electronic device controlled through a second UI screen is defined as a first external electronic device, an external electronic device selected through a third UI screen is defined as a second external electronic device, do.

Specifically, when a user command for selecting any one of the at least one external device displayed on the third UI screen, for example, the second external electronic device, is inputted, the processor 240 transmits the second external electronic device And may transmit a selection command to electronic device 200 that includes associated connection information.

Then, when the processor 240 transmits a selection command for selecting the second external electronic device to the electronic device 100, the electronic device 100, in a state in which it operates with the first external electronic device as a source, The second external electronic device can be operated as a source based on the input source switching command included in the second external electronic device.

Meanwhile, the processor 240 may change a second UI screen for controlling the first external electronic device displayed in the second area to a fourth UI screen for controlling the second external electronic device.

Specifically, when a user command for selecting a second external electronic device is input, the processor 240 generates a graphic for controlling a second external electronic device corresponding to the selection instruction from the graphic object data previously stored in the remote control device 200 The object can be searched.

Accordingly, the processor 240 may change a second UI screen for controlling the first external electronic device displayed in the second area to a fourth UI screen for controlling the second external electronic device.

On the other hand, it is only an embodiment that mobile object data related to the above-described second external electronic device is stored, and the processor 240 receives the graphic object mapped with the key data for controlling the second external electronic device from the external server And receive and display it.

Thereafter, when a user command for selecting a graphic object included in the fourth UI screen is inputted, the processor 240 can transmit a remote control signal corresponding to the selected graphic object to the electronic device 100, Control for the electronic device can be performed.

As described above, the remote control apparatus 200 according to the embodiment of the present disclosure not only can provide a UI screen capable of controlling the electronic device 100 and the first external electronic device, When the external electronic device is selected and the source of the electronic device 100 is changed, the user's convenience can be increased in that a UI screen capable of controlling the second external electronic device can be provided.

FIG. 18 is a diagram for explaining a method in which a remote control apparatus according to an embodiment of the present disclosure changes and displays a third UI screen.

18A, when the electronic device 100 is a TV and the first external electronic device is a set-top box, the processor 240 includes a first area 211, a first area 211 for controlling the electronic device 100, A second UI screen 1812 for controlling the set top box is displayed in the second area 212 and a list of external electronic devices connected to the TV is displayed in the third area 213 A third UI screen 1813 including the first UI screen 1813 can be displayed.

At this time, when a second external electronic device, such as a DVD player, is connected to the remote electronic device 200, the processor 240 may receive connection information for the DVD player from the electronic device 100, as described above .

The processor 240 may also receive connection information for a DVD player from a second external electronic device, e.g., a DVD player, as described above. Specifically, the processor 240 may communicate with the second external electronic device to send a signal to the second external electronic device requesting connection information for the electronic device 100 of the second external electronic device, The external electronic device can transmit the connection information to the remote control device 300. [

Then, based on the received connection information of the second external electronic device, the processor 240 determines whether the type and name of the second external electronic device and information on the interface of the electronic device to which the second external electronic device is connected Can be determined.

The processor 240 may change the third UI screen 1813 displayed in the third area 213 to a UI screen including connection information for the DVD player and display the UI screen.

For example, referring to FIG. 18B, the processor 240 determines whether the second external electronic device is a DVD player and is connected through the HDMI port 2 of the electronic device 100, based on the received connection information of the second external electronic device , It is possible to display the list 1823 including 'DVD (HDMI 2)' in the third area (213).

As such, just by connecting the second external electronic device to the remote control device 200, the UI 1823 containing the connection information for the second external electronic device is displayed so that the user is connected to the electronic device 100 It becomes possible to quickly recognize the type of the external electronic device.

19 is a diagram for explaining an operation when a remote control device according to an embodiment of the present disclosure selects an external electronic device through a third UI screen.

When a user command for selecting a second external electronic device is input through the fourth UI screen while the second UI screen for controlling the first external electronic device is displayed in the second area, The electronic device 100 can transmit the source switching command. Specifically, the processor 240 may send a source switching command to the electronic device 100, including instructions to control the switching of the input source of the electronic device 100 from a first external electronic device to a second external electronic device .

In addition, when a user command for selecting a second external electronic device is input through the fourth UI screen, the processor 240 changes the second UI screen to a fourth UI screen for controlling the second external electronic device, can do.

For example, referring to FIG. 19A, when a user command to select a second external electronic device, e.g., a DVD player, is input 1930 through a third UI screen 213, The second UI screen 1912 can be changed to the fourth UI screen 1922 and displayed by searching for a graphic object corresponding to the second external electronic device selected according to the user command in the object data.

Accordingly, the user can conveniently select and control an external electronic device to be currently controlled from a plurality of external electronic devices connected to the electronic device 100. [

20 is a view for explaining the operation of the remote control device when the input source of the electronic device according to the embodiment of the present disclosure is switched.

The processor 240 may change the fourth UI screen to the second UI screen and display the fourth UI screen when a command for switching the input source of the electronic device 100 is inputted.

For example, referring to FIG. 20A, a graphical object 2010-1 to which key data for switching the source of the electronic device 100 is mapped may be displayed on the first UI screen 2010. FIG. Here, when the source switching key of the electronic device 100 is selected (2030) according to the user input, the processor 240 can transmit the source switching command to the electronic device 100. [

For example, when a source switching command is received from the remote control device 200 while the electronic device 100 is currently displaying an image provided by a second external electronic device, e.g., a DVD player, the electronic device 100 The source may be switched to a first external electronic device, e.g., a set top box, which is then connected to the electronic device 100 to display the image provided by the set top box.

At this time, the processor 240 may receive the connection information for the changed external electronic device from the electronic device 100 according to the source switching. Accordingly, the processor 240 can search the graphic object for the changed external electronic device based on the received connection information, and display the UI screen for controlling the changed external electronic device in the second area 212 .

For example, in the case where the electronic device 100 is providing an image with the DVD player as the source as shown in FIG. 20A, when the source is switched to the set-top box according to the source switching command 2030, the processor 240 And may receive identification information for the set-top box from the electronic device 100. [

Accordingly, as shown in FIG. 20B, the processor 240 can change the fourth UI screen 2012 to the second UI screen 921 and display it.

Accordingly, the user can conveniently control the external electronic device by changing the UI screen of the second area only by switching the source of the electronic device, without having to select an external electronic device to control through the list of external electronic devices .

21 is a detailed block diagram for explaining a remote control apparatus according to an embodiment of the present disclosure;

21, a remote control device 200 'according to an embodiment of the present invention includes a display 210, a first communication unit 220, a second communication unit 230, a processor 240, a storage unit 250 And a user interface 260. Hereinafter, the portions overlapping with the above-described portions will be omitted or abbreviated.

The storage unit 250 may store instructions or data related to components of the operating system (OS) and the remote control device 200 'for controlling the overall operation of the components of the remote control device 200' .

Accordingly, the processor 240 can control a plurality of hardware or software components of the remote control device 200 'using various commands or data stored in the storage unit 250, and can control at least one of the other components Load or process commands or data received from one in the volatile memory, and store various data in the nonvolatile memory.

The user interface 260 receives various user commands. In particular, the user interface 260 may receive user commands for various UI screens for controlling functions of the remote control device 200 'provided through the display 210. In particular, when the user interface 260 is implemented through the display 210, the user interface 260 may receive a user command for selecting a graphic object through a touch.

The processor 240 is a configuration for controlling the overall operation of the remote control device 200 '.

Specifically, the processor 240 includes a RAM 241, a ROM 242, a graphics processing unit 243, a main CPU 244, first through n interfaces 245-1 through 245-n, and a bus 246 . Here, the RAM 241, the ROM 242, the graphics processing unit 243, the main CPU 244, the first through n interfaces 245-1 through 245-n, etc. may be connected to each other via a bus 246 .

The first to n-th interfaces 245-1 to 245-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

The main CPU 244 accesses the storage unit 250 and performs booting using the O / S stored in the storage unit 250. [ The main CPU 244 can perform various operations using various programs, contents and data stored in the storage unit 250. [

The RAM 241 stores a command set for booting the system and the like. When power is supplied to the remote control apparatus 200 ', the main CPU 244 copies the O / S stored in the storage unit 250 to the RAM 241 according to the instruction stored in the ROM 242, To boot the system. When the booting is completed, the main CPU 244 copies various programs stored in the storage unit 250 to the RAM 241, executes the program copied to the RAM 241, and performs various operations.

The graphic processing unit 243 generates a screen including various objects such as an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The calculation unit (not shown) calculates an attribute value such as a coordinate value, a shape, a size, a color, and the like to be displayed for each object according to the layout of the screen based on the received control command. The rendering unit (not shown) creates screens of various layouts including objects based on the attribute values calculated by the operation unit (not shown). A screen generated in the rendering unit (not shown) is displayed on the display 210.

22 is a flowchart for explaining a control method of the remote control apparatus according to an embodiment of the present disclosure;

The remote control device displays a first UI screen for controlling the electronic device in the first area to control one of the electronic device and the first external electronic device connected to the electronic device, The UI screen can be displayed in the second area. The remote control device receives the external device connection information of the electronic device, displays a third UI screen displaying at least one external device connection information in the third area, and displays the third UI screen in the third area based on the external device connection information A selection command for selecting a second external electronic device is transmitted to the electronic device and a fourth UI screen for controlling the second external electronic device is displayed in the second area when the second external electronic device is selected . Accordingly, the user can be provided with a UI screen for controlling the electronic device and the external electronic device. When the input source of the electronic device is switched, the UI screen for controlling the external electronic device corresponding to the switched input source The external electronic device can be conveniently controlled together with the electronic device.

23 is a flow chart illustrating a method of controlling an electronic device 100 according to an embodiment of the present disclosure.

While the electronic device 100 is operating in the first mode of operation, the electronic device 100 includes a background image layer including a background background image of the electronic device 100 and a first content A screen can be displayed (S2310). As described above, the same method can be applied even when the electronic device 100 is changed from the second operation mode to the first operation mode.

When the operation mode switching command is input, the electronic device 100 decreases the resolution of the first content screen and displays a content layer including a content image on a part of the first content screen (S2320). Specifically, the electronic device 100 may remove the shadow layer included in the first content screen and reduce the resolution of the object layer and the background image layer.

Meanwhile, the methods according to various embodiments of the present invention described above can be implemented in the form of software or applications that can be installed in existing electronic devices.

Moreover, the methods according to various embodiments of the present invention described above can be implemented by software upgrading, or hardware upgrading, for existing electronic devices.

It is also possible that the various embodiments of the present invention described above are performed through an embedded server provided in the electronic device or a server outside the electronic device.

Meanwhile, the control method according to the various embodiments described above can be implemented by a program and provided to an electronic device. In particular, a program including a control method may be stored in a non-transitory computer readable medium.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of this disclosure.

100: electronic device 110: communication unit
120: display 130: memory
140: Processor 150: Broadcast receiver
155: Signal separator 160: A / V processor
165: audio output unit 170:
175: sensor 180:

Claims (15)

In an electronic device,
display; And
A processor for controlling the display; Lt; / RTI >
The processor comprising:
Wherein when the electronic device is in the first operation mode, a content screen including a background image layer including a background background image of the electronic device and an object layer including a graphic object is displayed on the display,
When a switching command for switching to the second operation mode is input, a resolution of the content screen displayed on the display is reduced, and a content layer including a content image progressively enlarged from one area in the content screen is displayed on the content screen So as to be displayed on the display unit.
The method according to claim 1,
The processor comprising:
When the content image included in the content layer is enlarged to the same size as the content screen, the content screen displayed on the display is removed, and another content screen including the enlarged content image is displayed on the display ≪ / RTI >
3. The method of claim 2,
Wherein the resolution of the other content screen is higher than the reduced resolution of the content screen.
The method according to claim 1,
The processor comprising:
Wherein when the switching command for switching to the second operation mode is input, the resolution of the object layer among the layers included in the content screen is reduced.
The method according to claim 1,
Wherein the content screen further comprises a shadow layer,
The processor comprising:
And when the switch command for switching to the second operation mode is input, the shadow layer is removed.
3. The method of claim 2,
The processor comprising:
When the electronic device is in the second operation mode, causing the other content screen including the content layer to be displayed on the display
When the switching instruction to switch to the first operation mode is input, the resolution of the other content screen displayed on the display is reduced, and the content screen is progressively enlarged from one area in the other content screen Electronic device.
The method according to claim 6,
The other content screen further includes an object layer itself,
The processor comprising:
And when the switch command for switching from the second operation mode to the first operation mode is input, removes the object layer of the other contents screen.
A method of displaying an electronic device,
Displaying a content screen including a background image layer including a background background image of the electronic device and an object layer including a graphic object when the electronic device is in a first operation mode; And
When a switching command for switching to the second operation mode is inputted, a resolution of the content screen is reduced, and a content layer including a content image gradually enlarged and displayed from one area of the content screen is added to the content screen, ; / RTI >

9. The method of claim 8,
If the content image included in the content layer is enlarged to the same size as the content screen, removing the content screen and displaying another content screen including the enlarged content image; ≪ / RTI >
10. The method of claim 9,
Wherein the resolution of the other content screen is higher than the reduced resolution of the content screen.
9. The method of claim 8,
Wherein the resolution of the content screen is reduced by adjusting the resolution of the object layer.
9. The method of claim 8,
Wherein the content screen further comprises a shadow layer,
In the display method,
Removing the shadow layer when switching from the first operation mode to the second operation mode; ≪ / RTI >
10. The method of claim 9,
Displaying the other content screen including the content layer when the electronic device is in the second operation mode; And
Reducing the resolution of the other content screen and progressively enlarging the content screen from one area of the other content screen when a switching command for switching to the first operation mode is input; ≪ / RTI >
14. The method of claim 13,
The other content screen further includes an object layer itself,
In the display method,
Removing the object layer of the other content screen when the second operation mode is switched to the first operation mode; ≪ / RTI >

A computer-readable recording medium containing a program for executing a display operation of an electronic apparatus,
The display operation of the electronic device includes:
Displaying a content screen including an object layer including a background image layer and a graphic object including a background background image of the electronic device while the electronic device is operating in a first operation mode; And
Wherein when a switching command for switching from the first operation mode to the second operation mode is input, a content layer including a content image gradually enlarged from one area in the content screen is reduced, Adding and displaying the content screen; Readable medium.

Images