KR20210121784A - Display device - Google Patents

Abstract

An objective of the present disclosure is to provide a display device that enables a user to quickly access desired information. The display device according to an embodiment of the present disclosure includes a communication interface for communicating with an external device; a display for showing a user interface (UI) screen; and a processor for receiving, from the external device, an image through the communication interface, identifying an object included in the image, from the received image, generating an icon representing the identified object, adding the created icon on the UI screen, and outputting detailed information of the object according to the command to select the icon.

Description

display device {DISPLAY DEVICE}

The present disclosure relates to a display device, and more particularly, to a wall display device.

A wall display is a type of display in which a rear surface is fixed to a wall and displayed.

The wall display can be used as a picture frame by displaying a picture or a picture when operating in a standby mode at home. That is, the wall display can be used harmoniously with the interior of the house.

Wall displays are mainly used to reproduce moving images or still images.

A conventional wall display displays a plurality of app icons corresponding to each of a plurality of applications, like a function provided by a conventional TV.

However, each app icon has a uniform shape provided by the manufacturer of the display device, and there is a problem in that it does not reflect the taste of the user.

In addition, when selecting each app icon, the user needs an additional input for searching, so there is a problem in accessibility to the application.

An object of the present disclosure is to enable an icon to be created in which a user's taste is reflected.

An object of the present disclosure is to provide a display device that enables a user to quickly access desired information.

A display device according to an embodiment of the present disclosure fixed to a wall according to an embodiment of the present disclosure includes a communication interface for communicating with an external device, a display displaying a user interface (UI) screen, and the external device, Receive an image through the communication interface, identify an object included in the image from the received image, generate an icon representing the identified object, add the generated icon on the UI screen, and select the icon The processor may include a processor that outputs detailed information of the object according to a selected command.

The detailed information of the object may include one or more of access information for accessing the detailed information of the object, search information indicating a search result of the object, and content information describing the contents of the object.

The processor may generate the icon having the same shape as the identified object.

When the identified object is a book, the processor may acquire a signature of the book by an optical character reading technique, and add the acquired signature on the icon.

The processor may display an e-book electronically providing the contents of the book on the display according to a command for selecting the icon.

The display device further includes a memory for storing an artificial neural network-based object identification model learned by a deep learning algorithm or a machine learning algorithm, and the processor uses the object identification model to identify the object from the image to obtain object identification data, and use the obtained object identification data to generate the icon.

The operation mode of the display device includes a power saving mode and a normal mode, the UI screen is displayed under the normal mode, and the processor captures the UI screen when the operating mode is changed from the normal mode to the power saving mode and the captured captured image may be displayed on the display.

The processor may change the operation mode from the normal mode to a power saving mode when no user is detected for a predetermined time.

The display device further includes one or more sensors for acquiring sensed data, wherein the sensed data includes either motion data acquired through a motion sensor or voice data acquired through a microphone, and the processor includes motion data or The user may be detected using voice data.

Under the normal mode, the UI screen may be manipulated by a cursor, and under the power saving mode, the captured image may be continuously displayed on the display.

The UI screen may be an initial screen displayed when the power of the display device is turned on.

The UI screen may include a first icon selectable by the cursor and a second icon selectable by the cursor.

When the cursor is placed on the first icon, the processor may display an indicator including summary information of the detailed information accessible by selection of the first icon.

The UI screen may further include a lighting icon for controlling a lighting device connected to the display device, and the processor may transmit a signal for controlling power of the lighting device to the lighting device by selecting the lighting icon.

According to various embodiments of the present disclosure, a user may create an icon suitable for a desired taste and use it as a component of the interior of the home.

In addition, the user can quickly access detailed information through the icon created on the UI screen.

Also, when the display device is not in use, an image displayed by the display device can give an interior effect and prevent power consumption.

1 is a view for explaining an actual configuration of a display device according to an embodiment of the present disclosure.
2 is a block diagram illustrating a configuration of a display apparatus according to an embodiment of the present disclosure.
3 is a view for explaining a method of operating a display apparatus according to an embodiment of the present disclosure.
4 is a flowchart illustrating a method of correcting an image based on an amount of light and a color of a wall according to an embodiment of the present disclosure;
5 and 6 are diagrams for explaining an example of correcting a source image based on at least one of an amount of light and a color of a wall according to an embodiment of the present disclosure.
7 is a view for explaining a table in which output brightness of a display corresponding to an amount of light sensed through an illuminance sensor is stored.
8 is a view for explaining a process of adjusting a quality factor of a source image according to an embodiment of the present disclosure.
9 is a view for explaining a process of adjusting a quality factor of a source image according to another embodiment of the present disclosure.
10 is a view for explaining a learning process of a sun position estimation model according to an embodiment of the present disclosure.

1 is a view for explaining an actual configuration of a display device according to an embodiment of the present disclosure.

The display device 100 may be implemented as a TV, a tablet PC, digital signage, or the like.

The display device 100 of FIG. 1 may be fixed to the wall 10 . As the display apparatus 100 is fixed to the wall, the display apparatus 100 may be referred to as a wall display apparatus.

The wall display apparatus 100 may be provided in a home and perform a decorative function. The wall display apparatus 100 may display a picture or a picture, and may be used as a single frame.

2 is a block diagram illustrating components of a display device according to an embodiment of the present disclosure.

In particular, the components of FIG. 2 may be provided in the head 101 of FIG. 1 .

Referring to FIG. 2 , the display apparatus 100 includes a communication unit 110 , an input unit 120 , a learning processor 130 , a sensing unit 140 , an output unit 150 , a memory 170 , and a processor 180 . may include

The communication unit 110 may transmit/receive data to and from external devices such as another terminal or an external server using wired/wireless communication technology. For example, the communication unit 110 may transmit/receive sensor information, a user input, a learning model, a control signal, and the like with external devices.

At this time, the communication technology used by the communication unit 110 includes GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), LTE (Long Term Evolution), 5G, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity) ), Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), ZigBee, NFC (Near Field Communication), and the like.

The input unit 120 may acquire various types of data.

In this case, the input unit 120 may include a camera for inputting an image signal, a microphone for receiving an audio signal, a user input unit for receiving information from a user, and the like. Here, the camera or microphone may be treated as a sensor, and a signal obtained from the camera or microphone may be referred to as sensing data or sensor information.

The input unit 120 may acquire training data for model training and input data to be used when acquiring an output using the training model. The input unit 120 may acquire raw input data, and in this case, the processor 180 or the learning processor 130 may extract an input feature as a preprocessing for the input data.

The input unit 120 may include a camera (Camera, 121) for inputting an image signal, a microphone (Microphone, 122) for receiving an audio signal, and a user input unit (User Input Unit, 123) for receiving information from a user. have.

The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For the input of image information, the display apparatus 100 includes one or more Cameras 121 may be provided.

The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 .

The microphone 122 processes an external sound signal as electrical voice data. The processed voice data may be variously utilized according to a function (or a running application program) being performed by the display apparatus 100 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be applied to the microphone 122 .

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123 , the processor 180 may control the operation of the display apparatus 100 to correspond to the input information. .

The user input unit 123 includes a mechanical input means (or a mechanical key, for example, a button located on the front/rear or side of the terminal 100, a dome switch, a jog wheel, a jog switch, etc.) and It may include a touch-type input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. It may be made of a touch key (touch key) disposed on the.

The learning processor 130 may train a model composed of an artificial neural network by using the training data. Here, the learned artificial neural network may be referred to as a learning model. The learning model may be used to infer a result value with respect to new input data other than the training data, and the inferred value may be used as a basis for a decision to perform a certain operation.

In this case, the learning processor 130 may include a memory integrated or implemented in the display device 100 . Alternatively, the learning processor 130 may be implemented using the memory 170 , an external memory directly coupled to the display device 100 , or a memory maintained in an external device.

The sensing unit 140 may acquire at least one of internal information of the display apparatus 100 , information about the surrounding environment of the display apparatus 100 , and user information by using various sensors.

At this time, sensors included in the sensing unit 140 include a proximity sensor, an illuminance sensor, an acceleration sensor, a magnetic sensor, a gyro sensor, an inertial sensor, an RGB sensor, an IR sensor, a fingerprint recognition sensor, an ultrasonic sensor, an optical sensor, a microphone, and a lidar. , radar, etc.

The output unit 150 may generate an output related to visual, auditory or tactile sense.

In this case, the output unit 150 may include a display unit that outputs visual information, a speaker that outputs auditory information, and a haptic module that outputs tactile information.

The output unit 150 includes at least one of a display unit 151, a sound output unit 152, a haptic module 153, and an optical output unit 154. can do.

The display unit 151 displays (outputs) information processed by the display apparatus 100 . For example, the display unit 151 may display information on an execution screen of an application program driven on the display device 100 , or user interface (UI) and graphic user interface (GUI) information according to the information on the execution screen.

The display unit 151 may implement a touch screen by forming a layer structure with the touch sensor or being formed integrally with the touch sensor. Such a touch screen may function as the user input unit 123 providing an input interface between the display apparatus 100 and a user, and may provide an output interface between the terminal 100 and the user.

The sound output unit 152 may output audio data received from the communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like.

The sound output unit 152 may include at least one of a receiver, a speaker, and a buzzer.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration.

The light output unit 154 outputs a signal for notifying the occurrence of an event by using the light of the light source of the display apparatus 100 . Examples of the event generated in the display apparatus 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The memory 170 may store data supporting various functions of the display apparatus 100 . For example, the memory 170 may store input data obtained from the input unit 120 , learning data, a learning model, a learning history, and the like.

The processor 180 may determine at least one executable operation of the display apparatus 100 based on information determined or generated using a data analysis algorithm or a machine learning algorithm. In addition, the processor 180 may control the components of the display apparatus 100 to perform the determined operation.

To this end, the processor 180 may request, search, receive, or utilize the data of the learning processor 130 or the memory 170, and may perform a predicted operation or an operation determined to be desirable among the at least one executable operation. It is possible to control the components of the display apparatus 100 to execute it.

In this case, when the connection of the external device is required to perform the determined operation, the processor 180 may generate a control signal for controlling the corresponding external device and transmit the generated control signal to the corresponding external device.

The processor 180 may obtain intention information with respect to a user input and determine a user's requirement based on the obtained intention information.

In this case, the processor 180 uses at least one of a speech to text (STT) engine for converting a voice input into a character string or a natural language processing (NLP) engine for obtaining intention information of a natural language. Intention information corresponding to the input may be obtained.

At this time, at least one of the STT engine and the NLP engine may be configured as an artificial neural network, at least a part of which is learned according to a machine learning algorithm. And, at least one or more of the STT engine or the NLP engine may be learned by the learning processor 130 , learned by an external server, or learned by distributed processing thereof.

The processor 180 collects history information including user feedback on the operation contents or operation of the display device 100 and stores it in the memory 170 or the learning processor 130, or to an external device such as an external server. can be transmitted The collected historical information may be used to update the learning model.

The processor 180 may control at least some of the components of the display apparatus 100 to drive an application program stored in the memory 170 . Furthermore, in order to drive the application program, the processor 180 may operate two or more components included in the display apparatus 100 in combination with each other.

3 is a view for explaining a method of operating a display apparatus according to an embodiment of the present disclosure.

The processor 180 of the display apparatus 100 displays a user interface screen on the display 151 (S301).

In an embodiment, the UI screen may be a screen displayed first when the power of the display apparatus 100 is turned on. The UI screen may be an initial screen displayed when the display 151 is turned on.

When the display apparatus 100 is provided in the house, the UI screen may be a screen in harmony with the interior of the room, such as a chest of drawers or a picture frame.

The UI screen may include a plurality of icons. Each icon may correspond to an application. The application may be installed on the display device 100 .

The UI screen may include selectable icons and non-selectable icons according to a user input.

The processor 180 of the display apparatus 100 receives an image and icon creation command from an external device (S303).

The processor 180 may receive an image captured by the external device and an icon creation command corresponding to the image.

In an embodiment, the external device may be a user's mobile terminal. The processor 180 may receive an image and icon creation command from the mobile terminal through the communication interface 110 .

The icon creation command may be a command for generating an icon for identifying an object included in the received image.

The icon creation command may be a command for adding an icon for providing detailed information of an object included in an image on the UI screen.

The processor 180 of the display apparatus 100 identifies an object included in the image by using the received image (S305).

The processor 180 may identify the object from the image by using the object identification model stored in the memory 170 .

The object identification model may be an artificial neural network-based model supervised through a deep learning algorithm or a machine learning algorithm.

An object identification model is demonstrated with reference to FIG.

4 is a diagram illustrating a learning process of an object identification model according to an embodiment of the present disclosure.

Referring to FIG. 4 , the object identification model 400 may infer object identification information by using a training data set including image data for training and labeling data labeled therewith.

The labeling data is correct answer data and may be object identification data.

The object identification model 400 may be trained to minimize a cost function corresponding to the difference between the labeling data and the inferred object identification data.

The cost function of the object identification model 400 may be expressed as a square average of a difference between a label for object identification information corresponding to each image data and object identification data inferred from each image data.

When an input feature vector is extracted from the image data for training and input, an object identification result is output as a target feature vector, and the object identification model 400 loses a loss corresponding to the difference between the output target feature vector and the labeled object identification information. It can be learned to minimize the function.

The object identification model 400 may be learned by the learning processor 130 or the AI server of the display apparatus 100 and mounted on the display apparatus 100 .

As such, through the object identification model 400 , an object may be identified from the image data.

The object identification data or object identification information may be the name of the object.

Again, FIG. 3 will be described.

The processor 180 of the display apparatus 100 generates an icon corresponding to the object based on the identified object (S307).

In an embodiment, the processor 180 may generate an icon in a form corresponding to the object.

For example, when the object is a book, an icon having a book shape may be created.

As another example, when the object is a plant, an icon having the behavior of a plant may be created.

In another embodiment, the processor 180 may generate the received image itself as an icon.

In another embodiment, the processor 180 may acquire a three-dimensional icon having a shape similar to that of the object by searching for the identified object.

In another embodiment, the processor 180 may generate an icon by combining the 3D shape of the identified object with the received image.

In another embodiment, the icon may be created according to a user's setting on a menu for creating an icon. The menu may include items for setting the properties of the icon, such as the shape and size of the icon, and the user may create an icon of a desired shape by manipulating the menu.

The processor 180 of the display apparatus 100 adds the generated icon to the UI screen (S309).

The processor 180 may insert the created icon in one area of the UI screen.

The UI screen may include a plurality of areas. Each of the plurality of regions may include a selectable icon or a non-selectable image item.

The selectable icon may be one that can be selected by a remote control device such as a remote control. That is, the selectable icon may be an icon selectable by a cursor.

The cursor may move according to the movement of the remote control for controlling the operation of the display apparatus 100 and may be controlled according to the operation of the remote control.

The non-selectable image item may be an item that cannot be selected by a cursor.

The processor 180 of the display apparatus 100 displays detailed information of an object corresponding to the icon on the display 151 according to a command for selecting an icon added to the UI screen (S311).

The detailed information of the object may include one or more of access information for accessing the identified object, information describing the contents of the object, and search information indicating a search result of the object.

The access information of the object may be an access address of a web site that can provide detailed information of the object.

5 to 8 are diagrams for explaining an example of adding an icon for identifying an object from an image photographed through an external device and providing detailed information of the object according to the selection of the icon, according to an embodiment of the present disclosure.

In particular, FIGS. 5 to 8 relate to an embodiment of photographing a book through the user's mobile terminal 200, adding an icon for identifying the book on the UI screen, and providing the contents of the book according to the selection of the icon will be.

First, referring to FIG. 5 , the display apparatus 100 displays a UI screen 500 on the display 151 .

The display apparatus 100 may display the UI screen 500 on the display 151 under the standby mode.

The mobile terminal 200 may photograph the book 501 . The display apparatus 100 may receive an image of the book 501 photographed from the mobile terminal 200 .

The display apparatus 100 may obtain identification data of an object from the received image by using the object identification model 400 .

The display apparatus 100 may identify the responsibility of the object included in the image through the object identification model 400 .

The display apparatus 100 may further recognize text included in the image by using an optical character recognition (OCR) technique.

The display apparatus 100 may obtain the signature of the book 501 through the recognized text.

The display apparatus 100 may generate an identified book-shaped book icon.

The display device 100 may add the recognized text to the book icon by using an optical character reading company.

The display apparatus 100 may add a book icon 610 in which text is written on the UI screen 500 .

Referring to FIG. 6 , it can be seen that a book icon 610 is added to the UI screen 500 .

On the other hand, when a command for selecting the book icon 610 included on the UI screen 500 is received, the display device 100 displays related information or the book 501 of the book 501 identified by the book icon 610 . ) can be provided.

Specifically, when a command to select the book icon 610 is received, the display device 100 displays the related information 700 of the book 501 on the display 151 as shown in FIG. 7 . can

When the display apparatus 100 receives a command to select the book icon 610 , the display device 100 searches for the related information 700 of the book 501 through the website using the signature of the book 501 , and the retrieved information 700 may be displayed on the display 151 .

The related information 700 of the book 501 may include one or more of a price of the book 501 , a plot of the book, an author of the book, a book review of the book, and information on an e-book provider.

As another example, when the display apparatus 100 receives a command to select the book icon 610, as shown in FIG. 8, the electronic book 800 provides the contents of the book 501 in the form of a web browser. may be displayed on the display 151 .

After obtaining the signature of the book 501 , the display apparatus 100 may obtain information about the e-book in advance.

The user can easily access information on the book 501 through the related information of the book 501 or the electronic book 800 .

In another embodiment, the analysis of the image captured by the mobile terminal 200 may be performed on the mobile terminal 200 .

The mobile terminal 200 may obtain identification data of an object from the captured image by using the object identification model.

The mobile terminal 200 may transmit the acquired object identification data, image, and text acquired through the optical character reading technique to the display device 100 .

The display apparatus 100 may generate an icon for identifying the object by using the object identification data, the image, and the text.

The display apparatus 100 may search for and acquire the shape of the object based on the identification data of the object, combine the shape of the object with an image, and generate an icon.

As another example, the display apparatus 100 may generate an icon by reflecting the text on the shape of the object.

9 is a flowchart illustrating a method of operating a display apparatus according to another embodiment of the present disclosure.

In particular, FIG. 9 is a view for explaining an embodiment in which power saving of the display apparatus 100 can be performed according to whether a user is detected.

The power mode of the display apparatus 100 may include a power saving mode and a normal mode.

The power saving mode may be a mode in which only a minimum amount of power is required to drive the display apparatus 100 . Under the power saving mode, the display 151 may only display a specific image, and only some pixels may be driven. In addition, under the power saving mode, the brightness of the displayed image may be automatically controlled to decrease.

The normal mode may be a mode in which all pixels constituting the display 151 are driven and a UI screen displayed on the display 151 can be controlled through a user input.

Referring to FIG. 9 , the processor 180 of the display apparatus 100 displays a UI screen on the display 151 ( S901 ).

The processor 180 may display a UI screen on the display 151 under the normal mode of the display apparatus 100 . The UI screen may be the screen 500 illustrated in FIG. 5 .

The processor 180 determines whether the user is not detected for a predetermined period of time (S903), and when it is determined that the user is not detected for a predetermined period of time, switches the operation mode of the display apparatus 100 to a power saving mode ( S905).

The processor 180 may determine whether the user is detected based on the sensing data acquired through the sensing unit 140 .

The processor 180 may acquire the user's motion data by using the motion sensor included in the sensing unit 140 . The motion data may be data used to detect a user's movement.

The processor 180 may determine that the user is detected when the user's movement is detected by using the motion data.

As another example, the processor 180 may acquire voice data input through the microphone 122 as sensing data. The microphone 122 may exist as a component of the sensing unit 140 .

When the voice data is a human voice, the processor 180 may determine that the user is detected.

When there is no input to the remote control device for controlling the operation of the display device 100 for a predetermined time, the processor 180 may determine that the user is not detected.

The processor 180 may operate the operation mode of the display apparatus 100 as a power saving mode when no user is detected for a predetermined time. The predetermined time may be 30 seconds, but this is only an example.

Thereafter, the processor 180 captures the UI screen being displayed on the display 151 (S907), and displays an image of the captured UI screen on the display 151 (S909).

The processor 180 may capture the UI screen and display the captured image on the display 151 .

The processor 180 may continuously display the captured image in the power saving mode until the user is detected later.

On the captured image, an icon or other item may not be selectable through the cursor. This is because an icon is also a simple image.

Thereafter, the processor 180 determines whether the user is detected (S911), and when it is determined that the user is detected, changes the captured image to the UI screen (S913).

When it is determined based on the sensed data that the user is detected, the processor 180 may change the operation mode from the power saving mode to the normal mode and simultaneously change the captured image to the UI screen.

That is, when the user is not detected, the processor 180 may display a captured image of the UI screen on the display 151 to prevent power consumption. When the user is detected, the processor 180 automatically converts the image displayed on the display 151 to the UI screen, thus enabling manipulation of the UI screen naturally.

10 is a UI screen displayed under the normal mode of the display apparatus, and FIG. 11 may be a captured image displayed under the power saving mode of the display apparatus.

Referring to FIG. 10 , the display apparatus 100 may display the UI screen 1000 under the normal mode.

The UI screen 1000 may include a first icon 1010 , a third icon 1050 selectable by the cursor 201 , and a second icon 1030 selectable by the cursor 201 .

Each of the first icon 1010 and the third icon 1050 may be an icon generated by photographing an object according to the embodiment of FIG. 3 .

The second icon 1030 may be an icon for emphasizing the interior effect when the operation mode of the display apparatus 100 is the power saving mode.

The UI screen 1000 may be a screen that can be manipulated by the cursor 201 .

The UI screen 1000 may be a screen on which an indicator related to an icon is displayed according to the position of the cursor 201 .

For example, when the cursor 201 is positioned on a specific icon 1010 , the display apparatus 100 may display an indicator 1011 indicating that the icon 1010 can be selected adjacent to the icon 1010 , or (1010) can be displayed.

The indicator 1011 may include summary information summarizing detailed information accessible according to selection of the icon 1010 .

When receiving a command for selecting either the icon 1010 or the indicator 1011 , the display apparatus 100 may display an execution screen of an application corresponding to the icon 1010 or the indicator 1011 .

Referring to FIG. 11 , when the operation mode is in the power saving mode, the display apparatus 100 displays the captured image 1100 of the UI screen 1000 on the display 151 .

When the user is not detected for a predetermined time, the display apparatus 100 may change the operation mode from the normal mode to the power saving mode. At the same time, the display apparatus 100 may capture the UI screen 1000 and display the captured image 1100 on the display 151 .

The captured image 1100 may be continuously displayed while the operation mode of the display apparatus 100 maintains the power saving mode.

When the UI screen 1000 is a chest-shaped screen, the captured image 1100 may also be a chest-shaped image. The captured image 1100 may bring about an interior effect, such as a chest of drawers, where the display device 100 is located.

Meanwhile, in the UI screen 1000 illustrated in FIG. 10 , the second icon 1050 may be an icon for controlling a lighting device in the home. For example, when receiving a command for selecting the second icon 1050 , the display apparatus 100 may turn on or off the power of a lighting device wirelessly connected to the display apparatus 100 .

The display device 100 may provide a status of the lighting device through the second icon 1050 .

12 is a view for explaining an example of controlling an external device connected to a display device through selection of an icon on a UI screen according to an embodiment of the present disclosure;

Referring to FIG. 12 , the UI screen 1000 may include a third icon 1050 for controlling a lighting device in the living room by being wirelessly connected to the display device 100 .

When the display device 100 receives a command to select the third icon 1050 , the display device 100 communicates a control signal for turning on or off the power of the lighting device to the lighting device in the living room identified by the third icon 1050 . It can be transmitted through the interface 110 .

The lighting device may turn on or off the lighting according to a control signal received from the display device 100 .

The user can easily control the lighting device in the house through the lighting icon 1050 included in the UI screen 1000, thereby greatly improving convenience.

Meanwhile, the UI screen 1000 may include a fourth icon 1070 representing a plant generated by photographing a plant.

The display apparatus 100 may change the property of the fourth icon 1070 by using the illuminance information measured by the illuminance sensor provided in the sensing unit 140 .

For example, the display apparatus 100 may apply an effect of growing leaves or flowers to the fourth icon 1070 as the amount of light measured by the illuminance sensor increases. Accordingly, the user may receive a feeling of actually growing plants.

13 is a view for explaining that a UI screen in a different form is provided by replacing a side frame included in a periphery of a display according to an embodiment of the present disclosure;

Referring to FIG. 13 , the display apparatus 100 may include a display 151 and a peripheral portion 1300 surrounding the display 151 .

Any one of a plurality of detachable side frames 1301 to 1307 may be mounted on a side surface of the peripheral portion 1300 .

The display apparatus 100 may display a UI screen in a different form according to a change in the side frame mounted on the side of the peripheral part 1300 .

For example, the display apparatus 100 may control the UI screen to match the color of the drawer with the color of the side frame on the UI screen in the form of a chest of drawers.

As another example, the display apparatus 100 may change the color of icons included in the UI screen according to the color of the side frame on the UI screen in the form of a chest of drawers.

As described above, by changing the shape of the UI screen according to the properties of the side frame, the interior effect may be more prominent.

The above-described method according to an embodiment of the present disclosure may be implemented as a processor-readable code on a medium in which a program is recorded. Examples of the processor-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like.

In the display device described above, the configuration and method of the above-described embodiments are not limitedly applicable, but all or part of each embodiment may be selectively combined so that various modifications may be made. may be

Claims (14)

In the display device,
a communication interface for communicating with an external device;
a display for displaying a user interface (UI) screen; and
Receive an image from the external device through the communication interface, identify an object included in the image from the received image, generate an icon representing the identified object, and add the created icon to the UI screen and a processor for outputting detailed information of the object according to a command for selecting the icon
display device. According to claim 1,
The detailed information of the object is
Including at least one of access information for accessing the detailed information of the object, search information indicating a search result of the object, and content information describing the content of the object
display device. According to claim 1,
the processor
generating the icon having the same shape as the identified object
display device. 4. The method of claim 3,
the processor
If the identified object is a book, obtaining a signature of the book by an optical character reading technique,
adding the acquired signature on the icon
display device. 5. The method of claim 4,
the processor
displaying an e-book electronically providing the contents of the book on the display according to a command for selecting the icon
display device. According to claim 1,
Further comprising a memory for storing an artificial neural network-based object identification model learned by a deep learning algorithm or a machine learning algorithm,
the processor
obtaining, from the image, object identification data for identifying the object by using the object identification model;
Using the obtained object identification data to create the icon
display device. According to claim 1,
The operation mode of the display device includes a power saving mode and a normal mode,
The UI screen is displayed under the general mode,
the processor
When the operation mode is changed from the normal mode to the power saving mode, capturing the UI screen and displaying the captured captured image on the display
display device. 8. The method of claim 7,
the processor
When the user is not detected for a certain period of time, the operation mode is switched from the normal mode to the power saving mode.
display device. 9. The method of claim 8,
One or more sensors for acquiring sensing data,
The sensing data includes either motion data acquired through a motion sensor or voice data acquired through a microphone,
The processor detects the user using motion data or voice data.
display device. 8. The method of claim 7,
Under the general mode, the UI screen is operable by a cursor,
Under the power saving mode, the captured image is continuously displayed on the display.
display device. According to claim 1,
The UI screen is an initial screen displayed when the power of the display device is turned on.
display device. According to claim 1,
The UI screen is
A first icon selectable by the cursor and a second icon not selectable by the cursor
display device. 13. The method of claim 12,
the processor
When the cursor is placed on the first icon, displaying an indicator including summary information of the detailed information accessible by selection of the first icon
display device. According to claim 1,
The UI screen is
Further comprising a lighting icon for controlling a lighting device connected to the display device,
The processor transmits a signal for controlling the power of the lighting device to the lighting device by selecting the lighting icon
display device.

Images