WO2019182255A1

WO2019182255A1 - Video display device and control method thereof

Info

Publication number: WO2019182255A1
Application number: PCT/KR2019/002218
Authority: WO
Inventors: 이다경; 김남훈; 김성엽; 노진욱; 유혜종; 이상운; 임정빈
Original assignee: 엘지전자 주식회사
Priority date: 2018-03-22
Filing date: 2019-02-22
Publication date: 2019-09-26

Abstract

The present invention provides a video display device and a control method thereof. The video display device includes a display unit, a sensor configured to detect an object when the display unit is turned off, and a control unit configured to control the display unit to turn on at least one area of the display unit in response to the detection of a predetermined object through the sensor.

Description

Video display device and its control method

The present invention relates to an image display device, and more particularly, to an image display device including a display unit and a control method thereof.

The video display device includes both a device for recording and playing a video and a device for recording and playing audio. The apparatus for recording and reproducing moving images includes a TV, a computer monitor, a projector, and the like as the image display apparatus.

As the functions of the video display device are diversified, in addition to the playback of music or video files, the video display device has a multimedia player in the form of a complex function such as taking a picture or video, playing a game or receiving a broadcast. Is being implemented. Further, in order to support and increase the function of the image display device, it may be considered to improve the structural part and the software part of the image display device.

The video display device may provide a standby screen that provides an image and simple time information when the user does not see the video display device. However, there is a limitation that the standby screen cannot be provided when the power is off and not linked with the contents provided in real time.

It is difficult to determine when the screen is activated and the privacy level of the content because it is difficult to recognize the user presence and profile in front of the device in a video display device without a sensor capable of user recognition. Even if the user recognition sensor is applied to the image display device, since the image display device is a common device, there is a need for a method of delivering customized information in a situation where a single user or multiple users exist.

It is an object of the present invention to solve the above and other problems.

An object of the present invention is to provide a video display device that can recognize a user even when the display unit is off, and can provide a customized image to the user by turning on the display unit without a user input.

The present invention provides an image display device and a control method thereof.

The video display device includes a display unit; A sensor configured to detect an object in the off state of the display unit; And a controller configured to control the display unit to turn on at least one area of the display unit in response to the detection of a predetermined object through the sensor.

According to an embodiment of the present disclosure, the camera may further include a camera configured to photograph the predetermined object in response to the detection of the predetermined object from the sensor, and the controller may identify the user by using an image received from the camera, The display may be controlled to display different images in the at least one region.

According to an embodiment of the present disclosure, when the user is a registered user registered in a storage space, the controller may control the display unit to display a customized image based on a preference of the registered user.

According to an embodiment of the present disclosure, when the unregistered user who is not registered in the storage space is included in the user, the controller may control the display unit to display a basic image instead of the customized image.

According to an embodiment of the present disclosure, the controller controls the display unit to display the first image in response to the first user being identified, and controls the display unit to display the second image in response to the second user to be identified. can do.

According to an embodiment of the present disclosure, when the first user and the second user are identified at the same time, the controller selects one user facing the display and displays an image corresponding to the selected user. The display unit may be controlled to be controlled.

According to an embodiment of the present disclosure, when the first user and the second user are simultaneously identified, the controller may control the display unit such that the first image and the second image are spaced apart from each other and simultaneously displayed.

According to an embodiment of the present disclosure, when the first user and the second user are simultaneously identified, the controller may control the display unit to display a third image.

According to an embodiment of the present disclosure, the controller may control the display unit to turn off the entire area of the display unit in response to the user not being detected through the sensor.

According to an embodiment, at least one of the size and shape of the at least one region where an image is displayed may vary according to the user.

According to an embodiment of the present disclosure, the controller may control the display unit to display an image of a channel viewed by the user last.

According to an embodiment of the present disclosure, the control unit controls the display unit to display guide information indicating that the user is identified while identifying the user on a portion of the display unit, and when the identification of the user is completed. The controller may select one image based on the user and control the display unit to display the selected image on a portion of the display unit instead of the guide information.

According to an embodiment of the present disclosure, the selected image is summary information of content recommended to the user, and the controller is further configured to display the content in the entire area of the display unit when the user's gaze is directed to the selected image for a predetermined time. The display unit may be controlled to be controlled.

According to an embodiment of the present disclosure, the controller may control the display unit to turn off the entire area of the display unit in response to the gaze of the user not facing the display unit for a predetermined time while the selected image is displayed.

According to an embodiment of the present disclosure, the sensor may output light and detect the object by using a flight time in which the light is reflected by the object and returned.

According to an embodiment of the present disclosure, the controller may track the position of the object through the sensor and determine at least one of the size and shape of the at least one region based on the position.

The present invention provides a control method of an image display device having the above-described sensor and display.

The control method may include turning off the display unit; Detecting a predetermined object through the sensor while the display unit is turned off; And controlling the display unit to turn on at least one region of the display unit in response to detecting the predetermined object.

According to an embodiment of the present disclosure, the control method may include photographing the predetermined object by using a camera in response to detecting the predetermined object from the sensor; Identifying a user using an image received from the camera; And displaying different images according to the identified user in the at least one region.

According to an embodiment of the present disclosure, displaying different images according to the identified user may include: selecting a customized image based on a preference of the registered user when the identified user is a registered user registered in a storage space; Selecting a basic image instead of the customized image when an unregistered user who is not registered in the storage space is included in the user; And displaying the customized image or the basic image on the at least one region.

According to an embodiment of the present disclosure, the control method may include: tracking a location of the predetermined object through the sensor; And determining at least one of the size and shape of the at least one region based on the position.

According to an embodiment of the present invention, there are one or more of the following effects.

According to the present invention, the presence or absence of a user can be detected by using a motion sensor to turn on at least one region of the display unit 172, and a user can be distinguished by detecting a face with a camera. This may provide a customized image to the identified user.

Furthermore, the 3D depth sensor may be used to track the gaze in the direction of the nose and the eyes, determine whether the user gazes at the content, and selectively provide summary information or detailed information of the specific content. When the summary information is displayed, power consumption is minimized because local dimming is applied to the display unit or some areas are turned off.

When the identified user is a registered user, a customized image is provided according to a preference, and when two or more people are provided, a customized image having a common preference is provided. On the contrary, when the identified user includes an unregistered user, the controller 150 considers that the user is not a family member and provides a basic image. This protects the privacy of the user.

When the user is within the range of influence of the video display device 100, the display unit 172 may be selectively turned on to display related information, thereby reducing unnecessary power consumption. Furthermore, since the location, size, and shape of the area where the image is displayed are changed based on the location of the user, the burden on the user can be minimized.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a block diagram illustrating an image display device 100 and an external input device 200 according to the present invention.

FIG. 2 is a detailed block diagram illustrating the external input device 200 of FIG. 1.

3 is a conceptual diagram illustrating the mutual operation of the image display apparatus 100 and the external input apparatus 200 according to the present invention.

4 is a flowchart illustrating a method of controlling a video display device.

5 is an exemplary diagram for describing a control method of FIG. 4.

6A, 6B, and 6C are exemplary diagrams for describing different images displayed on at least one region of the display unit according to a user.

FIG. 7 is an exemplary diagram for describing different images displayed on at least one area of a display unit when a plurality of users are identified.

8A, 8B, and 8C are exemplary diagrams for describing embodiments in which at least one region in which an image is displayed is changed according to a user.

9 is a flowchart for describing a control method of an image display apparatus that determines at least one region where an image is displayed according to a position of a user.

10A and 10B are exemplary diagrams for describing the control method of FIG. 9.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

In the present specification, an image display apparatus includes both an apparatus for receiving and displaying a broadcast, recording and reproducing a moving image, and an apparatus for recording and reproducing audio. Hereinafter, the television will be described by way of example.

1 is a block diagram illustrating a video display device 100 and an external input device 200 according to the present invention. The video display device 100 includes a tuner 110, a demodulator 120, a signal input / output unit 130, an interface unit 140, a controller 150, a sensor 151, a storage unit 160, and an output unit. (170). An A / V input unit 180 and a driver 190 are included. However, the external input device 200 may be a separate device from the image display device 100 or may be included as one component of the image display device 100.

Referring to FIG. 1, the tuner 110 selects an RF broadcast signal corresponding to a channel selected by a user from a radio frequency (RF) broadcast signal received through an antenna, and converts the RF broadcast signal into an intermediate frequency signal or a baseband image. Convert to voice signal. For example, if the RF broadcast signal is a digital broadcast signal, the tuner 110 converts the RF broadcast signal into a digital IF signal (DIF). On the other hand, if the RF broadcast signal is an analog broadcast signal, the tuner 110 converts the RF broadcast signal into an analog baseband video / audio signal (CVBS / SIF). As such, the tuner 110 may be a hybrid tuner capable of processing digital broadcast signals and analog broadcast signals.

The digital IF signal DIF output from the tuner 110 is input to the demodulator 120, and the analog baseband video / audio signal CVBS / SIF output from the tuner 110 is input to the controller 160. Can be. The tuner 120 may receive an RF broadcast signal of a single carrier according to an Advanced Television Systems Committee (ATSC) scheme or an RF broadcast signal of multiple carriers according to a digital video broadcasting (DVB) scheme.

Although one tuner 110 is shown in the figure, the present invention is not limited thereto, and the image display apparatus 100 may include a plurality of tuners, for example, first and second tuners. In this case, the first tuner may receive a first RF broadcast signal corresponding to a broadcast channel selected by a user, and the second tuner may sequentially or periodically receive a second RF broadcast signal corresponding to a previously stored broadcast channel. . The second tuner may convert the RF broadcast signal into a digital IF signal (DIF) or an analog baseband video / audio signal (CVBS / SIF) in the same manner as the first tuner.

The demodulator 120 receives a digital IF signal DIF converted by the tuner 110 and performs a demodulation operation. For example, when the digital IF signal DIF output from the tuner 110 is an ATSC scheme, the demodulator 120 performs 8-VSB (8-Vestigal Side Band) demodulation. In this case, the demodulator 120 may perform channel decoding such as trellis decoding, de-interleaving, Reed Solomon decoding, and the like. To this end, the demodulator 120 may include a trellis decoder, a de-interleaver, a reed solomon decoder, and the like.

For another example, if the digital IF signal DIF output from the tuner 110 is a DVB scheme, the demodulator 120 performs coded orthogonal frequency division modulation (COFDMA) demodulation. In this case, the demodulator 120 may perform channel decoding such as convolutional decoding, deinterleaving, and Reed Solomon decoding. To this end, the demodulator 120 may include a convolution decoder, a deinterleaver and a Reed-Solomon decoder.

The signal input / output unit 130 is connected to an external device to perform signal input and output operations, and for this purpose, may include an input / output terminal (not shown) and a wireless communication unit (not shown).

Input / output terminals are Ethernet terminal, USB terminal, Composite Video Banking Sync (CVBS) terminal, component terminal, S-video terminal (analog), DVI (Digital Visual Interface) terminal, HDMI (High Definition Multimedia Interface) terminal, MHL (Mobile High-definition Link) terminal, RGB terminal, D-SUB terminal, IEEE 1394 terminal, SPDIF terminal, a liquid (Liquid) HD terminal and the like. The digital signal input through these terminals may be transmitted to the controller 150. In this case, an analog signal input through the CVBS terminal and the S-video terminal may be converted into a digital signal through an analog-digital converter (not shown) and transmitted to the controller 150.

The wireless communication unit may perform a wireless internet connection. For example, the wireless communication unit performs wireless Internet access by using a wireless LAN (Wi-Fi), a wireless broadband (Wibro), a world interoperability for microwave access (Wimax), a high speed downlink packet access (HSDPA), or the like. can do. In addition, the wireless communication unit may perform near field communication with other electronic devices. For example, the wireless communication unit may perform short range wireless communication using Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like. have.

The signal input / output unit 130 is a video signal and an audio provided from an external device such as a digital versatile disk (DVD) player, a Blu-ray player, a game device, a camcorder, a computer (laptop), a mobile device, a smartphone, or the like. The signal and the data signal may be transmitted to the controller 150. Also, the video signal, audio signal, and data signal of various media files stored in an external storage device such as a memory device or a hard disk may be transmitted to the controller 150. In addition, the video signal, the audio signal, and the data signal processed by the controller 150 may be output to another external device.

The signal input / output unit 130 may be connected to a set-top box, for example, a set-top box for an IPTV (Internet Protocol TV) through at least one of the terminals described above, to perform signal input and output operations. For example, the signal input / output unit 130 may transmit the video signal, the audio signal, and the data signal processed by the set-top box for the IPTV to the controller 150 to enable bidirectional communication, and may be processed by the controller 150. The signals can also be passed to set-top boxes for IPTV. Here, the IPTV may include ADSL-TV, VDSL-TV, FTTH-TV, etc. classified according to a transmission network.

The digital signal output from the demodulator 120 and the signal output unit 130 may include a stream signal TS. The stream signal TS may be a signal multiplexed with a video signal, an audio signal, and a data signal. For example, the stream signal TS may be an MPEG-2 TS (Transprt Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like. Here, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The interface unit 140 may receive an input signal for power control, channel selection, screen setting, etc. from the external input device 200, or may transmit a signal processed by the controller 160 to the external input device 200. . The interface unit 140 and the external input device 200 may be connected by wire or wirelessly.

As an example of the interface unit 140, a sensor unit may be provided, and the sensor unit may be configured to detect the input signal from a remote controller, for example, a remote controller.

The network interface unit (not shown) provides an interface for connecting the video display device 100 to a wired / wireless network including an internet network. The network interface unit 230 may include an Ethernet terminal for connection with a wired network, and for connection with a wireless network, a WLAN (Wi-Fi) or Wibro (Wireless). Broadband, Wimax (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA) communication standards, and the like may be used.

The network interface unit (not shown) can access a predetermined web page through a network. That is, by accessing a predetermined web page through the network, it is possible to send or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, content such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider may be received through a network. In addition, it is possible to receive the update information and the update file of the firmware provided by the network operator. It may also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit (not shown) may select and receive a desired application from among applications that are open to the public through the network.

The controller 150 may control the overall operation of the image display apparatus 100. More specifically, the controller 150 is formed to control the generation and output of the image. For example, the controller 150 may control the tuner 110 to tune an RF broadcast signal corresponding to a channel selected by a user or a previously stored channel. Although not shown in the drawing, the controller 150 may include a demultiplexer, an image processor, an audio processor, a data processor, and an on screen display (OSD) generator. In addition, the controller 150 may include a CPU or a peripheral device in hardware.

The controller 150 may demultiplex the stream signal TS, for example, the MPEG-2 TS, and separate the video signal, the audio signal, and the data signal.

The controller 150 may perform image processing, for example, decoding on the demultiplexed image signal. More specifically, the controller 150 decodes the encoded video signal of the MPEG-2 standard by using the MPEG-2 decoder, and H according to the Digital Multimedia Broadcasting (DMB) method or the DVB-H using the H.264 decoder. The encoded video signal of the .264 standard can be decoded. In addition, the controller 150 may process the image such that brightness, tint, color, etc. of the image signal are adjusted. The image signal processed by the controller 150 may be transmitted to the display unit 172 or may be transmitted to an external output device (not shown) through an external output terminal.

The controller 150 may perform voice processing, for example, decoding on the demultiplexed voice signal. In more detail, the controller 150 decodes the encoded audio signal of the MPEG-2 standard using the MPEG-2 decoder, and uses the MPEG 4 decoder according to the MPEG 4 Bit Sliced Arithmetic Coding (BSAC) standard according to the DMB scheme. The encoded audio signal may be decoded, and the encoded audio signal of the AAC (Advanced Audio Codec) standard of MPEG 2 according to the satellite DMB scheme or DVB-H may be decoded using the AAC decoder. In addition, the controller 150 may process base, treble, volume control, and the like. The voice signal processed by the controller 150 may be transmitted to the audio output unit 171, for example, a speaker, or may be transmitted to an external output device.

The controller 150 may perform signal processing on the analog baseband video / audio signal CVBS / SIF. Here, the analog baseband video / audio signal CVBS / SIF input to the controller 150 may be an analog baseband video / audio signal output from the tuner 110 or the signal input / output unit 130. The signal processed video signal is displayed on the display unit 172, and the signal processed audio signal is output through the audio output unit 171.

The controller 150 may perform data processing, for example, decoding on the demultiplexed data signal. Here, the data signal may include EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcast in each channel. The EPG information may include, for example, TSC-PSIP (ATSC-Program and System Information Protocol) information in the ATSC scheme, and DVB-Service Information (DVB-SI) in the DVB scheme. ATSC-PSIP information or DVB-SI information may be included in a header (4 bytes) of MPEG-2 TS.

The controller 150 may perform a control operation for OSD processing. In more detail, the controller 150 displays an OSD for displaying various types of information in the form of a graphic or text based on at least one of an image signal and a data signal or an input signal received from the external input device 200. You can generate a signal. The OSD signal may include various data such as a user interface screen, a menu screen, a widget, and an icon of the video display device 100.

The storage unit 160 may store a program for signal processing and control of the controller 150, or may store a signal processed video signal, an audio signal, and a data signal. The storage unit 160 may include a flash memory, a hard disk, a multimedia card micro type, a card type memory (for example, SD or XD memory), random access (RAM), and the like. memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk At least one of the storage medium may include.

The output unit 170 is used to generate an output related to vision, hearing, and the like, and includes an audio output unit 171 and a display unit 172.

The audio output unit 171 outputs a voice signal processed by the controller 150, for example, a stereo signal or 5.1 signals. The audio output unit 171 may be implemented by various types of speakers.

The display unit 172 may generate a driving signal by converting an image signal, a data signal, an OSD signal, etc. processed by the controller 150 into an RGB signal. Through this, the display unit 172 outputs an image. The display unit 172 includes a plasma display panel (PDP), a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), and an organic light emitting diode (Organic). Light Emitting Diode (OLED), a flexible display (flexible display), a three-dimensional display (3D display), it can be implemented in various forms such as an electronic ink display (e-ink display). In addition, the display 171 may be implemented as a touch screen to perform a function of an input device.

The A / V input unit 180 is for inputting an audio signal or a video signal, and may include a camera 181 and a microphone 182. The camera 181 processes an image frame such as a still image or a moving image obtained by the image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 172.

The image frame processed by the camera 181 may be stored in the storage 160 or transmitted to the outside through a wireless communication unit (not shown). Two or more cameras 181 may be provided according to a usage environment.

On the other hand, the camera 181 may photograph the user. The camera 181 may be implemented by one camera, but is not limited thereto and may be implemented by a plurality of cameras. Image information photographed by the camera 181 is input to the controller 150.

Meanwhile, in order to detect a gesture of a user, as described above, a sensing unit (not shown) including at least one of a touch sensor, a sound sensor, a position sensor, and a motion sensor may be further provided in the image display apparatus 100. have. The signal detected by the sensing unit (not shown) may be transmitted to the controller 150 through the user input interface unit 140.

The controller 150 may detect a user's gesture by combining or respectively combining an image captured by the camera 181 or a detected signal from a sensing unit (not shown).

The microphone 182 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The microphone 182 may be implemented with various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The driver 190 applies a force to deform at least a portion of the flexible display when the display 170 is configured as a flexible display. A method of applying a force will be described later with reference to FIGS. 5 and 7.

Referring back to FIG. 1, a power supply unit (not shown) supplies corresponding power throughout the image display device 100. In particular, power may be supplied to the controller 150, which may be implemented in the form of a system on chip (SOC), a display unit 172 for displaying an image, and an audio output unit 171 for audio output. Can be.

To this end, the power supply unit (not shown) may include a converter (not shown) for converting AC power into DC power. Meanwhile, for example, when the display unit 172 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM operation may be further provided for driving of variable brightness or dimming. It may be.

The external input device 200 is connected to the interface unit 140 by wire or wirelessly, and transmits an input signal generated according to a user input to the interface unit 140. The external input device 200 may include a remote controller, a mouse, a keyboard, and the like. The remote controller may transmit an input signal to the interface unit 140 through Bluetooth, RF communication, infrared communication, UWB (Ultra Wideband), ZigBee, or the like. The remote controller can be implemented as a space remote control device. The space remote control device may generate an input signal by detecting an operation of the main body in the space.

The video display device 100 receives at least one of ATSC (8-VSB) digital broadcasting, DVB-T (COFDM) digital broadcasting, ISDB-T (BST-OFDM) digital broadcasting, and the like. It can be implemented as a fixed digital broadcast receiver possible. Also, the video display device 100 may include terrestrial DMB digital broadcasting, satellite DMB digital broadcasting, ATSC-M / H digital broadcasting, DVB-H digital broadcasting, and media flow. Link Only) may be implemented as a mobile digital broadcast receiver capable of receiving at least one of digital broadcasting and the like. In addition, the video display device 100 may be implemented as a digital broadcast receiver for cable, satellite communication, and IPTV.

2 is a block diagram illustrating in detail the external input device 200 of FIG. 1. The external input device 200 includes a wireless communication unit 210, a user input unit 220, a detection unit 230, an output unit 240, a power supply unit 250, a storage unit 260, and a control unit 270. .

Referring to FIG. 2, the wireless communication unit 210 transmits a signal to or receives a signal from the image display apparatus 100. To this end, the wireless communication unit 210 may include an RF module 211 and an IR module 212. The RF module 211 is connected to the interface unit 140 of the image display device 100 according to the RF communication standard to transmit and receive signals, and the IR module 212 interfaces of the image display device 100 according to the IR communication standard. Transmit and receive signals with the unit 140.

The user input unit 220 may include a keypad, a key button, a scroll key, a jog key, and the like as an input means. The user may input a command related to the image display apparatus 100 by manipulating the user input unit 220. Such a command may be input, for example, by a user through a push operation of a hard key button of the user input unit 200.

The detector 230 may include a gyro sensor 231 and an acceleration sensor 232. The gyro sensor 231 may detect the spatial movement of the external input device 200 based on the x, y, and z axes. The acceleration sensor 232 may detect a moving speed of the external input device 200 and the like.

The output unit 240 outputs the information corresponding to the operation of the user input unit 230 and the information corresponding to the transmission signal of the video display device 100. Therefore, the user may recognize the operation state of the user input unit 230 or the control state of the image display apparatus 100 through the output unit 230. For example, the output unit 240, in response to the operation of the user input unit 230 or the signal transmission and reception through the wireless communication unit 210, the LED module 241 is turned on, the vibration module 242 for generating vibration, A sound output module 243 for outputting sound and a display module 244 for outputting an image may be provided.

The power supply unit 250 supplies power to various electronic elements of the external input device 200. When the external input device 200 does not move for a predetermined time, the power supply 250 may reduce power waste by stopping power supply. The power supply unit 250 may resume power supply when a predetermined key of the external input device 200 is operated.

The storage unit 260 may store various programs, applications, and frequency band information related to the control or operation of the external input device 200. The controller 270 performs an overall control operation of the external input device 200.

3 is a conceptual diagram illustrating the mutual operation of the image display apparatus 100 and the external input apparatus 200 according to the present invention. Here, a TV receiver is shown as an example of the video display device 100, and a remote controller is shown as an example of the external input device 200.

Referring to FIG. 3, the external input device 200 may transmit or receive a signal with the image display device 100 according to an RF communication standard. The control menu may be displayed on the screen of the image display apparatus 100 according to a control signal of the external input apparatus 200. The external input device 200 may include a plurality of buttons and generate an external input signal according to a user's button manipulation.

The image display device 100 further includes the sensor 151 of FIG. 1.

The sensor 151 may include at least one of a motion sensor, a 3D depth sensor, a face recognition sensor, and a voice recognition sensor illustrated in FIG. 3. Hereinafter, operations of the motion sensor, the 3D depth sensor, the face recognition sensor, and the voice recognition sensor may be performed by the sensor 151.

The motion sensor is configured to detect an object while the display unit 172 is turned off. The motion sensor may continuously detect the object even when at least one region of the display unit 172 is turned on.

The motion sensor may output light, and detect the object by using a flight time in which the light is reflected back to the object. For example, the motion sensor may be a time of flight (TOF) camera or a structured-light camera. The sensor 151 may express depth information of an object and a space as a three-dimensional image and provide the same to the controller 150.

The motion sensor may detect that a new object appears or disappears in a predetermined area, and calculates a three-dimensional height (or depth information) of the object.

The motion sensor is a sensor for measuring distance information between a surface reflecting light and a sensor, and detects movement of a body in real time in detail so that a user appears in front of the image display device 100 and / or leaves it. Can be detected.

The motion sensor is always operated even when the image display apparatus 100 is turned off, and immediately generates a wake up signal when a user appears in a predetermined area in front of the image display apparatus 100. have. The face recognition sensor and the voice recognition sensor are switched from an off state to an on state in response to the wakeup signal.

The motion sensor may generate a sleep signal when the user disappears from the predetermined area. . The face recognition sensor and the voice recognition sensor are switched from an on state to an off state in response to the sleep signal.

The motion sensor continues to be activated even when the image display apparatus 100 is turned off to detect whether a user appears in the predetermined area. In contrast, the face recognition sensor and the voice recognition sensor are selectively activated in response to a signal generated by the motion sensor. This is to minimize power consumption.

The controller 150 may detect that a new object appears or disappears in a predetermined area by using the image received from the motion sensor, and calculates a three-dimensional height (or depth information) of the object. In other words, the controller 151 may detect whether the user appears in the direction toward the display unit 172 through the sensor 151. The predetermined area may be variously defined according to the number, installation direction, and performance of the sensor 151 provided in the image display device 100.

The 3D depth sensor may generate 3D coordinates corresponding to the user's face and track the gaze based on a direction in which the nose and the eye face. The direction of the user's gaze and the time the gaze dwells may be measured by the information generated from the 3D depth sensor.

The controller 150 may measure the position and distance of the user through the motion sensor and the 3D depth sensor.

The face recognition sensor captures a face of a user located in front of the image display device 100 to generate a face image. The controller 150 searches for a matching user ID by matching the face image with a profile image of an account registered in a storage unit 160 or a server (not shown) provided in the image display apparatus 100 or a cloud. can do. For example, the face recognition sensor may be the camera 181 of FIG. 1. The camera 181 may be configured to photograph the predetermined object in response to detecting the predetermined object from the motion sensor.

The controller 150 uses the face recognition sensor to determine whether a user (or a user located in a predetermined area) identified by the motion sensor is a registered user registered in a storage space or an unregistered user who is not registered in a storage space. You can judge.

The voice recognition sensor is configured to receive a voice of a user. For example, the voice recognition sensor may be the microphone 182 of FIG. 1.

Hereinafter, an operation performed by the controller 150 using the sensor 151 will be described in detail.

4 is a flowchart illustrating a control method of the video display device, and FIG. 5 is an exemplary diagram for explaining the control method of FIG. 4.

The controller 150 may turn the display 172 on or off. For example, when an off command is received from the user, the display unit 172 may be turned off.

The controller 150 may detect a predetermined object through the sensor while the display unit 172 is turned off (S410).

The controller 150 may detect that an object enters a predetermined area through the sensor 151, and determine whether the object is a predetermined object that needs to be turned on at least one area of the display 172. .

The predetermined object may be set as a person. For example, when a person enters the predetermined area, it may be detected as a predetermined object, and when a puppy enters the predetermined area, it may not be detected as a predetermined object.

The predetermined object may be set as an adult rather than a minor. The controller 150 may obtain three-dimensional coordinates corresponding to the face of the user through the sensor 151, and determine whether the user corresponds to a predetermined object based on the three-dimensional coordinates. For example, in the case of a minor, the head size and the distance between both eyes may be set as a condition for detecting the predetermined object so as not to correspond to the predetermined object.

The sensor 151 or the controller 150 may generate a wakeup signal in response to the detection of the predetermined object. The other sensor and / or display unit 172 which is turned off by the wake-up signal is switched from the off state to the on state.

The controller 150 may control the display unit 172 to turn on at least one area of the display unit 172 in response to the detection of the predetermined object (S430).

At least one area of the display unit 172 is turned on in response to the wake signal. When some regions of the display unit 172 are turned on, the remaining regions remain off.

For example, as shown in FIG. 5, the controller 150 displays the guide information 510 for indicating that the user is identified while identifying the user in a partial area of the display unit. Can be controlled.

As another example, although not shown in the drawing, an image of a channel last viewed by the identified user may be displayed in at least one region of the display unit 172. An image of a channel output before the power of the image display apparatus 100 is turned off may be displayed.

The controller 150 may photograph the predetermined object using a camera in response to the detection of the predetermined object from the sensor in operation S450, and identify the user using the image received from the camera in operation S470.

The controller 150 performs face recognition using the image. By comparing the information stored in the storage unit 160 and / or the server included in the image display apparatus 100 with face information extracted from the image, the controller 150 determines whether the identified user is a registered user or not registered. It can be determined whether the user.

The controller 150 may display different images according to the identified user in the at least one region (S490).

When identification of the user is completed, the display unit 172 selects one image based on the identified user and displays the selected image 520 on a portion of the display unit instead of the guide information 510. ) Can be controlled.

When the identified user is a registered user registered in the storage space, the controller 150 may control the display unit 172 to display a customized image based on the preference of the registered user.

The preference of the registered user is stored in the storage space. The preference may be set differently according to the day of the week and the time zone of the channel and / or the program that the registered user mainly watches, the favorite channel and / or the program.

The preference may be set automatically by storing the viewing record of the registered user as big data. Alternatively, it may be set manually by a user input input from the registered user.

When a first user who mainly watches a movie is identified, a custom image related to the movie may be displayed. For another example, when a second user who mainly watches baseball of the L-Adgers is identified, a customized image related to the baseball relay of the L-Adgers may be displayed. For another example, when an unregistered user who is not registered in the storage space is identified, a basic image including basic information may be displayed instead of the customized image. The basic image may include information such as weather or securities.

The selected image 520 may be summary information of content recommended for the identified user.

The summary information may include text or an image for introducing a customized image based on the preference. Furthermore, weather or stock information may be included, or text or images introducing the latest contents, popular contents, discount contents, or the like may be included.

The summary information may be a still image in the form of a card.

The controller 150 may select one or more cards among a plurality of cards based on the identified user's preference. Priority is given to the one or more cards according to the preference, and each card is sequentially displayed on one area of the display unit 172 according to the priority.

For example, if the baseball relay of the L-Adagers is the first ranking, and the baseball relay of the New York Yankees is the second-ranked, the first card that guides the baseball results of the L-Adagers is displayed first and then the baseball result of the New York Yankees is guided. A second card may be displayed instead of the first card.

The controller 150 may turn on a partial region of the display 172 and turn off the remaining region so that the display unit 172 is turned on to prevent power consumption regardless of a user's intention. Alternatively, the controller 150 may turn on the entire area of the display unit 172 and perform local dimming to minimize power consumption by the remaining areas.

Thereafter, the controller 150 may track the gaze of the identified user through the sensor 151. When the gaze is directed to the selected image 520 for a predetermined time, the display unit 172 may be controlled to display the content 530 on the entire area of the display unit 172. In other words, when the user views the video display device 100, the entire area of the display unit 172 may be turned on.

For example, when the gaze is directed to the first card for a predetermined time while the first card guiding the baseball results of the L-Adgers is displayed on a portion of the display unit 172, the controller 150 may The display unit 172 may be controlled to display the baseball relay image of the L-Adgers in the entire area of the display unit 172.

Although not shown in the drawing, the controller 150 responds that the gaze of the identified user does not face the display unit 172 for a predetermined time while the selected image 510 is displayed. The display unit 172 may be controlled to turn off the entire area of the display. In this case, the controller 150 or the sensor 151 may generate a sleep signal.

The controller 150 may start time counting from the time when the selected image 510 starts to be displayed. When the counting is completed for a predetermined time, the sleep signal is generated. When the identified user's eyes point toward the selected image 510 while time counting, time counting may be initialized and time counting may be started again from the beginning.

The controller 150 may control the display unit 172 to turn off the entire area of the display unit 172 in response to the user not being detected in the predetermined area through the sensor 151. This is because there are no more people watching the image displayed on at least one area of the display unit 172.

According to the present invention described above, even when the user does not watch the video display device 100, the video display device 100 may recognize the user and recommend personalized content and information. In this case, at least one region of the display unit 172 is activated, thereby minimizing power consumption.

Summary information in the form of a card may be displayed on at least one region of the display unit 172. The summary information depends on the identified user. More specifically, one or more cards among a plurality of cards may be selected and output as the summary information according to the identified user's preference.

If the user is a registered user registered in the storage space, a customized image based on the preference of the registered user is displayed.

For example, as shown in FIG. 6A, a poster, a program title, program performer information, and the like of a program currently being aired on a channel preferred by the identified user or a channel watched by the identified user is summarized. Can be included. The remaining play time of the program may be displayed as a progress bar. As examples of voice commands associated with the program, keywords such as “play it now” and “record” may be included in the summary information.

As illustrated in FIG. 6B, when a user prefers a specific application to a broadcast channel, summary information for guiding content provided by the specific application may be displayed. As an example of a voice command related to the specific application, a keyword such as “play the 1st episode” may be included in the summary information.

In contrast, when an unregistered user who is not registered in the storage space is included in the user, a basic image is displayed instead of the customized image.

As illustrated in FIG. 6C, when the identified user is an unregistered user (or an unknown user) having difficulty in identifying preferences, a basic image is displayed instead of the customized image. The basic video may include weather or stock information, or may include information on content currently being performed on the last output channel.

Meanwhile, the image display apparatus 100 according to the present invention may adjust the privacy level by distinguishing between a case where there is only one identified user and a plurality of cases.

FIG. 7 is an exemplary diagram for describing different images displayed on at least one region of the display unit when a plurality of users are identified, and FIGS. 8A, 8B, and 8C illustrate at least one region where an image is displayed according to a user. Exemplary diagrams for describing the embodiments will be described.

When one user is identified, the controller 150 determines an image to be displayed on at least one area of the display unit 172 based on the identified user. In this case, different images may be displayed depending on whether the user is a registered user or an unregistered user.

In contrast, when a plurality of users is identified, the controller 150 determines an image to be displayed on at least one area of the display unit 172 based on the plurality of users.

For example, if a plurality of users are all registered users, content that is commonly preferred may be preferentially selected using the preference of each user. If there is no common favorite content, the default video is selected instead of the customized video. This is to prevent a person's preferences from being disclosed to others.

If an unregistered user is included among the plurality of users, the basic image is displayed instead of the customized image.

As illustrated in FIG. 8A, the controller 150 controls the display unit 172 to display the first image 812 in response to the first user 810 being identified, and the second user 820. In response to being identified), the display unit 172 may be controlled to display the second image 822.

When the first user and the

second user

810 and 820 are identified at the same time, the controller 150 selects one user facing the display unit 172 and selects one user. The display unit 172 may be controlled to display a corresponding image.

For example, the controller 150 may display guide information for guiding that the user is identified while identifying the user. When the first and second users are identified, one of the first and second users may be selected based on the gaze of each user. When the first user looks at the display unit 172, the first image corresponding to the first user is displayed, and when the second user looks at the display unit 172, the second image is displayed. The second image corresponding to the user may be displayed.

When the first and second users are identified, the controller 150 may simultaneously display the first image 812 'and the second image 822' as illustrated in FIG. 8C. When the first user and the second user are identified at the same time, the controller 150 may control the display unit 172 to display the first image and the second image at the same time.

At least one of a position, a size, and a shape of an area in which each image is displayed may vary according to a position of a user corresponding to each image.

For example, as illustrated in FIG. 8A, when the first user 810 is located at a first location, the location and size of an area where the first image 812 is displayed based on the first location. And the shape is determined. On the contrary, as shown in FIG. 8C, when the second user 810 is located at the second position, the position, size, and size of the region in which the first image 812 ′ is displayed by the second position are determined. The shape is variable.

An embodiment in which at least one of a position, a size, and a shape in which an image is displayed is changed according to a user will be described.

FIG. 9 is a flowchart illustrating a control method of an image display apparatus for determining at least one area in which an image is displayed according to a location of a user, and FIGS. 10A and 10B are exemplary views for explaining the control method of FIG. 9.

The controller 150 may track the position of the object through the sensor 151 (S910).

The controller 150 and / or the sensor 151 may calculate coordinates corresponding to the position of the object, and determine the direction and distance of the object based on the coordinates.

The controller 150 may determine at least one of a size, a location, and a shape of at least one area of the display unit 172 based on the location (S930).

For example, as shown in FIG. 10A, when the user is located on the left side with respect to the direction in which the display unit 172 faces, the image 1010 may be displayed on the left area of the display unit 172. have. In contrast, as shown in FIG. 10B, when the user is located on the right side with respect to the direction in which the display unit 172 faces, the image 1010 may be displayed in the right region of the display unit 172. .

The size of the area where the image 1010 is displayed may vary depending on the distance between the user and the sensor 151. For example, as shown in FIG. 10A, when the user is located at the first distance L1, the image 1010 is output in the first size, and as shown in FIG. When located at a second distance L2 farther than one distance L1, the image 1010 may be output at a second size larger than the first size.

The location of the user is tracked in real time, and at least one of the location, size, and shape in which the image 1010 is displayed may vary in real time according to the location of the user.

The image 1010 may be enlarged or reduced in accordance with the size of an area in which the image 1010 is displayed. As the size of the area where the image 1010 is displayed increases, new information may be additionally displayed. As the size of the area where the image 1010 is displayed decreases, the existing information may disappear.

Meanwhile, according to one embodiment disclosed herein, the above-described method may be implemented as code that can be read by a processor in a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

The image display apparatus 100 described above may not be limitedly applied to the configuration and method of the above-described embodiments, and the embodiments may be selectively or partially changed in each embodiment so that various modifications may be made. It may be configured in combination.

Claims

A display unit;

A sensor configured to detect an object in the off state of the display unit;

And a controller configured to control the display unit to turn on at least one area of the display unit in response to the detection of a predetermined object through the sensor.
The method of claim 1,

A camera configured to photograph the predetermined object in response to detecting the predetermined object from the sensor;

The control unit,

And identify the user by using the image received from the camera, and control the display unit to display different images in the at least one region according to the user.
The method of claim 2,

The control unit,

And when the user is a registered user registered in a storage space, controlling the display unit to display a customized image based on a preference of the registered user.
The method of claim 3,

The control unit,

And a non-registered user who is not registered in the storage space is included in the user, and controls the display unit to display a basic image instead of the customized image.
The method of claim 2,

The control unit,

And controlling the display unit to display a first image in response to the first user being identified, and controlling the display unit to display the second image in response to the second user being identified.
The method of claim 5,

The control unit,

When the first user and the second user are identified at the same time, any one user looking at the display unit is selected, and the display unit is controlled to display an image corresponding to the selected one user. Video display device.
The method of claim 5,

The control unit,

And when the first user and the second user are identified at the same time, the display unit controls the display unit to display the first image and the second image at the same time.
The method of claim 5,

The control unit,

And controlling the display unit to display a third image when the first user and the second user are simultaneously identified.
The method of claim 2,

The control unit,

And control the display unit to turn off the entire area of the display unit in response to the user not being detected through the sensor.
The method of claim 2,

And at least one of a size and a shape of the at least one region where an image is displayed varies according to the user.
The method of claim 2,

The control unit,

And controlling the display unit to display an image of a channel viewed last by the user.
The method of claim 2,

The control unit,

The display unit is controlled such that guide information for guiding the identification of the user is displayed on a portion of the display unit while identifying the user.

When the identification of the user is completed, an image display apparatus for selecting one image based on the user and controlling the display unit to display the selected image on a partial region of the display unit instead of the guide information. .
The method of claim 12,

The selected image is summary information of content recommended for the user.

The control unit,

And when the gaze of the user is directed to the selected image for a predetermined time, controlling the display unit to display the content in the entire area of the display unit.
The method of claim 13,

The control unit,

And controlling the display unit to turn off the entire area of the display unit in response to the gaze of the user not facing the display unit for a predetermined time while the selected image is displayed.
The method of claim 1,

The sensor,

And outputting light and detecting the object by using a flight time in which the light is reflected by the object and returned.
The method of claim 15,

The control unit,

The image display device of claim 1, wherein the position of the object is tracked through the sensor, and at least one of the size and shape of the at least one region is determined based on the position.
A control method of a video display device having a sensor and a display unit,

Turning off the display;

Detecting a predetermined object through the sensor while the display unit is turned off; And

And controlling the display unit to turn on at least one area of the display unit in response to the detection of the predetermined object.
The method of claim 17,

Photographing the predetermined object using a camera in response to detecting the predetermined object from the sensor;

Identifying a user using an image received from the camera; And

And displaying a different image according to the identified user in the at least one region.
The method of claim 18,

Displaying different images according to the identified user,

If the identified user is a registered user registered in a storage space, selecting a customized image based on a preference of the registered user;

Selecting a basic image instead of the customized image when an unregistered user who is not registered in the storage space is included in the user; And

And displaying the customized image or the basic image on the at least one region.
The method of claim 17,

Tracking the location of the predetermined object via the sensor; And

And determining at least one of a size and a shape of the at least one area based on the position.