KR20150014290A - Image display device and operation method of the image display device - Google Patents

Abstract

Disclosed are an image display device which uses only a required number of infrared LED devices to support a camera angle for a user tracking function and can selectively operate the infrared LED devices which are necessary according to user locations within the camera angle range during the operation of the infrared camera, and an operation method thereof. The image display device according to embodiments of the present invention comprises a display unit, a bezel unit formed along the edge of the front surface of the display unit, and a control unit. The bezel unit is coupled to a photographing unit, which photographs a user image, using at least one image sensor, and multiple infrared LED devices which are a given distance away from the photographing unit are embedded in the bezel unit. Also, when the infrared photographing mode starts, the control unit operates the photographing unit and selectively operates the infrared LED devices based on a control signal.

Description

TECHNICAL FIELD [0001] The present invention relates to an image display apparatus and an image display apparatus,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus and a method of operating the image display apparatus, and more particularly, to an image display apparatus having a camera in the main body and an operation method of the image display apparatus.

The image display device includes both a device for receiving and displaying a broadcast, a device for recording and reproducing a moving image, and a device for recording and reproducing audio. Such a video display device is implemented in the form of, for example, a television, a computer monitor, a projector, a tablet, a navigation device, a digital broadcast receiving device (Digital Television)

Such a video display device has a variety of functions, so that it can be used as a multimedia player having a complex function such as photographing, video shooting, game, broadcast reception in addition to broadcasting, music or video file playback function . Furthermore, in recent years, video display devices have been implemented as smart devices (for example, smart television). Accordingly, the video display device may operate in conjunction with a mobile terminal or a computer as well as the Internet. In addition, the image display device receives digital broadcasting and takes charge of functions of a server in a home network environment or a ubiquitous environment.

In addition, as the functions of the image display apparatus are diversified, the image display apparatus can have a video call function for transmitting images, voice, and data between the user and the other party so that the user can view and interact with the images. In addition, it is possible to provide a user tracking function that can detect a change in the line of sight of a user watching an image through a camera provided in the image display device.

Meanwhile, in order to improve the accuracy of the user tracking function, it is preferable to use an infrared camera other than a general camera which can be used for a video call function. In the case of such an infrared camera, a large number of infrared LED elements are generally used together to support a view angle of a camera for tracking a user's gaze. Further, all the infrared LED elements are always emitted regardless of where the user is located within the angle of view of the camera. Thus, a large number of LED elements emit light during the execution of the user tracking function, resulting in high power consumption.

Therefore, in the embodiments of the present invention, as many infrared LED elements as necessary to support the angle of view of the infrared camera for the user tracking function are used, and when the infrared camera is driven, And an operation method of the image display apparatus.

Accordingly, an image display apparatus according to an embodiment of the present invention includes: a display unit configured to output a screen; A bezel formed along a front edge of the display unit; And a control unit. The bezel unit is coupled to a photographing unit that photographs a user image using at least one image sensor, and the bezel unit includes a plurality of infrared light emitting devices spaced apart from the photographing unit at predetermined intervals. The control unit, when entering the infrared ray photographing mode, drives the photographing unit and controls the operation of the plurality of infrared ray emitting devices based on the control signal.

In one embodiment, the control unit detects a position of a user in a predetermined range based on the display unit when the infrared ray photographing mode is entered, and selects the plurality of infrared light emitting elements as a selective And outputs a control signal for operating the switch.

In one embodiment, the photographing section by the photographing section is divided into a plurality of areas, and the control section, when entering the infrared photographing mode, detects the photographing area corresponding to the detected position of the user, And outputs a control signal for operating at least one infrared light emitting element having a light emitting range that affects the region.

In one embodiment, the control unit controls the display unit to display a screen change corresponding to the changed shooting area in one area of the display unit when the detected shooting area changes from the first area to the second area .

In one embodiment, the control unit controls to output a predetermined notification when the detected position of the user is out of the plurality of photographing regions.

According to an embodiment of the present invention, the control unit controls the display unit to display an indicator capable of visually recognizing the position of the infrared light emitting element in operation among the plurality of infrared light emitting elements, based on a user input .

In one embodiment, the control unit sets all of the plurality of infrared light emitting elements on when entering the infrared ray photographing mode, and sets at least a part of the plurality of infrared light emitting elements according to the sensed position of the user And is controlled to be maintained in an on state or changed to an off state.

In one embodiment, the control unit outputs a control signal for causing only the infrared light emitting element at a position corresponding to the sensed user's position to emit light when entering the infrared ray photographing mode.

In one embodiment, the control unit recognizes the movement of the eyes of the user in a predetermined range based on the display unit in accordance with the driving of the photographing unit and the operation of the plurality of infrared light emitting elements, And controls to select an object of the output screen on the basis of the control information.

In one embodiment, the image display apparatus further includes a sensing unit for sensing a surrounding illumination state, and the control unit controls the plurality of infrared light emitting elements to emit light in different patterns according to the sensed illumination state .

In one embodiment, the bezel unit includes a plurality of infrared light-emitting elements adjacent to the photographing unit and a plurality of infrared light-emitting elements spaced from the photographing unit, and the control unit controls the bezel unit such that if the sensed illuminance state is the first state And controls the plurality of infrared light emitting elements spaced apart from the photographing unit to correspond to the detected position of the user, and when the sensed illuminance state is the second state, And the plurality of infrared light emitting elements emit light.

In one embodiment, the first state is a high illuminance state or a general illuminance state, the second state is a low light state, and the control section changes the first state to the second state or the first state And outputs a second indicator for informing the sensed illumination state to one area of the display unit when the change to the state is detected.

In one embodiment, the number of the plurality of infrared light emitting devices embedded in the bezel varies depending on the size of the display unit.

In one embodiment, the infrared light emitting element is an infrared light emitting diode (LED) element.

According to another aspect of the present invention, there is provided a method of operating an image display apparatus including a camera coupled to a bezel formed along a front edge of a display unit, and a plurality of infrared light emitting elements spaced apart from each other by a predetermined distance from the camera, An operation method of a video display device built in a bezel unit, comprising: detecting whether an infrared ray photographing mode is entered; Detecting a position of a user within a predetermined range based on the display unit from an image photographed by the camera when an entry into the infrared photographing mode is detected; And controlling the plurality of infrared light emitting elements to selectively operate based on the detected position of the user.

In one embodiment, the step of controlling to selectively operate includes the steps of: detecting an imaging region corresponding to the detected position of the user; And outputting a control signal for selectively operating at least one infrared light emitting element having a light emitting range that affects the detected photographing area.

Therefore, according to the method of operating the image display apparatus and the image display apparatus according to the embodiment of the present invention, in order to support the angle of view of the infrared camera for the user tracking function, the infrared LED elements are spaced apart from each other by a predetermined distance, , The user tracking function can be performed with only a small number of infrared LED elements.

According to the image display apparatus and the method of operating the image display apparatus according to the embodiments of the present invention, when the infrared camera is driven, only the necessary number of infrared LED elements are selectively emitted according to the user's position within the angle of view of the camera, Power consumption due to the light emission of the infrared LED element can be minimized.

1 is a block diagram showing a detailed configuration of a video display device related to the present invention.
FIG. 2 is a block diagram showing the external input device of FIG. 1 in detail.
FIGS. 3A to 3C are views showing a light emitting region of an infrared LED device according to driving of a camera when a user tracking function is performed using a general infrared camera.
4A and 4B are schematic views of an image display apparatus according to an embodiment of the present invention and a light emitting region of an infrared LED element according to driving of a camera when a user tracking function is performed in the image display apparatus.
5 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention.
6 is a flowchart illustrating an operation method of an image display apparatus according to another embodiment of the present invention.
FIGS. 7A to 7D are conceptual diagrams for explaining selective light emission of an infrared LED element affecting an imaging region where a user is located in an image display apparatus according to an exemplary embodiment of the present invention.
8A to 8D are conceptual diagrams illustrating selective light emission of an infrared LED device at a position corresponding to a user's position in an image display apparatus according to an exemplary embodiment of the present invention.
9 is a diagram for explaining how the emission pattern of an infrared LED element varies depending on the ambient illuminance state when a user tracking function is performed in an image display apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art can easily carry out the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly explain the present invention, parts not related to the description are omitted, and like parts are denoted by similar reference numerals throughout the specification.

In the present specification, the video display device is a concept including both a device for receiving and displaying a broadcast, a device for recording and reproducing a moving image, and a device for recording and reproducing audio.

1 is a block diagram showing an image display apparatus 100 related to the present invention. The image display apparatus 100 includes a tuner 110, a demodulator 120, a signal input / output unit 130, an interface unit 140, a controller 150, a memory 160, a display unit 170, A unit 180, and a photographing unit 190.

1, a tuner 110 selects an RF broadcast signal corresponding to a channel selected by a user from among RF (Radio Frequency) broadcast signals received through an antenna, converts the RF broadcast signal into an intermediate frequency signal or a baseband image / Convert to voice signal. For example, if the RF broadcast signal is a digital broadcast signal, the tuner 110 converts the RF broadcast signal into a digital IF signal (DIF). On the other hand, if the RF broadcast signal is an analog broadcast signal, the tuner 110 converts the RF broadcast signal into an analog baseband video / audio signal (CVBS / SIF). As described above, the tuner 110 may be a hybrid tuner capable of processing a digital broadcasting signal and an analog broadcasting signal.

The digital IF signal DIF output from the tuner 110 is input to the demodulator 120 and the analog baseband video / audio signal CVBS / SIF output from the tuner 110 is input to the controller 160 .

The tuner 110 can receive an RF broadcast signal of a single carrier according to an Advanced Television Systems Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Although one tuner 110 is shown in the drawing, the present invention is not limited thereto. The video display device 100 may include a plurality of tuners, for example, first and second tuners. In this case, the first tuner may receive the first RF broadcast signal corresponding to the broadcast channel selected by the user, and the second tuner may sequentially or periodically receive the second RF broadcast signal corresponding to the previously stored broadcast channel . The second tuner can convert the RF broadcast signal into a digital IF signal (DIF) or an analog baseband video / audio signal (CVBS / SIF) in the same manner as the first tuner.

The demodulator 120 receives the converted digital IF signal DIF from the tuner 110 and performs a demodulation operation.

If the digital IF signal DIF output from the tuner 110 is of the ATSC scheme, the demodulation unit 120 performs 8-VSB (8-Vestigal Side Band) demodulation. 8-VSB (8-Vestigal Side Band) demodulation is a residual sideband modulation of a single carrier amplitude modulation using the NTSC (National Television System Committee) frequency band. At this time, the demodulator 120 may perform channel decoding such as trellis decoding, de-interleaving, and Reed-Solomon decoding. For this, the demodulator 120 may include a trellis decoder, a de-interleaver, and a Reed Solomon decoder.

If the digital IF signal DIF output from the tuner 110 is of the DVB scheme, the demodulator 120 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. At this time, the demodulator 120 may perform channel decoding such as convolutional decoding, deinterleaving, and Reed-Solomon decoding. For this, the demodulator 120 may include a convolution decoder, a deinterleaver, and a Reed-Solomon decoder.

The demodulation unit 120 may perform the demodulation and channel decoding and output the stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal TS may be an MPEG-2 TS (Transprt Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Here, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The signal output from the demodulator 120 is input to the controller 170, and demultiplexing and video / audio signal processing can be performed.

The signal input / output unit 130 may be an external device such as a digital versatile disk (DVD), a Blu ray, a game device, a camera, a camcorder, a computer (notebook), a set- And is wirelessly connected to perform signal input and output operations. For this, an A / V input / output unit for connection with a wired network and a wireless communication unit for connection with a wireless network may be included.

The A / V I / O section is composed of an Ethernet terminal, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S- video terminal (analog), a DVI (digital visual interface) terminal, , A Mobile High-definition Link (MHL) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, a SPDIF terminal, and a liquid HD terminal. The digital signal input through these terminals may be transmitted to the control unit 150. At this time, the analog signal inputted through the CVBS terminal and the S-video terminal may be converted into a digital signal through an analog-digital converter (not shown) and transmitted to the controller 150.

The wireless communication unit can perform a wireless Internet connection. For example, the wireless communication unit performs wireless Internet access using a WLAN (Wi-Fi), a Wibro (wireless broadband), a Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) can do. In addition, the wireless communication unit can perform short-range wireless communication with other electronic devices. For example, the wireless communication unit can perform near field wireless communication using Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee have.

The signal input / output unit 130 can access a predetermined web page and transmit / receive data to / from the server through a wired / wireless network. In addition, the signal input / output unit 130 can transmit content or data provided by a content provider or a network operator, , An advertisement, a game, a VOD, a broadcasting signal, and related information. The signal input / output unit 130 can receive update information and an update file of the firmware provided by the network operator through the wired / wireless network, and can select and receive a desired application among the applications open to the public have.

The signal input / output unit 130 may transmit a video signal, an audio signal, and a data signal provided from the external device to the control unit 150. Also, the signal input / output unit 130 may transmit a video signal, a voice signal, and a data signal of various media files stored in an external storage device such as a memory device, a hard disk, etc. to the control unit 150. Also, the signal input / output unit 130 can transmit the video signal, audio signal, and data signal processed by the controller 150 to the external device or other external device.

More specifically, the signal input / output unit 130 may be connected to a set-top box, for example, a set-top box for IPTV (Internet Protocol TV) through at least one of the various terminals described above to perform signal input and output operations . In addition, the signal input / output unit 130 can transmit a video signal, a voice signal, and a data signal processed by the settop box for IPTV to the control unit 150 so that bidirectional communication can be performed, and the signals processed by the control unit 150 It can also be passed back to the set-top box for IPTV. In this case, the IPTV may include ADSL-TV, VDSL-TV, FTTH-TV, and the like which are classified according to the transmission network, and may include TV over DSL, Video over DSL, TV over IP (TVIP) An Internet TV capable of accessing the Internet, and a full browsing TV.

The digital signal output from the signal input / output unit 130 may also include a stream signal TS. Such a stream signal TS may be a signal in which a video signal, an audio signal, and a data signal are multiplexed as described above.

The interface unit 140 may transmit a signal input by the user to the control unit 150 or may transmit the signal transmitted from the control unit 150 to the user.

The interface unit 140 may transmit a user input signal to the controller 150, such as a power key, a channel key, a volume key, a setting key, and the like. In addition, the interface unit 140 may include a sensor unit (not shown) for sensing a user's gesture, a user's position, a touch, and the like. To this end, the sensor unit may include a touch sensor, a voice sensor, a position sensor, a motion sensor, a gyro sensor, and the like. In this case, the interface unit 140 may transmit the input signal input from the sensor unit to the controller 150 or may transmit the signal from the controller 150 to the sensor unit.

The interface unit 140 receives an input signal input by the user for power control of the external input device 200, for example, power supply control from the spatial remote controller, channel selection, screen setting, or the like, To the external input device (200). At this time, the interface unit 140 and the external input device 200 may be connected by wire or wirelessly.

In addition, the interface unit 140 can receive personal information from the external input device 200 and / or receive web server information that is being accessed through such personal information. For example, when the mobile terminal accesses the external input device 200 within a predetermined distance to perform near field communication (NFC), the external input device 200 can receive the personal information stored in the mobile terminal . Here, the personal information may be information necessary for logging into a predetermined account to access the electronic device or use the service.

The control unit 150 controls the overall operation of the image display apparatus 100. The control unit 150 demultiplexes the stream signal TS received through the tuner 110, the demodulator 120, and / or the signal input / output unit 130, processes the demultiplexed signals, It is possible to generate and output signals for video or audio output. For example, the controller 150 may control the tuner 110 to tune an RF broadcast signal corresponding to a channel selected by the user or a previously stored channel.

The video signal processed by the controller 150 is transmitted to the display unit 170 and can output an image corresponding to the resolution video signal and the audio signal processed by the controller 150 is transmitted to the audio output unit 180 So that the sound can be outputted. The video signal and / or audio signal processed by the controller 150 may be input to an output device of an external device through the signal input /

For example, the controller 150 demultiplexes the stream signal TS or processes the demultiplexed signals to generate and output a signal for video or audio output. Although not shown in the figure, the controller 150 may include a demultiplexer, An OSD (On Screen Display) generating unit, a voice processing unit, a data processing unit, a channel browsing processing unit, and the like.

A demultiplexer (not shown) demultiplexes the input stream signal TS. For example, when the MPEG-2 stream signal TS is input, the demultiplexing unit demultiplexes the MPEG-2 stream signal TS into a video signal, a voice signal, and a data signal, respectively. Here, the stream signal TS may be output from the tuner 110, the demodulator 120, and / or the signal input / output 130, as described above.

The image processing unit (not shown) may perform image processing, for example, decoding, of the demultiplexed image signal. More specifically, the image processing unit decodes an MPEG-2 standard-encoded video signal using an MPEG-2 decoder, and outputs a DMB (Digital Multimedia Broadcasting) or DVB-H (Digital Video Broadcast- It is possible to decode the encoded video signal of the H.264 standard according to the handheld method. In addition, the image processing unit may perform image processing such that the brightness, tint, and color of the image signal are adjusted. In addition, the image processing unit may scaling the demultiplexed image signal so that the demultiplexed image signal can be output from the display unit 170. [ The image signal processed by the image processing unit may be transmitted to the display unit 170 or to an external output device (not shown) through an external output terminal.

The OSD generator (not shown) may generate an OSD signal according to user input or by itself. In more detail, the OSD generation unit may display various information on a screen of the display unit 170 based on at least one of an image signal and a data signal or an input signal received from the external input apparatus 200, ) Or text (Text) can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, an icon, and a pointer corresponding to a pointing signal transmitted from the external input device 200. In addition, the generated OSD signal may include a 2D object or a 3D object.

The control unit 150 may mix the OSD signal generated by the OSD generation unit and the decoded video signal processed by the image processing unit. The mixed video signal can change the frame rate of an image through a frame rate converter (FRC). In addition, the mixed video signal may be output by changing the format of a video signal through a formatter, or may separate a 2D video signal and a 3D video signal for 3D video display or may convert a 2D video signal into a 3D video signal .

The voice processing unit (not shown) can perform a voice signal, for example, decryption on the demultiplexed voice signal. More specifically, the voice processing unit can decode an encoded voice signal of the MPEG-2 standard using an MPEG-2 decoder and use the MPEG 4 decoder to perform a bit sliced arithmetic coding (MPEG4) And decodes the encoded audio signal of the AAC (Advanced Audio Codec) standard of MPEG 2 according to the satellite DMB method or DVB-H (Digital Video Broadcast-Handheld) method using an AAC decoder . Further, the voice processing unit can process a base, a treble, a volume control, and the like. The voice signal processed in the voice processing unit may be transmitted to the audio output unit 180, for example, a speaker, or to an external output device.

A data processing unit (not shown) may perform data processing, for example, decoding, on the demultiplexed data signal. Here, the data signal may include electronic program guide (EPG) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel. The EPG information may include, for example, ATSC-PSIP (ATSC-Program and System Information Protocol) information in the ATSC scheme and DVB-Service Information (DVB-SI) information in the DVB scheme. Here, the ATSC-PSIP information or the DVB-SI information may be included in the header (4 bytes) of the MPEG-2 stream signal TS.

The channel browsing processor (not shown) receives the stream signal TS output from the demodulator 120 or the stream signal TS output from the signal input / output unit 130, extracts an image therefrom, and generates a thumbnail image . The generated thumbnail image can be directly or encoded and input to the controller 150. In such a case, the controller 150 may display a thumbnail list having a plurality of thumbnail images on the display unit 170 using the input thumbnail images. At this time, the thumbnail image in the thumbnail list may be displayed in the entire area of the display unit 170 or in a part of the display unit 170 in a simple view mode. In addition, the thumbnail images in the thumbnail list can be sequentially updated.

Meanwhile, the controller 150 may perform signal processing on the analog baseband video / audio signal (CVBS / SIF). For example, the analog baseband video / audio signal CVBS / SIF input to the controller 150 may be an analog baseband video / audio signal output from the tuner 110 or the signal input / output unit 130. The control unit 150 processes the input analog baseband video / audio signal CVBS / SIF, displays the processed video signal through the display unit 170, and outputs the processed audio signal to the audio output unit 180).

The control unit 150 may control the operation of the image display apparatus 100 based on a user command or an internal program input through the signal input / output unit 130 or the interface unit 140. More specifically, the control unit 150 receives device information of a nearby external device in the vicinity of the video display device 100, remote controllable channel information of another external device, received from the signal input / output unit 130 or the interface unit 140, Based on the personal information from the external input device 200, based on the frequency information or the code information, determines whether or not each external device is connected, and controls the display 170 to display an object indicating that the external device is connected can do.

In addition, the controller 150 may display at least one object displayed on the display unit 170 as a 3D object. Here, the object may be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

The control unit 150 controls the gesture of the user by individually or in combination with the image photographed by the camera (not shown), the sensed signal from the sensing unit (not shown), or the input signal transmitted from the external input device 200 Can be detected.

Also, the control unit 150 can recognize the position of the user based on the image photographed from the camera (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped, and the x-axis coordinate and y-axis coordinate in the display unit 170 corresponding to the user position can be grasped .

The memory 160 may store a program for signal processing and control of the controller 150 and may store information on a predetermined broadcast channel through a channel memory function such as a video signal, a voice signal, a data signal, And so on. The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium.

In addition, the memory 160 may store IR format key codes for controlling other external devices, and may store an IR format key database of a plurality of external devices.

The display module is divided into a display unit 170 for outputting an image and a bezel unit 172 formed along an edge of the display unit 170.

The display unit 170 converts a video signal, a data signal, an OSD signal processed by the controller 150 or a video signal, a data signal, a control signal, and the like received from the signal input / output unit 130 or the interface unit 140 into RGB Signal to generate a driving signal, thereby outputting an image. The display unit 170 may be a plasma display panel (PDP), a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), an organic light emitting diode Light emitting diodes (OLED), flexible displays, 3D displays (3D displays), and electronic ink displays (e-ink displays)

For example, when the display unit 170 is a 3D display, the display unit 170 may be implemented by an additional display method or a single display method for viewing 3D images. The single display method can implement a 3D image without a separate display, for example, without a glass or the like, and the display unit 170 can be realized by a method such as a lenticular method, a parallax barrier, Can be applied. In addition, the additional display method can implement a 3D image using a 3D viewing apparatus in addition to the display unit 170. For example, a head-mounted display (HND) type, a glasses type, or the like can be applied.

In addition, when the display unit 170 is implemented as a touch screen having a touch sensor, it may perform an input device function in addition to an output device.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 170 or a capacitance generated in a specific portion of the display unit 170 into an electrical input signal. The touch sensor can be configured to detect not only the position and area where the touch object is touched on the touch sensor but also the pressure at the time of touch. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller. Thus, the control unit 150 can know which area of the display unit 170 is touched or the like.

The audio output unit 180 receives the audio signal processed by the control unit 150, for example, a stereo signal or a 5.1 channel signal, and outputs a sound corresponding thereto. To this end, the audio output unit 180 may be implemented by various types of speakers.

It is to be noted that the photographing unit 190 (hereinafter referred to as "photographing unit 190" and "camera" may be used in combination) may be used to photograph an image of a surrounding area to receive an audio signal and a video signal, To the external device or tracks the user. The photographing unit 190 may include at least one image sensor (not shown), and may further include a visible light blocking filter (not shown) and an infrared blocking filter (not shown). In addition, the photographing unit 190 may further include a microphone (not shown).

The photographing unit 190 photographs a user, and the image photographed through the photographing unit 190 is input to the control unit 150. Accordingly, the controller 150 can detect a user's movement, position, gesture, change of gaze, etc. based on the photographed image. The photographing unit 190 can perform both the user tracking function and the general photographing function using one camera. Alternatively, the photographing unit 190 may include a general camera for general photographing and an infrared camera for user tracking.

A microphone (not shown) may receive a predetermined voice command from the user. The microphone (not shown) may include various noise elimination algorithms for eliminating noise generated when an external acoustic signal is input.

In addition, the image display apparatus 100 may include an image communication unit (not shown) including a photographing unit 190 and a microphone (not shown). The control unit 150 processes the image information photographed by the camera and the audio information collected by the microphone and transmits the image information to the image communication apparatus of the other party through the signal input / output unit 130 or the interface 140.

In addition, the image display apparatus 100 may include a user tracking unit (not shown) including a photographing unit 190 and a microphone (not shown). The control unit 150 recognizes the position of the user's binocular from the image photographed by the camera and can detect a change in the line of sight corresponding to the movement of the user's binocular. The control unit 150 can acquire the user's gaze information based on the signal transmitted from the user tracking unit (not shown).

The sensing unit 190 senses an external device existing in the vicinity of the image display device 100 or senses a surrounding environment of the image display device 100 such as illuminance, Contact or external force.

A power supply unit (not shown) supplies power to the entire video display device 100. Particularly, it is possible to supply power to a control unit 150 that can be implemented in the form of a system on chip (SOC), a display unit 170 for displaying an image, and an audio output unit 180 for audio output .

To this end, the power supply unit (not shown) may include a converter (not shown) for converting AC power to DC power. On the other hand, for example, when the display unit 170 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM operation is further provided for driving a variable luminance or dimming You may.

The external input device 200 is connected to the interface 140 via a wired or wireless connection and transmits an input signal generated according to a user input to the interface 140. The external input device 200 may include a remote controller (e.g., a space remote controller), a mouse, a keyboard, a wheel, and the like. The remote controller can transmit an input signal to the interface unit 140 through Bluetooth, RF communication, infrared communication (IR communication), UWB (Ultra Wideband), ZigBee, or the like. When the external input device 200 is implemented with a spatial remote controller, the operation of the main body can be sensed to generate a predetermined input signal.

Meanwhile, the image display apparatus 100 may be implemented as a fixed digital broadcast receiver or a portable digital broadcast receiver.

When the video display device 100 is implemented as a fixed digital broadcast receiver, it is possible to use digital broadcasting of ATSC (8-VSB) using a single carrier, terrestrial DVB-T (COFDM) using a plurality of carriers, Digital broadcasting of an ISDB-T system (BST-OFDM system) in which different broadcasting channels can be used according to a user's authority, and the like.

When the video display apparatus 100 is implemented as a mobile digital broadcasting receiver, the terrestrial DMB type digital broadcasting, the satellite DMB type digital broadcasting, the ATSC-M / H type digital broadcasting, the Digital Video Broadcast-Handheld ) Type digital broadcasting, and a media flow (Media Foward Link Only) type digital broadcasting.

Meanwhile, the video display device 100 may be implemented as a digital broadcast receiver for cable, satellite communication, and IPTV. Also, the video display device 100 described above can be applied to a mobile terminal. The mobile terminal may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, tablet PCs, ultrabooks, and the like.

When the video display device is used as a mobile terminal, a wireless communication unit (not shown) may be further added in addition to the above-described configuration. The wireless communication unit enables wireless communication between the mobile terminal and the wireless communication system or between the mobile terminal and the network in which the mobile terminal is located.

To this end, the wireless communication unit may include at least one of a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a location information module.

The broadcast receiving module can receive broadcast signals and / or broadcast-related information from a broadcast management server through a broadcast channel.

Here, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. Here, the broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated and transmitted to the terminals. In addition, the broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal .

Here, the broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider, and the broadcast-related information may be provided through a mobile communication network. In addition, the broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVF-H), a Digital Video Broadcast- , DVB-CBMS (Convergence of Broadcasting and Mobile Service), OMA-BCAST (Open Mobile Alliance-Broadcast), CMMB (China Multimedia Mobile Broadcasting), MBBMS (Mobile Broadcasting Business Management System), ISDB- Terrestrial) or the like can be used to receive a digital broadcast signal. Of course, the broadcast receiving module may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in a memory.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The mobile communication module is configured to implement a video communication mode and a voice communication mode. The video call mode refers to a state of talking while viewing a video of the other party, and the voice call mode refers to a state in which a call is made without viewing the other party's video. The mobile communication module is configured to transmit and receive at least one of voice and image to implement a video communication mode and a voice communication mode.

The wireless Internet module is a module for wireless Internet access, and can be embedded in a mobile terminal or externally. Wireless Internet technologies include WLAN (Wireless LAN), WiFi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) GSM, CDMA, WCDMA, Long Term Evolution (LTE), or the like may be used.

The short-range communication module is a module for short-range communication. It is possible to use short range communication technology such as Bluetoot, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC), Wi- Etc. may be used.

The location information module is a module for acquiring the location of the mobile terminal, and representative examples thereof include a Global Position System (GPS) module or a Wireless Fidelity (WiFi) module.

FIG. 2 is a block diagram showing the external input device 200 shown in FIG. 1 in detail. The external input device 200 includes a wireless communication unit 210, a user input unit 220, a sensing unit 230, an output unit 240, a power supply unit 250, a storage unit 260, .

Referring to FIG. 2, the wireless communication unit 210 transmits a signal to the image display apparatus 100 or receives a signal from the image display apparatus 100. For this, the wireless communication unit 210 may include an RF module 211 and an IR module 212. The RF module 211 is connected to the interface unit 140 of the video display device 100 according to the RF communication standard to transmit and receive a signal and the IR module 212 is connected to the interface of the video display device 100 according to the IR communication standard. Receiving unit 140 can transmit and receive signals. For example, the wireless communication unit 210 may transmit a signal including information such as the motion of the external input apparatus 200 to the image display apparatus 100 through the RF module 211.

On the other hand, the external input device 200 further includes an NFC module (not shown) for short-range magnetic field communication with an external device, Server information and the like and transmit the received information to the image display apparatus 100 through the RF module 211 or the IR module 212. [

In addition, the external input device 200 may be connected to the interface unit of the image display device 100 using Bluetooth, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) (140). ≪ / RTI >

The external input device 200 can receive video, audio, or data signals output from the interface unit 140 of the video display device 100. The external input device 200 can display or output audio on the external input device 200 based on the received video, audio, or data signal.

The external input device 200 may also receive device information of other external devices, channel information capable of remotely controlling other external devices, frequency information, code information, and the like from neighboring external devices in the vicinity, Based on the information, a channel, frequency, or code may be assigned to the external device to perform remote control.

The user input unit 220 may include, for example, a keypad, a key button, a touch screen, a scroll key, a jog dial, etc. as input means. The user can input a control command related to the image display apparatus 100 by operating the user input unit 220. [ This control command can be input through, for example, a push operation of the hard key button of the user input unit 200 by the user. In addition, for example, when the user input unit 220 has a touch screen, the command may be entered by the user touching the soft key of the touch screen.

The user input unit 220 may include, for example, an Okay key, a menu key, a direction key, a channel adjustment key, a volume adjustment key, a back key, a home key, have. An OK key (not shown) is available when a menu or item is selected, and a menu key (not shown) is available for displaying a predetermined menu. The four directional keys (not shown) may be used to move the pointer or indicator displayed on the display unit 170 of the image display device 100 up, down, left, or right. The channel adjustment key (not shown) can be used for adjusting the channel up and down, and the volume adjustment key (not shown) can be used for adjusting the volume up and down. Also, a back key (not shown) can be used when moving to a previous screen, and a home key (not shown) can be used when moving to a home screen.

The confirmation key can be implemented by adding a scroll function. For this purpose, the confirmation key may be implemented in the form of a wheel key. That is, when the user pushes the confirmation key up / down or left / right, it can be used as a corresponding menu or item selection. In case of rotating the provided wheel up / down, The screen displayed on the display unit 170 of the display unit 100 may be scrolled or switched to the next list page. For example, when only a part of the screen to be output as a whole screen is displayed on the display unit 170, if the wheel of the confirmation key is scrolled to search the screen of the desired part, Area may be output to the display unit 170. [ As another example, when the list page is displayed on the display unit 170, the previous page or the next page of the current page displayed on the display unit 170 can be displayed by scrolling the wheel of the confirmation key.

Also, by using the scroll function of the confirmation key, it is possible to increase or decrease the channel by the number corresponding to the rotation of the wheel when the broadcast channel is switched, and adjust the volume The output can be made high or the volume can be made small.

In addition, the scroll function of the confirmation key may be realized by a separate key.

The sensing unit 230 may include a gyro sensor 231 and an acceleration sensor 232. The gyro sensor 231 can sense the spatial movement of the external input device 200 on the basis of the x-axis, the y-axis, and the z-axis. The acceleration sensor 232 can sense the moving speed of the external input device 200 or the like.

In addition, the sensing unit 230 may further include a distance measuring sensor, thereby sensing the distance to the display unit 170.

The output unit 240 outputs information corresponding to the operation of the user input unit 220 and information corresponding to the transmission signal of the image display apparatus 100. [ The user can recognize the operation state of the user input unit 220 or the control state of the image display apparatus 100 through the output unit 240. The output unit 240 outputs an LED module 241 that is turned on, a vibration module 242 that generates vibration, and a sound output unit 242 in response to an operation of the user input unit 220 or a signal transmitted and received through the wireless communication unit 210. [ And a display module 244 for outputting an image.

The power supply unit 250 supplies power to various electronic devices of the external input device 200. When the external input device 200 does not move for a predetermined period of time, the power supply unit 250 may reduce power consumption by stopping the power supply. When the predetermined key of the external input device 200 is operated, Can be resumed.

The storage unit 260 may store various programs, applications, frequency band information, and the like related to the control or operation of the external input device 200. In addition, the storage unit 260 may store IR format key codes for controlling other external devices using an IR signal, and may store an IR format key database of a plurality of external devices.

The control unit 270 controls overall matters related to the control of the external input device 200. The control unit 270 can transmit a signal corresponding to a predetermined key operation of the user input unit 220 to the image display apparatus 100 through the communication unit 210. [ The control unit 270 may transmit a signal corresponding to the movement of the external input device 200 sensed by the sensing unit 230 to the image display device 100 through the wireless communication unit 210, 100 can calculate the coordinate value of the pointer corresponding to the movement of the external input device 200. [

3 is a conceptual diagram showing a state in which an image of a user is photographed through a photographing unit 190 of the image display apparatus 100 related to the present invention. Here, a television receiver is shown as an example of the video display device 100 for the purpose of explanation.

In FIG. 3, a photographing unit 190, that is, a camera disposed in an upper part of a frame of the image display apparatus 100, for example, a camera, The position of both of the eyes of the user 900 located in the user's eyes.

At this time, the camera may be detachably mounted on a frame of the image display apparatus 100. [ That is, the camera may be built in or detached from the image display apparatus 100.

When the binocular position is sensed, the camera can acquire gaze information of a user viewing an image output to the image display device 100. [ That is, the control unit 150 of the video display device 100 can execute the corresponding control command in response to the user's eyes moving up / down, left / right, forward / back, or blinking.

In addition, a pointer corresponding to the user's gaze may be displayed or not displayed on the screen of the video display device 100. [ When the pointer is displayed, the image display apparatus 100 may calculate the X and Y coordinates of the corresponding pointer from the user's sight line information and display the corresponding pointer on the display unit 170. In addition to the arrow shapes shown in FIG. 3, these pointers can be formed into various shapes of objects, such as points, cursors, prompts, and outlines.

On the other hand, when another control signal is inputted in combination with the sight line information of the user sensed through the camera, the controller 150 controls the display of the position where the user's eyes stay, .

3, an image capturing unit 190, that is, a camera disposed in an upper center of one frame of the image display apparatus 100, that is, a camera, has a predetermined range (e.g., The control unit 150 may transmit the image of the user 900 located on the display unit 170 to the control unit 150. The control unit 150 may then output the image of the user to the display unit 170. [ That is, an image communication function of transmitting and receiving an image photographing function or a video image to / from another external device through the photographing unit 190 is possible.

The image display apparatus 100 according to an embodiment of the present invention including the above-described configuration includes a bezel unit 172 formed along the front edge of the display unit 170, and a photographing unit 190 are combined or embedded.

Here, the photographing unit 190 includes a single image sensor (not shown) and a plurality of cut filters, for example, a visible light blocking filter (not shown) and an infrared blocking filter (not shown) Camera module. The image sensor 191 may be implemented as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor.

The bezel part 172 is provided with a plurality of infrared light emitting elements (for example, infrared ray LEDs, hereinafter, 'infrared ray emitting element' and 'infrared ray LED') which are spaced apart from the photographing part 190 by a predetermined distance Which is used as a meaning in advance). At this time, the total number of the plurality of infrared light emitting elements arranged at a predetermined interval in the bezel part 172 is much smaller than the number of infrared LED elements required when a general infrared camera is used.

3A to 3C, in the conventional image display apparatus, when the infrared camera 31 is coupled to the upper end of the display module, as shown in FIG. 3B, A large number of infrared LED elements 32 are arranged adjacent to both sides of the infrared camera 31 in the form of aggregate. When the infrared camera 31 is driven in this structure, the adjacent infrared LED elements 32 emit light simultaneously to form a light emission range B including the angle of view range A of the camera. As described above, in the case of the infrared camera combined with the conventional image display apparatus 100, a large number of coherent infrared LED elements 32 are required. Once the infrared camera 31 is driven, As shown in FIG. 3C, many parts of the light emitting range of the infrared LED element overlap each other as a result of simultaneous light emission by the light emitting elements 32, resulting in a large amount of power waste.

Meanwhile, the image display device 100 according to the embodiment of the present invention is implemented with a structure in which a plurality of infrared light emitting devices are disposed in a bezel part 172 of a display module so as to be spaced apart from each other at a predetermined interval.

Here, the infrared light-emitting element embedded in the bezel portion 172 means an infrared light-emitting diode (IR LED) element.

Here, the number of the infrared light emitting elements included in the bezel part 172 varies depending on the size of the display part 170. For example, the larger the display unit 170, the larger the frame of the bezel 172, and a blind spot where the light emitting range is not enough is generated, so that a larger number of infrared light emitting devices can be incorporated. On the other hand, the smaller the display unit 170, the smaller the frame of the bezel 172 and the number of overlapping portions of the light emitting range becomes larger, so that a smaller number of infrared light emitting devices can be incorporated. The infrared light emitting elements included in the bezel part 172 may be arranged to be spaced at equal intervals, but some of them may be disposed adjacent to each other, for example, around the photographing part 190.

For example, referring to FIGS. 4A and 4B, an image display apparatus 100 according to an embodiment of the present invention includes at least one infrared camera 190 And a plurality of infrared LDE elements spaced apart from the infrared camera 190 and spaced apart from each other by at least one infrared LDE element 301 adjacent to the infrared camera 190, 172 as shown in FIG.

For example, as shown in FIG. 4A, the infrared LED elements are arranged at four corner points of the bezel portion 172 and four at the middle point between the corner and the corner, It can be a built-in structure. However, the present invention is not limited thereto, and a larger number of infrared LED devices may be incorporated or a smaller number of infrared LED devices may be incorporated depending on the size and usage environment of the display unit 170. The position information of the built-in infrared LED element can be stored in the memory 160 in advance. In the case of performing the user tracking function in the image display apparatus shown in FIG. 4A, the light emitting regions of the infrared LED elements driven by the camera are not overlapped with each other as shown in FIG. 4B. Thus, power dissipation is reduced.

When the image display apparatus 100 having such a structure enters the infrared ray photographing mode, the control unit 150 of the image display apparatus 100 drives the photographing unit 190, Thereby controlling the operation of a plurality of infrared light emitting elements built in the bezel part 172. [

Specifically, when the user enters the infrared ray photographing mode, the control unit 150 drives the photographing unit 190 to detect the position of a user in a predetermined range on the basis of the display unit 170. When the position of the user is sensed, the controller 150 outputs a control signal for selectively operating the plurality of infrared light emitting devices built in the bezel 172 based on the sensed position of the user.

Here, the photographing area by the photographing unit 190 can be distinguished into a plurality of areas. In such a case, the control component 150 may detect an imaging region corresponding to the detected position of the user. For example, the photographing area may be divided into four areas as front, back, left, and right with respect to the display unit 170 as a whole view angle range. In addition, the photographing area may include positional information of an intermediate optimal area in which the frontal, rear, left, and right areas and some areas intersect with each other, .

When the photographing area corresponding to the user's position is detected, the controller 150 can output a control signal for operating at least one infrared light emitting element having a light emitting range that affects the detected photographing area.

For this, the controller 150 controls the position of the infrared light emitting element located anywhere according to the position of the user, based on the position information of the infrared light emitting element previously stored in the memory 160 and the light emitting range (i.e., boundary coordinate of the light emitting range) And decide whether to operate it.

As described above, the image display apparatus according to the embodiment of the present invention has a structure in which the infrared LED elements are spaced apart from each other by a predetermined distance and incorporated in the bezel portion in order to support the angle of view of the infrared camera for the user tracking function, In addition, when the infrared camera is driven, only the necessary number of infrared LED elements are selectively emitted according to the position of the user in the angle of view of the camera, thereby minimizing power consumption due to the light emission of the infrared LED device to provide.

Hereinafter, an operation method of the image display apparatus according to an embodiment of the present invention will be described with reference to FIGS. 8A to 8D and FIG. In the bezel part 172 (FIG. 1) of the image display device 100 (FIG. 1), eight infrared light emitting elements are arranged in a spaced- It is assumed that the photographing unit 190 having one image sensor is composed of an accessory type or a structure built in the bezel portion 172. [

5, a screen is displayed on the display unit 170 (FIG. 1) of the image display device 100 (FIG. 1) (S501).

Here, there is no limitation on the type of the screen displayed on the display unit 170. [ For example, the screen may be screen information of a specific broadcast program, an execution screen of a specific application, or a screen displaying setting information for controlling the screen state.

1) can detect whether or not the image display apparatus 100 has entered the infrared ray photographing mode in a state where predetermined screen information is outputted to the display unit 170 (FIG. 1) (S502 ).

Here, the infrared ray photographing mode is a control mode for executing the user tracking function, and can enter through a user input of a predetermined method. For example, the user may input a predetermined voice command, input a predetermined user gesture, push the specific key to the video display device 100 through an external input device, By entering a signal, an infrared ray photographing mode for executing a user tracking function can be entered.

Further, even if the user enters the infrared ray photographing mode, the user tracking function is executed in the background, so it is difficult to recognize that the user enters the infrared ray photographing mode and the user tracking function is being executed. Accordingly, when the controller 150 enters the infrared ray photographing mode, the controller 150 may output a predetermined indicator (e.g., text or image) indicating the infrared ray photographing mode to one area of the display unit 170. [ On the other hand, when the infrared mode is changed to the normal mode, another indicator indicating the change of the control mode may be output to the display unit 170.

In addition, the control unit 150 may perform an operation for calibration at least once at the time of entering the infrared ray photographing mode. Here, the calibration refers to a process in which the image display apparatus 100 enters the infrared ray photographing mode, for example, before the user tracking function (monitoring the pupil's gazing point, movement, etc.) A distance between the users, a change in illuminance, and the like, and measures and displays the lens focal length or aperture scale of the photographing unit 190 in advance. Thus, the accuracy of the user tracking function can be enhanced. For example, the control unit 150 displays a calibration operation on the display unit 170, outputs a predetermined point, and then prompts the user to look at the pointer. When the user strobes the pointer, the pointer is moved to another point in the display unit 170 and displayed, and the user is guided to look again. When the above process is repeated a predetermined number of times, the calibration operation is terminated.

Specifically, when the controller 150 enters the infrared ray photographing mode, the control unit 150 turns on all of the plurality of infrared ray emitting devices built in the bezel unit 172. Then, as described in more detail below, control is performed so that at least a part of the plurality of infrared light emitting elements is kept on or changed to an off state according to the user's position.

When the user enters the infrared ray photographing mode, the control unit 150 drives the photographing unit 190 and detects the user's position from the photographed image according to the driving of the photographing unit 190, that is, the infrared camera (S503) .

In step S504, the controller 180 controls the plurality of infrared light emitting elements arranged to be spaced apart from the bezel 172 (FIG. 1) to selectively emit light based on the sensed position of the user.

For example, when the control unit 150 enters the infrared ray photographing mode, the control unit 150 may output a control signal for causing only the infrared ray emitting device at the position corresponding to the sensed user position to emit light.

Specifically, the plurality of infrared light emitting elements, which are disposed on the bezel portion 172 and are spaced apart from each other, have a predetermined light emission range centered on a built-in position. That is, although each infrared light emitting element may partially overlap or overlap with the light emitting range of another infrared light emitting element, the infrared light emitting element has its own light emitting range. In order to track the pupils of the user, will be. Therefore, the infrared light emitting element located at a position corresponding to the detected user position means a specific infrared light emitting element or an infrared light emitting element adjacent to a specific infrared light emitting element, in which a light emitting range is formed around a point where the user is located will be.

8A to 8D are conceptual diagrams illustrating selective light emission of an infrared LED device at a position corresponding to a user's position sensed by an image display device according to an embodiment of the present invention. Here, it is assumed that the photographing area by the photographing section 190 is divided into a plurality of areas with the display section 170 as a reference. Further, it is assumed that the number of infrared light emitting devices built in the bezel portion 172 is four at each corner, and one between the corner and the corner, for a total of eight.

8A, when the user is located at the center of the front of the display unit 170, the infrared light emitting device 801 located nearest to the user position, that is, The element 801 is turned on.

On the other hand, when the sensed user's position is on the right side with respect to the display unit 170 as shown in FIG. 8B, the infrared light emitting device 802 located closest to the display unit, that is, the bezel unit 172 The infrared light emitting element 802 incorporated in the center of the right side is turned on. 8C, when the user's position is moved to the left with respect to the display unit 170, the infrared light emitting element 803 built in the center of the left side of the bezel 172 is turned on do. At this time, the infrared light emitting devices 801 and 802, which were previously turned on, are controlled to be turned off, thereby minimizing power consumption by light emission.

In addition, as shown in FIG. 8D, if only one infrared light emitting element is used at the center with respect to the user display unit 170, the light emission range applied to the user may be narrow and the user tracking may be restricted. A plurality of infrared light emitting elements 801 and 804 having similar emission ranges can be operated in an on state. Even in this case, since only two infrared light emitting elements among the eight infrared light emitting elements built in the bezel 172 emit light, the power consumption due to light emission is greatly reduced.

In addition, the controller 150 controls the display unit 170 to display an indicator capable of visually recognizing the position of the infrared light emitting device that is operating among the plurality of infrared light emitting devices, based on a user input . For example, when the user inputs a voice signal indicating 'LED position indication!', The control unit 150 recognizes the voice and displays the position of the plurality of infrared light emitting devices built in the bezel unit 172, An indicator (e.g., a thumbnail image) can be displayed. According to this, the user can obtain the effect of detecting the failure or failure (i.e., non-operation) of the plurality of built-in infrared light emitting elements.

On the other hand, when the position of the user is not recognized for a preset time (for example, one minute), or when it is recognized that the user is located outside a predetermined range with respect to the display unit 170, And the infrared ray photographing mode can be automatically terminated.

Hereinafter, an operation method of the image display apparatus according to another embodiment of the present invention will be described with reference to FIGS. 7A to 7D and FIG. In the bezel part 172 (FIG. 1) of the image display device 100 (FIG. 1), eight infrared light emitting elements are arranged in a spaced- It is assumed that the photographing unit 190 having one image sensor is composed of an accessory type or a structure built in the bezel portion 172. [ It is also assumed that the photographing area by the photographing unit 190 is divided into a plurality of areas based on the display unit 170. [

Referring to FIG. 6, a predetermined screen is displayed on the display unit 170 (FIG. 1) of the image display device 100 (FIG. 1) (S601). Here, there is no limitation on the type of the screen displayed on the display unit 170. [

1) can detect whether or not the image display apparatus 100 has entered the infrared ray photographing mode in a state where predetermined screen information is outputted to the display unit 170 (FIG. 1) (S602 ). Entry into the infrared imaging mode can be accomplished through user input in various manners, as described above. Also, when a specific application is executed, it is possible to set in advance to automatically enter the infrared ray photographing mode even if there is no user input. For example, when the web application is executed in the image display apparatus 100 and a specific web page screen is output to the display unit 170, the user enters the infrared photographing mode automatically to execute the user tracking function in the background It is possible to do.

When the user enters the infrared ray photographing mode, the control unit 150 drives the photographing unit 190 and detects the position of the user from the photographed image according to driving of the photographing unit 190, that is, the infrared camera S603). For this, the control unit 150 may process the image transmitted from the photographing unit 190 and calculate the position of the user as a predetermined coordinate value, for example, X, Y, Z values.

In addition, the controller 150 detects an image capturing area corresponding to the detected position of the user (S604). Specifically, when the control unit 150 enters the infrared ray photographing mode, the control unit 150 detects an image sensing area corresponding to a position of the user sensed as being within a predetermined range on the basis of the display unit 170.

For this purpose, the photographing region corresponding to the angle of view range of the photographing unit 190 may be divided into a plurality of regions. For example, the photographing region may be divided into four photographing regions of front / rear / left / Or divided into four shooting regions of translocation / front / back / forward based on the display unit 170. The shooting area can be changed by dividing the number and dividing criteria through user input.

The controller 150 can determine the position of the shooting area where the current user is located based on the calculated coordinate values and the position information of the predetermined divided shooting area. The position information and the range information of the divided shooting regions can be stored in the memory 160 in advance. In addition, the location information and the range information of the pre-stored divided shooting regions may be changed through user input or may be set to be different when activating the user tracking function for a plurality of users.

In addition, when the position of the user is changed and the shooting area is changed accordingly, the controller 150 may display a screen change corresponding to the changed shooting area.

For example, when the shooting area where the user is located is changed from the first area to the second area, the control unit 150 controls the display unit 170 to display a screen change corresponding to the changed shooting area in one area of the display unit 170 . For this, the control unit 170 may display an indication of a plurality of divided shooting regions and an indicator indicating the shooting region where the user is located, in one area of the display unit 170. [ Alternatively, depending on the environment, a pop-up window or a signal (e.g., a voice signal, a haptic signal, a highlighting effect on the screen, etc.) for guiding the user to move into a specific shooting area may be output.

If the detected position of the user is out of the plurality of photographing areas, that is, if the position of the user is outside the range of the angle of view of the photographing unit 190, the control unit 150 may output a predetermined notification have. There is no restriction on the format of such a notification, and a predetermined voice signal or a pop-up window on the screen can be output.

When the imaging area corresponding to the user's position is determined as described above, the controller 150 generates a control signal for selectively operating the infrared light emitting element having the light emitting range that affects the detected imaging area (S605) .

In this regard, FIGS. 7A to 7D are conceptual diagrams for explaining selective light emission of an infrared light emitting device that affects an imaging region where a user is located in an image display apparatus according to an embodiment of the present invention. First, the photographing region is divided into four regions based on the display unit 170: translational (front left) / foreground (front right) / rear (rear left) / rear (right rear).

Referring to FIG. 7A, when the user's position is the photographing area A of the translator, the LEDs positioned at the center and the upper end of the plurality of infrared light emitting devices built in the bezel 172 are turned on And tracks the user (or the pupils of the user) in accordance with the driving of the photographing unit 190. Here, three infrared light emitting elements whose emission range is mainly in the A region are operated among the eight infrared light emitting elements, but the present invention is not limited to this. However, all the infrared light emitting elements built in the left side operate, Only one infrared light emitting element that covers all of them can be implemented to operate.

7B to 7D, when the position of the user is the photographing area B of the vehicle, when the position of the user is the photographing area C of the back seat, The infrared light emitting elements mainly having the light emitting range in the corresponding photographing region are turned on and the user (or the user's eye) is tracked according to the driving of the photographing unit 190.

When the plurality of infrared light emitting elements built in the bezel part 172 selectively emit light according to the user's position along with the driving of the photographing part 190, the controller 150 controls the display part 170 as a reference It is possible to recognize the movement of the eyes of the user in a predetermined range. Then, the control unit 150 may control the selection of the object of the screen output to the display unit 170 based on the recognized eye movement.

For example, when a specific object is examined for a predetermined period of time on a screen on which a recognized user's eye is displayed, the corresponding object is selected, and a related function is executed according to the type of the screen or the corresponding application type. For example, in the case of the execution screen of the map application, if it is recognized that a specific point has been stared for a predetermined time or more, the execution screen can be enlarged based on a specific point.

Hereinafter, referring to FIG. 9, the operation of the infrared LED element is controlled differently according to the ambient illuminance state when the user tracking function is performed in the infrared ray photographing mode. To this end, the image display apparatus 100 according to the present invention may include a sensing unit 195 for sensing the illuminance state around the main body. The sensing unit 195 may be a separate sensor or may be implemented as one function included in the photographing unit 190.

In the bezel part 172 (FIG. 1) of the image display device 100 (FIG. 1), nine infrared light emitting elements are embedded in a structure spaced apart from each other by a predetermined distance. It is assumed that the structure is closely arranged.

In addition, it is assumed that the photographing unit 190 having at least one image sensor is coupled to the upper end of the bezel unit 172 in an accessory form or built in the bezel unit 172.

The infrared light emitting elements disposed to be spaced apart from the photographing unit 190 selectively emit light in a dark Pupil manner of recognizing the darkness of the user's pupil, Likewise, the light is selectively emitted by a method of recognizing the brightness of the user's pupil (Bright Pupil).

The method of recognizing the darkness of the pupil (Dark Pupil) is a method in which the IR (infrared) light entering the photographing unit 190 is not reflected directly to the pupil and the pupil is dark. The bright pupil The infrared (IR) light coming into the part 190 is reflected directly to the pupil and the pupil appears bright. Conventionally, an infrared camera for tracking a user has a structure in which a plurality of infrared light emitting devices are aggregated around a camera, so that a method of recognizing brightness of a pupil (Bright Pupil) is used.

In the present invention, in order to use a dark pupil that recognizes the darkness of the user's pupil in consideration of the angle of view range and the structure of the bezel portion (which is easy to be spaced apart from the photographing unit 190), most infrared light- (Not shown). However, as described below, it is advantageous to operate the infrared light emitting elements in a manner of recognizing the brightness of the user's pupil (Bright Pupil) depending on the environment (for example, the ambient illuminance state) May have a structure disposed close to the substrate 190.

The control unit 150 (FIG. 1) detects whether or not the image display apparatus 100 has entered the infrared ray photographing mode in a state where predetermined screen information is outputted to the display unit 170 (FIG. 1) of the image display apparatus 100 can do.

When the user enters the infrared ray photographing mode, the control unit 150 drives the photographing unit 190 and detects the position of the user from the photographed image according to the photographing unit 190, that is, the infrared camera. Then, the control unit 180 controls the plurality of infrared light emitting elements arranged to be spaced apart from the bezel unit 172 (FIG. 1) to selectively emit light based on the sensed position of the user.

In the infrared ray photographing mode, the photographing unit 190 emits an infrared ray (Ir) to both sides of the user, and the photographing unit 190 recognizes an image reflected therefrom. Accordingly, the control unit 150 can detect that the user's line of sight is fixed to a specific object on the screen displayed on the display unit 170, for example.

During the infrared photographing mode, the controller 150 receives the ambient illuminance information from the sensor 195, and controls the plurality of infrared light emitting devices to emit light in different patterns according to the sensed illuminance state. For example, if it is equal to or less than a predetermined threshold value (minimum value for selling in a low-light state), the infrared light emitting element is selectively emitted in the first pattern, and if not, the infrared light emitting element is selectively emitted in the second pattern.

To this end, the bezel part 172 of the display module is provided with a plurality of infrared light emitting elements (at least one pair) adjacent to the photographing part 190 and a plurality of infrared light emitting elements spaced apart from the photographing part 190 do.

Specifically, the control unit 150 controls the plurality of infrared light emitting elements, which are spaced apart from the photographing unit 190, to emit light corresponding to the detected position of the user when the sensed illuminance state is the first state do. On the other hand, when the sensed illuminance state is the second state (e.g., low illuminance), the controller 150 controls the plurality of infrared light emitting elements positioned adjacent to the photographing unit 190 to emit light corresponding to the sensed user's position.

Here, the first state means a high degree of illumination or the general illumination state, and the second state means a low illumination state.

Here, the low illuminance state is a state in which the average brightness of the photographed image does not exceed the preset reference value even when the iris opening amount of the camera is increased and the analog gain value is increased, It means that it is difficult to track the movement of the pupil by means of Dark Pupil which recognizes the pupil's darkness. Accordingly, in this case, the infrared light emitting element disposed close to the photographing unit 190 is operated to track the movement of the pupil by the bright pupil of the pupil.

When the control unit 150 detects a change from the first state to the second state or from the second state to the first state, the controller 150 displays an indicator for notifying the sensed illumination state to the display unit 170 ) To be output to one area of the display device. However, such a notification may be implemented in the form of sound, vibration, highlighting, or the like.

As described above, the infrared light emitting elements emit light in accordance with a method of recognizing bright pupils of the conventional art (Bright Pupil) in exceptional cases, thereby improving the accuracy of the user tracking function. Meanwhile, the bright pupil of the pupil can be selectively used according to the user's setting, the change of the environment value, or the user's position as well as the low-illuminance state.

As described above, according to the method of operating the image display apparatus and the image display apparatus according to the present invention, in order to support the angle of view of the infrared camera for the user tracking function, the infrared LED elements are spaced apart from each other by a predetermined interval, The user tracking function can be performed with only a small number of infrared LED elements. In addition, when the infrared camera is driven, only the necessary number of infrared LED elements are selectively emitted according to the position of the user within the angle of view of the camera, so that power consumption due to the light emission of the infrared LED element can be minimized.

Further, it will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative and non-restrictive in every respect. The scope of the present invention is defined by the appended claims rather than the foregoing detailed description, and all changes or modifications derived from the meaning and scope of the claims and the equivalents thereof are included in the scope of the present invention Should be interpreted.

Claims (16)

A display unit configured to output a screen; And
A bezel formed along a front edge of the display unit; And
And a control unit,
Wherein the bezel unit is coupled to a photographing unit that photographs a user image using at least one image sensor, and the bezel unit includes a plurality of infrared light emitting devices spaced apart from the photographing unit at predetermined intervals,
Wherein the control unit drives the photographing unit and controls the operation of the plurality of infrared light emitting devices based on a control signal when the infrared photographing mode is entered. The method according to claim 1,
Wherein,
Upon entering the infrared ray photographing mode,
Wherein the control unit senses a position of a user in a predetermined range based on the display unit and outputs a control signal for selectively operating the plurality of infrared light emitting devices based on the sensed position of the user. 3. The method of claim 2,
An imaging area by the imaging unit is divided into a plurality of areas,
Wherein,
The control unit detects a photographing area corresponding to the detected position of the user and outputs a control signal for operating at least one infrared light emitting element having a light emitting range affecting the detected photographing area And the video display device. The method of claim 3,
Wherein,
And controls the display unit to display a screen change corresponding to the changed shooting area in one area of the display unit when the detected shooting area is changed from the first area to the second area. The method of claim 3,
Wherein,
And to output a predetermined notification when the detected position of the user is out of the plurality of photographing regions. The method according to claim 1,
Wherein,
And controls to display, in one area of the display unit, an indicator capable of visually recognizing the position of the infrared light emitting element being operated among the plurality of infrared light emitting elements based on user input. 3. The method of claim 2,
Wherein,
When the infrared ray photographing mode is entered, all of the plurality of infrared ray emitting elements are turned on, and at least a part of the plurality of infrared ray emitting elements is kept on or off according to the sensed position of the user off state of the video display device. 3. The method of claim 2,
Wherein,
And outputs a control signal for causing only the infrared ray emitting element at a position corresponding to the sensed user's position to emit light when entering the infrared ray photographing mode. The method according to claim 1,
Wherein,
And a controller for recognizing a movement of a user's eye within a predetermined range based on the display unit in accordance with the operation of the photographing unit and the operation of the plurality of infrared light-
And controls the selected object of the output screen based on the recognized eye movement. 3. The method of claim 2,
Further comprising a sensing unit for sensing a surrounding illuminance state,
Wherein,
And controls the plurality of infrared light emitting elements to emit light in different patterns according to the sensed illuminance state. 11. The method of claim 10,
The bezel unit includes a plurality of infrared light emitting elements adjacent to the photographing unit and a plurality of infrared light emitting elements spaced from the photographing unit
Wherein,
And controls the plurality of infrared light emitting elements spaced apart from the photographing unit to emit light corresponding to the sensed user's position if the sensed illuminance state is the first state,
And controls the plurality of infrared light emitting elements adjacent to the photographing unit to emit light corresponding to the sensed user's position if the sensed illuminance state is the second state. 12. The method of claim 11,
Wherein the first state is a high degree of illumination or a general illumination state, the second state is a low illumination state,
Wherein,
When the change from the first state to the second state or from the second state to the first state is detected, outputs a second indicator for notifying the sensed illuminance state to one area of the display unit Video display device. The method according to claim 1,
Wherein the number of the plurality of infrared light emitting elements embedded in the bezel varies depending on a size of the display unit. The method according to claim 1,
Wherein the infrared light emitting device is an infrared LED (IR LED) device. A method of operating an image display device having a camera coupled to a bezel portion formed along a front edge of a display portion and a plurality of infrared light emitting elements spaced apart from each other by a predetermined distance from the camera,
Detecting whether an infrared ray photographing mode is entered;
Sensing a position of a user in a predetermined range based on the display unit from an image photographed by the camera when an entry into the infrared photographing mode is detected; And
And controlling the plurality of infrared light emitting elements to selectively operate based on the sensed position of the user. 16. The method of claim 15,
The method of claim 1,
Detecting an imaging region corresponding to the detected position of the user; And
And outputting a control signal for selectively operating at least one infrared light emitting element having a light emitting range that affects the detected photographing region.

Images