KR20160024273A - Image display device and method for controlling the same - Google Patents

Abstract

The present invention relates to an image display device which can sense a voice or a gesture of a user, and a method for controlling the same. According to an embodiment of the present invention, the image display device comprises: a photographing unit for photographing one or more users positioned in an area of the preset range; a sensing unit for sensing the voice spoken by the users; a display unit for displaying a position of the user who is positioned in the area of the preset range, and a position of the user who is granted with control authority among the users; and a control unit for selecting the user who speaks a preset voice and takes a preset gesture among the users positioned in the area of the preset range based on an image photographed by the photographing unit and the voice sensed by the sensing unit, and granting the control authority to the selected user.

Description

TECHNICAL FIELD [0001] The present invention relates to a video display device and a control method thereof.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus capable of detecting a user's voice or a gesture and a control method thereof.

The video display device includes both a device for receiving and outputting a broadcast, a device for recording and reproducing video, and a device for recording and reproducing audio. Such a video display device includes, for example, a television, a monitor, a projector, a tablet, and the like.

As the functions of the video display device are diversified, the video display device is implemented in the form of a multimedia player having multiple functions such as photographing, video shooting, game, and broadcast reception in addition to the output of the broadcast and the playback of the video .

In addition, the image display device can sense the user's voice or gesture, and the user who is given the control right of the image display device can control the image display device by generating a voice corresponding to the control operation or taking a gesture.

However, once the control direction, which is the direction in which the user who is given the control right is located, is fixed until the control end, there is a problem that the control right is lost if the user who is given the control right moves.

Further, there is another problem that the voice control and the control right selection method for operation control are different from each other and can not be used at the same time, and their functions are limited. At this time, in the case of voice control, there is a possibility of selecting the control direction in the wrong direction due to noise or the like, and in the case of motion control, due to movement of several persons.

Further, there is a problem that it is difficult for the user to recognize the information on the selected control direction.

The present invention is directed to solving the above-mentioned problems and other problems. Another object of the present invention is to provide a video display device and a control method thereof, in which a control right is given to a user in consideration of a user's voice and a gesture, and a movement of a user given control is tracked and displayed.

According to an aspect of the present invention, there is provided an information processing apparatus comprising: a photographing unit photographing at least one user located in an area within a predetermined range; A sensing unit for sensing speech uttered by the at least one user; A display unit for displaying a position of at least one user located in an area within the predetermined range and a position of a user given control of the at least one user; And a user who has made a preset gesture by selecting a preset voice among at least one user located in an area within the predetermined range based on the video shot by the shooting section and the voice sensed by the sensing section And a control unit for giving the control right to the selected user.

In an embodiment, the control unit may perform a preset control operation corresponding to at least one of a gesture and a voice sensed by the user who is given the control right.

In one embodiment of the present invention, when the user located in the area within the predetermined range moves in the area within the predetermined range, the control unit controls the display unit so that the position of the user changed in accordance with the movement is displayed can do.

In an exemplary embodiment, the control unit may return the control right granted to the user when the user who has been given the control right moves to an area outside the predetermined range.

In an exemplary embodiment, the control unit may return the control right granted to the user when a preset voice is sensed from the user who is given the control right.

In an exemplary embodiment, the control unit may return the control right granted to the user when a predetermined gesture is detected from the user who has been given the control right.

In an exemplary embodiment, the control unit may return the control right granted to the user when a predetermined gesture or voice corresponding to the control operation is not detected from a user who has been given the control right for a predetermined period of time have.

According to another aspect of the present invention, there is also provided a method of detecting a sound, comprising the steps of: (a) photographing at least one user located in an area within a predetermined range; (b) selecting a user who has made a preset gesture by speaking a preset voice among at least one user located in the area within the predetermined range based on the photographed image and the sensed voice, Assigning control to the selected user; And (c) displaying a position of at least one user located in an area within the predetermined range and a position of a user given the control right among the at least one user, to provide.

In one embodiment of the present invention, the step (b) may include performing a preset control operation corresponding to at least one of a gesture and a voice sensed by the user who is given the control right.

In the embodiment, the step (c) may include displaying the position of the user, which is changed according to the movement, when the user located in the area within the predetermined range moves in the area within the predetermined range ; ≪ / RTI >

In one embodiment, the step (b) may include returning the control right granted to the user when the user who is given the control right moves to an area outside the predetermined range.

In the embodiment, the step (b) may include returning the control right granted to the user when a preset voice is detected from the user who is given the control right.

The step (b) may include returning the control right granted to the user when a predetermined gesture is detected by the user who has been given the control right.

In one embodiment of the present invention, the step (b) may include: if the gesture or voice preset to correspond to the control operation is not detected from a user who has been given the control right for a predetermined period of time, And returning the data.

Effects of the image display apparatus and the control method thereof according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, there is an advantage that a user can simultaneously use voice control and operation control.

In addition, according to at least one embodiment of the present invention, there is an advantage that the control right can be maintained by tracing the path even if the user who has been given the control right moves. At this time, since the movement route of the user who has been given the control right is outputted, it becomes easy to check the information related to the control right.

As a result, the convenience of the user can be improved.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.

1 is a block diagram of a video display apparatus and a remote control apparatus according to the present invention.
2 is a block diagram of a video display device according to the present invention.
3 is a flowchart illustrating a method of controlling an image display apparatus according to the present invention.
4 is a conceptual diagram illustrating an embodiment in which the location of users is displayed on the display unit of the image display apparatus according to the present invention.
FIG. 5 is a conceptual view showing an embodiment in which a position according to a user's movement is displayed on a display unit of an image display apparatus according to the present invention.
FIG. 6 is a conceptual diagram illustrating an embodiment in which a location of a user who is given control of a display is displayed on the display unit of the image display apparatus according to the present invention.
FIG. 7 is a conceptual diagram showing an embodiment in which a position according to a user's movement, which is given a control right, is displayed on the display unit of the image display apparatus according to the present invention.
FIG. 8 is a conceptual diagram illustrating a change of a user who is given control of the display unit of the image display apparatus according to the present invention.

Hereinafter, a video display device according to the present invention will be described in detail with reference to the drawings.

In the present specification, the same or similar reference numerals are given to different embodiments in the same or similar configurations. As used herein, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. In addition, the suffix "module" and " part "for constituent elements used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The video display device related to the present invention includes both a device for receiving and outputting a broadcast, a device for recording and reproducing video, and a device for recording and reproducing audio. Hereinafter, as an example of this, a television will be described as an example.

1 is a block diagram of a video display apparatus and a remote control apparatus according to the present invention.

1, an image display apparatus 100 includes a tuner 110, a demodulating unit 111, an external device interface unit 122, a network interface unit 123, a storage unit 130, a user input interface unit A control unit 180, a display unit 140, a driving unit 150, an audio output unit 124, a power supply unit 190, and a 3D viewing device 140a.

The tuner 110 selects a channel selected by the user or an RF broadcast signal corresponding to all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 110 can be directly input to the controller 180. [

Also, the tuner 110 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

In the present invention, the tuner 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna, and converts the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal can do.

The demodulator 111 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 111 performs 8-VSB (8-Vestigal Side Band) demodulation. In addition, the demodulation unit 111 may perform channel decoding. For this, the demodulator 111 includes a trellis decoder, a de-interleaver, and a Reed Solomon decoder, and performs trellis decoding, deinterleaving, Decryption can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 111 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. In addition, the demodulation unit 111 may perform channel decoding. To this end, the demodulator 111 may include a convolution decoder, a deinterleaver, a Reed-Solomon decoder, and the like to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulation unit 111 may perform demodulation and channel decoding and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Meanwhile, the demodulating unit 111 may be separately provided according to the ATSC scheme and the DVB scheme. That is, the ATSC demodulation unit and the DVB demodulation unit can be provided.

The stream signal output from the demodulation unit 111 may be input to the control unit 180. The control unit 180 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display unit 140 and outputs audio to the audio output unit 124.

The external device interface unit 122 can connect the external device and the video display device 100. [ To this end, the external device interface unit 122 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 122 may be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook) The external device interface unit 122 transmits external video, audio, or data signals to the controller 180 of the video display device 100 through a connected external device. Also, the controller 180 can output the video, audio, or data signal processed by the controller 180 to a connected external device. To this end, the external device interface unit 122 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The video display device 100 is connected to other electronic devices in accordance with communication standards such as Bluetooth, Radio Frequency Identification (RFID), IrDA (Infrared Data Association), UWB (Ultra Wideband), ZigBee, Can be connected.

Also, the external device interface unit 122 may be connected to the various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

Meanwhile, the external device interface unit 122 can transmit and receive data to and from the 3D viewing apparatus 140a.

The network interface unit 123 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. The network interface unit 123 may include an Ethernet terminal or the like for connection to a wired network and may be a WLAN (Wireless LAN, Wi-Fi), a Wibro (wireless broadband) , World Interoperability for Microwave Access (Wimax), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 123 can receive, via the network, contents or data provided by the Internet or a content provider or a network operator. That is, it can receive contents such as movies, advertisements, games, VOD, broadcasting signals, and the like, provided from a contents provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

The network interface unit 123 is connected to, for example, an IP (Internet Protocol) TV, receives the processed video, audio, or data signals from the settop box for IPTV and controls the controller 180 And can transmit signals processed by the control unit 180 to the IPTV set-top box.

The IPTV may include ADSL-TV, VDSL-TV, FTTH-TV and the like depending on the type of the transmission network. The IPTV may include a TV over DSL, a video over DSL, a TV over IP ), And the like. In addition, IPTV may also mean an Internet TV capable of accessing the Internet, or a full browsing TV.

The storage unit 130 may store a program for each signal processing and control in the control unit 180 or may store a signal-processed video, audio, or data signal.

In addition, the storage unit 130 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 122. [ In addition, the storage unit 130 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

The storage unit 130 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), and the like. The image display apparatus 100 may reproduce and provide a file (a moving image file, a still image file, a music file, a document file, etc.) stored in the storage unit 130 to a user.

FIG. 1 illustrates an embodiment in which the storage unit 130 is provided separately from the control unit 180, but the scope of the present invention is not limited thereto. The storage unit 130 may be included in the controller 180.

The user input interface unit 121 transmits a signal input by the user to the controller 180 or a signal from the controller 180 to the user.

For example, the user input interface unit 121 may be configured to turn on / off the power, select the channel, and set the screen from the remote control device 121a according to various communication methods such as a radio frequency (RF) communication method and an infrared Or may transmit a signal from the control unit 180 to the remote control device 121a.

Also, for example, the user input interface unit 121 can transmit a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 180.

For example, the user input interface unit 121 may transmit a user input signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 180 or may sense a signal from the control unit 180 (Not shown). Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, an operation sensor, and the like.

The control unit 180 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 111 or the external device interface unit 122 to output a signal for video or audio output Can be generated and output.

The image signal processed by the controller 180 is input to the display unit 140 and can be displayed as an image corresponding to the image signal. In addition, the image signal processed by the controller 180 may be input to the external output device through the external device interface 122.

The audio signal processed by the control unit 180 may be output to the audio output unit 124 as an audio signal. The voice signal processed by the control unit 180 may be input to the external output device through the external device interface unit 122. Although not shown in FIG. 1, the controller 180 may include a demultiplexer, an image processor, and the like.

In addition, the control unit 180 can control the overall operation of the image display apparatus 100. For example, the control unit 180 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a previously stored channel.

The control unit 180 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 121 or the remote control apparatus 121a.

For example, the control unit 180 controls the tuner 110 so that a signal of a selected channel is input according to a predetermined channel selection command received through the user input interface unit 121. Then, video, audio, or data signals of the selected channel are processed. The control unit 180 may output the video or audio signal processed through the channel information selected by the user through the display unit 140 or the audio output unit 124.

The controller 180 may control the operation of the external device via the external device interface unit 122 according to an external device video playback command received through the user input interface unit 121. For example, So that a video signal or a voice signal can be output through the display unit 140 or the audio output unit 124.

Meanwhile, the control unit 180 may control the display unit 140 to display an image. For example, the broadcast image input through the tuner 110, the external input image input through the external device interface unit 122, the image input through the network interface unit 123, or the image stored in the storage unit 130 To be displayed on the display unit 140.

At this time, the image displayed on the display unit 140 may be a still image or a moving image, and may be a 2D image or a 3D image.

On the other hand, the control unit 180 generates a 3D object for a predetermined object among the images displayed on the display unit 140, and displays the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images and text.

The 3D object may be processed to have a depth different from that of the image displayed on the display unit 140. Preferably, the 3D object may be processed so as to be protruded compared to the image displayed on the display unit 140.

On the other hand, the control unit 180 recognizes the position of the user based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the video display device 100 corresponding to the user position can be grasped.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 111 or the stream signal output from the external device interface unit 122 and extracts an image from an input stream signal to generate a thumbnail image have. The generated thumbnail image can be directly or encoded and input to the controller 180. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 180. The control unit 180 may display a thumbnail list including a plurality of thumbnail images on the display unit 140 using the input thumbnail images. At this time, the thumbnail list may be displayed in a simple viewing manner displayed on a part of the display unit 140 in a state in which a predetermined image is displayed, or may be displayed in an overall viewing manner displayed in most areas of the display unit 140. [

The display unit 140 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit 180, a video signal, a data signal, a control signal, and the like received from the external device interface unit 122, .

In the present invention, it is illustrated that the display unit 140 is configured to be deformable into a flat shape or a curved shape. In addition, the display unit 140 may be embodied as a flexible display unit.

When the flexible display unit 140 is transformed into a curved shape as if it surrounds a user on the front side, a realistic image quality and immersion can be provided to the user. Such a flexible display 140 may be implemented, for example, by an OLED panel.

The display unit 140 may be configured to provide a three-dimensional image to the user. The display unit 140 may be divided into an additional display method and a single display method for three-dimensional image viewing.

In the single display method, a 3D image can be implemented by the display unit 140 alone without using a separate 3D viewing apparatus 140a, for example, 3D glasses, and examples thereof include a lenticular system, a parallax barrier barrier) can be applied.

Meanwhile, the additional display method can implement a 3D image using the 3D viewing apparatus 140a in addition to the display unit 140. For example, various methods such as a head mount display (HMD) type and a glasses type can be applied . In addition, the glasses type can be further divided into a passive type such as a polarizing glasses type and an active type such as a shutter glass type. On the other hand, head-mounted display type can be divided into a passive type and an active type.

Meanwhile, the display unit 140 may include a touch screen and may be used as an input device in addition to the output device.

The drive unit 150 is formed to deform the flexible display unit 140 into a flat shape or a curved shape. The driving unit 150 may be configured to deform the flexible display unit 140 by applying a physical force to the flexible display unit 140 directly or indirectly.

The audio output unit 124 receives a voice-processed signal, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal from the control unit 180, and outputs the voice. The audio output unit 124 may be implemented by various types of speakers.

In order to detect a user's gesture, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further provided in the image display apparatus 100 have. A signal sensed by a sensing unit (not shown) is transmitted to the control unit 180 through the user input interface unit 121.

The control unit 180 may sense a gesture of the user by respectively combining the images captured from the photographing unit (not shown) or the sensed signals from the sensing unit (not shown).

The power supply unit 190 supplies corresponding power to the video display device 100. Particularly, it is possible to supply power to a control unit 180 that can be implemented in the form of a system on chip (SOC), a display unit 140 for displaying an image, and an audio output unit 124 for audio output have. Further, according to the embodiment, power can be supplied to the heat generating portion including the heat ray.

The remote control device 121a transmits the user input to the user input interface unit 121. [ To this end, the remote controller 121a can use infrared (IR) communication, radio frequency (RF) communication, Bluetooth, ultra wideband (UWB), or ZigBee. Also, the remote controller 121a can receive the video, audio, or data signal output from the user input interface unit 121 and display it or output it by the remote controller 121a.

The video display device 100 described above is a fixed type and is a digital broadcast of ATSC system (8-VSB system), digital broadcast of DVB-T system (COFDM system), digital broadcast of ISDB-T system (BST- And may be a digital broadcast receiver capable of receiving at least one. In addition, as a portable type, digital terrestrial DMB broadcasting, satellite DMB broadcasting, ATSC-M / H broadcasting, DVB-H broadcasting (COFDM broadcasting), MediaFoward Link Only And a digital broadcasting receiver capable of receiving at least one of digital broadcasting and the like. It may also be a digital broadcast receiver for cable, satellite communications, or IPTV.

Meanwhile, the video display device described in this specification includes a TV receiver, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) .

Meanwhile, the block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram of an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the video display device 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

FIG. 2 is a block diagram of another embodiment of an image display apparatus 100 according to the present invention.

2, an image display apparatus 100 according to the present invention includes a photographing unit 210, a sensing unit 220, a display unit 140, and a control unit 180.

Specifically, the photographing section 210 can photograph at least one user located in an area within a predetermined range.

As an embodiment, the photographing unit 210 may be implemented by one or more cameras that can rotate and adjust the photographing angle. The preset range can be set as an area that can be photographed by the rotation of the camera 210 or an area included in this area. That is, the camera 210 can photograph the users who are located within the photographable range while rotating.

The sensing unit 220 may sense a voice uttered by at least one user located in an area within a predetermined range.

As an embodiment, the sensing unit 220 may be implemented as a voice sensor such as one or a plurality of microphones, and may sense a voice uttered by users located in a photographable area by the camera 210. [

The display unit 140 may display a position of at least one user located in an area within a predetermined range and a position of a user given control of at least one user.

Specifically, the control right means an authority to input a control command to the image display apparatus 100 and to control it. The control unit 180 may perform a preset control operation corresponding to at least one of the gesture and voice sensed by the user who is given the control right.

As an embodiment, the control command may be implemented as a gesture or voice corresponding to the control operation, and when the user who has been given the control right takes a gesture corresponding to the operation to power on, the power of the video display device 100 is turned on .

On the other hand, even if a user who is located in an area within a preset range but is not given a control right takes a gesture corresponding to the operation of powering on the power, the power of the video display device 100 is not turned on. These users can be viewed as candidates who are likely to be given control.

In another embodiment, the location of the users may be displayed in a relative position such that the user who is given the control right can be identified, and may be displayed in one area at the top or bottom of the screen 140.

That is, the position of at least one user located in an area within a predetermined range and the position of a user who has been given control of at least one user can be displayed separately.

The control unit 180 generates a predetermined voice of at least one user located in an area within a predetermined range based on the image photographed by the photographing unit 210 and the voice sensed by the sensing unit 220, The user who has taken the set gesture can be selected and the control right can be given to the selected user.

Specifically, the control unit 180 calculates the direction information for the users who have taken the gesture to receive the control right among the users by reviewing the photographed image, and can detect the position of the users based on the calculated direction information have. As a result, the users who are present at the detected position can be selected by the users who have taken the gesture to receive the control right.

In another embodiment, the control unit 180 may combine the photographed image and the result detected by the motion sensor 220 to calculate direction information on users who have taken a gesture that can be given control of the users, And the position of the users can be detected based on the calculated direction information. As a result, the users who are present at the detected position can be selected by the users who have taken the gesture to receive the control right.

In addition, the control unit 180 may calculate direction information for users who have uttered a voice that can be given control of the users based on the detected voice, and may detect the location of the users based on the calculated direction information have. As a result, users present at the detected position can be selected as users who have uttered voice capable of being given control.

Then, the control unit 180 may take a gesture to receive the control right from among the selected users, and may assign the control right to the selected user by selecting the user who has uttered the voice capable of being given the control right.

At this time, even if a gesture or voice capable of being given the control right is simultaneously or sequentially recognized from the user, control can be given to the user.

As an embodiment, it is possible to select a user who has uttered a voice of 'start' while raising his / her right arm, and can give control to a selected user.

As another embodiment, the user who has uttered the voice of 'start' can be selected after the right arm is firstly laid, and the control right can be given to the selected user.

As another embodiment, it is possible to select a user who has raised a right arm after uttering a voice of 'start', and to give a control right to a selected user.

3 is a flowchart for explaining a control method of the image display apparatus 100 according to the present invention.

Referring to FIG. 3, at first, at least one user located in an area within a predetermined range is photographed, and a step S310 is performed in which a sound is emitted from at least one user.

Specifically, one or more cameras 210 may photograph at least one user located in an area within a predetermined range, and one or a plurality of microphones 220 may sense a voice uttered by these users .

As described above, the predetermined range can be set as an area that can be photographed by the rotation of the camera 210 or an area included in this area.

Then, based on the photographed image and the sensed voice, a user who has made a preset gesture by speaking a predetermined voice among at least one user located in an area within a preset range is selected, (S320). ≪ / RTI >

Specifically, the control unit 180 detects a direction of a user who has taken a preset gesture so that the control right can be given from the image photographed by one or a plurality of cameras 210, for example, a gesture that nods the head can do. In addition, the users who are nodding their heads can be selected by locating the users based on the sensed directions.

As another example, the controller 180 may combine the images captured by one or more cameras 210 with the results detected by the motion sensor 220 to detect the direction of the users who took the nodding gesture can do. In addition, the users who are nodding their heads can be selected by locating the users based on the sensed directions.

In addition, the control unit 180 detects the directions of users who have uttered a preset voice, for example, a voice called 'start', so that a control right can be given from the voice sensed by one or more microphones 220 . In addition, users can be identified based on the detected direction and users who have uttered a voice of 'start' can be selected.

Then, the control unit 180 may nod the head of the selected users and give control to the selected user by selecting the user who said 'start'.

At this time, even if a gesture or voice capable of being given a control right from the user is simultaneously or sequentially recognized, control can be given to the user.

That is, you can give control to a user who nods your head or after you have spoken the word "Start", or you can give control to a user who takes a gesture that nods your head after saying "Start" have.

According to the embodiment, the control unit 180 may control the image captured by the camera 210, the voice sensed by the microphone 220, the motion of the users sensed by the motion sensor 220, Can be utilized. That is, as described with reference to FIG. 1, the sensing unit 220 may include a voice sensor, a position sensor, an operation sensor, and the like.

In addition, as described above, the control right means an authority to input a control command to the image display apparatus 100 and to control it.

As an embodiment, the control command may be implemented as a gesture or voice corresponding to the control operation, and when the user who has been given the control right takes a gesture corresponding to the operation to power on, the power of the video display device 100 is turned on .

On the other hand, even if a user who is located in an area within a preset range but is not given a control right takes a gesture corresponding to the operation of powering on the power, the power of the video display device 100 is not turned on. These users can be viewed as candidates who are likely to be given control.

Next, a step S330 of displaying the position of at least one user located in an area within a predetermined range and the position of a user given control of at least one user is performed.

In an embodiment, the positions of the users may be displayed in relative positions such that the user who is given the control right can be identified, and may be displayed in one area at the top or bottom of the screen 140.

In addition, when the user moves within a predetermined range, the position of the user to be changed corresponding to the moved position may be displayed on the display unit 140.

4 is a conceptual diagram illustrating an embodiment in which the location of users is displayed on the display unit 140 of the image display apparatus 100 according to the present invention.

Referring to FIG. 4A, the camera 210 and the left and right microphones 220 may be disposed in a region of the upper bezel of the TV 100. As an example, one or more cameras 210 and a microphone 220 may be disposed.

As another example, one or more cameras 210 and a microphone 220 may be disposed in one area of the left or right bezel, or one area of the lower bezel.

In addition, the camera 210 can photograph an area 400 within a predetermined range. As described above, the range 400 can be set as an area that can be photographed by the camera 210 or an area included in the photographable area.

The display unit 140 can output the positions 410-1 and 420-1 of the users 410 and 420 located in the area 400 within the predetermined range in one area 440 at the upper or lower end have. At this time, the position of the user 430 out of the area 400 within the preset range is not output.

4B shows an example of a region of the display unit 140 in which the positions 410-1 and 420-1 of the users 410 and 420 located in the region 400 within the predetermined range are output 440).

4B, the relative positions 410-1 and 410-2 of the users 410 and 420 located in the area 400 within the predetermined range in one area 440 at the lower end of the display unit 140, 420-1 may be output.

Specifically, the screen 140 is displayed such that the positions 410-1 and 420-1 of the users 410 and 420 located in the predetermined range 400 correspond to the screen 140 (412 and 422) And may be displayed as a circle in one area 440 at the bottom. At this time, the position of the user 430 out of the area 400 within the preset range is not output.

On the other hand, when the user moves from the area 400 within the range set by the user 410 located in the area 400 within the predetermined range, the controller 180 determines that the position of the user 410, So that the display unit 140 can be controlled.

5 is a conceptual diagram showing an embodiment in which a position of a user 410 is displayed on a display unit 140 of an image display apparatus 100 according to the present invention.

5A and 5B, when the first user 410 located in the area 400 within the predetermined range moves to the right (①), the first user 410 May be displayed on the screen 140. [0051] FIG.

Similarly, when the first user 410 located in the area 400 within the predetermined range moves to the left (②), the position 410-3 of the first user 410 in accordance with the movement moves to the screen 140 .

On the other hand, when the first user 410 located in the area 400 within the predetermined range moves to the left and deviates from the area 400 within the predetermined range (3) The position of the first user 410 according to the movement can be output to the screen 140 only until the user moves from the first user 410 to the second user 410.

That is, the position of the first user 410 outside the area 400 within the predetermined range is not output to the screen 140.

Also, as described above, the position of the user who has been given the control right can be displayed so as to be distinguished from other users' positions.

6 is a conceptual diagram illustrating an embodiment in which a location of a user who is given control of the display unit 140 of the video display device 100 according to the present invention is displayed.

6A and 6B, when the positions of the users 410, 600, and 420 located in the area 400 within the predetermined range are positioned in one area 440 of the screen 140, (410-1, 600-1, 420-1).

At this time, the circle 600-1 corresponding to the position of the user 600 having the control right is different from the circles 410-1 and 420-1 corresponding to the positions of the other users 410 and 420, . ≪ / RTI >

As another example, the position of the user 600 to which control is given may be displayed in a figure other than a circle.

The control unit 180 may return the control right granted to the user 400 when the user 600 to which the control right is given moves to an area outside the preset range 400. [

FIG. 7 is a conceptual diagram illustrating an embodiment in which a position according to movement of a user 600 to which a control right is given to a display unit 140 of an image display apparatus 100 according to the present invention is displayed.

When the user 600 having the control right located in the area 400 within the predetermined range moves to the right side (①), the position 600-2 of the user 600, (140).

Likewise, when the user 600 having the control right located in the area 400 within the predetermined range moves to the left (2), the position 600-3 of the user 600, May be output to the screen 140. [

On the other hand, when the user 600 having been given the control right located in the area 400 within the predetermined range moves to the right and moves out of the area 400 within the predetermined range (3) The location of the user 600 who has been given the control right according to the movement can be displayed on the screen 140 only until the user 600 moves.

That is, the position of the user 600 that has been given control over the region 400 within the predetermined range is not output to the screen 140.

In addition, as the user 600 that has been given the control right moves out of the area 400 within the preset range, the user 600 loses the control rights that the user 600 has been granted.

For example, the user 600 having been given the control right can say 'small' to reduce the volume of the TV 100. However, when the user 600 to which the control right is given moves to the right and leaves the area 400 within the preset range (3), the volume of the TV 100 is maintained even if it is said to be 'small'.

As another embodiment, the control unit 180 may return the control right granted to the user 600 when a preset voice is detected from the user 600 to whom the control right is given.

Specifically, if the user 600 to which the control right is granted utteres words such as 'cancel' or 'end', the user 600 loses control that has been granted. At this time, the user 600 may be located in the area 400 within the predetermined range or may be out of the area 400 within the predetermined range.

That is, even if the user 600 is in the area 400 within the predetermined range, if the words such as 'cancel' or 'end' are uttered, the user 600 loses control.

In another embodiment, the control unit 180 may return the control right granted to the user 600 when a predetermined gesture is detected from the user 600 having been given the control right.

Specifically, when the user 600 having received the control right takes a swing gesture, the user 600 loses control. At this time, the user 600 may be located in the area 400 within the predetermined range or may be out of the area 400 within the predetermined range.

That is, even if the user 600 is in the area 400 within the predetermined range, if the user takes a swinging gesture, the user 600 loses control.

In another embodiment, when the gesture or voice preset to correspond to the control operation is not detected from the user 600 having been given the control right for a preset time, Can be returned.

Specifically, if the user 600 having been given the control right for 30 minutes can not detect a gesture or voice related to the operation of the TV 100 such as turning on the power of the TV 100 or adjusting the volume, Loses control that was granted.

At this time, the user 600 may be located in the area 400 within the predetermined range or may be out of the area 400 within the predetermined range.

That is, even if the user 600 is in the predetermined area 400, if the gesture or voice related to the operation of the TV 100 is not detected for 30 minutes, the user 600 loses control that has been granted.

In addition, since the control right is returned from the user 600 having the control right, the control unit 180 can search for a user who can be newly given the control right.

As an embodiment, control can be given to a user who is present in an area 400 within a predetermined range and in which a voice and a gesture for obtaining a control right among users 410 and 420 that can be given control can be sensed.

FIG. 8 is a conceptual diagram illustrating a change of a user who is given control of the display unit of the image display apparatus according to the present invention.

Referring to FIG. 8A, a gesture and voice, which can be given control from the first user, among the first user and the second user located in a predetermined range, can be detected. As a result, control can be given to the first user.

For example, when the first user lifts the left hand and says "start", control can be given to the first user.

In addition, the positions of the first user and the second user, which have been given control over one area 440 of the screen 140, can be displayed separately.

As an example, circles 810 and 820 corresponding to the positions of the first user and the second user, which have been given control in one area 440 of the screen 140, may be displayed, The circle 810 corresponding to the position of the second user may be displayed larger than the circle 820 corresponding to the position of the second user.

At this time, the control right granted to the first user can be given to the second user. That is, the first user loses control, and the second user can be given control.

As an example, as described in FIG. 7, if the first user moves out of the area within the preset range, the first user loses control that has been given. Then, when a voice and a gesture capable of being given control by the second user are detected, that is, when the second user lifts the left hand and says 'start', the second user can be given control.

In another embodiment, when the first user fires a word such as 'cancel' or 'end', which is a keyword in which the first user loses control, the first user loses control. Then, when the second user lifts the left hand and says 'start', control can be given to the second user.

In another embodiment, when the first user takes a shaking motion, which is a gesture in which the first user loses control, the first user loses control. Then, when the second user lifts the left hand and says 'start', control can be given to the second user.

In another embodiment, when the gesture or voice preset to correspond to the control operation is not detected from the first user who has been given the control right for a preset time, for example, the first user who has been given the control right for 30 minutes If the gesture or voice associated with the operation of the TV 100, such as turning on the power of the TV 100 or adjusting the volume, is not detected, the first user loses control.

Then, when the second user lifts the left hand and says 'start', control can be given to the second user.

In another embodiment, when the second user lifts the left hand and says 'start' in a state where control is given to the first user, the control right may be passed from the first user to the second user.

Referring to FIG. 8B, as control is transferred from the first user to the second user, a circle 820 corresponding to the position of the second user corresponds to a circle 810 corresponding to the position of the first user, It can be displayed that the control right has been given to the second user.

Effects of the image display apparatus and the control method thereof according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, there is an advantage that a user can simultaneously use voice control and operation control.

In addition, according to at least one embodiment of the present invention, there is an advantage that the control right can be maintained by tracing the path even if the user who has been given the control right moves. At this time, since the movement route of the user who has been given the control right is outputted, it becomes easy to check the information related to the control right.

As a result, the convenience of the user can be improved.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a controller 180 of the image display apparatus. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

210 -
220 - sensing unit
180 -
140 -

Claims (14)

A photographing unit photographing at least one user located in an area within a predetermined range;
A sensing unit for sensing speech uttered by the at least one user;
A display unit for displaying a position of at least one user located in an area within the predetermined range and a position of a user given control of the at least one user; And
A user who has set a predetermined gesture by using a predetermined voice among at least one user located in an area within the preset range based on the image photographed by the photographing unit and the voice sensed by the sensing unit, And a control unit for giving the control right to the selected user. The method according to claim 1,
Wherein,
Wherein the controller executes a preset control operation so as to correspond to at least one of a gesture and a voice sensed by the user who is given the control right. The method according to claim 1,
Wherein,
Wherein the controller controls the display unit to display the position of the user changed according to the movement when the user located in the predetermined range moves in the predetermined range. 3. The method of claim 2,
Wherein,
And returns the control right granted to the user when the user who has been given the control right moves to an area outside the predetermined range. 3. The method of claim 2,
Wherein,
And returns the control right granted to the user when a preset voice is sensed by the user who is given the control right. 3. The method of claim 2,
Wherein,
And returns the control right granted to the user when a predetermined gesture is detected from the user who has been given the control right. 3. The method of claim 2,
Wherein,
And returns the control right granted to the user when a predetermined gesture or voice corresponding to the control operation is not detected from a user who has been given the control right for a predetermined period of time. (a) photographing at least one user located in an area within a predetermined range, and detecting a voice uttered by the at least one user;
(b) selecting a user who has made a preset gesture by speaking a preset voice among at least one user located in the area within the predetermined range based on the photographed image and the sensed voice, Assigning control to the selected user; And
(c) displaying a position of at least one user located in an area within the predetermined range and a position of a user given the control right among the at least one user, Control method. 9. The method of claim 8,
The step (b)
And performing a preset control operation corresponding to at least one of a gesture and a voice sensed by the user who is given the control right. 9. The method of claim 8,
The step (c)
And displaying the position of the user to be changed according to the movement when the user located in the area within the predetermined range moves in the area within the predetermined range. / RTI > 10. The method of claim 9,
The step (b)
And returning the control right granted to the user when the user who has been given the control right moves to an area outside the preset range. 10. The method of claim 9,
The step (b)
And returning the control right granted to the user when a preset voice is sensed by the user who is given the control right. 10. The method of claim 9,
The step (b)
And returning the control right granted to the user when a predetermined gesture is detected from the user who is given the control right. 10. The method of claim 9,
The step (b)
And returning the control right granted to the user when a predetermined gesture or voice corresponding to the control operation is not detected from a user who has been given the control right for a predetermined period of time A method of controlling a display device.

Images