KR101790342B1 - Display apparatus and controlling method thereof - Google Patents

Abstract

The present invention relates to a display apparatus and a control method thereof, the method comprising: recognizing a first operation of a user; Granting a control right to perform a function of the display device through an operation to the user corresponding to the recognized first operation; And displaying information on the user who is given the control right.

Description

[0001] The present invention relates to a display apparatus and a control method thereof,

The present invention relates to a method of controlling the operation of a display device.

2. Description of the Related Art [0002] In recent years, a digital broadcasting receiver (Digital Television) has provided various functions such as reception of an electronic program guide (EPG), a bidirectional communication function, and an internet connection function in addition to a broadcasting reception function of analogue or digital broadcasting. In addition, the digital broadcast receiving apparatus can handle functions of a server in a home network environment or a ubiquitous environment.

As the display device such as the digital broadcasting receiver can perform many functions, the number of items to be controlled by the user is increased and complicated. Therefore, the conventional infrared remote control system can not efficiently control such complex functions. In order to control the functions, the user has to carry the remote controller at all times.

It is an object of the present invention to provide a method for efficiently controlling a display device.

A method of controlling a display device according to an embodiment of the present invention includes: recognizing a first operation of a user; In response to the recognized first operation, granting the user the control right to perform the function of the display device through the operation; And displaying information on the user who is given the control right.

According to an embodiment of the present invention, there is provided a display device including: an operation recognizing unit recognizing an operation performed by a user; A control unit for giving a control right to perform the function of the display device through an operation to the user corresponding to the first operation of the recognized user using the operation recognition unit; And a display unit for displaying an image of a user to whom the control right is given, and is not controlled by an operation of another user other than the user to whom the control right is given.

Meanwhile, the control method of the display device may be embodied as a computer-readable recording medium on which a program for execution by a computer is recorded.

According to the embodiment of the present invention, the convenience of the user can be improved by recognizing the operation of the display user and performing the corresponding function without using a separate device such as a conventional remote controller.

In addition, it is possible to give a control permission to control the display device to the recognized specific user through the operation, and prevent the display device from being controlled by the user who does not have the control right, Can be prevented.

In addition, by displaying information such as a video of a user having the control right on the screen, the user can easily check the current control person, thereby efficiently controlling the display device.

1 is a block diagram showing a simplified configuration of a display device according to an embodiment of the present invention.
2 is a diagram for explaining a method of controlling a display device by recognizing a user's operation.
3A to 3D are diagrams illustrating an embodiment of user operations corresponding to functions of a display device, respectively.
4 is a diagram illustrating an embodiment of a method of displaying broadcast channel information.
5 is a block diagram illustrating a configuration of a display device according to another embodiment of the present invention.
6 is a flowchart showing a first embodiment of a method of controlling a display device according to the present invention.
FIGS. 7 to 16 are views showing embodiments of a method of displaying a user's operation or a function of a corresponding display device.
17 is a flowchart showing a second embodiment of a method of controlling a display device according to the present invention.
FIGS. 18 to 21 are views showing embodiments of a method for giving a specific user control over the display device.
22 is a flowchart showing a third embodiment of a control method of a display apparatus according to the present invention.
23 to 27 are views showing embodiments of a method for changing the control right.
28 is a flowchart showing a fourth embodiment of a control method of a display apparatus according to the present invention.
29 to 32 are views showing embodiments of a method of displaying information about a user having control.

Hereinafter, a display device and a control method thereof according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram of a simplified configuration of a display device according to an embodiment of the present invention. The display device shown in FIG. 1 may include an operation recognition unit 10, a control unit 20, and a display unit 30.

For example, the display device 100 according to an embodiment of the present invention can be used for real-time broadcast, COD (Contents on Demand), game, news, video communication, etc. using an Internet network connected to each home, And may be a digital broadcasting receiver (Digital Television) capable of providing various kinds of contents services to users.

An example of content service provision using the Internet network is IPTV (Internet Protocol TV). The IPTV refers to transmitting various information services, moving picture contents, broadcasting, and the like to a user's television using a high-speed Internet network.

In addition, the display device 100 may be a broadband TV, a web TV, or the like, which is a type of network TV developed further in the IPTV. Unlike the IPTV, the broadband TV or the web TV has a plurality of content providers , The user can individually access a plurality of content providers and receive various contents such as VODs and games provided by the content providers.

Referring to FIG. 1, the motion recognition unit 10 includes a camera module for recognizing physical information of a user's action, for example, a user's face, a hand, a leg, etc., can do.

2, the operation recognition unit 10 may include a camera module 11 attached to the upper end of the display device 100, for example, Can be recognized.

For example, the motion recognition unit 10 may include various devices capable of capturing an image, such as a digital camera, a CMOS camera, and a CCD (Charged Coupled Device) camera, and various sensor devices capable of sensing a subject.

According to an embodiment of the present invention, the camera module included in the motion recognition unit 10 can recognize a hand motion of a user by photographing an image related to a gesture of a hand such as a hand shape and an operation of the user .

For example, the motion recognizing unit 10 may distinguish a hand region of the user from the photographed user's image, and may extract a hand region of the user by distinguishing colors of the user's hand and background colors other than the hand .

In addition, the motion recognizing unit 10 can recognize the hand motion of the user, for example, the shape or motion of the hand, using the extracted hand region of the user.

More specifically, the motion recognition unit 10 may express the movement of the user's hand in a predetermined coordinate or vector on the x, y, and z axes.

The control unit 20 can perform the operation of the user recognized by the operation recognition unit 10, for example, the function of the display device 100 corresponding to the user's hand operation.

For this purpose, a plurality of user actions can be respectively corresponded to a plurality of functions of the display device 100 that can be performed by a user's operation, and information about the user's actions, for example, Information may be stored in a storage unit (not shown).

The control unit 20 compares the hand operation information of the user inputted from the operation recognition unit 10 with the information stored in the storage unit (not shown), and when the corresponding hand operation information exists, the function of the display device 100 . ≪ / RTI >

FIGS. 3A through 3D illustrate examples of user operations corresponding to functions of a display device, respectively.

Referring to FIG. 3A, when the user 200 takes a hand operation in which the thumb and the forefinger of the both hands are opened to collect each other, the hand operation of the user is performed by using a specific function of the display device 100, for example, .

3A, the operation recognition unit 10 recognizes the shape of the user's hand operation and outputs information on the shape to the control unit 20, and the control unit 20 May perform a function corresponding to the input information, i.e., a broadcast channel information display function.

FIG. 4 illustrates an embodiment of a method of displaying broadcast channel information. The broadcast channel information is displayed on a screen 10 of the display device 100, that is, a plurality of broadcast channels, Information can be displayed.

The displayed broadcast channel information may include a broadcasting station name of the corresponding channel, a channel number, a name or content of contents broadcasted in the current or specific time zone on the channel in the form of characters or images.

In an embodiment of the present invention, information on a plurality of broadcast channels displayed on a screen of the display device 100 may include an image corresponding to an image of each broadcast channel, more specifically, a thumbnail image or a movie clip, And the like.

The user can select any one of the information on the broadcast channels displayed on the screen to reproduce the contents of the desired channel.

Referring to FIG. 3B, in the case where the user 200 takes a manual operation for unfolding the palm and moving it to the left or right, the hand operation of the user may correspond to a specific function of the display device 100, for example, channel switching.

3B, the operation recognizing unit 10 recognizes the shape of the user's hand and recognizes the movement of the user, and outputs the information to the control unit 20. The control unit 20 20 may perform channel switching, which is a function corresponding to the input information.

For example, when the user 200 spreads the palm toward the display device 100 and then moves to the right, the number of the channel increases. When the user 200 moves to the left, the number of the channel decreases.

Referring to FIG. 3C, when the user 200 takes a hand gesture to unfold and rotate the palm of a hand, the user's hand gesture may correspond to a specific function of the display device 100, for example, a sound output volume adjustment .

3C, the operation recognition unit 10 recognizes the shape of the hand of the user and recognizes the movement and outputs the information to the control unit 20, and the control unit 20 20 may perform voice output size adjustment, which is a function corresponding to the input information.

For example, when the user 200 spreads the palm of the hand toward the display device 100 and then rotates clockwise, the volume of the voice output increases. When the user 200 moves in the counterclockwise direction, the voice output size may decrease .

Referring to FIG. 3D, when the user 200 takes a hand gesture of a fist shape, the user's hand gesture may correspond to a specific function of the display device 100, for example, a menu selection function.

3D, the operation recognition unit 10 recognizes the shape of the user's hand operation and outputs information on the shape to the control unit 20, and the control unit 20 May perform a function corresponding to the input information, i.e., a menu function.

In addition to the above operations, the control unit 20 controls the overall operation of the display device 100, and controls the display unit 30 to display an image corresponding to the broadcast channel or various contents selected by the user can do.

The configuration and operation of the control unit 20 and the display unit 30 will be described in detail with reference to FIG.

5 is a block diagram illustrating a configuration of a display device according to another embodiment of the present invention.

5, the display apparatus 100 includes a first tuner 120, a second tuner 125, an external signal input unit 128, a first demodulating unit 130, a second demodulating unit 135, A digital conversion unit 140, an interface unit 150, a control unit 20, a channel browsing processing unit 170, a storage unit 175, a display unit 30 and an audio output unit 185.

The first tuner 120 selects an RF broadcast signal corresponding to a channel selected by a user from an RF (Radio Frequency) broadcast signal received through an antenna, converts the selected RF broadcast signal into an intermediate frequency signal or a baseband video / audio signal .

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal DIF1, and if it is an analog broadcast signal, it is converted into an analog baseband video / audio signal CVBS 1 / SIF. That is, the first tuner 120 may be a hybrid tuner capable of processing a digital broadcast signal and an analog broadcast signal. The analog baseband video / audio signal (CVBS 1 / SIF) output from the first tuner 120 may be directly input to the control unit 20.

Also, the first tuner 120 can receive RF carrier signals of a single carrier according to an Advanced Television Systems Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Similarly to the first tuner 120, the second tuner 125 selects an RF broadcast signal corresponding to a channel selected by the user from among RF (Radio Frequency) broadcast signals received through the antenna, To an intermediate frequency signal or a baseband video / audio signal.

The second tuner 125 sequentially selects a corresponding RF broadcast signal of all broadcast channels previously stored through the channel memory function among the RF broadcast signals received through the antenna and periodically selects the corresponding RF broadcast signal, It is also possible to convert it into a baseband video / audio signal. In the embodiment of the present invention, images of other channels previously stored are also displayed in a thumbnail form on at least a part of the screen, so that it is possible to sequentially receive RF broadcasting signals of all channels previously stored.

For example, the first tuner 120 converts a main RF broadcast signal selected by the user into an intermediate frequency signal or a baseband video / audio signal, and the second tuner 125 converts all RF broadcasts except for the main RF broadcast signal It is possible to sequentially and periodically select a signal (sub-RF broadcast signal) or all RF broadcast signals and to convert it into an intermediate frequency signal or a baseband video / audio signal.

The first demodulator 130 receives the digital IF signal DIF 1 converted by the first tuner 120 and performs a demodulation operation.

For example, when the digital IF signal DIF 1 output from the first tuner 120 is of the ATSC scheme, the first demodulator 130 performs 8-VSB (8-Vestigal Side Band) demodulation. Also, the first demodulator 130 may perform channel decoding.

For this, the first demodulator 130 includes a Trellis decoder, a de-interleaver, and a Reed Solomon decoder to perform trellis decoding and deinterleaving de-interleaving and reed solomon decoding.

For example, when the digital IF signal DIF 1 output from the first tuner 120 is a DVB scheme, the first demodulator 130 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the first demodulator 130 may perform channel decoding.

To this end, the first demodulator 130 may include a convolution decoder, a deinterleaver, a Reed-Solomon decoder, and the like to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The external signal input unit 128 performs signal input with an external device. To this end, the external signal input unit 128 may include an A / V input / output unit and a wireless communication unit.

The external signal input unit 128 is connected to an external device such as a digital versatile disk (DVD), a Blu ray, a game device, a camcorder, a computer (notebook computer), etc. to output an external input video signal, And transmits the signal to the control unit 20 in the display device 100. In addition, the video signal, audio signal, and data signal processed in the control unit 20 can be output to another external device.

The A / V I / O unit is provided with an Ethernet terminal, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog) terminal for inputting / , A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, a SPDIF terminal, and a Liquid HD terminal.

Though not shown in the drawing, various input signals input through the external signal input unit 128 may be input to a channel browsing processing unit 170, which will be described later, and a thumbnail image extracting process may be performed.

For example, the analog signal input through the CVBS terminal and the S-video terminal may be converted into a digital signal and input to the channel browsing processing unit 170, as described above. The digital signal input through the other input terminal can be directly input to the channel browsing processing unit 170 without analog / digital conversion.

Here, the digital signal output from the external signal input unit 128 may be a stream signal. For example, an MPEG-2 TS (Digital Versatile Disc) (Transprt Stream).

The wireless communication unit can perform a wireless Internet connection. For example, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) .

In addition, the wireless communication unit can perform short-range wireless communication with other electronic devices. For example, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

Meanwhile, the external signal input unit 128 may be connected to the various set-top boxes through at least one of the various terminals described above to perform input / output operations with the set-top box.

For example, when the set-top box is a set-top box for an IP (Internet Protocol) TV, the video, audio and data signals processed in the IPTV set-top box can be transmitted to the controller 20, The control unit 20 may transmit the processed signals to the IPTV set-top box.

On the other hand, the video, audio and data signals processed in the IPTV set-top box can be processed by the controller 20 via the channel browsing processor 170.

The IPTV may include ADSL-TV, VDSL-TV, FTTH-TV and the like depending on the type of the transmission network. The IPTV may include a TV over DSL, a video over DSL, a TV over IP ), And the like. In addition, IPTV may also mean an Internet TV capable of accessing the Internet, or a full browsing TV.

The first demodulator 130 performs demodulation and channel decoding, and can output the stream signal TS 1. The stream signal TS 1 at this time may be a signal in which a video signal, an audio signal, and a data signal are multiplexed. For example, the stream signal TS 1 may be an MPEG-2 TS (Transprt Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The stream signal TS1 is input to the control unit 20, and demultiplexing, signal processing, and the like are performed. In the embodiment of the present invention, before being input to the control unit 20, the channel browsing processing unit 170 inputs a channel browsing process. The channel browsing operation will be described later.

Meanwhile, the first demodulating unit 130 may be separately provided according to the ATSC scheme and the DVB scheme. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The second demodulator 135 receives the digital IF signal DIF 2 converted by the second tuner 125, performs a demodulation operation, and outputs a stream signal TS 2. The operation of the second demodulation unit 135 will be omitted with reference to the operation of the first demodulation unit 130 described above.

On the other hand, when the signal output from the second tuner 125 is the analog baseband video signal CVBS 2, the conversion from the analog / digital converter 140 to the digital signal is required.

The analog-to-digital converter 140 converts the input analog signal into a digital signal. If the input signal is a video signal, sampling and quantization may be performed and converted into a digital video signal DV. The converted digital signal may be an uncoded signal. The converted digital video signal DV is input to the channel browsing processing unit 170 and processed.

The interface unit 150 transmits an input signal from the user to the control unit 20 or a signal from the control unit 20 to the user. For example, the interface unit 150 may be provided with various functions such as power on / off, channel selection, screen setting, and the like from the remote control device 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared And can transmit a signal from the control unit 20 to the remote control device 200. [

According to an embodiment of the present invention, the interface unit 150 may include an operation recognition unit 10 as described with reference to FIGS. 1 to 4, Information can be output to the control unit 20. [

The control unit 20 demultiplexes the input stream and processes the demultiplexed signals to generate and output a signal for video and audio output. The overall operation of the display device 100 can be controlled.

Although not shown in the figure, the control unit 20 may include a demultiplexing unit, a video processing unit, a voice processing unit, a user input signal processing unit, and the like.

The control unit 20 demultiplexes an input stream signal, for example, an MPEG-2 TS, into a video signal, a voice signal, and a data signal, respectively.

In addition, the control unit 20 can perform image processing of the demultiplexed video signal. For example, if the demultiplexed video signal is a coded video signal, it can be decoded. Specifically, when the demultiplexed video signal is an MPEG-2 standard-coded video signal, it can be decoded by an MPEG-2 decoder. Also, if the demultiplexed video signal is a video signal of the H.264 standard according to the DMB (Digital Multimedia Broadcasting) scheme or DVB-H, it can be decoded by the H.264 decoder.

In addition, the controller 20 may process the brightness, tint, and color of the video signal.

The video signal processed by the control unit 20 is input to the display unit 30 and displayed. It is also possible to input to an external output terminal connected to the external output device.

Also, the control unit 20 can perform the voice processing of the demultiplexed voice signal. For example, if the demultiplexed speech signal is a coded speech signal, it can be decoded. Specifically, when the demultiplexed speech signal is an MPEG-2 standard encoded speech signal, it can be decoded by an MPEG-2 decoder.

In addition, if the demultiplexed speech signal is a coded voice signal of the MPEG 4 BSAC (Bit Sliced Arithmetic Coding) standard according to a terrestrial DMB (Digital Multimedia Broadcasting) scheme, it can be decoded by an MPEG 4 decoder. Also, if the demultiplexed speech signal is an encoded audio signal of the AAC (Advanced Audio Codec) standard of MPEG 2 according to the satellite DMB scheme or DVB-H, it can be decoded by the AAC decoder.

In addition, the control unit 20 can process a base, a treble, a volume control, and the like.

The voice signal processed in the control unit 20 is input to the voice output unit 185, for example, a speaker and is output as voice. It is also possible to input to an external output terminal connected to the external output device.

Also, the control unit 20 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in case of ATSC, and DVB-Service Information (DVB-SI) information in case of DVB. The ATSC-PSIP information or the DVB-SI information may be information included in the above-described stream, i.e., the header (4 bytes) of the MPEG-2 TS.

Also, the control unit 20 may perform an OSD (On Screen Display) process. Specifically, the control unit 20 displays various types of information on the screen of the display unit 30 based on at least one of the image-processed video signal and the data-processed data signal and the user input signal from the remote control device 200 To generate graphics for displaying graphics or text. The generated signal may be input to the display unit 30 together with the processed image signal and the processed data signal.

The signal generated for the graphic or text display may include various data such as a user interface screen of the display device 100, various menu screens, a widget, and an icon.

The channel browsing processor 170 may perform browsing processing on at least one of a broadcast signal corresponding to a received channel and various input video signals input through the external signal input unit 128. [

Specifically, the demodulation unit 130 and the demodulation unit 135 receive the demodulated and channel-decoded stream signal TS 1 or TS 2, receive the stream signal from the external input signal input unit 128, 140 and demultiplexes the stream signal TS 1 or TS 2 and extracts a part of the demultiplexed video signals and outputs the video signal including the extracted video signal And output a new stream signal TSa. For example, the stream signal TSa or TSb may be an MPEG 2 TS.

In addition, the channel browsing processor 170 may output the main stream signal TSb corresponding to the main video signal displayed in the main area of the display unit 30 without any processing, The sub stream signal TSa corresponding to the sub video signal displayed in the sub region of the video signal displayed on the display unit 30 may be subjected to the channel browsing process and output as described above.

In the embodiment of the present invention, when a partial list of the broadcast signals of a plurality of channels is extracted and re-encoded into a stream format through the channel browsing processing unit 170 to display the channel list on the display unit 30, At least a part of the images can be displayed on the screen in the form of a thumbnail. As a result, the user can intuitively know the content broadcast on the other channel.

The channel browsing processing unit 170 extracts a part of images of various external input images inputted through the external signal input unit 128 and re-encodes them into a stream form so that when displaying an external input list on the display unit 30, At least a part of the external input image from the external input device can be displayed on the screen in a thumbnail form. Accordingly, the user can intuitively know the contents input from the external input device.

On the other hand, the channel browsing processor 170 extracts a broadcasting signal image of the channel and a partial image of the external input image described above, and re-encodes the partial image into a stream form, thereby displaying a channel list and an external input list on the display unit 30 , It is possible to display at least a part of the broadcast signal image of the plurality of channels and the external input image from the plurality of external input devices in a thumbnail form on the screen.

Accordingly, the user can intuitively know the contents input from the plurality of channels and the external input device.

The storage unit 175 may store a program for each signal processing and control in the control unit 20, and may store a video signal, a voice signal, and a data signal, which have undergone signal processing.

The storage unit 175 may also function to temporarily store video, audio, or data signals input from the external signal input unit 128.

The storage unit 175 may store a corresponding broadcast channel through a channel memory function. For example, a flash memory type, a hard disk type, a multimedia card micro type type memory, a card type memory (e.g., SD or XD memory), a RAM, a ROM (EEPROM, etc.), and the like.

Although the storage unit 175 is shown separately from the control unit 20 in the drawing, the storage unit 175 is not limited thereto and may be included in the control unit 20.

Meanwhile, the display apparatus 100 may reproduce files (moving picture files, still picture files, music files, document files, etc.) stored in the storage unit 175 and provide them to users.

The display unit 30 converts an image signal, a data signal, an OSD signal processed by the control unit 20 or a video signal and a data signal received from the external signal input unit 128 into R, G, and B signals, respectively, .

The display unit 30 can be implemented in various forms such as a PDP, an LCD, an OLED, a flexible display, and a 3D display unit. The display unit 30 may include a touch screen and may be used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the control unit 20, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The voice output unit 185 may be implemented by various types of speakers.

5, the display device 100 includes two tuners 120 and 125. However, the present invention is not limited to this, and it is also possible to include one or more tuners.

The display device 100 described above is a fixed type and has at least one of an ATSC (8-VSB) digital broadcast, a DVB-T (COFDM) digital broadcast, and an ISDB-T (BST- Digital broadcasting of the terrestrial DMB system, digital broadcasting of the satellite DMB system, digital broadcasting of the ATSC-M / H system, digital broadcasting of the DVB-H system (COFDM system) A digital broadcast receiver capable of receiving at least one of a Media Foward Link Only type digital broadcast and the like. It may also be a digital broadcast receiver for cable, satellite communications, or IPTV.

According to the first embodiment of the present invention, by displaying information on the recognized user's operation or the function of the display device corresponding thereto performed by using an indicator on the screen, it is possible to intuitively Feedback can be efficiently delivered to the user, thereby efficiently inducing the control operation of the user and reducing the occurrence of control errors.

6 is a flow chart showing a first embodiment of a method of controlling a display device according to the present invention. The control method shown in Fig. 6 is applied to the configuration of the display device 100 shown in Figs. 1 and 5 .

Referring to FIG. 6, the operation recognition unit 10 recognizes the first operation of the user (step S1), and executes an indicator corresponding to the recognized operation of the user (step S2).

For example, the first operation may be a predetermined operation to start the control of the display device 100 through the operation of the user.

7, when the user 200 is positioned in front of the display device 100, for example, in a specific area in front of the display device 100 recognizable by the motion recognition unit 10, An image indicating the above state can be displayed on the screen.

In addition, when the user 200 performs a first operation for starting the control of the display device 100, for example, a one-handed operation as shown in Fig. 8, The first operation of lifting the hand of the user 200 can be recognized.

Accordingly, the control unit 20 sets the display device 100 in a state that can be controlled by the operation of the user 200 in response to the recognized first operation, and sets the current control state of the display device 100 as The display unit 30 may be controlled so that an indicator 300 for displaying the displayed image is displayed on the screen.

For example, the display unit 30 receives control of the user recognized by the operation recognition unit 10 at the lower end of the screen or information on the function of the display device 100 corresponding thereto under the control of the control unit 20 An indicator 300 may be displayed to indicate the user.

When the operation recognition unit 10 recognizes the second operation of the user (step S3) after the indicator is executed as described above, the display unit 30 displays the indicator corresponding to the recognized second operation or the second operation The function of the display device 100 is displayed (step S4).

Thereafter, the control unit 20 can perform the function of the display device 100 corresponding to the second operation of the user 200. [

The second operation may correspond to any one of a plurality of functions of the display device 100 that can be controlled by a user operation, and may be any one of hand motions as shown in, for example, Figs. 3A to 3D have.

9 to 12 illustrate examples of functions performed in the display device 100 and indicator information displayed on the display unit 30 according to a user's hand gesture.

Referring to FIG. 9, when the user takes a manual operation for collecting the thumb and forefinger of both hands as shown in FIG. 3A, information on a plurality of channels as described above is displayed on the screen of the display device 100 A channel browser for displaying the channel information, and the like, and the indicator 300 can display an icon 301 visually indicating channel information display, which is a function corresponding to the hand operation of the user.

As described above, the function of the display device 100 corresponding to the user's hand operation or the information about the function performed on the current screen is displayed using the indicator 300 and fed back to the user, It is possible to induce the correct hand motion of the user and prevent malfunction of the display device 100 due to erroneous hand movement or recognition.

Referring to FIG. 10, when the user takes a hand motion to open the palm of the hand as shown in FIG. 3B toward the screen of the display device 100 and then move it to the left or right, And the indicator 300 can display an icon 302 visually indicating a channel change function corresponding to the hand operation of the user.

Referring to FIG. 11, when the user takes a manual operation to open the palm of the hand as shown in FIG. 3C toward the screen of the display device 100 and then rotate it, the size of the sound output changed on the screen of the display device 100 is displayed And the indicator 300 may display an icon 303 that visually indicates a voice output size adjustment function corresponding to the hand operation of the user.

Referring to FIG. 12, when a user takes a fist clenching operation of a hand as shown in FIG. 3D, a menu (menu (not shown)) for changing various settings or functions of the display device 100 on the screen of the display device 100 Is activated, and the indicator 300 can display an icon 304 that visually shows a menu execution function corresponding to the hand operation of the user.

On the other hand, when the user 200 selects a search on the menu screen as described above, the display device 100 displays a screen for searching, for example, a keyboard And the indicator 300 may display an icon 305 that visually indicates the search execution.

The indicator 300 may display information on the user's actions corresponding to each of the plurality of functions that can be controlled by the display apparatus 100 and may thereby control the display apparatus 100 The user's hand motion can be easily induced.

Referring to FIG. 14, the indicator 300 may display a preset user's hand gestures as a visual image, and when the user takes a specific gesture, the corresponding image is highlighted, Images can be distinguished from each other, so that the situation that is currently being performed in the display device 100 can be fed back to the user.

Meanwhile, referring to FIG. 15, the indicator 300 may display texts of predetermined hand movements of the user.

In addition, the indicator 300 may display feedback information indicating the recognition result of the user's operation. For example, as shown in FIG. 16, the operation of the user recognized by the operation recognition unit 10 It is possible to indicate whether the corresponding function of the display device 100 exists or not.

More specifically, when there is a function of the display device 100 corresponding to a user's operation, that is, when the user's operation for controlling the display device 100 is correct, the indicator 300 displays a specific color, A red icon 306 may be displayed.

On the contrary, when the function of the display device 100 corresponding to the user's operation does not exist, that is, when the user's operation for controlling the display device 100 is not correct, the indicator 300 displays the color different from the specific color For example, an icon 307 having a blue color.

According to the second embodiment of the present invention, it is possible to give a control permission to control the display device 100 through an operation to a recognized specific user, and to allow the display device 100 to be controlled by a user who does not have the control right It is possible to prevent the display device 100 from malfunctioning due to the daily operation of the user or the like and thus to efficiently control the display device 100. [

17 is a flow chart showing a second embodiment of the control method of the display apparatus according to the present invention. The control method shown in Fig. 17 is applied to the configuration of the display apparatus 100 shown in Figs. 1 and 5 .

Referring to FIG. 17, when the operation recognition unit 10 recognizes the first operation of the first user (S400), the control unit 20 gives the control right to the first user (S410).

The control right is an authority to perform a function of the display apparatus 100 through an operation, and the display apparatus 100 may not be controlled by the operation of another user except for the first user to whom the control right is given.

Meanwhile, the first operation may be a predetermined operation for granting the control as described above. For example, as shown in FIG. 18, when the first user 200 located in front of the display device 100 is connected to one side The user can be given the control right by performing the first operation for lifting the hand.

Accordingly, the control unit 20 gives the control right to the first user 200 corresponding to the first operation of the recognized first user 200, that is, the one-handed operation, The display device 100 can be prevented from being controlled by the operation of other users.

Referring to FIG. 19, when the first user 200 acquires the control right through the first hand-lifting operation as shown in FIG. 18, the second user 210 having no control right moves the display device 100 An icon 306 indicating that the second user 210 currently operating in the indicator 300 can not control the display device 100 due to lack of control may be displayed.

As described above, when the control right is given to a specific user, for example, the first user 200, the control right is locked to the first user 200 before the preset predetermined condition is satisfied .

Accordingly, the second user 210 may not acquire the control right until the control right is recovered from the first user 200 and becomes 'free' according to the satisfaction of the certain condition.

20, when the first user 200 having the control right receives a predetermined time or more from the specific area in front of the display device 100 that can be recognized by the front of the display device 100, for example, If so, control may be retrieved from the first user 200 and placed in a 'free' state.

Meanwhile, the indicator 300 displayed on the screen may display an icon 307 indicating that the current control right is 'free' state not given to any user.

In this case, the second user 210 performs the first operation such as the one-handed operation for acquiring the control right, for example, as described above, Can receive.

Alternatively, if the control right is 'free' as shown in FIG. 20 and only one user, for example, the second user 210, is located in a specific area in front of the display device 100, And may be automatically given to the second user 210.

The condition that the control right granted to the first user 200 as described above is recovered and is in the 'free' state can be variously set.

Referring to FIG. 21, when the first user 200 having the control right maintains a specific operation set to return the control right to the 'free' state, for example, , The control right can be recovered from the first user 200 and become 'free'.

Alternatively, the display device 100 or the like may have a control initialization button. In this case, the first user 200 may be in a 'free' state as described above by pressing the initialization button have.

According to the third embodiment of the present invention, the control right granted to a specific user can be changed or transferred to another user according to a preset condition or operation, and accordingly, a separate device such as a remote controller is not provided A plurality of users can easily control the display device.

22 is a flowchart showing a third embodiment of a method of controlling a display device according to the present invention. The control method shown in Fig. 22 is applied to the configuration of the display device 100 shown in Figs. 1 and 5 .

Referring to FIG. 22, the control unit 100 grants control to a first user among a plurality of users (operation 500). The method of granting the control right in step 500 may be the same as that described with reference to FIGS. 17 to 21, and the following description will be omitted.

Thereafter, the operation recognition unit 10 recognizes the first operation of the second user (step 510), and the control unit 20 receives the control right from the first user corresponding to the recognized first operation of the second user 2 user (step 520).

For example, the first operation may be a preset operation for transferring the control to the display device 100 as described above.

Referring to FIG. 23, when the first user 200 receives the control right and is recovered and is currently in the 'free' state, the second user 210 performs a first operation for transferring the control right, The control right can be changed to the second user 210 through the lifting operation.

Referring to FIG. 24, when the control right is changed to the second user 210 as described above, an icon 308 indicating that the control right has been changed can be displayed using a specific area on the screen, for example, the indicator 300 .

25, when two or more users 210 and 220 among a plurality of users perform a first operation for granting or transferring control, for example, a one-handed operation, the two or more users 210 and 220 may be given control.

For example, the user who satisfies a specific condition among the two or more users 210 and 220 can be given control, and as shown in FIG. 26, among the users 210 and 220 desiring to receive the control right A user closer to the center area in front of the display device 100, i.e., the second user 210 can be given control.

Meanwhile, as described above, the operation of the user set to correspond to the specific function for controlling the display device 100 can be changed.

For example, as shown in FIG. 27, the user may be granted or transferred the control as described above through an operation of unfolding the palm and then moving it closer to the display device 100 or moving it away.

That is, the operations of the user shown in FIGS. 3A to 3D are defined according to the movement of the user's hand on the xy plane among the preset x, y and z axes, and the user for control granting or handing over as shown in FIG. A hand gesture can be defined as moving along the z-axis.

By defining the user's hand gestures as described above, it is possible to reduce the malfunction of the display device 100 due to confusion between the user's hand gestures set to correspond to each of the plurality of functions of the display device 100. [

According to one embodiment of the present invention, the display device 100 can display information on the user with the control right when the control right is given or changed as described with reference to Figs. 17 to 27, Accordingly, it is possible to easily grasp the current control authority.

28 is a flow chart showing a fourth embodiment of a method of controlling a display device according to the present invention. The control method shown in Fig. 28 is applied to the configuration of the display device 100 shown in Figs. 1 and 5 .

Referring to FIG. 18, when the operation recognition unit 10 recognizes the first operation of the first user (S600), the control unit 20 gives the control right to the first user (S610).

The control right is an authority to perform a function of the display apparatus 100 through an operation, and the display apparatus 100 may not be controlled by the operation of another user except for the first user to whom the control right is given.

The first operation may be a predetermined operation for granting the control as described above. For example, as shown in FIG. 29, when the first user 200 located in front of the display device 100 is connected to one side The user can be given the control right by performing the first operation for lifting the hand.

Accordingly, the control unit 20 gives the control right to the first user 200 corresponding to the first operation of the recognized first user 200, that is, the one-handed operation, The display device 100 can be prevented from being controlled by the operation of other users.

Thereafter, the display unit 30 displays information on the first user to which the control right is given (step S620).

The information displayed in step S620 may include a video of the first user to which the control right is granted or a message indicating the current state of the control right.

Referring to FIG. 29, when the control right is given to the first user, a pop-up window 700 including information on the first user to which the control right is given may be displayed on the screen of the display device 100. [

For example, the pop-up window 700 may include a video 710 of the first user to which the control right is given and a message informing that the first user is granted the control right.

The displayed image 710 of the first user may be an image captured from an image acquired by the camera module included in the operation recognition unit 10 to recognize the operation of the user, The current state of the first user can be displayed.

As described above, the display device 100 displays information about the user to which the control right is given by using the pop-up window 700. Accordingly, the user can clearly recognize that the control right is given to the user, Can be reduced.

Referring to FIG. 30, a pop-up window 700 for displaying information on a user to which control is given may display a plurality of images 710 of users located in front of the display device 100.

For example, when the second user 210 among the first to third users 200, 210, and 220 located at the front of the display device 100 obtains control by holding hands, The image 710 including the users 200, 210 and 220 can be displayed in the pop-up window 700 and the second user 200, 210, The image 712 of the user 210 may be displayed to be distinct from the images 711 and 713 of the other first and third users 200 and 220.

Using the image 710 of the users displayed in the pop-up window 700 and the message indicating that the control right has been granted, the users can easily and intuitively recognize that the second user 210 currently in the middle is given the control right have.

On the other hand, even when the control right is changed by the method described with reference to FIGS. 22 to 27, the information on the changed control right can be displayed using the pop-up window 700 as described above.

31, when the control right is changed from the second user 210 to the third user 220, a pop-up window 700 including information on the third user 220 as the changed control owner is displayed on the screen .

For example, when the image 713 of the third user 220 whose control right has been changed among the images 710 of the users included in the pop-up window 700 is displayed on the images 711 of the first and second users 200 and 210 , And 712, and a message indicating that the control right has been changed may be displayed together with the pop-up window 700. [

With the pop-up window 700 as described above, users can easily and intuitively recognize that the control right has been changed to the third user 210 at the rightmost position.

According to another embodiment of the present invention, even when a user who has no control right takes an operation for controlling the display device 100 as described with reference to FIG. 19, a pop-up window containing information on a user having the current control right (700) can be displayed on the screen.

32, when the second user 210 having no control has an operation such as lifting a hand to execute a specific function of the display device 100 in a state where the current control right is present to the third user 220 The second user 210 may display a pop-up window 700 indicating that the user does not have control.

For example, the image 713 of the third user 220 having the current control right among the images 710 of the users included in the pop-up window 700 may be displayed on the first and second users 200 and 210 711, and 712, and a message indicating that the user who is operating for the control of the display device 100 has no control right may be displayed together with the pop-up window 700. [

Accordingly, the second user 210 can easily and intuitively recognize that the control right should be transferred from the third user 220 in order to execute the function of the desired display device 700.

Meanwhile, the method of controlling a display device according to an embodiment of the present invention is not limited to being performed by the above-described display device, and may be applied to a mobile phone, a smart phone, a notebook computer, , A digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation, and the like.

In addition, the control method according to the present invention may be stored in a computer-readable recording medium. The computer-readable recording medium may be a ROM, a RAM, a CD-ROM , A magnetic tape, a floppy disk, and an optical data storage device.

The computer readable recording medium may be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And, functional programs, codes and code segments for implementing the control method can be easily inferred by programmers of the technical field to which the present invention belongs.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (12)

A method of controlling a display device by recognizing an operation of a user,
Recognizing a first action of the user;
In response to the recognized first operation, granting the user the control right to perform the function of the display device through the operation; And
And displaying information on the user who is given the control right,
The step of displaying information about the user
Displaying a plurality of user images corresponding to each of a plurality of users located in front of the display device,
A user image corresponding to a user who has obtained the control right among the plurality of user images and user images corresponding to remaining users who have not obtained the control right are distinguished from each other,
The display device control method includes:
Further comprising the step of recognizing the operation of the user and displaying an indicator for guiding the hand operation,
The indicator
A plurality of hand motion images corresponding to a plurality of hand movements and a plurality of texts describing a function of the display device corresponding to each of the plurality of hand movements,
The display device control method includes:
Displaying a screen on which the function of the display corresponding to the recognized hand operation is executed when any one of the hand operations of the plurality of hand operations is recognized;
Further comprising changing the indicator to an icon representing a function of the display corresponding to a recognized hand action
A method of controlling a display device. The display device according to claim 1, wherein the display device
Wherein the control information is not controlled by an operation of another user other than the user to which the control right is given. 2. The method according to claim 1,
And when the control right is given or changed. 2. The method according to claim 1,
Wherein the control is performed when a user other than the user to whom the control right is given takes an action to perform the function of the display device. delete 2. The method according to claim 1,
And displaying a message indicating a current state of the control right. delete A display device capable of recognizing and controlling a user's operation,
An operation recognizing unit recognizing an operation performed by a user;
A control unit for giving a control right to perform the function of the display device through an operation to the user corresponding to the first operation of the recognized user using the operation recognition unit; And
And a display unit for displaying an image of a user to whom the control right is given,
The control unit
Displaying a plurality of user images corresponding to each of a plurality of users located in front of the display device,
A user image corresponding to a user who has obtained the control right among the plurality of user images and user images corresponding to remaining users who have not obtained the control right are distinguished from each other,
The control unit
An indicator for recognizing the operation of the first user and guiding the hand operation,
The indicator
A plurality of hand motion images corresponding to a plurality of hand movements and a plurality of texts describing a function of the display device corresponding to each of the plurality of hand movements,
The control unit
When a hand operation of any one of the plurality of hand operations is recognized, displays a screen on which the function of the display corresponding to the recognized hand operation is executed,
The indicator is changed to an icon representing the function of the display corresponding to the recognized hand operation
Display device. delete delete 9. The method of claim 8,
Wherein the image of the user to which the control right is given is obtained using a camera provided in the operation recognition unit. A computer-readable recording medium storing a program for causing a computer to execute the method according to any one of claims 1 to 4.

Images