KR20120028016A - Display apparatus and controlling method thereof - Google Patents

Abstract

PURPOSE: A display device and a control method thereof are provided to rapidly modify unintended operation and to cancel the executed function by the operation of a user. CONSTITUTION: An operation of a user is recognized(S500). A function corresponding to a first operation is executed(S510). If a second operation of the user is recognized, a prior state function is executed is restored(S520, S530). The information about the prior state function is stored. The stored information is displayed according to the second operation of the user.

Description

Display apparatus and control method thereof

The present invention relates to a method of controlling the operation of a display device.

Recently, a digital television receiver provides various functions such as reception of an electronic program guide (EPG), a bidirectional communication function, and an internet access function, in addition to a broadcast reception function of analog or digital broadcasting. In addition, the digital broadcast receiving apparatus can be responsible for the function of the server in the home network environment or ubiquitous environment (ubiquitous) environment.

As a display device such as the digital broadcast receiving device can perform many of these functions, there are many and complicated items to be controlled by the user. Therefore, the conventional infrared communication remote control cannot efficiently control such complex functions, and there is a problem that the user must always carry the remote control to control the function.

An object of the present invention is to provide a method for efficiently controlling a display device.

In accordance with another aspect of the present invention, a display device control method includes: recognizing a user's motion; Executing a function corresponding to the first operation; And if the second operation of the user is recognized, returning to a state before the function is executed.

A display apparatus according to an embodiment of the present invention, the motion recognition unit for recognizing the operation performed by the user; And a controller configured to execute a function corresponding to the first operation of the user, and when the second operation of the user is recognized, the controller returns the display device to a state before the function is executed.

Meanwhile, the control method of the display apparatus may be implemented as a computer-readable recording medium that records a program to be executed in a computer.

According to an exemplary embodiment of the present invention, the user's convenience may be improved by recognizing the operation of the display user and performing a function corresponding thereto without using a separate device such as a conventional remote controller.

In addition, by canceling a function executed by a user's operation and allowing the display device to return to a state before executing the function, an unintended operation of the display device due to a motion recognition error or a user's control error can be easily and quickly performed. It can be modified to improve the user's convenience for controlling the display device.

1 is a block diagram showing a simplified configuration of a display device according to an embodiment of the present invention.
2 is a diagram for describing a method of controlling a display apparatus by recognizing a user's motion.
3 is a diagram illustrating an embodiment of a method of displaying broadcast channel information.
4 is a block diagram illustrating a configuration of a display apparatus according to another embodiment of the present invention.
5 is a flowchart illustrating a first embodiment of a control method of a display apparatus according to the present invention.
6 to 12 are diagrams illustrating embodiments of a method of displaying a user's operation or a function of a display apparatus corresponding thereto.
13 is a flowchart illustrating a second embodiment of a control method of a display apparatus according to the present invention.
14 and 15 illustrate embodiments of a method of granting a control right to the display apparatus to a specific user.
16 is a flowchart illustrating a third embodiment of a control method of a display apparatus according to the present invention.
17 to 19 are diagrams illustrating an embodiment of a method of canceling a function executed by a user's operation and returning to a state before execution of the function.
20 to 24 are diagrams illustrating still other embodiments of a method of returning to a state before execution of a function.

Hereinafter, a display apparatus and a control method thereof according to an exemplary embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a simplified configuration of a display apparatus according to an exemplary embodiment of the present invention. The illustrated display apparatus may include an operation recognition unit 10, a controller 20, and a display unit 30.

For example, the display apparatus 100 according to an exemplary embodiment of the present invention uses real-time broadcasting, contents on demand (COD), games, news, video communication, etc. using an internet network connected to each home, in addition to the existing radio wave media. It may be a digital broadcasting receiver (Digital Television) that can provide various types of content services to the user.

An example of providing a content service using the Internet network may be an Internet Protocol TV (IPTV). The IPTV refers to transmitting a variety of information services, moving picture content and broadcasting to a user's television using a high-speed Internet network.

In addition, the display apparatus 100 may be a network TV, which is one step further from the IPTV, and may be a broadband TV or a web TV. Unlike the IPTV, the broadband TV or the web TV has a plurality of content providers. In addition, the user may individually access a plurality of content providers and receive various VODs, games, and the like provided by the content providers.

Referring to FIG. 1, the motion recognition unit 10 recognizes physical information of a user's motion, for example, a user's face, hands, and legs, and includes a camera module for capturing an image of the user. can do.

For example, the motion recognition unit 10 may include a camera module 11 attached to an upper end of the display apparatus 100, as illustrated in FIG. 2, to operate the user 200 using the camera module 11. Can be recognized.

For example, the motion recognition unit 10 may include various devices capable of capturing an image, such as a digital camera, a CMOS camera, a Charged Coupled Device (CCD) camera, or various sensor devices capable of detecting a subject.

According to an embodiment of the present invention, the camera module provided in the motion recognition unit 10 may capture an image related to the gesture of the hand such as the shape of the user's hand, the motion, and recognize the user's hand motion. .

For example, the motion recognition unit 10 may classify the user's hand region from the photographed user's image, and extract the user's hand region by distinguishing the color of the user's hand and the background color other than the hand. .

In addition, the motion recognition unit 10 may recognize the user's hand motion, for example, the shape or movement of the hand, by using the user's hand region extracted as described above.

More specifically, the gesture recognition unit 10 may express the movement of the user's hand as a coordinate or a vector on x, y, and z axes.

The controller 20 may perform a function of the display apparatus 100 corresponding to the user's operation recognized by the motion recognition unit 10, for example, the user's hand gesture.

For that purpose, a plurality of user operations may correspond to a plurality of functions of the display apparatus 100 which can be performed by the user's operation, and information about the corresponding functions, for example, the function and the user's hand gesture corresponding thereto, may be applied. Information may be stored in a storage unit (not shown).

The controller 20 compares the hand gesture information of the user input from the gesture recognition unit 10 with the information stored in the storage unit (not shown), and if there is a matched hand gesture information, the function of the display apparatus 100 corresponding thereto. Can be performed.

For example, when the user 200 takes a hand gesture in which a thumb and an index finger of both hands are held together, the user's hand gesture may correspond to a specific function of the display apparatus 100, for example, a channel information display function. Can be.

That is, when the user 200 takes the hand gesture as described above, the motion recognition unit 10 recognizes the shape of the hand gesture of the user and outputs information about the hand gesture to the control unit 20, and the control unit 20 controls the control unit 20. A function corresponding to the input information, that is, a broadcast channel information display function may be performed.

FIG. 3 illustrates an embodiment of a method for displaying broadcast channel information, and corresponds to a plurality of broadcast channels that can be received on the screen 10 of the display apparatus 100, that is, each of the first to twelfth channels. Information can be displayed.

The displayed broadcast channel information may include a name of a broadcasting station, a channel number of a corresponding channel, a name or content of content broadcasted at a current or specific time zone in the channel, in the form of a text or an image.

According to an embodiment of the present invention, the information on the plurality of broadcast channels displayed on the screen of the display apparatus 100 may include an image corresponding to an image of each broadcast channel, more specifically, a thumbnail image or a movie clip. It may be provided as a channel browser (channel browser) including the.

The user may select any one of the information on the broadcast channels displayed on the screen as described above, so that the content of the desired channel can be played.

In addition, when the user 200 takes a hand gesture to open a palm and moves it to the left or right, the hand gesture of the user may correspond to a specific function of the display apparatus 100, for example, a channel change.

For example, when the user 200 extends the palm toward the display apparatus 100 and moves the palm to the right, the number of the channel may increase, and if the user 200 moves to the left, the number of the channel may decrease.

On the other hand, when the user 200 takes a hand gesture to open and rotate the palm, the user's hand gesture may correspond to a specific function of the display apparatus 100, for example, adjusting the volume of the voice output.

For example, when the user 200 extends the palm toward the display apparatus 100 and rotates the palm in the clockwise direction, the volume of the voice output increases, and when the user 200 moves the counterclockwise, the volume of the voice output decreases. .

In addition, when the user 200 takes a fist-shaped hand gesture, the user's hand gesture may correspond to a specific function of the display apparatus 100, for example, a menu selection function.

In addition to the above-described operation, the controller 20 controls the overall operation of the display apparatus 100 and, for example, controls the display 30 to display an image corresponding to a broadcast channel or various contents selected by a user. can do.

A detailed description of the configuration and operation of the control unit 20 and the display unit 30 will be described in detail with reference to FIG. 4.

4 is a block diagram illustrating a configuration of a display apparatus according to another exemplary embodiment of the present invention.

Referring to FIG. 4, the display apparatus 100 includes a first tuner 120, a second tuner 125, an external signal input unit 128, a first demodulator 130, a second demodulator 135, and an analog. The digital converter 140 may include an interface unit 150, a controller 20, a channel browsing processor 170, a storage unit 175, a display unit 30, and an audio output unit 185.

The first tuner 120 selects an RF broadcast signal corresponding to a channel selected by a user among RF (Radio Frequency) broadcast signals received through an antenna, and converts the selected RF broadcast signal into an intermediate frequency signal or a baseband video / audio signal. Convert to

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal DIF1, and if it is an analog broadcast signal, it is converted into an analog baseband video / audio signal CVBS 1 / SIF. That is, the first tuner 120 may be a hybrid tuner capable of processing digital broadcast signals and analog broadcast signals. The analog baseband video / audio signal CVBS 1 / SIF output from the first tuner 120 may be directly input to the controller 20.

In addition, the first tuner 120 may receive an RF broadcast signal of a single carrier according to an Advanced Television Systems Committee (ATSC) scheme or an RF broadcast signal of multiple carriers according to a digital video broadcasting (DVB) scheme.

Similar to the first tuner 120, the second tuner 125 selects an RF broadcast signal corresponding to a channel selected by a user from a radio frequency (RF) broadcast signal received through an antenna, and selects the selected RF broadcast signal. Converts to an intermediate frequency signal or baseband video / audio signal.

Meanwhile, the second tuner 125 sequentially and periodically selects corresponding RF broadcast signals of all stored broadcast channels through the channel memory function among the RF broadcast signals received through the antenna in the present invention, and the intermediate frequency signal or It is also possible to convert baseband video / audio signals. According to an embodiment of the present invention, since images of other pre-stored channels are also shown in thumbnail form on at least part of the screen, it is possible to sequentially / periodically receive RF broadcast signals of all pre-stored channels.

For example, the first tuner 120 converts a main RF broadcast signal selected by a user into an intermediate frequency signal or a baseband video / audio signal, and the second tuner 125 performs all RF broadcasts except for the main RF broadcast signal. It is possible to select a signal (sub RF broadcast signal) or all RF broadcast signals sequentially / periodically and convert them into an intermediate frequency signal or a baseband video / audio signal.

The first demodulator 130 receives the digital IF signal DIF 1 converted by the first tuner 120 and performs a demodulation operation.

For example, when the digital IF signal DIF 1 output from the first tuner 120 is an ATSC scheme, the first demodulator 130 performs 8-VSB (8-Vestigal Side Band) demodulation. In addition, the first demodulator 130 may perform channel decoding.

To this end, the first demodulator 130 includes a trellis decoder, a de-interleaver, a reed solomon decoder, and the like. de-interleaving) and read solo decoding.

For example, when the digital IF signal DIF 1 output from the first tuner 120 is a DVB scheme, the first demodulator 130 performs coded orthogonal frequency division modulation (COFDMA) demodulation. In addition, the first demodulator 130 may perform channel decoding.

To this end, the first demodulator 130 may include a convolution decoder, a deinterleaver, a reed-soloman decoder, and the like to perform convolutional decoding, deinterleaving, and reed-soloman decoding.

The external signal input unit 128 performs signal input with an external device. To this end, the external signal input unit 128 may include an A / V input / output unit and a wireless communication unit.

The external signal input unit 128 is connected to an external device such as a digital versatile disk (DVD), a Blu-ray (Blu ray), a game device, a camcorder, a computer (laptop), and the like to input an external input video signal, an external input audio signal, and an external input data. The signal is transmitted to the controller 20 in the display apparatus 100. In addition, the video signal, the audio signal, and the data signal processed in the controller 20 may be output to another external device.

The A / V input / output section is for inputting / outputting video / audio signals to / from external devices, including Ethernet, USB, Composite Video Banking Sync (CVBS), Component, and S-Video (analog). It may include a DVI (Digital Visual Interface) terminal, HDMI (High Definition Multimedia Interface) terminal, RGB terminal, D-SUB terminal, IEEE 1394 terminal, SPDIF terminal, Liquid (HD) terminal.

Although not shown in the drawing, various input signals input through the external signal input unit 128 may be input to the channel browsing processor 170 to be described later to perform thumbnail image extraction processing.

For example, as described above, the analog signal input through the CVBS terminal and the S-video terminal may be converted into a digital signal and then input to the channel browsing processor 170. Digital signals input through other input terminals may be directly input to the channel browsing processor 170 without analog / digital conversion.

Here, the digital signal output from the external signal input unit 128 may be a stream signal. For example, the MPEG-2 TS multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like. (Transprt Stream).

The wireless communication unit may perform a wireless internet connection. For example, for wireless Internet access, a wireless local area network (WLAN) (Wi-Fi), a wireless broadband (Wibro), a world interoperability for microwave access (Wimax), a high speed downlink packet access (HSDPA), or the like may be used. .

In addition, the wireless communication unit may perform near field communication with other electronic devices. For example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.

Meanwhile, the external signal input unit 128 may be connected through at least one of the various set top boxes and the various terminals described above, and perform input / output operations with the set top box.

For example, if the set-top box is a set-top box for an IP (internet protocol) TV, video, audio, and data signals processed by the set-top box for IPTV may be transmitted to the controller 20 to enable bidirectional communication. Signals processed by the control unit 20 may be transferred to the set-top box for IPTV.

Meanwhile, the video, audio, and data signals processed by the IPTV set-top box may be processed by the controller 20 via the channel browsing processor 170.

Meanwhile, the above-described IPTV may mean ADSL-TV, VDSL-TV, FTTH-TV, etc. according to the type of transmission network, and include TV over DSL, Video over DSL, TV overIP (TVIP), and Broadband TV (BTV). ) And the like. In addition, IPTV may also mean an Internet TV capable of accessing the Internet, or a full browsing TV.

The first demodulator 130 may perform demodulation and channel decoding and output a stream signal TS 1. In this case, the stream signal TS 1 may be a signal multiplexed with a video signal, an audio signal, and a data signal. For example, the stream signal TS 1 may be an MPEG-2 TS (Transprt Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like. In more detail, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The stream signal TS1 is input to the controller 20 to perform demultiplexing and signal processing. In the embodiment of the present invention, before input to the control unit 20, it is input to the channel browsing processing unit 170 to perform a process for channel browsing. Channel browsing operations will be described later.

Meanwhile, the above-described first demodulator 130 may be provided separately according to the ATSC method and the DVB method. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The second demodulator 135 receives the digital IF signal DIF 2 converted by the second tuner 125 to perform a demodulation operation, and outputs a stream signal TS 2. The operation of the second demodulator 135 is omitted with reference to the operation of the first demodulator 130.

On the other hand, when the signal output from the second tuner 125 is an analog baseband video signal CVBS 2, it is necessary to convert the analog / digital converter 140 into a digital signal.

The analog / digital converter 140 converts the input analog signal into a digital signal. When the input signal is an image signal, sampling and quantization may be performed and converted into a digital image signal DV. The converted digital signal may be an uncoded signal. The converted digital image signal DV is input to the channel browsing processor 170 and processed.

The interface unit 150 transmits an input signal from the user to the controller 20 or transmits a signal from the controller 20 to the user. For example, the interface unit 150 may be configured such as power on / off, channel selection, screen setting, etc. from the remote control apparatus 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method. The user input signal may be received or a signal from the controller 20 may be transmitted to the remote controller 200.

According to an embodiment of the present invention, the interface unit 150 may include a motion recognition unit 10 as described with reference to FIGS. 1 to 3, and thus recognizes the user's motion and Information may be output to the controller 20.

The controller 20 may demultiplex the input stream and signal-process the demultiplexed signals to generate and output signals for video and audio output. In addition, the overall operation of the display apparatus 100 may be controlled.

Although not shown in the drawing, the controller 20 may include a demultiplexer, an image processor, a voice processor, and a user input signal processor.

The controller 20 may demultiplex an input stream signal, for example, an MPEG-2 TS, and divide the input stream signal into a video signal, an audio signal, and a data signal, respectively.

In addition, the controller 20 may perform image processing of the demultiplexed image signal. For example, when the demultiplexed video signal is an encoded video signal, it may be decoded. Specifically, when the demultiplexed video signal is an encoded video signal of MPEG-2 standard, it may be decoded by an MPEG-2 decoder. In addition, when the demultiplexed video signal is a video signal of the H.264 standard according to the Digital Multimedia Broadcasting (DMB) scheme or DVB-H, it may be decoded by the H.264 decoder.

In addition, the controller 20 may process brightness, tint, and color adjustment of the image signal.

The image signal processed by the controller 20 is input to the display unit 30 to be displayed. It is also possible to input to an external output terminal connected to the external output device.

In addition, the controller 20 may perform voice processing of the demultiplexed voice signal. For example, if the demultiplexed speech signal is a coded speech signal, it can be decoded. Specifically, when the demultiplexed speech signal is an encoded speech signal of MPEG-2 standard, it may be decoded by an MPEG-2 decoder.

In addition, when the demultiplexed speech signal is an encoded speech signal of MPEG 4 Bit Sliced Arithmetic Coding (BSAC) standard according to the terrestrial digital multimedia broadcasting (DMB) scheme, it may be decoded by an MPEG 4 decoder. In addition, when the demultiplexed speech signal is an encoded audio signal of the AAC (Advanced Audio Codec) standard of MPEG 2 according to the satellite DMB scheme or DVB-H, it may be decoded by the AAC decoder.

In addition, the controller 20 may process a base, treble, volume control, and the like.

The voice signal processed by the controller 20 is input to the voice output unit 185, for example, a speaker, and outputs voice. It is also possible to input to an external output terminal connected to the external output device.

In addition, the controller 20 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be EPG (Electronic Progtam Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted in each channel.

For example, the EPG information may be TSC-PSIP (ATSC-Program and System Information Protocol) information in the ATSC scheme, and may include DVB-Service Information (DVB-SI) in the DVB scheme. The ATSC-PSIP information or the DVB-SI information may be information included in the aforementioned stream, that is, the header (4 bytes) of the MPEG-2 TS.

In addition, the controller 20 may perform an on screen display (OSD) process. In detail, the controller 20 may display various types of information on the screen of the display unit 30 based on at least one of an image signal, a data signal, and a user input signal from the remote controller 200. It can generate a signal for displaying a graphic or text. The generated signal may be input to the display unit 30 together with the image processed image signal and the data processed data signal.

The signal generated for the graphic or text display may include various data such as a user interface screen, various menu screens, widgets, and icons of the display apparatus 100.

The channel browsing processor 170 may perform a browsing process on at least one of a broadcast signal corresponding to a received channel and various input image signals input through the external signal input unit 128.

In detail, the demodulation unit 130 or 135 receives the demodulated and channel decoded stream signal TS 1 or TS 2, receives the stream signal from the external input signal input unit 128, or receives an analog / digital converter ( An image signal including the digital signal DV converted in operation 140, demultiplexing the stream signal TS 1 or TS 2, extracting some of the demultiplexed image signals, and including the extracted image signal The new stream signal TSa may be output by multiplexing on the basis of. For example, the stream signal TSa or TSb may be MPEG 2 TS.

In addition, the channel browsing processor 170 may output the main stream signal TSb corresponding to the main video signal displayed in the main area among the video signals displayed on the display 30 without any additional processing. The sub stream signal TSa corresponding to the sub video signal displayed in the sub region among the video signals displayed at 30 may be output by performing channel browsing processing as described above.

In the exemplary embodiment of the present invention, when the channel list is displayed on the display unit 30 by extracting a partial image of the broadcast signal of the plurality of channels through the channel browsing processor 170 and re-coding the stream in the form of a stream, the broadcast signal of the multiple channel is displayed. At least a part of the image may be displayed on a screen in the form of a thumbnail. Accordingly, the user can intuitively know the contents broadcast in the other channel.

The channel browsing processing unit 170 extracts some images of various external input images input through the external signal input unit 128 and re-encodes them in a stream form to display the external input list on the display unit 30. At least a part of the external input image from the external input device may be displayed on the screen in the form of a thumbnail. Accordingly, the user can intuitively know the content input from the external input device.

Meanwhile, the channel browsing processor 170 extracts the broadcast signal image of the above-described channel and the partial image of the above-described external input image and re-encodes them in a stream form to display the channel list and the external input list on the display unit 30. In this case, at least a part of a broadcast signal image of a plurality of channels and an external input image from a plurality of external input devices may be displayed on a screen in a thumbnail form.

Accordingly, the user can intuitively know the contents input from the plurality of channels and the external input device.

The storage unit 175 may store a program for processing and controlling each signal in the controller 20, or may store a signal processed video signal, an audio signal, and a data signal.

In addition, the storage unit 175 may perform a function for temporarily storing an image, audio, or data signal input from the external signal input unit 128.

Meanwhile, the storage unit 175 may store a corresponding broadcast channel through a channel memory function, and for this purpose, a flash memory type, a hard disk type, and a multimedia card micro type may be used. type), a card type memory (eg, SD or XD memory, etc.), a RAM, or a ROM (EEPROM, etc.) of at least one type of storage medium.

In the drawing, the storage unit 175 is illustrated as being provided separately from the control unit 20, but is not limited thereto. The storage unit 175 may be included in the control unit 20.

Meanwhile, the display apparatus 100 may provide a user with a file (video file, still image file, music file, document file, etc.) stored in the storage unit 175.

The display unit 30 converts an image signal, a data signal, an OSD signal, or an image signal, data signal, etc., received from the external signal input unit 128, processed by the controller 20 into R, G, and B signals, respectively. Create

The display unit 30 may be implemented in various forms such as a PDP, an LCD, an OLED, a flexible display, a 3D display, and the like. In addition, the display unit 30 may be configured as a touch screen and used as an input device in addition to the output device.

The voice output unit 185 receives a signal processed by the controller 20, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs a voice signal. The voice output unit 185 may be implemented by various types of speakers.

In FIG. 4, the display apparatus 100 includes two tuners 120 and 125, but the present invention is not limited thereto and may include one or three tuners.

The above-described display apparatus 100 is a fixed type and includes at least one of ATSC (8-VSB) digital broadcasting, DVB-T (COFDM) digital broadcasting, ISDB-T (BST-OFDM) digital broadcasting, and the like. It may be a digital broadcast receiver capable of receiving one, and is also mobile, terrestrial DMB digital broadcasting, satellite DMB digital broadcasting, ATSC-M / H digital broadcasting, DVB-H digital broadcasting (COFDM), It may be a digital broadcast receiver capable of receiving at least one of media broadcasting (Media Foward Link Only) type digital broadcasting. It may also be a digital broadcast receiver for cable, satellite communications, or IPTV.

According to the first embodiment of the present invention, by displaying information on the recognized user's operation or the function of the display device performed correspondingly by using an indicator on the screen, it is intuitive to the function currently performed on the display device. In-feedback can be efficiently delivered to the user, thereby efficiently inducing the user's control actions and reducing the occurrence of control errors.

5 is a flowchart illustrating a first embodiment of a control method of a display apparatus according to the present invention. The control method illustrated in FIG. 6 is combined with the configuration of the display apparatus 100 illustrated in FIGS. 1 and 4. Let's explain.

Referring to FIG. 5, the operation recognition unit 10 recognizes a first operation of a user (step S1), and executes an indicator in response to the recognized first operation of the user (step S2).

For example, the first operation may be a preset operation for starting the control of the display apparatus 100 through a user's operation.

Referring to FIG. 6, when the user 200 is located in front of the display apparatus 100, for example, in a specific area in front of the display apparatus 100 recognizable by the motion recognition unit 10, the display apparatus 100 may be used. In the power standby state, an image indicating the state may be displayed on the screen.

In addition, when the user 200 performs a first operation for starting the control of the display apparatus 100, for example, lifting one hand as shown in FIG. 7A, the operation recognition unit 10 may be configured to perform the operation. The first operation of lifting the hand of 200 may be recognized.

Accordingly, the controller 20 sets the display apparatus 100 to a state in which the display apparatus 100 can be controlled by the operation of the user 200 in response to the recognized first operation, and sets the current control state of the display apparatus 100. The display unit 30 may be controlled to display the indicator 300 for display on the screen.

For example, the display unit 30 is controlled by the controller 20, and information about a user's operation recognized by the motion recognition unit 10 at the bottom of the screen or a function of the display apparatus 100 corresponding thereto. An indicator 300 may be displayed to indicate.

After the indicator is executed as described above, when the motion recognition unit 10 recognizes the user's second operation (step S3), the display unit 30 corresponds to the recognized second operation or the second operation on the indicator. The function of the display apparatus 100 is displayed (S4 step).

Thereafter, the controller 20 may perform a function of the display apparatus 100 corresponding to the second operation of the user 200.

The second operation may correspond to any one of a plurality of functions of the display apparatus 100 which can be controlled by a user operation.

Meanwhile, the position or method of displaying the indicator 300 as described above may be changeable.

For example, as illustrated in FIG. 7B, the indicator 300 may be displayed as a sub-screen in the screen of the display apparatus 100.

8 to 12 illustrate embodiments of functions performed by the display apparatus 100 and indicator information displayed on the display unit 30 according to a user's hand gesture.

Referring to FIG. 8, when a user performs a hand gesture of gathering the thumb and the index finger of both hands, a channel browser or the like for displaying information on the plurality of channels as described above is displayed on the screen of the display apparatus 100. In addition, the indicator 300 may display an icon 301 that visually displays a channel information display, which is a function corresponding to the user's hand gesture.

As described above, information on the function of the display apparatus 100 corresponding to the user's hand gesture or the function performed on the current screen is displayed using the indicator 300 and fed back to the user, thereby controlling the display apparatus 100. It is possible to induce a correct hand gesture of the user and to prevent a malfunction of the display apparatus 100 due to an incorrect hand gesture or recognition.

Referring to FIG. 9, when the user takes a hand gesture of spreading a palm toward the screen of the display apparatus 100 and then moving it to the left or right, an image of a channel that is changed on the screen of the display apparatus 100 is displayed and an indicator ( 300 may display an icon 302 that visually indicates a channel change, which is a function corresponding to the hand gesture of the user.

Referring to FIG. 10, when the user takes a hand gesture of spreading a palm toward the screen of the display apparatus 100 and rotating the palm, the changed voice output size is displayed on the screen of the display apparatus 100, and the indicator 300 is displayed. May display an icon 303 that visually indicates the size of the voice output, which is a function corresponding to the user's hand gesture.

Referring to FIG. 11, when a user takes a fist fist, a menu for changing various settings or functions of the display apparatus 100 is activated on the screen of the display apparatus 100, and an indicator is activated. 300 may display an icon 304 that visually indicates menu execution, a function corresponding to a user's hand gesture.

On the other hand, when the user 200 selects a search on the menu screen as described above, as shown in FIG. 12, the display apparatus 100 displays a screen for searching, for example, a keyboard for inputting a search word. The image may be displayed, and the indicator 300 may display an icon 305 that visually indicates the search execution.

In addition, the indicator 300 as described above may display information on the user's actions corresponding to each of the plurality of controllable functions of the display apparatus 100, thereby controlling the display apparatus 100. The user's hand gestures can be easily induced.

Meanwhile, the indicator 300 may display the user's hand gestures as a visual image. When the user makes a specific hand gesture, the indicator 300 may distinguish the image from other images by using a method such as highlighting. As a result, a situation currently performed in the display apparatus 100 may be fed back to the user.

In addition, the indicator 300 may display preset user's hand gestures in text and may display feedback information indicating a recognition result of the user's motion.

For example, when there is a function of the display apparatus 100 corresponding to the user's operation, that is, when the user's operation for controlling the display apparatus 100 is correct, the indicator 300 has a specific color, for example. An icon with a red color can be displayed.

On the contrary, when the function of the display apparatus 100 corresponding to the operation of the user does not exist, that is, when the user's operation for the control of the display apparatus 100 is not correct, the indicator 300 is different from the specific color. For example, an icon having a blue color may be displayed.

According to the second exemplary embodiment of the present invention, a control right for controlling the display apparatus 100 is granted to a recognized specific user, and the display apparatus 100 is not controlled by a user who does not have the control right. By doing so, the display apparatus 100 may be prevented from malfunctioning due to a user's daily operation or the like, and the display apparatus 100 may be efficiently controlled.

FIG. 13 is a flowchart illustrating a second embodiment of a control method of a display apparatus according to the present invention. The control method illustrated in FIG. 13 is combined with the configuration of the display apparatus 100 illustrated in FIGS. 1 and 4. Let's explain.

Referring to FIG. 13, when the motion recognition unit 10 recognizes a first operation of a first user (step S400), the controller 20 grants a control right to the first user (step S410).

The control right is a right to perform a function of the display apparatus 100 through an operation, and the display apparatus 100 may not be controlled by an operation of another user except the first user to which the control right is granted.

Meanwhile, the first operation may be a preset operation for granting the control right as described above. For example, as illustrated in FIG. 14, the first user 200 located in front of the display apparatus 100 may have one side. Control may be granted by performing the first operation of lifting a hand.

Accordingly, the controller 20 grants the control right to the first user 200 in response to the recognized first operation of the first user 200, that is, to lift one hand, and the first user 200. The display device 100 may not be controlled by the operation of other users except for.

Referring to FIG. 15, when the first user 200 acquires the control right through the first operation of lifting a hand as shown in FIG. 14, the second user 210 without the control right may control the display apparatus 100. When the control operation is performed, an icon 306 indicating that the second user 210 currently operating in the indicator 300 does not have a control right and thus cannot control the display apparatus 100 may be displayed.

As described above, when the control right is granted to a specific user, for example, the first user 200, the control right is locked to the first user 200 before the predetermined predetermined condition is satisfied. Can be.

Accordingly, as the predetermined condition is satisfied, the second user 210 may not acquire the control right until the control right is recovered from the first user 200 and becomes 'free'.

On the other hand, when the first user 200 having the control right deviates from the front of the display device 100, for example, the specific region in front of the display device 100 that can be recognized by the motion recognition unit 10 for a predetermined time or more, The control right may be recovered from the first user 200 and be in a 'free' state.

Meanwhile, the indicator 300 displayed on the screen may display an icon indicating that the current control right is 'free', which is not granted to any user.

In this case, the second user 210 grants the control right that is currently in a 'free' state by performing an operation for acquiring the control right, for example, lifting the one hand as described above. I can receive it.

Alternatively, when the control right is in a 'free' state and only one user, for example, the second user 210 is located in a specific area in front of the display apparatus 100, the control right is the second user 210. May be automatically assigned to the.

The condition under which the control right granted to the first user 200 as described above is recovered and in the 'free' state can be variously set.

In addition, when the first user 200 having the control right maintains a specific motion set to return the control right to a 'free' state, for example, a control lowering motion for a predetermined time or more, the control right is removed. 1 may be recovered from the user 200 and become a 'free' state.

The display apparatus 100 may include a control right initialization button. In this case, the control right may be 'free' as described above by the first user 200 pressing the initialization button.

In addition, the control right granted to a specific user as described above may be changed or transferred to another user by a preset condition or operation, and thus a plurality of users may easily display the device without having a separate device such as a remote controller. Can be controlled.

According to an embodiment of the present invention, as described above, the display apparatus 100 recognizes the user's motion and executes the function corresponding to the recognized motion, and then cancels the executed function by the preset user's motion. And quickly return to the state before execution of the function.

FIG. 16 is a flowchart illustrating a third embodiment of a control method of a display apparatus according to the present invention. The illustrated control method will be described with reference to the configuration of the display apparatus 100 shown in FIGS. 1 and 4. Shall be.

Referring to FIG. 16, when the gesture recognition unit 10 of the display apparatus 100 recognizes a user's operation and the recognized operation corresponds to a first operation corresponding to a specific function (step S500), the controller 20 In operation S510, a function corresponding to the recognized first operation of the user is executed.

For example, as illustrated in FIG. 17, the user may take an action corresponding to the “run menu” function, ie, lift one hand and clench a fist while watching a broadcast of “Ch 9”.

Accordingly, as illustrated in FIG. 18, a "menu execution" function corresponding to the first operation taken by the user, that is, the fist-clamping operation, may be executed.

Meanwhile, the first operation may be various operations corresponding to each of the plurality of functions of the display apparatus 100 as described with reference to FIGS. 1 to 12.

Thereafter, when the motion recognition unit 10 recognizes the user's second motion (step S520), the controller 20 returns the display apparatus 100 to a state before the function is executed (step S530).

The second operation of the user may be a preset operation for returning the display apparatus 100 to a state before executing the function, and the controller 20 cancels the executed function as the user takes the set second operation. The display apparatus 100 may be returned to a state before the function is executed.

Referring to FIG. 19, when the user takes the second preset operation "raising both hands" in order to return the display apparatus 100 to the state before the function execution, the control unit 20 executes the "execution of the menu" previously executed. The function may be canceled and the display apparatus 100 may be returned to a state before the execution of the “menu execution” function.

Accordingly, the interface for "menu execution" disappears on the screen of the display apparatus 100, and may return to a state in which the broadcast of "Ch 9" before the execution of the "menu execution" function is reproduced.

On the other hand, when the user takes a second operation for returning the display apparatus 100 to a state before executing the function, for example, "raising both hands," the display apparatus 100 returns to the state before executing the function. At the same time, the indicator 300 may display an icon 307 indicating the cancellation of the executed function.

According to another embodiment of the present invention, as described above, as the user takes the second operation for returning the display apparatus 100 to a state before executing the function, the display apparatus 100 immediately before the function is canceled. In addition to the state of, it can be returned to a state earlier than that.

20-24 illustrate further embodiments of a method of returning to a state prior to execution of a function.

Referring to FIG. 20, when a user takes a preset second operation, for example, “raising both hands,” the states of the display apparatus 100 before the current time point may be displayed. 620 and 630.

For example, the storage unit 175 of the display apparatus 100 may store history information on states changed by the user's control, and the state change history information of the display apparatus 100 may be previously executed. Information on the plurality of functions that have been used and information on the plurality of screens changed as the functions are executed may be stored.

Using the history information stored in the storage unit 175, the display apparatus 100 displays a plurality of previous states of the display apparatus 100 in a screen specific area, for example, the bottom of the screen, according to the second operation of the user. The thumbnail images 600, 610, 620, and 630 may be displayed.

Meanwhile, the plurality of thumbnail images 600, 610, 620, and 630 representing the previous screens of the display apparatus 100 may be arranged and displayed in one direction in a time sequence.

That is, the first thumbnail image 600 disposed at the rightmost side among the plurality of thumbnail images 600, 610, 620, and 630 may display the first screen of the display apparatus 100 in which the function previously executed in the current state is cancelled. Can be represented.

In addition, the second thumbnail image 610 disposed adjacent to the left side of the first thumbnail image 600 may be configured to display the first image of the display apparatus 100 canceling a function previously executed in the first screen state of the display apparatus 100. 3 You can display the screen.

On the other hand, the third thumbnail image 620 disposed adjacent to the left side of the second thumbnail image 610 is the first image of the display apparatus 100 canceling a function previously executed in the second screen state of the display apparatus 100. 3 You can display the screen.

In addition, the fourth thumbnail image 630 disposed on the leftmost side may represent the fourth screen of the display apparatus 100 in which the function previously executed in the third screen state of the display apparatus 100 is canceled.

The user may select any one of the plurality of thumbnail images 600, 610, 620, and 630 displayed on the screen so that the display apparatus 100 returns to the screen state corresponding to the selected thumbnail image.

Meanwhile, a pointer 50 is displayed on the screen of the display apparatus 100, and the pointer 50 is operated according to a user's motion recognized by the motion recognition unit 10, for example, a user's hand movement. It may be moved to correspond thereto.

As described above, the pointer 50 is moved according to the movement of the user's hand, and may designate a specific point, area, or object on the screen.

Referring to FIG. 20, a user may move one of two hands, for example, a right hand, to move the pointer 50 to an area in which one thumbnail image is displayed, and then select a corresponding thumbnail image.

For example, the user may move his right hand to position the pointer 50 in the area where the second thumbnail image 610 is displayed and take a "fist to hold" action, which is a preset action for selecting a thumbnail image.

Accordingly, the display apparatus 100 may return to the screen state corresponding to the selected second thumbnail image 610.

Meanwhile, since the number of thumbnail images 600, 610, 620, and 630 displayed on the screen of the display apparatus 100 may be limited, the user may use the left and right arrow keys 650 and 651 displayed on the screen to display a plurality of thumbnail images. The thumbnail images indicating the state of the display device 100 before or after the thumbnail images 600, 610, 620, and 630 may be displayed on the screen.

For example, when the user moves the pointer 50 to select the left direction key 650, the screen of the display apparatus 100 that is earlier than the plurality of thumbnail images 600, 610, 620, 630 currently displayed. The thumbnail image indicating the may be displayed on the screen.

In addition, when the user moves the pointer 50 and selects the right direction key 651, the screen of the display apparatus 100 that is more recent than the currently displayed plurality of thumbnail images 600, 610, 620, and 630 may be displayed. You can check the thumbnail image.

FIG. 21 illustrates a plurality of thumbnail images 600 and 610 on a screen when a user takes a "raising two hands" operation for canceling a function while the "execute menu" function as shown in FIG. 18 is executed. , An example of a method of displaying 620 and 630 is illustrated.

Referring to FIG. 21, the first thumbnail image 600 disposed at the far right shows a screen of the display apparatus 100 that is playing the “Ch 9” broadcast before the current “menu play” function is executed. Can be represented.

In addition, the second thumbnail image 610 may display a screen of the display apparatus 100 that executes the "channel switching" function before the state of playing the "Ch 9" broadcast represented by the first thumbnail image 600. Can be represented.

Meanwhile, the third thumbnail image 620 may display a screen of the display device 100 that is playing the “Ch 11” broadcast before the state of executing the “channel switching” function represented by the second thumbnail image 610. Can be represented.

The fourth thumbnail image 630 disposed on the far left is a display device that executes the " channel information display " function before the state of playing the " Ch 11 " broadcast represented by the third thumbnail image 620. The screen of 100 may be displayed.

According to an embodiment of the present invention, as shown in FIG. 21, when the user lowers both hands or one hand while the thumbnail images 600, 610, 620, and 630 are displayed on the screen, the thumbnail images 600. , 610, 620, and 630 may disappear on the screen, and the display apparatus 100 may maintain a current state.

Referring to FIG. 22, when the user moves the pointer 50 and selects the left direction key 650, the display apparatus executing the “search” function earlier than the state represented by the fourth thumbnail image 630. A fifth thumbnail image 640 representing the screen state of 100 may be displayed on the screen.

Meanwhile, as the fifth thumbnail image 640 is displayed on the leftmost side, the display positions of the second to fourth thumbnail images 630, 620, and 610 are shifted one by one in the right direction, and the first thumbnail image 600 is displayed. May no longer be displayed on the screen.

Referring to FIG. 23, the user moves the pointer 50 according to the movement of the right hand to position the fifth thumbnail image 640 in the area where the fifth thumbnail image 640 is displayed, and the fist of the right hand is selected to select the fifth thumbnail image 640. You can take action.

Accordingly, as shown in FIG. 24, the display apparatus 100 may return to a screen state corresponding to the fifth thumbnail image 640, that is, a screen for executing a “search” function.

Meanwhile, the user may move the pointer 50 to search for content by selecting a desired character or symbol.

On the other hand, the control method of the display device according to an embodiment of the present invention is not limited to being performed by the display device as described above, a mobile phone, a smart phone (notebook computer), a notebook computer (notebook computer) capable of displaying an image , A digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, or the like.

In addition, the above-described control method according to the present invention can be stored in a computer-readable recording medium that is produced as a program for execution in a computer, examples of the computer-readable recording medium are ROM, RAM, CD-ROM Magnetic tapes, floppy disks, optical data storage devices, and the like, and also include those implemented in the form of carrier waves (eg, transmission over the Internet).

The computer readable recording medium can be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. In addition, functional programs, codes, and code segments for implementing the control method can be easily inferred by programmers in the art to which the present invention belongs.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Claims (11)

In a method of controlling a display device by recognizing a user's motion,
Recognizing a user's motion;
Executing a function corresponding to the first operation; And
If the second operation of the user is recognized, returning to a state before the function is executed. The method of claim 1,
Storing information about a state before executing the function; And
And displaying the stored information according to the second operation of the user. The method of claim 2, wherein the displaying step
And a thumbnail image of the screen before executing the function. The method of claim 3, wherein the returning step
Receiving the displayed thumbnail image from a user; And
And returning to a screen state corresponding to the selected thumbnail image. The method of claim 4, wherein said selecting step
A method of controlling a display device, wherein the thumbnail image is selected using a pointer displayed on a screen and moved according to a user's operation. The method of claim 2, wherein the previous state information is
And information on a plurality of screens changed as the functions are executed. The method of claim 6, wherein the displaying step
And a plurality of thumbnail images respectively representing the plurality of screens, arranged in one direction in a time sequence. In the display device that can recognize and control the user's motion,
A motion recognition unit for recognizing an action performed by a user; And
It includes a control unit for executing a function corresponding to the first operation of the user,
The control unit
And when the second operation of the user is recognized, returning the display device to a state before the function is executed. The method of claim 8,
A storage unit which stores information on a state before executing the function; And
And a display unit which displays at least one thumbnail image representing a screen before executing the function by using previous state information stored in the storage unit. 10. The apparatus of claim 9, wherein the control unit
And a display apparatus for returning to a screen state corresponding to a thumbnail image selected by a user among the displayed thumbnail images. A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 1 to 7.

Images