KR20130033182A - Method for operating an image display apparatus - Google Patents

Abstract

PURPOSE: An operation method of an image display device is provided to conveniently and variously input a command, thereby improving user convenience. CONSTITUTION: A control unit of an image display device enters a gesture mode corresponding to an input signal of a remote control device(S610). The control unit receives motion information of the remote control device through a user input interface unit(S620). The control unit moves a pointer of a display based on the received motion information(S630). When movement speed of the remote control device is below a reference time, the control unit displays guide information for a gesture command capable of being input through the display(S640,S650). [Reference numerals] (AA) Start; (BB) No; (CC) Yes; (DD) End; (S610) Entering a gesture mode; (S620) Receiving movement information; (S630) Moving a pointer; (S650) Displaying guide information;

Description

Method for operating an image display apparatus

The present invention relates to a video display device, a remote control device and an operation method thereof, and more particularly, to an image display device, a remote control device and an operation method thereof that can improve user convenience.

The image display device is a device having a function of displaying an image that a user can watch. The user can watch the broadcast through the image display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is shifting from analog broadcasting to digital broadcasting worldwide.

Digital broadcasting refers to broadcasting for transmitting digital video and audio signals. Digital broadcasting is more resistant to external noise than analog broadcasting, so it has less data loss, is advantageous for error correction, has a higher resolution, and provides a clearer picture. In addition, unlike analog broadcasting, digital broadcasting is capable of bidirectional services.

SUMMARY OF THE INVENTION An object of the present invention is to provide an image display apparatus and an operation method thereof which can improve user convenience.

Another object of the present invention is to provide an image display device capable of providing various user interfaces and an operation method thereof.

An operation method of an image display apparatus according to an embodiment of the present invention for achieving the above object comprises the steps of: entering a gesture mode, receiving motion information from a remote control device, moving a pointer based on the motion information; And displaying guide information on an input gesture command when the moving speed of the remote controller is less than or equal to the reference speed.

According to another aspect of the present invention, there is provided a method of operating an image display device, the method comprising: entering a gesture mode, receiving motion information from a remote control device, and a moving speed of the remote control device being equal to or less than a reference speed; In a case, the method may further include displaying guide information on an inputable gesture command.

According to the present invention, a command can be conveniently and variously inputted, thereby improving user convenience. In addition, various user interfaces (UIs) may be provided.

1 is a block diagram illustrating an image display apparatus according to an exemplary embodiment of the present invention.
FIG. 2 is an internal block diagram of the controller of FIG. 1.
3 is a diagram illustrating a control method of the remote controller of FIG. 1.
Figure 4 is a perspective view of a remote control device according to an embodiment of the present invention, Figure 5 is an internal block diagram of the remote control device.
6 is a flowchart illustrating a method of operating an image display apparatus according to an embodiment of the present invention.
7 to 16 are views referred to for describing the operating method of FIG. 6.
17 is a flowchart illustrating a method of operating a remote control apparatus according to an embodiment of the present invention.
FIG. 18 is a diagram referred to describe the operating method of FIG. 17.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a block diagram illustrating an image display apparatus according to an exemplary embodiment of the present invention.

Referring to FIG. 1, the image display apparatus 100 according to an exemplary embodiment of the present invention may include a broadcast receiver 105, an external device interface 130, a storage 140, a user input interface 150, and a sensor. The controller may include a unit (not shown), a controller 170, a display 180, and an audio output unit 185.

The broadcast receiver 105 may include a tuner 110, a demodulator 120, and a network interface 130. Of course, it is possible to design the network interface unit 130 not to include the tuner unit 110 and the demodulation unit 120 as necessary, and to provide the network interface unit 130 with the tuner unit 110 And the demodulation unit 120 are not included.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 may process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal CVBS / SIF output from the tuner 110 may be directly input to the controller 170.

In addition, the tuner unit 110 may receive a single broadcast RF broadcast signal according to an ATSC (Advanced Television System Committee) scheme or a multiple broadcast RF broadcast signal according to a digital video broadcasting (DVB) scheme.

Meanwhile, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna in the present invention, and converts them to intermediate frequency signals or baseband video or audio signals. Can be converted to

On the other hand, the tuner unit 110 may be provided with a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner may be used to receive broadcast signals of multiple channels simultaneously.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. In this case, the stream signal may be a signal multiplexed with a video signal, an audio signal, or a data signal.

The stream signal output from the demodulator 120 may be input to the controller 170. After performing demultiplexing, image / audio signal processing, and the like, the controller 170 outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 may be connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray (Blu ray), a game device, a camera, a camcorder, a computer (laptop), a set top box, or the like by wire / wireless. It may also perform input / output operations with external devices.

The A / V input / output unit may receive a video and audio signal of an external device. The wireless communication unit may perform short range wireless communication with another electronic device.

The network interface unit 135 provides an interface for connecting the image display apparatus 100 to a wired / wireless network including an internet network. For example, the network interface unit 135 may receive content or data provided by the Internet or a content provider or a network operator through a network.

Meanwhile, the network interface unit 135 may perform data communication with an adjacent electronic device around the image display apparatus 100. In this case, the network interface unit 135 may receive device information of another electronic device, channel information that can be remotely controlled by another electronic device, frequency information or code information.

The storage 140 may store a program for processing and controlling each signal in the controller 170, or may store a signal-processed video, audio, or data signal.

In addition, the storage unit 140 may perform a function for temporarily storing an image, audio, or data signal input to the external device interface unit 130. In addition, the storage 140 may store information on a predetermined broadcast channel through a channel storage function such as a channel map.

In addition, the storage 140 may store IR format key codes for controlling other electronic devices as IR signals, and may store IR format key databases of a plurality of electronic devices.

1 illustrates an embodiment in which the storage unit 140 is provided separately from the control unit 170, but the scope of the present invention is not limited thereto. The storage 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the remote controller 200 transmits / receives a user input signal such as power on / off, channel selection, screen setting, or a local key (not shown) such as a power key, a channel key, a volume key, or a set value. Transmits a user input signal input from the control unit 170, or transmits a user input signal input from the sensor unit (not shown) for sensing the user's gesture to the control unit 170, or the signal from the control unit 170 It can transmit to a sensor unit (not shown).

According to an embodiment of the present invention, the user input interface unit 150 may receive personal information from the remote control apparatus 200. In addition to the personal information, the web server information being connected by the personal information may be further received.

For example, when the portable terminal 300 and the remote controller 200 approach within a predetermined distance to perform Near Field Communication (NFC), the remote controller 200 may store an individual stored in the portable terminal 300. Information can be received. In addition, the remote control apparatus 200 may transmit personal information to the image display apparatus 100 according to an IR scheme or an RF scheme. At this time, the user input interface unit 150 transmits the received personal information to the control unit 170.

Meanwhile, the personal information at this time may include personal ID information, password information, personal email information, and the like for the mobile terminal 300. Alternatively, the personal information may include personal ID information, password information, personal email information, and the like for the image display apparatus 100. Alternatively, the personal information may be personal ID information or password information that can be commonly used in various electronic devices including the mobile terminal 300. Alternatively, the personal information may be personal ID information, password information, or the like from the portable terminal 300 to a predetermined web server stored in advance. Alternatively, the personal information may be personal ID information, password information, etc., to a predetermined web server that can be used in the image display apparatus 100 including the mobile terminal 300. Alternatively, the personal information may be personal ID information, password information, or the like for a server connected to the video display device 100.

That is, the personal information may be information necessary to log in to a predetermined account for the electronic device or the service.

On the other hand, the user input interface unit 150, from the adjacent electronic device around the image display device 100, transmitted from the remote control device 200, device information of other electronic devices, channel information capable of remote control of other electronic devices Frequency information or code information may be received.

The controller 170 may demultiplex the input stream or process the demultiplexed signals through the tuner unit 110, the demodulator 120, or the external device interface unit 130. Signals can be generated and output.

The image signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the image signal. In addition, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The voice signal processed by the controller 170 may be sound output to the audio output unit 185. In addition, the voice signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

Although not shown in FIG. 1, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG. 2.

In addition, the controller 170 may control overall operations of the image display apparatus 100. For example, the controller 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.

In addition, the controller 170 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150.

The controller 170 may control the display 180 to display an image. In this case, the image displayed on the display 180 may be a still image or a video, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate and display a 3D object with respect to a predetermined object in the image displayed on the display 180. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

The controller 170 may recognize a location of a user based on an image photographed by a photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 may be determined. In addition, the x-axis coordinates and the y-axis coordinates in the display 180 corresponding to the user position may be determined.

On the other hand, according to an embodiment of the present invention, the control unit 170 may control to log in based on the personal information received from the remote control device 200. In this case, the login may be a login of the image display apparatus 100 itself, a login to a server connected to the image display apparatus 100, or a login to a predetermined web server subscribed by personal information.

For example, when the user logs in to the video display device 100 by personal ID information and password information received from the remote controller 200, the controller 170 displays a personal screen set for each user account. The control may be displayed at 180. When there is an image being watched, the controller 170 may control to display a personal setting screen together with the image being watched. Alternatively, it is possible to control to change the scene of the video being viewed and to display it on the personal setting screen.

As another example, when logging in to a server connected to the image display apparatus 100, the controller 170 may control to display a server connection screen received from the server on the display 180. Specifically, it may be an app server screen. If there is an image being watched, the controller 170 may control to display a server connection screen together with the image being watched. Alternatively, it is possible to control to switch the video being viewed to the scene and display it on the server connection screen.

As another example, when the received personal information is personal information about predetermined web servers that are connected to another electronic device, specifically, the mobile terminal 300, the controller 170 indicates that the image display apparatus 100 corresponds to the web servers. The control unit may be controlled to access the screen, and to display the screen of the connected web server on the display 180. In this case, the web servers may be web servers that provide a social network service. When there is an image being watched, the controller 170 may control to display a screen of the connected web server together with the image being watched. Alternatively, it is also possible to control the display of the image being watched to be displayed on the screen of the connected web server.

Meanwhile, the controller 170 may control a power supply unit (not shown) to turn on the image display apparatus 100 when the image display apparatus 100 is turned off while personal information is received. Can be. That is, in the standby mode, when personal information is received from the user input interface unit 150, the controller 170 switches to the wake up mode to supply power to various modules or units. The supply can be controlled.

On the other hand, the control unit 170, the device information of the adjacent electronic device around the image display device 100, received from the network interface unit 135 or the user input interface unit 150, the channel capable of remote control of other electronic devices Based on the personal information from the remote control apparatus 200 based on the information, the frequency information, the code information, or the like, it is determined whether each electronic device or the like is connected, and displays an object indicating that the other electronic device is logged in. You can control it to display.

Alternatively, the controller 170 may control the remote controller 200 based on device information of adjacent electronic devices around the image display device 100, channel information that can be remotely controlled by another electronic device, frequency information, code information, or the like. It may be controlled to transmit the corresponding device information, channel information, frequency information or code information.

On the other hand, although not shown in the figure, it may be further provided with a channel browsing processing unit for generating a thumbnail image corresponding to the channel signal or the external input signal. The channel browsing processor may receive a stream signal TS output from the demodulator 120 or a stream signal output from the external device interface 130, extract a video from the input stream signal, and generate a thumbnail image. Can be. The generated thumbnail image may be stream decoded together with the decoded image and input to the controller 170. The controller 170 may display a thumbnail list including a plurality of thumbnail images on the display 180 by using the input thumbnail image.

In this case, the thumbnail list may be displayed in a simple viewing manner displayed in a partial region while a predetermined image is displayed on the display 180 or in an overall viewing manner displayed in most regions of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts an image signal, a data signal, an OSD signal, a control signal, or an image signal, a data signal, a control signal received from the external device interface unit 130 processed by the controller 170, and generates a driving signal. Create

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or a 3D display.

 The display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the controller 170 and outputs the audio signal.

A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. Meanwhile, the photographing unit (not shown) may be embedded in the image display device 100 on the display 180 or disposed separately. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The controller 170 may detect a user's gesture based on each of the images captured by the photographing unit (not shown) or the sensed signal from the sensor unit (not shown) or a combination thereof.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. To this end, the remote control device 200, Bluetooth, RF (Radio Frequency) communication, Infrared (IR) communication, UWB (Ultra Wideband), ZigBee (ZigBee), Near Field Communication (MFC) method, etc. Can be used.

In addition, the remote control apparatus 200 may receive an image, audio or data signal output from the user input interface unit 150. In addition, the remote control apparatus 200 may display or output audio from the remote control apparatus 200 based on the received video, audio, or data signal.

On the other hand, the remote control device 200 according to an embodiment of the present invention, can receive information by a predetermined electronic device and near field communication. As described above, the information may be personal ID information and password information that can be used in a portable terminal, an image display device, an electronic device, or the like.

The remote controller 200 may transmit the received personal information to the video display device 100. The communication method at this time may use an IR method or an RF method.

In an embodiment of the present invention, the remote control apparatus 200 describes a spatial remote controller capable of displaying a pointer corresponding to a user's movement. That is, the remote control apparatus 200 may transmit personal information to the image display apparatus 100 using the RF method.

Meanwhile, the remote control apparatus 200 may further receive web server information, etc. being accessed by the personal information, in addition to the personal information. For example, the mobile terminal may receive web server information about a social network service that is being logged in and accessed. Such web server information is also transmitted to the image display apparatus 100.

Meanwhile, it is also possible to receive device information of another electronic device, channel information remotely controllable by another electronic device, frequency information, code information, and the like from the adjacent electronic device around the image display apparatus 100. Based on such other electronic device information, a remote control may be performed by allocating a channel, a frequency, or a code to the corresponding electronic device.

Meanwhile, the above-described image display apparatus 100 may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasting.

Meanwhile, a block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 that is actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

On the other hand, the image display apparatus 100 does not include the tuner 110 and the demodulator 120 shown in FIG. 1, unlike the illustrated in FIG. 1, but the network interface 130 or the external device interface unit ( Through 135, image content may be received and played back.

FIG. 2 is an internal block diagram of the controller of FIG. 1.

Referring to the drawings, the control unit 170 according to an embodiment of the present invention, the demultiplexer 310, the image processor 320, the processor 330, the OSD generator 340, the mixer 345 , Frame rate converter 350, and formatter 360. In addition, the apparatus may further include a voice processor (not shown) and a data processor (not shown).

The demultiplexer 310 demultiplexes an input stream. For example, when an MPEG-2 TS is input, it may be demultiplexed and separated into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110, the demodulator 120, or the external device interface unit 130.

The image processor 320 may perform image processing of the demultiplexed image signal. To this end, the image processor 320 may include an image decoder 325 and a scaler 335.

The image decoder 325 decodes the demultiplexed video signal, and the scaler 335 performs scaling to output the resolution of the decoded video signal on the display 180.

The video decoder 325 can include a decoder of various standards.

The processor 330 may control overall operations in the image display apparatus 100 or the controller 170. For example, the processor 330 may control the tuner 110 to control tuning of an RF broadcast corresponding to a channel selected by a user or a previously stored channel.

In addition, the processor 330 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150.

In addition, the processor 330 may perform data transmission control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generator 340 generates an OSD signal according to a user input or itself. For example, a signal for displaying various types of information on a screen of the display 180 as a graphic or text may be generated based on a user input signal. The generated OSD signal may include various data such as a user interface screen, various menu screens, widgets, and icons of the image display apparatus 100. In addition, the generated OSD signal may include a 2D object or a 3D object.

In addition, the OSD generator 340 may generate a pointer that can be displayed on a display based on a pointing signal input from the remote controller 200. In particular, such a pointer may be generated by the pointing signal processor, and the OSD generator 240 may include such a pointing signal processor (not shown). Of course, the pointing signal processor (not shown) may be provided separately without being provided in the OSD generator 240.

Meanwhile, in accordance with an embodiment of the present invention, the OSD generator 340 may generate or configure a set personal screen when a user logs in to the image display apparatus 100 itself. Alternatively, the OSD generator 340 may generate or configure at least a portion of the server access screen to display the server access screen received from the server on the display 180 when logging in to the connected server. Alternatively, the OSD generator 340 may generate or configure at least a part of the web server access screen based on the web server information being accessed by the personal information.

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded image signal processed by the image processor 320. In this case, the OSD signal and the decoded video signal may each include at least one of a 2D signal and a 3D signal. The mixed video signal is provided to the frame rate converter 350.

A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the frame rate converter 350 can output the data as it is without additional frame rate conversion.

The formatter 360 receives a mixed signal, that is, an OSD signal and a decoded video signal, from the mixer 345 and changes the format of the signal to be suitable for the display 180. For example, the R, G, B data signals may be output, and the R, G, B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

Meanwhile, the formatter 360 may separate the 2D video signal and the 3D video signal for displaying the 3D video. In addition, the format of the 3D video signal may be changed or the 2D video signal may be converted into a 3D video signal.

The voice processing unit (not shown) in the controller 170 may perform voice processing of the demultiplexed voice signal. To this end, the voice processing unit (not shown) may include various decoders.

Also, the voice processing unit (not shown) in the controller 170 may process a base, a treble, a volume control, and the like.

The data processor (not shown) in the controller 170 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be EPG (Electronic Progtam Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted in each channel.

In FIG. 2, the signals from the OSD generator 340 and the image processor 320 are mixed in the mixer 345 and then 3D processed in the formatter 360, but the present invention is not limited thereto. May be located after the formatter.

Meanwhile, a block diagram of the controller 170 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the controller 170 that is actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170, but may be provided separately.

3 is a diagram illustrating a control method of the remote controller of FIG. 1.

As illustrated in FIG. 3A, a pointer 205 corresponding to the remote controller 200 is displayed on the display 180.

The user can move or rotate the remote control device 200 up and down, left and right (FIG. 3 (b)), front and rear (FIG. 3 (c)). The pointer 205 displayed on the display 180 of the image display device corresponds to the movement of the remote controller 200. The remote control apparatus 200 may be referred to as a spatial remote controller because the pointer 205 is moved and displayed according to the movement in the 3D space as shown in the figure.

3B illustrates that when the user moves the remote control apparatus 200 to the left side, the pointer 205 displayed on the display 180 of the image display apparatus also moves to the left side correspondingly.

Information about the movement of the remote control device 200 detected through the sensor of the remote control device 200 is transmitted to the image display device. The image display device may calculate the coordinates of the pointer 205 from the information about the movement of the remote controller 200. The image display device may display the pointer 205 to correspond to the calculated coordinates.

3C illustrates a case in which the user moves the remote control apparatus 200 away from the display 180 while pressing a specific button in the remote control apparatus 200. As a result, the selection area in the display 180 corresponding to the pointer 205 may be zoomed in and enlarged. On the contrary, when the user moves the remote controller 200 to be closer to the display 180, the selection area in the display 180 corresponding to the pointer 205 may be zoomed out and reduced. On the other hand, when the remote control device 200 moves away from the display 180, the selection area is zoomed out, and when the remote control device 200 approaches the display 180, the selection area may be zoomed in.

On the other hand, while pressing a specific button in the remote control device 200 can recognize the up, down, left and right movement. That is, when the remote control device 200 moves away from or near the display 180, the up, down, left and right movements are not recognized, and only the front and back movements can be recognized. In a state where a specific button in the remote controller 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movements of the remote controller 200.

Meanwhile, the moving speed or the moving direction of the pointer 205 may correspond to the moving speed or the moving direction of the remote control apparatus 200.

Figure 4 is a perspective view of a remote control device according to an embodiment of the present invention, Figure 5 is an internal block diagram of the remote control device.

Referring to FIG. 4, the spatial remote control 201 according to an embodiment of the present invention may include various input keys or input buttons.

For example, the spatial remote control 201 may include an ok key 291, a menu key 292, a four-way key 293, a channel adjustment key 294, and a volume adjustment key 296. have.

For example, the ok key 291 may be used to select a menu or item, the menu key 292 may be used to display a predetermined menu, and the four-way key 293 may move up or down the pointer or indicator. It can be used to move up, down, left and right, the channel adjustment key 294 can be used to adjust the channel up and down, and the volume adjustment key 296 can be used to adjust the volume up and down.

The spatial remote control 201 may further include a back key 297 and a home key 298. For example, the back key 297 may be used when moving to the previous screen, and the home key 298 may be used when moving to the home screen.

On the other hand, as shown in the figure, the confirmation key 291 may be added with a scroll function. To this end, the confirmation key 291 can be implemented in the form of a wheel key. That is, when the confirmation key 291 is pressed, it is used as a menu or item selection, and when the confirmation key 291 is scrolled up and down, display screen scrolling or list page switching may be performed.

In detail, when an image larger than the size of the display is displayed on the display unit 180, when the confirmation key 291 is scrolled to search for the corresponding image, an image area not currently displayed on the display is displayed on the display. As another example, when the list page is displayed on the display unit 180, when the confirmation key 291 is scrolled, the previous page or the next page of the current page may be displayed.

The scroll function may be provided as a key other than the confirmation key 291.

On the other hand, the four-way key 293, in the circular type, as shown in the upper, lower, left, right keys may be arranged in four directions, respectively. Meanwhile, a touch input to the four-way key 293 may also be possible. For example, when there is a touch operation from an up key to a down key in the four-way key 293, a set function may be input or performed according to the corresponding touch input.

Referring to FIG. 5, the remote control apparatus 200 includes a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, and a storage unit 270. It may include a control unit 280.

The wireless communication unit 220 transmits and receives a signal with any one of the image display apparatus according to the embodiments of the present invention described above. Among the image display apparatuses according to the exemplary embodiments of the present invention, one image display apparatus 100 will be described as an example.

In the present embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving signals with the image display apparatus 100 according to the RF communication standard. In addition, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving signals with the image display apparatus 100 according to IR communication standards.

In addition, the remote control device 200 may further include an NFC module (not shown) for short-range magnetic field communication with the electronic device.

The remote control device 200 can transmit a signal containing information on the motion and the like of the remote control device 200 to the image display device 100 through the RF module 221.

In addition, the remote control apparatus 200 may receive a signal transmitted from the image display apparatus 100 through the RF module 221. In addition, the remote controller 200 may transmit a command regarding power on / off, channel change, volume change, etc. to the image display device 100 through the IR module 223 as necessary.

On the other hand, according to the present embodiment, the remote control device 200 can receive personal information by a predetermined electronic device and near field communication.

The remote controller 200 may transmit the received personal information to the video display device 100. The communication method at this time may use an IR method or an RF method.

Meanwhile, the remote control apparatus 200 may further receive web server information, etc. being accessed by the personal information, in addition to the personal information. For example, the mobile terminal 300 may receive web server information about a social network service that is being logged in and accessed. Such web server information may also be transmitted to the image display apparatus 100.

Meanwhile, the remote control apparatus 200 may also receive device information of another electronic device, channel information remotely controllable by another electronic device, frequency information or code information. Based on such other electronic device information, a remote control may be performed by allocating a channel, a frequency, or a code to the corresponding electronic device.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 230. When the user input unit 230 includes a hard key button, the user may input a command related to the image display apparatus 100 to the remote control apparatus 200 through a push operation of the hard key button. When the user input unit 230 includes a touch screen, the user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by touching a soft key of the touch screen. In addition, the user input unit 230 may include various kinds of input means that a user can operate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 may sense information about the movement of the remote controller 200.

For example, the gyro sensor 241 may sense information about the operation of the remote control apparatus 200 based on the x, y, and z axes. The acceleration sensor 243 may sense information about a moving speed of the remote controller 200. Meanwhile, a distance measuring sensor may be further provided, whereby the distance with the display 180 may be sensed.

The output unit 250 may output a video or audio signal corresponding to a manipulation of the user input unit 230 or a signal transmitted from the image display apparatus 100. The user may recognize whether the user input unit 230 is manipulated or whether the image display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 may include a LED module 251 that is turned on when the user input unit 230 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 225, and a vibration module generating vibration. 253, a sound output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 may reduce power waste by stopping the power supply when the remote controller 200 does not move for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control apparatus 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control apparatus 200. If the remote control apparatus 200 transmits and receives a signal wirelessly through the image display apparatus 100 and the RF module 221, the remote control apparatus 200 and the image display apparatus 100 transmit signals through a predetermined frequency band. Send and receive The control unit 280 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving signals with the image display device 100 paired with the remote control device 200 in the storage unit 270. Reference may be made.

In addition, the storage unit 270 may store IR format key codes for controlling other electronic devices as an IR signal, and may store IR format key databases of a plurality of electronic devices.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The controller 280 transmits a signal corresponding to a predetermined key manipulation of the user input unit 230 or a signal corresponding to the movement of the remote controller 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100 can be sent.

The controller 280 may control the received personal information to be transmitted to the video display device 100 through the wireless communication unit 220 by the electronic device and near field communication. In particular, when there is a predetermined key input by the user input unit 230, the controller 280 may control the received personal information to be transmitted to the image display apparatus 100 through the wireless communication unit 220.

In addition, the controller 280 may control the received personal information to be transmitted to other electronic devices other than the image display apparatus 100. At this time, it is possible to use different channels, frequencies or codes corresponding to each electronic device. Such a channel, frequency or code may be based on device information, remotely controllable channel information, frequency information or code information from another electronic device in advance.

6 is a flowchart illustrating a method of operating an image display device according to an exemplary embodiment of the present invention, and FIGS. 7 to 16 are views for explaining the method of FIG. 6.

Referring to the drawings, first, the operation method of the image display apparatus according to an embodiment of the present invention enters the gesture mode.

For example, when using specific content or a menu, a gesture mode capable of inputting a gesture command may be entered.

Alternatively, the method may further include receiving an input for entering a gesture mode. For example, the input for entering a gesture mode may be a double-click or a long-key input of a first button of a remote controller. have.

Meanwhile, in the present specification, a long-key input may include an input of pressing and releasing a predetermined button for more than a predetermined time and an input of holding a button while pressing and releasing for a predetermined time.

On the other hand, when entering the gesture mode may further display the information of the entire gesture that can be input, this entire information may disappear after a predetermined time.

Thereafter, the image display device receives the motion information of the remote control device from the remote control device (S620), and moves the pointer based on the motion information of the remote control device (S630).

On the other hand, if the moving speed (V) of the remote control device is less than the reference time (R) (S640), the control unit 170 may control to display the guide information for the input gesture command (S650).

Here, when the moving speed of the remote control device is less than the reference speed is a case slower than the set reference speed, the remote control device may include a stopped state.

The set value of the reference speed can be changed by setting. The user may set a reference speed at which the gesture guide is displayed according to his or her skill level.

On the other hand, if the movement speed of the remote control device is not included in the received motion information, the method may further include calculating a movement speed of the remote control device based on the movement information.

The guide information may include shape information and function information of the inputtable gesture command. The gesture guide includes information to help a user learn and execute a gesture for inputting a command. In addition, the guide information may include information of all input gestures.

Using the remote control device, you can execute specific functions through pictures such as gestures rather than simple keystrokes. However, when a gesture is possible by input of a command, it is difficult for a user to know whether a gesture exists, and when a user attempts to input by using a gesture, it is troublesome to memorize all the functions of each gesture.

According to the present invention, when the user decelerates or stops while inputting a gesture, by displaying a gesture guideline, a novice user can see all possible gestures and commands.

In addition, when the user is accustomed to using the gesture input, the user may input the gesture faster than the reference speed so that the user may input the gesture quickly without seeing the unnecessary gesture guide.

Therefore, the user can efficiently use the gesture input because the user can see the gestures and commands possible when the motion is slow or stopped at any time.

Meanwhile, the method may further include displaying the movement trajectory of the pointer, thereby helping the user to intuitively grasp the gesture path input by the user.

On the other hand, the operation method of the image display device according to an embodiment of the present invention may further comprise the step of changing the display state of the guide information in accordance with the movement of the pointer.

That is, according to the gesture input process of the remote controller, some gesture commands may not be able to input corresponding gestures, and other commands may be enabled. That is, the gesture guide may be displayed in a variable manner in response to the change of the gesture.

Accordingly, in the changing of the display state of the guide information, the guide information about the gesture command that is not inputted by the movement of the pointer may be deleted, and the guide information about the gesture command that is enabled for input may be added.

Alternatively, the changing of the display state of the guide information may change at least one of color, transparency, and size of the guide information according to the movement of the pointer.

Meanwhile, when a legitimate gesture command is input, an operation corresponding to the input gesture command may be performed.

Referring to the case where the gesture guide is displayed, according to the gesture shape of the first gesture command included in the guide information, when the pointer is moved, an operation corresponding to the first gesture command may be performed. That is, as long as an operation corresponding to the gesture command is made, the corresponding operation may be performed.

In another embodiment, moving the pointer according to a gesture shape of a first gesture command included in the guide information, double-click input of a first button of the remote controller, or a long-key release input. The method may further include receiving an operation and performing an operation corresponding to the first gesture command.

That is, in order to prevent a malfunction, an additional input for notifying or completing the gesture input may be required. This input may be the same as or opposite to the input for entering the gesture mode.

For example, when the user enters the gesture mode by double-clicking the first button, double-clicking the first button performs an operation corresponding to the input gesture.

Alternatively, when entering the gesture mode by the long key input of the first button, the operation is performed as a long-key release input of releasing the long button input or releasing the first button held again. It can also be done.

Meanwhile, the method of operating an image display apparatus according to an embodiment of the present invention may further include moving the pointer to a predetermined position when the pointer moves to an area where a space required for inputting a gesture command is not secured. Can be.

7 to 16 are views referred to for describing the operating method of FIG. 6.

According to the setting, when entering the gesture mode, gesture information including a list of possible gestures as shown in FIG. 7 may be displayed for each direction. The gesture list may be set to appear only when desired by differently starting the gesture and the time point at which the gesture list appears.

Depending on the setting, the gesture list may not appear when dragging immediately after the click, or may be distinguished by a long key or a double click so that the user may view the gesture list if desired.

The gesture guide may include shape information for guiding a gesture, such as a moving direction and a moving shape for inputting a gesture command, and function information indicating a function to be executed.

In FIG. 7, for inputting a gesture command, shape information 710, 720, 730, and 740 indicating a direction in which the remote controller moves or the pointer 205 may move, and a command that may be moved and input in a corresponding direction Function information 711, 721, 731, 741 representing the list is illustrated.

Lists 711, 721, 731, and 741 of commands input by gestures may be edited, and may be edited so that different functions may be mapped to predetermined gestures for each user.

In addition, a function used a lot may be assigned based on a user's usage history.

8 and 9 illustrate examples of a user inputting a gesture using a remote control apparatus.

When the user moves the remote controller in the first direction, the pointer 205 also moves in the first direction based on the movement of the remote controller.

When the user stops drawing or slows down the input speed, a gesture guide indicating the shapes 810, 820, and 830 of the inputable gestures and the functions 811, 821, and 831 of the gestures is displayed. When the user stops drawing a gesture, only a list of gestures that can be input may be displayed according to the input direction.

In addition, the gesture guide may be displayed when a minimum gesture is input, that is, when the pointer 205 moves at least the minimum distance while the moving speed becomes slow.

On the other hand, the image display device may display the trajectory 850 corresponding to the gesture or the movement of the pointer of the remote control device, and the trajectory 850 may be different from the gesture guide in a display state such as transparency, color, and size. have.

For example, the gesture guide may be translucent or process colors differently for each direction, and the gesture drawn by the user may be represented by a solid line.

Then, when the gesture is drawn in the shape of the displayed gesture guide, a corresponding function may be executed. When the gesture input 950 corresponding to the function of returning to the home screen is completed as shown in FIG. 9, the screen may be switched to the home screen.

Meanwhile, as shown in FIG. 10, the gesture input in the predetermined direction 1040 may correspond to a function 1041 capable of canceling at least one gesture input. Here, the gesture input for the same direction may be processed as one gesture input.

According to the present invention, it is possible to improve the convenience of the user by providing a gesture guide for notifying the user of the gesture to the user who is not familiar with the gesture and learning the gesture input.

In addition, by providing a gesture guide when the input speed is lower than the reference speed, it is effective even for an experienced user through the same interface.

On the other hand, the gesture guide shown in Figures 8 to 10 is exemplary and the present invention is not limited thereto. For example, when a gesture is stopped while drawing or the input speed is slowed, a gesture guide showing the shapes 1110, 1120, and 1130 of the inputtable gesture and the functions 1111, 1121, and 1131 of the gesture as shown in FIG. Can be displayed.

FIG. 12 is a diagram illustrating a case where a pointer is moved in a direction different from that of FIG. 8.

After moving the pointer 205 while pressing the button of the remote controller in the direction in which the desired function is performed (1250), if it stops for a while, a list of possible gestures 1211 and 1221 is displayed according to the input directions 1210 and 1220.

Thereafter, after moving the pointer 205 along the displayed gesture shape (1250), when the user releases the button of the remote controller, a function corresponding to the gesture is executed.

Meanwhile, the operating method of the image display apparatus according to an embodiment of the present invention may further include moving the pointer to a predetermined position when moving to an area where space necessary for displaying the gesture guide is not secured. have.

Referring to FIG. 13A, although the pointer 205 is positioned at the outer portion of the screen, the functions 1311 and 1321 corresponding to the first direction 1310 and the second direction 1320 may be displayed. The gesture guide in the right direction cannot be displayed.

In this case, as shown in FIG. 13B, the pointer 205 may be moved to a predetermined position and displayed, and the gesture guide may be displayed to include a function 1331 corresponding to the remaining direction 1330.

On the other hand, even in this case, when the remote controller moves faster than the reference speed R, the corresponding function can be executed immediately without displaying the gesture guide.

Meanwhile, the guide information regarding the gesture command that is impossible to input according to the movement of the pointer may be deleted, and the guide information about the gesture command that enables the input may be added.

In addition, at least one of color, transparency, and size of the guide information may be changed according to the movement of the pointer.

Referring to FIG. 14A, when the pointer 205 moves to the predetermined trajectory 1450 and the moving speed becomes slow, the input directions, shapes 1410, 1420, 1430, and functions 1411, 1421, A gesture guide including 1431 is displayed.

As shown in FIG. 14B, when the pointer 205 draws a predetermined trajectory 1460, the first direction is less likely to be input, so the gesture guides 1410 and 1411 in the first direction are thinner than the gesture guides in the other direction. I can display it.

Thereafter, when the pointer 205 moves further, the gesture guides 1410 and 1411 in the first direction may be deleted.

Meanwhile, the gesture guide may be displayed differently from the beginning according to the usage statistics of the user. For example, as shown in FIG. 15, the gesture guide of the function most used by the user may be displayed in a larger or darker color than other gesture guides 1510, 1511, 1520, and 1521.

On the other hand, if a gesture is input faster than a reference speed after pressing a predetermined button of the remote control device, the gesture guide may not appear and the function may be executed immediately. That is, an experienced user can quickly input and execute without a gesture guide.

In this case, as shown in FIG. 16, the pointer 205 and the movement trajectory 1610 may be displayed to help the user intuitively grasp his / her input.

FIG. 17 is a flowchart illustrating a method of operating a remote control apparatus according to an embodiment of the present invention, and FIG. 18 is a diagram referred to describe the method of operation of FIG. 17.

Referring to the drawings, a method of operating an image display device according to another embodiment of the present invention includes entering a gesture mode (S1710), receiving motion information from a remote controller (S1720), and the remote control. When the movement speed V of the device is less than or equal to the reference speed R (S1730), the method may include displaying guide information on an input gesture command (S1740).

When the user stops drawing or slows down the input speed, a gesture guide indicating the shapes 1810, 1820, and 1830 of the inputtable gestures and the functions 1811, 1821, and 1831 of the gestures is displayed. When the user stops drawing a gesture, the user may display a list of gestures that can be input according to the input direction.

That is, it differs from the embodiment described above with reference to FIGS. 6 through 16 in that the pointer and the movement trajectory of the pointer are not displayed, and the embodiment described above with reference to FIGS. 6 through 16 is identically or similarly applied except for the difference. Can be.

The image display apparatus and its operation method according to the present invention are not limited to the configuration and method of the embodiments described as described above, but the embodiments are all or part of each embodiment so that various modifications can be made. May be optionally combined.

Meanwhile, the operation method of the image display apparatus of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet. . The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

Entering a gesture mode;
Receiving motion information from a remote control device;
Moving a pointer based on the motion information; And
And displaying guide information on an input gesture command when the moving speed of the remote controller is less than or equal to a reference speed. The method of claim 1,
And receiving an input for entering the gesture mode. The method of claim 2,
And the input for entering the gesture mode is a double-click or a long-key input of a first button of the remote controller. The method of claim 1,
And the guide information includes shape information and function information of the inputtable gesture command. The method of claim 1,
Calculating a moving speed of the remote control device. The method of claim 1,
And displaying the movement trajectory of the pointer. The method of claim 1,
And the guide information includes information of all gestures that can be input. The method of claim 7, wherein
And the set value of the reference speed is changeable. The method of claim 1,
And changing a display state of the guide information according to the movement of the pointer. 10. The method of claim 9,
The changing of the display state of the guide information may include deleting guide information about a gesture command that is impossible to input according to the movement of the pointer, and adding guide information about a gesture command that enables input. Method of operation. 10. The method of claim 9,
The changing of the display state of the guide information may include changing at least one of color, transparency, and size of the guide information according to the movement of the pointer. The method of claim 1,
And performing an operation corresponding to an input gesture command. The method of claim 1,
Moving the pointer according to a gesture shape of a first gesture command included in the guide information; And
And performing an operation corresponding to the first gesture command. The method of claim 1,
Moving the pointer according to a gesture shape of a first gesture command included in the guide information;
Receiving a double click input of a first button of the remote controller or a release key of a long key; And
And performing an operation corresponding to the first gesture command. The method of claim 1,
And moving the pointer to a predetermined position when the pointer moves to an area in which space necessary for displaying the gesture guide is not secured. Entering a gesture mode;
Receiving motion information from a remote control device;
And displaying guide information on an input gesture command when the moving speed of the remote controller is less than or equal to a reference speed. 17. The method of claim 16,
And the guide information includes shape information and function information of the inputtable gesture command. 17. The method of claim 16,
Calculating a moving speed of the remote control device. 17. The method of claim 16,
And changing the display state of the guide information according to the motion information of the remote control device. 17. The method of claim 16,
And performing an operation corresponding to an input gesture command.

Images