KR20170027590A - Remote controller capable of remotely controlling a plurality of device, and method for operating the same - Google Patents

Abstract

The present invention relates to a remote controller capable of remotely controlling a plurality of devices and a method of operating the same. The remote controller capable of remotely controlling a plurality of devices includes: a transmission part for transmitting a transmission signal; a reception part for receiving a reflection signal from a first reflection pattern; an audio output module; a display; and a control part for determining whether the reflection pattern is identical with a previously registered reflection pattern based on the received reflection signal, wherein the control part enters a reflection pattern registration mode when the reflection pattern is not identical with a previously registered reflection pattern, outputs an indicator indicating the reflection pattern registration mode through at least of the audio output module and the display, and when information about a first device is received, registers the reflection signal from the reflection pattern of the first reflection pattern as the reflection signal of the first device based on the received information about the first device, or the reflection pattern of the first device based on the reflection signal. Thus, a device corresponding to the reflection pattern may be easily registered using the reflection pattern.

Description

[0001] The present invention relates to a remote control device capable of performing remote control on a plurality of devices and a method of operating the same,

Field of the Invention [0002] The present invention relates to a remote control device and an operation method thereof, which can easily register a device corresponding to a reflection pattern using a reflection pattern.

The remote control device is used for remotely controlling a TV, an air conditioner, an optical disc player, and the like.

On the other hand, remote control devices for TVs, remote control devices for air conditioners, remote control devices for optical disc players, etc., in which different control codes are assigned to remote control of each electronic device, are used.

For the sake of user convenience, the number of electronic apparatuses employing remote control apparatuses is increasing. However, when a separate remote control apparatus is used for each electronic apparatus, there is a disadvantage in that the use of the user is inconvenient. Accordingly, efforts have been made to solve such a user inconvenience.

An object of the present invention is to provide a remote control device and a method of operating the same that can easily register a device corresponding to a reflection pattern using a reflection pattern.

It is another object of the present invention to provide a remote control device capable of performing remote control on a plurality of devices and an operation method thereof.

According to an aspect of the present invention, there is provided a remote control apparatus including a transmitter for transmitting a transmission signal, a receiver for receiving a reflection signal from the first reflection pattern, an acoustic output module, The control unit judges whether or not it is a pre-registered reflection pattern based on the signal, and when it is not the pre-registered reflection pattern, enters the reflection pattern registration mode and sets the indicator indicating the reflection pattern registration mode to at least one And when the information about the first device is received, the reflected signal from the first reflection pattern is registered as the reflection signal of the first device, based on the information about the received first device, And a control section for controlling the reflection pattern based on the reflection signal to be registered as the reflection pattern of the first device.

According to another aspect of the present invention, there is provided a method of operating a remote control device, the method comprising: transmitting a transmission signal; receiving a reflection signal from a first reflection pattern; The method comprising the steps of: confirming whether the first pattern is a pre-registered pattern, a step of entering a pattern registration mode when the pattern is not a pre-registered pattern and outputting an indicator indicating a pattern registration mode, And a control unit that controls the first device and the second device based on the information about the received first device and the reflected signal from the first device, As shown in FIG.

A remote control apparatus according to an embodiment of the present invention includes a transmitter for transmitting a transmission signal, a receiver for receiving a reflection signal from the first reflection pattern, an acoustic output module, a display, If it is not the previously registered reflection pattern, enters the reflection pattern registration mode and outputs an indicator indicating the reflection pattern registration mode through at least one of the sound output module and the display And when the information about the first device is received, the reflection signal from the first reflection pattern is registered as the reflection signal of the first device based on the information about the received first device, or the reflection based on the reflection signal And a control unit for controlling the pattern to be registered as a reflection pattern of the first device, It is possible to register a device corresponding to the reflection pattern.

On the other hand, when information on the first device is sequentially received, objects sequentially representing the first device are sequentially generated based on the sequentially received information, and objects sequentially generated are displayed, It is possible to recognize completion of the first device registration.

On the other hand, when it is confirmed based on the received reflection signal that it is a pre-registered reflection pattern, it enters a mode for remote control of the first device and transmits a first remote control signal corresponding to the selected button or item , The first device can be remotely controlled.

On the other hand, when receiving a reflection signal from the second reflection pattern in a state in which the remote control screen for the first device is displayed, the remote control screen for the first device is switched to transmit the remote control screen for the second device By displaying the control screen, it becomes possible to perform remote control for a plurality of devices.

1 is a diagram illustrating a device remote control system according to an embodiment of the present invention.
2 is a diagram illustrating a device-specific remote control device or a remote control screen.
Figs. 3A to 3F are diagrams illustrating how the types of devices controlled according to the direction of the orientation of the remote control device of Fig. 1 are variable.
4A to 4B are diagrams showing the appearance of the remote control device of FIG.
5 is a diagram illustrating an example of a reflection pattern.
FIG. 6 is a view showing a reflection signal output using a reflection pattern. FIG.
7 is an internal block diagram of the remote control apparatus of FIG.
8 is a flowchart showing an example of an operation method of a remote control apparatus according to an embodiment of the present invention
Figs. 9A to 16 are views referred to the description of the operation method of the remote control apparatus of Fig.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a diagram illustrating a device remote control system according to an embodiment of the present invention.

1, a device remote control system 10 according to an embodiment of the present invention includes a remote control device 200, a plurality of devices 100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h, and reflective patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h that are mounted in or disposed around each device.

On the other hand, the device remote control system 10 may further include a gateway 400, servers 700a, ..., 700n, and the like.

In the drawing, an example of a device includes an image display device 100a such as a TV, a set top box 100b, an air conditioner 100c, a lighting device 100d, a robot cleaner 100e, a refrigerator 100f, (100g), a temperature controller (100h), and the like, but various other examples are possible. On the other hand, the device shown in the drawing may be called a home device.

For example, it is possible to use a device such as a washing machine, an optical disk reproducing device, a game device, a security device such as a gas valve or a security camera, a door that is opened and closed electronically, a window that is electronically opened and closed, Electronic frames, energy storage devices (ESS), digital cameras, perfume emitting devices, vehicles, drones, and the like.

Hereinafter, the devices shown in the drawings are mainly described.

On the other hand, each of the reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h can reflect a transmission signal output from the remote control device 200 that is directed.

That is, each of the reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h outputs a reflection signal corresponding to the reflection pattern using the transmission signal output from the remote control device 200 can do.

The remote control apparatus 200 is capable of displaying the images on the basis of the reflection signals from the respective reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g and 101h, Can be identified.

The reflection signal or reflection pattern may include at least one of device type information, manufacturer information, device model name information, device status information, and device control command related information for each device.

On the other hand, the device status information may include an ON / OFF state of the device, an operation value state at the time of device operation, and the like.

Meanwhile, the transmission signal is a signal having good directivity, and may be an Infra Red signal, an RF (Radio Frequency) signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, (Ultra Wideband) signal.

The remote control apparatus 200 can receive a plurality of reflection signals from the respective reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h.

At this time, when the remote control device 200 is provided with any one of the plurality of devices 100a, 100b, 100c, 100d, 100e, 100f, 100g, and 100h, or a plurality of the reflection patterns 101a, 101b, 101c, 101e, 101f, 101g, and 101h, the remote control device 200 can detect one of the received at least one reflected signal as a representative reflected signal.

Then, the remote control device 200 performs signal processing on the detected reflected signal or the representative reflected signal, and transmits the device type information, manufacturer information, device model name information, device status information, device control Based on at least one of the information associated with the command, a device corresponding to the reflected signal may be identified or identified.

Alternatively, the remote control device 200 can compare the detected reflected signal or the representative reflected signal with the data related to the reflected signal stored in the remote control device 200, thereby identifying or identifying the device.

Then, the remote control device 200 can control to display a remote control screen for the confirmed device remote control.

When an item of the remote control screen is selected by the user after the display of the remote control screen for device control, the remote control device 200 outputs the signal corresponding to the selected item, that is, the remote control signal, Can be transmitted.

For example, when the remote control device 200 is aimed at the air conditioner 100c, the remote control device 200 sets the first item of the remote control screen to a remote control screen And to output and transmit a remote control signal related to the wind force adjustment to the air conditioner in the operation of the first item.

As a result, when the remote control device 200 is directed in the first device direction, it detects a first reflected signal from the first reflected pattern attached corresponding to the first device, and based on the detected first reflected signal, And controls to display a first remote control screen for remote control of the first device, detects the received second reflected signal when it is directed to the second device, and, based on the detected second reflected signal, And to display a second remote control screen for remote control of the second device.

Accordingly, remote control of various devices becomes possible with one remote control device 200. [

A set-top box 100b, an air conditioner 100c, a lighting apparatus 100d, a robot cleaner 100e, a refrigerator 100f, and an air conditioner 100d according to the direction of the remote control device 200 The air purifier 100g, and the temperature controller 100h can be remotely controlled.

The remote control signal output from the remote control device 200 may include an infrared signal, an RF signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, A laser signal, and a UWB (Ultra Wideband) signal.

On the other hand, the remote control apparatus 200 can receive, from the gateway 400, control command information for at least a part of the remote control screen for remote control for each device.

Alternatively, the remote control device 200 may transmit control command information for at least a part of the remote control screen to the gateway 400, for remote control for each device.

In particular, the gateway 400 may be configured to provide control over at least some of the remote control screens, for remote control to each device, from the external servers 700a, ..., 700n, Command information can be received.

At this time, the external servers 700a, ..., 700n may be a server operated by each device manufacturer or a server storing information about each device.

On the other hand, according to the present invention, when the remote control device 200 outputs a transmission signal and receives a reflection signal from a predetermined reflection pattern, the reflection pattern registration mode enters the reflection pattern registration mode And outputting at least one of the indicators indicative of the first reflection pattern through at least one of the sound output module 455 and the display 480. When information on the first device is received, The reflection signal from the first device 101a can be registered as the reflection signal of the first device or the reflection pattern based on the reflection signal can be registered as the reflection pattern of the first device. This makes it possible to easily register a device corresponding to the reflection pattern.

On the other hand, when information on the first device is sequentially received, objects sequentially representing the first device are sequentially generated based on the sequentially received information, and objects sequentially generated are displayed, It is possible to recognize completion of the first device registration.

2 is a diagram illustrating a device-specific remote control device or a remote control screen.

2 shows an example of a remote control device 201a for a video display device, a remote control device 201b for an optical disc player, a remote control device 201c for an air conditioner, and a remote control device 201d for a robot cleaner do.

As shown in FIG. 2, when a remote control device or the like, to which different codes are allocated for remote control of each electronic device, is used, the number of remote control devices increases, which is inconvenient for a user to use.

In the present invention, a remote control device capable of remote control of a plurality of devices is presented more easily.

Figs. 3A to 3F are diagrams illustrating how the types of devices controlled according to the direction of the orientation of the remote control device of Fig. 1 are variable.

3A illustrates a case where the remote control device 200 is oriented in the direction of the air conditioner 100c among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control apparatus 200 receives at least one reflection signal including a reflection signal from the reflection pattern 101c corresponding to the air conditioner 100c. Then, the remote control device 200 detects the device identification information in the received at least one reflected signal, and based on the detected device identification information, identifies whether or not the remotely controllable device is the air conditioner 100c can do.

For example, when at least one of device type information, manufacturer information, and device model name information is included in the detected reflected signal, the remote control device 200 performs signal processing on the reflected signal, At least one of manufacturer information and device model name information is extracted and the device corresponding to the reflected signal can be identified or identified based on at least one of the extracted device type information, manufacturer information, and device model name information.

As another example, the remote control apparatus 200 may be configured such that the reflected signal received and detected, the reflected signal stored in the memory 465, and the reflected signal detected when the received and detected reflected signal is a set specific signal, The device can be identified or identified by comparison with associated data.

More specifically, when the received and detected reflected signal is a space-based pattern signal, the remote control device 200 compares the space-based pattern signal-related data stored in the memory 465 with the received pattern signal , The device can be identified or identified.

Then, the remote control device 200 can control the display of the remote control screen for the air conditioner 100c after identifying that the device to be oriented is the air conditioner 100c.

On the other hand, when the device identification is completed or the remote control screen display is completed based on the reflection signal detection, the remote control device 200 outputs the device controllable message 311a as a sound, Can emit light for a predetermined time, or can output a vibration. Thereby, the user can recognize that air conditioning control is possible. On the other hand, FIG. 3a shows outputting an air conditioner controllable message 311a such as "Control the air conditioner" as a sound.

Alternatively, for convenience of use by the user, the device whose identification is completed or is controllable by the remote control device 200 may be configured such that the LED included in the device or the transmission device emits light for a predetermined period of time, It is also possible to make a specific sound in the sound device or display a remotely controllable message of the remote control device 200 on the display included in the device or the transmission device.

Particularly, when a predetermined item in the remote control screen is selected after the remote control screen display is completed, the remote control device 200 can transmit the remote control signal corresponding to the control command of the predetermined item to the air conditioner 100c .

On the other hand, the air conditioner 100c may emit the LED built in the air conditioner 100c for a predetermined time after receiving the remote control signal. Thereby, the user can recognize that the air conditioning control is being performed.

Next, FIG. 3B illustrates a case where the remote control device 200 is directed in the direction of the image display device 100a among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives the reflection signal from the reflection pattern 101a corresponding to the video display device 100a.

Then, the remote control device 200 detects the device identification information in at least one reflected signal including the identification signal received from the video display device 100a, and based on the detected device identification information, It is possible to confirm or identify that the video display device 100a is the video display device 100a. The method of confirming the video display device 100a will be omitted with reference to the description of Fig. 3a.

Then, the remote control device 200 can control to display a remote control screen for the video display device 100a after confirming that the device to be directed is the video display device 100a.

Next, FIG. 3C illustrates a case where the remote control device 200 is directed in the direction of the lighting device 100d among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control apparatus 200 receives a reflection signal, for example, an infrared (IR) signal from the reflection pattern 101d corresponding to the illumination apparatus 100d.

The remote control device 200 can confirm that the device to be directed is the lighting device 100d based on the infrared (IR) signal. The method of confirming the illumination device 100d is omitted by referring to the description of Fig. 3a.

Then, after confirming that the device to be directed is the lighting device 100d, the remote control device 200 can control to display the remote control screen for the lighting device 100d.

Next, FIG. 3D illustrates a case where the remote control device 200 is oriented in the direction of the robot cleaner 100e among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives the reflection signal from the reflection pattern 101e corresponding to the robot cleaner 100e.

Then, the remote control device 200 detects the device identification information in at least one reflected signal including the identification signal received from the robot cleaner 100e, and based on the detected device identification information, , The robot cleaner 100e can be confirmed or identified. The method of confirming the robot cleaner 100e will be omitted with reference to the description of Fig. 3a.

After confirming that the device to be oriented is the robot cleaner 100e, the remote control device 200 can control to display the remote control screen for the robot cleaner 100e.

3E shows a case where the remote control device 200c transmits the remote control enable signal Skeystc to the air conditioner 100c when the setting for the remote control of the air conditioner 100c is completed .

The air conditioner 100c may display the air conditioner remotely controllable message 311 ac on the display 180c or output the air conditioner remotely controllable message 311ab as a sound after receiving the remote control enable signal Skeystc .

Instead of outputting the air conditioner controllable message 311a such as " Controlling the air conditioner in the remote control device 200, unlike FIG. 3A, the remote controllable signal Skeystc is sent to the air conditioner 100c 100c, and it is also possible that the air conditioner remote control enable messages 311ab, 311ac are output from the air conditioner 100c.

On the other hand, FIG. 3F shows a case where, when the setting for remote control of the video display device 100a is completed, the remote control device 200 causes the video display device 100a to display a remote control enable signal Skeysta, And transmitted to the device 100a.

After receiving the remote control enable signal Skeysta, the video display device 100a displays the video display device remote control enablement message 311bc on the display 180a or the video display device remote control enablement message 311bb Sound can also be output.

4A to 4B are diagrams showing the appearance of the remote control device of FIG.

4A illustrates that the display 480 is displayed in the upper case 297 of the remote control apparatus according to an embodiment of the present invention.

Next, Fig. 4B illustrates that when the slide type upper case 297 is operated up, the lower case 296 is fixed, and the upper case 297 moves in the upward direction.

The lower case 296 may include a first button 401 associated with power on / off and a second button 402 associated with condition execution.

Meanwhile, the first button 401 and the second button 402 may be provided in the key input unit (430 of FIG. 7).

4B, when the upper case 297 and the lower case 296 are separated from each other, the remote control device 200 can be activated.

5 is a diagram illustrating an example of the reflection pattern 101a.

Referring to the drawing, it is preferable that the reflection pattern 101a is an infrared ray pattern.

FIG. 6 is a view showing a reflection signal output using a reflection pattern. FIG.

Referring to the drawing, the reflection pattern 101ab of FIG. 6 is a 3X3-size infrared pattern, and a reflection material can be applied to a part of 3X3.

For example, when the transmission signal SIR is an infrared signal, the reflection pattern 101ab can output the reflection signal Sida corresponding to the transmission signal transmission signal SIR.

The size and pattern of the reflection signal Sida are varied by the shape of the reflection pattern 101ab or the like so that the remote control device 200 can identify the device corresponding to the reflection pattern 101ab.

7 is an internal block diagram of the remote control apparatus of FIG.

The remote control device 200 includes a wireless communication unit 420, a key input unit 430, a microphone 435, a sensor unit 440, an output unit 450, a power supply unit 460, A controller 470, a display 480, a camera 495, and a fingerprint recognition unit 499.

The wireless communication unit 420 can transmit and receive signals with any one of the devices, as described above. To this end, the wireless communication unit 420 may include a receiving unit 423 and a transmitting unit 421.

In this embodiment, the remote control apparatus 200 may include a receiving section 423 for receiving a device reflection signal and a transmitting section 421 for outputting a remote control signal or an output signal or a calling signal.

The transmitting unit 421 is a unit for transmitting an infrared signal, an RF signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, a laser signal, and a UWB Any one of the transmission signals can be output.

Meanwhile, the transmitter 421 may transmit and receive signals including an infrared signal, an RF signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, a laser signal, an Ultra Wideband (UWB) The remote control signal can be output.

For example, the transmitting unit 421 includes an IR module 421a, and can output a transmission signal based on an infrared signal. On the other hand, the transmitting unit 421 can output a remote control signal based on an infrared signal.

Meanwhile, the transmitting unit 421 includes an RF module 421b, and can output an RF-based remote control signal.

The receiving unit 423 is a unit for receiving signals such as an Infra Red signal, an RF (Radio Frequency) signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, Any one of the reflection signals can be received from the reflection pattern 101.

On the other hand, when the device is the video display device 100a, the remote control device 200 can transmit a signal containing information on the pointing information of the remote control device 200, for example, movement and the like.

The key input unit 430 may include a plurality of keys. The plurality of keys may be implemented as a keypad, a button, a touch pad, or a touch screen.

The microphone 435 receives the user's voice, converts the received user's voice into an electrical signal, and transmits the electrical signal to the control unit 470.

The sensor unit 440 may include a gyro sensor 441 or an acceleration sensor 443. The gyro sensor 441 can sense information about the motion of the remote control device 200. [

For example, the gyro sensor 441 can sense information about the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 443 can sense information on the moving speed and the like of the remote control device 200.

The output unit 450 may output a vibration or a sound signal corresponding to the operation of the key input unit 430 or may emit the LED. The user can recognize whether the key input unit 430 is operated through the output unit 450.

For example, the output unit 450 includes an LED module 451 that is turned on when the key input unit 430 is operated or an IR signal is transmitted or received through the wireless communication unit 425, a vibration module 453 that generates vibration, And an audio output module 455 for outputting the audio output signal.

The power supply unit 460 supplies power to the remote control device 200. The power supply unit 460 can reduce power waste by interrupting the power supply when the remote controller 200 is not moving for a predetermined period of time. The power supply unit 460 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The memory 465 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [

In particular, the reflection pattern corresponding to the received signal and the received signal can be stored for each device.

The control unit 470 controls various matters related to the control of the remote control device 200.

When receiving at least one reflection signal including a device reflection signal from a reflection pattern corresponding to at least one device or device through the reception unit 423, the control unit 470 controls the reception unit 423 to transmit the received at least one reflection signal And at least one of the plurality of keys is matched to a control command for remote control of the device, and a key matched to the control command is selected It is possible to control the transmitting unit 421 so as to output the remote control signal corresponding to the control command.

On the other hand, the control unit 470 can identify the device based on the reflection signal received from the reflection pattern corresponding to the device or the device, when the remote control device is oriented in the device direction.

On the other hand, when the remote control device 200 is directed to the first device, the control unit 470 detects the first reflected signal from at least one reflected signal including the first reflected signal received from the first device , At least one of the plurality of keys is matched to a control command for remote control of the first device based on the detected first reflected signal and when the remote control device 200 is oriented in the second device direction, Detecting at least one reflected signal from at least one reflected signal including a second reflected signal received from a second device and detecting at least one of the plurality of keys based on the detected second reflected signal, Control commands for control purposes.

On the other hand, the control unit 470 can control the remote control signal corresponding to the predetermined key operation of the key input unit 430 to be transmitted to the device through the wireless communication unit 425. [

On the other hand, the control unit 470 identifies the video display device 100a by directing the remote control device 200 in the direction of the video display device 100a, and when a part of the control keys is the control instruction of the video display device 100a A signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 440 or a pointing signal can be transmitted to the image display device 100a through the wireless communication unit 425. [

On the other hand, based on the reflection signal received by the receiver 423, the control unit 470 confirms whether or not it is a pre-registered reflection pattern, and if it is not the pre-registered reflection pattern, enters the reflection pattern registration mode, Controls to output an indicator indicating the pattern registration mode through at least one of the sound output module 455 and the display 480. When information on the first device is received, It is possible to register the reflection signal from the first reflection pattern 101a as the reflection signal of the first device or to register the reflection pattern based on the reflection signal as the reflection pattern of the first device.

On the other hand, when information on the first device is sequentially received, the control unit 470 sequentially generates objects representing the first device based on information sequentially received, and sequentially displays the generated objects Can be controlled.

On the other hand, the receiving unit 423 receives the remote control signal from the remote control device 201a of the first device, and the control unit 470 determines whether or not it is a remote signal of the first device based on the received remote control signal Based on the remote control signal of the first device, objects representing the first device are sequentially generated, and objects to be sequentially generated are displayed on the display 480. [

On the other hand, the control unit 470 extracts the first device information from the sound including the first device information input through the microphone 435, and sequentially outputs the object representing the first device, And controls the display 480 to display the sequentially generated objects.

On the other hand, the receiving unit 423 can receive the information about the first device from the gateway 400, and the control unit 470 can receive the information about the first device received via the gateway 400 It is possible to register the reflection signal from the first reflection pattern 101a as the reflection signal of the first device or to register the reflection pattern based on the reflection signal as the reflection pattern of the first device.

On the other hand, the control unit 470 controls the reflection pattern registration mode to be terminated after the reflection pattern registration of the first device and controls the indicator indicating the end of the reflection pattern registration mode to be at least one of the sound output module 455 or the display 480 Can be controlled to output through one.

On the other hand, when it is confirmed based on the received reflection signal that it is a pre-registered reflection pattern, the control unit 470 enters a mode for remote control of the first device, Controls to display a remote control screen for the device and controls to transmit the first remote control signal corresponding to the first item when the first item in the remote control screen for the first device is selected.

On the other hand, the control unit 470 can control to terminate the remote control screen display for the first device when the item selection in the remote control screen for the first device is not for a predetermined time.

On the other hand, the transmitting unit 421 transmits the transmission signal while the first device remote control screen is displayed, and the receiving unit 423 receives the reflection signal from the second reflection pattern. When it is determined based on the reflection signal from the two reflection patterns that the first device is a pre-registered reflection pattern, it enters a mode for remote control of the second device, switches the remote control screen for the first device, A remote control screen for a second device having an item can be displayed.

On the other hand, the camera 495 can capture an image. Particularly, when the camera 495 is directed toward the user's face, an image including the user's face can be captured.

The control unit 470 can identify or confirm the user based on the captured user face image and pre-stored user image related data.

On the other hand, the fingerprint recognition unit 499 can capture an image including the fingerprint of the user. In this case, the control unit 470 may identify or confirm the user based on the captured user finger fingerprint image and the stored user finger fingerprint image related data.

On the other hand, the control unit 470 performs user authentication based on the image captured by the camera 495, and controls the remote control of the device when the user authentication is successful.

On the other hand, the control unit 470 controls the user information to be transmitted to the devices that can be controlled and can be controlled, and when the user authentication confirmation information is received from the device, the control unit 470 can perform remote control for the devices.

Meanwhile, the device 100 may include a wireless communication unit 411 capable of wirelessly transmitting / receiving signals to / from the remote control device 200 and a control unit 170 for controlling operations corresponding to the received wireless signal .

The wireless communication unit 411 can wirelessly transmit and receive signals to and from the remote control device 200. [ In addition, the wireless communication unit 411 can receive signals transmitted by the remote control device 200 according to various communication standards.

FIG. 8 is a flowchart showing an example of an operation method of a remote control apparatus according to an embodiment of the present invention, and FIGS. 9A to 16 are views referencing a description of an operation method of the remote control apparatus of FIG.

First, referring to Fig. 8, the transmitting section 421 of the remote control apparatus 200 transmits a transmission signal (S805).

9A, after the first reflection pattern 101a is newly attached to the first device 100a, the remote control device 200 transmits the first reflection pattern 101a toward the first reflection pattern 101a, Signal (SIR).

The first reflection pattern 101a can output a reflection signal Sida corresponding to the reflection pattern after the transmission signal SIR is incident, as shown in Fig. 9A.

Next, the receiving section 423 of the remote control apparatus 200 receives the reflection signal Sida from the first reflection pattern 101a (S810).

Next, the control unit 470 of the remote control device 200 confirms whether or not it is a pre-registered reflection pattern based on the reflection signal received by the receiving unit 423 (S815).

Next, when the reflection pattern based on the reflection signal received by the receiving unit 423 is not the pre-registered reflection pattern (S820), the control unit 470 of the remote control device 200 enters the reflection pattern registration mode S825), and controls to output an indicator indicating the reflection pattern registration mode through at least one of the sound output module 455 and the display 480 (S830).

9A illustrates that the indicator indicating the reflection pattern registration mode is outputted as the sound 900 through the sound output module 455. FIG.

Next, the control unit 470 of the remote control device 200 receives the information about the first device (S840), and based on the information about the received first device, the reflection from the first reflection pattern 101a A signal may be registered as a reflection signal of the first device or a reflection pattern based on the reflection signal may be registered as a reflection pattern of the first device (S850).

Next, the control unit 470 of the remote control device 200 exits the reflection pattern registration mode after registration with the reflection pattern of the first device (S855).

On the other hand, in step S820, the control unit 470 of the remote control device 200 controls the remote control of the first device based on the reflection signal received by the receiving unit 423, (Step S860).

On the other hand, in relation to the operation 850 (S850), when the control unit 470 of the remote control device 200 determines that the reflection pattern is a pre-registered reflection pattern based on the received reflection signal, And may match a control command for remote control of the first device to at least a portion of the plurality of buttons.

As another example, the control unit 470 of the remote control device 200 enters a mode for remote control of the first device, if it is confirmed that it is a pre-registered reflection pattern, based on the received reflection signal, It is possible to control to display the remote control screen for the first device having the remote control item.

Next, when the first button of the plurality of buttons or the first item in the remote control screen for the first device is selected (S865), the control unit 470 of the remote control device 200 selects the first item The control unit 470 controls the first device 101a to transmit the first remote control signal corresponding to the first button or the first item in the remote control screen for the first device (S870).

For example, the information about the first device may be extracted from a sound containing the first device information extracted from the remote control signal received from the remote control device 201a of the first device or received via the microphone 435 Or may be extracted from the signal including the information about the first device from the gateway 400. [

On the other hand, the control unit 470 of the remote control device 200 can control to output guide information 901 for button operation for the device to be registered as shown in Fig. 9B.

For example, when the remote control device 201a of the video display device 101a is a device to be registered, the control unit 470 of the remote control device 200, as shown in FIG. 9B, (901) as a sound.

Accordingly, when the user presses the power button 201ab of the remote control device 201a, the remote control device 201a of the video display device 101a transmits the power signal Sit1 to the remote control device 200a, As shown in FIG. Thus, the receiving section 423 of the remote control apparatus 200 receives the power supply signal Sit1.

On the other hand, the control unit 470 of the remote control device 200 can search for a matching power source signal among the previously registered power source signals registered in the memory 465 based on the received power source signal Sit1.

On the other hand, the control unit 470 of the remote control device 200 may not be able to identify the corresponding device only with the received power signal Sit1.

In consideration of this point, the control unit 470 of the remote control device 200 can control to sequentially output the guide information for the button operation for the device to be registered.

FIG. 9C illustrates that the second guide information 903 for volume button operation is output following the first guide information 901. FIG.

The control unit 470 of the remote control device 200 can control to output the guide information 901 for volume button operation as a sound as shown in Fig.

Accordingly, when the user presses the volume button 201ac of the remote control device 201a, the remote control device 201a of the video display device 101a transmits the volume signal Sit2 to the remote control device 200a, As shown in FIG. Thus, the receiving section 423 of the remote control apparatus 200 receives the volume signal Sit2.

On the other hand, the control unit 470 of the remote control device 200 can search for the matching volume signal among the previously registered volume signals registered in the memory 465 based on the received volume signal Sit2.

On the other hand, the control unit 470 of the remote control device 200 can grasp that it is the remote control signal of the first device using the remote control signals Sit1 and Sit2 as shown in Figs. 9B and 9C.

Then, the control unit 470 of the remote control device 200 can control to register the first reflection pattern as a reflection pattern corresponding to the first device.

The control unit 470 of the remote control device 200 controls the display unit 480 to display the object 929 representing the first device on the display 480 when the first device registration for the first reflection pattern is completed, can do.

On the other hand, the control unit 470 of the remote control device 200 controls to terminate the reflection pattern registration mode after registering the reflection pattern of the first device, and outputs the indicator indicating the end of the reflection pattern registration mode to the sound output module 455 Or through the display 480, via the at least one of the display 480 and the display 480.

FIG. 9D illustrates that an indicator 928 indicating the end of the reflection pattern registration mode is displayed on the display 480. FIG.

On the other hand, Figs. 10A to 10C illustrate obtaining the first device information from the user's sound.

Figs. 10A and 10C are the same as Figs. 9A and 9D, respectively, and a description thereof will be omitted.

10B, when the user outputs a sound 902 containing the first device information, the microphone 435 of the remote control device 200 collects the sound 902 and converts it into an electric signal.

The control unit 470 of the remote control device 200 can control to extract the first device information from the sound 902 to be collected and to register the first reflection pattern with the reflection pattern corresponding to the first device.

When the first device registration for the first reflection pattern is completed, the control unit 470 of the remote control device 200 displays an object 929 representing the first device on the display 480 .

On the other hand, when information on the first device is sequentially received, the control unit 470 of the remote control device 200 sequentially generates objects representing the first device based on information sequentially received, To display an object generated by the user. This will be described with reference to FIG.

11A illustrates an example in which an indicator 921 for registering a reflection pattern is output to the display 480 of the remote control device 200. FIG.

When the first key 430a is selected, the control unit 470 of the remote control device 200 displays a guide message 922 for registration of the reflection pattern on the display 480 as shown in FIG. 11 (b) .

When the first key 430a is selected, the control unit 470 of the remote control device 200 transmits the power button guide message 924 as an example of the guide message to the display (not shown) 480).

9B, when the power supply signal Sit1 is received, the control unit 470 of the remote control device 200 transmits a volume button guide message 928 as another example of the guide message, On the display 480, as shown in Fig.

On the other hand, the control unit 470 of the remote control device 200 displays an object 927 indicating information about the device briefly grasped according to the power supply signal Sit1 as shown in Fig. 11 (d) Can be controlled.

9C, when the volume signal Sit2 is received, the control unit 470 of the remote control device 200 displays an object 929 indicating information on the identified device in accordance with the volume signal Sit2, As shown in Fig. 11 (e).

Thus, by sequentially generating the objects representing the first device based on the sequentially received information, and sequentially displaying the generated objects, the user's convenience of use can be increased.

On the other hand, when the first device registration for the first reflection pattern is completed, the controller 470 of the remote control device 200 displays an indicator 928 indicating the end of the reflection pattern registration mode, as shown in (e) So that it can be displayed on the display 480.

Figs. 12A to 12D correspond to Figs. 9A to 9D, and there is a difference in performing registration with the air conditioner 100c, not with the image display apparatus 100a.

12A illustrates that the transmission signal SIR is transmitted in the second reflection pattern 101a and the reflection signal Sidc is received in the second reflection pattern 101a.

On the other hand, Fig. 12A illustrates that the indicator indicating the reflection pattern registration mode is outputted as the sound 1100 through the sound output module 455. Fig.

12B illustrates that guide information 1101 for a button operation for a device to be registered is output.

Accordingly, when the user presses the power button 201cb of the air conditioner remote control device 201c, the air conditioner remote control device 201c transmits the power source signal Sia1 to the remote control device 200 . Thus, the receiving section 423 of the remote control apparatus 200 receives the power supply signal Sia1.

On the other hand, the control unit 470 of the remote control device 200 can search for a matching power source signal among the previously registered power source signals registered in the memory 465 based on the received power source signal Sia1.

12C illustrates that the second guide information 1103 for the volume button operation is outputted following the first guide information 1101. [

Accordingly, when the user presses the temperature control button 201cc of the air conditioner remote control device 201c, the remote control device for air conditioner 201c) outputs the temperature control signal Sia2 to the remote control device 200 ). ≪ / RTI > Thus, the receiving section 423 of the remote control apparatus 200 receives the temperature control signal Sia2.

On the other hand, the control unit 470 of the remote control device 200 can search for the matching temperature control signal among the previously registered temperature control signals registered in the memory 465 based on the received temperature control signal Sia2 have.

On the other hand, the control unit 470 of the remote control device 200 can grasp that it is the remote control signal of the second device by using the remote control signals Sia1 and Sia2 as shown in Figs. 12B and 12C.

The control unit 470 of the remote control device 200 can control to register the second reflection pattern 101c in a reflection pattern corresponding to the second device.

The control unit 470 of the remote control device 200 controls the display unit 480 to display the object 1129 representing the first device on the display 480 when the second device registration for the second reflection pattern is completed, can do.

Fig. 12D illustrates that an indicator 1128 indicating the end of the reflection pattern registration mode is displayed on the display 480. Fig.

On the other hand, when information on the second device is sequentially received, the control unit 470 of the remote control device 200 sequentially generates objects representing the second device based on information sequentially received, To display an object generated by the user. This will be described with reference to FIG.

FIG. 13A illustrates that an indicator 1121 for registering a reflection pattern is output on the display 480 of the remote control device 200. FIG.

When the first key 430a is selected, the control unit 470 of the remote control device 200 displays a guide message 1122 for registration of the reflection pattern on the display 480 as shown in FIG. 13 (b) .

When the first key 430a is selected, the controller 470 of the remote controller 200 displays the power button guide message 1124 as an example of the guide message on the display (FIG. 13 480).

12B, when the power supply signal Sia1 is received, the control unit 470 of the remote control device 200 transmits a temperature control button guide message 1128 as another example of the guide message, ) On the display 480, as shown in Fig.

On the other hand, the control unit 470 of the remote control device 200 displays an object 1127 indicating information about the device briefly grasped according to the power supply signal Sia1 as shown in Fig. 13 (d) Can be controlled.

12C, when the temperature control signal Sia2 is received, the control unit 470 of the remote control device 200 displays an object (hereinafter, referred to as " 1129 can be controlled to be displayed as shown in Fig. 13 (e).

Thus, by sequentially generating the objects representing the second device based on the sequentially received information and sequentially displaying the generated objects, the user's convenience of use can be increased.

On the other hand, when the second device registration for the second reflection pattern is completed, the controller 470 of the remote control device 200 displays an indicator 1128 indicating the end of the reflection pattern registration mode, as shown in (e) So that it can be displayed on the display 480.

14 exemplifies reception of the first device information from the gateway 400. Fig.

When the remote control apparatus 200 transmits a transmission signal to the reflection pattern 101f attached to the refrigerator 100f as in 1), the reflection signal is received from the reflection pattern 101f as in 2).

At this time, when the remote control device 200 is not the pre-registered reflection pattern, the remote control device 200 enters the reflection pattern registration mode and can output an indicator indicating the reflection pattern registration mode.

Accordingly, the user presses the button 1401, for example, the WPS button 1401 provided in the refrigerator 100f, as shown in 3), and presses a button (not shown) corresponding to the gateway 400 1401). For example, when the WPS button 1402 is pressed, the refrigerator 100f and the gateway 400 are paired with each other to perform wireless connection. For example, a wireless connection is performed using a WiFi communication method.

Accordingly, the refrigerator 100f can transmit information on the refrigerator, for example, product information, etc., to the gateway 400, as in 5).

The gateway 400 may then send information, e.g., product information, etc., about the refrigerator, such as 6) to the networked, remote control device 200, either automatically or on a separate request have.

The control unit 470 of the remote control device 200 transmits the reflection pattern 101f to the refrigerator 100f using the information on the refrigerator received through the receiving unit 421, As shown in Fig.

On the other hand, the control unit 470 can control to terminate the first device remote control screen display when the item selection in the first device remote control screen is not for a predetermined time. It is possible to control to end the remote control screen display for the first device when there is no input for a predetermined time in order to reduce power consumption.

On the other hand, the transmitting section 421 of the remote control apparatus 200 transmits a transmission signal while the first device remote control screen is displayed, and the receiving section 423 of the remote control apparatus 200 transmits the second reflection pattern And the control unit 470 of the remote control device 200 receives the reflected signal from the second reflection pattern based on the reflection signal from the second reflection pattern, It is possible to switch to the remote control screen for the first device and control to display the remote control screen for the second device having a plurality of remote control items. This will be described with reference to Figs. 15A to 15C.

15A shows a state in which the remote control device 200 outputs a transmission signal SIR to the reflection pattern 101d of the illumination device 100d and receives the reflection signal Sidd, And the remote control screen 1500 for controlling the display unit 100d is displayed.

15B, when the direction of the remote control device 200 is moved, the remote control device 200 outputs the transmission signal SIR. However, if there is no reflection pattern in the direction of the direction, Lt; / RTI >

In this case, the control unit 470 of the remote control device 200 can control to continuously display the remote control screen 1500 for lighting device control, as shown in FIG. 15B.

15C, the remote control device 200 outputs a transmission signal SIR and outputs the transmission signal SIR to the reflection pattern 101a of the video display device 100a The remote control screen 1510 for controlling the image display device 100a is displayed on the display 480 as the transmission signal SIR is output and the reflection signal Sida is received.

In this manner, when it is confirmed that the reflection pattern is a pre-registered reflection pattern based on the reflection signal from the second reflection pattern, the control unit 470 of the remote control device 200 enters the mode for remote control of the second device , It is possible to switch the remote control screen for the first device so as to display the remote control screen for the second device having the plurality of remote control items.

On the other hand, the remote controller 200 control unit 470 can transmit the pointing signal to the image display apparatus 100a when the remote control object is the image display apparatus 100a.

Fig. 16 illustrates that the pointer 205 based on the pointing signal from the remote control device 200 is displayed on the video display device 100a.

On the other hand, the control unit 470 of the remote control device 200 controls the display 480 to display the switched remote control screen 1510, while the video display device 100a displays the remote control screen 1510, The control unit 150 can control to transmit more information about the network 1500 to the network.

16, the video display device 100a can display a remote control screen 1420 for remote control of the lighting device 100d.

At this time, the image display apparatus 100a can display the position of the remote control screen 1420 in the left direction based on the received pointing signal.

Meanwhile, the operation method of the remote control apparatus of the present invention can be implemented as a code readable by a processor on a recording medium readable by a processor included in the remote control apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

A transmission unit for transmitting a transmission signal;
A receiver for receiving a reflection signal from the first reflection pattern;
Acoustic output module;
display;
And a control unit for controlling the display unit based on the received reflection signal to check whether or not it is a pre-registered reflection pattern and to enter a reflection pattern registration mode when the pre- Or through the at least one of the displays,
When the information about the first device is received, a reflection signal from the first reflection pattern is registered as a reflection signal of the first device based on the information about the received first device, And a control unit for controlling to register the reflection pattern based on the reflection pattern of the first device. The method according to claim 1,
Wherein,
Wherein when the information on the first device is sequentially received, objects sequentially representing the first device are sequentially generated based on the sequentially received information, and objects sequentially generated are displayed on the basis of the sequentially received information. Remote control device. The method according to claim 1,
The receiver may further comprise:
Receiving a remote control signal from a remote control device of the first device,
Wherein,
Determines whether the remote signal is the remote signal of the first device based on the received remote control signal,
And sequentially displays the object representing the first device on the basis of the remote control signal of the first device to display the sequentially generated object on the display. The method according to claim 1,
And a microphone for receiving a sound including the first device information,
Wherein,
Extracting the first device information from the sound,
And sequentially displays the objects representing the first device on the basis of the first device information to display the sequentially generated objects on the display. The method according to claim 1,
The receiver may further comprise:
And receives information on the first device from the gateway. The method according to claim 1,
Wherein,
Controls to exit the reflection pattern registration mode after the reflection pattern registration of the first device and controls to output an indicator indicating the end of the reflection pattern registration mode through at least one of the sound output module or the display Remote control device. The method according to claim 1,
Wherein,
A control unit for entering a mode for remote control of the first device when at least a part of the plurality of buttons is controlled for remote control of the first device, Matching commands,
And controls to transmit a first remote control signal corresponding to a control command matched with the first button when the first button among the plurality of buttons is operated. The method according to claim 1,
Wherein,
When it is confirmed based on the received reflection signal that it is a pre-registered reflection pattern, enters a mode for remote control of the first device and displays a remote control screen for a first device having a plurality of remote control items Display,
And controls to transmit the first remote control signal corresponding to the first item when the first item in the remote control screen for the first device is selected. 9. The method of claim 8,
Wherein,
And controls to end the remote control screen display for the first device when the item selection in the remote control screen for the first device is not for a predetermined time. 9. The method of claim 8,
The transmitter may further comprise:
And transmits a transmission signal in a state in which the remote control screen for the first device is displayed,
The receiver may further comprise:
Receiving a reflected signal from the second reflective pattern,
The control unit enters a mode for remote control of the second device when it is confirmed that it is a pre-registered reflection pattern based on the reflection signal from the second reflection pattern, And displays a remote control screen for a second device having a plurality of remote control items. Transmitting a transmission signal;
Receiving a reflected signal from the first reflection pattern;
Confirming whether the received reflection signal is a pre-registered reflection pattern based on the received reflection signal;
If the pattern is not a previously registered reflection pattern, enters a reflection pattern registration mode and outputs an indicator indicating a reflection pattern registration mode;
Receiving information about a first device;
Wherein the control unit registers the reflection signal from the first reflection pattern as a reflection signal of the first device based on the information on the received first device or a reflection pattern based on the reflection signal on the reflection pattern of the first device And registering the remote control device with the remote control device. 12. The method of claim 11,
And sequentially generating objects representing the first device based on the sequentially received information and sequentially displaying the generated objects when the information about the first device is sequentially received The remote control apparatus comprising: 12. The method of claim 11,
Wherein the step of receiving information on the first device comprises:
Receiving a remote control signal from a remote control device of the first device,
Determining whether the first device is a remote signal based on the received remote control signal; And
And sequentially generating and displaying an object representing the first device based on the remote control signal of the first device. 12. The method of claim 11,
Wherein the step of receiving information on the first device comprises:
Receiving a sound comprising first device information,
Extracting the first device information from the sound; And
And sequentially generating and displaying an object representing the first device based on the first device information. 12. The method of claim 11,
Wherein the step of receiving information on the first device comprises:
And receiving information on the first device from the gateway. ≪ Desc / Clms Page number 19 > 12. The method of claim 11,
Terminating the reflection pattern registration mode after registering the reflection pattern of the first device;
And outputting an indicator indicating the end of the reflection pattern registration mode. 12. The method of claim 11,
A control unit for entering a mode for remote control of the first device when at least a part of the plurality of buttons is controlled for remote control of the first device, Matching an instruction;
And transmitting a first remote control signal corresponding to a control command matched with the first button when the first button of the plurality of buttons is operated. 12. The method of claim 11,
When it is confirmed based on the received reflection signal that it is a pre-registered reflection pattern, enters a mode for remote control of the first device and displays a remote control screen for a first device having a plurality of remote control items Displaying;
And transmitting a first remote control signal corresponding to the eleventh item when the eleventh item in the remote control screen for the first device is selected. 19. The method of claim 18,
And terminating the remote control screen display for the first device when the item selection in the remote control screen for the first device is not performed for a predetermined time. 19. The method of claim 18,
Transmitting a transmission signal in a state that the remote control screen for the first device is displayed;
Receiving a reflected signal from a second reflective pattern;
When it is confirmed that the reflected pattern is a pre-registered reflection pattern based on the reflection signal from the second reflection pattern, enters a mode for remote control of the second device to switch the remote control screen for the first device, Further comprising the step of displaying a remote control screen for a second device having a remote control item of the remote control item.

Images