KR102484779B1 - Remote controller capable of remotely controlling a plurality of device, and method for operating the same - Google Patents

Abstract

The present invention relates to a remote control apparatus capable of remotely controlling a plurality of devices and an operation method thereof. A remote control device according to an embodiment of the present invention includes a transmitter for transmitting a transmission signal, a receiver for receiving a reflection signal from a first reflection pattern, a sound output module, a display, and a device based on the received reflection signal. It checks whether it is a registered reflective pattern, and if it is not a pre-registered reflective pattern, enters the reflective pattern registration mode, and controls an indicator indicating the reflective pattern registration mode to be output through at least one of a sound output module or a display; , When the information on the first device is received, the reflection signal from the first reflection pattern is registered as the reflection signal of the first device based on the received information on the first device, or the reflection pattern based on the reflection signal and a control unit for controlling to register the reflective pattern of the first device. Accordingly, it is possible to conveniently register a device corresponding to the reflection pattern using the reflection pattern.

Description

Remote controller capable of remotely controlling a plurality of devices, and method for operating the same

The present invention relates to a remote control apparatus and an operation method thereof, which can conveniently register a device corresponding to a reflective pattern using a reflective pattern.

The remote control device is used to remotely control a TV, an air conditioner, an optical disc player, and the like.

Meanwhile, in order to remotely control each electronic device, a remote control device for a TV, a remote control device for an air conditioner, and a remote control device for an optical disc player, to which different control codes are assigned, are used.

For user convenience, the number of electronic devices employing remote control devices tends to increase, but when a separate remote control device is used for each electronic device, it is inconvenient for users to use. Accordingly, efforts are being made to solve such user inconvenience.

An object of the present invention is to provide a remote control apparatus and its operating method, which can conveniently register a device corresponding to a reflective pattern using a reflective pattern.

Another object of the present invention is to provide a remote control apparatus capable of remotely controlling a plurality of devices and an operation method thereof.

A remote control device according to an embodiment of the present invention for achieving the above object includes a transmitter for transmitting a transmission signal, a receiver for receiving a reflection signal from a first reflection pattern, a sound output module, a display, and a received reflection. Based on the signal, it is checked whether it is a pre-registered reflective pattern, and if it is not a pre-registered reflective pattern, a reflective pattern registration mode is entered, and an indicator indicating the reflective pattern registration mode is displayed on at least one of a sound output module or a display. When information on the first device is received, a reflected signal from the first reflection pattern is registered as a reflected signal of the first device based on the received information on the first device, or and a control unit controlling to register a reflection pattern based on the reflection signal as a reflection pattern of the first device.

Meanwhile, a method for operating a remote control device according to an embodiment of the present invention for achieving the above object includes transmitting a transmission signal, receiving a reflection signal from a first reflection pattern, and based on the received reflection signal. checking whether the reflective pattern is pre-registered, and if not, entering the reflective pattern registration mode and outputting an indicator indicating the reflective pattern registration mode, and providing information about the first device A step of receiving a reflection signal from the first reflection pattern based on the received information about the first device, registering the reflection signal as the reflection signal of the first device, or registering the reflection signal based on the reflection signal as the reflection pattern of the first device; It includes registering with

A remote control device according to an embodiment of the present invention includes a transmitter for transmitting a transmission signal, a receiver for receiving a reflection signal from a first reflection pattern, a sound output module, a display, and based on the received reflection signal, It checks whether it is a pre-registered reflective pattern, and if it is not a pre-registered reflective pattern, enters the reflective pattern registration mode and outputs an indicator indicating the reflective pattern registration mode through at least one of the sound output module and the display. And, when the information on the first device is received, based on the received information on the first device, the reflection signal from the first reflection pattern is registered as a reflection signal of the first device, or reflection based on the reflection signal. By including a control unit for controlling registration of the pattern as the reflection pattern of the first device, it is possible to conveniently register a device corresponding to the reflection pattern using the reflection pattern.

Meanwhile, when information on the first device is sequentially received, objects representing the first device are sequentially generated based on the sequentially received information, and the sequentially generated objects are displayed so that the user can intuitively, Completion of the first device registration can be recognized.

On the other hand, based on the received reflection signal, if it is confirmed that the reflection pattern is pre-registered, the mode for remote control of the first device is entered and the first remote control signal corresponding to the selected button or item is transmitted. , the first device can be remotely controlled.

Meanwhile, when a reflection signal is received from the second reflection pattern while the remote control screen for the first device is displayed, the remote control screen for the first device is switched and the remote control screen for the second device having a plurality of remote control items is received. By displaying the control screen, it is possible to perform remote control of a plurality of devices.

1 is a diagram showing a device remote control system according to an embodiment of the present invention.
2 is a diagram illustrating a remote control device or remote control screen for each device.
3a to 3f are views illustrating that the type of device to be controlled varies according to the direction of the remote controller of FIG. 1 .
4a to 4b are views showing the appearance of the remote control device of FIG. 1 .
5 is a diagram illustrating an example of a reflection pattern.
6 is a diagram illustrating reflection signal output using a reflection pattern.
7 is an internal block diagram of the remote control device of FIG. 1;
8 is a flowchart showing an example of a method of operating a remote control device according to an embodiment of the present invention.
9A to 16 are diagrams referred to in the description of the method of operating the remote control device of FIG. 8 .

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "unit" for the components used in the following description are simply given in consideration of ease of writing this specification, and do not themselves give a particularly important meaning or role. Accordingly, the “module” and “unit” may be used interchangeably.

1 is a diagram showing a device remote control system according to an embodiment of the present invention.

Referring to FIG. 1, according to an embodiment of the present invention, the device remote control system 10 includes a remote control apparatus 200, a plurality of devices 100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h), and reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h mounted in each device or disposed around the device.

Meanwhile, the device remote control system 10 may further include a gateway 400, servers 700a, ..., 700n, and the like.

In the drawing, as an example of a device, an image display device 100a such as a TV, a set-top box 100b, an air conditioner 100c, a lighting device 100d, a robot cleaner 100e, a refrigerator 100f, and an air purifier (100g), a thermostat (100h), etc. are exemplified, but various other examples are possible. Meanwhile, the device shown in the drawings may be referred to as a home device.

For example, as a device, a washing machine, an optical disc player, a game machine, a gas valve, a security device such as a security camera, an electronically opened and closed door, an electronically opened and closed window, a sound output device, and a game machine. , Electronic photo frames, energy storage devices (ESS), digital cameras, fragrance emitting devices, vehicles, drones, and the like may be further exemplified.

Hereinafter, the devices shown in the drawings will be mainly described.

Meanwhile, each of the reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h may reflect a transmission signal output from the directed remote control device 200.

That is, each reflection pattern (101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h) uses a transmission signal output from the remote control device 200 to output a reflection signal corresponding to the reflection pattern. can do.

The remote control device 200 controls the device based on the reflection signals from the respective reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h, in particular, according to the reflection patterns based on the reflection signals. can be identified.

The reflection signal or reflection pattern may include at least one of device type information, manufacturer information, device model name information, device state information, and information related to a device control command for each device.

Meanwhile, the device state information may include an on/off state of the device, an operating value state during device operation, and the like.

On the other hand, the transmission signal is a signal with good directivity, such as an infrared (Infra Red) signal, an RF (Radio Frequency) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, a laser signal, and a UWB signal. (Ultra Wideband) signal.

The remote control device 200 may receive a plurality of reflected signals from each of the reflection patterns 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h.

At this time, the remote control apparatus 200 is any one of a plurality of devices (100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h), or a plurality of reflection patterns (101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h), the remote control device 200 may detect one reflected signal among at least one received reflected signal as a representative reflected signal.

And, the remote control device 200 performs signal processing on the detected reflection signal or representative reflection signal, and includes device type information, manufacturer information, device model name information, device state information, and device control included in the detected identification signal. Based on at least one of information related to the command, a device corresponding to the reflected signal may be identified or identified.

Alternatively, the remote control device 200 may check or identify the device by comparing the detected reflected signal or representative reflected signal with data related to the reflected signal pre-stored in the remote control device 200 .

And, the remote control device 200 may control to display a remote control screen for remote control of the confirmed device.

And, after displaying the remote control screen for device control, when any one item of the remote control screen is selected by the user, the remote control apparatus 200 outputs a signal corresponding to the selected item, that is, a remote control signal, can be sent

For example, when the remote control device 200 directs the air conditioner 100c, the remote control device 200 selects a first item among the remote control screens as a remote control screen for adjusting the wind speed of the air conditioner. is displayed, and when the first item is operated, a remote control signal related to wind strength adjustment for the air conditioner may be output and transmitted.

As a result, when the remote control apparatus 200 is directed in the direction of the first device, it detects the first reflection signal from the first reflection pattern attached corresponding to the first device, and based on the detected first reflection signal, , Control to display a first remote control screen for remote control of the first device, detect a received second reflection signal when directed in the direction of the second device, and based on the detected second reflection signal, It can control to display the second remote control screen for remote control of the second device.

Accordingly, with one remote control device 200, remote control for various devices is possible.

That is, according to the direction of the remote control device 200, an image display device such as a TV 100a, a set-top box 100b, an air conditioner 100c, a lighting device 100d, a robot vacuum cleaner 100e, and a refrigerator 100f ), an air purifier (100g), a temperature control device (100h), etc. can be remotely controlled.

On the other hand, the remote control signal output from the remote control device 200 is an infrared (Infra Red) signal, an RF (Radio Frequency) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, It may be any one of a laser signal and a UWB (Ultra Wideband) signal.

Meanwhile, the remote control apparatus 200 may receive, from the gateway 400, control command information for at least a portion of the remote control screen for remote control of each device.

Alternatively, the remote control apparatus 200 may transmit, to the gateway 400, control command information for at least a portion of the remote control screen for remote control of each device.

In particular, the gateway 400 controls at least a part of the remote control screen for remote control of each device from the external server 700a, ..., 700n, etc. through the network 550. Command information can be received.

At this time, the external servers 700a, ..., 700n may be servers operated by each device manufacturer, or servers storing information about each device.

Meanwhile, in the present invention, when the remote control device 200 outputs a transmission signal and receives a reflection signal from a predetermined reflection pattern, if it is not a pre-registered reflection pattern, it enters the reflection pattern registration mode and sets the reflection pattern registration mode. An indicator is outputted through at least one of the sound output module 455 and the display 480, and when information on the first device is received, a first reflection pattern is generated based on the received information on the first device. The reflection signal from 101a may be registered as a reflection signal of the first device, or a reflection pattern based on the reflection signal may be registered as a reflection pattern of the first device. Accordingly, it is possible to conveniently register a device corresponding to the reflection pattern.

Meanwhile, when information on the first device is sequentially received, objects representing the first device are sequentially generated based on the sequentially received information, and the sequentially generated objects are displayed so that the user can intuitively, Completion of the first device registration can be recognized.

2 is a diagram illustrating a remote control device or remote control screen for each device.

Referring to the drawings, FIG. 2 illustrates a remote control device 201a for an image display device, a remote control device 201b for an optical disk player, a remote control device 201c for an air conditioner, and a remote control device 201d for a robot vacuum cleaner. do.

As shown in FIG. 2 , when remote control devices to which different codes are assigned are used to remotely control each electronic device, the number of remote control devices increases, making it inconvenient for users to use.

In the present invention, more conveniently, a remote control apparatus capable of remotely controlling a plurality of devices is proposed.

3a to 3f are views illustrating that the type of device to be controlled varies according to the direction of the remote controller of FIG. 1 .

3A illustrates a case in which the remote control apparatus 200 is directed toward an air conditioner 100c among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives at least one reflected signal including a reflected signal from the reflective pattern 101c corresponding to the air conditioner 100c. Then, the remote control apparatus 200 detects device identification information from at least one received reflected signal, and confirms or identifies that the remotely controllable device is the air conditioner 100c based on the detected device identification information. can do.

For example, if at least one of device type information, manufacturer information, and device model name information is included in the detected reflected signal, the remote control apparatus 200 performs signal processing on the reflected signal to obtain device type information, At least one of manufacturer information and device model name information may be extracted, and a device corresponding to the reflected signal may be identified or identified based on at least one of the extracted device type information, manufacturer information, and device model name information.

As another example, the remote control apparatus 200, when the received and detected reflected signal is a specific signal set to enable identification of each device, the received and detected reflected signal, the reflected signal stored in the memory 465, and Compared to related data, the device can be identified or identified.

More specifically, when the reflected signal received and detected is a space-based pattern signal, the remote control device 200 compares the space-based pattern signal-related data stored in the memory 465 with the received pattern signal , can check or identify the device.

And, after identifying that the device to be directed is the air conditioner 100c, the remote control apparatus 200 may control the remote control screen for the air conditioner 100c to be displayed.

On the other hand, the remote control device 200 outputs a device controllable message 311a as a sound when device identification is completed or the display of the remote control screen is completed based on the reflection signal detection, or the remote control device 200 ) may emit light for a predetermined period of time or output vibration. Accordingly, the user can recognize that the air conditioner can be controlled. Meanwhile, in FIG. 3A , an air conditioner controllable message 311a such as “air conditioner is controlled” is output as a sound.

Alternatively, for the user's convenience, identification is completed by the remote control device 200, or a controllable device emits an LED included in the device or transmission device for a predetermined period of time, or is included in the device or transmission device. It is also possible to emit a specific sound from a sound device that has been installed, or to display a remote controllable message of the remote control device 200 on a display included in a device or transmission device.

In particular, when a predetermined item in the remote control screen is selected after completion of the remote control screen display, the remote control device 200 may transmit a remote control signal corresponding to a control command of the predetermined item to the air conditioner 100c. .

On the other hand, the air conditioner (100c), after receiving the remote control signal, the LED built in the air conditioner (100c) may emit light for a predetermined time. As a result, the user can recognize that the air conditioner control is being performed.

Next, FIG. 3B illustrates a case in which the remote control device 200 is directed toward the image display device 100a among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives a reflected signal from the reflective pattern 101a corresponding to the image display device 100a.

Then, the remote control apparatus 200 detects device identification information from at least one reflected signal including the identification signal received from the image display apparatus 100a, and based on the detected device identification information, a device capable of being remotely controlled. It is possible to confirm or identify that it is the image display device 100a. A method for checking the image display device 100a will be omitted with reference to the description of FIG. 3A.

And, after confirming that the directed device is the image display device 100a, the remote control device 200 may control a remote control screen for the image display device 100a to be displayed.

Next, FIG. 3C illustrates a case in which the remote control device 200 is directed toward the lighting device 100d among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives a reflected signal from the reflective pattern 101d corresponding to the lighting device 100d, for example, an infrared (IR) signal.

Also, the remote control apparatus 200 may confirm that the directed device is the lighting apparatus 100d based on the infrared (IR) signal. A method of confirming the lighting device 100d is omitted with reference to the description of FIG. 3A .

And, after confirming that the directed device is the lighting device 100d, the remote control device 200 may control the remote control screen for the lighting device 100d to be displayed.

Next, FIG. 3D illustrates a case where the remote control device 200 is directed toward the robot cleaner 100e among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives a reflected signal from the reflective pattern 101e corresponding to the robot cleaner 100e.

Then, the remote control apparatus 200 detects device identification information from at least one reflected signal including the identification signal received from the robot cleaner 100e, and based on the detected device identification information, a device capable of being remotely controlled is , it is possible to confirm or identify that it is the robot cleaner 100e. A method for checking the robot cleaner 100e is omitted with reference to the description of FIG. 3A.

Further, after confirming that the directed device is the robot cleaner 100e, the remote control apparatus 200 may control the remote control screen for the robot cleaner 100e to be displayed.

Meanwhile, in FIG. 3E , when setting for remote control of the air conditioner 100c is completed, the remote control enable signal Skeystc is transmitted from the remote controller 200 to the air conditioner 100c to the air conditioner 100c. foreshadow what it is

After receiving the remote control possibility signal Skeystc, the air conditioner 100c may display the air conditioner remote control possibility message 311ac on the display 180c or output the air conditioner remote control possibility message 311ab as sound. .

That is, unlike FIG. 3A, instead of outputting the air conditioner controllable message 311a such as "The remote control device 200 controls the air conditioner", the air conditioner 100c sends the remote controllable signal Skeystc to the air conditioner ( 100c), it is also possible for the air conditioner 100c to output the air conditioner remote control enable messages 311ab and 311ac.

Meanwhile, in FIG. 3F , when the setting for remote control of the image display device 100a is completed, the remote control enable signal Skeysta is sent from the remote control device 200 to the image display device 100a to display an image. It illustrates what is transmitted to device 100a.

After receiving the remote controllable signal Skeysta, the image display device 100a displays the image display device remote controllable message 311bc on the display 180a or sends the image display device remote controllable message 311bb. It can also be output with sound.

4a to 4b are views showing the appearance of the remote control device of FIG. 1 .

First, FIG. 4A illustrates that the display 480 is displayed in the upper case 297 of the remote control device according to an embodiment of the present invention.

Next, FIG. 4B illustrates that when the upper case 297 of the slide type is operated upward, the lower case 296 is fixed and the upper case 297 moves upward.

The lower case 296 may include a first button 401 related to power on/off and a second button 402 related to performing a condition.

Meanwhile, the first button 401 and the second button 402 may be provided in a key input unit ( 430 in FIG. 7 ).

Meanwhile, as shown in FIG. 4B , when the upper case 297 and the lower case 296 are spaced apart from each other, the remote control device 200 may be activated.

5 is a diagram illustrating an example of a reflective pattern 101a.

Referring to the drawing, the reflective pattern 101a is preferably an infrared pattern.

6 is a diagram illustrating reflection signal output using a reflection pattern.

Referring to the drawing, the reflective pattern 101ab of FIG. 6 is an infrared pattern having a size of 3X3, and a reflective material may be applied to a partial area of the 3X3 area.

For example, when the transmission signal SIR is an infrared signal, the reflection pattern 101ab may output a reflection signal Sida corresponding to the transmission signal SIR.

Depending on the shape of the reflective pattern 101ab, the size and pattern of the reflective signal Sida vary, and accordingly, the remote control apparatus 200 can identify a device corresponding to the reflective pattern 101ab.

7 is an internal block diagram of the remote control device of FIG. 1;

Referring to the drawings, the remote control device 200 includes a wireless communication unit 420, a key input unit 430, a microphone 435, a sensor unit 440, an output unit 450, a power supply unit 460, a memory 465, a controller 470, a display 480, a camera 495, and a fingerprint recognition unit 499 may be included.

As described above, the wireless communication unit 420 may transmit/receive signals with any one of the devices. To this end, the wireless communication unit 420 may include a receiving unit 423 and a transmitting unit 421 .

In this embodiment, the remote control apparatus 200 may include a receiver 423 that receives a device reflection signal and a transmitter 421 that outputs a remote control signal, an output signal, or a call signal.

The transmitter 421 is selected from among an infrared (Infra Red) signal, a Radio Frequency (RF) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, a laser signal, and an Ultra Wideband (UWB) signal. Any one of the transmission signals can be output.

On the other hand, the transmission unit 421, infrared (Infra Red) signal, RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, ZigBee (ZigBee) signal, Bluetooth (bluetooth) signal, laser signal, UWB (Ultra Wideband) Any one of the signals, the remote control signal, can be output.

For example, the transmitter 421 may include an IR module 421a and output a transmission signal based on an infrared signal. Meanwhile, the transmitter 421 may output a remote control signal based on an infrared signal.

On the other hand, the transmitter 421 may include an RF module 421b and output an RF-based remote control signal.

The receiving unit 423 includes an infrared (Infra Red) signal, a Radio Frequency (RF) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, a laser signal, and an Ultra Wideband (UWB) signal. Any one of the reflection signals may be received from the reflection pattern 101 .

Meanwhile, when the device is the image display device 100a, the remote control device 200 may transmit pointing information of the remote control device 200, for example, a signal containing information about motion.

The key input unit 430 may include a plurality of keys. A plurality of keys may be implemented as a keypad, button, touch pad, or touch screen.

The microphone 435 may receive a user's voice, convert the received user's voice into an electrical signal, and transmit the received user's voice to the control unit 470 .

The sensor unit 440 may include a gyro sensor 441 or an acceleration sensor 443 . The gyro sensor 441 may sense information about the movement of the remote control device 200 .

For example, the gyro sensor 441 may sense information about the operation of the remote control device 200 based on x, y, and z axes. The acceleration sensor 443 may sense information about the moving speed of the remote control device 200 and the like.

The output unit 450 may output a vibration or sound signal corresponding to manipulation of the key input unit 430 or emit LED. Through the output unit 450, the user can recognize whether the key input unit 430 has been manipulated.

For example, the output unit 450 includes an LED module 451 that lights up when the key input unit 430 is manipulated or an IR signal is transmitted or received through the wireless communication unit 425, a vibration module 453 that generates vibration, and a sound It may be provided with a sound output module 455 that outputs.

The power supply unit 460 supplies power to the remote control device 200 . The power supply unit 460 can reduce power waste by stopping power supply when the remote control device 200 does not move for a predetermined period of time. The power supply unit 460 may resume power supply when a predetermined key provided in the remote control device 200 is manipulated.

The memory 465 may store various types of programs and application data necessary for controlling or operating the remote control device 200 .

In particular, a received signal and a reflection pattern corresponding to the received signal may be stored for each device.

The control unit 470 controls all matters related to the control of the remote control device 200.

When the controller 470 receives, through the receiver 423, at least one reflection signal including a device reflection signal from at least one device or a reflection pattern corresponding to the device, the received at least one reflection signal Detects a reflected signal, identifies or identifies a device based on the detected reflected signal, matches at least one of a plurality of keys to a control command for remote control of the device, and selects a key matched to the control command. In this case, the transmitter 421 may be controlled to output a remote control signal corresponding to the control command.

Meanwhile, when the remote control apparatus is directed toward the device, the controller 470 may identify the device based on a reflection signal received from the device or a reflection pattern corresponding to the device.

Meanwhile, the controller 470 detects a first reflection signal from at least one reflection signal including the first reflection signal received from the first device when the remote control apparatus 200 is directed toward the first device, and , Based on the detected first reflection signal, at least one of a plurality of keys is matched with a control command for remote control of the first device, and the remote control apparatus 200 is directed in the direction of the second device, Detecting a second reflected signal from at least one reflected signal including the second reflected signal received from the second device, and based on the detected second reflected signal, at least one of a plurality of keys, remote control of the second device For control, it can match a control command.

Meanwhile, the control unit 470 may transmit a remote control signal corresponding to a predetermined key manipulation of the key input unit 430 to the device through the wireless communication unit 425 .

On the other hand, the controller 470 directs the remote control device 200 in the direction of the image display device 100a to identify the image display device 100a, and some of the control keys give a control command for the image display device 100a. , a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 440 or a pointing signal may be transmitted to the image display device 100a through the wireless communication unit 425.

On the other hand, the controller 470 checks whether or not it is a pre-registered reflection pattern based on the reflection signal received from the receiver 423, and if it is not a pre-registered reflection pattern, enters the reflection pattern registration mode to reflect the reflection pattern. An indicator indicating a pattern registration mode is controlled to be output through at least one of the audio output module 455 and the display 480, and when information on the first device is received, based on the received information on the first device. Thus, the reflection signal from the first reflection pattern 101a may be registered as the reflection signal of the first device, or the reflection pattern based on the reflection signal may be controlled to be registered as the reflection pattern of the first device.

Meanwhile, when information on the first device is sequentially received, the controller 470 sequentially generates objects representing the first device based on the sequentially received information, and displays the sequentially generated objects. You can control it.

Meanwhile, the receiving unit 423 receives a remote control signal from the remote control apparatus 201a of the first device, and the controller 470 determines whether or not the remote control signal is the remote signal of the first device based on the received remote control signal. In addition, based on the remote control signal of the first device, objects representing the first device may be sequentially generated, and the sequentially generated objects may be controlled to be displayed on the display 480 .

Meanwhile, the controller 470 extracts first device information from sound including the first device information input through the microphone 435, and sequentially creates objects representing the first device based on the first device information. , and the sequentially created objects can be controlled to be displayed on the display 480 .

Meanwhile, the receiver 423 may receive information about the first device from the gateway 400, and the controller 470 may receive information about the first device via the gateway 400 based on the information about the first device. Thus, the reflection signal from the first reflection pattern 101a may be registered as the reflection signal of the first device, or the reflection pattern based on the reflection signal may be controlled to be registered as the reflection pattern of the first device.

Meanwhile, after registering the reflection pattern of the first device, the controller 470 controls to end the reflection pattern registration mode, and displays an indicator indicating the end of the reflection pattern registration mode on at least one of the sound output module 455 and the display 480. Through one, you can control it to output.

On the other hand, the controller 470 enters a mode for remote control of the first device when it is determined that the reflected pattern is a pre-registered reflection pattern based on the received reflection signal, and the first device having a plurality of remote control items. Control to display a remote control screen for a device, and when a first item in the remote control screen for a first device is selected, control to transmit a first remote control signal corresponding to the first item.

Meanwhile, the controller 470 may control display of the remote control screen for the first device to end when there is no selection of an item in the remote control screen for the first device for a predetermined period of time.

Meanwhile, the transmitter 421 transmits a transmission signal while the remote control screen for the first device is displayed, the receiver 423 receives the reflected signal from the second reflection pattern, and the controller 470 2 Based on the reflection signal from the reflection pattern, if it is confirmed that the reflection pattern is a pre-registered reflection pattern, a mode for remote control of the second device is entered, the remote control screen for the first device is switched, and a plurality of remote controls are entered. It can be controlled to display a remote control screen for a second device having items.

Meanwhile, the camera 495 may capture an image. In particular, when the camera 495 is directed toward the user's face, an image including the user's face may be captured.

The controller 470 may identify or check the user based on the captured user's face image and pre-stored data related to the user's image.

Meanwhile, the fingerprint recognition unit 499 may capture an image including a user's finger print. In this case, the controller 470 may identify or verify the user based on the captured user's fingerprint image and pre-stored data related to the user's fingerprint image.

Meanwhile, the controller 470 may perform user authentication based on an image captured by the camera 495 and, if the user authentication is successful, may control the device to be remotely controlled.

Meanwhile, the control unit 470 controls to transmit user information to a device that has been identified and can be controlled, and when user authentication confirmation information is received from the device, it can control the device to be remotely controlled.

Meanwhile, the device 100 may include a wireless communication unit 411 capable of transmitting and receiving signals wirelessly with the remote control apparatus 200, and a control unit 170 for controlling an operation corresponding to a received wireless signal. .

The wireless communication unit 411 may transmit and receive signals with the remote control device 200 wirelessly. In addition, the wireless communication unit 411 may receive signals transmitted by the remote control device 200 according to various communication standards.

8 is a flow chart showing an example of a method of operating a remote control device according to an embodiment of the present invention, and FIGS. 9A to 16 are views referenced for description of the method of operating the remote control device of FIG. 8 .

First, referring to FIG. 8, the transmission unit 421 of the remote control device 200 transmits a transmission signal (S805).

For example, as shown in FIG. 9A, after the first reflection pattern 101a is newly attached to the first device 100a, the remote control apparatus 200, in a state facing the first reflection pattern 101a, transmits A signal SIR may be transmitted.

As shown in FIG. 9A , the first reflection pattern 101a may output a reflection signal Sida corresponding to the reflection pattern after the transmission signal SIR is incident.

Next, the receiver 423 of the remote control device 200 receives the reflection signal Sida from the first reflection pattern 101a (S810).

Next, the control unit 470 of the remote control device 200 checks whether or not it is a pre-registered reflection pattern based on the reflection signal received from the receiver 423 (S815).

Next, if the reflection pattern based on the reflection signal received from the receiver 423 is not a pre-registered reflection pattern (S820), the control unit 470 of the remote control device 200 enters the reflection pattern registration mode ( S825), the indicator indicating the reflection pattern registration mode is output through at least one of the sound output module 455 and the display 480 (S830).

9A illustrates that an indicator indicating a reflection pattern registration mode is output as a sound 900 through a sound output module 455 .

Next, the control unit 470 of the remote control apparatus 200 receives information on the first device (S840), and based on the received information on the first device, the reflection from the first reflection pattern 101a. The signal may be controlled to be registered as a reflection signal of the first device or to register a reflection pattern based on the reflection signal as a reflection pattern of the first device (S850).

Next, the control unit 470 of the remote control apparatus 200 ends the reflection pattern registration mode after registering it as the reflection pattern of the first device (S855).

Meanwhile, in step 820 (S820), based on the reflection signal received by the receiver 423, if the reflection pattern is pre-registered, the controller 470 of the remote control apparatus 200 remotely controls the first device. Control to enter the mode for (S860).

Meanwhile, in relation to step 850 (S850), the control unit 470 of the remote control apparatus 200 remotely controls the first device when it is determined that the reflection signal is a pre-registered reflection pattern based on the received reflection signal. It is possible to enter a mode for, and match a control command for remote control of the first device to at least some of the plurality of buttons.

As another example, the control unit 470 of the remote control device 200 enters a mode for remote control of the first device, when it is determined that the reflected pattern is a pre-registered reflection pattern based on the received reflection signal, and It can be controlled to display a remote control screen for the first device having remote control items.

Next, the control unit 470 of the remote control apparatus 200, when the first button of the plurality of buttons or the first item in the remote control screen for the first device is selected (S865), the control unit of the remote control apparatus 200 In operation 470, a first remote control signal corresponding to a first button among a plurality of buttons or a first item in the remote control screen for the first device is controlled to be transmitted to the first device 101a (S870).

For example, information on the first device is extracted from a remote control signal received from the remote control apparatus 201a of the first device or extracted from sound including the first device information received through the microphone 435. Alternatively, it may be extracted from a signal including information about the first device from the gateway 400.

Meanwhile, the controller 470 of the remote control apparatus 200 may control to output guide information 901 for a button operation for a device to be registered, as shown in FIG. 9B.

For example, when the remote control device 201a of the video display device 101a is a device to be registered, the control unit 470 of the remote control device 200, as shown in FIG. 9B, guide information for power button operation. 901 can be controlled to be output as sound.

Accordingly, when the user presses the power button 201ab of the remote control device 201a, the remote control device 201a of the image display device 101a transmits the power signal Sit1 to the remote control device 200. can be sent to Accordingly, the receiver 423 of the remote control device 200 receives the power signal Sit1.

Meanwhile, the controller 470 of the remote control device 200 may search for a matching power signal among pre-registered power signals registered in the memory 465 based on the received power signal Sit1.

Meanwhile, the control unit 470 of the remote control apparatus 200 may not be able to identify a corresponding device using only the received power signal Sit1.

In consideration of this point, the control unit 470 of the remote control apparatus 200 may control to sequentially output guide information for a button operation for a device to be registered.

9C illustrates that second guide information 903 for a volume button operation is output following the first guide information 901 .

The control unit 470 of the remote control device 200 may control the guide information 901 for the volume button operation to be output as a sound, as shown in FIG. 9c.

Accordingly, when the user presses the volume button 201ac of the remote control device 201a, the remote control device 201a of the image display device 101a transmits the volume signal Sit2 to the remote control device 200. can be sent to Accordingly, the receiver 423 of the remote control device 200 receives the volume signal Sit2.

Meanwhile, the control unit 470 of the remote control device 200 may search for a matching volume signal among pre-registered volume signals registered in the memory 465 based on the received volume signal Sit2.

Meanwhile, the control unit 470 of the remote control apparatus 200 may determine that the remote control signal of the first device is a remote control signal by using the remote control signals Sit1 and Sit2 as shown in FIGS. 9B and 9C.

Also, the control unit 470 of the remote control apparatus 200 may control the first reflection pattern to be registered as a reflection pattern corresponding to the first device.

When the registration of the first device for the first reflection pattern is completed, the control unit 470 of the remote control apparatus 200 controls an object 929 indicating the first device to be displayed on the display 480 as shown in FIG. 9D. can do.

Meanwhile, the control unit 470 of the remote control apparatus 200 controls to end the reflection pattern registration mode after registering the reflection pattern of the first device, and provides an indicator indicating the end of the reflection pattern registration mode to the sound output module 455. Alternatively, it may be controlled to output through at least one of the displays 480 .

9D illustrates displaying an indicator 928 indicating the end of the reflection pattern registration mode on the display 480 .

Meanwhile, FIGS. 10A to 10C illustrate obtaining first device information from a user's sound.

10A and 10C are the same as those of FIGS. 9A and 9D, respectively, so descriptions thereof are omitted.

As shown in FIG. 10B, when the user outputs a sound 902 including first device information, the microphone 435 of the remote control apparatus 200 collects the sound 902 and converts it into an electrical signal.

The control unit 470 of the remote control apparatus 200 may extract first device information from the collected sound 902 and control the first reflection pattern to be registered as a reflection pattern corresponding to the first device.

Further, the control unit 470 of the remote control apparatus 200 displays an object 929 indicating the first device on the display 480 when the registration of the first device for the first reflection pattern is completed, as shown in FIG. 10C . can be controlled as much as possible.

On the other hand, the control unit 470 of the remote control apparatus 200, when information about the first device is sequentially received, based on the sequentially received information, sequentially creates an object representing the first device, You can control to display objects created with . This will be described with reference to FIG. 11 .

11(a) illustrates that an indicator 921 for registering a reflection pattern is output to the display 480 of the remote control device 200.

When the first key 430a is selected, the controller 470 of the remote control device 200 sends a guide message 922 for registering a reflection pattern on the display 480 as shown in FIG. 11(b). control to display.

When the first key 430a is selected, the control unit 470 of the remote control device 200 displays a power button guide message 924 as an example of a guide message, as shown in (c) of FIG. 11 ( 480).

As shown in FIG. 9B, when the power signal Sit1 is received, the controller 470 of the remote control device 200 sends a volume button guide message 928 as another example of the guide message, as shown in FIG. 11(d). As such, it is controlled to be displayed on the display 480.

On the other hand, the control unit 470 of the remote control apparatus 200 displays an object 927 representing information on a briefly grasped device according to the power signal Sit1, as shown in FIG. 11(d). You can control it.

Next, as shown in FIG. 9C, when the volume signal Sit2 is received, the controller 470 of the remote control apparatus 200 generates an object 929 representing information about the identified device according to the volume signal Sit2. , as shown in (e) of FIG. 11, can be controlled to be displayed.

In this way, based on the sequentially received information, objects representing the first device are sequentially generated and the sequentially generated objects are displayed, thereby increasing user convenience.

Meanwhile, when the first device registration for the first reflection pattern is completed, the controller 470 of the remote control apparatus 200 displays an indicator 928 indicating the end of the reflection pattern registration mode, as shown in FIG. 11(e). It can be controlled to be displayed on the display 480 .

12a to 12d correspond to FIGS. 9a to 9d, and there is a difference in that registration is performed for the air conditioner 100c rather than the image display device 100a.

12A illustrates that the transmission signal SIR is transmitted to the second reflection pattern 101a and the reflection signal Sidc is received by the second reflection pattern 101a.

Meanwhile, FIG. 12A illustrates that an indicator indicating a reflection pattern registration mode is output as a sound 1100 through a sound output module 455 .

12B illustrates that guide information 1101 for a button operation for a device to be registered is output.

Accordingly, when the user presses the power button 201cb of the remote control device 201c for the air conditioner, the remote control device 201c for the air conditioner transmits the power signal Sia1 to the remote control device 200. can Accordingly, the receiver 423 of the remote control device 200 receives the power signal Sia1.

Meanwhile, the controller 470 of the remote control device 200 may search for a matching power signal among pre-registered power signals registered in the memory 465 based on the received power signal Sia1.

12C illustrates that second guide information 1103 for a volume button operation is output following the first guide information 1101 .

Accordingly, when the user presses the temperature control button 201cc of the remote control device 201c for air conditioner, the remote control device 201c for air conditioner sends the temperature control signal Sia2 to the remote control device 200. ) can be sent. Accordingly, the receiving unit 423 of the remote control device 200 receives the temperature control signal Sia2.

Meanwhile, the control unit 470 of the remote control device 200 may search for a matching temperature control signal among pre-registered temperature control signals registered in the memory 465 based on the received temperature control signal Sia2. there is.

Meanwhile, the control unit 470 of the remote control device 200 may determine that the remote control signal of the second device is a remote control signal using the remote control signals Sia1 and Sia2 as shown in FIGS. 12B and 12C.

Also, the controller 470 of the remote control apparatus 200 may control the second reflection pattern 101c to be registered as a reflection pattern corresponding to the second device.

When registration of the second device for the second reflection pattern is completed, the control unit 470 of the remote control apparatus 200 controls the object 1129 representing the first device to be displayed on the display 480 as shown in FIG. 12D. can do.

FIG. 12D illustrates displaying an indicator 1128 indicating the end of the reflection pattern registration mode on the display 480 .

On the other hand, the control unit 470 of the remote control apparatus 200, when information about the second device is sequentially received, based on the sequentially received information, sequentially generates an object representing the second device, sequentially You can control to display objects created with . This will be described with reference to FIG. 13 .

13(a) illustrates that an indicator 1121 for registering a reflection pattern is output to the display 480 of the remote control device 200.

When the first key 430a is selected, the controller 470 of the remote control device 200 sends a guide message 1122 for registering a reflection pattern on the display 480 as shown in FIG. 13(b). control to display.

When the first key 430a is selected, the control unit 470 of the remote control device 200 displays a power button guide message 1124 as an example of a guide message, as shown in (c) of FIG. 13 ( 480).

As shown in FIG. 12B, when the power signal Sia1 is received, the control unit 470 of the remote control device 200, as another example of the guide message, sends the temperature control button guide message 1128, as shown in FIG. 13 (d ), it is controlled to be displayed on the display 480.

On the other hand, the control unit 470 of the remote control apparatus 200 displays an object 1127 representing information on a briefly grasped device according to the power signal Sia1, as shown in FIG. 13(d). You can control it.

Next, as shown in FIG. 12C, when the temperature control signal Sia2 is received, the control unit 470 of the remote control device 200, according to the temperature control signal Sia2, objects indicating information on the identified device ( 1129) can be controlled to be displayed as shown in (e) of FIG. 13.

In this way, based on the sequentially received information, objects representing the second device are sequentially generated and the sequentially generated objects are displayed, thereby increasing user convenience.

Meanwhile, when the second device registration for the second reflection pattern is completed, the controller 470 of the remote control apparatus 200 displays an indicator 1128 indicating the end of the reflection pattern registration mode, as shown in (e) of FIG. It can be controlled to be displayed on the display 480 .

14 illustrates receiving first device information from the gateway 400 .

When the remote control device 200 transmits a transmission signal to the reflective pattern 101f attached to the refrigerator 100f as in 1), the reflected signal is received from the reflective pattern 101f as in 2).

In this case, the remote control device 200 may enter a reflection pattern registration mode if the reflection pattern is not pre-registered, and output an indicator indicating the reflection pattern registration mode.

Accordingly, the user presses a button 1401 provided on the refrigerator 100f, for example, the WPS button 1401, as in 3), and a button comparable to the gateway 400 as in 4) ( 1401), for example, when the WPS button 1402 is pressed, the refrigerator 100f and the gateway 400 are paired with each other, and wireless connection is performed. For example, wireless access is performed in a WiFi communication method.

Accordingly, the refrigerator 100f may transmit information about the refrigerator, for example, product information, to the gateway 400 as in 5).

And, the gateway 400 can transmit information about the refrigerator, for example, product information, to the network-connected remote control device 200 automatically or upon a separate request, as in 6). there is.

The controller 470 of the remote control device 200 corresponds to the reflective pattern 101f to the refrigerator 100f by using information about the refrigerator received through the receiver 421, for example, product information. It can be controlled to register as a reflection pattern that

Meanwhile, the controller 470 may control displaying of the remote control screen for the first device to end when there is no selection of an item in the remote control screen for the first device for a predetermined period of time. In order to reduce power consumption, when there is no input for a predetermined time, the display of the remote control screen for the first device may be controlled to end.

Meanwhile, the transmitter 421 of the remote control device 200 transmits a transmission signal while the remote control screen for the first device is displayed, and the receiver 423 of the remote control device 200 transmits a second reflection pattern. receives a reflection signal from the remote control device 200, and the control unit 470 of the remote control apparatus 200, based on the reflection signal from the second reflection pattern, performs remote control of the second device when it is confirmed that the reflection pattern is a pre-registered reflection pattern. mode, the remote control screen for the first device can be switched, and the remote control screen for the second device having a plurality of remote control items can be controlled to be displayed. This will be described with reference to FIGS. 15A to 15C.

15A shows that the remote control device 200 outputs the transmission signal SIR to the reflection pattern 101d of the lighting device 100d and receives the reflection signal Sidd, and displays the lighting device on the display 480. (100d) It illustrates that the remote control screen 1500 for control is displayed.

On the other hand, as shown in FIG. 15B, when the directing direction of the remote control device 200 is moved, the remote control device 200 outputs a transmission signal (SIR), but when a reflection pattern does not exist in the directing direction, the reflected signal will not be able to receive

In this case, the controller 470 of the remote control device 200 may control the remote control screen 1500 for controlling the lighting device to be continuously displayed, as shown in FIG. 15B.

On the other hand, as shown in FIG. 15C, when the direction of the remote control device 200 is further moved, the remote control device 200 outputs a transmission signal (SIR) and sends it to the reflection pattern 101a of the image display device 100a. As the transmission signal SIR is output and the reflected signal Sida is received, the display 480 displays the remote control screen 1510 for controlling the image display device 100a.

In this way, the controller 470 of the remote control device 200 enters a mode for remote control of the second device when it is determined that the reflection pattern is a pre-registered reflection pattern based on the reflection signal from the second reflection pattern. , It is possible to change the remote control screen for the first device to display a remote control screen for the second device having a plurality of remote control items.

Meanwhile, the controller 470 of the remote control device 200 may transmit a pointing signal to the image display device 100a when the remote control target is the image display device 100a.

16 illustrates that the pointer 205 based on the pointing signal from the remote control device 200 is displayed on the image display device 100a.

Meanwhile, the control unit 470 of the remote control device 200 controls the display 480 to display the converted remote control screen 1510, while the video display device 100a displays the previously displayed remote control screen. Information on (1500) can be controlled to be further transmitted.

Accordingly, as shown in FIG. 16 , the image display device 100a may display a remote control screen 1420 for remote control of the lighting device 100d.

In this case, the image display device 100a may display the position of the remote control screen 1420 in a leftward direction based on the received pointing signal.

Meanwhile, the operating method of the remote control device of the present invention can be implemented as processor-readable codes in a processor-readable recording medium included in the remote control device. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also include those implemented in the form of carrier waves such as transmission through the Internet. . In addition, the processor-readable recording medium is distributed in computer systems connected through a network, so that the processor-readable code can be stored and executed in a distributed manner.

In addition, although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. Of course, various modifications are possible by those skilled in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (20)

a transmission unit that transmits a transmission signal;
a receiving unit receiving a reflection signal from the first reflection pattern;
sound output module;
display;
a microphone for receiving sound including first device information;
Based on the received reflection signal, it is checked whether it is a pre-registered reflection pattern, and if it is not a pre-registered reflection pattern, a reflection pattern registration mode is entered, and an indicator indicating the reflection pattern registration mode is displayed in the sound output module. Or control to output through at least one of the displays,
When the information on the first device is received, based on the received information on the first device, a reflection signal from the first reflection pattern is registered as a reflection signal of the first device, or the reflected signal And a control unit for controlling to register the reflection pattern based on the reflection pattern of the first device,
The control unit,
Extracting the first device information from the sound;
Based on the first device information, objects representing the first device are sequentially generated, and the sequentially generated objects are controlled to be displayed on the display;
The control unit,
Based on the received reflection signal, when it is determined that the reflection pattern is a pre-registered reflection pattern, a mode for remote control of the first device is entered, and a remote control screen for the first device having a plurality of remote control items is displayed. control to display
Control to transmit a first remote control signal corresponding to the first item when a first item in the remote control screen for the first device is selected;
The sending unit,
Transmitting a transmission signal while the remote control screen for the first device is displayed;
the receiver,
Receiving a reflection signal from the second reflection pattern;
When it is confirmed that the reflection pattern is a pre-registered reflection pattern based on the reflection signal from the second reflection pattern, the control unit enters a mode for remote control of the second device and displays a remote control screen for the first device. A remote control device characterized in that the control is performed so as to display a remote control screen for a second device having a plurality of remote control items. According to claim 1,
The control unit,
When the information on the first device is sequentially received, objects representing the first device are sequentially generated based on the sequentially received information, and the sequentially generated objects are controlled to be displayed. remote control device. delete delete delete delete According to claim 1,
The control unit,
Based on the received reflection signal, if it is determined that the reflection pattern is a pre-registered reflection pattern, a mode for remote control of the first device is entered, and at least some of a plurality of buttons are controlled for remote control of the first device. match the command,
When a first button of the plurality of buttons is operated, the remote control device characterized in that the control to transmit a first remote control signal corresponding to the control command matched to the first button.

delete delete delete delete delete delete delete delete delete delete delete delete delete

Images