KR102313300B1 - Remote controller capable of remotely controlling a plurality of device - Google Patents

Abstract

According to the present invention, a remote control apparatus capable of performing remote control of a plurality of devices transmits a call signal to a key input unit having a plurality of keys and at least one device or a transmitting apparatus corresponding to the device. and a first transmitter that receives a pairing response signal or receives at least one identification signal from at least one device or a transmitter corresponding to the device, and performs pairing based on the received pairing response signal, a processor for detecting an identification signal of a remote controllable device from the received at least one device identification signal, and matching at least one of the plurality of keys to a control command for remote control of the device based on the detected identification signal; and a second transmitter configured to transmit a signal corresponding to the control command when a key matching the control command is selected. Accordingly, it is possible to perform remote control of a plurality of devices.

Description

A remote controller capable of remotely controlling a plurality of devices

The present invention relates to a remote control apparatus capable of identifying a plurality of devices and performing remote control of the identified devices.

The remote control device is used to remotely control a TV, an air conditioner, an optical disc player, and the like.

Meanwhile, in order to remotely control each electronic device, a remote control device for a TV, a remote control device for an air conditioner, a remote control device for an optical disc player, etc. to which different control codes are assigned are used.

For user convenience, the number of electronic devices employing a remote control device is increasing. However, when a separate remote control device is used for each electronic device, there is a disadvantage in that the use of the remote control device is inconvenient for the user. Accordingly, efforts are being made to solve such user inconvenience.

It is an object of the present invention to provide a remote control apparatus capable of identifying a plurality of devices and performing remote control of the identified devices.

Another object of the present invention is to provide a remote control apparatus capable of remotely controlling a plurality of devices through a remote control apparatus without a display.

In order to achieve the above object, a remote control apparatus according to an embodiment of the present invention includes a key input unit having a plurality of keys, and at least one device or a first device for transmitting a call signal to a transmitting apparatus corresponding to the device. 1 A transmitter and a receiver that receives a pairing response signal or receives at least one identification signal from at least one device or a transmitter corresponding to the device, and performs pairing based on the received pairing response signal, a processor for detecting an identification signal of a remote controllable device from the at least one device identification signal, and matching at least one of a plurality of keys to a control command for remote control of the device based on the detected identification signal; and a second transmitter configured to transmit a signal corresponding to a control command when a key matched to is selected.

On the other hand, the remote control apparatus according to another embodiment of the present invention for achieving the above object, a key input unit having a plurality of keys (key), and at least one device or a transmission device corresponding to the device, to receive a call signal A first transmitter for transmitting, a first receiver for receiving a pairing request signal from at least one device or a transmitter corresponding to the device, and a second transmitter for transmitting a pairing response signal based on reception of the pairing request signal; A second receiver for receiving at least one device identification signal from at least one device or a transmission apparatus corresponding to the device, and detecting an identification signal of a remote controllable device from the received at least one device identification signal, and the detected identification A processor matching at least one of the plurality of keys to a control command for remote control of the device based on the signal, and a third transmitter configured to transmit a signal corresponding to the control command when the key matched to the control command is selected includes

Meanwhile, a remote control apparatus according to another embodiment of the present invention for achieving the above object includes a key input unit having a plurality of keys, and at least one device or a transmitting apparatus corresponding to the device, including a call signal A first transmitter for transmitting, a first receiver for receiving at least one identification signal from at least one device or a transmission apparatus corresponding to the device, and an identification signal of a remotely controllable device from the received at least one device identification signal a processor that detects, based on the detected identification signal, identifies a vise, and matches at least one of the plurality of keys to a control command for remote control of the identified device; A transmitting device that transmits a pairing request signal, a second receiving unit receiving a pairing response signal from an identified device or a transmitting apparatus corresponding to the identified device, and a key matching a control command is selected case, a third transmitter for transmitting a signal corresponding to the control command.

According to an embodiment of the present invention, a remote control apparatus includes a key input unit having a plurality of keys, at least one device or a transmission apparatus corresponding to the device, and a first transmission unit for transmitting a call signal; At least one device or a receiving unit that receives a pairing response signal or receives at least one identification signal from a transmitting apparatus corresponding to the device, and performs pairing based on the received pairing response signal, the received at least one device A processor that detects an identification signal of a remote controllable device from the identification signal, and matches at least one of a plurality of keys to a control command for remote control of the device, based on the detected identification signal, and a key matched to the control command When is selected, it is possible to remotely control a plurality of devices by including a second transmitter for transmitting a signal corresponding to the control command.

In particular, after performing pairing, device identification or confirmation may be performed by detecting the identification signal, so that detection of the identification signal may be easily performed.

In particular, when directed in the direction of the device, based on an identification signal transmitted from the device or a transmission apparatus around the device, the device can be identified or identified, and accordingly, a predetermined control command is set to a key corresponding to the device By doing so, it is possible to conveniently perform remote control of a plurality of devices.

According to another embodiment of the present invention, a remote control apparatus includes a key input unit having a plurality of keys, at least one device or a transmission apparatus corresponding to the device, and a first transmission unit for transmitting a call signal; A first receiver for receiving a pairing request signal from at least one device or a transmitter corresponding to the device, a second transmitter for transmitting a pairing response signal based on reception of the pairing request signal, and at least one device or device. a second receiving unit for receiving at least one device identification signal from a corresponding transmitting apparatus, and detecting an identification signal of a remote controllable device from the received at least one device identification signal, and based on the detected identification signal, a plurality of A plurality of devices by comprising: a processor matching at least one of the keys to a control command for remote control of the device; and a third transmitter configured to transmit a signal corresponding to the control command when the key matching the control command is selected. remote control can be performed.

According to another embodiment of the present invention, a remote control apparatus includes a key input unit having a plurality of keys, at least one device or a transmission apparatus corresponding to the device, and a first transmission unit for transmitting a call signal; , at least one device or a first receiving unit for receiving at least one identification signal from a transmitting apparatus corresponding to the device, and detecting an identification signal of a remote controllable device from the received at least one device identification signal, and the detected identification A pairing request is made to a processor that identifies a vise based on the signal and matches at least one of the plurality of keys to a control command for remote control of the identified device, and to the identified device or a transmitting apparatus corresponding to the identified device. A second transmitter for transmitting a signal; a second receiver for receiving a pairing response signal from the identified device or a transmitter corresponding to the identified device; By including a third transmitter for transmitting a signal, it is possible to perform remote control of a plurality of devices.

1 is a diagram illustrating a device remote control system according to an embodiment of the present invention.
2 is a diagram illustrating a remote control device or a remote control screen for each device.
3A to 3F are diagrams illustrating that the type of controlled device is changed according to the orientation direction of the remote control device of FIG. 1 .
4 to 5 are diagrams illustrating various examples of the remote control device of FIG. 1 .
6 is an example of an internal block diagram of the transmitter of FIG. 1 .
FIG. 7 is an internal block diagram of the remote control device of FIG. 1 .
8 is a flowchart illustrating an example of a method of operating a remote control device according to an embodiment of the present invention.
9A to 9D are diagrams referenced in the description of the operation method of the remote control device of FIG. 8 .
10 is a flowchart illustrating an example of a method of operating a remote control device according to another embodiment of the present invention.
11A to 11H are diagrams referenced in the description of the operation method of the remote control device of FIG. 10 .
12A to 12C are flowcharts illustrating various examples of a method of operating a remote control apparatus according to another embodiment of the present invention.
13A to 13D are diagrams referenced in the description of the operation method of FIGS. 12A to 12C .
14 is a flowchart illustrating an example of a method of operating a remote control device according to another embodiment of the present invention.
15A to 15B are diagrams referenced in the description of the operation method of the remote control device of FIG. 14 .
16 is a flowchart illustrating an example of a method of operating a remote control device according to another embodiment of the present invention.
17A to 27E are diagrams referenced in the description of the operation method of the remote control device of FIG. 16 .
28 is a flowchart showing an example of a method of operating a remote control device according to another embodiment of the present invention.
29A to 29C are diagrams referenced in the description of the operation method of the remote control device of FIG. 28 .

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "part" for the components used in the following description are given simply in consideration of the ease of writing the present specification, and do not give a particularly important meaning or role by themselves. Accordingly, the terms “module” and “unit” may be used interchangeably.

1 is a diagram illustrating a device remote control system according to an embodiment of the present invention.

1, according to an embodiment of the present invention, the device remote control system 10, the remote control apparatus 200, a plurality of devices (100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h), and transmitting apparatuses 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h mounted in each device or disposed around the device.

Meanwhile, the device remote control system 10 may further include a gateway 400, servers 700a, ..., 700n, and the like.

In the drawings, examples of the device include an image display device 100a such as a TV, a set-top box 100b, an air conditioner 100c, a lighting device 100d, a robot cleaner 100e, a refrigerator 100f, and an air purifier. (100g), the temperature control device (100h), etc. are exemplified, but various other examples are possible. Meanwhile, the device illustrated in the drawing may be referred to as a home device.

For example, as a device, a washing machine, an optical disc player, a game device, a gas valve, a security device such as a security camera, an electronically opened door, an electronically opened and closed window, a sound output device, a game device , an electronic picture frame, an energy storage device (ESS), a digital camera, a fragrance generating device, a vehicle, a drone, etc. may be further exemplified.

Hereinafter, the devices shown in the drawings will be mainly described.

Each of the transmitting apparatuses 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h can transmit a device identification (ID) signal for identification with other devices.

The device identification signal may include at least one of device type information, manufacturer information, device model name information, device state information, and device control command related information for each device.

Meanwhile, the device state information may include an on/off state of the device, an operation value state during device operation, and the like.

Alternatively, the device identification signal may be a specific signal set to enable identification of each device. For example, it may be a time-based pattern signal or a space-based pattern signal. More specifically, the device identification signal may be a time-based infrared pattern signal or a space-based infrared pattern signal.

On the other hand, each of the transmitting apparatuses 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h reflects an output signal output from the directed remote control apparatus 200, and transmits a device identification (ID) signal to the remote control apparatus. It can also be transmitted in the direction of the control device 200 .

On the other hand, the device identification signal, as a signal with good directivity, infrared (Infra Red) signal, RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, ZigBee signal, Bluetooth (bluetooth) signal, laser signal, It may be any one of Ultra Wideband (UWB) signals.

The remote control device 200 can receive a plurality of identification signals from each of the transmission devices 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h.

At this time, the remote control device 200, any one of the plurality of devices (100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h), or a plurality of transmission devices (101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h), the remote control device 200 may detect one of the received at least one identification signal as a representative identification signal.

In addition, the remote control apparatus 200 performs signal processing on the detected identification signal or representative identification signal, and includes device type information, manufacturer information, device model name information, device status information, and device control included in the detected identification signal. Based on at least one of the information related to the command, the device corresponding to the identification signal may be identified or identified.

Alternatively, the remote control apparatus 200 may check or identify the device by comparing the detected identification signal or representative identification signal with the identification signal pre-stored in the remote control apparatus 200 and related data.

In addition, the remote control apparatus 200 may match at least a portion of a plurality of provided keys as a control command for the checked device control. Alternatively, the remote control apparatus 200 may set at least a part of a plurality of provided keys as a specific operation key for controlling a corresponding device.

And, when any one of a plurality of keys is selected by the user after setting a control command or after setting a key for device control, the remote control apparatus 200 provides a signal corresponding to the control command of the selected key. , that is, it can output and transmit remote control signals.

For example, when the remote control device 200 is directed toward the air conditioner 100c, the remote control device 200 uses a first key among a plurality of keys as a control command for adjusting the wind strength for the air conditioner. Matching, when the first key is operated, it is possible to output and transmit a remote control signal related to the adjustment of the wind strength for the air conditioner.

As a result, the remote control apparatus 200, when directed in the direction of the first device, detects a first identification signal received from the first device, and based on the detected first identification signal, at least one of a plurality of keys matches a control command for remote control of the first device, detects a received second identification signal when directed in the direction of the second device, and based on the detected second identification signal, one of a plurality of keys At least one may match a control command for remote control of the second device.

Accordingly, with one remote control apparatus 200, remote control of various devices is possible.

That is, according to the orientation direction of the remote control device 200, an image display device 100a such as a TV, a set-top box 100b, an air conditioner 100c, a lighting device 100d, a robot cleaner 100e, a refrigerator 100f ), an air purifier (100g), a temperature control device (100h), and the like, can be remotely controlled.

On the other hand, the remote control signal output from the remote control device 200, infrared (Infra Red) signal, RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, ZigBee signal, Bluetooth (bluetooth) signal, It may be any one of a laser signal and an Ultra Wideband (UWB) signal.

Meanwhile, the remote control apparatus 200 may receive, from the gateway 400 , control command information for at least a portion of a plurality of keys for remote control of each device.

Alternatively, the remote control apparatus 200 may transmit, to the gateway 400 , control command information for at least a portion of a plurality of keys for remote control of each device.

In particular, the gateway 400, via the network 550, from an external server (700a, ..., 700n), etc., for remote control of each device, at least in part of a plurality of keys (key) For the control command information, it is possible to receive.

In this case, the external servers 700a, ..., 700n may be a server operated by each device manufacturer or a server that stores information about each device.

2 is a diagram illustrating a remote control device or a remote control screen for each device.

Referring to the drawings, FIG. 2A shows a remote control device 201a for an image display device, a remote control device 201b for an optical disc player, a remote control device 201c for an air conditioner, and a remote control device for a robot cleaner ( 201d) is illustrated.

2B is a remote control screen 601a for an image display device that can be displayed on a display built in the mobile terminal 600 or the remote control device 200, a remote control screen 601b for an optical disc player, and an air conditioner. A remote control screen 601c and a remote control screen 601d for a robot cleaner are exemplified.

As shown in (a) of FIG. 2 , when a remote control device to which different control codes are assigned is used to remotely control each electronic device, the number of remote control devices increases, making it inconvenient for users to use there is a ham

In addition, as shown in (b) of FIG. 2 , there is an inconvenience in that the user has to separately display the corresponding remote control screen through application download and execution.

In the present invention, more conveniently, a remote control apparatus capable of remote control of a plurality of devices is provided.

3A to 3F are diagrams illustrating that the type of controlled device is changed according to the orientation direction of the remote control apparatus of FIG. 1 .

3A illustrates a case in which the remote control apparatus 200 is directed toward the air conditioner 100c among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives at least one identification signal including an identification signal from the transmission device 101c corresponding to the air conditioner 100c. In addition, the remote control apparatus 200 may detect an identification signal from the received at least one identification signal, and, based on the detected identification signal, confirm or identify that the remote controllable device is the air conditioner 100c. have.

For example, when at least one of device type information, manufacturer information, and device model name information is included in the detected identification signal, the remote control apparatus 200 performs signal processing on the identification signal to obtain device type information, At least one of manufacturer information and device model name information may be extracted, and a device corresponding to the identification signal may be identified or identified based on at least one of the extracted device type information, manufacturer information, and device model name information.

As another example, when the received and detected identification signal is a specific signal set to enable identification of each device, the remote control device 200 includes the received and detected identification signal and the identification signal stored in the storage unit 470 . By comparing the and related data, it is possible to identify or identify the device.

More specifically, when the received and detected identification signal is a time-based pattern signal, the remote control device 200 compares the time-based pattern signal related data stored in the storage unit 470 with the received pattern signal. Thus, the device may be identified or identified.

Alternatively, when the received and detected identification signal is a space-based pattern signal, the remote control device 200 compares the space-based pattern signal related data stored in the storage unit 470 with the received pattern signal, The device can be identified or identified.

In addition, after identifying that the directed device is the air conditioner 100c, the remote control apparatus 200 may match at least some of the plurality of keys as a control command for the air conditioner 100c.

On the other hand, the remote control apparatus 200, based on the detection of the identification signal, when the device identification is completed or the key setting is completed, output the device controllable message 311a as a sound, or to the remote control apparatus 200 The included LED may emit light for a predetermined time, or output vibration. Accordingly, the user can recognize that the air conditioner control is possible. Meanwhile, FIG. 3a illustrates outputting an air conditioner controllable message 311a such as “control the air conditioner” as sound.

Alternatively, for user convenience, a device whose identification is completed or controllable by the remote control device 200 emits light for a predetermined time by the LED included in the device or the transmitter, or is included in the device or the transmitter. It is also possible to make a specific sound from the sound device or to display a remote control possible message of the remote control device 200 on a display included in the device or transmission device.

In particular, when a specific key of the remote control device 200 operates after the key setting is completed, the remote control device 200 may transmit a remote control signal corresponding to the control command of the corresponding key to the air conditioner 100c. have.

On the other hand, the air conditioner 100c, after receiving the remote control signal, the LED built in the air conditioner 100c may be emitted for a predetermined time. Accordingly, the user can recognize that the air conditioner control is being performed.

Next, FIG. 3B illustrates a case in which the remote control apparatus 200 is directed toward the image display apparatus 100a among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives an identification signal from the transmission device 101a corresponding to the image display device 100a.

And, the remote control apparatus 200 detects an identification signal from at least one identification signal including the identification signal received from the image display apparatus 100a, and based on the detected identification signal, a device capable of remote control, It can be confirmed or identified that it is the image display device 100a. A method of confirming the image display device 100a will be omitted with reference to the description of FIG. 3A .

In addition, after confirming that the directed device is the image display apparatus 100a, the remote control apparatus 200 may match at least some of the plurality of keys with a control command for the image display apparatus 100a.

Next, FIG. 3C illustrates a case in which the remote control apparatus 200 is directed toward the lighting apparatus 100d among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives an identification signal, for example, an infrared (IR) signal, from the transmitting device 101d corresponding to the lighting device 100d.

And, the remote control apparatus 200, based on the infrared (IR) signal, it can be confirmed that the directed device, the lighting apparatus (100d). The method of confirming the lighting device 100d is omitted with reference to the description of FIG. 3A .

And, after confirming that the directed device is the lighting apparatus 100d, the remote control apparatus 200 may match at least some of the plurality of keys with a control command for the lighting apparatus 100d.

Next, FIG. 3D illustrates a case in which the remote control apparatus 200 is directed toward the robot cleaner 100e among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives an identification signal from the transmission device 101e corresponding to the robot cleaner 100e.

And, the remote control apparatus 200 detects an identification signal from at least one identification signal including the identification signal received from the robot cleaner 100e, and based on the detected identification signal, a device capable of remote control, the robot It may be confirmed or identified that the cleaner 100e is. A method of confirming the robot cleaner 100e is omitted with reference to the description of FIG. 3A .

And, after confirming that the directed device is the robot cleaner 100e, the remote control apparatus 200 may match at least some of the plurality of keys with a control command for the robot cleaner 100e.

Meanwhile, in FIG. 3E , when the setting for remote control of the air conditioner 100c is completed, the remote control device 200, the air conditioner 100c, and the remote control enable signal Skeystc are transmitted to the air conditioner 100c. foreshadows to be

After receiving the remote control enable signal Skeystc, the air conditioner 100c may display the air conditioner remote control enable message 311ac on the display 180c or output the air conditioner remote control enable message 311ab as sound. .

That is, unlike in FIG. 3A , instead of outputting the air conditioner controllable message 311a such as "The remote control device 200 controls the air conditioner", the remote control possible signal Skeystc is the air conditioner 100c, 100c), in the air conditioner 100c, it is also possible to output the air conditioner remote control possible messages (311ab, 311ac).

Meanwhile, in FIG. 3f , when the setting for remote control of the image display device 100a is completed, the remote control device 200, the image display device 100a, the remote control enable signal Skeysta, display the image Transmission to the device 100a is illustrated.

After receiving the remote control enable signal (Skeysta), the image display device 100a displays the image display device remote control enable message 311bc on the display 180a, or displays the image display device remote control enable message 311bb It can also be output as sound.

4 to 5 are diagrams illustrating various examples of the remote control device of FIG. 1 .

First, FIG. 4 illustrates an example of the remote control device 200 .

Referring to the drawings, the remote control device 200 may include a plurality of keys.

In the drawing, a power key 202, a menu key 203, a multi-device operation key 204, a wheel key 206, a confirmation key 207, a back key 208, a home key 209 ), a volume key 211 , a channel key 212 , a number key 214 , a reproduction-related key 216 , and the like are exemplified.

Among them, the first area Ar1 including the power key 202, the menu key 203, the multi-device operation key 204, the wheel key 206, and the confirmation key 207 is used for all devices, respectively. It can be any possible key.

On the other hand, a second including a back key 208, a home key 209, a volume key 211, a channel key 212, a number key 214, a reproduction related key 216, and the like. The area Ar2 may be usable only during remote control of a set-top box or an image display device.

Next, FIG. 5 illustrates another example of the remote control device 200b.

The remote control device 200b of FIG. 5 is similar to the remote control device 200 of FIG. 4 , but has a difference in that a number key, a channel key, a volume key, and the like are not provided. That is, in FIG. 4 , only keys described as keys usable to all devices may be provided.

In the figure, a power key 202b, a menu key 203b, a multi-device operation key 204b, a wheel key 206b, and an OK key 207b are exemplified.

Hereinafter, the remote control device 200 of FIG. 4 will be mainly described.

6 is an example of an internal block diagram of the transmitter of FIG. 1 .

Referring to the drawings, the transmission device 101 may include a sensor unit 103 , a memory 104 , a processor 107 , a transmission unit 106 , an LED module 108 , a communication unit 109 , and the like.

The sensor unit 103 may sense power on/off of a corresponding device nearby. To this end, the sensor unit 103 may include an electromagnetic field (EMF) sensor.

The processor 107 may check the device type or device model name information based on the data related to the information related to the corresponding device stored in the memory 104 or the data related to the identification signal of a specific pattern corresponding to the device. In addition, the processor 107 may control the transmitter 106 to transmit an identification signal corresponding to the confirmed device type or device model.

Meanwhile, in the process 107 , the power on/off state information of the device may be checked by the power on/off sensing information of the device detected by the sensor unit 103 . In addition, the process 107 may control the transmitter 106 to transmit an identification signal or device state information corresponding to the checked device power on/off state information.

Alternatively, the process 107 may check the power on/off state information of the device based on the power on/off sensing information of the device detected by the sensor unit 103 . In addition, the process 107 may check device type information or device model name information based on the checked device power on/off state information. Then, the process 107 may control the transmitter 106 so that an identification signal or device state information corresponding to the confirmed device type information or device model name information is transmitted.

The memory 104 may store information related to a corresponding device or data related to an identification signal of a specific pattern corresponding to the device.

The transmitter 106 transmits an identification signal. Meanwhile, the identification signal may include power on/off state information of the device. In particular, it is possible to transmit an identification signal of a specific pattern corresponding to the device. Also, the transmitter 106 may transmit power on/off state information of the device.

The LED module 108 may emit light according to the operating state of the transmitter 101 . For example, in the remote control device 200, when a remote control signal is transmitted, the LED module 108 may blink.

The communication unit 109 can exchange data with the device. For example, an identification signal may be received from the device. That is, the communication unit 109 may receive, from the device, at least one of device type information, manufacturer information, device model name information, device state information, and information related to a device control command for each device.

Meanwhile, the communication unit 109 may exchange data with the remote control device 200 .

For example, the communication unit 109 may receive a call signal from the remote control device 200 . In addition, the communication unit 109 may transmit a pairing response signal based on the received call signal. Alternatively, the communication unit 109 may transmit a pairing request signal based on the received call signal.

Meanwhile, the device state information may include an on/off state of the device, an operation value state during device operation, and the like.

Alternatively, the communication unit 109 may transmit/receive data to and from the gateway 400 .

For example, the communication unit 109 may receive, from the gateway 400 , control command information for at least a portion of a plurality of keys for remote control of each device.

Meanwhile, the communication unit 109 may transmit, to the gateway 400 , control command information for at least a portion of a plurality of keys for remote control of each device.

Meanwhile, although not shown in the drawings, a power supply unit may be further provided. The power supply unit may convert commercial AC current into DC power and supply it to each unit, or may supply DC power to each unit through a separate battery.

Meanwhile, although not shown in the drawings, a display unit and a sound output unit may be further provided. The display unit may display whether the remote control device is remotely controllable or whether pairing with the remote control device is possible, and the sound output unit outputs sound output whether the remote control device is remotely controllable or whether pairing with the remote control device is possible. can do.

FIG. 7 is an internal block diagram of the remote control device of FIG. 1 .

Referring to the drawings, the remote control device 200 includes a wireless communication unit 420 , a key input unit 430 , a microphone 435 , a sensor unit 440 , an output unit 450 , a power supply unit 460 , and storage. It may include a unit 470 , a processor 480 , a camera 495 , and a fingerprint recognition unit 499 .

As described above, the wireless communication unit 420 may transmit/receive a signal to and from any one of the devices. To this end, the wireless communication unit 420 may include a receiving unit 423 and a transmitting unit 421 .

In the present embodiment, the remote control apparatus 200 may include a receiver 423 for receiving a device identification signal, and a transmitter 421 for outputting a remote control signal or an output signal or a call signal.

The transmitter 421 includes a call signal transmitter 421a that transmits a call signal, a pairing request/response signal transmitter 421b that transmits a pairing request/response signal, and a remote control signal that transmits a remote control signal corresponding to a control command. A transmitter 421c may be provided.

At this time, the call signal transmitter 421a, the pairing request/response signal transmitter 421b, and the remote control signal transmitter 421c may be physically or logically separated.

Alternatively, the call signal transmitter 421a, the pairing request/response signal transmitter 421b, and the remote control signal transmitter 421c may be implemented as the same single transmitter.

The receiving unit 423 includes a pairing request/response signal receiving unit 423a for receiving a pairing request/response signal, and an identification signal receiving unit 423b for receiving an identification signal from at least one device or a transmission apparatus corresponding to the device. can do.

At this time, the pairing request/response signal receiver 423a and the identification signal receiver 423b may be physically or logically separated.

Alternatively, the pairing request/response signal receiver 423a and the identification signal receiver 423b may be implemented as the same single transmitter.

The receiver 423 includes an infrared (Infra Red) signal, a radio frequency (RF) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, a laser signal, and an Ultra Wideband (UWB) signal. Any one of the device identification signals can be received from the transmission apparatus 101 .

On the other hand, the transmitter 421, an infrared (Infra Red) signal, RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, ZigBee (ZigBee) signal, Bluetooth (bluetooth) signal, laser signal, UWB (Ultra Wideband) signal Any one of the signals, a remote control signal, can be output.

Meanwhile, the transmitter 421 may output different remote control signals for each of the plurality of devices. For example, when a remote control signal is output as an IR signal, different patterns or IR signals of different frequency bands may be output.

Meanwhile, the transmitter 421 may output the output signal Sout corresponding to the case of FIG. 11A . At this time, the output signal Sout is an infrared (Infra Red) signal, a RF (Radio Frequency) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, a laser signal, and a UWB (Ultra Wideband) signal. ) may be any one of the signals.

Meanwhile, the transmitter 421 may output a call signal Scall, corresponding to the case of FIG. 13A . At this time, the call signal (Scall) is an infrared (Infra Red) signal, RF (Radio Frequency) signal, Wi-Fi signal, ZigBee signal, Bluetooth (bluetooth) signal, laser signal, UWB (Ultra Wideband) signal ) may be any one of the signals.

On the other hand, when the device is the image display apparatus 100a, the remote control apparatus 200 may transmit a signal containing pointing information of the remote control apparatus 200, for example, information on movement, and the like.

The key input unit 430 may include a plurality of keys. The plurality of keys may be implemented as a keypad, a button, a touch pad, or a touch screen.

The microphone 435 may receive a user's voice, convert the received user's voice into an electrical signal, and transmit it to the processor 480 .

The sensor unit 440 may include a gyro sensor 441 or an acceleration sensor 443 . The gyro sensor 441 may sense information about the movement of the remote control device 200 .

For example, the gyro sensor 441 may sense information about the operation of the remote control device 200 based on x, y, and z axes. The acceleration sensor 443 may sense information about the moving speed of the remote control device 200 .

The output unit 450 may output a vibration or sound signal corresponding to the manipulation of the key input unit 430 or emit LED light. Through the output unit 450 , the user may recognize whether the key input unit 430 has been operated.

For example, the output unit 450 includes an LED module 451 that is lit when the key input unit 430 is manipulated or an IR signal is transmitted or received through the wireless communication unit 425, a vibration module 453 that generates vibration, a sound A sound output module 455 for outputting .

The power supply unit 460 supplies power to the remote control device 200 . The power supply unit 460 may reduce power consumption by stopping the power supply when the remote control device 200 does not move for a predetermined period of time. The power supply unit 460 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 470 may store various types of programs and application data required for control or operation of the remote control device 200 .

In particular, a plurality of device information or a plurality of device identification information may be stored. The processor may enable identification or identification of a device capable of remote control based on the stored plurality of device information or the plurality of device identification information and the detected identification information. In addition, pattern related data of a plurality of signals received from a plurality of devices may be stored. In addition, it is possible to store control command data for each device, for setting an operation key. In addition, a signal pattern for each device and operation key may be stored.

The processor 480 controls all matters related to the control of the remote control device 200 .

When the processor 480 receives, through the receiver 423 , at least one identification signal including a device identification signal from at least one device or a transmission apparatus corresponding to the device, the received at least one identification signal detecting an identification signal in the , identifying or identifying a device based on the detected identification signal, matching at least one of a plurality of keys to a control command for remote control of the device, and selecting a key matching the control command In this case, the transmitter 421 may be controlled to transmit a signal corresponding to the control command.

Meanwhile, when the remote control device is directed in the device direction, the processor 480 may identify the device based on an identification signal received from the device or a transmission device corresponding to the device.

Meanwhile, the processor 480 detects a first identification signal from at least one identification signal including the first identification signal received from the first device when the remote control device 200 is directed toward the first device, and , based on the detected first identification signal, matching at least one of the plurality of keys to a control command for remote control of the first device, and when the remote control apparatus 200 is directed toward the second device, Detect a second identification signal from at least one identification signal including the second identification signal received from the second device, and based on the detected second identification signal, select at least one of the plurality of keys from a remote control of the second device For control, it can match a control command.

Meanwhile, the processor 480 may control to transmit a signal corresponding to a predetermined key operation of the key input unit 430 to the device through the wireless communication unit 425 .

On the other hand, the processor 480, the remote control device 200 is directed toward the image display device 100a, identifies the image display device 100a, and some of the control keys are control commands of the image display device 100a. , a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 440 or a pointing signal may be transmitted to the image display device 100a through the wireless communication unit 425 .

Meanwhile, the camera 495 may capture an image. In particular, when the camera 495 is directed in the direction of the user's face, an image including the user's face may be captured.

The processor 480 may identify or confirm the user based on the captured user face image and pre-stored user image related data.

Meanwhile, the fingerprint recognition unit 499 may capture an image including a user's fingerprint. In this case, the processor 480 may identify or confirm the user based on the captured user finger fingerprint image and pre-stored user finger fingerprint image related data.

Meanwhile, the processor 480 may perform user authentication based on the image captured by the camera 495 , and when the user authentication is successful, control the device to be remotely controlled.

Meanwhile, the processor 480 may control the user information to be transmitted to a controllable device after identification is completed, and when receiving user authentication confirmation information from the device, may control to enable remote control of the device.

Meanwhile, the device 100 may include a wireless communication unit 411 capable of wirelessly transmitting and receiving signals with the remote control apparatus 200 and a control unit 170 for controlling an operation corresponding to the received wireless signal. .

The wireless communication unit 411 may transmit/receive a signal to and from the remote control device 200 wirelessly. Also, the wireless communication unit 411 may receive a signal transmitted by the remote control device 200 according to various communication standards.

8 is a flowchart illustrating an example of an operating method of a remote control device according to an embodiment of the present invention, and FIGS. 9A to 9D are diagrams referenced in the description of the operating method of the remote control device of FIG. 8 .

First, referring to FIG. 8 , when the remote control apparatus 200 is directed toward the device ( S805 ), the receiver 423 of the remote control apparatus 200 receives an identification signal ( S810 ).

For example, as shown in FIG. 3A , when the remote control device 200 is directed to the air conditioner 100c, the receiving unit 423 of the remote control device 200 corresponds to the air conditioner 100c or the air conditioner 100c. An identification signal of a pattern corresponding to the air conditioner may be received from the transmitting device 101c.

Next, the processor 480 of the remote control device 200 may detect an identification signal from the received at least one identification signal (S811).

Next, the processor 480 of the remote control apparatus 200, based on the detected identification signal, identifies the device (S813).

As described above, the device identification method identifies a device by extracting information from the received identification signal, or data related to the received identification signal and a plurality of device information or a plurality of device identification signals stored in the storage unit 470 . By comparing the , a method of identifying a device and the like are possible.

Next, the processor 480 of the remote control apparatus 200 matches at least one of the plurality of keys to a control command for remote control of the device (S815).

Next, the processor 480 of the remote control device 200 determines whether a key matching the control command is selected (S820), and, if applicable, controls to transmit a remote control signal corresponding to the control command (S825). Accordingly, it is possible to easily remote control the corresponding device.

Referring to FIG. 9A , the plurality of transmission devices 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h are active transmission devices, each of which has a separate power supply and can output a device identification signal, respectively. have.

In the figure, when the remote control device 200 is directed to the air conditioner 100c, the transmitting device 101c corresponding to the air conditioner 100c exemplifies that the identification signal Sidc is output.

Accordingly, the remote control device 200, through the receiving unit 423, receives at least one identification signal including the identification signal (Sidc), detects the identification signal (Sidc) from the received identification signal, the detected By performing signal processing on the identification signal Sidc, it is possible to confirm or identify that the current air conditioner 100c can be remotely controlled.

In addition, at least some of the plurality of keys may be set to operate as an air conditioner operation key.

9B illustrates that the transmitter 106c of the transmitter 101c corresponding to the air conditioner 100c outputs the first infrared identification signal IRc.

As shown in (a) of FIG. 9B , the infrared camera 423aa of the remote control device 200 may capture an infrared image including the transmitting device 101c corresponding to the air conditioner 100c.

Meanwhile, FIG. 9B (b) illustrates that the first infrared identification signal IRc has a constant low level LVL and a high level LVH, and the duty thereof is variable. That is, the first infrared identification signal IRc having the duty of the first pattern based on time is exemplified.

The processor 480 may detect a first infrared identification signal IRc having a duty of a first pattern, as shown in the drawing, based on a plurality of infrared images captured during a predetermined frame period.

The processor 480 compares the pattern data pre-stored in the storage unit 470 and the like with the first pattern of the detected first infrared identification signal IRc to identify the directed device as the air conditioner 100c. have.

9C illustrates that, when the remote control device 200 is directed to the image display device 100a, the transmitting device 101a corresponding to the image display device 100a outputs the identification signal Sida. .

Accordingly, the remote control device 200, through the receiving unit 423, receives at least one identification signal including the identification signal (Sida), detects the identification signal (Sida) from the received identification signal, the detected identification By performing signal processing on the signal Sida, it is possible to confirm or identify that the current image display apparatus 100a can be remotely controlled.

In addition, at least some of the plurality of keys may be set to operate as an operation key for the image display device.

Next, FIG. 9D illustrates that the transmitter 106a of the transmitter 101a corresponding to the image display device 100a outputs the second infrared identification signal IRa.

As shown in (a) of FIG. 9D , the infrared camera 423aa of the remote control device 200 may capture an infrared image including the transmitting device 101a corresponding to the image display device 100a.

Meanwhile, FIG. 9D (b) illustrates that the infrared identification signal IRa has a constant low level LVL and a high level LVH, and the duty thereof is variable. That is, the second infrared identification signal IRa having the duty of the second pattern based on time is exemplified.

The processor 480 may detect a second infrared identification signal IRa having a duty of a second pattern, as shown in the drawing, based on a plurality of infrared images captured during a predetermined frame period.

Then, the processor 480 compares the pattern data pre-stored in the storage unit 470 and the like with the second pattern of the detected second infrared identification signal IRa, and the directed device is the image display apparatus 100a. can be identified as

10 is a flowchart showing an example of an operating method of a remote control device according to another embodiment of the present invention, and FIGS. 11A to 11H are diagrams referenced in the description of the operating method of the remote control device of FIG. 10 .

First, the operation method of FIG. 10 is similar to the operation method of FIG. 8, but the output signal output step (S906) and the step (S910) of receiving the identification signal reflected in response to the output signal are different from those of FIG. have. Other than that, the 905th step (S905), the 913th step (S913) to the 925th step (S925) are the 805th step (S805), the 811th step (S811), the 813th step (S813) to the step 925th of FIG. It corresponds to step 825 (S825).

Referring to FIG. 11A , the transmitters 101aa, 101bb, 101cc, 101dd, 101ee, 101ff, 101gg, and 101hh are passive transmitters and include a reflective member that reflects an output signal from the outside without a separate power supply. can do.

Meanwhile, for device identification during reflection, different reflection pattern members may be provided for each device.

On the other hand, the remote control apparatus 200, through the transmitter 421, the output signal (Sout), in a directed device direction, may be output.

11A , when the remote control device 200 is directed to the air conditioner 100c, the output signal Sout output from the remote control device 200 is a transmission device 101cc corresponding to the air conditioner 100c. is incident on the , and the transmitting device 101cc may output the reflected signal, that is, the identification signal Sidcc, in the direction of the remote control device 200 by reflection or total reflection using the formed specific pattern.

Accordingly, the remote control device 200 receives, through the receiving unit 423, at least one identification signal including the identification signal Sidcc, and performs signal processing on the identification signal Sidcc, so that the current air conditioner ( 100c) can be confirmed, or identified, that remote control is possible.

11B illustrates the transmitting device 101cc of the air conditioner 100c having a first spatially based infrared reflection pattern.

In particular, in FIG. 11B (a), the transmitter 421 of the remote control device 200 outputs the infrared output signal Sout to the transmitter 101cc of the air conditioner 100c to which the air conditioner 100c is directed. It is exemplified that the reflected infrared signal Sidcc is received by the infrared camera 423aa by the first infrared reflection pattern formed in the transmitting device 101cc of the .

Accordingly, the infrared camera 423aa may capture at least one infrared image 1011a including the first infrared reflection pattern 1012a as shown in (b) of FIG. 11B .

The processor 480 compares the first infrared reflection pattern 1012a in the captured infrared image 1011a with the infrared pattern data pre-stored in the storage unit 470 or the like, and the directed device is the air conditioner 100c. can be identified as being

Meanwhile, in the drawings, the infrared pattern is illustrated as 3X3, but various modifications are possible.

11C illustrates that the transmitting device 101cc having the first spatially based infrared reflection pattern is formed on the logo 101lgc formed on the front surface of the air conditioner 100c.

As shown in the figure, when the transmitting device 101cc having the first spatially based infrared reflection pattern is formed on the logo 101lgc formed on the front surface of the air conditioner 100c, the infrared reflection pattern is not installed in a separate space. Therefore, the degree of design freedom can be improved.

11D, when the remote control device 200 is directed to the image display device 100a, the output signal Sout output from the remote control device 200 is a transmission device corresponding to the image display device 100a. It is incident on 101aa, and the transmitting device 101aa outputs the reflected signal, that is, the identification signal Sidaa, in the direction of the remote control device 200 by reflection or total reflection using the formed specific pattern. exemplify

Accordingly, the remote control device 200 receives, through the receiver 423, at least one identification signal including the identification signal Sidaa, detects the identification signal Sidaa among them, and the detected identification signal ( Sidaa), it is possible to confirm or identify that the current image display device 100a can be remotely controlled.

11E illustrates a transmitting device 101aa of the image display device 100a having a second spatially based infrared reflection pattern.

In particular, in FIG. 11E (a), the transmitter 421 of the remote control device 200 outputs the infrared output signal Sout to the transmitter 101aa of the image display device 100a to which the image is displayed. It is exemplified that the reflected infrared signal Sidaa is received by the infrared camera 423aa by the second infrared reflection pattern formed in the transmitting device 101aa of the apparatus 100a.

Accordingly, the infrared camera 423aa may capture the infrared image 1011b including the second infrared reflection pattern 1012b as shown in FIG. 11E (b).

The processor 480 compares the second infrared reflection pattern 1012b in the captured infrared image 1011b with the infrared pattern data pre-stored in the storage unit 470, etc., so that the directed device is an image display device ( 100a) can be identified or identified.

11F illustrates that the transmitting device 101aa having the second spatially based infrared reflection pattern is formed in the bezel area 101lgc of the image display device 100a.

As shown in the figure, when the transmitting device 101aa having the spatially-based second infrared reflection pattern is formed in the bezel region 101lgc of the image display device 100a, the infrared reflection pattern is not installed in a separate space. Therefore, the degree of design freedom can be improved.

11G is similar to FIG. 11B, but the infrared output signal Sout is not output from the transmitter 421 of the remote control device 200, and the transmitter 101cb of the air conditioner 100c has nine infrared light emitting units. Among them, it is exemplified that only some (LPc3, LPc6, LPc7, LPc9) emit light.

The infrared image 1011a obtained by the infrared camera 423aa may be the same as that of FIG. 11B , and accordingly, the processor 480 compares it with the infrared pattern data pre-stored in the storage unit 470, etc. It can be identified that the device is the air conditioner 100c.

11H is similar to FIG. 11E , but the infrared output signal Sout is not output from the transmitter 421 of the remote control device 200 , and the transmitter 101ab of the image display device 100a receives nine infrared rays. It is exemplified that only some of the light emitting units LPa2, LPa3, and LPa7 emit light.

The infrared image 1011b obtained by the infrared camera 423aa may be the same as that of FIG. 11E , and accordingly, the processor 480 compares it with the infrared pattern data pre-stored in the storage unit 470, etc. It can be identified that the device is the image display apparatus 100a.

12A to 12C are flowcharts showing various examples of an operating method of a remote control device according to another embodiment of the present invention, and FIGS. 13A to 13D are diagrams referenced in the description of the operating method of FIGS. 12A to 12C .

First, referring to FIG. 12A , when the remote control apparatus 200 is directed in the device direction (S955), the call signal transmitter 421a among the transmitters 421 of the remote control apparatus 200 is directed toward the device. A call signal (Scall) is transmitted (S960).

Meanwhile, the call signal Scall may include a pairing request signal for communication pairing between the remote control apparatus 200 and the device 100 .

Meanwhile, the communication signal capable of communication pairing may be any one of a radio frequency (RF) signal, a Wi-Fi signal, a ZigBee signal, a Bluetooth signal, and an Ultra Wideband (UWB) signal.

The device 100 to which the remote control apparatus 200 is directed may receive a call signal (Scall) (S961) and recognize the call signal (Scall) (S962).

Meanwhile, the device 100 may receive the call signal Scall through an infrared (IR) signal receiver (not shown), a laser signal receiver (not shown), or the like.

The device 100 may recognize a pairing request signal according to the call signal recognition, and may transmit a pairing response signal corresponding to the pairing request signal ( S968).

The pairing request/response signal receiver 423a among the receivers 423 of the remote control device 200 may receive a pairing response signal (S969). Accordingly, pairing between the remote control apparatus 200 and the device 100 may be completed.

Meanwhile, the device 100 may transmit an identification signal after pairing is completed (S974).

In addition, the identification signal receiving unit 423b among the receiving units 423 of the remote control device 200 may receive the identification signal (S975).

The processor 170 of the remote control apparatus 200 may identify the device based on the identification signal (S980). The device identification method is as described above.

Next, the processor 480 of the remote control apparatus 200 matches at least one of the plurality of keys to a control command for remote control of the device (S985).

Next, the processor 480 of the remote control device 200 determines whether a key matching the control command is selected (S990), and, if applicable, sends a remote control signal corresponding to the control command, a remote control signal Through the transmitter 421c, it is controlled to transmit (S995). Accordingly, it is possible to easily remote control the corresponding device.

Next, FIG. 12B is similar to FIG. 12A , but there is a difference between the step of outputting the call signal ( S960 ) and the step of identifying ( S980 ).

According to FIG. 12B , a call signal transmitter 421a among the transmitters 421 of the remote control apparatus 200 transmits a call signal Scall in a directed device direction (S960).

The device 100 to which the remote control apparatus 200 is directed may receive a call signal (Scall) (S961) and recognize the call signal (Scall) (S962).

The device 100 may transmit a pairing request signal according to the call signal recognition (S963).

The pairing request/response signal receiver 423a among the receivers 423 of the remote control device 200 may receive a pairing request signal (S964).

In addition, the pairing request/response signal transmitter 421b among the transmitters 421 of the remote control device 200 may transmit a pairing response signal corresponding to the pairing request signal (S968b). ).

The device 100 may receive a pairing response signal (S969b). Accordingly, pairing between the remote control apparatus 200 and the device 100 may be completed.

Meanwhile, the device 100 may transmit an identification signal after pairing is completed (S974). The identification signal receiving unit 423b among the receiving units 423 of the remote control device 200 may receive the identification signal (S975).

Next, FIG. 12C is similar to FIG. 12A, but there is a difference between the call signal output step S960 and the matching step S985.

According to FIG. 12C , the call signal transmitter 421a among the transmitters 421 of the remote control apparatus 200 transmits a call signal Scall in the directed device direction (S960).

The device 100 to which the remote control apparatus 200 is directed may receive a call signal (Scall) (S961) and recognize the call signal (Scall) (S962).

The device 100 may transmit an identification signal according to the call signal recognition (S974). The identification signal receiving unit 423b among the receiving units 423 of the remote control device 200 may receive the identification signal (S975).

Next, the processor 480 of the remote control apparatus 200, based on the received identification signal, identifies the device (S980). Then, at least one of the plurality of keys is matched with a control command for remote control of the device (S985).

Next, the pairing request/response signal transmitter 421b among the transmitters 421 of the remote control device 200 may transmit a pairing request signal (S986). The device 100 may receive a pairing request signal (S987).

Next, the device 100 may transmit a pairing response signal corresponding to the pairing request signal (S988).

The pairing request/response signal receiver 423a among the receivers 423 of the remote control device 200 may receive a pairing response signal (S989). Accordingly, pairing between the remote control apparatus 200 and the device 100 may be completed.

Meanwhile, the call signal transmitter 421a, the pairing request/response signal transmitter 421b, and the remote control signal transmitter 421c in the transmitter 421 may be physically or logically separated.

Alternatively, the call signal transmitter 421a, the pairing request/response signal transmitter 421b, and the remote control signal transmitter 421c may be implemented as the same single transmitter.

Meanwhile, the pairing request/response signal receiver 423a and the identification signal receiver 423b may be physically or logically separated.

Alternatively, the pairing request/response signal receiver 423a and the identification signal receiver 423b may be implemented as the same single transmitter.

FIG. 13A is a diagram referenced to explain an example of a method for the remote control device 200 to identify the air conditioner 101c with reference to FIG. 12A .

When the remote control device 200 transmits a call signal Scall to the air conditioner 101c, the air conditioner 101c receives and recognizes the call signal Scall. Then, the air conditioner 101c recognizes the pairing request signal Sprq in the call signal Scall.

The air conditioner 101c transmits a pairing response signal Sprsc according to recognition of the pairing request signal Sprq. The remote control device 200 receives the pairing response signal Sprsc, thereby completing pairing.

Meanwhile, the air conditioner 101c outputs the identification signal Sidc after pairing is completed. The remote control device 200 receives the identification signal Sidc, and identifies the air conditioner 101c based on the identification signal Sidc.

FIG. 13B is a diagram referenced to explain another example of a method for the remote control device 200 to identify the image display device 100a with reference to FIG. 12A .

When the remote control device 200 transmits a call signal Scall to the image display device 100a, the image display device 100a receives and recognizes the call signal Scall. Then, the image display device 100a recognizes the pairing request signal Sprq in the call signal Scall.

The video display device 100a transmits a pairing response signal Sprsa according to recognition of the pairing request signal Sprq. The remote control device 200 receives the pairing response signal Sprsa, thereby completing pairing.

On the other hand, through the pairing between the image display device 100a and the remote control device 200, the remote control device 200, RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, Zigbee from the image display device 100a The identification signal may be received from any one of a (ZigBee) signal, a Bluetooth signal, a laser signal, and an Ultra Wideband (UWB) signal.

Meanwhile, the image display device 100a outputs an identification signal Sida after pairing is completed. The remote control device 200 receives the identification signal Sida, and identifies the image display device 100a based on the identification signal Sida.

FIG. 13C is a diagram referenced to explain another example of a method for the remote control device 200 to identify the image display device 100a in relation to FIG. 12B .

When the remote control device 200 transmits a call signal Scall to the image display device 100a, the image display device 100a receives and recognizes the call signal Scall. Then, the image display device 100a transmits a pairing request signal Sprq according to the recognition of the call signal Scall.

The remote control device 200 receives the pairing request signal Sprq, and transmits a pairing response signal Sprs in response to the pairing request signal Sprq.

The video display device 100a receives the pairing response signal Sprs, thereby completing pairing.

Meanwhile, the image display device 100a outputs an identification signal Sida after pairing is completed. The remote control device 200 receives the identification signal Sida, and identifies the image display device 100a based on the identification signal Sida.

FIG. 13D is a diagram referenced to explain another example of a method for the remote control device 200 to identify the image display device 100a with reference to FIG. 12C .

When the remote control device 200 transmits a call signal Scall to the image display device 100a, the image display device 100a receives and recognizes the call signal Scall. Then, the image display device 100a outputs the identification signal Sida according to the recognition of the call signal Scall. The remote control device 200 receives the identification signal Sida, and identifies the image display device 100a based on the identification signal Sida.

Meanwhile, the remote control apparatus 200 transmits a pairing request signal Sprq after device identification is completed. The video display device 100a receives the pairing request signal Sprq, and transmits a pairing response signal Sprsa in response to the pairing request signal Sprq.

The remote control device 200, the video display device 100a, receives the pairing response signal Sprsa, and thus pairing is completed.

14 is a flowchart illustrating an example of an operating method of a remote control device according to another embodiment of the present invention, and FIGS. 15A to 15B are diagrams referenced in the description of the operating method of the remote control device of FIG. 14 .

First, referring to FIG. 14 , the receiver 423 of the remote control device 200 may capture an infrared image ( S1011 ).

For example, when the transmitting device 101 outputs an infrared (IR) identification signal, the receiving unit 423 of the remote control device 200 may include an infrared camera 423aa for detecting the infrared identification signal. have.

In addition, when the infrared camera 423aa receives at least one infrared identification signal, the infrared camera 423aa may capture an infrared image from the received at least one infrared identification signal.

In particular, the infrared camera 423aa may capture an infrared image including the device 100 or the transmitting apparatus 101 corresponding to the device according to the orientation direction of the remote control apparatus 200 .

Next, the processor 480 may detect an infrared pattern from the device 100 or the transmission apparatus 101 corresponding to the device in the captured infrared image ( S1013 ).

Next, the processor 480 outputs an infrared (IR) signal from at least one device or at least one transmission device corresponding to the at least one device, and based on the at least one infrared signal, whether an infrared pattern is detected is determined (S1015).

And, if applicable, the processor 480 may detect an infrared pattern located in the most central region of the infrared image as a representative infrared pattern (S1017), and identify a device based on the representative infrared pattern (S1019).

Meanwhile, when there is one infrared pattern in step 1015 ( S1015 ), as in step 1019 ( S1019 ), the processor 480 may identify a device based on the single infrared pattern.

15A to 15B are diagrams illustrating a method of selecting a device based on any one infrared (IR) signal when a plurality of infrared (IR) signals are received by the remote control device.

First, it is assumed that the remote control device 200 includes a receiving unit 423 for receiving an infrared (IR) signal, and the receiving unit 423 includes an infrared camera 423aa.

Referring to FIG. 15A , as shown in FIG. 3A , when the remote control device 200 is directed to the air conditioner 100c among the plurality of devices, the infrared camera 423aa may capture an infrared image 1010a as shown in the figure. can

When receiving a plurality of IR signals, the processor 480 detects an IR signal located in the most central region in an infrared image captured by the infrared camera as a representative IR signal, and identifies a device corresponding to the detected representative IR signal. And it can be controlled so that remote control of the identified device can be performed.

That is, the processor 480 detects an infrared pattern located in the most central region in the infrared image as a representative infrared pattern, identifies or identifies a device corresponding to the detected infrared pattern, and remotely controls the identified or identified device. can be controlled so that it can be performed.

That is, in the drawing, the air conditioner 100c and the transmitting device 101c corresponding to the air conditioner are located in the center of the infrared image 1010a, and on the left side, the lighting device 100d, and the corresponding transmitting device 101d, It is exemplified that the set-top box 100b and the corresponding transmitting device 101b, and the image display device 100a and the corresponding transmitting device 101a are disposed on the leftmost side.

Meanwhile, the processor 480 may detect an infrared pattern region from which an infrared signal is output in the infrared image 1010a.

Meanwhile, the processor 480 includes an area Arca including the transmission device 101c corresponding to the air conditioner, an area Arda including the transmission device 101d corresponding to the lighting device 100d, and the set-top box 100b. ) of the area Arba including the transmitting device 101b corresponding to ) and the area Araa including the transmitting device 101a corresponding to the image display device 100a, the transmission corresponding to the air conditioner located at the center An area Arca containing the device 101c may be selected.

In addition, the processor 480 may extract an area Arca including the transmitting device 101c corresponding to the air conditioner located at the center among the plurality of areas, and detect an infrared pattern within the area Arca. have.

For example, the processor 480 detects an infrared (IR) signal from the transmitter 101c corresponding to the air conditioner 100c as a representative infrared (IR) signal, and corresponds to the detected representative infrared (IR) signal. to confirm or identify the air conditioner 100c, and to match at least some of the plurality of keys as a control command for remote control of the air conditioner 100c in response to the confirmed or identified air conditioner 100c.

Referring to FIG. 15B , as shown in FIG. 3C , when the remote control apparatus 200 is directed to the image display apparatus 100a among a plurality of devices, the infrared camera 423aa generates an infrared image 1010b as shown in the drawing. can capture.

The processor 480, when receiving a plurality of infrared (IR) signals, detects an infrared (IR) signal located in the most central region in the infrared (IR) image captured by the infrared camera as a representative infrared (IR) signal, , a device corresponding to the detected representative infrared (IR) signal may be identified or identified, and a control may be performed to perform remote control of the identified or identified device.

In the drawing, the image display device 100a, and the transmission device 101a corresponding thereto are located in the center of the image 1010b, and on the right side, the set-top box 100b and the transmission device 101b corresponding thereto, and the lighting device. (100d), and a transmission device 101d corresponding thereto are disposed, and an air conditioner 100c, and a transmission device 101c corresponding thereto, are disposed on the rightmost side, and on the left side of the image display device 100a, The arrangement of the robot cleaner 100e and the transmission device 101e corresponding thereto is exemplified.

Meanwhile, the processor 480 may detect an infrared (IR) pattern region from which an infrared signal is output in the infrared image 1010b.

Meanwhile, the processor 480 includes an area Arab including the transmitting device 101a corresponding to the image display device 100a and an area Arbb including the transmitting device 101b corresponding to the set-top box 100b. , the area Ardb including the transmitting device 101d corresponding to the lighting device 100d, the area Arcb including the transmitting device 101c corresponding to the air conditioner, and the transmitting device 101c corresponding to the air conditioner 100c ), the transmitting device 101a corresponding to the image display device 100a located at the center of the area Areb, the transmitting device 101e corresponding to the robot cleaner 100e is included. You can select an area (Arab) to be used.

Then, the processor 480 extracts an area Arab including the transmission device 101a corresponding to the image display device 100a located at the center among the plurality of areas, and extracts the area Arab within the area Arab. Infrared (IR) patterns can be detected.

Accordingly, the processor 480 detects an infrared (IR) signal from the transmitting device 101a corresponding to the image display device 100a as a representative infrared (IR) signal, and receives the detected representative infrared (IR) signal. A corresponding image display apparatus 100a may be identified or identified, and at least some of the plurality of keys may be matched with a control command for remote control of the image display apparatus 100a in response to the image display apparatus 100a.

Meanwhile, the above-described infrared pattern may be a concept including a time-based infrared pattern or a space-based infrared pattern.

The time-based infrared pattern may be a concept including a pattern of a variable level or a variable duty for a predetermined time when the transmitting device 101 transmits an infrared signal based on a variable level or a variable duty. have.

In this case, when the transmitting device 101 transmits an infrared signal based on a variable level or a variable duty, the processor 480 detects an infrared pattern based on a variable level or a variable duty based on a plurality of captured infrared images. and, based on the detected infrared pattern, the device may be identified.

On the other hand, the space-based infrared pattern is transmitted from the transmitter 421 of the remote control device 200 to the transmitter 101 when an infrared reflection pattern is formed instead of the transmitter 101 not outputting an infrared signal by itself. ), the infrared output signal Sout is output, and the infrared output signal Sout is selectively reflected by the infrared reflection pattern in the transmitting device 101 , so it may be a concept including the shape of the reflection pattern.

At this time, the processor 480, the device 100a or at least one reflection pattern including the infrared reflection pattern reflected from the transmitting apparatus 101a corresponding to the device within the captured infrared image, to the device 100a or the device. An infrared pattern reflected by the infrared reflection pattern formed in the corresponding transmitting apparatus 101a may be detected, and based on the detected infrared pattern, the device 100a may be identified or identified.

On the other hand, the processor 480, when a partial reflection pattern and a partial absorption pattern are formed in the transmission apparatus 101, the infrared reflection pattern, and the infrared absorption pattern formed in the device or the transmission apparatus corresponding to the device in the captured infrared image. Based on the , an infrared pattern may be detected, and a device may be identified based on the detected infrared pattern.

For time-based infrared pattern detection, see FIGS. 9B to 9D , and for space-based infrared pattern detection, refer to FIGS. 11B to 11F .

First, FIG. 9B illustrates that the transmitter 106c of the transmitter 101c corresponding to the air conditioner 100c outputs the infrared identification signal IRc.

As shown in (a) of FIG. 9B , the infrared camera 423aa of the remote control device 200 may capture an infrared image including the transmitting device 101c corresponding to the air conditioner 100c.

Meanwhile, when the directed device is changed, the processor 480 may control a control command for at least one of a plurality of keys to vary. This will be described with reference to FIG. 16 and below.

16 is a flowchart showing an example of an operating method of a remote control device according to another embodiment of the present invention, and FIGS. 17A to 27E are diagrams referenced in the description of the operating method of the remote control device of FIG. 16 .

First, referring to FIG. 16 , when the remote controller 200 is directed to the first device ( S1105 ), the receiver 423 of the remote controller 200 receives at least one identification signal ( S1110 ). .

Next, the processor 480 of the remote control device 200 detects a first identification signal from at least one identification signal including the first identification signal (S1111). Then, based on the detected first identification signal, the first device is identified (S1113).

For example, as shown in FIG. 3A , when the remote control device 200 is directed to the air conditioner 100c, the receiver 423 of the remote control device 200 receives at least one identification signal, and at least one From the identification signal, the air conditioner 100c or a first identification signal corresponding to the air conditioner from the transmission device 101c corresponding to the air conditioner 100c may be detected.

Any one of the identification signals may be detected by the method described in FIGS. 14 to 15B .

And, the processor 480 of the remote control device 200, based on the detected first identification signal, identifies or checks whether the identification signal of the first device. For example, it may be confirmed as the identification signal of the first device by comparison with the identification signal pattern data stored in the storage unit 470 .

Then, the processor 480 of the remote control apparatus 200 matches at least one of the plurality of keys to a control command for remote control of the first device (S1115).

Next, the processor 480 of the remote control device 200 determines whether a first key is selected from among the keys matching the control command (S1120), and, if applicable, the control command or corresponding to the first key. Control to transmit the first remote control signal (S1125). Accordingly, it is possible to conveniently remote control the first device.

Next, when the remote controller 200 is directed to the second device ( S1130 ), the receiver 423 of the remote controller 200 , the receiver 423 of the remote controller 200 , identifies at least one A signal is received (S1135).

Next, the processor 480 of the remote control device 200 detects a second identification signal from at least one identification signal including the second identification signal (S1136). Then, based on the detected second identification signal, the second device is identified (S1138).

For example, as shown in FIG. 3B , when the remote control device 200 is directed to the image display device 100a, the receiving unit 423 of the remote control device 200 receives at least one identification signal, and at least From one identification signal, a second identification signal corresponding to the image display apparatus 100a from the image display apparatus 100a or the transmission apparatus 101a corresponding to the image display apparatus 100a may be detected.

Next, the processor 480 of the remote control device 200 checks or identifies whether it is an identification signal of the second device based on the detected second identification signal. For example, by comparing with the identification signal pattern data stored in the storage unit 470 , it may be confirmed or identified as the identification signal of the second device.

Then, the processor 480 of the remote control apparatus 200 matches at least one of the plurality of keys to a control command for remote control of the second device (S1140).

Next, the processor 480 of the remote control device 200 determines whether a first key is selected from among the keys matched to the control command (S1145), and, if applicable, the control command or corresponding to the first key. Control to transmit the second remote control signal (S1150). Accordingly, it is possible to easily remote control the second device.

17A illustrates a case in which the remote control apparatus 200 is directed toward the air conditioner 100c among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives the identification signal Sidc from the transmission device 101c corresponding to the air conditioner 100c. And, the identification signal (Sidc) is detected from the at least one identification signal including the identification signal (Sidc), based on the detected identification signal (Sidc), the directed device is identified or identified as the air conditioner (100c), , at least some of the plurality of keys may be matched as a control command for the air conditioner 100c.

Next, FIG. 17B illustrates a case in which the menu key 203 is selected among a plurality of keys of the remote control device 200 . Accordingly, the remote control signal Sremc corresponding to the menu key 203 is transmitted to the air conditioner 100c.

For example, the remote control device 200 may match the menu key 203 with a wind intensity adjustment control command to control the air conditioner.

Accordingly, as shown in FIG. 17C , the air conditioner 100c can output the cold wind 1103 in response to the wind strength set according to the operation of the menu key 203 .

18A illustrates a case in which the remote control apparatus 200 is directed toward the image display apparatus 100a among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives the identification signal Sida from the transmission device 101a corresponding to the image display device 100a. Then, the identification signal Sida is detected from at least one identification signal including the identification signal Sida, and based on the detected identification signal Sida, it is confirmed that the directed device is the image display apparatus 100a or It is possible to identify and match at least some of the plurality of keys as a control command for the image display device 100a.

Next, FIG. 18B illustrates a case in which the menu key 203 is selected among a plurality of keys of the remote control device 200 . Accordingly, the remote control signal Srema corresponding to the menu key 203 is transmitted to the image display device 100a.

Accordingly, as shown in FIG. 18C , in a state where a predetermined image 1210 is displayed on the image display device 100a, a menu object can be displayed at the bottom of the screen according to an operation of the menu key 203 .

17A to 18C , by setting different operations to the menu key to control different devices, it is possible to conveniently remotely control different devices.

19A illustrates a case in which the remote control apparatus 200 is directed toward the set-top box 100b among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote controller 200 receives the identification signal Sidb from the transmitter 101b corresponding to the set-top box 100b. Then, the identification signal Sidb is detected from at least one identification signal including the identification signal Sidb, and based on the detected identification signal Sidb, it is confirmed or identified that the directed device is the set-top box 100b. and at least some of the plurality of keys may be matched with a control command for the set-top box 100b.

Next, FIG. 19B illustrates a case in which the menu key 203 is selected among a plurality of keys of the remote control device 200 .

For example, when a specific operation is not set to the menu key 203 when controlling the set-top box, as shown in the drawing, the remote control apparatus 200 may output an operation disabled message 1311 as a sound. Accordingly, the user can recognize that the operation of the menu key does not work.

Next, FIG. 19C illustrates a case in which the channel key 212 is selected among a plurality of keys of the remote control device 200 .

The remote control device 200 may transmit a remote control signal Sremb related to a channel change to the set-top box 100b according to an operation of the channel key 212 .

Accordingly, the set-top box 100b may perform a channel change and provide the channel-changed broadcast video image to the video display device 100a.

In the drawing, the broadcast image 1310 of CH36-1 displayed in FIG. 19B is changed and the broadcast image 1315 of CH37-1 is displayed on the image display device 100a.

20A illustrates a case in which the remote control apparatus 200 is directed toward the air conditioner 100c among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives the identification signal Sidc from the transmission device 101c corresponding to the air conditioner 100c. And, the identification signal (Sidc) is detected from the at least one identification signal including the identification signal (Sidc), based on the detected identification signal (Sidc), the directed device is identified or identified as the air conditioner (100c), , at least some of the plurality of keys may be matched as a control command for the air conditioner 100c.

On the other hand, the remote control device 200, in the state in which the remote control device 200 is oriented in the direction of the air conditioner 100c, when the device check is completed or the key setting is completed, as shown in the drawing, "controls the air conditioner It is possible to output an air conditioner controllable message 311a such as ". Accordingly, the user can recognize that the air conditioner control is possible.

Next, FIG. 20B illustrates a case in which the multi-device operation key 204 is selected from among a plurality of keys of the remote control apparatus 200 .

The multi-device operation key 204 may be referred to as an IFTTT (If This, Then That) key.

In a state in which the remote control device 200 is set to remotely control the air conditioner 100c, the multi-device operation key 204 may set the power-on function of the air conditioner 100c and the power-on function of the image display device 100a. have.

For example, when the multi-device operation key 204 is selected, the remote control apparatus 200 transmits a power-on signal as the first remote control signal Sremc1 to the air conditioner 100c, and the image display apparatus 100a ) to transmit a power-on signal as the second remote control signal Srema1.

Accordingly, as shown in FIG. 20C , the air conditioner 100c may be powered on to output cold wind 1103 , and the image display device 100a may be powered on to display a predetermined image 1315 . there will be

On the other hand, the multi-device function setting for the multi-device operation key 204 can be variously set by the user's selection.

For example, when the multi-device operation key 204 is selected, the remote control apparatus 200 provides a power-on signal and a second remote control signal Srema11 as the first remote control signal Sremc1 to the air conditioner 100c. ) can also be transmitted.

In this case, the air conditioner 100c may transmit a power-on signal that is the second remote control signal Srema11 to the image display device 100a as shown in FIG. 20D .

That is, according to the operation of the multi-device operation key 204 , the directed device may receive a predetermined remote control signal and transmit a remote control signal corresponding to the multi-device operation key 204 to another device.

21A illustrates a case in which the remote control apparatus 200 is directed toward the image display apparatus 100a among various devices 100a, 100b, 100c, 100d, and 100e in the house.

The remote control device 200 receives the identification signal Sida from the transmission device 101a corresponding to the image display device 100a. Then, the identification signal Sida is detected from at least one Sicville signal including the identification signal Sida, and it is confirmed that the remote controllable device is the image display apparatus 100a based on the detected identification signal Sida. Alternatively, it is possible to identify and match at least some of the plurality of keys as a control command for the image display device 100a.

Next, FIG. 21B illustrates a case in which the multi-device operation key 204 is selected among a plurality of keys of the remote control apparatus 200 .

In a state in which the remote control apparatus 200 is set to remotely control the image display apparatus 100a, the multi-device operation key 204 has a power-on function of the image display apparatus 100a and a power-on function of the lighting apparatus 100d. can be

That is, according to the selection of the multi-device operation key 204, the remote control apparatus 200 transmits a power-on signal as the first remote control signal Srema2 to the image display apparatus 100a, and the lighting apparatus 100d. to transmit the power-on signal as the second remote control signal Sremd2.

Accordingly, as shown in Fig. 21c, according to the operation of the multi-device operation key 204, the image display apparatus 100a, the image display apparatus 100a is turned on, and a predetermined image 1315 can be displayed, The lighting device 100d is turned on, so that the light 1511 of the first color can be output.

22A to 22C illustrate a method of remotely controlling a device corresponding to a user's voice when a user's voice is received through a microphone.

First, FIG. 22A shows that the remote control device 200 is not directed to any one of the devices 100a, 100b, 100c, 100d, and 100r in the front, in a state such as "lighting a room on the second floor". It illustrates that a sound 1611 indicating a device is received.

The microphone 435 of the remote control device 200 acquires a user voice including a predetermined device, and the processor 480 performs signal processing on the acquired user voice to extract device information in the voice, At least one of the plurality of keys may be matched to a control command for remote control of a device corresponding to the extracted device information.

That is, the processor 480 may perform signal processing on the user's voice through a voice recognition algorithm to recognize a sound such as "2nd floor room lighting".

And, perform key setting for the second floor lighting device (not shown), and when the key setting is completed, as shown in the drawing, a second floor room lighting controllable message 1612 such as "I control the lighting of the second floor room" can be output as sound. Thereby, the user can recognize that the 2nd floor room lighting control is possible.

Next, FIG. 22C illustrates a case in which the power key 202 is selected among a plurality of keys of the remote control device 200 .

The processor 480 outputs a remote control signal Srem2 for powering on the lighting device in the second floor in the direction of the AP device 300 according to the operation of the power key 202 . In addition, the AP device 300 may transmit the remote control signal Srem2 to the second floor room lighting device 1605 that is connected to the wireless network.

Accordingly, the second-floor room lighting device 1605 is powered on, so that the light 1606 of a predetermined color can be output.

On the other hand, the processor 480, based on the infrared (IR) signal, the remote control signal output when the operation of the key set for the device remote control, based on the voice recognition, the key set for the device remote control The type of remote control signal output during operation can be set to be different.

That is, the processor 480, based on the reception of the infrared (IR) signal, the remote control signal output when the key set for remote control of the device is operated is output based on the infrared (IR) signal, the transmitter 421 can be controlled, and based on voice recognition, the transmitter 421 can be controlled so that a remote control signal output when a key set for remote control of the device is operated is output based on various communication protocols.

Meanwhile, when the infrared (IR)-based remote control signal is output, the processor 480 may control to output an infrared (IR)-based remote control signal of a different pattern for controlling a specific device.

Meanwhile, the remote control apparatus 200 may perform remote control by further using various input methods such as voice recognition and gesture in addition to a key in the input unit for remote control of a specific device.

For example, when the remote control apparatus 200 is directed to a specific device, by receiving an identification signal through the receiving unit 423, to enable remote control of the device, at least one of a plurality of keys, the corresponding When the user's voice is obtained through the microphone 435 in a state set as the device control key, it is possible to control to transmit a remote control signal corresponding to the user's voice to the device.

Alternatively, the processor 480 of the remote control apparatus 200 obtains the user's voice through the microphone 435 within a predetermined time in a state in which device identification is completed or a control command matching for remote control of the device is completed. In this case, it is possible to control to transmit a remote control signal corresponding to the user's voice to the device.

Specifically, the processor 480 of the remote control device 200, when the user's voice is obtained through the microphone 435 within a predetermined time in a state in which the first device can be remotely controlled, remote control corresponding to the user's voice You can control the signal to be sent to the device. This will be described with reference to FIGS. 23A to 23C.

23A illustrates a case in which the remote control apparatus 200 can remotely control the air conditioner 100c among various devices 100a, 100b, 100c, 100d, and 100e in the house, as shown in FIG. 20A .

Next, FIG. 23B exemplifies a case in which there is a user's voice, such as "operation at 23° C.".

The microphone 435 of the remote control device 200 recognizes a user's voice 1711, such as "driving at 23° C.", and the processor 480 performs signal processing on the acquired user's voice.

The processor 480 may control a remote control signal Sremcc corresponding to "operation at 23° C." 1711 to be output after processing the voice recognition signal.

Accordingly, as shown in FIG. 23C , the air conditioner 100c operates, and the target temperature is set to 23° C. and can be operated. In the drawing, it is exemplified that the cold wind 1104 is output by driving.

In this way, after the remote control apparatus can remotely control a specific device, it is possible to remotely control the device simply through the user's voice rather than by a key operation.

On the other hand, the processor 480 of the remote control apparatus 200, when the remote control apparatus 200 receives the identification signal (Sid) from the device 100, at least one identification signal including the identification signal (Sid) The identification signal Sid may be detected, and when the detection of the identification signal Sid is completed, an identification signal detection completion message may be output.

24A illustrates that the identification signal detection completion message 1701 is output as sound.

The processor 480 of the remote controller 200 may check or identify a device based on the detected device identification signal Sidc. In addition, for remote control of the confirmed or identified device, at least one of a plurality of keys may be controlled such that a control command is matched.

Meanwhile, the processor 480 of the remote control device 200 may control to output a message 1702 indicating that key setting is being performed or will be performed.

24B illustrates that, after the device identification signal Sidc, a message 1702 indicating that key setting is being performed or will be performed is output as sound.

Meanwhile, the processor 480 of the remote control apparatus 200 may control to output a controllable message 1703 as shown in FIG. 24C when matching the key to the control command for remote control of the device is completed. In the drawing, it is exemplified that the air conditioner controllable message 1703 is output as sound.

24D exemplifies that the identification signal detection completion message 1704 is output as sound.

The processor 480 of the remote control apparatus 200 may perform device identification or identification based on the detected device identification signal Side. In addition, for remote control of the confirmed or identified device, at least one of a plurality of keys may be controlled such that a control command is matched.

Meanwhile, the processor 480 of the remote control device 200 may control to output a message 1702 indicating that key setting is being performed or will be performed.

24E illustrates that after the device identification signal (Side), a message 1705 indicating that key setting is being performed or to be performed is output as sound.

Meanwhile, the processor 480 of the remote control apparatus 200 may control to output a controllable message 1706 as shown in FIG. 24F when matching the key to the control command for remote control of the device is completed. In the figure, it is exemplified that the robot cleaner controllable message 1706 is output as a sound.

Meanwhile, the processor 480 controls a plurality of control commands to match a first key among a plurality of keys, and a gesture operation performed according to the number of times the first key is selected, a selection time, or while the first key is selected. , or according to a user's voice input while selecting the first key, a remote control signal corresponding to a corresponding control command among a plurality of control commands may be controlled to be transmitted to the device. This will be described with reference to FIGS. 25A to 25D.

25A shows, in a state in which the remote control device 200 can remotely control the air conditioner 100c, and the menu key 203 is pressed during the Tx period, the menu key 203 matches the wind strength setting command, and the menu key According to the operation (203), it is exemplified that setting the wind strength is performed in the air conditioner 100c. In the drawing, the cold wind 1103 corresponding to the set wind strength is exemplified to be output.

Next, FIG. 25B shows, in a state in which the remote control device 200 can remotely control the air conditioner 100c, when the menu key 203 is pressed for a Ty period longer than the Tx period, the menu key 203 is a driving time setting command is matched, and according to the operation of the menu key 203, the operation time setting is performed in the air conditioner 100c.

On the other hand, the processor 480 of the remote control device 200, when the menu key 203 is long pressed, such as during Ty period, controls to match the air conditioner operation time setting command, and the operation time setting message 1707 ) can be controlled to be output.

Next, FIG. 25C illustrates that the menu key 203 operates and the remote control device 200 rotates clockwise in a state in which the remote control device 200 can remotely control the air conditioner 100c.

The processor 480 of the remote control device 200 may extract the motion of the remote control device 200 based on the gyro sensor 441 or the acceleration sensor 443 , and match a control command corresponding to the motion. can do.

In the drawings, it is exemplified that a control command corresponding to a target temperature increase is matched according to the clockwise movement of the remote control device 200 .

The processor 480 of the remote control device 200 may control the control command corresponding to the target temperature increase to be matched according to the clockwise movement of the remote control device 200 , and a target temperature increase message 1708 is displayed. , can be controlled to be output as sound.

Meanwhile, FIG. 25D illustrates that, unlike FIG. 25C , a control command corresponding to a target temperature decrease is matched according to the counterclockwise movement of the remote control device 200 .

The processor 480 of the remote control device 200 may control a control command corresponding to the target temperature decrease to be matched according to the counterclockwise movement of the remote control device 200 , and a target temperature decrease message 1709 ) can be controlled to be output as sound.

On the other hand, the processor 480 of the remote control apparatus 200, when the remote control apparatus 200 receives the identification signal (Sid) from the device 100, at least one identification signal including the identification signal (Sid) The identification signal Sid may be detected, and when the detection of the identification signal Sid is completed, an identification signal detection completion message may be output.

26A illustrates that the identification signal detection completion message 1701 is output as sound.

Meanwhile, the remote control device 200 may include a camera 495 that captures an image, and the processor 480 performs user authentication based on the image captured by the camera 495 and performs user authentication. If successful, you can control to enable remote control of the device.

26B illustrates that the camera 495 of the remote control device 200 is positioned in the direction of the face of the user 51 .

The camera 495 may capture an image including the user's face, and the processor 480 may perform user authentication based on the image captured by the camera 495 .

For example, when the user's face image is stored in the storage 470 , the processor 480 compares the image captured by the camera 495 with the user's face image data stored in the storage 470 , authentication can be performed.

26C illustrates that user authentication is performed using the fingerprint recognition unit 499 of the remote control device 200 .

When the user 51 places his/her finger 52 on the fingerprint recognition unit 499 of the remote control device 200 , the fingerprint recognition unit 499 may capture the fingerprint of the finger 52 . .

The processor 480 may perform user authentication by comparing the fingerprint image data stored in the storage 470 with the captured fingerprint image data.

When the user authentication is successful, the processor 480 of the remote control device 200 may control the user authentication success message 1711 to be output as a sound, as shown in FIG. 26D .

Alternatively, the processor 480 of the remote control device 200, based on the image captured by the camera 495, extracts user information, and the user information (Suser), as shown in FIG. 26E, the directed device 100c ), and when receiving the user authentication confirmation information (Sok) from the device 100c, it is possible to control so that remote control of the device is possible.

In particular, when the processor 480 of the remote control device 200 receives the user authentication confirmation information Sok from the device 100c, the authentication completion message 1712 from the device may be controlled to be output as a sound. .

On the other hand, the processor 480 of the remote control device 200, if the user authentication is successful, can control the device to be remote control, as shown in FIG. 26f, a device control execution message for the authenticated user ( 1713) can be controlled to output.

For example, the processor 480 of the remote control device 200 may control to output a key setting guide message 1714 for at least some of the plurality of keys, as shown in FIG. 26G .

Accordingly, the user can conveniently select a key for a desired operation.

In particular, the processor 480 of the remote control device 200 may perform customized operation key setting according to user authentication, and thus, user convenience may be increased.

On the other hand, the processor 480 controls to enter the standby mode when there is no key input for a predetermined period of time, and when the standby mode is terminated, for remote control of the device directed immediately before, among a plurality of keys At least one may match a control command for remote control of the device. This will be described with reference to FIGS. 27A to 27E.

27A illustrates a case in which the remote control device 200 operates to control the air conditioner 100c.

On the other hand, as shown in FIG. 27B , when the remote control device 200 does not operate for a predetermined time, the processor 480 of the remote control device 200 limits the power in each unit and enters the standby mode. can be controlled For example, only the sensor unit 440 and the wireless communication unit 420 may be controlled to operate.

Meanwhile, when the processor 480 of the remote control device 200 enters the standby mode, as shown in the drawing, a message 1716 indicating the entry into the standby mode may be controlled to be output as a sound.

Next, the processor 480 of the remote control device 200, in the standby mode state, as shown in FIG. 27c, when the remote control device 200 moves or a predetermined key is pressed, to control the standby mode to end can

On the other hand, the processor 480 of the remote control device 200, as shown in the figure, may control the standby mode end message 1717 to be output as a sound.

In this case, the processor 480 of the remote control device 200 may control the remote control device 200 to operate in order to control the air conditioner 100c oriented immediately before the end of the standby mode.

As shown in the figure, the processor 480 of the remote control device 200 may control the air conditioner controllable message 1717 to be output as sound.

Meanwhile, the processor 480 of the remote control device 200 may initialize at least one of the plurality of keys when the standby mode ends. Also, the processor 480 of the remote control device 200 may control the initialization message 1718 to be output as a sound, as shown in FIG. 27D .

On the other hand, when the processor 480 of the remote control device 200 terminates the standby mode, as shown in FIG. 27E , when user authentication is performed through the camera 495 of the remote control device 200, according to the user authentication, the default It is also possible to control to perform remote control of the device set to . In addition, the processor 480 of the remote control apparatus 200 may control the device controllable message 1719 according to user authentication to be output as a sound, as shown in FIG. 27E .

28 is a flowchart illustrating an example of an operating method of a remote control device according to another embodiment of the present invention, and FIGS. 29A to 29C are diagrams referenced in the description of the operating method of the remote control device of FIG. 28 .

28 exemplifies that when the remote control device 200 is in the standby mode, it wakes up and sets a control command for the directed remote control device.

Referring to FIG. 28 , the processor 480 of the remote control device 200 determines whether the remote control device 200 moves ( S3010 ).

The processor 480 of the remote control device 200 determines whether the remote control device 200 is moving based on sensor information from the gyro sensor 441 or the acceleration sensor 4430 in the sensor unit 440 . can judge

When the remote control device 200 moves, the processor 480 of the remote control device 200 may control each unit of the remote control device 200 to wake up (S3015). For example, it is possible to control so that power is supplied to each unit.

As another example, when a predetermined key of the remote control device 200 is selected, the processor 480 of the remote control device 200 may control each unit of the remote control device 200 to wake up. have.

Next, when the remote control apparatus 200 is directed to a specific device direction, the receiver 423 of the remote control apparatus 200 receives at least one identification signal (S3020).

Then, the processor 480 of the remote control apparatus 200 detects an identification signal from the device 100 or the transmission apparatus 101 corresponding to the device from the received at least one identification signal (S3023),

Then, the processor 480 of the remote control device 200 may search the database in the storage unit 470 for comparison with the detected identification signal (S3025). Then, by comparing the received identification signal with the previously stored identification signal data, it is possible to identify or confirm the device (S3030).

On the other hand, the processor 480 of the remote control device 200 determines whether the identified device is an infrared (IR) based device (S3035), and if applicable, at least one of a plurality of keys, infrared (IR) A signal-based control command may be matched (S3040).

Alternatively, if it is not an infrared (IR)-based device, the processor 480 of the remote control apparatus 200 may match at least one of a plurality of keys to a control command based on a communication protocol other than infrared (IR). There is (S3045).

On the other hand, signals other than infrared (IR), RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, ZigBee (ZigBee) signal, Bluetooth (bluetooth) signal, laser signal, any one of UWB (Ultra Wideband) signal can be

29A to 29A are a remote control device 200, an infrared (IR) based device, an image display device 100a, and an infrared (IR) other signal-based device, a smart plug 100i, a smart Light bulb 100d and gateway 400 are illustrated.

29A illustrates that the remote control device 200 is directed toward the image display device 100a.

The processor 480 of the remote control apparatus 200 may perform device identification based on the identification signal Sida from the transmission apparatus 101a corresponding to the image display apparatus 100a. In addition, at least one of the plurality of keys may be matched to a control command based on an infrared (IR) signal. Accordingly, when any one of the matched keys is selected, an infrared (IR) based remote control signal Srema may be output.

Meanwhile, the remote control signal Srema from the remote control device 200 may be directly transmitted to the image display device 100a or may be transmitted to the image display device 100a via the gateway 400 .

On the other hand, as shown in Fig. 29b or 29c, when the remote control device 200 is directed toward the smart light bulb 100d or the smart plug 100i, based on the received identification signal (Sidd or Sidi), remote control The processor 480 of the device 200 may match at least one of the plurality of keys to a control command based on signals other than infrared (IR). Accordingly, when any one of the matched keys is selected, a remote control signal (Sremd or Sremi) based on a signal other than infrared (IR) may be output. In particular, the remote control signal Sremd or Sremi based on signals other than the output infrared (IR) may be transmitted to the smart plug 100i or the smart light bulb 100d via the gateway 400 .

Meanwhile, the remote control device of the present invention and the method of operating an image display device having the same can be implemented as processor-readable codes on a processor-readable recording medium provided in each device. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also includes those implemented in the form of carrier waves such as transmission over the Internet . In addition, the processor-readable recording medium is distributed in a computer system connected through a network, so that the processor-readable code can be stored and executed in a distributed manner.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims Various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

Claims (27)

a key input unit having a plurality of keys;
a first transmitter for transmitting a call signal to at least one device or a transmitter corresponding to the device;
a receiver configured to receive a pairing response signal or at least one identification signal from the at least one device or a transmitter corresponding to the device;
Pairing is performed based on the received pairing response signal, and an identification signal of a remote controllable device is detected from the received at least one device identification signal, and based on the detected identification signal, at least one of a plurality of keys a processor matching a control command for remote control of the device; and
a second transmitter configured to transmit a signal corresponding to the control command when a key matching the control command is selected; and
The transmitting device is
It is disposed around the device and has an infrared reflection pattern corresponding to the device,
The second transmitter,
Control to transmit an infrared output signal to a transmitting device corresponding to the device,
The processor is
detecting an infrared pattern, reflected by an infrared reflection pattern formed in a transmitting apparatus corresponding to the device, and identifying the device based on the detected infrared pattern;
A remote control apparatus, characterized in that the infrared reflection patterns of the transmitting apparatus for each device are different from each other. According to claim 1,
The call signal, the remote control device, characterized in that it includes a pairing request signal. a key input unit having a plurality of keys;
a first transmitter for transmitting a call signal to at least one device or a transmitter corresponding to the device;
a first receiver configured to receive a pairing request signal from the at least one device or a transmitter corresponding to the device;
a second transmitter configured to transmit a pairing response signal based on reception of the pairing request signal;
a second receiver configured to receive at least one device identification signal from the at least one device or a transmission apparatus corresponding to the device;
Detecting an identification signal of a remote controllable device from the received at least one device identification signal, and matching at least one of a plurality of keys to a control command for remote control of the device based on the detected identification signal processor; and
a third transmitter configured to transmit a signal corresponding to the control command when a key matching the control command is selected; and
The transmitting device is
It is disposed around the device and has an infrared reflection pattern corresponding to the device,
The third transmitter,
Control to transmit an infrared output signal to a transmitting device corresponding to the device,
The processor is
detecting an infrared pattern, reflected by an infrared reflection pattern formed in a transmitting apparatus corresponding to the device, and identifying the device based on the detected infrared pattern;
A remote control apparatus, characterized in that the infrared reflection patterns of the transmitting apparatus for each device are different from each other. a key input unit having a plurality of keys;
a first transmitter for transmitting a call signal to at least one device or a transmitter corresponding to the device;
a first receiver configured to receive at least one identification signal from the at least one device or a transmitter corresponding to the device;
Detect an identification signal of a remote controllable device from the received at least one device identification signal, identify the device based on the detected identification signal, and assign at least one of a plurality of keys to the remote control of the identified device a processor matching a control command for control;
a second transmitter configured to transmit a pairing request signal to the identified device or a transmitter corresponding to the identified device;
a second receiver configured to receive a pairing response signal from the identified device or a transmitter corresponding to the identified device; and
a third transmitter configured to transmit a signal corresponding to the control command when a key matching the control command is selected;
The transmitting device is
It is disposed around the device and has an infrared reflection pattern corresponding to the device,
The third transmitter,
Control to transmit an infrared output signal to a transmitting device corresponding to the device,
The processor is
detecting an infrared pattern, reflected by an infrared reflection pattern formed in a transmitting apparatus corresponding to the device, and identifying the device based on the detected infrared pattern;
A remote control apparatus, characterized in that the infrared reflection patterns of the transmitting apparatus for each device are different from each other. According to claim 1,
The processor is
After performing the pairing, the remote control apparatus, characterized in that detecting the identification signal of the remote controllable device from the received at least one device identification signal. 5. The method of claim 4,
The processor is
After detecting the identification signal of the remote controllable device from the received at least one device identification signal, the remote control apparatus, characterized in that the control to transmit the pairing request signal. According to claim 1,
The remote control device, characterized in that the first transmitter and the second transmitter are the same. 5. The method according to any one of claims 3 to 4,
The first to third transmitters are the same or
The remote control device, characterized in that the first receiving unit to the second receiving unit is the same. 4. The method of claim 1 or 3,
The processor is
When the remote control apparatus receives the at least one device identification signal, it detects an identification signal of a remote controllable device from the received at least one device identification signal, and based on the detected identification signal, the device A remote control device, characterized in that for identifying. 10. The method of claim 9,
The identification signal includes an infrared identification signal,
The receiving unit,
When receiving at least one infrared identification signal, the remote control device, characterized in that capturing an infrared image from the received at least one infrared identification signal. 11. The method of claim 10,
The processor is
Based on the at least one captured infrared image, an infrared pattern located in the most central region is detected as a representative infrared pattern, and the device is identified based on the detected representative infrared pattern. . 11. The method of claim 10,
The processor is
When the receiver receives an infrared identification signal based on a variable level or a variable duty, based on a plurality of captured infrared images, an infrared pattern based on a variable level or a variable duty is detected, and based on the detected infrared pattern , a remote control device, characterized in that for identifying the device. delete 11. The method of claim 10,
The processor is
and detecting an infrared pattern emitting light from the device or a transmitter corresponding to the device in the captured infrared image, and identifying the device based on the detected infrared pattern. 5. The method of any one of claims 1, 3 and 4,
The processor is
detect a first identification signal of the at least one identification signal, and match, based on the detected first identification signal, at least one of the plurality of keys to a control command for remote control of a first device,
detecting a second identification signal from among the at least one identification signal, and matching at least one of the plurality of keys with a control command for remote control of a second device based on the detected second identification signal Features a remote control device. 5. The method of any one of claims 1, 3 and 4,
A microphone for acquiring the user's voice; further comprising,
The processor is
When a user's voice is obtained through the microphone within a predetermined time in a state in which the device identification is completed or a control command matching for remote control of the device is completed, a remote control signal corresponding to the user's voice is transmitted to the device A remote control device, characterized in that it controls to transmit. 16. The method of claim 15,
The processor is
When at least one of the plurality of keys matches a control command for remote control of the first device, a multi-device operation key in the key input unit operates,
The remote control apparatus, characterized in that the control to transmit a first remote control signal for remote control of the first device and a second remote control signal for remote control of the second device. 16. The method of claim 15,
A sound output module; further comprising,
The processor is
control to output a first sound indicating remote control for a first device based on the detection of the first identification signal,
and controlling to output a second sound indicating remote control for a second device based on the detection of the second identification signal. 5. The method of any one of claims 1, 3 and 4,
A microphone for acquiring the user's voice; further comprising,
The processor is
By performing signal processing on the obtained user voice, device information included in the voice is extracted, and at least one of the plurality of keys is used in a control command for remote control of a device corresponding to the extracted device information. A remote control device, characterized in that matching. 5. The method of any one of claims 1, 3 and 4,
The second transmitter,
When any one of the plurality of keys is selected, a remote control signal corresponding to a control command of the selected key is transmitted as a radio frequency (RF) signal to the device. 5. The method of any one of claims 1, 3 and 4,
A signal corresponding to the control command is
Infrared (Infra Red) signal, RF (Radio Frequency) signal, Wi-Fi (Wi-Fi) signal, ZigBee (ZigBee) signal, Bluetooth (bluetooth) signal, laser signal, characterized in that any one of UWB (Ultra Wideband) signal remote control device. 5. The method of any one of claims 1, 3 and 4,
The device identification signal is
A remote control apparatus comprising at least one of device type information, manufacturer information, device model name information, device status information, and information related to a device control command. 5. The method of any one of claims 1, 3 and 4,
A storage unit for storing device control command information; further comprising,
The processor is
Identifies a device based on the detected device identification signal, and for remote control of the identified device, based on the device control command information stored in the storage unit, at least one of the plurality of keys, A remote control device, characterized in that it matches a control command for remote control. 5. The method of any one of claims 1, 3 and 4,
a camera that captures images; or
fingerprint recognition unit; It further comprises at least one of
The processor is
The remote control apparatus of claim 1, wherein user authentication is performed based on the image captured by the camera or the fingerprint recognition unit, and when the user authentication is successful, remote control of the device is performed. 5. The method of any one of claims 1, 3 and 4,
The processor is
A remote control apparatus, characterized in that controlling to transmit user information to the device, and controlling to enable remote control of the device when receiving user authentication confirmation information from the device. 5. The method of any one of claims 1, 3 and 4,
The processor is
control so that a plurality of control commands are matched to a first key among the plurality of keys;
According to the number of times of selection of the first key, selection time, or a gesture operation performed while selecting the first key, or according to a user voice input while selecting the first key, a corresponding one of the plurality of control commands A remote control apparatus, characterized in that it controls so that a remote control signal corresponding to a control command to be transmitted to the device. 5. The method of any one of claims 1, 3 and 4,
The processor is
If there is no key input for a predetermined time, control to enter the standby mode, and when the standby mode is terminated, at least one of the plurality of keys is initialized.

Images