WO2017052077A1

WO2017052077A1 - Remote control device, remote control method and remote control system

Info

Publication number: WO2017052077A1
Application number: PCT/KR2016/009095
Authority: WO
Inventors: 이상영
Original assignee: 엘지이노텍 주식회사
Priority date: 2015-09-23
Filing date: 2016-08-18
Publication date: 2017-03-30
Also published as: KR20170035547A; CN208188782U

Abstract

A remote control apparatus according to an embodiment of the present invention, as a watch-type wearable remote control device that remotely controls an external device according to a user's input, comprises: a wireless communication unit for transmitting a remote execution signal for controlling the external device to the external device; a gesture sensor for sensing a gesture of the user; a motion sensor for sensing a motion of the user; and a control unit for determining a control mode according to the sensed user's gesture and generating a remote execution signal in accordance with the motion of the sensed user in the determined control mode.

Description

Remote control device, remote control method and remote control system

The present invention relates to a remote control device, a remote control method and a remote control system.

Recently, attention is increasing not only to devices that users hold in their hands, such as terminals, but also to wearable devices such as smart watches or smart glasses that the user wears directly on the body.

In the case of such a wearable device, it is easy to carry, and thus, the wearable device has been spotlighted as a next-generation device that can replace a general terminal mobile phone.

However, current user input for controlling a wearable device is mostly dependent on a button or a touch screen.

However, the wearable device may be worn on a part of the user's body, neck, head, wrist, etc., and when the existing touch panel is applied as it is, the input of the wearable device may be difficult and the advantages of the wearable may be faded.

Accordingly, the wearable device needs sensors that can provide an interface suitable for wearable device characteristics, away from the existing touch sensors that merely grasp the touch position.

On the other hand, since the wearable device is worn on the user's body, there is an advantage that the user can input anytime, anywhere.

A remote control method for controlling a remote external device using such a wearable device has attracted attention.

However, the current remote control method using the wearable device merely provides an interface that does not reflect the characteristics of the external device and the wearable device.

The embodiment is to solve the above-described problem, to provide a remote control device, a remote control method and a remote control system that can effectively control an external device using a wearable device.

A remote control apparatus according to an embodiment includes a watch type wearable remote control device for remotely controlling an external device according to a user input, the wireless communication unit transmitting a remote execution signal for controlling the external device to the external device; A gesture sensor for detecting a gesture of the user; A motion sensor detecting the motion of the user; And a controller configured to determine a control mode according to the sensed user gesture and to generate a remote execution signal according to the detected user motion in the determined control mode.

In this case, the gesture may be a maintainable gesture taken while wearing the remote controller, and the gesture sensor may detect at least two gestures.

In addition, the gesture sensor may detect a fist gesture, a fist gesture, and a gesture of at least one finger.

The gesture sensor may detect a change in contact area with a remote control device according to a gesture of the user as a change in capacitance.

In addition, the motion sensor may include at least two or more of an acceleration sensor, a gyroscope sensor, and a gravity sensor to detect different motions with at least two modules.

The acceleration sensor may detect a first motion of the user moving the wrist in a specific direction, and detect the gyroscope sensor and a second motion of the user tilting the wrist in a specific direction.

The controller may generate a remote execution signal according to the detected user motion in the first control mode when the gesture sensor detects the first gesture and in the second control mode when the second gesture is detected.

The control unit may generate a first remote execution signal when the first motion is detected in the first control mode, generate a third remote execution signal when the first motion is detected in the second control mode, and generate the first remote signal. The execution signal and the third remote execution signal may control different characteristics of the external device.

In this case, the second remote execution signal is generated when the second motion is detected in the first control mode, and the fourth remote execution signal is generated when the second motion is detected in the second control mode, and the first remote execution signal to The fourth remote execution signal may control different characteristics of the external device.

In addition, the external device may be a drone.

In this case, the first control mode may be a control mode in a state of raising the drone, and the second control mode may be a control in a state of lowering the drone.

The controller may control the tilt of the drone when the first motion is detected. You can generate a remote execution signal.

The controller may generate a remote execution signal for controlling the acceleration direction of the drone when the second motion is detected.

The first control mode may be a mode for controlling the movement characteristics of the drone, and the second control mode may be a mode for controlling the camera of the drone.

The external device may be a smart TV.

In this case, the first control mode may be a mode for controlling the channel of the smart TV, the second control mode may be a mode for controlling the sound of the smart TV.

In addition, the wireless communication unit may include a short range communication module for directly transmitting the remote execution signal to the external device located in close proximity by the Bluetooth communication method.

The apparatus may further include an output unit configured to output the gesture detection state and the motion detection state.

In addition, the remote control method according to the embodiment is a method for remotely controlling an external device using a watch type remote control device, comprising: starting a remote control; Detecting a gesture of the user; Determining a control mode according to the gesture state of the user; Detecting a motion input of the user in the determined control mode; Generating a remote execution signal according to the motion input in the determined control mode; And wirelessly transmitting the remote execution signal to the external device.

In addition, the remote control system according to the embodiment is a watch type wearable device for determining the control mode according to the user's gesture, generates a remote execution signal in accordance with the input motion in the determined control mode, and wirelessly transmitting the remote execution signal Remote control unit; And an external device that receives the remote execution signal from the remote control device and is controlled according to the received remote execution signal.

The remote control apparatus and control method control system according to the embodiment may provide a user interface that can intuitively and easily control external devices through gestures and motions.

In detail, the remote control apparatus according to the embodiment may provide a new input method instead of the existing touch input method.

More specifically, the gesture sensor of the remote control device can detect at least two or more user gestures suitable for input by a worn user.

The sensor electrode of the gesture sensor may detect a change in contact area with the band according to a gesture of the user as a change in capacitance.

Since the capacitive sensor electrode is capable of detecting a gesture even when disposed in the band member, the gesture sensor can be protected from the external environment, and the band shape can be free from design constraints.

In addition, since the gesture sensor senses the capacitance that changes precisely according to the distance between the user and the sensor electrode, there is an advantage that can accurately recognize the user's gesture.

Meanwhile, the motion sensor may include at least two or more sensors to precisely detect at least two or more user motions.

In particular, the remote control apparatus according to the embodiment may generate a plurality of execution signals using simple gestures and motions by providing a control mode that distinguishes gestures and motions and generates execution signals in at least two steps.

In addition, it is possible to provide a user interface that specializes in many of the generated execution signals to external devices.

That is, the remote control system according to the embodiment has an advantage of providing an intuitive user interface suitable for the characteristics of the external device to be controlled.

1 is a view for explaining a remote control system.

2 is a perspective view of a wearable device according to an exemplary embodiment of the present invention.

3 is an internal block diagram of a wearable device according to an exemplary embodiment of the present invention.

4 is a perspective view of a band portion for representing a gesture sensor according to an embodiment of the present invention.

5 to 7 are diagrams for describing a method of detecting a first gesture according to an embodiment of the present invention.

8 to 10 are diagrams for describing a method of detecting a second gesture according to an embodiment of the present invention.

11 is a view for explaining a motion sensor according to an embodiment of the present invention.

12 illustrates a screen of a display unit according to an exemplary embodiment of the present invention.

13 is a flowchart illustrating a process of remotely controlling an external device using a remote control apparatus according to an embodiment of the present invention.

14 is a block diagram illustrating an example of a remote control system according to an embodiment of the present invention.

15 is a view for explaining a remote control according to the gesture according to an embodiment of the present invention.

16 is a view for explaining a remote control according to the second motion according to an embodiment of the present invention.

17 is a view for explaining a remote control according to the first motion according to an embodiment of the present invention.

18 is a view for explaining a remote control according to another embodiment of the present invention.

19 is a block diagram illustrating an example of a remote control system according to another embodiment of the present invention.

20 is a diagram for describing remote control according to motion in a first control mode according to another embodiment of the present invention.

21 is a diagram for describing remote control according to motion in a second control mode according to another embodiment of the present invention.

22 is a block diagram illustrating an example of a remote control system according to another embodiment of the present invention.

23 to 26 are views showing a state of performing a remote control according to another embodiment of the present invention.

27 is a block diagram illustrating an example of a remote control system according to another embodiment of the present invention.

28 to 29 are diagrams showing a state of performing a remote control according to another embodiment of the present invention.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, and the same or similar components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other.

In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, the accompanying drawings are intended to facilitate understanding of the embodiments disclosed herein, but are not limited to the technical spirit disclosed herein by the accompanying drawings, all changes included in the spirit and scope of the present invention. It should be understood to include equivalents and substitutes.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a remote control system according to an embodiment of the present invention.

Since the wearable device is always worn by the user, the wearable device may enhance user convenience when used to remotely control an external device.

For example, referring to FIG. 1, a user may remotely control a display device, a vehicle, a home appliance, a drone, and the like with an external device using a wearable device.

Wearable devices that can be worn by the user may include a neckband type device worn on the user's neck, a headset type device worn on the user's head, or a watch type device worn on the user's wrist. Can be.

Although the embodiment describes a watch type wearable device among the wearable devices as a remote control device, the embodiment can be applied to the above-described various types of wearable devices.

2 is a perspective view of a wearable device according to an exemplary embodiment of the present invention, and FIG. 3 is an internal block diagram of the wearable device according to an exemplary embodiment of the present invention.

2 to 3, the remote control apparatus 100 according to the embodiment will be described in more detail.

From the outside, the remote control device 100 may include a body 201, a band 205, and a fastener 207.

First, the body 201 may include a case forming an appearance. An internal space for accommodating various electronic components may be provided in the case of the main body 201. In this case, the main body 201 may be separated and fastened into a first case and a second case to provide an inner space.

The display unit 151 may be disposed in front of the main body 201 to output information. The touch sensor may be disposed on the display unit 151 and provided as a touch screen.

The touch screen may have a circular shape, but it is not necessarily limited thereto, and may have an elliptic shape and a square shape. The shape of the touch screen of the embodiment may give a visually good image to the user and may be any shape as long as it can help the user's manipulation of the touch screen.

The band 205 may be connected to the main body 201. The band 205 may be worn on the wrist and formed to surround the wrist.

In addition, the band 205 may be formed of a flexible material to facilitate wearing. For example, the band 205 may be formed of leather, rubber, silicone, synthetic resin, or the like.

In addition, the band 205 may be provided with a fastener 207 (fastener) for wearing. The fastener 207 may be implemented by a buckle, a snap-fit hook structure, a velcro (trade name), or the like, and may include an elastic section or material. . The embodiment shows an example in which the fastener 207 is implemented in the form of a buckle.

Meanwhile, the display unit 151 of the remote control apparatus 100 is implemented as a touch screen to display execution screen information of an application program driven by the remote control apparatus 100 or UI and GUI information according to the execution screen information. can do. In this case, the user may control the remote controller 100 by a touch input to the UI or the GUI.

The remote control apparatus 100 is limited by the size of the display unit 151 due to the characteristics of the device worn on the wrist. In general, the display unit 151 is implemented to be small, and therefore, the UI and GUI displayed on the display unit 151 are also displayed small.

Therefore, when the user touches the display unit 151 with a finger, the finger covers a substantial portion of the display unit 151. As a result, a user may have difficulty touching an unintentional UI or GUI or touching a small size UI or GUI.

As such, there is a lot of inconvenience in controlling the device by the existing touch input method in the remote control device 100. Therefore, a new input method is required rather than the existing touch input method.

The remote control apparatus 100 includes a wireless communication unit 110, an input unit 120, a sensor unit 140, an output unit 150, an interface unit 160, a memory 170, a controller 180, and a power supply unit ( 190) and the like. The components shown in FIG. 3 are not essential to implementing the remote control 100, so that the remote control 100 described herein may have more or fewer components than those listed above. Can have

First, among the components, the wireless communication unit 110 may include one or more modules that enable wireless communication between the remote control apparatus 100 and the wireless communication system and between the remote control apparatus 100 and an external device. . In addition, the wireless communication unit 110 may include one or more modules for connecting the remote control device 100 to one or more networks.

The wireless communication unit 110 may transmit data on various gestures and motion inputs of the user sensed by the remote control apparatus 100 to an external device. In addition, a feedback of an external device with respect to the transmitted data may be received and transmitted to the controller 180.

The wireless communication unit 110 may include at least one of the broadcast receiving module 111, the mobile communication module 112, the wireless internet module 113, the short range communication module 114, and the location information module 115. .

More specifically, the mobile communication module 112 may include technical standards or communication schemes (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), and Code Division Multi Access 2000). ), Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), A wireless signal is transmitted and received with at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to Long Term Evolution-Advanced (LTE-A).

The wireless signal may include various types of data according to transmission and reception of an external device remote control signal, a voice signal, a video call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the remote control apparatus 100. The wireless internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless internet technologies.

Examples of wireless Internet technologies include Wireless LAN (WLAN), Wireless-Fidelity (Wi-Fi), Wireless Fidelity (Wi-Fi) Direct, Digital Living Network Alliance (DLNA), Wireless Broadband (WiBro), and WiMAX (World). Interoperability for Microwave Access (HSDPA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and the like. ) Transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above. In view of the fact that the wireless Internet access through WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through the mobile communication network, the wireless Internet module 113 for performing the wireless Internet access through the mobile communication network It may be understood as a kind of mobile communication module 112.

In particular, the short range communication module 114 is for short range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), and ZigBee. By using at least one of Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technology, local area communication may be supported. The short range communication module 114 may be configured between a remote control device 100 and an external device, between a remote control device 100 and a wireless communication system, and a remote control device 100 through a local area network. Wireless communication between other remote control devices or between a network in which the remote control device 100 and the mobile terminal (or an external server) is located may be supported. The local area network may be local area network (Wireless Personal Area Networks).

The short range communication module 114 may detect (or recognize) another external device that can be controlled around the remote control apparatus 100.

In an embodiment, the controller 180 is described as controlling the external device using the short range communication module 114, but is not limited thereto. For example, the controller 180 may remotely control an external device by directly transmitting a remote control signal to an external device located in close proximity through a short range communication module 114 through a Bluetooth communication method. When the short range communication module 114 is used, it may be advantageous for remote control in terms of high security and fast response speed since it does not go through a relay network.

The input unit 120 may include a camera 121 or an image input unit for inputting an image signal, a microphone 122 for inputting an audio signal, an audio input unit, or a user input unit 123 for receiving information from a user. , Touch keys, mechanical keys, and the like. The voice data or the image data collected by the input unit 120 may be analyzed and processed as a control command of the user.

The sensor unit 140 may include one or more sensors for sensing at least one of information in the remote control apparatus 100, surrounding environment information surrounding the remote control apparatus 100, and a user input.

In an embodiment, the sensor unit 140 may detect at least two or more user inputs suitable for input by a user wearing the remote control apparatus 100.

In detail, the sensor unit 140 may include at least two of a gesture sensor 130 for detecting a user input, a motion sensor 141, and other sensors 142 for detecting environment information.

First, the gesture sensor 130 may detect a gesture input of a user. Here, the gesture of the user means a gesture that the user takes while wearing the remote control apparatus 100. In this case, the gesture may mean a maintainable gesture, not a simple one-time movement.

For example, in the watch type remote control device 100, the gesture may include a fist gesture, a fist gesture, and a gesture of at least one finger gesture.

In an embodiment, the gesture sensor 130 may be located in the band 205 of the remote controller 100 to detect a gesture of the user.

4 illustrates a perspective view of a portion of the band 205 for representing the gesture sensor 130 according to an embodiment of the present invention, and FIGS. 5 to 7 illustrate a method of detecting a first gesture according to an embodiment of the present invention. 8 to 10 illustrate a method of detecting a second gesture according to an embodiment of the present invention.

Hereinafter, the gesture sensor 130 will be described in more detail with reference to FIGS. 4 to 10.

Referring to FIG. 4, the gesture sensor 130 includes a sensor electrode 131 including at least one electrode pattern, a sensor wiring electrode 133 connected to the sensor electrode 131, a wiring electrode, and a controller 180. It may include a printed circuit board 135 connecting the.

When the user makes a gesture, the sensor electrode 131 according to the embodiment may measure an area in which the wearing part of the user contacts the band 205 and detect the user's gesture.

In detail, the sensor electrode 131 may detect a change in contact area with the band 205 according to a gesture of the user as a change in capacitance. For example, a change in distance between the user's wearing part according to the gesture and the sensor electrode 131 disposed on the band 205 may be detected as a change in capacitance.

Such a change in capacitance may sense a user's gesture even when the worn portion and the sensor electrode 131 are separated by a predetermined distance or more. Therefore, even if the sensor electrode 131 is disposed in the enclosing band 205 member, the gesture can be sensed, so that the gesture sensor can be safely protected from the external environment, and the shape of the band 205 can be free from design constraints.

In addition, since the gesture sensor 130 senses a capacitance that is precisely changed according to the distance between the user and the sensor electrode 131, there is an advantage that can accurately recognize the user's gesture.

Unlike the exemplary embodiment, the gesture sensor 130 may detect a gesture by using an electrical signal (EMG) generated in skeletal muscle as a signal change according to a user's gesture. However, when using the EMG signal, the sensor electrode 131 for recognizing the EMG should be exposed to the outside of the remote control device 100, there is a design constraint and may be vulnerable to the external environment.

4, the gesture sensor 130 includes a sensor electrode 131 including at least one electrode pattern, a sensor wiring electrode 133 connected to the sensor electrode 131, and a sensor wiring electrode ( 133 may include a printed circuit board 135 connecting the controller 180.

In detail, the sensor electrode 131 may include at least one electrode pattern.

For example, the plurality of electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 may be listed. In detail, the electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 have a bar pattern, and are predetermined so as not to contact each other in the band 205. The left and right may be spaced apart by an interval. In more detail, the electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 are bar patterns formed vertically long, and the plurality of bar patterns are spaced at equal intervals. It may be arranged to be arranged in the horizontal direction. In the embodiment, although the electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 are illustrated as having a bar shape, the embodiment is not limited thereto. That is, the sensor electrode 131 may have various shapes that can detect whether the band 205 type sensor is in contact with a part of the user's body when the sensor is worn by the user.

In addition, the plurality of electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 of the sensor electrode 131 may be symmetrically disposed. In detail, when the number of the plurality of electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 is an even number, the electrode pattern on the left side from the center of the band 205 as a reference line The number of (131-1, 131-2, and 131-3) and the number of electrode patterns 31-4, 131-5, and 131-6 on the right side may be the same, and may be arranged to be symmetrical from the reference line. Alternatively, when the number of the plurality of electrode patterns is an odd number, the electrode pattern is disposed on the reference line, and the plurality of electrode patterns may be disposed to be symmetrically based on the reference line.

The plurality of electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 may be worn by the user and the electrode patterns 131-1, 131-1 when a predetermined gesture is input. 2, 131-3, 131-4, 131-5, and 131-6, by measuring the change in capacitance according to the distance change, the user's gesture input can be accurately detected.

5 to 7, when a user's fist is gripped as shown in FIG. 5, a portion of the wrist may fall away from the band 205 as the muscles of the wrist contract. Therefore, as shown in FIG. 6, the third to fifth electrode patterns 131-3, 131-4, and 131-5 may be far from the wrist. Therefore, as shown in FIG. 7, a gesture of holding a fist by detecting a small capacitance coupled to a wrist in the third to fifth electrode patterns 131-3, 131-4, and 131-5 may have a specific capacitance value. Can be. That is, the gesture of the user's fist cleavage corresponds to a specific capacitance value measured in the plurality of electrode patterns, the gesture sensor 130 may detect the user's gesture through this.

Similarly, referring to FIGS. 8 to 10, as the user's fist is fisted as shown in FIG. 8, the contact area between the band 205 and the wrist may increase as the muscles of the wrist expand. In detail, referring to FIG. 9, it can be seen that the band 205 is in contact with the entire wrist. Therefore, referring to FIG. 10, the capacitance coupled to the wrist in the first to sixth electrode patterns 131-1, 131-2, 131-3, 131-4, 131-5, and 131-6 is large. The fist-fighting gesture may have a specific capacitance value since it is detected as. That is, the gesture of the user's fist cleavage corresponds to a specific capacitance value measured in the plurality of electrode patterns, the gesture sensor 130 may detect the user's gesture through this.

In the above description, a gesture of fist-fisting blood is described. However, the gesture sensor may recognize various other gestures. For example, the user may recognize at least two of gestures such as a thumb gesture, an index finger gesture, a middle finger gesture, a ring finger gesture, and a finger gesture.

That is, the gesture sensor 130 may recognize various gestures in which the distance between the worn portion and the band 205 may change when the user makes a gesture.

Through this, the user can easily input a signal to the band 205 type sensor through a finger movement, thereby providing an interface optimized for the watch type remote controller 100.

The sensor electrode 131 may detect a change in capacitance according to contact and distance with a user's wearing part by using a self-capacitance method and / or a mutual-capacitance method.

For example, the sensor electrode 131 may detect a gesture of a user through a self capacitance method. The self-capacitance method has good sensing sensitivity, and further, proximity sensing can be performed. Therefore, even if the distance between the worn portion and the sensor electrode 131 is large, the user's gesture can be accurately detected.

The sensor electrode (131) is indium tin oxide, indium zinc oxide, copper oxide, tin oxide, zinc oxide, titanium oxide. The sensor electrode 131 may include a nanowire, a photosensitive nanowire film, carbon nanotubes (CNT), graphene, a conductive polymer, or a mixture thereof.

In the case of using a nano composite such as nano wire or carbon nanotube (CNT), it may be composed of black, and has the advantage of controlling color and reflectance while securing electric conductivity through controlling the content of nano powder.

In addition, the sensor electrode 131 may include a highly conductive material through which electricity flows. For example, the sensor electrode 131 includes at least one metal of chromium (Cr), nickel (Ni), copper (Cu), aluminum (Al), silver (Ag), molybdenum (Mo), and alloys thereof. can do. At this time, the sensor electrode 131 may be opaque.

Meanwhile, the gesture sensor 130 may include sensor wire electrodes 133 that electrically connect the sensor electrodes 131.

The sensor wiring electrodes 133 may be provided in plurality. That is, the sensor wiring electrodes 133 are connected to the first sensor wiring electrode 133-1 connected to one end of the sensor electrode 131 and the second sensor wiring electrode 133-2 connected to the other end of the sensor electrode 131. It may include.

The sensor wiring electrode 133 may transfer the capacitance value detected by the sensor electrode 131 to the printed circuit board 135, and the printed circuit board 135 may be connected to the controller 180.

The controller 180 may detect a gesture of the user according to the capacitance value measured by the sensor electrode 131.

Next, the sensor unit may further include a motion sensor 141 for detecting a motion of the user.

The motion sensor 141 may include at least two or more sensors for detecting the motion of the user in different ways, and may detect at least two or more motions of the user.

11 is a view for explaining a motion sensor 141 according to an embodiment of the present invention.

In detail, referring to FIG. 11, the motion sensor 141 may include an acceleration sensor, a gyroscope sensor, and a gravity sensor.

First, the acceleration sensor may measure the amount of acceleration that the remote control device 100 moves in a specific direction in space as shown in FIG. For example, the acceleration sensor may detect a first motion in which the user moves the wrist in up, down, left, and right directions.

And the gyroscope sensor can measure the degree of inclination of the remote control device 100 in the horizontal plane, as shown in Figure 11 (b). For example, the gyroscope sensor may detect a second motion of the user tilting the remote control apparatus 100 in various directions.

At this time, the gravity sensor as shown in FIG. 11 (c) may complement the motion detection of the acceleration sensor and the gyroscope sensor.

That is, the motion sensor 141 of the sensor unit may detect various motions by dividing the various motions that the user takes while wearing the remote control apparatus 100.

In addition, the sensor unit may include other sensors 142 such as a proximity sensor, an illumination sensor, a touch sensor, a magnetic sensor, an RGB sensor, and an infrared sensor (IR sensor). ), Fingerprint scan sensors, ultrasonic sensors, optical sensors, battery gauges, environmental sensors (e.g. barometers, hygrometers, thermometers, radiation sensors, heat sensors) Sensor, gas detection sensor, etc.), a chemical sensor (eg, electronic nose, healthcare sensor, biometric sensor, etc.) Meanwhile, the remote controller 100 disclosed herein may include: The information sensed by at least two or more of these sensors may be combined to further improve gesture detection or motion detection accuracy.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a hap tip module 153, and an optical output unit 154. can do. The display unit 151 forms a layer structure with or is integrally formed with the touch sensor, thereby implementing a touch screen. Such a touch screen may provide an output interface between the remote control device 100 and the user while functioning as a user input unit 123 providing an input interface between the remote control device 100 and the user.

12 illustrates a screen of the display unit 151 according to the embodiment of the present invention.

The user may recognize the gesture detection state and the motion detection state through the output unit. In detail, as illustrated in FIG. 12, the output unit may provide a haptic, sound, or display output during gesture or motion input.

The interface unit 160 serves as a path to various types of external devices connected to the remote control apparatus 100. The interface unit 160 connects a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port. In the remote control apparatus 100, even when an external device is directly connected through the interface unit 160, appropriate control may be performed.

In addition, the memory 170 stores data supporting various functions of the remote control apparatus 100. The memory 170 may store a plurality of application programs or applications that are driven by the remote controller 100, data for operating the remote controller 100, and instructions. At least some of these applications may be downloaded from an external server via wireless communication. In addition, at least some of these application programs may exist on the remote control device 100 from the time of shipment for the basic functions of the remote control device 100. Meanwhile, the application program may be stored in the memory 170 and installed on the remote controller 100 so as to be driven by the controller 180 to perform an operation (or function) of the remote controller 100. .

In addition to the operation related to the application program, the controller 180 typically controls the overall operation of the remote controller 100. The controller 180 may provide or process information or a function appropriate to a user by processing signals, data, information, and the like, which are input or output through the above-described components, or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components described with reference to FIG. 1 to drive an application program stored in the memory 170. In addition, the controller 180 may operate by combining at least two or more of the components included in the remote control apparatus 100 to drive an application program.

The power supply unit 190 receives power from an external power source and an internal power source under the control of the controller 180 to supply power to each component included in the remote control apparatus 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other in order to implement an operation, control, or control method of the remote control apparatus 100 according to various embodiments described below. In addition, the operation, control, or control method of the remote control apparatus 100 may be implemented on the remote control apparatus 100 by driving at least one application program stored in the memory 170.

Hereinafter, a remote control method implemented through the remote control apparatus 100 described above will be described in more detail.

13 illustrates a method for providing a remote control interface according to an embodiment of the present invention.

Referring to FIG. 13, the controller 180 may detect a user gesture input from the gesture sensor 130. (S101)

In detail, when the remote control apparatus 100 is activated and the user makes a specific gesture, the gesture sensor 130 may measure the capacitance change value according to the specific gesture and transmit the value to the controller 180.

In this case, the gesture of the user may be a gesture capable of maintaining a gesture state.

For example, when the user makes a fist gesture, the capacitance value generated by the sensor electrode 131 in the first gesture may be transmitted to the controller 180. Alternatively, when the user takes the second gesture to punch, the capacitance value generated by the sensor electrode 131 in the second gesture may be transmitted to the controller 180.

Thereafter, the controller 180 may determine the gesture state that the user takes through the capacitance value transmitted from the gesture sensor 130. (S103)

In detail, the controller 180 compares the capacitance value transmitted from the gesture sensor 130 with the capacitance value according to the specific gesture stored in the memory, and calculates a gesture corresponding to the transferred capacitance value to determine the gesture. Can be.

In more detail, a capacitance value according to a specific gesture is stored as a profile in the memory, and the controller 180 compares the detected capacitance value with the profile value of the memory, detects the closest profile, and gestures corresponding to the detected profile. Can be determined as input by the user.

In this case, the controller 180 can improve the accuracy in gesture determination by continuously updating the capacitance value according to the user gesture input to the profile of the memory.

The controller 180 may generate a remote execution signal according to the gesture input state. That is, the controller 180 can provide a remote control interface for generating a remote execution signal matching the gesture input and transmitting the same to an external device.

In addition, the controller 180 may provide different control modes according to the gesture input state. That is, the remote execution signal according to the gesture input may be a control mode selection execution signal.

In detail, the controller 180 may provide different control modes in a gesture that the user takes, and generate a control signal by receiving additional input from the user in different control modes. In more detail, the execution signal that the controller 180 matches with the user's input may be changed according to the control mode.

For example, according to the control mode, the motion of the user may be generated by different execution signals.

If the controller 180 detects the first gesture, the controller 180 may enter the first control mode. (S105)

In detail, when the first gesture is detected, the controller 180 may generate an execution input according to the motion of the user in the first control mode.

For example, the controller 180 may generate an execution signal according to the user's input in the first control mode when the gesture of the fist is detected.

In detail, the controller 180 may detect a motion input of the user after entering the first control mode. (S107)

For example, the controller 180 detects the first motion through the motion sensor 141 to move the remote control device 100 in the front, rear, left, and right directions by stretching or pulling the fist in a gesture input state in which the user holds the fist. can do.

In addition, the controller 180 may detect the second motion of changing the inclination of the remote controller 100 by tilting the wrist in the gesture input state in which the user holds a fist through the motion sensor 141.

The controller 180 may generate a remote execution signal separately from the gesture input and the motion input. In such a case, the motion input may generate a matching remote execution signal regardless of the control mode.

The controller 180 may generate a remote execution signal according to a motion input in the first control mode. (S109)

In detail, the controller 180 may generate a first remote execution signal when detecting the first motion in the first control mode.

In addition, the controller 180 may generate a second remote execution signal when the second motion is detected in the first control mode.

The first remote execution signal and the second remote execution signal may control different characteristics in the external device.

The remote execution signal generated as described above may be transmitted to an external device through the communication unit. (S117)

In detail, the controller 180 may remotely control the external device by generating a remote execution signal and transmitting the signal generated through the communication unit to the external device. For example, the controller 180 may transmit a remote execution signal generated through a Bluetooth communication method to a short range communication module to an external device.

In this case, the controller 180 may receive feedback from the external device according to the execution input through the communication unit.

This feedback is output through the output unit so that the user can recognize the control content to the external device according to the gesture or motion.

If the controller 180 detects the second gesture, the controller 180 may enter the second control mode. (S111)

In detail, when detecting the second gesture, the controller 180 may generate an execution signal according to a user input in the second control mode.

For example, the controller 180 may generate an execution signal according to a user's motion input in the second control mode when the gesture of fist fist is detected.

In detail, the controller 180 may detect a motion input of the user after entering the second control mode. (S113)

For example, the controller 180 may detect the first motion of moving the remote controller 100 by extending or pulling a hand in a gesture input state in which a user makes a fist through the motion sensor 141.

In addition, the controller 180 may detect the second motion of changing the inclination of the remote controller 100 by tilting the wrist in a gesture input state in which a user makes a fist through the motion sensor 141.

The controller 180 may generate a remote execution signal according to a motion input in the second control mode. (S115)

In detail, the controller 180 may generate a third remote execution signal upon detecting the first motion in the second control mode.

In addition, the controller 180 may generate a fourth remote execution signal when the second motion is detected in the second control mode.

The first to fourth remote execution signals may control different characteristics in the external device.

On the other hand, in the embodiment, the control unit 180 has been described as generating the execution signal in motion after setting the control mode with a gesture, on the contrary, it is also possible to generate the execution signal after setting the control mode in motion.

In addition, the controller 180 generates an execution signal for a gesture regardless of whether it is later or later, and generates an execution signal for a motion, so that a user may generate each remote control signal through motion and gesture input.

In addition, the controller 180 may generate a remote execution signal by combining a gesture input and a motion input, or generate a remote execution signal by generating a separate execution signal for a gesture input and a separate execution signal for a motion input. Of course it will be possible.

In detail, the controller 180 effectively combines an execution signal according to a gesture input, an execution signal based on a motion input, and an execution signal based on a gesture and motion input by reflecting the characteristics of the remote control device, thereby allowing a user suitable for the characteristic of the remote control apparatus. It can provide an interface. A detailed user interface will be described later.

Returning to the embodiment, the remote execution signal generated in this way may be transmitted to the external device through the communication unit. (S117)

The controller 180 according to the exemplary embodiment can generate a large number of execution signals using simple gestures and motions by providing a control mode that distinguishes a user's gestures and motions and generates an execution signal in at least two steps.

And such gestures and motion is a method that can be easily input while the user wears the remote control device 100 and the user can intuitively recognize the motion according to the gesture and motion input, the wearable remote control device 100 It is possible to provide a suitable effective user interface.

Hereinafter, specific examples of controlling an external device through the remote control method will be described.

14 is a block diagram illustrating an example of a remote control system according to an embodiment of the present invention. 15 is a view for explaining a remote control according to the gesture according to an embodiment of the present invention. 16 is a view for explaining a remote control according to the second motion according to an embodiment of the present invention. 17 is a view for explaining a remote control according to the first motion according to an embodiment of the present invention. 18 is a view for explaining a remote control according to another embodiment of the present invention.

First, a detailed remote control method of controlling a drone, which is an external device, by the watch type remote controller 100 will be described with reference to FIGS. 14 to 18.

Referring to FIG. 14, a remote control system for controlling a drone includes a remote control device 100, a drone 10 including a camera 11, and a display device capable of displaying images captured by the camera 11. . In this case, the remote control apparatus 100 may also display an image captured by the camera 11, but the embodiment will be described as displaying the image on a separate display device.

Numerous control inputs may be required to control the drone 10 among external devices. For example, an input for raising or lowering the drone 10, an input for determining the moving direction (acceleration direction) of the drone 10, an input for controlling the tilt of the drone 10, and other elements included in the drone 10. An input for controlling the devices (eg, the direction in which the camera 11 is photographed) may be necessary.

The remote control system according to the embodiment may provide a user interface using a wearable device specialized for the drone 10 having such characteristics.

Referring to FIG. 15, the remote controller 100 may generate and transmit a remote execution signal for raising or lowering the drone 10 according to a gesture input of a user, thereby controlling the vertical movement of the drone 10. .

In detail, the remote controller 100 may detect the first gesture or the second gesture through the gesture sensor 130.

The remote control apparatus 100 may enter the first control mode in the first gesture, and in this case, the remote control apparatus 100 may be a control mode in which the drone 10 is raised. In this case, the remote control apparatus 100 may first transmit the execution input according to the first control mode to the drone 10.

In contrast, the remote control apparatus 100 may enter the second control mode in the second gesture, and in this case, the second control mode may be a control mode in a state in which the drone 10 is lowered. In this case, the remote control apparatus 100 may first transmit the execution input according to the second control mode to the drone 10.

The remote controller 100 may control the drone 10 by generating and transmitting a remote execution signal by detecting a motion according to a control mode.

In detail, the remote control apparatus 100 may generate the first remote execution signal upon detecting the first motion in the first control mode, and generate the second remote execution signal upon detecting the second motion in the first control mode. .

In addition, the remote control apparatus 100 may generate a third remote execution signal upon detecting the first motion in the second control mode, and generate a fourth remote execution signal upon detecting the second motion in the second control mode. .

In addition, the first to fourth remote execution signals may control different characteristics in the drone 10.

In detail, referring to FIG. 16, when the remote controller 100 detects a motion of changing a tilt of the remote controller 100 by tilting a wrist in a pinned state, the drone 10 may be raised ( An execution input for controlling the slope of 10) may be generated.

On the contrary, when the remote control device 100 detects a motion of changing the inclination of the remote control device 100 by tilting the wrist in a fist state, the tilt of the drone 10 is controlled in a state where the drone 10 descends. You can create a run input to

In addition, referring to FIG. 17, when the remote controller 100 detects a motion of moving the remote controller 100 in a specific direction by stretching or pulling a hand in a pinned state, the drone 10 is raised. You can create a run input that accelerates to a specific direction on.

On the contrary, when the remote control device 100 detects a motion of moving the remote control device 100 in a specific direction by stretching or pulling a hand in a fist state, the drone 10 accelerates toward a specific direction in a descending state. You can generate run inputs.

Through this method, the remote control apparatus 100 according to the embodiment may provide a user interface that can intuitively control various movement characteristics of the drone 10 through simple gestures and motions.

Meanwhile, in another embodiment, the control mode may be a control mode for controlling different modules of the drone 10.

In detail, referring to FIG. 18, when the remote controller 100 detects the first gesture state, the remote controller 100 may control the movement characteristic of the drone 10 in the first control mode. For example, the remote controller 100 may generate and transmit an execution input for controlling the movement of the drone 10 when the hand detects various motions in a pin state.

In addition, the remote control apparatus 100 may control the camera 11 of the drone 10 in the second control mode when the second gesture state is detected. For example, when the remote controller 100 detects various motions in a fist state, the remote controller 100 may generate and transmit an execution input for controlling a camera 11's photographing direction, focus, and the like of the drone 10.

Through this method, the remote controller 100 according to another embodiment may provide a user interface that can intuitively control various modules of the drone 10 through simple gestures and motions.

As such, the remote control system according to the above-described embodiment may input a gesture and a motion even when the user does not see the wearable device. Therefore, the user can easily input the control of the drone 10 through the wearable device while observing the drone 10 or the display device. That is, the remote control system according to the embodiment has an advantage of providing an intuitive user interface suitable for the characteristics of the external device to be controlled.

19 is a block diagram illustrating an example of a remote control system according to another embodiment of the present invention. 20 is a diagram for describing remote control according to motion in a first control mode according to another embodiment of the present invention. 21 is a diagram for describing remote control according to motion in a second control mode according to another embodiment of the present invention.

First, a detailed remote control method of controlling the display device 30 (eg, the smart TV 30) that is an external device with the watch type remote control device 100 will be described with reference to FIGS. 19 to 21.

19, the remote control system for controlling the smart TV 30 includes a remote control device 100 and a display device 30.

Numerous control inputs may be required to control the smart TV 30 among external devices. For example, an input for changing a channel, an input for changing a sound, an input for controlling a play video, etc. may be required in the smart TV 30.

The remote control system according to another embodiment may provide a user interface using a wearable device specialized for the smart TV 30 having such characteristics.

20 and 21, the remote controller 100 may select a characteristic of the smart TV 30 to be controlled according to a gesture input of a user.

In detail, the remote control apparatus 100 may detect the first gesture or the second gesture through the gesture sensor.

In addition, the remote controller 100 may enter a first control mode that controls the first characteristic of the smart TV 30 in the first gesture, and selects a channel of the smart TV 30 as the first control mode. It may be a control mode.

In contrast, the remote control apparatus 100 may enter the second control mode in the second gesture, and in this case, the second control mode may be a mode for controlling the sound of the smart TV 30.

The remote controller 100 may control the smart TV 30 by generating and transmitting a remote execution signal by detecting a motion according to a control mode.

Referring to FIG. 20, the remote control apparatus 100 may generate a remote execution signal that lowers a channel number when detecting a motion of moving a hand to the left in a pin state of a hand and transmits the signal to the smart TV 30.

On the contrary, the remote controller 100 may generate a remote execution signal that increases the channel number and transmits the signal to the smart TV 30 when the motion of the hand is moved to the right in the pin state.

Referring to FIG. 21, the remote control apparatus 100 may generate a remote execution signal that raises a sound upon motion detection of moving a hand upward while holding a hand and transmits the signal to the smart TV 30.

On the contrary, the remote controller 100 may generate a remote execution signal for lowering the sound when the motion is detected to move the hand downward while holding the hand and transmit the signal to the smart TV 30.

Through this method, the remote control apparatus 100 according to the embodiment may provide a user interface that can intuitively control various characteristics of the smart TV 30 through simple gestures and motions.

22 is a block diagram illustrating an example of a remote control system according to another embodiment of the present invention. 23 to 26 are views showing a state of performing a remote control according to another embodiment of the present invention.

First, referring to FIGS. 22 to 26, a detailed remote control method for controlling the vehicle 40 (or an auxiliary device in the vehicle 40) that is an external device with the watch type remote control device 100 will be described.

Referring to FIG. 22, the wearable device of the remote control system includes a remote control device 100 and a vehicle 40.

Numerous control inputs may be required to control the vehicle 40 among external devices. For example, a driving operation input for driving the vehicle 40, an input for operating other devices of the vehicle 40, and the like are required.

The remote control system according to another embodiment may provide a user interface using the remote control device 100 specialized for the vehicle 40 having such characteristics.

Referring to FIGS. 23 and 24, the remote controller 100 may select characteristics of the vehicle 40 to be controlled according to a gesture input of a user.

In addition, the remote controller 100 may enter a first control mode that controls the first characteristic of the vehicle 40 when the first gesture is detected. For example, the first control mode may be a mode for controlling the audio output of the vehicle 40.

In contrast, the remote controller 100 may enter the second control mode in the second gesture. For example, the second control mode may be a mode for controlling the air conditioning apparatus of the vehicle 40.

The remote control apparatus 100 may control the vehicle 40 by generating and transmitting a remote execution signal by detecting a motion according to a control mode.

Referring to FIG. 23, the remote control apparatus 100 generates a remote execution signal for increasing or decreasing the output of audio through an input for moving a hand up and down while holding the hand, and outputting the signal to the audio output device of the vehicle 40. Can transmit

In addition, the remote control apparatus 100 may generate a remote execution signal for selecting a file (or frequency) to be output when detecting a motion of moving the hand from side to side while holding the hand, and may transmit the signal to the audio output device.

Referring to FIG. 24, the remote control apparatus 100 may generate a remote execution signal for setting a temperature of an air conditioning apparatus of the vehicle 40 and transmit the remote execution signal to the air conditioning apparatus when detecting a motion of moving the hand up and down in a pin state. have.

In addition, the remote control device 100 may generate a remote execution signal for setting the wind strength of the air conditioning device to detect the motion of moving the hand from side to side in a pin state and transmits to the air conditioning apparatus.

In this way, the remote control apparatus 100 according to the embodiment provides a user interface that can intuitively control various characteristics of the vehicle 40 through simple gestures and motions, thereby enhancing user convenience and driving attention. It is possible to maintain a safe driving.

On the other hand, when the remote control device 100 is placed in the hand controlling the handle, a remote control method of the remote control device 100 will be described.

25 to 26, when the remote control is placed on a hand that controls the handle, the user may generally take a first gesture that holds the handle by hand, and a second gesture that touches the handle and touches the handle. .

As illustrated in FIG. 25, when the remote controller 100 detects the first gesture in which the steering wheel is held by the hand, the remote controller 100 sees the driver as trying to control the steering wheel in detail while driving, and increases the steering level of the steering wheel. The remote execution signal may be transmitted to the vehicle 40.

In addition, as shown in FIG. 26, when the remote control device 100 detects the second gesture on the steering wheel by hand, the driver views the driver to apply a lot of manipulation force to the steering wheel, such as parking, and reduces the steering level of the steering wheel. A remote execution input may be transmitted to the vehicle 40.

Through this method, the remote control apparatus 100 according to the embodiment may provide a user interface that can intuitively control the steering characteristics of the vehicle 40 through simple gestures and motions.

27 is a block diagram illustrating an example of a remote control system according to another embodiment of the present invention. 28 to 29 are diagrams showing a state of performing a remote control according to another embodiment of the present invention.

First, referring to FIGS. 27 to 29, a detailed remote control method for controlling the notebook 50, which is an external device, using the watch type remote control apparatus 100 will be described. Here, the notebook 50 may be understood to include a general computer, a tablet, and the like.

Referring to FIG. 27, the remote control system includes a price control device 100 and a notebook computer 50.

Numerous control inputs may be required to control the notebook 50 among external devices. For example, keyboard input of the notebook 50, mouse input of the notebook 50, button input, and the like.

The remote control system according to another embodiment may provide a user interface using the remote control device 100 specialized for the notebook 50 having such characteristics.

The remote controller 100 may select a characteristic of the notebook 50 to be controlled according to the gesture input of the user.

Referring to FIG. 28, and when the first gesture is detected, the remote controller 100 may enter a first control mode that controls the first characteristic of the notebook 50. For example, the first control mode may be a keyboard input mode of the notebook 50.

Referring to FIG. 29, the remote control apparatus 100 may enter a second control mode in a second gesture. For example, the second control mode may be a mouse input mode of the notebook 50.

The remote controller 100 may control the notebook 50 by generating and transmitting a remote execution signal by detecting a motion according to a control mode.

Referring to FIG. 28, the remote controller 100 may generate a keyboard input remote execution signal according to a motion of moving a finger in a pin state and transmit the generated keyboard input remote execution signal to the notebook 50.

Referring to FIG. 29, the remote controller 100 may generate a mouse input remote execution signal according to a motion of moving a finger in a pin state and transmit the generated mouse input remote execution signal to the notebook 50.

Meanwhile, the remote execution signal may be generated by the first gesture and the second gesture. For example, a hand-and-blood gesture can generate a mouse click input remote execution signal.

Through these embodiments, the remote control apparatus 100 according to the embodiment provides a user interface that can intuitively control various characteristics of the notebook 50 through simple gestures and motions, thereby enhancing user convenience and driving. You can keep your attention and drive safely.

Features, structures, effects, and the like described in the above embodiments are included in at least one embodiment of the present invention, and are not necessarily limited to only one embodiment. In addition, the features, structures, effects, and the like illustrated in the embodiments may be combined or modified with respect to other embodiments by those skilled in the art to which the embodiments belong. Therefore, contents related to such combinations and modifications should be construed as being included in the scope of the present invention.

In addition, the above description has been made with reference to the embodiments, which are merely examples and are not intended to limit the present invention, and those skilled in the art to which the present invention pertains may be illustrated as above without departing from the essential characteristics of the present embodiments. It will be appreciated that various modifications and applications are possible. For example, each component specifically shown in the embodiments may be modified. And differences relating to such modifications and applications will have to be construed as being included in the scope of the invention defined in the appended claims.

Claims

A watch type wearable remote controller that remotely controls an external device in response to a user input.

A wireless communication unit transmitting a remote execution signal for controlling the external device to the external device;

A gesture sensor for detecting a gesture of the user;

A motion sensor detecting the motion of the user; And

And a controller configured to generate a first remote execution signal according to the detected user gesture and to generate a second remote execution signal according to the detected motion.
The method of claim 1,

The gesture is a maintainable gesture taken while wearing the remote control device,

And the gesture sensor detects at least two other gestures.
The method of claim 1,

The gesture sensor,

Remote control device for detecting a change in the contact area with the remote control device according to the gesture of the user as a change in capacitance.
The method of claim 1,

The motion sensor,

A remote control device for detecting different motions with at least two modules, including at least two of an acceleration sensor, a gyroscope sensor, and a gravity sensor.
The method of claim 4, wherein

The acceleration sensor,

Detect a first motion of the user moving the wrist in a specific direction,

The gyroscope sensor,

And a second motion sensing of the user tilting the wrist in a specific direction.
The method of claim 1,

The control unit determines a control mode according to the detected user gesture, and generates a remote execution signal in accordance with the motion of the detected user in the determined control mode.
The method of claim 6,

The control unit,

And detecting a first gesture by the gesture sensor in a first control mode, and when detecting a second gesture, generating a remote execution signal according to the detected motion of the user.
The method of claim 7, wherein

The control unit,

Generating a first remote execution signal upon detecting a first motion in the first control mode,

Generating a third remote execution signal upon detecting a first motion in the second control mode,

And the first remote execution signal and the third remote execution signal control different characteristics of the external device.
The method of claim 8,

Generating a second remote execution signal upon detecting a second motion in the first control mode,

Generating a fourth remote execution signal upon detecting a second motion in the second control mode,

And the first to fourth remote execution signals control different characteristics of the external device.
The method of claim 1,

The external device is a drone remote control device.
The method of claim 10,

The control unit,

Generate a remote execution signal that raises the drone upon detecting a first gesture,

And generating a remote execution signal for lowering the drone upon detecting the second gesture.
The method of claim 11,

The control unit,

A remote control device for generating a remote execution signal for controlling the tilt of the drone upon detecting the first motion.
The method of claim 12,

The control unit,

And generating a remote execution signal for controlling the acceleration direction of the drone when detecting the second motion.
The method of claim 10,

The control unit,

Providing a first control mode for controlling a movement characteristic of the drone upon detecting a first gesture,

And a second control mode for controlling a camera of the drone upon detecting a second gesture.
The method of claim 9,

The external device is a smart TV remote control device.
The method of claim 15,

The first control mode is a mode for controlling the channel of the smart TV,

The second control mode is a mode for controlling the sound of the smart TV remote control device.
The method of claim 1,

The wireless communication unit

And a short range communication module configured to directly transmit the remote execution signal to the external device located in close proximity by a Bluetooth communication method.
The method of claim 1,

And an output unit configured to output the gesture detection state and the motion detection state.
As a method of remotely controlling an external device using a watch type remote controller,

Starting a remote control;

Detecting a gesture of the user;

Determining a control mode according to the gesture state of the user;

Detecting a motion input of the user in the determined control mode;

Generating a remote execution signal according to the motion input in the determined control mode; And

And wirelessly transmitting the remote execution signal to the external device.
A remote control device configured to determine a control mode according to a gesture of a user with a watch type wearable device, generate a remote execution signal according to a motion input in the determined control mode, and wirelessly transmit the remote execution signal; And

And an external device that receives the remote execution signal from the remote control device and is controlled according to the received remote execution signal.