KR101678292B1 - METHOD, SYSTEM AND COMPUTER-READABLE RECORDING MEDIUM FOR CONTROLLING IoT(Internet of Things) DEVICE USING A WEARABLE DEVICE - Google Patents

Abstract

According to an embodiment of the present invention, there is provided a system for controlling an object Internet appliance using a wearable device and a server, the wearable device including: a motion sensor unit for sensing motion of the wearable device and generating sensing information; A wearable device processor for generating motion information corresponding to the motion of the wearable device based on the sensing information; And a first communication unit for transmitting the motion information to the server. Wherein the server comprises: a second communication unit for receiving the motion information from the wearable device; And a server processor for generating a device control signal based on the motion information; Wherein the apparatus control signal is a signal transmitted to the object Internet apparatus through the second communication unit and used for controlling an operation of the object internet apparatus, .

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a control method, system, and computer readable recording medium for a thing Internet device using a wearable device,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a control method, system and computer-readable recording medium for an object Internet appliance using a wearable device.

With the development of communication and sensor technologies and the spread of smartphones, the influence of the Internet of Things has been expanding widely from all industries to everyday life.

Recently, it has been required to check the condition of the house from the outside through the rapid spread of smart phones, and to control the boiler, the lamp, the gas valve, and the like. In addition, a smart home system can be constructed when a thing Internet device is connected to a home network.

However, in order to control the Internet device by using the smart phone, the user must carry the smart phone all the time and use the user interface displayed on the screen of the smart phone. In other words, there was a limitation in providing an intuitive UX (USER EXPERIENCE) method of controlling the Internet device using a smart phone.

SUMMARY OF THE INVENTION The present invention has been made to solve all the problems of the prior art described above.

One embodiment of the present invention provides a smart home system capable of selecting an object Internet appliance through an intuitive operation of a wearable device and controlling an operation of the selected appliance using a wearable device and a object Internet-based server.

In order to accomplish the above object, a representative structure of the present invention is as follows.

In a system for controlling an object Internet appliance using a wearable device and a server according to an embodiment, the wearable device may include a motion sensor unit for sensing motion of the wearable device and generating sensing information; A wearable device processor for generating motion information corresponding to the motion of the wearable device based on the sensing information; A first communication unit for receiving the motion information from the wearable device processor and transmitting the motion information to the server; Wherein the server comprises: a second communication unit for receiving the motion information from the wearable device; And a server processor for generating a device control signal based on the motion information; Wherein the device control signal is a signal transmitted to the Internet appliance through the second communication unit and used for controlling the operation of the Internet appliance, and the motion information includes a YAW axis, a PITCH axis, and a ROLL axis (Global Coordinate), which is formed on the basis of an amount of change and is represented by an inertial frame having an arbitrary position as an origin in a space in which the server and the object Internet appliance are arranged, Wherein when the position indicated by the wearable device identified using the three-dimensional coordinate system including the x-axis, the y-axis, and the z-axis is matched with the predetermined location of the location Internet device, And a control unit for controlling the operation of the object Internet appliance control system.

The server processor according to an embodiment generates a device control signal corresponding to a predetermined gesture when the motion information is matched with information of a predetermined gesture, and the information about the predetermined gesture is transmitted to a second And may be stored in memory.

The object Internet apparatus control system according to an embodiment may include a plurality of object Internet devices, and when the motion information is matched with information of a gesture that is horizontally or vertically moved, It is possible to generate a device control signal for selecting the object Internet device located in the direction of the gesture among the devices.

The server processor according to an exemplary embodiment may generate a device control signal that is controlled so that the position of the pointer output to the output unit of the object Internet device is changed when the motion information matches the information of the gesture that is horizontally or vertically moved .

The server processor according to an exemplary embodiment may be configured such that when the motion information is matched with gesture information rotated in a clockwise or counterclockwise direction, the application output to the output unit of the object Internet appliance returns to the previous screen or the initial screen It is possible to generate a device control signal to be controlled.

The wearable device according to an embodiment may include a plurality of motion sensor units, and when the motion information is matched with the information of the gesture moving so that the distance between the plurality of motion sensor units changes, It is possible to generate a device control signal for controlling the zoom-in or zoom-out of the image output to the output unit of the Internet device.

A method for controlling an Internet appliance using a wearable device and a server according to an embodiment, the method comprising: receiving a device control signal from the server; And controlling an operation of the wearable device based on the device control signal; Wherein the device control signal is generated in the server when the motion information generated in correspondence with the movement of the wearable device matches the information of the predetermined gesture on the basis of the amount of change of the YAW axis, the PITCH axis, and the ROLL axis, (Global Coordinate) represented by an inertial frame having an arbitrary position as an origin within a space in which the server and the Internet apparatus are disposed, and is information on movement of the wearable device, And controlling the operation of the to-be-watermarked Internet appliance matched with the wearable device when a position indicated by the wearable device identified using the three-dimensional coordinate system including the z-axis matches a predetermined position of the to-be-watermarked Internet appliance. The present invention provides a method of controlling Internet devices.

In addition to this, another method for implementing the present invention, another system, and a computer-readable recording medium for recording a computer program for executing the method are further provided.

According to an embodiment of the present invention, a user-oriented smart home system can be provided by controlling an object Internet device based on an intuitive UX (User Experience) using a wearable device.

FIG. 1 is a schematic view of a system for controlling Internet apparatuses using wearable devices according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 2 is a block diagram illustrating a wearable device, a server, and a stuff Internet device included in the object Internet appliance control system according to an embodiment.
FIG. 3 is a flowchart of a method for controlling an object Internet appliance using a wearable device and a server in a object Internet appliance control system according to an exemplary embodiment.
4 is a diagram illustrating an example of specifying a location of a destination Internet appliance based on a location of a user wearing a wearable device in the Internet appliance control system according to an embodiment.
5 is a diagram illustrating an example of selecting a destination Internet appliance on the basis of the movement of the wearable device in the Internet appliance control system according to the embodiment.
6 to 7 are views showing an example of controlling a selected object Internet appliance on the basis of the movement of the wearable device in the object Internet appliance control system according to the embodiment.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings. Referring to the accompanying drawings, the same or corresponding components are denoted by the same reference numerals, and a duplicate description thereof will be omitted.

FIG. 1 is a schematic diagram of a to-be-Internet appliance control system 10 using a wearable device 100 according to an embodiment.

1, the object Internet appliance control system 10 may include a wearable device 100, a server 200, a matter Internet appliance 300, and a user terminal 400.

Hereinafter, the components will be described in order.

The object Internet appliance control system 10 according to an embodiment is a system for controlling the object Internet appliance 300 through a wearable device 100 or a user terminal 400 from the outside to a home electric appliance such as a home appliance, , A smart television, a smart computer, and the like.

The wearable device 100, the user terminal 400 or the object Internet device 300 according to an embodiment may be a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, an electronic frame, a navigation device, Such as a wrist watch or a wearable device such as a head-mounted display (HMD), and the like.

The wearable device 100 according to one embodiment may be mounted on a user and moved.

For example, the wearable device 100 can detect motion of the wearable device 100 using the motion sensor unit 110 mounted in the wearable device 100, and generate motion information corresponding to the motion . In this case, the generated motion information may be transmitted to the server 200. [

Meanwhile, the wearable device 100 according to one embodiment is a ring-shaped device, and can be worn like a ring or a clock on the user's finger.

The server 200 according to an exemplary embodiment may be a server 200 based on the Internet.

For example, the server 200 according to one embodiment may include a Gateway, a Raspberry-based Pi, and the like. In addition, the server 200 according to one embodiment may be located close to the outside of the object Internet appliance 300 to control the object Internet appliance 300. [

In addition, the server 200 according to one embodiment can transmit and receive data to / from the wearable device 100 or the object Internet device 300 according to an embodiment through the network 20.

For example, the server 200 can receive the motion information corresponding to the movement of the wearable device 100 from the wearable device 100, and generate the device control signal corresponding to the received motion information. In this case, the device control signal may be transmitted to the object Internet device 300. [

The object Internet appliance 300 according to an embodiment can be controlled based on information received from the server 200. [

For example, the object Internet device 300 can perform an operation corresponding to the device control signal generated in the server 200 based on the motion information corresponding to the motion of the wearable device 100.

Accordingly, the object Internet appliance control system 10 according to an embodiment of the present invention allows the wearable device 100 and the object Internet-based server 200 to perform the intuitive operation of the wearable device 100, 300), and controls the operation of the selected device.

The network 20 according to one embodiment is capable of transmitting and receiving data between the wearable device 100, the server 200, the object Internet appliance 300 and the user terminal 400 in the object Internet appliance control system 10 Wired or wireless communication.

For example, the network 20 may include a user and an object Internet device 300, a server 200 such as a WPAN, a WiFi, a 3G / 4G / LTE, a Bluetooth, an Ethernet, a BcN, a satellite communication, a Microware, Means any wireless network that can be connected.

In addition, data can be transmitted and received between the wearable device 100, the server 200, and the object Internet appliance 300 using local communication.

The short-range communication according to an embodiment is a connection communication network enabling bidirectional communication between the wearable device 100, the server 200, and the object Internet appliance 300. For example, the short range communication may include at least one of Bluetooth and WiFiIRECT.

The object Internet appliance control system 10 according to the embodiment is capable of controlling the object Internet device 300 without connecting the wearable device 100, the server 200 and the object Internet appliance 300, The operation of the device 300 can be controlled.

FIG. 2 is a block diagram illustrating a wearable device 100, a server 200, and an object Internet appliance 300 included in the object Internet appliance control system 10 according to an embodiment.

2, the wearable device 100 of the object Internet appliance control system 10 includes a motion sensor unit 110, a first memory 120, an input / output unit 130, a first communication unit 140, A device processor 150, and the like.

The motion sensor unit 110, the first memory 120, the input / output unit 130, the first communication unit 140, and the wearable device processor 150 according to an embodiment may be connected to each other via a bus.

For example, the bus according to one embodiment may be a universal asynchronous receiver / transmitter (UART), which is a type of computer hardware that transmits data in parallel and in a serial manner.

The sensing information sensed by the motion sensor unit 110 is transmitted to the wearable device processor 150 through the asynchronous transceiver and the motion information generated by the wearable device 100 is also transmitted to the communication unit through the asynchronous transceiver Lt; / RTI >

The wearable device 100 is also provided with a physical sensor capable of obtaining information from type, such as remote sensing, SAR, radar, position, motion, image sensor, and the like, from temperature, humidity, heat, gas, . ≪ / RTI >

The motion sensor unit 110 according to an embodiment can detect movement of the wearable device 100 mounted on the user.

For example, the motion sensor unit 110 may include a gyroscope, an inertial measurement unit (IMU), an accelerometer, a magnetometer, and the like.

The motion sensor unit 110 according to one embodiment may include at least one inertial measurement unit (IMU motion sensor unit). In this case, the IMU motion sensor unit includes a 6-axis IMU motion sensor unit including a 3-axis accelerometer and a 3-axis gyroscope, and a 9-axis IMU motion sensor unit including a 3-axis accelerometer, a 3-axis gyroscope, Or more.

In this case, the sensing information sensed by the motion sensor unit 110 according to an exemplary embodiment may be a local coordinate system represented by a body frame having the center of the motion sensor unit 110 as an origin. An angle of rotation of the shaft or rotation of the various axes, and the like. Meanwhile, the sensing information sensed by the motion sensor unit 110 may be transmitted to the wearable device processor 150 through the bus.

As described above, it should be noted that the method of detecting the movement of the wearable device 100 by using various sensors is not limited to a specific method because there are various methods commonly used in the industry.

The first memory 120 according to one embodiment may store a program for processing and controlling the wearable device processor 150 and may store data input to and / or output from the wearable device 100.

The first memory 120 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) , A magnetic disk, or an optical disk.

Also, the wearable device 100 may operate a web storage or a cloud server 200 that performs a storage function of the first memory 120 on the web.

The programs stored in the first memory 120 may be classified into a plurality of modules according to their functions, for example, a UI module (not shown), a touch screen module (not shown) .

The UI module (not shown) can provide a specialized UI, a GUI, and the like that are interlocked with the wearable device 100. For example, the UI module according to one embodiment can provide a UI, a GUI, and the like, which are specialized in detecting motion in the wearable device 100 and generating the motion sensor unit 110.

The input / output unit 130 according to an embodiment can output data generated in the wearable device 100 or input externally generated data.

The first communication unit 140 may transmit motion information generated by the wearable device 100 to the server 200 according to an embodiment of the present invention. For example, the first communication unit 140 according to an embodiment may be a Bluetooth module, which is an example of short-range communication.

The wearable device processor 150 according to an embodiment controls the entire operation of the wearable device 100 in general.

For example, the wearable device processor 150 may control operations between the motion sensor unit 110, the first memory 120, the input / output unit 130, and the first communication unit 140.

Some or all of the motion sensor unit 110, the first memory 120, the input / output unit 130, the first communication unit 140, and the wearable device processor 150 may be operated by a software module, , Some of the above-described configurations may be operated by hardware. In addition, at least some of the motion sensor unit 110, the first memory 120, the input / output unit 130, and the first communication unit 140 may be included in the wearable device processor 150, . For example, the wearable device 100 according to one embodiment may include a wearable device processor 150, a first memory 120, and micro-controllers (MPUs) including an input / have.

The wearable device processor 150 according to one embodiment can obtain motion information of the wearable device 100 related to the movement of the wearable device 100. [

For example, the wearable device processor 150 can receive sensing information sensed from the motion sensor unit 110 through the bus, and generate motion information based on sensing information.

For example, the sensing information sensed in relation to the movement of the wearable device 100 may include one or more axes in a local coordinate system represented by a body frame having the center of the motion sensor unit 110 as an origin, Or an amount of angular change of the rotational motion of the various axes, and the like.

In this case, the motion information according to an exemplary embodiment may be information about motion of the wearable device 100 in a reference coordinate system (Global Coordinate) represented by an inertial frame having an arbitrary position in the house as an origin. That is, the sensing information obtained in the local coordinate system can be converted into the reference coordinate system to generate motion information.

In addition, the wearable device processor 150 according to an exemplary embodiment may convert the motion information into a profile to generate a Bluetooth HID profile (HID Profile). In this case, the Bluetooth HID profile (HID Profile) may be transmitted to the first communication unit 140 via the bus.

For example, in the form of a Bluetooth HID profile (HID Profile), the motion information corresponding to the motion is determined by whether it is an input device such as a mouse or a keyboard, whether it is left or right clicked, And the value of the scroll.

The server 200 of the object Internet appliance control system 10 according to an embodiment may include a second communication unit 210, a second memory 220, and a server processor 230.

The second communication unit 210 may receive motion information from the wearable device 100 through the network 20. Hereinafter, the configuration of the second communication unit 210 is the same as that of the first communication unit 140, and a detailed description thereof will be omitted.

The second memory 220 according to an embodiment may store a program for processing and controlling the server processor 230 and may store data input to and / or output from the server 200.

For example, the UI module stored in the second memory 220 according to an exemplary embodiment may provide a UI, a GUI, and the like, which are specialized in generating a device control signal from the server 200.

Hereinafter, the configuration of the second memory 220 is the same as that of the first memory 120, and thus a detailed description thereof will be omitted.

The server processor 230 according to an exemplary embodiment controls overall operation of the server 200. [

The server processor 230 according to an exemplary embodiment may generate a device control signal for controlling the operation of the object Internet device 300 based on the motion information received by the second communication unit 210. [

For example, the device control signal is generated based on the motion information received from the wearable device 100 and the action of the object Internet device 300 corresponding to the information of the predetermined gestures stored in the second memory 220 . In this case, the device control signal can be transmitted to the object Internet device 300 via the network 20 and can be used to control the operation of the object Internet device 300.

The object Internet apparatus 300 of the object Internet appliance control system 10 may include a third communication unit 310, a third memory 320 and a matter Internet appliance processor 330.

The third communication unit 310 may receive the device control signal from the server 200 through the network 20. [ Hereinafter, the configuration of the third communication unit is the same as that of the first communication unit 140, and a detailed description thereof will be omitted.

The third memory 320 according to an embodiment may store a program for processing and controlling the object Internet appliance processor 330 and may store data input to and / or output from the object internet appliance 300.

For example, the UI module stored in the third memory 320 according to an exemplary embodiment may provide a UI, a GUI, and the like, which are specialized in controlling operations in the object Internet device 300. [

Since the configuration of the third memory 320 is the same as that of the first memory 120, a detailed description will be omitted.

The object Internet appliance processor 330 according to an embodiment controls overall operation of the server 200 as a whole.

For example, the object Internet appliance processor 330 can control the operation of the object Internet appliance 300 based on the device control signal received from the server 200. [ This will be described in detail with reference to FIGS. 5 to 7. FIG.

The various embodiments described herein may be embodied in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions.

In some cases, such embodiments may be implemented by wearable device processor 150, server processor 230, or object Internet appliance processor 330. According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software code may also be stored in the first memory 120, the second memory 220 or the third memory 320 and may be stored in the wearable device processor 150, the server processor 230, Lt; / RTI >

3 is a flowchart of a method for controlling the object Internet appliance 300 using the wearable device 100 and the server 200 in the object Internet appliance control system 10 according to an exemplary embodiment.

As shown in FIG. 3, the server 200 can receive the motion information generated in the wearable device 100, and generate the device control signal based on the received motion information. In this case, the server 200 may transmit a device control signal to the object internet appliance 300, and the device control signal may be used to control the operation of the object internet appliance 300.

The wearable device 100 may sense the sensing information related to the movement of the wearable device 100 by using the motion sensor unit 110 mounted on the wearable device 100 in step 100. [

For example, if the motion sensor unit 110 is the inertial measurement unit, that is, the IMU motion sensor unit, the sensing information sensed by the motion sensor unit 110 may include at least one of a body coordinate system Body And an amount of angular change of rotation motion of one axis or multiple axes of a local coordinate represented by a frame.

The sensed information sensed in relation to the movement of the wearable device 100 in the motion sensor unit 110 is detected by detecting the rotation between the horizontal and the vertical at the fixed position of the wearable device 100 using the acceleration sensor, The sensor can be used to measure the amount of angular movement of one or more axes, or to measure absolute directions using a geomagnetic sensor.

For example, the sensing information sensed in relation to the movement of the wearable device 100 in the motion sensor unit 110 may include a variation amount of the Euler angles, a variation amount of the acceleration, a variation amount of the magnetic field, and the like.

In step 110, the wearable device 100 may generate motion information based on the sensing information sensed in step 100. [

For example, the wearable device processor 150 can receive sensing information sensed by the motion sensor unit 110 through a bus. In this case, the wearable device processor 150 can generate motion information corresponding to the motion of the wearable device 100 based on the sensing information.

For example, the motion information according to an exemplary embodiment may be information related to motion of the wearable device 100 in a reference coordinate system (Global Coordinate) represented by an inertial frame having an arbitrary position in the house as an origin have.

That is, the sensing information obtained in the local coordinate system can be converted into the reference coordinate system to generate motion information.

In step 120, the wearable device 100 may transmit the motion information generated in step 110 to the server 200. [

For example, the motion information generated in the wearable device processor 150 may be converted into a Bluetooth HID profile (HID Profile) format and transmitted to the first communication unit 140 via the bus. In this case, the first communication unit 140 may transmit the converted Bluetooth HID profile (HID Profile) to the server 200.

In step 130, the server 200 may generate a device control signal based on the motion information received from the wearable device 100 in step 120.

The server 200 according to an embodiment can receive motion information from the wearable device 100 through the second communication unit 210 and generate the device control signal based on the motion information.

For example, when the motion information is matched with information of a predetermined gesture stored in the second memory 220, a device control signal corresponding to a predetermined gesture can be generated.

For example, the predetermined gesture may be used when the wearable device 100 moves horizontally or vertically, or when the wearable device 100 rotates clockwise / counterclockwise, or when a plurality of A case where the distance between the motion sensor units 110 becomes narrower or distant from each other, and the like. In this case, a device control signal corresponding to a predetermined gesture can be generated. This will be described in detail with reference to Figs. 5 to 7. Fig.

In step 140, the server 200 may transmit the device control signal generated in step 130 to the object Internet appliance 300.

For example, the server processor 230 according to an embodiment determines whether motion information received by the second communication unit 210 matches a predetermined gesture stored in the second memory 220, And transmits the device control signal to the object Internet appliance 300 through the second communication unit 210. [ In this case, the device control signal may be a signal that has undergone format conversion to be transmitted to the object Internet device 300.

The object Internet device 300 can control the operation of the object Internet device 300 based on the device control signal received from the server 200 in step 140.

The object Internet apparatus 300 according to an embodiment may be controlled using a device control signal received from the server 200 via the third communication unit 310. [

For example, the operation of the object Internet device 300 may include a movement of the mouse of the object Internet device 300, a home mode or a back mode of the object Internet device 300, Zoom in / out of an image displayed on the output unit of the Internet device 300, and the like.

4 illustrates an example of specifying the location of the object Internet appliance 300 on the basis of the position of the user wearing the wearable device 100 in the object Internet appliance control system 10 according to the embodiment FIG.

As shown in FIG. 4, in the object Internet equipment control system 10, three coordinate systems can be calculated. A first local coordinate system 1000 represented by a body frame having the center of the motion sensor unit 110 of the wearable device 100 worn by the wearer as the origin, a wearable device 100 worn A second local coordinate system 3000 centered on a user who is currently using the object Internet 300 and a reference coordinate system expressed by an inertial frame having an arbitrary position in the house where at least one of the object Internet devices 300 is disposed as an origin 2000).

4, a first local coordinate system 1000, which is represented by a body frame having the center of the motion sensor unit 110 of the wearable device 100 as an origin, includes a YAW axis, a PITCH axis, and a ROLL axis May be a coordinate system that includes.

For example, at least one axis of the ROLL axis of the YAW axis and the PITCH axis may be rotated with respect to the movement of the wearable device 100. [

As shown in FIG. 4, a virtual cylinder having a radius L, which is the arm length of the wearer, can be set in the second local coordinate system 3000 in the three-dimensional space, centering on the user wearing the wearable device 100.

In this case, the coordinates in the virtual cylinder can be specified by the positions of the plurality of frames 3100 and the block 3200 included in each frame. For example, a frame may be divided into a circumference 2? L having a radius of a user's arm, L, and a 360 degree Deg, which is a range of Yaw, and then a rectangle larger than a predetermined size may be set as one frame. In addition, as shown in FIG. 4, the height H of the block included in each frame can be set to an equation of H = tan (a) xL.

Accordingly, blocks included in all frames in the user-centered second local coordinate system 3000 can be identified.

As shown in FIG. 4, at least one or more object internet devices 300 are arranged in the reference coordinate system 2000.

The object Internet appliance control system 10 according to the embodiment can control the operation of the object Internet appliance 300 based on the intuitive operation of the wearable device 100 worn by the user.

For example, when a predetermined gesture is recognized in the wearable device 100, an operation corresponding to a predetermined gesture can be performed in the object Internet device 300. [ For example, the predetermined gesture may be used when the wearable device 100 moves horizontally or vertically, or when the wearable device 100 rotates clockwise / counterclockwise, or when a plurality of motions included in the wearable device 100 A case where the distance between the sensor units 110 becomes narrower or farther, and the like.

This will be described in detail with reference to FIG. 5 to FIG.

5 is a diagram illustrating an example of selecting the object Internet appliance 300 based on the movement of the wearable device 100 in the object Internet appliance control system 10 according to the embodiment.

5, when the amount of change of the YAW axis and the PITCH axis is sensed in the first local coordinate system according to the movement of the wearable device 100, the wearable device 100 calculates motion information (motion information) based on the amount of change of the YAW axis and the PITCH axis, Lt; / RTI >

For example, in the object Internet control system 10 according to the embodiment, the object Internet device 300 to be controlled can be pointed by using the wearable device 100 worn by the user. In this case, when the wearable device 100 senses a motion of pointing toward the object Internet device 300 to be controlled, the object Internet device 300 positioned in the pointing direction can be selected.

The motion information may include a variation amount of the X value and a variation amount of the Y value in the reference coordinate system. In this case, the amount of change in the X value in the reference coordinate system can be calculated using the amount of change in the YAW axis, and the amount of change in the Y value in the reference coordinate system can be calculated using the amount of change in the PITCH axis.

The generated motion information may be transmitted to the server 200. When the server 200 recognizes that the gesture corresponding to the motion information is a horizontal or vertical gesture, It is possible to generate a device control signal for controlling the operation of the mouse cursor displayed on the screen of the mouse.

In this case, the device control signal is transmitted to the object Internet device 300, and the mouse cursor on the screen of the object Internet device 300 can be moved based on the amount of change in the X value and the amount of change in the Y value.

6 to 7 are views showing an example of controlling the selected object Internet appliance 300 based on the movement of the wearable device 100 in the object Internet appliance control system 10 according to the embodiment.

6, when the variation amount of the ROLL axis is sensed in one local coordinate system in accordance with the movement of the wearable device 100, the wearable device 100 can generate motion information based on the amount of change of the ROLL axis.

For example, the motion information may include information on whether the amount of change of the ROLL axis in the reference coordinate system rotates clockwise or counterclockwise.

The calculated motion information can be transmitted to the server 200. When the server 200 recognizes the gesture corresponding to the motion information as a gesture moving clockwise or counterclockwise, It is possible to generate a device control signal for controlling the operation of the application displayed on the screen of the device.

For example, when the gesture corresponding to the motion information is recognized as being rotated clockwise / counterclockwise, the server 200 determines whether the application displayed on the screen of the object Internet device 300 returns to the previous screen / It is possible to generate a device control signal capable of performing an operation.

In this case, the device control signal is transmitted to the object Internet device 300, and the application of the object Internet device 300 can return to the previous screen / initial screen.

As shown in FIG. 7, the wearable device 100 may be equipped with two motion sensor units 110.

For example, according to the movement of the wearable device 100, the YAW axis of the third local coordinate system 1000a based on the first motion sensor unit 110a and the YAW axis of the fourth local coordinate system 1000a based on the fourth motion sensor unit 110b When the amount of change in distance movement between the YAW axes of the local coordinate system 1000b is sensed, the wearable device 100 can generate motion information.

For example, the motion information may include information on whether the amount of change in the distance movement between the YAW axis of the third coordinate system and the YAW axis of the fourth coordinate system increases / decreases.

The calculated motion information may be transmitted to the server 200 and the server 200 may determine whether the gesture corresponding to the motion information is a direction in which the first motion sensor unit 110a and the second motion sensor unit 110b move away from / It is possible to generate a device control signal for controlling an operation of zooming in / zooming out an image displayed on the screen of the object Internet device 300. [

For example, when it is recognized that the gesture corresponding to the motion information is moved in the direction in which the first motion sensor unit 110a and the second motion sensor unit 110b are moving in the direction to / away from the first motion sensor unit 110a, A device control signal capable of performing an operation of zooming in / out of the image displayed on the screen of the device 300 can be generated.

In this case, the device control signal is transmitted to the object Internet device 300, and the image displayed on the screen of the object Internet device 300 can be zoomed in / out.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specifically designed and configured for the present invention or may be those known and used by those skilled in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROM and DVD, magneto-optical media such as floptical disks, medium, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code, such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified into one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications and changes may be made thereto without departing from the scope of the present invention.

Accordingly, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all ranges that are equivalent to or equivalent to the claims of the present invention as well as the claims .

10: Internet appliance control system 20: Network
100: wearable device 200: server
300: object Internet device 400: user terminal

Claims (10)

In a system for controlling a thing Internet appliance using a wearable device and a server,
The wearable device,
A motion sensor for sensing motion of the wearable device and generating sensing information;
A wearable device processor for generating motion information corresponding to the motion of the wearable device based on the sensing information; And
A first communication unit for receiving the motion information from the wearable device processor and transmitting the motion information to the server; Lt; / RTI >
The server comprises:
A second communication unit for receiving the motion information from the wearable device; And
A server processor for generating a device control signal based on the motion information; Lt; / RTI >
Wherein the device control signal is a signal transmitted to the Internet appliance through the second communication unit and used for controlling the operation of the Internet appliance,
The motion information is formed on the basis of the amount of change of the YAW axis, the PITCH axis, and the ROLL axis, and is expressed by an inertial frame having an arbitrary position as an origin in the space where the server and the object Internet appliance are arranged. (Global Coordinate) of the wearable device,
when the position indicated by the wearable device identified using the three-dimensional coordinate system including the x-axis, the y-axis, and the z-axis is matched with the predetermined location of the location Internet device, the operation of the location Internet device matching the wearable device Wherein said control means controls said control means so as to control said control means.
delete The method according to claim 1,
The server processor
Generates a device control signal corresponding to a predetermined gesture when the motion information matches the information of the predetermined gesture,
Wherein the information about the predetermined gesture is stored in a second memory included in the server. 4. The Internet appliance control system according to claim 3, wherein the object Internet appliance control system may include a plurality of object Internet appliances,
The server processor,
And generates a device control signal for selecting a destination Internet appliance located in the direction of the gesture among the plurality of destination Internet appliances when the motion information is matched with the information of the gesture moved horizontally or vertically, Device control system. The method of claim 3,
The server processor,
And generates a device control signal that is controlled so that the position of the pointer output to the output unit of the object Internet device is changed when the motion information is matched with the information of the gesture moving horizontally or vertically, Control system. The method of claim 3,
The server processor,
When the motion information is matched with the information of the gesture rotated clockwise or counterclockwise, generates a device control signal for controlling the application outputted to the output unit of the object Internet appliance to return to the previous screen or the initial screen Feature, Internet appliance control system. The wearable device of claim 3, wherein the wearable device may include a plurality of motion sensor units,
The server processor,
Generating a device control signal for controlling to zoom in or out an image output to the output unit of the object Internet device when the motion information is matched with information of a gesture moving so that the distance between the plurality of motion sensor units changes The Internet appliance control system comprising: A method of controlling a thing Internet appliance using a wearable device and a server,
Receiving a device control signal from the server; And
Controlling an operation of the wearable device based on the device control signal; Lt; / RTI >
The device control signal is generated in the server when the motion information generated in correspondence with the movement of the wearable device matches the information of the predetermined gesture based on the amount of change of the YAW axis, the PITCH axis, and the ROLL axis, Information on the movement of the wearable device in a reference coordinate system (Global Coordinate) represented by an inertial frame having an arbitrary position as an origin within a space in which the Internet appliance is disposed,
when the position indicated by the wearable device identified using the three-dimensional coordinate system including the x-axis, the y-axis, and the z-axis is matched with the predetermined location of the location Internet device, the operation of the location Internet device matching the wearable device Wherein the control unit controls the control unit.
delete A computer-readable recording medium recording a computer program for executing the method according to claim 8.

Images