WO2015102467A1 - Home device control apparatus and control method using wearable device - Google Patents

Home device control apparatus and control method using wearable device Download PDF

Info

Publication number
WO2015102467A1
WO2015102467A1 PCT/KR2015/000101 KR2015000101W WO2015102467A1 WO 2015102467 A1 WO2015102467 A1 WO 2015102467A1 KR 2015000101 W KR2015000101 W KR 2015000101W WO 2015102467 A1 WO2015102467 A1 WO 2015102467A1
Authority
WO
WIPO (PCT)
Prior art keywords
home
wearable device
terminal
control signal
user
Prior art date
Application number
PCT/KR2015/000101
Other languages
French (fr)
Korean (ko)
Inventor
구본현
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020140151603A external-priority patent/KR102277752B1/en
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority to US15/109,357 priority Critical patent/US10019068B2/en
Priority to CN201580003834.0A priority patent/CN105900376B/en
Priority to EP15733100.0A priority patent/EP3094045B1/en
Publication of WO2015102467A1 publication Critical patent/WO2015102467A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038Indexing scheme relating to G06F3/038
    • G06F2203/0383Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00Transmission systems of control signals via wireless link
    • G08C2201/30User interface
    • G08C2201/32Remote control based on movements, attitude of remote control device
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00Transmission systems of control signals via wireless link
    • G08C2201/90Additional features
    • G08C2201/93Remote control using other portable devices, e.g. mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L2012/2847Home automation networks characterised by the type of home appliance used
    • H04L2012/285Generic home appliances, e.g. refrigerators
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Definitions

  • the present invention relates to an apparatus and method for controlling a home device using a wearable device.
  • the home network system refers to a system that enables communication between home devices by connecting home devices installed in a home to a wired or wireless network.
  • An advanced home network system integrates home devices through a home gateway (HGW or H-GW) to connect the Internet to an external public data network, such as an Internet Protocol (IP) network (ie, the Internet).
  • IP Internet Protocol
  • home devices may be controlled according to a user's request to provide various services desired by the user.
  • Control technology for legacy home appliances eg, home devices
  • a terminal such as a smartphone in a wireless environment
  • user input to the terminal is required.
  • the present invention provides a home device control apparatus and a control method using a wearable device.
  • the present invention provides an apparatus and method for controlling a home device through a voice and a touch of a user using a wearable device.
  • the present invention provides a device and a method for controlling a home device in and outside a home using a wearable device.
  • the terminal for controlling a home device using a wearable device wearable on a user's body, the receiving unit for receiving a control signal generated based on the movement of the wearable device from the wearable device ; Determine a sensor value of a corresponding position based on the control signal, determine a probability value based on the sensor value, compare the probability value with a threshold value, and perform a control command to control a home device according to a comparison result It includes a control unit for determining whether or not.
  • a control signal generated based on a movement of the wearable device from the wearable device Receiving a process; Determining a sensor value based on the control signal; Determining a probability value based on the sensor value; And comparing the probability value with the threshold value and determining whether to perform a control command for controlling the home device according to the comparison result.
  • a wearable device includes a wearable device that can be worn on a user's body, the wearable device comprising: a motion sensor configured to recognize a movement of the wearable device; And a control unit generating a control signal according to the motion detected by the motion detection sensor and transmitting the control signal to the terminal.
  • a wearable device control method includes the steps of: controlling a home device in a wearable device wearable on a user's body, including: recognizing a movement of the wearable device; Generating a control signal according to the movement; And transmitting the control signal to the terminal.
  • the present invention can control a home device using a wearable device.
  • the present invention can control the home device through the voice input of the wearable device.
  • the present invention can control the indoor and outdoor home devices through the wearable device.
  • the present invention can control the indoor and outdoor home devices through the user touch interface of the wearable device.
  • the present invention enables the control of indoor and outdoor home devices through a wearable device that recognizes a snap.
  • FIG. 1 is a simplified structural diagram of a system for home device control according to an embodiment of the present invention
  • FIG. 2 is a detailed structural diagram of a system for home device control according to an exemplary embodiment of the present invention
  • FIG. 3 is a user interface for controlling a home device in a wearable device according to an embodiment of the present invention
  • FIG. 4 is a flowchart illustrating a method of controlling a home device in a wearable device according to a second embodiment of the present disclosure
  • FIG. 5 is a flowchart illustrating an operation procedure of a mode-based user touch interface method according to a first embodiment of the present invention
  • FIG. 11 is a scenario illustrating a gesture recognition based home device control method according to a third embodiment of the present invention.
  • FIG. 13 is a graph showing acceleration and change values of X, Y, and Z axis sensors of the gyro sensor
  • FIG. 14 is a diagram illustrating a method for calculating an outlier value according to an embodiment of the present invention.
  • 15 is a diagram illustrating a method for calculating an outlier value table according to an embodiment of the present invention.
  • FIG. 16 is a flowchart illustrating an entire process of processing whether a gesture pattern is matched and whether a control command is transmitted through a Bayesian probability calculation algorithm according to an embodiment of the present invention.
  • the home device to be described below may be described in combination with the device.
  • FIG. 1 is a simplified structural diagram of a system for controlling a home device according to an exemplary embodiment of the present invention.
  • a system for controlling a home device includes a terminal 100, a wrist watch type wearable device (hereinafter referred to as “wearable device” 110), and a legacy home appliance (eg, a home appliance 120).
  • a legacy home appliance eg, a home appliance 120
  • Home device 124
  • home gateway 122 of premises 120 authentication server / device management server, and remote routing management server 130, etc.
  • Home devices ( 124 is located in the home (or outside) and includes a smart appliance (Security), security devices, lighting devices (Lighting devices), energy devices (Energy devices).
  • the smart home appliance may be a smart TV, an Internet TV, a general TV, a refrigerator, a washing machine, or a robot cleaner.
  • the security device may be a door lock, a security camera, a security sensor, and the like
  • the lighting device may be a light emitting diode (LED) lighting device
  • the energy device may be a power meter, a power socket, an electrical outlet, a power strip, or the like.
  • the home devices may be, for example, personal computers (PCs), IP cameras, Internet phones, wired / wireless phones, mobile phones in the home, and the like.
  • the home devices 124 may communicate with the home gateway 122 according to a wired or wireless communication method, receive a control command from the home gateway 122, and transmit the requested information corresponding to the control command to the home gateway 122. It may be configured to be able to transmit to).
  • the home gateway 122 includes corresponding communication modules for communicating with the home devices 124 according to a wired or wireless communication scheme.
  • the home gateway 122 may register and back up the information of the home devices 124, control the operation and state of the home devices 124, and collect and manage necessary information from the home devices 124. have.
  • the home gateway 122 may be connected to a data network such as the Internet, that is, an IP network, to allow access by another terminal through the Internet, and to transmit a control signal received from the terminal to a corresponding home device.
  • home entertainment services such as Internet TV (IPTV), Smart TV, Video on Demand (VoD) through the Internet, data sharing, Internet telephony (eg, Voice over IP: VoIP)
  • home automation services such as home data communication services such as video telephony, remote control of home appliances, remote meter reading, crime prevention, and disaster prevention. That is, the home network system connects and controls all types of home devices used in the home / outside home as one network.
  • a user may remotely access each home device through a home gateway and a home gateway provided in a home network system using a wireless communication device such as a terminal from the outside.
  • the terminal may be, for example, a personal digital assistant (PDA) having a communication function, a smart phone, a mobile phone, a tablet computer, a laptop, and the like. You can access network systems.
  • PDA personal digital assistant
  • Wearable device 110 means a device that can be worn by the user, one or two are required.
  • the wearable device 110 may mean, for example, a wrist watch type phone, a wrist watch type device, or a health bracelet, but is not limited thereto.
  • the wearable device 110 includes, for example, a Samsung Galaxy Gear, a fit, and the like.
  • the de facto ZigBee based on the Home Automation Profile can be adopted between the home device and the gateway.
  • the wearable device 110 and the terminal 100 are connected using a Bluetooth (BLE) based protocol (eg, Samsung Accessary Protocol).
  • BLE Bluetooth
  • the terminal 100 is connected to the server 130, through which the home gateway 122 of the home 120 or the home devices 124 can be directly controlled.
  • the wearable device 110 detects a user's motion and generates a control signal according to the detected motion.
  • the movement includes at least one of a snap, a gesture pattern and a rotation.
  • the control signal refers to a signal for controlling the home device through the wearable device 110 and the terminal 100 or directly controlling the wearable device 110 and the home device.
  • the control signal may be generated in various forms according to the communication method between the wearable device 100 and the terminal.
  • the communication method between the wearable device 100 and the terminal may include, for example, Zigbee, Wi-Fi, Bluetooth, Near-Field Communication (NFC), 2G (Generation) or 3G cellular communication system, 3GPP (3rd Generation Partnership Project), Long Term Evoloution (LTE), World Interoperability for Microwave Access (WiMAX), and the like.
  • the home devices 124 are connected to the home gateway 122 by wired or wireless communication.
  • the home gateway 122 may connect to a wired network such as the Internet.
  • the registered terminal 100 may access a wireless network including a radio access network and an operator core network, and may access the home gateway 122 through a wired network.
  • the wireless network may be a 2G (Generation) or 3G cellular communication system, a 3rd Generation Partnership Project (3GPP), a 4G communication system, a long-term evolution (LTE), a world interoperability for microwave access (WiMAX), or the like.
  • the terminal 100 may access the home gateway 122 through the server 130.
  • the server 130 provides an authentication number to the home gateway 122, and stores a manufacturer's unique number of the home gateway.
  • the server 130 manages to communicate when the authentication number of the terminal and the authentication number of the home gateway match.
  • FIG. 2 illustrates a detailed structural diagram of a system for controlling a home device according to an exemplary embodiment of the present invention.
  • the system for controlling a home device includes a home gateway 122 serving as an in-house gateway, a terminal 100 serving as a delegator between a wristwatch-type device and a home gateway, and a wearable having a structure of a wristwatch-type device.
  • Device 122 serving as an in-house gateway, a terminal 100 serving as a delegator between a wristwatch-type device and a home gateway, and a wearable having a structure of a wristwatch-type device.
  • the home device performs a preliminary procedure of connecting to a home network system, for example, the terminal 100 when the home device is initially installed in the home (or outside the home).
  • the terminal 100 provides device information on the newly purchased home device. And obtain and store user information about a peer ID, a peerGroup ID, a countryCode, and the like.
  • the device information (device information) for the home device may be, for example, a unique user identifier (UUID), which is a unique ID of the home device, and other types, names, descriptions, and manufacturers. manufacturer, model ID, serialNumber, salesLocation, and versions.
  • UUID unique user identifier
  • the peerGroup ID indicates a group of home devices registered to the service server using a specific user account
  • the countryCode indicates country information where the user of the terminal 100 is located.
  • the terminal 100 is a device used by a user for checking a state of a home device or controlling the home device.
  • the terminal 100 may be a mobile terminal such as a smart phone or a tablet PC.
  • the home device 150 is located in the home (or outside the home) and is a device that can be controlled through the control device 160, and includes a home device (Smart Appliance), security devices, lighting devices, Energy devices and the like.
  • the home device may be a TV, an air conditioner, a refrigerator, a washing machine, a robot cleaner, a humidifier, and the like.
  • the security device may be a door lock, a security camera, a closed circuit television (CCTV), a security sensor, and the lighting fixture is an LED. (Light Emitting Diode), a lamp, etc.
  • the energy equipment may be a heating device, a power meter, a power socket, an electrical outlet, a power strip, and the like.
  • the home device 150 may include a personal computer (PC), an IP camera, an internet phone, a wired / wireless phone, an electrically controllable curtain, a blind, and the like.
  • the user may access the service server using an application running on the terminal 100, for example, a smart home app, register the home device information, or circulate or delete the registered home device information.
  • an application running on the terminal 100 for example, a smart home app
  • register the home device information or circulate or delete the registered home device information.
  • control information for the collective control of the home devices can be registered or the registered control information can be circulated or deleted.
  • FIG. 3 illustrates a user interface for controlling a home device in a wearable device according to an exemplary embodiment of the present invention.
  • the controllable home device list is loaded on the initial entry screen of the wearable device 110.
  • the home device list of FIG. 3 includes, for example, an LED on / off control 310, a door lock on / off control 320, a plug on / off control 330, a temperature control 340, and the like.
  • the user interface for controlling the home device it is possible to check the on / off status of each home device.
  • the on / off state is toggled.
  • the detailed control user interface of the corresponding device can be loaded to control temperature settings.
  • a mode-based user touch interface method is supported.
  • the wearable device 110 may control all or some "ON" states of currently connected (controllable) home devices.
  • the wearable device 110 may control all or some of the home devices to an "OFF" state.
  • a user's voice input may be received and executed as shown in FIG. 3B for executing the corresponding mode, and the execution result of the corresponding mode is the same as the user touch interface method.
  • FIG. 4 is a flowchart illustrating a method of controlling a home device in a wearable device according to a second embodiment of the present invention.
  • the wearable device 110 receives a user voice in step 401.
  • the wearable device 110 converts the user voice received in step 403 into streaming data and transmits the converted streaming data to the terminal 100.
  • the terminal 100 transmits an analysis request message of streaming data to the speech recognition analysis server 140.
  • the speech recognition analysis server 140 analyzes / interprets the streaming data and transmits the analysis result of the streaming data to the terminal 100 in step 407.
  • the terminal 100 generates a control command message corresponding to the analysis result. For example, if the analysis result is the return mode, the terminal 100 generates a control command message including the return mode. For example, if the analysis result is the outing mode, the terminal 100 generates a control command message including the outing mode.
  • the terminal 100 transmits the control command message generated in step 411 to the server 130.
  • the server 130 receives the control command message, the server 130 performs an authentication procedure and then transmits the control command message to the home device through the home gateway in step 413. Then, the home device executes ON / OFF in accordance with the control command message.
  • FIG. 5 is a flowchart illustrating an operation procedure of a mode-based user touch interface method according to a first embodiment of the present invention.
  • the wearable device transmits a CSRequestGetDeviceStatusList message to the terminal in step 501.
  • FIG. 6 illustrates a format of a CSRequestGetDeviceStatusList message according to an embodiment of the present invention.
  • the CSRequestGetDeviceStatusList message is a device list response request message and is a message transmitted from the wearable device to the terminal.
  • the device list response request message includes home device IDs such as LEDs, door locks, smart plugs, and thermostats, and home device IDs of LEDs, door locks, smart plugs, and thermostats are displayed on the user interface.
  • the terminal transmits a ParserCSResponseGetDeviceStatusList message to the wearable device.
  • the CSRequestGetDeviceStatusList message and the ParserCSResponseGetDeviceStatusList message correspond to controllable device list request messages to the terminal and response messages to the request messages, respectively.
  • the wearable device transmits a CSRequestPowerControl message to the terminal in step 505.
  • the CSRequestPowerControl message includes power on / off and thermostat settings for individual control of the home device.
  • Power On / Off transmits the ID and power status of the home device to be controlled. As shown in FIG. 7 in the user interface, the ID and power status of the home device to be controlled are displayed.
  • the thermostat setting not only conveys the ID and power state of the home device to be controlled, but also sets the device power state to, for example, "detailed power control" because detailed power control is required.
  • the user interface displays not only the ID and power state of the home device to be controlled, but also that the device power state is set to "detailed power control (e.g., 76 degrees control)".
  • step 507 the terminal transmits a ParserCSResponseGetDeviceStatusList message to the wearable device.
  • 8 illustrates a ParserCSResponseGetDeviceStatusList message format according to an embodiment of the present invention.
  • the ParserCSResponseGetDeviceStatusList message executes the CSRequestGetDeviceStatusList message or the CSRequestPowerControl message, and then informs the wearable device of the status of the connected home device.
  • CMD_ID CMD_VALUE_SEND_DEVICE_STATUS is 3, as shown in FIG. 8, the LED is powered off, the door lock is powered off, the smart plug is powered off, and the thermostat is in a detailed power control state (e.g., To the wearable device).
  • the CSRequestPowerControl message and the ParserCSResponseGetDeviceStatusList message represent control command (eg ON / OFF, etc.) and status response messages for a specific device.
  • step 509 the terminal transmits a ParserCSNotificationMotionEventDetected message to the wearable device.
  • the terminal transmits a still cut (stop cut) of the IP camera to the wearable device.
  • the wearable device transmits a CSRequestPowerControl-IP Cam Power on message to the terminal in step 511.
  • FIG. 10 illustrates a format of a CSRequestPowerControl-IP Cam Power on message according to an embodiment of the present invention.
  • the wearable device After confirming the still cut, the wearable device requests the terminal to monitor the IP camera. Upon request, the terminal performs IP camera streaming.
  • the ParserCSNotificationMotionEventDetected message and the CSRequestPowerControl-IP Cam Power on message indicate an alerting message such as a popup when responding to status information of a specific device.
  • FIG. 11 is a scenario illustrating a gesture recognition based home device control method according to a third embodiment of the present invention.
  • the third embodiment of the present invention proposes a method of controlling a home device by using a gesture such as a wrist snap using a wearable device.
  • the home device can be controlled using a plurality of wearable devices. That is, in the third embodiment of the present invention, for example, it is possible to receive sensor information by using a wearable device worn on the left wrist and the right wrist.
  • FIGS. 11 (a) and 11 (b) show a case where two wearable devices are used
  • FIGS. 11 (c) and 11 (d) show a case where one wearable device is used.
  • Fig. 11A shows a case of mode selection, in which snap operation is performed with both hands.
  • the snap action refers to an action of quickly or moving a hand by clicking, snapping, or clicking.
  • the mode selection may be a mode switching through shaking of both hands when selecting two modes, such as a control mode for controlling a home device and a slide mode for controlling page of a slide.
  • FIG. 11B illustrates dimming control, for example, and performs rotation with both hands.
  • the rotating gesture can control the level of diving. Adjusting the dimming level here means adjusting the light intensity.
  • FIG. 11C illustrates a case in which a specific home device is selected among home devices.
  • FIG. 11C may be used when a specific device is selected in the control mode described above, and the selection of a target device to be controlled may be changed by snapping the left wrist.
  • the selection of each home device may be sequentially changed in the order of LED ⁇ Fan ⁇ TV through repetition of snaps.
  • Fig. 11D shows a case of device control, for example, taking a snap operation with only the left hand.
  • the device control represents, for example, on / off of the LED lamp, on / off of the door lock, on / off of the smart plug, thermostat control, and the like.
  • the dipping (brightness) of the LED may be adjusted using rotation axis values such as X and Y axes of a wrist worn by the wearable device in addition to snaps.
  • Fig. 11D shows a snap operation with only the right hand.
  • FIG. 12 is a system structural diagram according to an embodiment of the present invention.
  • a system for controlling a gesture-based home device may include at least one home device (hereinafter referred to as a "home device") 1200, a home gateway 1220, a terminal 1240, and a wearable device ( 1260).
  • a home device hereinafter referred to as a "home device”
  • a home gateway 1220 may include at least one home device 1200, a home gateway 1220, a terminal 1240, and a wearable device ( 1260).
  • the communication methods between the home device 1200, the home gateway 1220, the terminal 1240, and the wearable device 1260 are described as 802.15.4, 802.11b / g / n, and 802.15.1, respectively. It is not limited, Various communication methods can be applied.
  • the wearable device 1260 generates a control signal based on a gesture pattern action, a snap, and a rotation of the user, and transmits the generated control signal to the terminal 1240.
  • the terminal 1240 receives a control signal from the wearable device 1260, determines whether to execute the control command based on a predetermined threshold value, and transmits the corresponding control command to the home gateway 1220.
  • the terminal 1240 transmits a control command to the home device when the probability value is greater than or equal to the threshold value and does not perform the control command when the probability value is less than the threshold value.
  • the home gateway 1220 receives a control command from the terminal 1240, and finally, converts to a network protocol recognized by the home device and transmits a control command for controlling the home device.
  • the home device 1200 receives the control command and processes and executes it.
  • the terminal determines whether to specify a threshold value based on the pattern of the gesture, as shown in FIG. 13, using a probability pattern analysis method based on an algorithm for recognizing a gesture, for example, a Bayesian estimation algorithm.
  • FIG. 13 (a) shows a normal gesture pattern
  • FIG. 13 (b) shows acceleration and change values of the X, Y, and Z axis sensors of the gyro sensor.
  • an occurrence probability (value) for an event may be estimated based on a previous distribution according to an existing event or an event that does not occur.
  • Friedman's technique is known to be well utilized for infinite events.
  • Profile the previous internode routing frequency and calculate how likely the current node will be when the routing connection request compares to the previous profile. Through this calculation, any request from a probabilistic low node is considered an abnormal request.
  • the sensor change value may be classified into S T1 , S T2 , and S T3 according to time.
  • the values corresponding to the three fields are extracted and based on this, such as S T1 (A), S T2 (B), and S T3 (C), ABC, ABD, EFH,...
  • the back is defined as a sample value, and the ideal value is calculated by measuring the frequency.
  • the process of calculating the outliers is as follows.
  • Equation 1 C (D, L) is calculated as in Equation 1 below.
  • C (D, L) represents the scaling factor (ie the number of all observable samples).
  • P represents the probability value of the standard to be observed.
  • N represents the total number of observation samples (number of occurrences of sensor values of AB).
  • K represents the number of different kinds of events observed (number of AB frequencies in previous training).
  • Alpha ⁇ represents a user defined value.
  • L represents the total number of observed samples (number of nodes that can occur).
  • X represents the sample to be observed (sensor value-ABC).
  • Ni represents the frequency of occurrence of a specific event (the frequency of sensor value occurrences from AB ⁇ C).
  • Equation 1 the P value may be expressed by Equation 2.
  • FIG. 14 is a diagram illustrating an abnormal value calculation method according to an exemplary embodiment of the present invention.
  • a method of calculating an ideal value according to an embodiment of the present invention is as follows. For example, on the sensor data generation graph as shown in FIG. 14, the sensor generation value (or sensor value) A may be displayed as the following sensor generation value graph.
  • the sensor value of each sample may be, for example, A-B-C, A-E-F, A-B-D, A-B-C, as shown in FIG.
  • 15 is a diagram illustrating a method of calculating an abnormal value table according to an embodiment of the present invention.
  • the probability of generating a C (S T3 ) sensor value after generating P (ABC) abnormal values is calculated as follows. After dividing the structure of ABC using 2-gram, P value is calculated through Equation 2. The calculated P value is compared with an abnormal value (for example, a threshold value) on an existing profile, and if it is out of the threshold range, it is determined as abnormal.
  • an abnormal value for example, a threshold value
  • 16 is a flowchart illustrating an entire process of processing whether a gesture pattern matches and whether a control command is transmitted through a Bayesian probability calculation algorithm according to an embodiment of the present invention.
  • the terminal receives sensor information in step 1600.
  • the sensor information is received from the wearable device using a snap using a wrist of the user.
  • the terminal extracts three fields S T1 , S T2 , and S T3 from the sensor information.
  • step 1604 the terminal compares whether a session exists on the profile. Step 1604 can be omitted. If step 1604 is omitted, the terminal calculates a probability value and then proceeds to step 1610.
  • step 1608 the terminal proceeds to step 1608 to calculate a probability value to occur, and proceeds to step 1610.
  • step 1606 the terminal proceeds to step 1606 to update the probability value, and compares the updated probability value with the threshold value in step 1608.
  • step 1610 the terminal checks whether the command is performed or the user interface is performed as a result of the comparison. If it is determined that the command execution / user interface execution (if the probability value is greater than the threshold value), the control command is transmitted in step 1614. However, if it is determined that the command execution / user interface is not performed (if the probability value is less than the threshold value), the terminal does not perform the generation data of the corresponding gesture pattern in step 1616.
  • the apparatus and control method for a home device using a wearable device may be realized in the form of hardware, software, or a combination of hardware and software.
  • Any such software may be, for example, volatile or nonvolatile storage, such as a storage device such as a ROM, whether or not removable or rewritable, or a memory such as, for example, a RAM, a memory chip, a device or an integrated circuit.
  • a storage medium that is optically or magnetically recordable and simultaneously readable by a machine (eg computer).
  • the method for controlling a home device using a wearable device may be implemented by a computer or a terminal including a controller and a memory, and the memory includes a program or instructions including implementing the embodiments of the present invention. It will be appreciated that this is an example of a machine-readable storage medium suitable for storing programs.
  • the present invention includes a program comprising code for implementing the apparatus or method described in any claim herein and a storage medium readable by a machine (such as a computer) storing such a program.
  • a program may be transferred electronically through any medium, such as a communication signal transmitted via a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.
  • the home device control apparatus using the wearable device may receive and store the program from a program providing apparatus connected by wire or wirelessly.
  • the program providing apparatus includes a memory for storing a program, instructions for causing the program processing apparatus to perform a home device control method using a preset wearable device, information necessary for a home device control method using a wearable device, and the like. It may include a communication unit for performing wired or wireless communication with a graphics processing apparatus, and a control unit for automatically transmitting a request or a corresponding program to the transmission and reception apparatus of the graphics processing apparatus.

Abstract

The present invention proposes a method for controlling a home device. More specifically, the present invention proposes a method of utilizing a user interface, a method of utilizing a voice, and a method of utilizing a gesture such as a wrist snap utilizing a wearable device.

Description

웨어러블 기기를 이용한 홈 디바이스 제어 장치 및 제어 방법Apparatus and method for controlling home device using wearable device
본 발명은 웨어러블 기기를 이용한 홈 디바이스 제어 장치 및 제어 방법에 관한 것이다.The present invention relates to an apparatus and method for controlling a home device using a wearable device.
홈 네트워크 시스템은 댁 내에 설치된 홈 디바이스(device)들을 유선 또는 무선 네트워크로 연결함으로써, 홈 디바이스들 간의 통신을 가능하도록 하는 시스템을 의미한다. 발전된 홈 네트워크 시스템은 홈 디바이스들을 홈 게이트웨이(Home Gateway: HGW 혹은 H-GW)를 통해 통합하여 외부의 공용 데이터 네트워크, 일 예로 인터넷 프로토콜(Internet Protocol: IP) 네트워크(즉, 인터넷)로 연결함으로써 인터넷과 연계된 보다 다양한 서비스를 제공한다. 이러한 홈 네트워크 시스템에서는 사용자의 요구에 따라 홈 디바이스들을 제어하여 사용자가 원하는 다양한 서비스를 제공할 수 있다.The home network system refers to a system that enables communication between home devices by connecting home devices installed in a home to a wired or wireless network. An advanced home network system integrates home devices through a home gateway (HGW or H-GW) to connect the Internet to an external public data network, such as an Internet Protocol (IP) network (ie, the Internet). Provide more diverse services linked to In such a home network system, home devices may be controlled according to a user's request to provide various services desired by the user.
무선 환경에서 스마트폰과 같은 단말을 활용한 레거시(Legacy) 가전 기기(예컨대, 홈 디바이스)에 대한 제어 기술은 존재하나, 단말에 대한 사용자의 입력이 필수적으로 요구된다.Control technology for legacy home appliances (eg, home devices) using a terminal such as a smartphone in a wireless environment exists, but user input to the terminal is required.
따라서, 단말을 제외한 다른 기기를 이용하여 홈 디바이스를 제어할 수 있는 기술이 요구된다.Therefore, a technique for controlling the home device using other devices except the terminal is required.
본 발명은 웨어러블(Wearable) 장치를 이용한 홈 디바이스 제어 장치 및 제어 방법을 제공한다.The present invention provides a home device control apparatus and a control method using a wearable device.
본 발명은 웨어러블 기기를 이용하여 사용자의 음성 및 터치를 통한 홈 디바이스 제어 장치 및 제어 방법을 제공한다.The present invention provides an apparatus and method for controlling a home device through a voice and a touch of a user using a wearable device.
본 발명은 웨어러블 기기를 이용하여 댁 내부와 외부에서 홈 디바이스 제어 장치 및 제어 방법을 제공한다.The present invention provides a device and a method for controlling a home device in and outside a home using a wearable device.
본 발명의 실시 예에 따른 단말은, 사용자 신체에 착용 가능한 웨어러블 기기를 이용하여 홈 디바이스를 제어하는 단말에 있어서, 상기 웨어러블 기기로부터 상기 웨어러블 기기의 움직임을 기반으로 하여 생성된 제어 신호를 수신하는 수신부; 상기 제어 신호를 기반으로 하여 해당 위치의 센서값을 결정하고, 상기 센서값을 기반으로 하여 확률값을 결정하고, 상기 확률값과 임계값을 비교하고, 비교 결과에 따라서 홈 디바이스를 제어하기 위한 제어 명령 수행 여부를 결정하는 제어부를 포함한다.The terminal according to an embodiment of the present invention, a terminal for controlling a home device using a wearable device wearable on a user's body, the receiving unit for receiving a control signal generated based on the movement of the wearable device from the wearable device ; Determine a sensor value of a corresponding position based on the control signal, determine a probability value based on the sensor value, compare the probability value with a threshold value, and perform a control command to control a home device according to a comparison result It includes a control unit for determining whether or not.
본 발명의 실시 예에 따른 단말 제어 방법은, 단말에서 사용자 신체에 착용 가능한 웨어러블 기기를 이용하여 홈 디바이스를 제어하는 방법에 있어서, 상기 웨어러블 기기로부터 상기 웨어러블 기기의 움직임을 기반으로 하여 생성된 제어 신호를 수신하는 과정; 상기 제어 신호를 기반으로 하여 센서값을 결정하는 과정; 상기 센서값을 기반으로 하여 확률값을 결정하는 과정; 및 상기 확률값과 임계값을 비교하고, 비교 결과에 따라서 홈 디바이스를 제어하기 위한 제어 명령 수행 여부를 결정하는 과정을 포함한다.In a method of controlling a terminal according to an embodiment of the present invention, in a method of controlling a home device using a wearable device wearable on a user's body in a terminal, a control signal generated based on a movement of the wearable device from the wearable device Receiving a process; Determining a sensor value based on the control signal; Determining a probability value based on the sensor value; And comparing the probability value with the threshold value and determining whether to perform a control command for controlling the home device according to the comparison result.
본 발명의 실시 예에 따른 웨어러블 기기는 사용자 신체에 착용 가능한 웨어러블 기기에 있어서, 상기 웨어러블 기기의 움직임을 인식하는 움직임 감지 센서; 및 상기 움직임 감지 센서에 의해 감지된 움직임에 따라 제어 신호를 생성하고, 상기 제어 신호를 단말로 전송하는 제어부를 포함한다.A wearable device according to an embodiment of the present invention includes a wearable device that can be worn on a user's body, the wearable device comprising: a motion sensor configured to recognize a movement of the wearable device; And a control unit generating a control signal according to the motion detected by the motion detection sensor and transmitting the control signal to the terminal.
본 발명의 실시 예에 따른 웨어러블 기기 제어 방법은 사용자 신체에 착용 가능한 웨어러블 기기에서 홈 디바이스 제어 방법에 있어서, 상기 웨어러블 기기의 움직임을 인식하는 과정; 상기 움직임에 따라 제어 신호를 생성하는 과정; 및 상기 제어 신호를 단말로 전송하는 과정을 포함한다.A wearable device control method according to an embodiment of the present invention includes the steps of: controlling a home device in a wearable device wearable on a user's body, including: recognizing a movement of the wearable device; Generating a control signal according to the movement; And transmitting the control signal to the terminal.
본 발명은 웨어러블 기기를 이용하여 홈 디바이스를 제어 할 수 있다.The present invention can control a home device using a wearable device.
본 발명은 웨어러블 기기의 음성 입력을 통해 홈 디바이스를 제어 할 수 있다.The present invention can control the home device through the voice input of the wearable device.
본 발명은 웨어러블 기기를 통한 댁내 및 댁외 홈 디바이스의 제어가 가능하다.The present invention can control the indoor and outdoor home devices through the wearable device.
본 발명은 웨어러블 기기의 사용자 터치 인터페이스를 통한 댁내 및 댁외 홈 디바이스의 제어가 가능하다.The present invention can control the indoor and outdoor home devices through the user touch interface of the wearable device.
본 발명은 스냅을 인식한 웨어러블 기기를 통한 댁내 및 댁외 홈 디바이스의 제어가 가능하다.The present invention enables the control of indoor and outdoor home devices through a wearable device that recognizes a snap.
도 1은 본 발명의 실시 예에 따른 홈 디바이스 제어를 위한 시스템의 간략화된 구조도;1 is a simplified structural diagram of a system for home device control according to an embodiment of the present invention;
도 2는 본 발명의 실시 예에 따른 홈 디바이스 제어를 위한 시스템의 구체화된 구조도;2 is a detailed structural diagram of a system for home device control according to an exemplary embodiment of the present invention;
도 3은 본 발명의 실시 예에 따라 웨어러블 기기에서의 홈 디바이스 제어를 위한 사용자 인터페이스;3 is a user interface for controlling a home device in a wearable device according to an embodiment of the present invention;
도 4는 본 발명의 제2 실시 예에 따른 웨어러블 기기에서의 홈 디바이스 제어 방법을 나타낸 흐름도;4 is a flowchart illustrating a method of controlling a home device in a wearable device according to a second embodiment of the present disclosure;
도 5는 본 발명의 제1 실시 예에 따른 모드 기반 사용자 터치 인터페이스 방식의 동작 절차를 도시한 흐름도;5 is a flowchart illustrating an operation procedure of a mode-based user touch interface method according to a first embodiment of the present invention;
도 6은 본 발명의 실시 예에 따른 CSRequestGetDeviceStatusList 메시지 포맷;6 is a format of a CSRequestGetDeviceStatusList message according to an embodiment of the present invention;
도 7은 CSRequestPowerControl 메시지 포맷;7 is a CSRequestPowerControl message format;
도 8은 본 발명의 실시 예에 따른 ParserCSResponseGetDeviceStatusList 메시지 포맷;8 is a ParserCSResponseGetDeviceStatusList message format according to an embodiment of the present invention;
도 9는 본 발명의 실시 예에 따른 ParserCSNotificationMotionEventDetected 메시지 포맷;9 is a ParserCSNotificationMotionEventDetected message format according to an embodiment of the present invention;
도 10은 본 발명의 실시 예에 따른 CSRequestPowerControl-IP Cam Power on 메시지 포맷;10 is a format of a CSRequestPowerControl-IP Cam Power on message according to an embodiment of the present invention;
도 11은 본 발명의 제3 실시 예에 따른 제스쳐 인식 기반의 홈 디바이스 제어 방법을 나타낸 시나리오;11 is a scenario illustrating a gesture recognition based home device control method according to a third embodiment of the present invention;
도 12는 본 발명의 실시 예에 따른 시스템 구조도;12 is a system structural diagram according to an embodiment of the present invention;
도 13은 가속도 및 자이로 센서의 X, Y, Z 축 센서의 변화값을 나타내는 도면;FIG. 13 is a graph showing acceleration and change values of X, Y, and Z axis sensors of the gyro sensor; FIG.
도 14는 본 발명의 실시 예에 따른 이상 값 계산 방법을 도시한 도면;14 is a diagram illustrating a method for calculating an outlier value according to an embodiment of the present invention;
도 15는 본 발명의 실시 예에 따른 이상 값 테이블 계산 방법을 도시한 도면; 및15 is a diagram illustrating a method for calculating an outlier value table according to an embodiment of the present invention; And
도 16은 본 발명의 실시 예에 따라 베이지언(Bayesian) 방식의 확률값 계산 알고리즘을 통해, 제스쳐 패턴의 일치 여부 및 제어 커맨드의 전송 여부를 처리하는 전체 과정을 도시한 흐름도.FIG. 16 is a flowchart illustrating an entire process of processing whether a gesture pattern is matched and whether a control command is transmitted through a Bayesian probability calculation algorithm according to an embodiment of the present invention.
이하, 첨부된 도면을 참조하여 본 발명의 바람직한 실시 예들을 상세히 설명한다. 이때 첨부된 도면에서 동일한 구성 요소는 가능한 동일한 부호로 나타내고 있음에 유의하여야 한다. 또한 본 발명의 요지를 흐리게 할 수 있는 공지 기능 및 구성에 대한 상세한 설명은 생략할 것이다.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this case, it should be noted that like elements are denoted by like reference numerals as much as possible. In addition, detailed descriptions of well-known functions and configurations that may blur the gist of the present invention will be omitted.
또한 이하에서 설명되는 본 명세서 및 청구범위에 사용된 용어나 단어는 통상적이거나 사전적인 의미로 한정해서 해석되어서는 아니 되며, 발명자는 그 자신의 발명을 가장 최선의 방법으로 설명하기 위해 용어의 개념으로 적절하게 정의할 수 있다는 원칙에 입각하여 본 발명의 기술적 사상에 부합하는 의미와 개념으로 해석되어야만 한다.Also, the terms or words used in the specification and claims described below should not be construed as being limited to the ordinary or dictionary meanings, and the inventors should use the concept of terms to explain their own invention in the best way. It should be interpreted as meanings and concepts corresponding to the technical idea of the present invention based on the principle that it can be properly defined.
이하에서 기재될 홈 디바이스는 디바이스와 혼용하여 기재할 수 있다.The home device to be described below may be described in combination with the device.
도 1은 본 발명의 실시 예에 따른 홈 디바이스 제어를 위한 시스템의 간략화된 구조도를 도시한 것이다.1 is a simplified structural diagram of a system for controlling a home device according to an exemplary embodiment of the present invention.
도 1을 참조하면, 홈 디바이스 제어를 위한 시스템은 단말(100), 손목 시계형 웨어러블(Wearable) 기기(이하, "웨어러블 기기)(110), 댁내(120)의 레거시(Legacy) 가전 기기(예컨대, 홈 디바이스)(124), 댁내(120)의 홈 게이트웨이(122), 인증 서버/기기 관리 서버 및 원격 라우팅 관리 서버(이하 "서버"이라 칭함)(130) 등을 포함한다. 홈 디바이스들(124)은 집 안(혹은 외부)에 위치하며 스마트 가전기기(Smart Appliance), 보안기기, 조명기구(Lighting devices), 에너지기기(Energy devices) 등을 포함한다.Referring to FIG. 1, a system for controlling a home device includes a terminal 100, a wrist watch type wearable device (hereinafter referred to as “wearable device” 110), and a legacy home appliance (eg, a home appliance 120). , Home device) 124, home gateway 122 of premises 120, authentication server / device management server, and remote routing management server (hereinafter referred to as "server") 130, etc. Home devices ( 124 is located in the home (or outside) and includes a smart appliance (Security), security devices, lighting devices (Lighting devices), energy devices (Energy devices).
일 예로 스마트 가전기기는 스마트 TV, 인터넷 TV, 일반 TV, 냉장고, 세탁기, 로봇청소기 등이 될 수 있다. 일 예로, 보안기기는 도어락, 보안 카메라, 보안 센서 등이 될 수 있고, 조명기구는 LED(Light Emitting Diode) 조명기구 등이 될 수 있고, 에너지기기는 전력측정기, 전력 소켓, 전기 콘센트, 멀티탭 등이 될 수 있다. 추가적으로 홈 디바이스들은 일 예로, 개인 컴퓨터(Personal Computer: PC), IP 카메라, 인터넷 전화, 유/무선 전화, 가정 내의 이동 전화 등이 될 수 있다.For example, the smart home appliance may be a smart TV, an Internet TV, a general TV, a refrigerator, a washing machine, or a robot cleaner. For example, the security device may be a door lock, a security camera, a security sensor, and the like, the lighting device may be a light emitting diode (LED) lighting device, and the energy device may be a power meter, a power socket, an electrical outlet, a power strip, or the like. This can be Additionally, the home devices may be, for example, personal computers (PCs), IP cameras, Internet phones, wired / wireless phones, mobile phones in the home, and the like.
홈 디바이스들(124)은 유선 혹은 무선 통신 방식에 따라 홈 게이트웨이(122)와 통신 가능하며, 홈 게이트웨이(122)로부터 제어 명령을 수신하고, 상기 제어 명령에 해당하는 요구된 정보를 홈 게이트웨이(122)에게 전송 가능하도록 구성될 수 있다. 홈 게이트웨이(122)는 홈 디바이스들(124)과 유선 혹은 무선 통신 방식에 따라 통신하기 위한 해당 통신 모듈들을 구비한다. 또한 홈 게이트웨이(122)는 홈 디바이스들(124)의 정보를 등록하여 백업하고, 홈 디바이스들(124)의 동작 및 상태를 제어하고, 홈 디바이스들(124)로부터 필요한 정보를 수집하여 관리할 수 있다. 특히, 홈 게이트웨이(122)는 인터넷과 같은 데이터 네트워크, 즉, IP 네트워크와 연결되어, 인터넷을 통해 다른 단말에 의한 접속을 허용하며, 단말로부터 수신되는 제어 신호를 해당하는 홈 디바이스에게 전달할 수 있다.The home devices 124 may communicate with the home gateway 122 according to a wired or wireless communication method, receive a control command from the home gateway 122, and transmit the requested information corresponding to the control command to the home gateway 122. It may be configured to be able to transmit to). The home gateway 122 includes corresponding communication modules for communicating with the home devices 124 according to a wired or wireless communication scheme. In addition, the home gateway 122 may register and back up the information of the home devices 124, control the operation and state of the home devices 124, and collect and manage necessary information from the home devices 124. have. In particular, the home gateway 122 may be connected to a data network such as the Internet, that is, an IP network, to allow access by another terminal through the Internet, and to transmit a control signal received from the terminal to a corresponding home device.
이상과 같이 구성되는 홈 네트워크 시스템에서는 인터넷을 통한 인터넷 TV(IPTV), 스마트 TV, 주문형 비디오(Video on Demand: VoD) 등과 같은 홈 엔터테인먼트 서비스, 데이터 공유, 인터넷 전화(예컨대, Voice over IP: VoIP) 및 영상전화와 같은 홈 데이터 통신 서비스, 가전 기기의 원격제어, 원격 검침, 방범, 방재와 같은 홈 오토메이션 서비스를 제공할 수 있다. 즉, 홈 네트워크 시스템은 가정 내부/외부에서 사용되는 모든 형태의 홈 디바이스들을 하나의 네트워크로 연결하여 통제한다.In the home network system configured as described above, home entertainment services such as Internet TV (IPTV), Smart TV, Video on Demand (VoD) through the Internet, data sharing, Internet telephony (eg, Voice over IP: VoIP) And home automation services such as home data communication services such as video telephony, remote control of home appliances, remote meter reading, crime prevention, and disaster prevention. That is, the home network system connects and controls all types of home devices used in the home / outside home as one network.
한편, 사용자는 외부에서 단말과 같은 무선통신 장비를 이용하여, 홈 네트워크 시스템 내에 구비된 홈 게이트웨이 및 홈 게이트웨이를 통해 각 홈 디바이스에 원격으로 접속할 수 있다. 단말은 일 예로써 통신 기능을 구비하는 개인 정보 단말기(Personal Digital Assistant: PDA), 스마트 폰(Smart Phone), 휴대폰, 태블릿(tablet) 컴퓨터, 노트북 등이 될 수 있으며, 사업자 네트워크와 인터넷을 통해 홈 네트워크 시스템에 접근할 수 있다.Meanwhile, a user may remotely access each home device through a home gateway and a home gateway provided in a home network system using a wireless communication device such as a terminal from the outside. The terminal may be, for example, a personal digital assistant (PDA) having a communication function, a smart phone, a mobile phone, a tablet computer, a laptop, and the like. You can access network systems.
본 발명의 실시 예에 따른 웨어러블 기기(110)는 사용자가 착용할 수 있는 기기를 의미하고, 1개 또는 2개가 필요하다. 웨어러블 기기(110)는 예컨대, 손목 시계 타입의 phone, 손목시계 형태의 기기, 또는 건강팔찌 등을 의미하지만, 이에 한정되지 않고 다양하게 구현될 수 있다. 웨어러블 기기(110)는 예컨대, 삼성전자의 갤럭시 기어(Galaxy Gear) 및 핏(fit) 등을 포함한다. Wearable device 110 according to an embodiment of the present invention means a device that can be worn by the user, one or two are required. The wearable device 110 may mean, for example, a wrist watch type phone, a wrist watch type device, or a health bracelet, but is not limited thereto. The wearable device 110 includes, for example, a Samsung Galaxy Gear, a fit, and the like.
홈 디바이스와 게이트웨이 사이에는 홈 자동 프로파일(Home Automation Profile)을 기반으로 한 de facto ZigBee가 채택될 수 있다. 웨어러블 기기(110)와 단말(100) 사이에는 Bluetooth(BLE) 기반의 프로토콜(예컨대, 삼성 액세서리 프로토콜(Samsung Accessary Protocol))을 이용하여 연결된다. 단말(100)은 서버(130)와 연결되며, 이를 통해 댁 내(120)의 홈 게이트웨이(122)를 통하거나, 혹은 홈 디바이스들(124)에 대해 직접 제어가 가능하게 된다.The de facto ZigBee based on the Home Automation Profile can be adopted between the home device and the gateway. The wearable device 110 and the terminal 100 are connected using a Bluetooth (BLE) based protocol (eg, Samsung Accessary Protocol). The terminal 100 is connected to the server 130, through which the home gateway 122 of the home 120 or the home devices 124 can be directly controlled.
웨어러블 기기(110)는 사용자의 움직임(motion)을 감지하고, 감지된 움직임에 따라 제어 신호를 생성한다. 움직임은 스냅(snap), 제스쳐 패턴, 회전 중 적어도 하나를 포함한다. 제어 신호는 웨어러블 기기(110)와 단말(100)을 통한 홈 디바이스의 제어 또는 웨어러블 기기(110)와 홈 디바이스의 직접 제어하기 위한 신호를 의미한다. 웨어러블 디바이스(100)와 단말간의 통신 방식에 따라 제어 신호는 다양한 형태로 생성될 수 있다. 웨어러블 디바이스(100)와 단말간의 통신 방식은 예컨대, 지그비, 와이파이(Wi-fi), 블루투스, NFC(Near-Field Communication), 2G(Generation) 혹은 3G 셀룰러 통신 시스템, 3GPP(3rd Generation Partnership Project), LTE(Long Term Evoloution), WiMAX(World Interoperability for Microwave Access) 등이 될 수 있다.The wearable device 110 detects a user's motion and generates a control signal according to the detected motion. The movement includes at least one of a snap, a gesture pattern and a rotation. The control signal refers to a signal for controlling the home device through the wearable device 110 and the terminal 100 or directly controlling the wearable device 110 and the home device. The control signal may be generated in various forms according to the communication method between the wearable device 100 and the terminal. The communication method between the wearable device 100 and the terminal may include, for example, Zigbee, Wi-Fi, Bluetooth, Near-Field Communication (NFC), 2G (Generation) or 3G cellular communication system, 3GPP (3rd Generation Partnership Project), Long Term Evoloution (LTE), World Interoperability for Microwave Access (WiMAX), and the like.
홈 디바이스들(124)은 유선 혹은 무선 통신 방식에 의해 홈 게이트웨이(122)에 접속된다. 홈 게이트웨이(122)는 인터넷과 같은 유선 네트워크에 접속할 수 있다. 한편 등록된 단말(100)은 무선 액세스 네트워크 및 사업자 코어 네트워크를 포함하는 무선 네트워크에 접속할 수 있으며, 유선 네트워크를 통해 홈 게이트웨이(122)에 접근할 수 있다. 무선 네트워크는 2G(Generation) 혹은 3G 셀룰러 통신 시스템, 3GPP(3rd Generation Partnership Project), 4G 통신 시스템, LTE(Long-Term Evolution), WiMAX(World Interoperability for Microwave Access) 등이 될 수 있다.The home devices 124 are connected to the home gateway 122 by wired or wireless communication. The home gateway 122 may connect to a wired network such as the Internet. Meanwhile, the registered terminal 100 may access a wireless network including a radio access network and an operator core network, and may access the home gateway 122 through a wired network. The wireless network may be a 2G (Generation) or 3G cellular communication system, a 3rd Generation Partnership Project (3GPP), a 4G communication system, a long-term evolution (LTE), a world interoperability for microwave access (WiMAX), or the like.
도 1에서는 단말(100)이 서버(130)를 통해 홈 게이트웨이(122)에 접근할 수 있다. 서버(130)는 홈 게이트웨이(122)에게 인증 번호를 제공하며, 홈 게이트웨이의 제조사 고유 번호 등을 저장한다. 또한 서버(130)는 단말의 인증 번호와 홈 게이트웨이의 인증번호가 일치할 경우에 통신할 수 있도록 관리한다.In FIG. 1, the terminal 100 may access the home gateway 122 through the server 130. The server 130 provides an authentication number to the home gateway 122, and stores a manufacturer's unique number of the home gateway. In addition, the server 130 manages to communicate when the authentication number of the terminal and the authentication number of the home gateway match.
도 2는 본 발명의 실시 예에 따른 홈 디바이스 제어를 위한 시스템의 구체화된 구조도를 도시한 것이다.2 illustrates a detailed structural diagram of a system for controlling a home device according to an exemplary embodiment of the present invention.
홈 디바이스 제어를 위한 시스템은 댁내 게이트웨이 역할을 수행하는 홈 게이트웨이(HomeSync)(122)와 손목 시계형 기기와 홈 게이트웨이 사이의 Delegator 역할을 수행하는 단말(100), 손목 시계형 기기의 구조를 가진 웨어러블 기기(122)를 포함한다.The system for controlling a home device includes a home gateway 122 serving as an in-house gateway, a terminal 100 serving as a delegator between a wristwatch-type device and a home gateway, and a wearable having a structure of a wristwatch-type device. Device 122.
홈 디바이스는 댁 내(혹은 댁 외)에 최초 설치 시에 홈 네크워크 시스템, 일례로 단말(100)과 연결하는 사전 절차를 수행하며, 이때, 단말(100)는 신규 구매된 홈 디바이스에 대한 디바이스 정보와 피어 아이디(peer ID), 피어 그룹 식별자(peerGroup ID) 및 국가 코드(countryCode) 등에 대한 사용자 정보를 획득하여 저장한다.The home device performs a preliminary procedure of connecting to a home network system, for example, the terminal 100 when the home device is initially installed in the home (or outside the home). In this case, the terminal 100 provides device information on the newly purchased home device. And obtain and store user information about a peer ID, a peerGroup ID, a countryCode, and the like.
상기 홈 디바이스에 대한 기기 정보(디바이스 정보)는 일례로 홈 디바이스의 고유 ID인 고유 사용자 식별자(UUID: unique user identifier)와 그 밖에 타입(type), 이름(name), 디스크립션(description), 제조사(manufacturer), 모델 ID, 시리얼 번호(serialNumber), 판매 지역(salesLocation), 버전(versions) 등을 포함한다. 또한 peerGroup ID는 특정한 사용자 계정을 이용해서 서비스 서버에 등록한 홈 디바이스들의 그룹을 지시하고, countryCode는 단말(100)의 사용자가 위치하는 국가 정보를 지시한다.The device information (device information) for the home device may be, for example, a unique user identifier (UUID), which is a unique ID of the home device, and other types, names, descriptions, and manufacturers. manufacturer, model ID, serialNumber, salesLocation, and versions. In addition, the peerGroup ID indicates a group of home devices registered to the service server using a specific user account, and the countryCode indicates country information where the user of the terminal 100 is located.
단말(100)은 사용자가 홈 디바이스의 상태를 확인하거나 상기 홈 디바이스를 제어하는 목적으로 사용되는 기기이며, 일례로 스마트 폰 등의 이동 단말이나 테블릿 PC 등이 될 수 있다.The terminal 100 is a device used by a user for checking a state of a home device or controlling the home device. For example, the terminal 100 may be a mobile terminal such as a smart phone or a tablet PC.
홈 디바이스(150)는 댁 내(혹은 댁 외)에 위치하며 제어 기기(160)를 통해 제어가 가능한 기기이며, 홈 디바이스(Smart Appliance), 보안기기(security devices), 조명기구(Lighting devices), 에너지기기(Energy devices) 등을 포함한다. 일례로 홈 디바이스는 TV, 에어컨, 냉장고, 세탁기, 로봇청소기, 가습기 등이 될 수 있으며, 보안기기는 도어락, 보안 카메라, CCTV(Closed Circuit Television), 보안 센서 등이 될 수 있고, 조명기구는 LED(Light Emitting Diode), 램프 등이 될 수 있고, 에너지기기는 난방기기, 전력측정기, 전력 소켓, 전기 콘센트, 멀티탭 등이 될 수 있다. 추가적으로 홈 디바이스(150)는 개인 컴퓨터(PC: Personal Computer), IP 카메라, 인터넷 전화, 유/무선 전화, 전기적으로 제어 가능한 커튼, 블라인드 등을 포함할 수 있다.The home device 150 is located in the home (or outside the home) and is a device that can be controlled through the control device 160, and includes a home device (Smart Appliance), security devices, lighting devices, Energy devices and the like. For example, the home device may be a TV, an air conditioner, a refrigerator, a washing machine, a robot cleaner, a humidifier, and the like. The security device may be a door lock, a security camera, a closed circuit television (CCTV), a security sensor, and the lighting fixture is an LED. (Light Emitting Diode), a lamp, etc., the energy equipment may be a heating device, a power meter, a power socket, an electrical outlet, a power strip, and the like. Additionally, the home device 150 may include a personal computer (PC), an IP camera, an internet phone, a wired / wireless phone, an electrically controllable curtain, a blind, and the like.
사용자는 단말(100)에서 실행되는 어플리케이션(Application), 일례로 스마트 홈 앱(Smart Home App) 등을 이용해 서비스 서버에 접속하여 홈 디바이스 정보를 등록하거나 기 등록된 홈 디바이스 정보를 회람 또는 삭제할 수 있으며, 홈 디바이스들의 일괄 제어를 위한 제어 정보를 등록하거나 기 등록된 제어 정보를 회람 또는 삭제할 수 있다.The user may access the service server using an application running on the terminal 100, for example, a smart home app, register the home device information, or circulate or delete the registered home device information. In addition, the control information for the collective control of the home devices can be registered or the registered control information can be circulated or deleted.
도 3은 본 발명의 실시 예에 따라 웨어러블 기기에서의 홈 디바이스 제어를 위한 사용자 인터페이스를 나타낸다.3 illustrates a user interface for controlling a home device in a wearable device according to an exemplary embodiment of the present invention.
웨어러블 기기(110)의 초기 진입화면에는 도 3과 같이, 제어 가능한 홈 디바이스 리스트가 로딩된다. 도 3의 홈 디바이스 리스트는 예컨대, LED On/Off 제어(310), 도어락 On/Off 제어(320), 플러그 On/Off 제어(330), 온도 제어(340) 등을 포함한다. As shown in FIG. 3, the controllable home device list is loaded on the initial entry screen of the wearable device 110. The home device list of FIG. 3 includes, for example, an LED on / off control 310, a door lock on / off control 320, a plug on / off control 330, a temperature control 340, and the like.
홈 디바이스 제어를 위한 사용자 인터페이스를 통해 각 홈 디비이스의 On/Off 등의 상태 확인이 가능하다. 또한, 홈 디바이스 제어를 위한 사용자 인터페이스에 해당 기기를 터치하게 되면, On/Off의 상태가 토글(toggle)된다. 또한 세부 제어가 필요한 서모스탯(Thermostat)의 경우와 같이, 사용자가 해당 기기를 선택하는 경우에는 해당 기기의 세부 제어 사용자 인터페이스를 로드하여 온도 설정 등의 제어가 가능하다.Through the user interface for controlling the home device, it is possible to check the on / off status of each home device. In addition, when the corresponding device is touched by the user interface for controlling the home device, the on / off state is toggled. In addition, as in the case of a thermostat requiring detailed control, when a user selects a corresponding device, the detailed control user interface of the corresponding device can be loaded to control temperature settings.
본 발명의 제1 실시 예에서는 도 3의 (A)와 같이 모드(Mode) 기반 사용자 터치 인터페이스 방식을 지원한다. 본 발명의 실시 예로 "귀가 모드(Comming Home Mode)"을 선택하는 경우, 웨어러블 기기(110)는 현재 연결된(제어 가능한) 홈 디바이스들에 대해 모두 또는 일부 "ON" 상태로 제어할 수 있다. 또한 본 발명의 실시 예로 외출 모드(Away Mode 또는 Going Out Mode)를 선택하는 경우, 웨어러블 기기(110)는 홈 디바이스들을 모두 또는 일부 "OFF" 상태로 제어할 수 있다.In the first embodiment of the present invention, as shown in FIG. 3A, a mode-based user touch interface method is supported. According to an embodiment of the present invention, when selecting the "Comming Home Mode," the wearable device 110 may control all or some "ON" states of currently connected (controllable) home devices. In addition, when an out mode (Away Mode or Going Out Mode) is selected as an embodiment of the present invention, the wearable device 110 may control all or some of the home devices to an "OFF" state.
본 발명의 제2 실시 예에서는 해당 Mode 실행에 대해 도 3의 (B)와 같이 사용자의 음성 입력을 받아 이를 실행할 수 있으며, 해당 Mode에 대한 실행 결과는 상기 사용자 터치 인터페이스 방식과 동일하다. According to the second embodiment of the present invention, a user's voice input may be received and executed as shown in FIG. 3B for executing the corresponding mode, and the execution result of the corresponding mode is the same as the user touch interface method.
도 4는 본 발명의 제2 실시 예에 따른 웨어러블 기기에서의 홈 디바이스 제어 방법을 나타낸 흐름도이다.4 is a flowchart illustrating a method of controlling a home device in a wearable device according to a second embodiment of the present invention.
웨어러블 기기(110)는 401 단계에서 사용자 음성을 수신한다. 웨어러블 기기(110)는 403 단계에서 수신된 사용자 음성을 스트리밍 데이터(Straming data)로 변환하고, 변환된 스트리밍 데이터를 단말(100)로 전송한다. 단말(100)은 405 단계에서 음성 인식 분석 서버(140)으로 스트리밍 데이터의 분석 요청 메시지를 전송한다. 음성 인식 분석 서버(140)는 스트리밍 데이터를 분석/해석하고, 스트리밍 데이터에 대한 분석 결과를 407 단계에서 단말(100)로 전송한다. 단말(100)은 409 단계에서 분석 결과에 해당하는 제어 명령 메시지를 생성한다. 예를 들어, 분석 결과가, 귀가 모드이면, 단말(100)은 귀가 모드를 포함하는 제어 명령 메시지를 생성한다. 예를 들어, 분석 결과가, 외출 모드이면, 단말(100)은 외출 모드를 포함하는 제어 명령 메시지를 생성한다.The wearable device 110 receives a user voice in step 401. The wearable device 110 converts the user voice received in step 403 into streaming data and transmits the converted streaming data to the terminal 100. In step 405, the terminal 100 transmits an analysis request message of streaming data to the speech recognition analysis server 140. The speech recognition analysis server 140 analyzes / interprets the streaming data and transmits the analysis result of the streaming data to the terminal 100 in step 407. In step 409, the terminal 100 generates a control command message corresponding to the analysis result. For example, if the analysis result is the return mode, the terminal 100 generates a control command message including the return mode. For example, if the analysis result is the outing mode, the terminal 100 generates a control command message including the outing mode.
단말(100)은 411 단계에서 생성된 제어 명령 메시지를 서버(130)로 전송한다. 서버(130)은 상기 제어 명령 메시지를 수신하면, 인증 절차를 수행한 후, 413 단계에서 상기 제어 명령 메시지를 홈 게이트웨이를 통해 홈 디비이스로 전송한다. 그러면, 홈 디바이스는 제어 명령 메시지에 따라서 ON/OFF를 실행한다.The terminal 100 transmits the control command message generated in step 411 to the server 130. When the server 130 receives the control command message, the server 130 performs an authentication procedure and then transmits the control command message to the home device through the home gateway in step 413. Then, the home device executes ON / OFF in accordance with the control command message.
도 5는 본 발명의 제1 실시 예에 따른 모드 기반 사용자 터치 인터페이스 방식의 동작 절차를 도시한 흐름도이다.5 is a flowchart illustrating an operation procedure of a mode-based user touch interface method according to a first embodiment of the present invention.
웨어러블 기기는 501 단계에서 단말로 CSRequestGetDeviceStatusList 메시지를 전송한다. The wearable device transmits a CSRequestGetDeviceStatusList message to the terminal in step 501.
도 6은 본 발명의 실시 예에 따른 CSRequestGetDeviceStatusList 메시지 포맷을 나타낸다.6 illustrates a format of a CSRequestGetDeviceStatusList message according to an embodiment of the present invention.
CSRequestGetDeviceStatusList 메시지는 기기 리스트 응답 요청 메시지로, 웨어러블 기기에서 단말로 전송되는 메시지이다. 예컨대, 기기 리스트 응답 요청 메시지는, LED, 도어락, 스마트 플러그, 서모스탯 등의 홈 디바이스 아이디가 포함되며, 사용자 인터페이스상에 LED, 도어락, 스마트 플러그, 서모스탯 등의 홈 디바이스 아이디가 디스플레이된다.The CSRequestGetDeviceStatusList message is a device list response request message and is a message transmitted from the wearable device to the terminal. For example, the device list response request message includes home device IDs such as LEDs, door locks, smart plugs, and thermostats, and home device IDs of LEDs, door locks, smart plugs, and thermostats are displayed on the user interface.
단말은 503 단계에서 ParserCSResponseGetDeviceStatusList 메시지를 웨어러블 기기로 전송한다. CSRequestGetDeviceStatusList 메시지와 ParserCSResponseGetDeviceStatusList 메시지는 단말로의 제어 가능한 기기 리스트 요청 메시지 및 요청 메시지에 대한 응답 메시지 각각에 해당한다.In step 503, the terminal transmits a ParserCSResponseGetDeviceStatusList message to the wearable device. The CSRequestGetDeviceStatusList message and the ParserCSResponseGetDeviceStatusList message correspond to controllable device list request messages to the terminal and response messages to the request messages, respectively.
웨어러블 기기는 505 단계에서 CSRequestPowerControl 메시지를 단말로 전송한다. The wearable device transmits a CSRequestPowerControl message to the terminal in step 505.
도 7은 CSRequestPowerControl 메시지 포맷을 나타낸다.7 illustrates a CSRequestPowerControl message format.
CSRequestPowerControl 메시지는 홈 디바이스를 개별적으로 제어할 수 있도록 Power On/Off와 서모스탯 설정이 포함된다. The CSRequestPowerControl message includes power on / off and thermostat settings for individual control of the home device.
먼저, Power On/Off는 제어할 홈 디바이스의 아이디와 전력 상태를 전달한다. 사용자 인터페이스에 도 7에 나타낸 바와 같이, 제어할 홈 디바이스의 아이디와 전력 상태가 디스플레이된다.First, Power On / Off transmits the ID and power status of the home device to be controlled. As shown in FIG. 7 in the user interface, the ID and power status of the home device to be controlled are displayed.
서모스탯 설정은 제어할 홈 디바이스의 아이디와 전력 상태를 전달할 뿐만 아니라, 세부적인 전력 제어가 필요하기 때문에 디바이스 전력 상태를 예컨대, "세부적인 전력 제어"으로 설정한다. 도 7에 나타낸 바와 같이, 사용자 인터페이스에 제어할 홈 디바이스의 아이디와 전력 상태 뿐만 아니라, 디바이스 전력 상태가 "세부적인 전력 제어(예컨대, 76도로 제어)"으로 설정되어 있는 것이 디스플레이된다.The thermostat setting not only conveys the ID and power state of the home device to be controlled, but also sets the device power state to, for example, "detailed power control" because detailed power control is required. As shown in Fig. 7, the user interface displays not only the ID and power state of the home device to be controlled, but also that the device power state is set to "detailed power control (e.g., 76 degrees control)".
단말은 507 단계에서 ParserCSResponseGetDeviceStatusList 메시지를 웨어러블 기기로 전송한다. 도 8은 본 발명의 실시 예에 따른 ParserCSResponseGetDeviceStatusList 메시지 포맷을 나타낸다.In step 507, the terminal transmits a ParserCSResponseGetDeviceStatusList message to the wearable device. 8 illustrates a ParserCSResponseGetDeviceStatusList message format according to an embodiment of the present invention.
ParserCSResponseGetDeviceStatusList 메시지는 CSRequestGetDeviceStatusList 메시지 또는 CSRequestPowerControl 메시지를 실행한 후, 연결되어 있는 홈 디바이스의 상태를 웨어러블 기기로 알려 준다. The ParserCSResponseGetDeviceStatusList message executes the CSRequestGetDeviceStatusList message or the CSRequestPowerControl message, and then informs the wearable device of the status of the connected home device.
예컨대, CMD_ID=CMD_VALUE_SEND_DEVICE_STATUS가 3일 경우, 도 8에 도시된 바와 같이, LED가 전력 오프 상태이고, 도어락이 전력 오프 상태이고, 스마트 플러그가 전력 오프 상태이고, 서모스탯이 세부적인 전력 제어 상태(예컨대, 76도로 제어)로 되어 있음을 웨어러블 기기로 알려 준다.For example, if CMD_ID = CMD_VALUE_SEND_DEVICE_STATUS is 3, as shown in FIG. 8, the LED is powered off, the door lock is powered off, the smart plug is powered off, and the thermostat is in a detailed power control state (e.g., To the wearable device).
CSRequestPowerControl 메시지와 ParserCSResponseGetDeviceStatusList 메시지는 특정 기기에 대한 제어(ON/OFF 등) 명령 전송 및 상태 응답 메시지를 나타낸다.The CSRequestPowerControl message and the ParserCSResponseGetDeviceStatusList message represent control command (eg ON / OFF, etc.) and status response messages for a specific device.
단말은 509 단계에서 ParserCSNotificationMotionEventDetected 메시지를 웨어러블 기기로 전송한다. In step 509, the terminal transmits a ParserCSNotificationMotionEventDetected message to the wearable device.
도 9는 본 발명의 실시 예에 따른 ParserCSNotificationMotionEventDetected 메시지 포맷을 나타낸다.9 illustrates a ParserCSNotificationMotionEventDetected message format according to an embodiment of the present invention.
도 9를 참조하면, 움직임이 감지되면, 단말은 웨어러블 기기로 IP 카메라의 스틸 컷(정지 컷)을 전송한다.Referring to FIG. 9, when a movement is detected, the terminal transmits a still cut (stop cut) of the IP camera to the wearable device.
웨어러블 기기는 511 단계에서 CSRequestPowerControl-IP Cam Power on 메시지를 단말로 전송한다. The wearable device transmits a CSRequestPowerControl-IP Cam Power on message to the terminal in step 511.
도 10은 본 발명의 실시 예에 따른 CSRequestPowerControl-IP Cam Power on 메시지 포맷을 나타낸다.10 illustrates a format of a CSRequestPowerControl-IP Cam Power on message according to an embodiment of the present invention.
웨어러블 기기는 스틸 컷을 확인 후, 단말로 IP 카메라의 모니터링을 요청한다. 요청 시, 단말에서 IP 카메라 스트리밍을 실행한다. After confirming the still cut, the wearable device requests the terminal to monitor the IP camera. Upon request, the terminal performs IP camera streaming.
ParserCSNotificationMotionEventDetected 메시지와 CSRequestPowerControl-IP Cam Power on 메시지는 특정 기기에 대한 상태 정보 응답 시, 팝업 등의 알람(Alerting) 실행하는 메시지를 나타낸다.The ParserCSNotificationMotionEventDetected message and the CSRequestPowerControl-IP Cam Power on message indicate an alerting message such as a popup when responding to status information of a specific device.
도 11은 본 발명의 제3 실시 예에 따른 제스쳐 인식 기반의 홈 디바이스 제어 방법을 나타낸 시나리오이다.11 is a scenario illustrating a gesture recognition based home device control method according to a third embodiment of the present invention.
본 발명의 제3 실시 예에서는 웨어러블 기기를 활용한 손목 스냅과 같은 제스쳐를 활용하여 홈 디바이스를 제어하는 방법을 제안한다. 이때 복수의 웨어러블 기기를 이용하여 홈 디바이스 제어가 가능하다. 즉, 본 발명의 제3 실시 예에서는 예컨대, 왼쪽 손목과 오른쪽 손목에 착용한 웨어러블 기기를 활용하여 센서 정보의 수신이 가능함 점을 이용한다. The third embodiment of the present invention proposes a method of controlling a home device by using a gesture such as a wrist snap using a wearable device. At this time, the home device can be controlled using a plurality of wearable devices. That is, in the third embodiment of the present invention, for example, it is possible to receive sensor information by using a wearable device worn on the left wrist and the right wrist.
도 11의 (a), (b)는 두 개의 웨어러블 기기를 사용하는 경우이고, 도 11의 (c), (d)는 한 개의 웨어러블 기기를 사용하는 경우를 나타낸다.11 (a) and 11 (b) show a case where two wearable devices are used, and FIGS. 11 (c) and 11 (d) show a case where one wearable device is used.
도 11의 (a)는 모드 선택하는 경우를 나타내는 것으로, 양 손으로 스냅 동작을 취한다. 스냅 동작이란, 손으로 찰칵, 딱까닥, 또는 탁하는 소리를 내며 재빨리 움직이거나 움직이게 하는 동작을 의미한다. 여기서 모드 선택하는 것은 홈 디바이스를 제어하는 제어 모드(controlling mode)와 슬라이드(slide)의 페이지 제어를 하는 슬라이드 모드와 같이, 두 가지 모드를 선택할 때, 양손의 shaking를 통해 모드 스위칭이 가능하다.Fig. 11A shows a case of mode selection, in which snap operation is performed with both hands. The snap action refers to an action of quickly or moving a hand by clicking, snapping, or clicking. Here, the mode selection may be a mode switching through shaking of both hands when selecting two modes, such as a control mode for controlling a home device and a slide mode for controlling page of a slide.
도 11의 (b)는 예컨대, 디밍 제어(dimming control)를 나타낸 것으로, 양손으로 회전(rotation)하는 동작을 취한다. 회전 제스쳐를 통해 디빙 레벨을 제어할 수 있다. 여기서 디밍 레벨을 조절한다는 것은 빛의 세기를 조절한다는 것을 의미한다. FIG. 11B illustrates dimming control, for example, and performs rotation with both hands. The rotating gesture can control the level of diving. Adjusting the dimming level here means adjusting the light intensity.
도 11의 (c)는 홈 디바이스들 중 특정 홈 디바이스를 선택하는 경우를 나타낸 것이다. FIG. 11C illustrates a case in which a specific home device is selected among home devices.
도 11의 (c)는 상기에서 설명한 제어 모드에서 특정 기기를 선택할 때, 사용할 수 있으며, 왼쪽 손목의 스냅을 통해 제어하고자 하는 대상 기기의 선택이 변경 가능하다. 예를 들어, 홈 디바이스의 종류가 LED 전등, 선풍기, TV가 있을 때, 각 홈 디바이스의 선택은 스냅의 반복을 통해 LED→선풍기→TV의 순서로 순차적으로 변경될 수 있다. FIG. 11C may be used when a specific device is selected in the control mode described above, and the selection of a target device to be controlled may be changed by snapping the left wrist. For example, when the type of home device is an LED lamp, a fan, or a TV, the selection of each home device may be sequentially changed in the order of LED → Fan → TV through repetition of snaps.
도 11의 (d)는 디바이스 제어하는 경우를 나타낸 것으로, 예컨대, 왼손만으로 스냅 동작을 취한다. 여기서 디바이스 제어는 예컨대, LED 전등의 On/Off, 도어락의 On/Off, 스마트 플러그의 On/Off, 서모스탯 제어 등을 나타낸다. 도 11의 (d)는 선택된 홈 디바이스가 LED 전등인 경우, 스냅 외에 웨어러블 기기를 착용한 손목의 X, Y 축 등의 회전축 값을 이용하여 LED의 디빙(밝기) 조절이 가능하다.Fig. 11D shows a case of device control, for example, taking a snap operation with only the left hand. Here, the device control represents, for example, on / off of the LED lamp, on / off of the door lock, on / off of the smart plug, thermostat control, and the like. 11 (d), when the selected home device is an LED light, the dipping (brightness) of the LED may be adjusted using rotation axis values such as X and Y axes of a wrist worn by the wearable device in addition to snaps.
도 11의 (d)는 오른손만으로 스냅 동작을 취한다. 대상 홈 디바이스가 선택되어 있는 경우, 스냅을 통해 On/Off의 제어가 가능하며, 슬라이드 모드인 경우 스냅을 통해 다음 슬라이드로의 이동 제어가 가능하다.Fig. 11D shows a snap operation with only the right hand. When the target home device is selected, it is possible to control on / off by snap, and in the slide mode, it is possible to control movement to the next slide by snap.
도 12는 본 발명의 실시 예에 따른 시스템 구조도이다.12 is a system structural diagram according to an embodiment of the present invention.
본 발명의 제3 실시 예에 따른 제스쳐 기반 홈 디바이스 제어를 위한 시스템은 적어도 하나의 홈 디바이스(이하 "홈 디바이스"이라 칭함)(1200), 홈 게이트웨이(1220), 단말(1240), 웨어러블 기기(1260) 등을 포함한다.A system for controlling a gesture-based home device according to a third embodiment of the present invention may include at least one home device (hereinafter referred to as a "home device") 1200, a home gateway 1220, a terminal 1240, and a wearable device ( 1260).
도 12에서 홈 디바이스(1200), 홈 게이트웨이(1220), 단말(1240), 웨어러블 기기(1260) 간 통신 방식을 각각 802.15.4, 802.11b/g/n, 802.15.1 등으로 기재하였지만, 이에 한정되지 않고, 다양한 통신 방식을 적용할 수 있다. In FIG. 12, the communication methods between the home device 1200, the home gateway 1220, the terminal 1240, and the wearable device 1260 are described as 802.15.4, 802.11b / g / n, and 802.15.1, respectively. It is not limited, Various communication methods can be applied.
웨어러블 기기(1260)는 사용자의 제스쳐 패턴 행위, 스냅, 및 회전 등을 기반으로 하여 제어 신호를 생성하고, 상기 생성한 제어 신호를 단말(1240)로 전송한다.The wearable device 1260 generates a control signal based on a gesture pattern action, a snap, and a rotation of the user, and transmits the generated control signal to the terminal 1240.
단말(1240)은 웨어러블 기기(1260)로부터 제어 신호를 수신하고, 정해진 임계값 등을 기반으로 하여 해당 제어 명령의 실행 여부를 판단하여 해당하는 제어 명령을 홈 게이트웨이(1220)로 전송한다.The terminal 1240 receives a control signal from the wearable device 1260, determines whether to execute the control command based on a predetermined threshold value, and transmits the corresponding control command to the home gateway 1220.
단말(1240)은 상기 비교 결과, 확률값이 임계값 이상일 경우, 제어 명령을 홈 디바이스로 전송하고, 상기 확률값이 상기 임계값 미만일 경우, 제어 명령을 수행하지 않는다.As a result of the comparison, the terminal 1240 transmits a control command to the home device when the probability value is greater than or equal to the threshold value and does not perform the control command when the probability value is less than the threshold value.
홈 게이트웨이(1220)는 상기 단말(1240)로부터 제어 명령을 수신하여 최종적으로 홈 디바이스가 인식할 수 있는 네트워크 프로토콜로의 변환 및 홈 디바이스를 제어하는 제어 명령을 전송한다.The home gateway 1220 receives a control command from the terminal 1240, and finally, converts to a network protocol recognized by the home device and transmits a control command for controlling the home device.
상기 홈 디바이스(1200)는 상기 제어 명령을 수신하여 이를 처리 및 실행한다. The home device 1200 receives the control command and processes and executes it.
상기 단말에서 해당 제스쳐의 패턴을 기반으로 하여 임계값의 지정 여부는 도 13과 같이, 제스쳐를 인식하는 알고리즘, 예컨대, 베이지언(Bayesian) 추정 알고리즘을 바탕으로 확률 패턴 분석 방식을 이용한다.The terminal determines whether to specify a threshold value based on the pattern of the gesture, as shown in FIG. 13, using a probability pattern analysis method based on an algorithm for recognizing a gesture, for example, a Bayesian estimation algorithm.
도 13의 (a)는 보통의 제스쳐 패턴을 나타내고, 도 13의 (b)는 가속도 및 자이로 센서의 X, Y, Z 축 센서의 변화값을 나타낸다.FIG. 13 (a) shows a normal gesture pattern, and FIG. 13 (b) shows acceleration and change values of the X, Y, and Z axis sensors of the gyro sensor.
베이지언 추정에서는 기존에 발생한 이벤트 혹은 발생하지 않은 이벤트에 따라서 해당 이벤트에 대해 발생 확률(값)을 이전 분포에 근거하여 추정할 수 있다. 특히, Friedman의 기법은 무한의 이벤트의 경우에도 잘 활용될 수 있다고 알려져 있다. 이전의 노드간 라우팅 빈도를 프로파일링하고, 현재의 노드가 라우팅 연결 요청이 이전의 프로파일과 비교할 때 발생할 확률이 어느 정도 되는지 계산한다. 이 계산을 통해 확률적으로 낮은 노드의 요청이라면 비정상적인 요청으로 판단한다.In Bayesian estimation, an occurrence probability (value) for an event may be estimated based on a previous distribution according to an existing event or an event that does not occur. In particular, Friedman's technique is known to be well utilized for infinite events. Profile the previous internode routing frequency and calculate how likely the current node will be when the routing connection request compares to the previous profile. Through this calculation, any request from a probabilistic low node is considered an abnormal request.
제스쳐 입력을 위한 스냅 행위 시, 발생되는 가속도 센서 데이터의 그래프는 도 13과 같다. 도 12의 (b)와 같이, 센서 변화값을 시간에 따라 ST1, ST2, ST3으로 구분할 수 있다.13 is a graph of acceleration sensor data generated during a snap action for gesture input. As shown in FIG. 12B, the sensor change value may be classified into S T1 , S T2 , and S T3 according to time.
세 필드에 해당하는 값을 추출하여 이를 바탕으로 ST1(A), ST2(B), ST3(C)와 같이, ABC, ABD, EFH,…등을 하나의 표본 값으로 정의하고, 빈도 수를 측정하여 이상 값을 계산한다. 이상 값의 계산 과정은 다음과 같다. The values corresponding to the three fields are extracted and based on this, such as S T1 (A), S T2 (B), and S T3 (C), ABC, ABD, EFH,... The back is defined as a sample value, and the ideal value is calculated by measuring the frequency. The process of calculating the outliers is as follows.
먼저, C(D,L)을 하기 <수학식 1>과 같이 계산한다. First, C (D, L) is calculated as in Equation 1 below.
C(D,L)은 스케일링 펙터(scaling factor)(즉, 관찰 가능한 모든 표본들의 수)를 나타낸다.C (D, L) represents the scaling factor (ie the number of all observable samples).
P는 관찰하고자 하는 표준의 확률값을 나타낸다.P represents the probability value of the standard to be observed.
수학식 1
Figure PCTKR2015000101-appb-M000001
Equation 1
Figure PCTKR2015000101-appb-M000001
Figure PCTKR2015000101-appb-I000001
Figure PCTKR2015000101-appb-I000001
상기 <수학식 1>에서 N은 전체 관찰 표본의 수(AB의 센서 값 발생 빈도 수)를 나타낸다.In Equation 1, N represents the total number of observation samples (number of occurrences of sensor values of AB).
K는 관찰된 다른 종류의 이벤트의 수(이전 훈련에서의 AB 빈도 수)를 나타낸다.K represents the number of different kinds of events observed (number of AB frequencies in previous training).
알파(α)는 사용자 정의 값을 나타낸다.Alpha α represents a user defined value.
L은 전체 관찰 표본 수(발생 가능한 노드 수)를 나타낸다.L represents the total number of observed samples (number of nodes that can occur).
Figure PCTKR2015000101-appb-I000002
는 훈련 데이터를 기반으로 추정된다.
Figure PCTKR2015000101-appb-I000002
Is estimated based on training data.
X는 관찰하고자 하는 표본(센서값-ABC)을 나타낸다.X represents the sample to be observed (sensor value-ABC).
Ni는 특정 이벤트가 발생한 빈도(AB → C의 센서 값 발생 빈도 수)를 나타낸다.Ni represents the frequency of occurrence of a specific event (the frequency of sensor value occurrences from AB → C).
수학식 1에서 P값은 <수학식 2>로 표현 가능하다.In Equation 1, the P value may be expressed by Equation 2.
수학식 2
Figure PCTKR2015000101-appb-M000002
Equation 2
Figure PCTKR2015000101-appb-M000002
도 14는 본 발명의 실시 예에 따른 이상 값 계산 방법을 도시한 도면이다.14 is a diagram illustrating an abnormal value calculation method according to an exemplary embodiment of the present invention.
본 발명의 실시 예에 따른 이상 값을 계산하는 방법은 다음과 같다. 예를 들어, 도 14와 같은 센서 데이터 발생 그래프 상에서 센서 발생 값(또는 센서값) A는 다음과 같은 센서 발생 값 그래프로 표시될 수 있다. A method of calculating an ideal value according to an embodiment of the present invention is as follows. For example, on the sensor data generation graph as shown in FIG. 14, the sensor generation value (or sensor value) A may be displayed as the following sensor generation value graph.
각 표본의 센서 값은 도 14에 도시한 바와 같이, 예컨대, A-B-C, A-E-F, A-B-D, A-B-C가 될 수 있다.The sensor value of each sample may be, for example, A-B-C, A-E-F, A-B-D, A-B-C, as shown in FIG.
도 15는 본 발명의 실시 예에 따른 이상 값 테이블 계산 방법을 도시한 도면이다.15 is a diagram illustrating a method of calculating an abnormal value table according to an embodiment of the present invention.
상기 설명한 예에서의 P(ABC) 이상 값, 즉, A(ST1)와 B(ST2)의 센서 값 발생 후, C(ST3) 센서 값이 발생할 확률은 다음과 같이 계산한다. ABC의 구조를 2-gram을 이용하여 분할 후, <수학식 2>를 통해 P값을 산출한다. 산출된 P값은 기존의 프로파일 상의 이상 값(예컨대, 임계값)과 비교하여, 임계값 범위를 벗어났다면, 이상으로 판단하게 된다.The probability of generating a C (S T3 ) sensor value after generating P (ABC) abnormal values, that is, sensor values of A (S T1 ) and B (S T2 ) in the above-described example, is calculated as follows. After dividing the structure of ABC using 2-gram, P value is calculated through Equation 2. The calculated P value is compared with an abnormal value (for example, a threshold value) on an existing profile, and if it is out of the threshold range, it is determined as abnormal.
도 16은 본 발명의 실시 예에 따라 베이지언 방식의 확률값 계산 알고리즘을 통해, 제스쳐 패턴의 일치 여부 및 제어 커맨드의 전송 여부를 처리하는 전체 과정을 도시한 흐름도이다. 16 is a flowchart illustrating an entire process of processing whether a gesture pattern matches and whether a control command is transmitted through a Bayesian probability calculation algorithm according to an embodiment of the present invention.
단말은 1600 단계에서 센서 정보를 수신한다. 센서 정보는 사용자의 손목을 이용한 스냅을 이용하여 웨어러블 기기로부터 수신된다. 단말은 1602 단계에서 센서 정보를 통해 ST1, ST2, ST3 세 필드를 추출한다.The terminal receives sensor information in step 1600. The sensor information is received from the wearable device using a snap using a wrist of the user. In step 1602, the terminal extracts three fields S T1 , S T2 , and S T3 from the sensor information.
단말은 1604 단계에서 프로파일 상의 세션 존재 여부를 비교한다. 1604 단계는 생략 가능하다. 1604 단계를 생략할 경우, 단말은 확률값을 계산한 후, 1610 단계로 진행한다.In step 1604, the terminal compares whether a session exists on the profile. Step 1604 can be omitted. If step 1604 is omitted, the terminal calculates a probability value and then proceeds to step 1610.
세션이 존재하지 않을 경우, 단말은 1608 단계로 진행하여 발생할 확률값을 계산하고, 1610 단계로 진행한다.If the session does not exist, the terminal proceeds to step 1608 to calculate a probability value to occur, and proceeds to step 1610.
그러나, 세션이 존재할 경우, 단말은 1606 단계로 진행하여 확률값을 갱신하고, 1608 단계에서 갱신된 확률값과 임계값을 비교한다. 단말은 1610 단계에서, 비교 결과로, 명령 수행/사용자 인터페이스 수행 여부를 체크한다. 만약 명령 수행/사용자 인터페이스 수행이라고 판단될 경우(확률값이 임계값 이상이라면), 1614 단계에서 제어 명령을 전송한다. 그러나 명령 수행/사용자 인터페이스 미수행이라고 판단될 경우(확률값이 임계값 미만이라면), 단말은 1616 단계에서 해당 제스쳐 패턴의 발생 데이터를 수행하지 않는다.However, if there is a session, the terminal proceeds to step 1606 to update the probability value, and compares the updated probability value with the threshold value in step 1608. In step 1610, the terminal checks whether the command is performed or the user interface is performed as a result of the comparison. If it is determined that the command execution / user interface execution (if the probability value is greater than the threshold value), the control command is transmitted in step 1614. However, if it is determined that the command execution / user interface is not performed (if the probability value is less than the threshold value), the terminal does not perform the generation data of the corresponding gesture pattern in step 1616.
또한 본 발명의 일 실시 예에 따른 웨어러블 기기를 이용한 홈 디바이스 제어 장치 및 제어 방법은 하드웨어, 소프트웨어 또는 하드웨어 및 소프트웨어의 조합의 형태로 실현 가능하다는 것을 알 수 있을 것이다. 이러한 임의의 소프트웨어는 예를 들어, 삭제 가능 또는 재기록 가능 여부와 상관없이, ROM 등의 저장 장치와 같은 휘발성 또는 비휘발성 저장 장치, 또는 예를 들어, RAM, 메모리 칩, 장치 또는 집적 회로와 같은 메모리, 또는 예를 들어 CD, DVD, 자기 디스크 또는 자기 테이프 등과 같은 광학 또는 자기적으로 기록 가능함과 동시에 기계(예를 들어, 컴퓨터)로 읽을 수 있는 저장 매체에 저장될 수 있다. 본 발명의 일 실시 예에 따른 웨어러블 기기를 이용한 홈 디바이스 제어 방법은 제어부 및 메모리를 포함하는 컴퓨터 또는 단말에 의해 구현될 수 있고, 상기 메모리는 본 발명의 실시 예들을 구현하는 지시들을 포함하는 프로그램 또는 프로그램들을 저장하기에 적합한 기계로 읽을 수 있는 저장 매체의 한 예임을 알 수 있을 것이다. In addition, it will be appreciated that the apparatus and control method for a home device using a wearable device according to an embodiment of the present invention may be realized in the form of hardware, software, or a combination of hardware and software. Any such software may be, for example, volatile or nonvolatile storage, such as a storage device such as a ROM, whether or not removable or rewritable, or a memory such as, for example, a RAM, a memory chip, a device or an integrated circuit. Or, for example, CD or DVD, magnetic disk or magnetic tape and the like can be stored in a storage medium that is optically or magnetically recordable and simultaneously readable by a machine (eg computer). The method for controlling a home device using a wearable device according to an embodiment of the present invention may be implemented by a computer or a terminal including a controller and a memory, and the memory includes a program or instructions including implementing the embodiments of the present invention. It will be appreciated that this is an example of a machine-readable storage medium suitable for storing programs.
따라서, 본 발명은 본 명세서의 임의의 청구항에 기재된 장치 또는 방법을 구현하기 위한 코드를 포함하는 프로그램 및 이러한 프로그램을 저장하는 기계(컴퓨터 등)로 읽을 수 있는 저장 매체를 포함한다. 또한, 이러한 프로그램은 유선 또는 무선 연결을 통해 전달되는 통신 신호와 같은 임의의 매체를 통해 전자적으로 이송될 수 있고, 본 발명은 이와 균등한 것을 적절하게 포함한다.Accordingly, the present invention includes a program comprising code for implementing the apparatus or method described in any claim herein and a storage medium readable by a machine (such as a computer) storing such a program. In addition, such a program may be transferred electronically through any medium, such as a communication signal transmitted via a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.
또한 본 발명의 실시 예에 따른 웨어러블 기기를 이용한 홈 디바이스 제어 장치는 유선 또는 무선으로 연결되는 프로그램 제공 장치로부터 상기 프로그램을 수신하여 저장할 수 있다. 상기 프로그램 제공 장치는 상기 프로그램 처리 장치가 기 설정된 웨어러블 기기를 이용한 홈 디바이스 제어 방법을 수행하도록 하는 지시들을 포함하는 프로그램, 웨어러블 기기를 이용한 홈 디바이스 제어 방법에 필요한 정보 등을 저장하기 위한 메모리와, 상기 그래픽 처리 장치와의 유선 또는 무선 통신을 수행하기 위한 통신부와, 상기 그래픽 처리 장치의 요청 또는 자동으로 해당 프로그램을 상기 송수신 장치로 전송하는 제어부를 포함할 수 있다. In addition, the home device control apparatus using the wearable device according to an embodiment of the present invention may receive and store the program from a program providing apparatus connected by wire or wirelessly. The program providing apparatus includes a memory for storing a program, instructions for causing the program processing apparatus to perform a home device control method using a preset wearable device, information necessary for a home device control method using a wearable device, and the like. It may include a communication unit for performing wired or wireless communication with a graphics processing apparatus, and a control unit for automatically transmitting a request or a corresponding program to the transmission and reception apparatus of the graphics processing apparatus.
한편 본 발명의 상세한 설명에서는 구체적인 실시 예에 관해 설명하였으나, 본 발명의 범위에서 벗어나지 않는 한도 내에서 여러 가지 변형이 가능함은 물론이다. 그러므로 본 발명의 범위는 설명된 실시 예에 국한되어 정해져서는 안되며 후술하는 특허청구의 범위뿐만 아니라 이 특허청구의 범위와 균등한 것들에 의해 정해져야 한다.Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by the equivalents of the claims.

Claims (14)

  1. 사용자 신체에 착용 가능한 웨어러블 기기를 이용하여 홈 디바이스를 제어하는 단말에 있어서,In the terminal for controlling the home device using a wearable device wearable on the user body,
    상기 웨어러블 기기로부터 상기 웨어러블 기기의 움직임을 기반으로 하여 생성된 제어 신호를 수신하는 수신부; 및A receiver configured to receive a control signal generated based on the movement of the wearable device from the wearable device; And
    상기 제어 신호를 기반으로 하여 해당 위치의 센서값을 결정하고, 상기 센서값을 기반으로 하여 확률값을 결정하고, 상기 확률값과 임계값을 비교하고, 비교 결과에 따라서 홈 디바이스를 제어하기 위한 제어 명령 수행 여부를 결정하는 제어부를 포함하는 단말 장치.Determine a sensor value of a corresponding position based on the control signal, determine a probability value based on the sensor value, compare the probability value with a threshold value, and perform a control command to control a home device according to a comparison result Terminal device including a control unit for determining whether or not.
  2. 사용자 신체에 착용 가능한 웨어러블 기기에 있어서,In the wearable device that can be worn on the user's body,
    상기 웨어러블 기기의 움직임을 인식하는 움직임 감지 센서; 및A motion sensor for recognizing a motion of the wearable device; And
    상기 움직임 감지 센서에 의해 감지된 움직임에 따라 제어 신호를 생성하고, 상기 제어 신호를 단말로 전송하는 제어부를 포함함을 특징으로 하는 웨어러블 기기. And a controller configured to generate a control signal according to the motion detected by the motion detection sensor and to transmit the control signal to the terminal.
  3. 제1항의 단말 또는 제2항의 웨어러블 기기에 있어서,The terminal of claim 1 or the wearable device of claim 2,
    상기 움직임은 스냅, 제스쳐 패턴, 및 회전 중 적어도 하나를 포함함을 특징으로 함.The movement comprises at least one of a snap, a gesture pattern, and a rotation.
  4. 제1항에 있어서,The method of claim 1,
    상기 확률값은 하기 수학식에 의해 결정됨을 특징으로 함.The probability value is characterized by the following equation.
    Figure PCTKR2015000101-appb-I000003
    Figure PCTKR2015000101-appb-I000003
    여기서,
    Figure PCTKR2015000101-appb-I000004
    이다.
    here,
    Figure PCTKR2015000101-appb-I000004
    to be.
    C(D,L)은 스케일링 펙터(scaling factor)를 나타낸다.C (D, L) represents a scaling factor.
    P는 관찰하고자 하는 표준의 확률값을 나타낸다.P represents the probability value of the standard to be observed.
    N은 전체 관찰 표본의 수를 나타낸다.N represents the total number of observation samples.
    K는 관찰된 다른 종류의 이벤트의 수를 나타낸다.K represents the number of different kinds of events observed.
    알파(α)는 사용자 정의 값을 나타낸다.Alpha α represents a user defined value.
    L은 전체 관찰 표본 수를 나타낸다.L represents the total number of observation samples.
    X는 관찰하고자 하는 표본을 나타낸다.X represents the sample to be observed.
    Ni는 특정 이벤트가 발생한 빈도를 나타낸다.Ni represents the frequency of occurrence of a particular event.
    Figure PCTKR2015000101-appb-I000005
    는 훈련 데이터를 기반으로 추정된다.
    Figure PCTKR2015000101-appb-I000005
    Is estimated based on training data.
  5. 제1항의 단말 또는 제2항의 웨어러블 기기에 있어서,The terminal of claim 1 or the wearable device of claim 2,
    상기 제어 신호는 상기 사용자의 음성을 기반으로 하여 생성된 것임을 특징으로 함.The control signal is generated based on the voice of the user.
  6. 제1항의 단말 또는 제2항의 웨어러블 기기에 있어서,The terminal of claim 1 or the wearable device of claim 2,
    상기 제어 신호는 상기 사용자의 터치를 기반으로 하여 생성된 것임을 특징으로 함.The control signal is generated based on the user's touch.
  7. 제1항에 있어서,The method of claim 1,
    상기 비교 결과, 상기 확률값이 상기 임계값 이상일 경우, 제어 명령을 홈 디바이스로 전송함을 특징으로 함.And when the probability is greater than or equal to the threshold, as a result of the comparison, transmitting a control command to a home device.
  8. 제1항에 있어서,The method of claim 1,
    상기 비교 결과, 상기 확률값이 상기 임계값 미만일 경우, 제어 명령을 수행하지 않음을 특징으로 함.If the probability value is less than the threshold value, the control command is not performed.
  9. 단말에서 사용자 신체에 착용 가능한 웨어러블 기기를 이용하여 홈 디바이스를 제어하는 방법에 있어서,In the method of controlling the home device using a wearable device wearable on the user's body in the terminal,
    상기 웨어러블 기기로부터 상기 웨어러블 기기의 움직임을 기반으로 하여 생성된 제어 신호를 수신하는 과정;Receiving a control signal generated based on the movement of the wearable device from the wearable device;
    상기 제어 신호를 기반으로 하여 센서값을 결정하는 과정;Determining a sensor value based on the control signal;
    상기 센서값을 기반으로 하여 확률값을 결정하는 과정; 및Determining a probability value based on the sensor value; And
    상기 확률값과 임계값을 비교하고, 비교 결과에 따라서 홈 디바이스를 제어하기 위한 제어 명령 수행 여부를 결정하는 과정을 포함함을 특징으로 하는 방법. And comparing the probability value with a threshold value and determining whether to perform a control command for controlling a home device according to a comparison result.
  10. 사용자 신체에 착용 가능한 웨어러블 기기에서 홈 디바이스 제어 방법에 있어서,In the wearable device wearable on the user's body in a home device control method,
    상기 웨어러블 기기의 움직임을 인식하는 과정;Recognizing a movement of the wearable device;
    상기 움직임에 따라 제어 신호를 생성하는 과정; 및Generating a control signal according to the movement; And
    상기 제어 신호를 단말로 전송하는 과정을 포함함을 특징으로 하는 방법.Transmitting the control signal to a terminal.
  11. 제9항의 방법 또는 제10항의 방법에 있어서,The method of claim 9 or the method of claim 10,
    상기 움직임은 스냅, 제스쳐 패턴, 및 회전 중 적어도 하나를 포함함을 특징으로 함.The movement comprises at least one of a snap, a gesture pattern, and a rotation.
  12. 제9항에 있어서,The method of claim 9,
    상기 확률값은 하기 수학식에 의해 결정됨을 특징으로 함.The probability value is characterized by the following equation.
    Figure PCTKR2015000101-appb-I000006
    Figure PCTKR2015000101-appb-I000006
    여기서,
    Figure PCTKR2015000101-appb-I000007
    이다.
    here,
    Figure PCTKR2015000101-appb-I000007
    to be.
    C(D,L)은 스케일링 펙터(scaling factor)를 나타낸다.C (D, L) represents a scaling factor.
    P는 관찰하고자 하는 표준의 확률값을 나타낸다.P represents the probability value of the standard to be observed.
    N은 전체 관찰 표본의 수를 나타낸다.N represents the total number of observation samples.
    K는 관찰된 다른 종류의 이벤트의 수를 나타낸다.K represents the number of different kinds of events observed.
    알파(α)는 사용자 정의 값을 나타낸다.Alpha α represents a user defined value.
    L은 전체 관찰 표본 수를 나타낸다.L represents the total number of observation samples.
    X는 관찰하고자 하는 표본을 나타낸다.X represents the sample to be observed.
    Ni는 특정 이벤트가 발생한 빈도를 나타낸다.Ni represents the frequency of occurrence of a particular event.
    Figure PCTKR2015000101-appb-I000008
    는 훈련 데이터를 기반으로 추정된다.
    Figure PCTKR2015000101-appb-I000008
    Is estimated based on training data.
  13. 제9항의 방법 또는 제10항의 방법에 있어서,The method of claim 9 or the method of claim 10,
    상기 제어 신호는 상기 사용자의 음성을 기반으로 하여 생성된 것임을 특징으로 하는 방법.The control signal is characterized in that generated based on the user's voice.
  14. 제9항의 방법 또는 제10항의 방법에 있어서,The method of claim 9 or the method of claim 10,
    상기 제어 신호는 상기 사용자의 터치를 기반으로 하여 생성된 것임을 특징으로 하는 방법.The control signal is characterized in that generated based on the user's touch.
PCT/KR2015/000101 2014-01-06 2015-01-06 Home device control apparatus and control method using wearable device WO2015102467A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US15/109,357 US10019068B2 (en) 2014-01-06 2015-01-06 Home device control apparatus and control method using wearable device
CN201580003834.0A CN105900376B (en) 2014-01-06 2015-01-06 Home device control apparatus and control method using wearable device
EP15733100.0A EP3094045B1 (en) 2014-01-06 2015-01-06 Home device control apparatus and control method using wearable devices

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2014-0001567 2014-01-06
KR20140001567 2014-01-06
KR10-2014-0151603 2014-11-03
KR1020140151603A KR102277752B1 (en) 2014-01-06 2014-11-03 Apparatus and method for controlling home device using wearable device

Publications (1)

Publication Number Publication Date
WO2015102467A1 true WO2015102467A1 (en) 2015-07-09

Family

ID=53493728

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/000101 WO2015102467A1 (en) 2014-01-06 2015-01-06 Home device control apparatus and control method using wearable device

Country Status (1)

Country Link
WO (1) WO2015102467A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105163443A (en) * 2015-09-10 2015-12-16 华南理工大学 Intelligent voice lighting control system
CN106102250A (en) * 2016-07-29 2016-11-09 华南理工大学 A kind of home intelligent illumination speech control system and method
EP3131258A1 (en) * 2015-08-13 2017-02-15 Xiaomi Inc. Smart household equipment control methods and corresponding apparatus
WO2017120622A1 (en) * 2016-01-04 2017-07-13 Sphero, Inc. Modular sensing device for processing gestures
WO2018063600A1 (en) * 2016-09-30 2018-04-05 Intel Corporation Reduced power consuming mobile devices method and apparatus
WO2018062834A1 (en) * 2016-09-30 2018-04-05 주식회사 테크앤 Wireless communication system using acknowledgment time slot
WO2020049527A1 (en) * 2018-09-07 2020-03-12 7Hugs Labs System and method for a smart remote carousel
WO2022139233A1 (en) * 2020-12-23 2022-06-30 삼성전자 주식회사 Electronic apparatus including sensor array, and control method therefor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120054743A (en) * 2010-11-22 2012-05-31 엘지전자 주식회사 Method for controlling using voice and gesture in multimedia device and multimedia device thereof
KR20120064923A (en) * 2010-12-10 2012-06-20 숭실대학교산학협력단 Apparatus for robot navigation control using EMG and acceleration sensor and method thereof
KR20120111330A (en) * 2011-03-31 2012-10-10 한국과학기술원 Remote controller and system using motion recognition and remote controlling method thereof
WO2012172487A1 (en) * 2011-06-16 2012-12-20 Fondazione Istituto Italiano Di Tecnologia An interface system for man-machine interaction
US20120330387A1 (en) * 2010-01-21 2012-12-27 Koninklijke Philips Electronics N.V. Control device, wearable device and lighting system for light therapy purposes

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120330387A1 (en) * 2010-01-21 2012-12-27 Koninklijke Philips Electronics N.V. Control device, wearable device and lighting system for light therapy purposes
KR20120054743A (en) * 2010-11-22 2012-05-31 엘지전자 주식회사 Method for controlling using voice and gesture in multimedia device and multimedia device thereof
KR20120064923A (en) * 2010-12-10 2012-06-20 숭실대학교산학협력단 Apparatus for robot navigation control using EMG and acceleration sensor and method thereof
KR20120111330A (en) * 2011-03-31 2012-10-10 한국과학기술원 Remote controller and system using motion recognition and remote controlling method thereof
WO2012172487A1 (en) * 2011-06-16 2012-12-20 Fondazione Istituto Italiano Di Tecnologia An interface system for man-machine interaction

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3131258A1 (en) * 2015-08-13 2017-02-15 Xiaomi Inc. Smart household equipment control methods and corresponding apparatus
RU2642410C2 (en) * 2015-08-13 2018-01-24 Сяоми Инк. Intelligent household appliance control method, device and system, mobile and wearable intelligent household appliances and apparatus
CN105163443A (en) * 2015-09-10 2015-12-16 华南理工大学 Intelligent voice lighting control system
US10001843B2 (en) 2016-01-04 2018-06-19 Sphero, Inc. Modular sensing device implementing state machine gesture interpretation
WO2017120622A1 (en) * 2016-01-04 2017-07-13 Sphero, Inc. Modular sensing device for processing gestures
WO2017120625A1 (en) * 2016-01-04 2017-07-13 Sphero, Inc. Smart home control using modular sensing device
US10534437B2 (en) 2016-01-04 2020-01-14 Sphero, Inc. Modular sensing device for processing gestures
US10275036B2 (en) 2016-01-04 2019-04-30 Sphero, Inc. Modular sensing device for controlling a self-propelled device
US9939913B2 (en) 2016-01-04 2018-04-10 Sphero, Inc. Smart home control using modular sensing device
CN106102250A (en) * 2016-07-29 2016-11-09 华南理工大学 A kind of home intelligent illumination speech control system and method
KR20180036822A (en) * 2016-09-30 2018-04-10 주식회사 테크앤 Wireless communications system using acknowledgement time slot
US9961642B2 (en) 2016-09-30 2018-05-01 Intel Corporation Reduced power consuming mobile devices method and apparatus
KR101897536B1 (en) 2016-09-30 2018-09-13 주식회사 테크앤 Wireless communications system using acknowledgement time slot
WO2018062834A1 (en) * 2016-09-30 2018-04-05 주식회사 테크앤 Wireless communication system using acknowledgment time slot
WO2018063600A1 (en) * 2016-09-30 2018-04-05 Intel Corporation Reduced power consuming mobile devices method and apparatus
WO2020049527A1 (en) * 2018-09-07 2020-03-12 7Hugs Labs System and method for a smart remote carousel
US11282375B2 (en) 2018-09-07 2022-03-22 7hugs Labs SAS System and method for a smart remote carousel
US11663905B2 (en) 2018-09-07 2023-05-30 7hugs Labs SAS System and method for a smart remote carousel
WO2022139233A1 (en) * 2020-12-23 2022-06-30 삼성전자 주식회사 Electronic apparatus including sensor array, and control method therefor

Similar Documents

Publication Publication Date Title
KR102277752B1 (en) Apparatus and method for controlling home device using wearable device
WO2015102467A1 (en) Home device control apparatus and control method using wearable device
WO2017111556A1 (en) Method and apparatus for controlling device
WO2016182374A1 (en) Remote control method and device using wearable device
WO2015076609A1 (en) Method and apparatus for controlling home devices on group basis in a home network system
WO2014092486A1 (en) Device and method for reproducing content in home network system
WO2014098477A1 (en) Method and device for controlling home device remotely in home network system
WO2017155144A1 (en) Wireless mesh network-based lighting device control method using mobile communication terminal, and computer readable recording medium storing program for implementing same
WO2014092513A1 (en) Apparatus and method for content backup in home network system
EP3402138A1 (en) Integrated gateway apparatus for implementing smart home
WO2014098481A1 (en) Method and device for managing energy consumption in home network system
WO2017010794A1 (en) Control method and apparatus for managing sleep environment
WO2015041490A1 (en) Apparatus and method by which user device in home network system transmits home-device-related information
WO2017111532A1 (en) Method and apparatus for controlling electronic device
US20160269691A1 (en) System for monitoring door using door phone
EP3072257A1 (en) Method and apparatus for controlling home devices on group basis in a home network system
WO2014069914A1 (en) Method and apparatus for controlling home device based on service logic in home network system
WO2016060371A1 (en) Terminal for internet of things and operation method of the same
WO2014092375A1 (en) Method and apparatus for controlling access between home device and external server in home network system
WO2016099193A1 (en) Method and apparatus for supporting facility control of terminal
US20160149717A1 (en) House monitoring system
US20160148476A1 (en) Monitoring system
WO2017054599A1 (en) A household appliance control method and apparatus
WO2017155145A1 (en) Lighting apparatus including function configuration switch module and control method therefor, and computer-readable recording medium having program recorded thereon for executing same
JP2015186096A (en) Communication system, relay device, control device, server device, control method, and information processing method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15733100

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15109357

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2015733100

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015733100

Country of ref document: EP