WO2017113871A1 - 可穿戴设备及其控制方法、智能家居控制系统 - Google Patents

可穿戴设备及其控制方法、智能家居控制系统 Download PDF

Info

Publication number
WO2017113871A1
WO2017113871A1 PCT/CN2016/098082 CN2016098082W WO2017113871A1 WO 2017113871 A1 WO2017113871 A1 WO 2017113871A1 CN 2016098082 W CN2016098082 W CN 2016098082W WO 2017113871 A1 WO2017113871 A1 WO 2017113871A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
home appliance
gesture
control command
gesture action
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/098082
Other languages
English (en)
French (fr)
Inventor
苏鹏程
谢馥励
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Inc
Original Assignee
Goertek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Inc filed Critical Goertek Inc
Priority to US15/540,808 priority Critical patent/US20180006840A1/en
Publication of WO2017113871A1 publication Critical patent/WO2017113871A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Program-control systems
    • G05B19/02—Program-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2807—Exchanging configuration information on appliance services in a home automation network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2807—Exchanging configuration information on appliance services in a home automation network
    • H04L12/2809—Exchanging configuration information on appliance services in a home automation network indicating that an appliance service is present in a home automation network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/283—Processing of data at an internetworking point of a home automation network
    • H04L12/2832—Interconnection of the control functionalities between home networks
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/284—Home automation networks characterised by the type of medium used
    • H04L2012/2841—Wireless
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/285—Generic home appliances, e.g. refrigerators

Definitions

  • the invention relates to the field of smart home technology, in particular to a wearable device and a control method thereof, and a smart home control system.
  • smart home technology has developed rapidly. It uses advanced computer technology, embedded technology, network communication technology, etc. to organically combine various subsystems related to home life (such as smart home appliance control, intelligent lighting control, intelligent security), each subsystem is controlled by the family.
  • the center conducts unified coordination and control.
  • the control mode usually adopts the traditional button or touch mode, the operation is relatively cumbersome, the degree of intelligence is relatively low, and the user experience is poor.
  • the invention provides a wearable device, a control method thereof and a smart home control system, so as to solve the problem that the control mode of the existing smart home control solution is cumbersome and the user experience is poor.
  • a wearable device comprising: a gesture recognition module, a wireless connection module, and a device configuration module;
  • a gesture recognition module configured to acquire, by the sensor, the wearer's feature data to be recognized, identify the current gesture action of the wearer, and send the gesture action to the device configuration module;
  • a device configuration module configured to establish, according to the acquired information of each household electrical appliance, a correspondence between a control command of each home appliance and a corresponding gesture action, and save, and when used to receive a gesture sent by the gesture recognition module And using the saved correspondence relationship to find the home appliance and the control command matched by the gesture action, generating a control message according to the matched home appliance and the control command, and transmitting the generated control message to the wireless connection module;
  • the wireless connection module is configured to receive the control message sent by the device configuration module and wirelessly send the control message to the smart home control server, so that the smart home control server controls the state of the home appliance according to the control message.
  • a smart home control system comprising: a wearable device, a smart home control server, and a wireless connection with a smart home control server, according to an aspect of the present invention Multiple household appliances;
  • the wearable device sends a control command to the smart home control server based on the gesture action of the user, and the smart home control server sends the control command to each home appliance through the wireless connection, thereby implementing control of each home appliance.
  • a method for controlling a wearable device is provided.
  • the wearable device is provided with a sensor, and the method includes:
  • the current gesture action is matched by using a corresponding relationship between the corresponding gesture action and the control command of the home appliance, and the control message is generated according to the matched home appliance information and the control command;
  • the generated control message is wirelessly sent to the smart home control server, so that the smart home control server controls the state of the home appliance according to the control message.
  • the invention has the beneficial effects that the wearable device of the embodiment of the invention can collect the gesture data of the wearer through the built-in sensor, recognize the gesture action, and control the state of the corresponding home appliance through the gesture action, thereby realizing: First, the wearer only needs to make corresponding gestures (such as drawing a circle) to facilitate and intuitive control of different smart home devices, avoiding relatively cumbersome control methods through other remote devices, smart phones and other terminal devices. . Secondly, the wearable device is generally worn on the user for a long time, so that the wearer can control the smart home at any time by performing certain gestures, and compared with the traditional control method, there is no need to find a control terminal, which saves time and improves efficiency. Enhanced user experience.
  • FIG. 1 is a block diagram showing the structure of a wearable device according to an embodiment of the present invention.
  • FIG. 2 is a structural block diagram of a smart watch according to still another embodiment of the present invention.
  • FIG. 3 is a schematic flow chart of gesture recognition according to an embodiment of the present invention.
  • FIG. 4 is a flowchart showing the operation of a smart watch according to an embodiment of the present invention.
  • FIG. 5 is a structural block diagram of a smart home control server according to still another embodiment of the present invention.
  • FIG. 6 is a flowchart showing the operation of a smart home control server according to an embodiment of the present invention.
  • FIG. 7 is a network structure diagram of a smart home control system according to an embodiment of the present invention.
  • FIG. 8 is a structural block diagram of a smart home control system according to an embodiment of the present invention.
  • the core idea of the present invention is that the present invention provides a wearable device (such as a smart watch) embedding a plurality of MEMS (Micro) in a smart watch for the problem that the operation of the existing smart home control mode is cumbersome and the user experience is poor.
  • a wearable device such as a smart watch
  • MEMS Micro
  • -Electro-Mechanical System such as accelerometers, gyroscopes, etc.
  • the wearer can issue different control commands only by performing certain gestures to control the state of the home appliance.
  • the interaction between the wearer and the home appliance is realized more conveniently and intuitively, and the user experience is enhanced.
  • the wearable device 10 includes:
  • the gesture recognition module 101 is configured to collect the feature data of the wearer to be recognized by the sensor, identify the current gesture action of the wearer, and send the information of the gesture action to the device configuration module 102;
  • the device configuration module 102 is configured to establish, according to the acquired information of each household electrical appliance, a correspondence between a control command of each home appliance and a corresponding gesture action, and save the gesture; and when used to receive the gesture sent by the gesture recognition module 101 The information of the action, using the stored correspondence to find the home appliance and the control command matching the gesture action, generating the control message according to the matched home appliance and the control command, and transmitting the generated control message to the wireless connection module 103;
  • the wireless connection module 103 is configured to receive the control message sent by the device configuration module 102 and wirelessly send the control message to the smart home control server, so that the smart home control server controls the state of the home appliance according to the control message.
  • the device configuration module 103 is configured with the information of the default gesture action, and the device configuration module 103 specifically stores the correspondence between the control commands of the home appliance and the default gesture action, and the device configuration module 103 receives the wearer.
  • the self-selecting gesture action input through the interactive interface of the wearable device is established, and the correspondence between the control command of each home appliance and the optional gesture action is established and saved.
  • the connection and control with the smart home device is realized by the wearable device shown in FIG. 1.
  • the wearable device can automatically detect and send a corresponding control command to the control center of the smart home, thereby controlling the state of the corresponding home appliance, thereby realizing the beneficial and intuitive interaction with the home appliance. effect.
  • Gesture recognition based on wearable devices requires consideration of calculation amount and power consumption.
  • a wearable device such as a smart watch is a resource-constrained device.
  • the continuous perception of the action requires a lot of energy, and thus an effective solution is needed to reduce the complexity of the algorithm and reduce the amount of calculation. To ensure the reliability of gesture recognition.
  • FIG. 2 is a structural block diagram of a smart watch according to an embodiment of the present invention.
  • the structure of the smart watch is mainly described.
  • the smart watch When using a smart watch to control different home appliances for the first time, first connect the smart watch to the smart home control server via wireless means such as BLE (Bluetooth Low Energy), and then connect to the smart home control server.
  • BLE Bluetooth Low Energy
  • Control of home appliances more specifically, smart watches to establish optional gestures or default gestures and control of home appliances
  • the correspondence between the commands, the optional gesture action can be customized by the wearer in the home appliance configuration interface of the smart watch.
  • the default gestures are gestures that are pre-stored in the smartwatch without the user's own design.
  • the smart watch control terminal 20 (disposed in the smart watch) includes: a gesture recognition module 201, a device configuration module 202, and a wireless connection module 203;
  • the wearer performs a certain gesture action, and after the gesture recognition module 201 recognizes the gesture action, the home appliance corresponding to the gesture action is queried from the corresponding relationship between the preset gesture action and the home appliance and the control command.
  • the device and the control command combine the unique identification ID and the control command information of the home appliance to form a control message, and then the wireless connection module 203 sends the control message to the smart home control server in a Bluetooth low energy BLE wireless manner.
  • This module is mainly used to create gesture templates and perform user gesture recognition functions, thereby providing users with a natural and intuitive gesture control method.
  • the module uses MEMS sensors to capture the wearer's gesture data and perform gesture recognition.
  • This embodiment considers the following two factors when creating a gesture action template: one is that the gesture should be as simple as possible, the user can easily grasp and use; the second is that the gesture is easily recognized and distinguished. Since the present embodiment is mainly used for controlling electric appliances such as electric lights, televisions, air conditioners, etc., several default gestures are pre-designed according to the characteristics of these household appliances, and are saved, see Table 1 below, Table 1 is gestures and different types of household electrical appliances. The correspondence table between the control commands.
  • the gesture action of drawing a rectangle in a clockwise direction and the gesture action of drawing a rectangle in a counterclockwise direction respectively correspond to an opening control command and a closing control command of a first type household electrical appliance (such as a television);
  • the circular gesture action in the hour hand direction and the circular motion gesture in the counterclockwise direction respectively correspond to the opening control command and the closing control command of the second type household electrical appliance (such as an electric lamp);
  • the gesture action and the gesture action of drawing the fold line from the bottom to the top respectively correspond to the opening control command and the closing control command of the third type household electrical appliance (such as an air conditioner).
  • the device configuration module can also provide an interactive interface for the user to customize the gesture when the corresponding relationship between the home appliance and the gesture action is specifically configured. .
  • the PCA Principal Component Analysis
  • the importance of each independent component can be determined according to the size of the feature value in the calculation process, and the most important component is selected, and the original feature data to be identified is reduced to one dimension, and the computational complexity can be reduced. Part of the noise is removed, reducing the posture requirements when the user performs a gesture. Then, the reduced-dimensional data is further subjected to an identification algorithm (for example, template matching or machine learning) to achieve accurate gesture recognition while reducing computational complexity.
  • an identification algorithm for example, template matching or machine learning
  • gesture recognition based on a triaxial acceleration sensor includes preprocessing, principal component analysis processing, feature extraction, gesture matching, and the like. Processing.
  • the present embodiment adopts the PCA method to reduce the three-dimensional acceleration data to one-dimensional and then perform matching and identification processing.
  • the specific processing procedures for gesture templates and test sequences are as follows:
  • Step S31 collecting data by using a triaxial acceleration sensor to obtain a three-dimensional acceleration template sequence (or a three-dimensional acceleration test sequence); and proceeding to step S32,
  • Step S32 pre-processing, pre-processing the collected three-dimensional acceleration sensor data, and performing processing methods such as mean filtering and Butterworth filtering to filter out interference noise. If the template sequence is collected, the process proceeds to step S330, if the acquisition is If the sequence is tested, the process proceeds to step S331.
  • Step S330 performing PCA processing on the three-dimensional acceleration sequence for the template sequence, to obtain a feature vector space of the principal component
  • the template sequence is subjected to feature extraction and dimension reduction (eg, mean, variance of adjacent data points, or direct extraction of waveform variation features) to obtain a one-dimensional template feature sequence, and proceeds to step S34.
  • feature extraction and dimension reduction eg, mean, variance of adjacent data points, or direct extraction of waveform variation features
  • Step S331 for the test sequence, projecting the three-dimensional acceleration sequence into the principal component feature vector space of the template sequence, performing feature extraction to obtain a one-dimensional test feature sequence, and proceeding to step S34.
  • Step S34 identifying a gesture action
  • the test feature sequence is matched with each template feature sequence (for example, template matching or machine learning method matching identification), and the recognition result is obtained, wherein the template feature sequence can be saved to the template library. Used for gesture recognition and matching.
  • step S34 For a more detailed calculation process of the gesture action recognition in step S34, reference may be made to the related content of the principal component analysis in the prior art, which is not described in detail in this embodiment.
  • the principal component analysis is used to perform feature extraction and data dimensionality reduction on the collected original acceleration signals, but is not limited thereto.
  • Other dimensionality reduction methods and means may also be adopted in other embodiments.
  • the device configuration module is configured to associate the control of the smart home device to be controlled with the gesture action of the user, so that the user can control the smart home device through the gesture after wearing the smart watch.
  • One implementation of the registration is that after the smart watch and the smart home control server establish a connection through the BLE and log in, when performing the configuration operation, the information of all the home appliances connected to the smart home control server is obtained from the smart home control server through the wireless connection module. The list is then presented on the interactive interface of the smart watch, so that the wearer can log in to the configuration interface to modify related home appliances and gestures at any time.
  • the device configuration module receives an instruction of the wearer to select to add or delete the home appliance in the list of home appliance information presented by the interactive interface of the smart watch, and then establishes a control command and a gesture action of the added home appliance according to the wearer's add instruction. After the corresponding relationship is saved, or according to the deletion instruction of the wearer, the correspondence between the control command of the deleted home appliance and the gesture action is released and saved.
  • the user frequently uses a home appliance device for a period of time, and the home appliance device can be added to the home appliance device list by gesture operation to perform gesture control.
  • the home appliance can be deleted and the corresponding relationship between the home appliance and the gesture action can be deleted, so that the same gesture can be reused, and multiple gestures can be avoided.
  • the configuration information of the home appliance is saved to facilitate subsequent gesture gesture search and matching.
  • the smart watch can control the state of the home appliance by setting different gesture actions and corresponding control commands of the home appliance.
  • the wireless connection module 203 is mainly used for wireless communication with the smart home control server.
  • the registration information of the smart watch is obtained through the wireless connection module in the smart watch and The identity information of the wearer is sent to the smart home control server, and the smart home control server verifies the smart watch and the wearer, and the smart watch and the wearer's registration are completed after the authentication is passed.
  • the outsider is prevented from using the same wearable device to control the home appliance, thereby ensuring the safety of the smart home by using gestures.
  • the smart watch can connect to the smart home control server through the BLE mode again, and can only send the login information to the smart home control server to realize automatic login without re-authentication.
  • the smart watch in order to further ensure security, can also verify the smart home server, that is, perform two-way verification, and the smart watch obtains the registration information of the smart home control server and saves it, and in the subsequent use, the smart
  • the watch's wireless connection module only sends a login request to the registered smart home control server; the smart home control server obtains the registration information of the smart watch and the smart watch wearer and saves it, and the smart home control server only accepts the registered smart watch and the wearer's control.
  • the command in this way, prevents non-authenticated users from using the smart watch to control the home appliance, ensuring that the smart watch controls the safety of the home appliance.
  • the wireless connection module 203 after receiving the control message including the unique identifier ID of the home appliance corresponding to the gesture action and the control command sent by the device configuration module 202, the wireless connection module 203 sends the control packet to the smart home control server, and the smart The home control server then implements state control of the designated home appliance according to the control message.
  • the wireless connection module 203 is further configured to receive feedback information (such as the success or failure of the control, the current state of the controlled home appliance, etc.) sent by the smart home control server, and send the feedback information to the device configuration module of the smart watch.
  • the device configuration module is controlled to output corresponding reminding information to the wearer.
  • the first control process of the smart watch includes the following steps S41 to S46:
  • Step S41 the sensor collects data, and then proceeds to step S42;
  • the wearer's feature data to be identified is collected by a sensor, where the sensor includes an acceleration sensor and an angular velocity sensor (such as a gyroscope), and the wearer's three-axis acceleration data sequence to be identified or three is obtained by a three-axis acceleration sensor or a three-axis angular velocity sensor.
  • Step S42 determining whether it is gesture data, if yes, proceeding to step S43, otherwise returning to step S41;
  • the three-axis acceleration data signal when the three-axis acceleration data signal is acquired, the three-axis acceleration data signal is first reduced in data dimension processing, and reduced to one dimension, thereby reducing computational complexity, reducing noise, and then One-dimensional acceleration signal
  • the line template is matched to determine whether the acceleration signal collected this time is a gesture action. Since the wearer may malfunction during the actual application process, it is necessary to determine whether it is gesture data. If it is not gesture data, the following processing steps are not performed to save power consumption, and the accuracy of the control is also ensured.
  • Step S43 the gesture motion recognition; using the saved gesture motion template to perform the gesture motion recognition, and then proceeds to step S44.
  • the current gesture action is matched by using a preset gesture action template and a corresponding relationship between the gesture action and the control command of the home appliance, and the control message is generated according to the matched home appliance information and the control command.
  • the gesture data sequence of step S42 and the gesture action sequence in the preset gesture action template need to be matched to determine the type of the gesture action.
  • the corresponding gesture actions include: a default gesture action and a self-selection gesture action; the smart watch can set a correspondence between the default gesture action and the control command of the home appliance by: clockwise drawing a rectangular gesture gesture and counterclockwise The gestures of the drawing rectangles of the direction respectively correspond to the opening control command and the closing control command of the first type of home appliance; respectively, the circular motion gestures in the clockwise direction and the circular motion gestures in the counterclockwise direction respectively correspond to the The opening control command and the closing control command of the second type household electrical appliance; the gesture action of drawing the fold line from the top to the bottom and the gesture action of drawing the fold line from the bottom to the top respectively correspond to the opening control command of the third type household electrical appliance and Close the control command.
  • the corresponding relationship between the self-selected gesture action and the control command of the home appliance is set as follows: the user-selected gesture action is received on the interface of the wearable device, and the correspondence between the gesture action and the control command of the home appliance is established. relationship.
  • the smart watch can also establish a corresponding relationship between the corresponding gesture action and the control command of the home appliance by: receiving the user to select to add or delete the home appliance in the list of home appliance information presented by the wearable interface of the wearable device.
  • the instruction of the device establishes a correspondence between the control command of the added home appliance and the gesture action according to the add instruction of the wearer; or, according to the deletion instruction of the wearer, cancels the correspondence between the control command of the deleted home appliance and the gesture action relationship.
  • Step S44 it is determined whether it is a valid gesture action; if yes, step S45 is performed, otherwise step S41 is performed;
  • a step of determining whether the recognized gesture action is an effective gesture action is further provided to further ensure the accuracy of the gesture motion control. Due to the actual application, the user can modify the correspondence between the gesture action and the home appliance and the control command through the interactive interface of the smart watch. At this time, the situation that the gesture action recognized based on the gesture action template is outdated may occur. For example, before the modification, the gesture action corresponding to the control command to turn on the TV is to draw a circle clockwise, and the wearer changes the control command to draw the rectangle clockwise during subsequent use. If the smart watch recognizes that the current gesture action of the user is a clockwise circle, it determines that the gesture action is an invalid gesture action (ie, the corresponding relationship between the currently saved gesture action and the home appliance and the control command does not match).
  • Step S45 query the saved correspondence, and then proceeds to step S46;
  • the smart watch end pre-establishes the correspondence between the corresponding gesture action and the control commands of the home appliance and the home appliance, and saves the correspondence to the database.
  • the saved correspondence relationship is queried, thereby finding the ID of the home appliance that matches the gesture action and the control command of the home appliance.
  • the control commands herein include: a command to turn on the home appliance or a command to turn off the home appliance, or include: adjusting the corresponding state of the home appliance Order (such as adjusting the volume of the smart TV), there is no limit to this.
  • Step S46 generating a control message and transmitting the message
  • the generated control message is wirelessly sent to the smart home control server, so that the smart home control server controls the state of the home appliance according to the control message. Specifically, after obtaining the ID of the home appliance and the control command, the control message is generated according to the home appliance ID and the control command, and the control message is sent to the wireless connection module, and the wireless connection module sends the control message to the smart home control server. At this point, the smart watch wearer completed a home appliance control. Then, returning, step S41 to step S46 are repeatedly performed. Sending the registration information of the wearable device and the identity information of the wearer to the smart home control server when the first connection to the smart home control server is performed, so that the smart home control server verifies the wearable device and the wearer;
  • the login information is sent to the smart home control server.
  • FIG. 5 is a structural block diagram of a smart home control server according to an embodiment of the present invention.
  • the structure of the smart home control server is mainly described.
  • the smart home control server 50 includes three modules, which are a connection control module 501, a command parsing module 502, and a home appliance control module 503. After the smart home control server 50 monitors and receives the control message sent by the smart watch control terminal, the home appliance ID and the corresponding control command are parsed from the control message, and the home appliance ID is stored in the pre-stored home appliance information list.
  • the smart home control server 50 can also send relevant feedback information to the smart watch end, so that the smart watch end can output reminder information to the user, prompting the user to know the execution result for the gesture action in time.
  • the module is used for establishing a wireless connection with the wireless connection module of the smart watch, and receiving and transmitting communication data, and the functions specifically include: establishing a wireless connection such as Bluetooth low-power BLE between the smart watch; when using the smart watch to control the household electrical device for the first time, Verify the smart watch and complete the registration of the smart watch.
  • the connection control module 501 receives the registration information of the smart watch sent by the smart watch and the identity information of the wearer, and then verifies the registration information and the identity information, and returns when the verification is passed.
  • the login page is given to the smart watch and receives the login information sent by the smart watch.
  • connection control module monitors the connection request of the smart watch, further receives the home appliance control message sent by the smart watch, and sends it to the command parsing module 502 for processing; and sends relevant feedback information to the smart watch control end. .
  • the module is mainly used to receive the control message from the connection control module 501, parse the received control message, obtain the home appliance ID and control command information in the control message, and then transmit the information to the home appliance control module. 503 for further processing.
  • the module queries the stored home appliance information list to obtain the network address and port number corresponding to the home appliance ID according to the home appliance ID obtained by the command parsing module 502, and determines whether the home appliance ID is a valid ID, and whether the control command is valid. control commands. If one of the device ID and the control command is invalid, no processing is performed, and the feedback information (for example, the home appliance ID is invalid) is directly sent to the smart watch end through the connection control module 501. If it is valid, the control command and its parameters are sent to the corresponding home appliance according to the network address and port number corresponding to the home appliance ID to implement a corresponding control command to implement the control function.
  • the home appliance control module 503 can also return the current state information of the home appliance to the connection control module 501, and send the feedback information to the smart watch control terminal through the connection control module 501.
  • FIG. 6 is a flowchart of the work of the smart home control server according to still another embodiment of the present invention.
  • the first control flow of the smart home control server includes the following steps S61 to S66:
  • Step S61 monitoring and receiving the control message of the smart watch end, and then proceeds to step S62;
  • the smart home control server receives the control message sent by the smart watch wirelessly, specifically, the smart home control server establishes a wireless connection such as Bluetooth low-power BLE between the smart watch end, and monitors the connection state to obtain the control message sent by the smart watch end.
  • a wireless connection such as Bluetooth low-power BLE
  • Step S62 the analysis obtains the home appliance ID and the control command, and then proceeds to step S63;
  • control message is parsed to obtain the home appliance information and the control command; specifically, the received control message is parsed to obtain the home appliance ID and the control command.
  • Step S63 query the home appliance address and port number according to the ID, and then proceeds to step S64;
  • the corresponding home appliance is searched for based on the home appliance information. Specifically, the home appliance ID of the home appliance corresponding to the home appliance ID is queried in the home appliance information list stored in advance based on the home appliance ID analyzed in step S62.
  • Step S64 determining whether it is a valid household electrical appliance ID and control command, if yes, proceeding to step S65, otherwise, proceeding to step S66;
  • the embodiment further includes an operation of determining whether the parsed home appliance ID and the control command are valid, for example, searching for the parsed ID in the pre-stored home appliance information list, and if yes, determining The home appliance ID obtained by the analysis is valid. Otherwise, it is determined that the parsed home appliance ID is invalid. If the home appliance ID is invalid, the smart home control server may return corresponding information to the smart watch end (eg, the home appliance ID is invalid). Information) to remind the smart watch end to confirm the transmitted home appliance ID.
  • Step S65 sending a control command to the designated home appliance
  • the control command is sent to the corresponding home appliance to perform control of the state of the home appliance.
  • step S66 the feedback information is sent to the smart watch end.
  • the smart home control server can obtain the execution result from the home appliance.
  • the execution result is fed back to the smart watch end, so that the smart watch end can output corresponding reminding information according to the feedback information to remind the wearer.
  • the smart watch controls the built-in vibration motor to emit a predetermined frequency of vibration to alert the wearer that the home appliance control succeeds or fails.
  • FIG. 7 is a network structure diagram of a smart home control system according to an embodiment of the present invention
  • FIG. 8 is a structural block diagram of a smart home control system according to an embodiment of the present invention.
  • a smart home is mainly combined with FIG. 7 and FIG.
  • the structure of the control server will be described, and other contents are referred to other embodiments of the present invention.
  • the smart home control system includes a smart home control server (ie, the computer shown in FIG. 7), and a plurality of smart home appliances (television, air conditioner, and lighting) wirelessly connected to the smart home control server.
  • a central controller of the home appliance can be installed inside the home, and the central controller is connected through the network and the smart home control server.
  • the smart home appliances are connected to the smart home control server through wireless means such as Wi-Fi or ZigBee to form a home internal network, which is controlled, coordinated and managed by the smart home control server.
  • wireless means such as Wi-Fi or ZigBee
  • the smart home control system of the embodiment is implemented by the wearer of the smart watch performing a certain gesture action.
  • the smart watch establishes a connection with the smart home control server through the BLE wireless method, uses the MEMS sensor in the smart watch to acquire the data to be identified, and uses the matching recognition algorithm to recognize the gesture action issued by the user, and based on the gesture.
  • the action generates a corresponding control command to the smart home control server.
  • the smart home control server performs corresponding control on the matched home appliance according to the received gesture control command.
  • the smart home control system includes: a smart watch control terminal 80, a server (ie, a smart home control server) 81, and a smart home device wirelessly connected to the server.
  • the smart watch control terminal 80 includes a gesture recognition module 801, a device configuration module 802, and a wireless connection module 803.
  • the smart home control server 81 includes a connection control module 811, a command analysis module 812, and a home appliance control module 813.
  • the gesture recognition module 801 of the smart watch control terminal 80 collects the feature data of the wearer to be recognized by the sensor to identify the current gesture action of the wearer; the device configuration module 802 uses the corresponding gesture action saved in advance and the control command of the home appliance. Corresponding relationship, matching the current gesture action, generating a control message according to the matched home appliance information and the control command; the wireless connection module 803 wirelessly transmitting the generated control message to the smart home control server 81.
  • the connection control module 811 of the smart home control server 81 establishes a wireless connection with the smart watch, and receives the control message sent by the smart watch, and sends the control message to the command parsing module 812.
  • the command parsing module 812 controls the received control message. Performing analysis, transmitting the analyzed home appliance information and control command to the home appliance control module 813; the home appliance control module 813 searches for the corresponding home appliance based on the received home appliance information, and transmits a control command to the home appliance to execute To achieve control of the state of home appliances.
  • the technical solution of the embodiment of the present invention utilizes a wearable device to perform control of the home appliance, such that the wearable device
  • the wearer can perform convenient and intuitive control on different home appliances by performing certain gesture actions, thereby avoiding relatively cumbersome control methods through other devices such as smart phones.
  • the built-in MEMS sensor in the wearable device the MEMS sensor-based gesture recognition is flexible and reliable, and is not affected by the environment and light, and the system is simple to implement.
  • the wearable device is generally worn on the user for a long time, and the wearer can issue different control commands at any time by performing gestures, thereby more conveniently implementing the interaction between the wearer and the home appliance, without looking for control using a remote controller and a smart phone.
  • the terminal saves time, improves efficiency, and enhances the user experience compared with the traditional control method.
  • the technical solution of the embodiment improves the gesture motion recognition, and reduces the original acceleration signal to one dimension by using the principal component analysis PCA, which is compared with the prior art gesture recognition directly on the three-dimensional data.
  • the computational complexity is further improved.
  • the original three-dimensional data is subjected to the dimensionality reduction processing and the motion recognition and matching are performed, the posture requirement when the user performs the gesture is reduced, so that the user can perform the gesture motion relatively freely.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种可穿戴设备、智能家居服务器及其控制方法和系统，该可穿戴设备（10）包括：手势识别模块（101）通过传感器采集得到佩戴者的待识别特征数据，识别佩戴者当前的手势动作，将该手势动作发送给设备配置模块（102）；设备配置模块（102）根据获取的各家电设备的信息，建立各家电设备的控制命令与相应的手势动作间的对应关系并保存；以及当收到手势动作时，利用对应关系查找该手势动作匹配的家电设备及控制命令，根据匹配的信息生成控制报文，将控制报文发送给无线连接模块（103）；无线连接模块（103）接收控制报文并将其无线发送至智能家居服务器（50，81）。通过采集可穿戴设备（10）的佩戴者的手势动作，根据手势动作控制家电设备的状态，更便捷了与家电的交互，增强了用户体验。

Description

可穿戴设备及其控制方法、智能家居控制系统 技术领域
本发明涉及智能家居技术领域，具体涉及一种可穿戴设备及其控制方法、智能家居控制系统。
背景技术
目前，随着技术的进步和人们生活水平的提高，智能家居技术得到了快速地发展。它利用先进的计算机技术、嵌入式技术、网络通讯技术等将与家居生活有关的各种子系统(如智能家电控制、智能灯光控制、智能安防)有机地结合在一起，各个子系统由家庭控制中心进行统一协调和控制。然而，现有的智能家居控制方案中，控制方式通常还采用传统的按键或触摸方式，操作相对繁琐，智能化的程度还比较低，用户体验较差。
发明内容
本发明提供了一种可穿戴设备及其控制方法、智能家居控制系统，以解决现有的智能家居控制方案的控制方式繁琐导致用户体验差的问题。
根据本发明的一个方面，提供了一种可穿戴设备，该可穿戴设备包括：手势识别模块、无线连接模块和设备配置模块；
手势识别模块，用于通过传感器采集得到佩戴者的待识别特征数据，识别出佩戴者当前的手势动作，将该手势动作发送给设备配置模块；
设备配置模块，用于根据获取到的各家电设备的信息，建立各家电设备的控制命令与相应的手势动作间的对应关系并保存；以及，用于当接收到手势识别模块发送的手势动作时，利用保存的对应关系查找该手势动作匹配的家电设备以及控制命令，根据匹配的家电设备以及控制命令生成控制报文，将生成的控制报文发送给无线连接模块；
无线连接模块，用于接收设备配置模块发送的控制报文并将控制报文无线发送至智能家居控制服务器，以使得智能家居控制服务器根据控制报文控制家电设备的状态。
根据本发明的另一个方面，提供了一种智能家居控制系统，该智能家居控制系统包括：如本发明一个方面的可穿戴设备，智能家居控制服务器，以及，与智能家居控制服务器之间无线连接的多个家电设备；
可穿戴设备基于用户的手势动作向智能家居控制服务器发送控制命令，智能家居控制服务器通过该无线连接将控制命令发送各家电设备，从而实现对各家电设备的控制。
根据本发明的再一个方面，提供了一种可穿戴设备的控制方法，该可穿戴设备中设置有传感器，方法包括：
通过传感器采集佩戴者的待识别特征数据，识别出佩戴者当前的手势动作；
利用预先保存的相应手势动作与家电设备的控制命令间的对应关系，对当前的手势动作进行匹配，根据匹配到的家电设备信息以及控制命令生成控制报文；
将生成的控制报文无线发送至智能家居控制服务器，以使得智能家居控制服务器根据控制报文控制家电设备的状态。
本发明的有益效果是：本发明实施例的可穿戴设备能够通过内置的传感器采集佩戴者的手势数据，识别出手势动作，并通过该手势动作控制相应的家电设备的状态，从而实现了：第一，佩戴者只需做出相应的手势动作(如画个圆形)就可以对不同的智能家居设备进行方便直观的控制，避免了通过遥控器、智能手机等其它终端设备相对繁琐的控制方式。第二，可穿戴设备一般都会长期戴在用户身上，这样佩戴者随时可以通过执行一定的手势动作控制智能家居，与传统控制方式相比，不需要寻找控制终端，节省了时间、提升了效率，增强了用户体验。
附图简要说明
图1是本发明一个实施例的一种可穿戴设备的结构框图；
图2是本发明又一个实施例的智能手表的结构框图；
图3是本发明一个实施例的手势识别的流程示意图；
图4是本发明一个实施例的智能手表的工作流程图；
图5是本发明再一个实施例的智能家居控制服务器的结构框图；
图6是本发明一个实施例的智能家居控制服务器的工作流程图；
图7是本发明一个实施例的智能家居控制系统的网络结构图；
图8是本发明一个实施例的智能家居控制系统的结构框图。
具体实施方式
本发明的核心思想是：针对现有的智能家居控制方式中存在的操作繁琐用户体验差的问题，本发明提供了一种可穿戴设备(如智能手表)在智能手表中嵌入多种MEMS(Micro-Electro-Mechanical System，微机电系统)传感器，如加速度计、陀螺仪等，对基于传感器的手势识别提供软硬件支持。并且考虑到智能手表一般都会长期戴在用户腕部，通过将智能手表作为智能家电设备的控制器，佩戴者只需执行一定的手势动作就可发出不同的控制命令，以控制家电设备的状态，更便捷直观地实现了佩戴者与家电设备的交互，增强了用户体验。
实施例一
图1是本发明一个实施例的一种可穿戴设备的结构框图，参见图1，该可穿戴设备10包括：
手势识别模块101，用于通过传感器采集得到佩戴者的待识别特征数据，识别出佩戴者当前的手势动作，将该手势动作的信息发送给设备配置模块102；
设备配置模块102，用于根据获取到的各家电设备的信息，建立各家电设备的控制命令与相应的手势动作间的对应关系并保存；以及，用于当接收到手势识别模块101发送的手势动作的信息时，利用保存的对应关系查找该手势动作匹配的家电设备以及控制命令，根据匹配的家电设备以及控制命令生成控制报文，将生成的控制报文发送给无线连接模块103；
无线连接模块103，用于接收设备配置模块102发送的控制报文并将控制报文无线发送至智能家居控制服务器，以使得智能家居控制服务器根据控制报文控制家电设备的状态。
本实施例中，设备配置模块103中设置有默认手势动作的信息，设备配置模块103具体建立各家电设备的控制命令与默认手势动作间的对应关系后保存；或者，设备配置模块103接收佩戴者通过可穿戴设备的交互界面输入的自选手势动作，并建立各家电设备的控制命令与自选手势动作间的对应关系后保存。
通过图1所示的可穿戴设备，实现与智能家居设备之间的连接和控制。当佩戴者发出某种手势动作时，可穿戴设备可以自动检测出来并发送相应的控制命令给智能家居的控制中心，进而控制相应的家电设备的状态，实现了方便直观地与家电设备交互的有益效果。
除此之外，在智能手表等可穿戴设备上实现对智能家居的控制，还必须克服以下技术困难：
(1)基于可穿戴设备的手势识别需要考虑计算量和功耗的问题。智能手表等可穿戴设备是资源受限的设备，在手势识别过程中，对动作的持续感知需要消耗不少的能量，因而需要进一步采取有效方案，在降低算法的复杂性、减少计算量的同时，保证手势动作识别的可靠性。
(2)如何通过不同的手势动作分别访问相应的家电设备，并对相应的家电设备进行控制。
(3)需要解决采用手势识别对智能家居控制的安全性问题，防止外人采用同样的可穿戴设备对家电设备进行控制。
以下结合本发明其他实施例，对本发明技术方案中克服上述技术困难而采取的技术手段进行具体说明。
实施例二
图2是本发明一个实施例的智能手表的结构框图，本实施例中主要是对智能手表的结构进行说明，其他内容参见本发明的其他实施例。
首次使用智能手表对不同的家电设备进行控制时，先将智能手表通过BLE(Bluetooth Low Energy，蓝牙低功耗)等无线方式与智能家居控制服务器建立连接，然后对智能家居控制服务器所连接的不同家电设备进行控制，更具体的，智能手表建立自选手势动作或默认手势动作与家电设备的控 制命令间的对应关系，自选手势动作可以由佩戴者在智能手表的家电配置界面中自定义。默认的手势动作是那些预先保存在智能手表中，而不需要用户自己设计的手势动作。
本实施例中，智能手表控制端20(设置在智能手表中)包括：手势识别模块201，设备配置模块202以及无线连接模块203；
在具体应用过程中，佩戴者执行一定的手势动作，手势识别模块201识别出该手势动作后，从预先保存的相应手势动作与家电设备以及控制命令的对应关系中查询出该手势动作对应的家电设备和控制命令，将家电设备的唯一标识ID和控制命令信息组成控制报文，然后由无线连接模块203将控制报文以蓝牙低能耗BLE无线方式发送到智能家居控制服务器。以下结合图2对智能手表控制端各模块的功能说明如下：
手势识别模块201
该模块主要用于创建手势模板、执行用户手势识别功能，从而为用户提供一种自然直观的手势控制方式。该模块使用MEMS传感器采集佩戴者的手势数据并进行手势识别。
功能一，手势模板的创建
本实施例在创建手势动作模板时考虑如下两个因素：一是手势应尽量简单，用户可以很轻松地掌握和使用；二是手势易被识别和区分。由于本实施例中主要用于控制电灯、电视、空调等家电设备，根据这些家电设备的特点预先设计几种默认的手势并保存，参见下表1，表1是手势动作与不同类型的家电设备的控制命令间的对应关系表。
Figure PCTCN2016098082-appb-000001
Figure PCTCN2016098082-appb-000002
表1
在表1中，定义了将顺时针方向的画矩形的手势动作和逆时针方向的画矩形的手势动作分别对应于第一类型家电设备(如电视)的开启控制命令和关闭控制命令；将顺时针方向的画圆形的手势动作和逆时针方向的画圆形的手势动作分别对应于第二类型家电设备(如电灯)的开启控制命令和关闭控制命令；将从上到下方向的画折线的手势动作和从下到上方向的画折线的手势动作分别对应于第三类型家电设备(如空调)的开启控制命令和关闭控制命令。
需要说明的是，表1只是示意性的示出了几种默认的手势动作，实际应用时还可以在设备配置模块具体配置家电设备与手势动作的对应关系时提供交互界面供用户自定义手势动作。
功能二，手势识别；
为了满足智能手表等可穿戴设备对资源和功耗的要求，在本实施例中通过MEMS传感器采集到待识别特征数据后，首先采用PCA(Principal Component Analysis，主成分分析)算法降低数据维数。
通过采用主成分分析，可以根据计算过程中的特征值大小来决定各独立成分的重要性，并选择最重要的成分，将原始待识别特征数据降至一维，在降低计算复杂度的同时可以去除一部分噪声，降低了对用户执行手势动作时的姿态要求。然后再对降维后的数据进一步执行识别算法(如，模板匹配或机器学习等算法)，在降低计算复杂度的同时实现准确的手势识别。
图3是本发明一个实施例的手势识别的流程示意图；参见图3，采用基于三轴加速度传感器(或三轴角速度传感器)的手势识别包括预处理、主成分分析处理、特征提取、手势匹配等处理过程。为了降低计算量，本实施例采用了PCA方法将三维加速度数据降为一维再进行匹配和识别等处理。对于手势模板和测试序列的具体处理过程如下：
步骤S31，通过三轴加速度传感器采集数据，得到三维加速度模板序列(或三维加速度测试序列)；进入步骤S32，
步骤S32，预处理，对采集到的三维加速度传感器数据进行预处理，可以采用均值滤波、Butterworth滤波等处理方法，以滤除干扰噪声，如果采集的是模板序列则进入步骤S330，如果采集的是测试序列，则进入步骤S331。
步骤S330，对于模板序列，将三维加速度序列进行PCA处理，得到主成分的特征向量空间，对 模板序列进行特征提取降维后(如，相邻数据点的均值、方差，或直接提取波形变化特征)，得到一维模板特征序列，进入步骤S34。
步骤S331，对于测试序列，将三维加速度序列投影到模板序列的主成分特征向量空间，进行特征提取后得到一维测试特征序列，进入步骤S34。
步骤S34，手势动作识别；
得到模板序列或测试序列的特征序列后，将测试特征序列与各模板特征序列进行匹配(如，采用模板匹配或机器学习方法匹配识别)，得到识别结果，其中，模板特征序列可以保存到模板库中用于手势动作识别和匹配。
关于步骤S34中的手势动作识别更详细的计算过程可以参见现有技术中的主成分分析的相关内容，本实施例中不再赘述。
需要说明的是，本实施例中采用了主成分分析对采集的原始加速度信号进行特征提取和数据降维，但不限于此，在其他实施例中也可以采取其他的降维方法和手段。
设备配置模块202
设备配置模块用于将待控制的智能家居设备的控制与用户的手势动作建立联系，使得用户可以佩戴智能手表后通过手势对智能家居设备进行控制。注册的一种实现方式是，智能手表与智能家居控制服务器通过BLE建立连接并登录后，在执行配置操作时，通过无线连接模块从智能家居控制服务器获取智能家居控制服务器连接的所有家电设备的信息列表，然后在智能手表的交互界面上呈现，方便佩戴者随时登录配置界面对相关的家电设备和手势进行修改。例如，通过设备配置模块，接收佩戴者在智能手表的交互界面呈现的家电设备信息列表中选择添加或删除家电设备的指令，然后根据佩戴者的添加指令建立添加的家电设备的控制命令与手势动作间的对应关系后保存；或者，根据佩戴者的删除指令，解除删除的家电设备的控制指令与手势动作间的对应关系后保存。
通过在本实施例的智能手表的交互界面上，呈现家电设备列表，接收用户从该家电设备列表中选择的想要进行手势控制的家电设备，然后基于用户的这一添加操作，建立添加的家电设备的控制命令对应的手势动作，或者接收用户在智能手表的交互界面上输入的从已进行手势控制的家电设备列表中删除某一家电设备的操作，并基于用户的这一删除操作，解除该删除操作对应的家电设备的控制命令与手势动作的对应关系，这样，一方面更加个性化，增强用户的参与感，优化用户使用体验。另一方面，每个手势动作可以重复使用来控制多个家电设备，例如，用户一段时间内经常使用某个家电设备，可以通过添加操作把这个家电设备添加到家电设备列表中进行手势控制，如果后续不再经常使用该家电设备可以删除该家电设备并解除家电设备与手势动作的对应关系，这样，同一个手势动作也可以被重复使用，避免了多次设计不同的手势动作。
通过将不同家电设备的控制命令与相应的手势(默认手势动作或自选手势动作)进行关联，然后将家电设备的配置信息保存以方便后续进行手势动作查找、匹配。
配置成功后，智能手表即可通过设定的不同手势动作与相对应的家电设备的控制命令，实现对家电设备状态的控制。
无线连接模块203
无线连接模块203主要用于同智能家居控制服务器进行无线通信。
为了保证利用智能手表和手势动作控制智能家居设备的安全性，在首次使用智能手表进行控制时，与智能家居控制服务器建立BLE连接后，通过智能手表中的无线连接模块将智能手表的注册信息以及佩戴者的身份信息发送到智能家居控制服务器，智能家居控制服务器对该智能手表以及佩戴者进行验证，认证通过后完成智能手表以及佩戴者的注册。通过对智能手表以及佩戴者的身份信息进行验证，防止外人采用同样的可穿戴设备对家电设备进行控制，保证了采用手势动作控制智能家居的安全性。
为了方便用户的操作，验证成功后智能手表再次通过BLE方式连接到智能家居控制服务器时，可以只发送登录信息到智能家居控制服务器，实现自动登录，而不需要再次进行验证。
在本发明的其他实施例中，为进一步保证安全性，智能手表还可以对智能家居服务器进行验证，即进行双向验证，智能手表获取智能家居控制服务器的注册信息并保存，后续使用过程中，智能手表的无线连接模块只向注册的智能家居控制服务器发送登录请求；智能家居控制服务器获取智能手表以及智能手表佩戴者的注册信息并保存，智能家居控制服务器只接受注册的智能手表和佩戴者的控制命令，如此，防止非认证用户使用智能手表控制家电设备，保证了智能手表控制家电设备的安全性。
本实施例中，无线连接模块203接收到设备配置模块202发送的包含手势动作对应的家电设备唯一标识ID以及控制命令的控制报文后，将这一控制报文发送到智能家居控制服务器，智能家居控制服务器再根据控制报文实现对指定家电设备的状态控制。
另外，无线连接模块203还用于接收智能家居控制服务器发送来的反馈信息(如控制成功与否，所控制的家电设备当前状态等信息)，将该反馈信息发送给智能手表的设备配置模块，使得设备配置模块控制输出相应的提醒信息给佩戴者。
图4是本发明一个实施例的智能手表的工作流程图；参见图4，智能手表的一次控制过程包括如下步骤S41至步骤S46：
步骤S41，传感器采集数据，然后进入步骤S42；
通过传感器采集佩戴者的待识别特征数据，这里的传感器包括加速度传感器和角速度传感器(如陀螺仪)，通过三轴加速度传感器或三轴角速度传感器采集得到佩戴者的待识别三轴加速度数据序列或三轴角速度数据序列。
步骤S42，判断是否为手势数据，是则，执行步骤S43，否则返回执行步骤S41；
具体的，以加速度传感器为例，当采集到三轴加速度数据信号后，对该三轴加速度数据信号先进行降低数据维数处理，降至一维，从而降低计算复杂度，减少噪声，然后再对一维的加速度信号进 行模板匹配，确定本次采集的加速度信号是否为手势动作。由于实际应用过程中佩戴者可能发生误操作，所以需要进行判断是否为手势数据，如果不是手势数据即可不进行下面的处理环节以节省功耗，并且也保证了控制的准确性。
步骤S43，手势动作识别；利用保存的手势动作模板进行手势动作识别，然后进入步骤S44，
利用预先保存的手势动作模板以及相应手势动作与家电设备的控制命令间的对应关系，对当前的手势动作进行匹配，根据匹配到的家电设备信息以及控制命令生成控制报文。具体的，本步骤中需要将步骤S42的手势数据序列和预先保存的手势动作模板中的手势动作序列进行匹配，确定出手势动作的类型。这里的，相应手势动作包括：默认手势动作和自选手势动作；智能手表可以通过如下方式设置默认手势动作与家电设备的控制命令间的对应关系：将顺时针方向的画矩形的手势动作和逆时针方向的画矩形的手势动作分别对应于第一类型家电设备的开启控制命令和关闭控制命令；将顺时针方向的画圆形的手势动作和逆时针方向的画圆形的手势动作分别对应于第二类型家电设备的开启控制命令和关闭控制命令；将从上到下方向的画折线的手势动作和从下到上方向的画折线的手势动作分别对应于第三类型家电设备的开启控制命令和关闭控制命令。以及，通过如下方式设置自选手势动作与家电设备的控制命令间的对应关系：在可穿戴设备的交互界面上接收用户输入的自选手势动作，并建立自选手势动作与家电设备的控制命令间的对应关系。
在其他实施例中，智能手表还可以通过如下方式建立相应手势动作与家电设备的控制命令间的对应关系：接收佩戴者在可穿戴设备的交互界面呈现的家电设备信息列表中选择添加或删除家电设备的指令，并根据佩戴者的添加指令建立添加的家电设备的控制命令与手势动作间的对应关系；或者，根据佩戴者的删除指令，解除删除的家电设备的控制指令与手势动作间的对应关系。
步骤S44，判断是否为有效手势动作；是则，执行步骤S45，否则执行步骤S41；
可选地，本实施例中还提供了判断识别出的手势动作是否为有效手势动作的步骤，以进一步保证手势动作控制的准确性。由于实际应用时，用户可通过智能手表的交互界面上对手势动作与家电设备以及控制指令的对应关系进行修改，这时可能出现基于手势动作模板识别出的手势动作中已经过时的情况。例如，修改前，打开电视这一控制命令对应的手势动作为顺时针画圆，在后续使用过程中佩戴者将这一控制命令修改为顺时针画矩形。如果此时智能手表识别出用户当前的手势动作为顺时针画圆，则，判断该手势动作为无效手势动作(即与当前保存的手势动作与家电设备以及控制命令的对应关系不符合)。
步骤S45，查询保存的对应关系，然后进入步骤S46；
这里智能手表端预先建立了相应手势动作与家电设备以及家电设备的控制命令间的对应关系，并将对应关系保存到了数据库中。在收到步骤S44确定的当前手势动作为有效手势动作信息后，查询保存的对应关系，从而找到该手势动作匹配的家电设备的ID以及家电设备的控制命令。这里的控制命令包括：开启家电设备的命令或关闭家电设备的命令，或者还包括：调整家电设备的相应状态的命 令(如调整智能电视的音量)，对此不做限制。
步骤S46，生成控制报文并发送；
将生成的控制报文无线发送至智能家居控制服务器，以使得智能家居控制服务器根据控制报文控制家电设备的状态。具体的，在得到家电设备的ID以及控制命令后，根据该家电设备ID以及控制命令制作生成控制报文，并将控制报文发送给无线连接模块，由无线连接模块发送给智能家居控制服务器，至此智能手表佩戴者完成了一次家电设备控制。然后返回，重复执行步骤S41至步骤S46。在首次连接到智能家居控制服务器时，发送可穿戴设备的注册信息以及佩戴者的身份信息给智能家居控制服务器，以使得该智能家居控制服务器对该可穿戴设备以及佩戴者进行验证；
以及在验证成功后再次连接到智能家居控制服务器时，发送登录信息至智能家居控制服务器。
实施例三
图5是本发明一个实施例的智能家居控制服务器的结构框图，本实施例中主要是对智能家居控制服务器的结构进行说明，其他内容参见本发明的其他实施例。
本实施例中，智能家居控制服务器50包括三个模块，分别是连接控制模块501、命令解析模块502、家电设备控制模块503。智能家居控制服务器50监听并收到智能手表控制端发送过来的控制报文后，从控制报文中解析出家电设备ID和相应的控制命令，根据家电设备ID在预先保存的家电设备信息列表中查询出相应的设备网络地址和端口号，然后再将控制指令发送给网络地址和端口号对应的家电设备，从而实现根据智能手表佩戴者的手势动作控制家电设备状态的有益效果，另外，在其他实施例中，智能家居控制服务器50还可以将相关的反馈信息发送给智能手表端，使得智能手表端可以向用户输出提醒信息，提示用户及时了解针对手势动作的执行结果。
下面结合图5对智能家居控制服务器50的每个模块分别进行说明：
连接控制模块501
该模块用于与智能手表的无线连接模块建立无线连接，接收和发送通信数据，功能具体包括：建立与智能手表间的蓝牙低功耗BLE等无线连接；在首次使用智能手表控制家电设备时，验证智能手表，完成智能手表的注册。
具体的，连接控制模块501在与智能手表首次建立无线连接后，接收智能手表发送的智能手表的注册信息以及佩戴者的身份信息，然后对注册信息以及身份信息进行验证，并在验证通过时返回登录页面给智能手表，接收智能手表发送的登录信息。
经过身份认证后，连接控制模块监听智能手表的连接请求，进一步的可接收智能手表发送的家电设备控制报文，并交给命令解析模块502进行处理；以及向智能手表控制端发送相关的反馈信息。
命令解析模块502
该模块主要用于从连接控制模块501接收控制报文，并对收到的控制报文进行解析，获取控制报文中的家电设备ID和控制命令信息，然后将这些信息传输给家电设备控制模块503做进一步处理。
家电设备控制模块503
该模块根据命令解析模块502获得的家电设备ID，从保存的家电设备信息列表中查询得到家电设备ID对应的网络地址和端口号，并判断该家电设备ID是否为有效ID，控制命令是否为有效控制命令。如果设备ID和控制命令中有一个无效，则不做处理，直接通过连接控制模块501将反馈信息(如，家电设备ID无效)发送给智能手表端。如果有效，则根据家电设备ID对应的网络地址和端口号将控制命令及其参数发送给相应的家电设备执行相应的控制命令，实现控制功能。
可选地，家电设备控制模块503还可以返回家电设备当前的状态信息给连接控制模块501，并通过连接控制模块501将反馈信息发送至智能手表控制端。
图6是本发明又一个实施例的智能家居控制服务器的工作流程图，参见图6，本实施例中，智能家居控制服务器的一次控制流程包括如下步骤S61至步骤S66：
步骤S61，监听和接收智能手表端的控制报文，然后进入步骤S62；
接收智能手表无线发送的控制报文，具体的，智能家居控制服务器建立与智能手表端之间的蓝牙低功耗BLE等无线连接，并监听连接状态，获取智能手表端发送来的控制报文。
步骤S62，解析获得家电设备ID和控制命令，然后进入步骤S63；
本步骤中对控制报文进行解析，得到家电设备信息以及控制命令；具体的，对接收到的控制报文进行解析得到家电设备ID和控制命令。
步骤S63，根据ID查询家电设备地址和端口号，然后进入步骤S64；
本步骤中根据家电设备信息查找对应的家电设备，具体的，根据步骤S62中解析得到的家电设备ID在预先保存的家电设备信息列表中查询家电设备ID对应的家电设备的网络地址和端口号。
步骤S64，判断是否为有效家电设备ID和控制命令，是则进入步骤S65，否则，进入步骤S66；
可选地，本实施例中还包括判断解析得到的家电设备ID和控制命令是否是有效的操作，例如，在预先保存的家电设备信息列表中查找解析得到的ID是否存在，如果存在，则确定该解析得到的家电设备ID为有效，否则，确定解析得到的家电设备ID为无效，如果家电设备ID无效，智能家居控制服务器可以向智能手表端返回相应的信息(如，该家电设备ID无效的信息)，以提醒智能手表端对发送的家电设备ID进行确认。
步骤S65，发送控制命令到指定家电设备；
根据步骤S63中查询到的家电设备ID对应的家电设备的网络地址和端口号，将控制命令发送给相应的家电设备执行，以实现对家电设备的状态的控制。
步骤S66，给智能手表端发送反馈信息。
在对家电设备的控制操作执行完成后，智能家居控制服务器可以从家电设备处获取执行结果， 并将执行结果反馈给智能手表端，使得智能手表端可以根据反馈信息，输出相应的提醒信息以提醒佩戴者。如，智能手表控制内置的振动马达发出预定频率的振动提醒佩戴者，家电设备控制成功或失败。
实施例四
图7是本发明一个实施例的智能家居控制系统的网络结构图，图8是本发明一个实施例的智能家居控制系统的结构框图，本实施例中主要是结合图7和图8对智能家居控制服务器的结构进行说明，其他内容参见本发明的其他实施例。
参见图7，智能家居控制系统包括智能家居控制服务器(即图7中示出的电脑)，与智能家居控制服务器无线连接的多个智能家电设备(电视、空调和照明灯)。实际应用的过程中，家庭内部可以安装一个家电设备的中央控制器，该中央控制器通过网络和智能家居控制服务器连接。
智能家电设备通过Wi-Fi或ZigBee等无线方式连接到智能家居控制服务器，组成了一个家庭的内部网络，并由智能家居控制服务器统一控制、协调和管理。为了方便用户对智能家居的控制操作，本实施例的智能家居控制系统中通过智能手表的佩戴者执行一定的手势动作来实现。
参见图7，在家庭网络内部，智能手表通过BLE无线方式与智能家居控制服务器建立连接，利用智能手表中的MEMS传感器获取待识别数据，采用匹配识别算法识别用户发出的手势动作，并基于该手势动作生成相应的控制命令给智能家居控制服务器。然后，智能家居控制服务器根据所接收的手势控制命令，实现对匹配到的家电设备进行相应的控制。
如图8所示，该智能家居控制系统包括：智能手表控制端80、服务端(即智能家居控制服务器)81，以及与该服务端无线连接的智能家电设备。其中，智能手表控制端80包括手势识别模块801、设备配置模块802以及无线连接模块803；智能家居控制服务器81包括连接控制模块811、命令解析模块812、家电设备控制模块813。
智能手表控制端80的手势识别模块801具体通过传感器采集佩戴者的待识别特征数据，识别出佩戴者当前的手势动作；设备配置模块802利用预先保存的相应手势动作与家电设备的控制命令间的对应关系，对当前的手势动作进行匹配，根据匹配到的家电设备信息以及控制命令生成控制报文；无线连接模块803将生成的控制报文无线发送至智能家居控制服务器81。
智能家居控制服务器81的连接控制模块811与智能手表建立无线连接，并接收智能手表发送的控制报文，将该控制报文发送给命令解析模块812；命令解析模块812，对接收的控制报文进行解析，将解析得到的家电设备信息以及控制命令发送给家电设备控制模块813；家电设备控制模块813，根据接收到的家电设备信息查找对应的家电设备，并将控制命令发送给该家电设备执行，以实现对家电设备状态的控制。
需要说明的是，本发明实施例中的智能家居控制系统包括的智能手表端的具体工作过程、智能家居控制服务器的工作过程可以参见本发明其他实施例中的相关描述，在此不再赘述。
综上所述，本发明实施例的技术方案利用可穿戴设备进行家电设备的控制，这样可穿戴设备的 佩戴者只需通过执行一定的手势动作即可对不同的家电设备进行方便直观的控制，避免了通过智能手机等其它设备相对繁琐的控制方式。并且可穿戴设备中内置MEMS传感器，这种基于MEMS传感器的手势识别灵活可靠，不受环境、光线的影响，系统实现简单。
另外，可穿戴设备一般都会长期戴在用户身上，佩戴者随时可以通过执行手势动作发出不同的控制命令，更便捷地实现佩戴者与家电设备的交互，不需要寻找使用遥控器和智能手机等控制终端，与传统控制方式相比，节省了时间、提升了效率，增强了用户体验。
而且，本实施例的技术方案对手势动作识别进行了改进，通过采用主成分分析PCA将原始加速度信号降至一维，与现有技术的手势识别直接在三维数据上分别进行操作相比，降低了计算复杂度；另外，由于对原始三维数据进行了降维处理后进行动作识别和匹配，降低了对用户执行手势时的姿态要求，使得用户可以相对随意地执行手势动作。
以上所述仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内所作的任何修改、等同替换、改进等，均包含在本发明的保护范围内。

Claims (14)

  1. 一种可穿戴设备，其中，该可穿戴设备包括：手势识别模块、无线连接模块和设备配置模块；
    所述手势识别模块，用于通过传感器采集得到佩戴者的待识别特征数据，识别出佩戴者当前的手势动作，将该手势动作的信息发送给所述设备配置模块；
    所述设备配置模块，用于根据获取到的各家电设备的信息，建立各家电设备的控制命令与相应的手势动作间的对应关系并保存；以及，用于当接收到手势识别模块发送的手势动作的信息时，利用保存的对应关系查找该手势动作匹配的家电设备以及控制命令，根据匹配的家电设备以及控制命令生成控制报文，将生成的控制报文发送给所述无线连接模块；
    所述无线连接模块，用于接收所述设备配置模块发送的控制报文并将所述控制报文无线发送至智能家居控制服务器，以使得智能家居控制服务器根据所述控制报文控制家电设备的状态。
  2. 根据权利要求1所述的可穿戴设备，其中，
    所述设备配置模块中设置有默认手势动作的信息，
    所述设备配置模块，建立各家电设备的控制命令与默认手势动作间的对应关系后保存；
    或者，所述设备配置模块，接收佩戴者通过可穿戴设备的交互界面输入的自选手势动作的信息，并建立各家电设备的控制命令与自选手势动作间的对应关系后保存。
  3. 根据权利要求2所述的可穿戴设备，其中，所述设备配置模块具体通过如下方式设置各家电设备的控制命令与默认手势动作间的对应关系：
    将顺时针方向的画矩形的手势动作和逆时针方向的画矩形的手势动作分别对应于第一类型家电设备的开启控制命令和关闭控制命令；
    将顺时针方向的画圆形的手势动作和逆时针方向的画圆形的手势动作分别对应于第二类型家电设备的开启控制命令和关闭控制命令；
    将从上到下方向的画折线的手势动作和从下到上方向的画折线的手势动作分别对应于第三类型家电设备的开启控制命令和关闭控制命令。
  4. 根据权利要求1所述的可穿戴设备，其中，
    所述无线连接模块，还用于在首次连接到智能家居控制服务器时，将该可穿戴设备的注册信息以及佩戴者的身份信息发送给所述智能家居控制服务器，使得该智能家居控制服务器对该可穿戴设备以及佩戴者进行验证；
    以及用于在验证成功后再次连接到智能家居控制服务器时，发送登录信息至智能家居控制服务器。
  5. 根据权利要求1所述的可穿戴设备，其中，
    所述手势识别模块，具体用于通过三轴加速度传感器或三轴角速度传感器采集得到佩戴者的待识别三轴加速度数据序列或三轴角速度数据序列；
    利用主成分分析对所述三轴加速度数据序列或三轴角速度数据序列进行特征提取，降低所述三轴加速度数据序列或三轴角速度数据序列的数据维数至一维；
    将降维后的一维加速度数据序列或一维角速度数据序列与对应的模板特征数据序列进行比较，以识别出佩戴者当前的手势动作；其中，所述模板特征数据序列包括加速度模板数据序列和角速度模板数据序列，并且加速度模板数据序列的数据维数和角速度模板数据序列的数据维数也为一维。
  6. 根据权利要求2所述的可穿戴设备，其中，
    所述设备配置模块，接收佩戴者在可穿戴设备的交互界面呈现的家电设备信息列表中选择添加或删除家电设备的指令，并根据佩戴者的添加指令建立添加的家电设备的控制命令与手势动作间的对应关系后保存；或者，根据佩戴者的删除指令，解除删除的家电设备的控制指令与手势动作间的对应关系后保存。
  7. 一种智能家居控制系统，其中，该智能家居控制系统包括：
    权利要求1-6任一项所述的可穿戴设备，智能家居控制服务器，以及，与所述智能家居控制服务器之间无线连接的多个家电设备；
    所述可穿戴设备基于用户的手势动作向智能家居控制服务器发送控制命令，智能家居控制服务器通过该无线连接将控制命令发送各家电设备，从而实现对各家电设备的控制。
  8. 根据权利要求7所述的智能家居控制系统，其中，所述智能家居控制服务器包括：连接控制模块，命令解析模块和家电设备控制模块：
    所述连接控制模块，用于与可穿戴设备建立无线连接，并接收可穿戴设备发送的控制报文，将该控制报文发送给命令解析模块；
    所述命令解析模块，用于对接收的控制报文进行解析，将解析得到的家电设备信息以及控制命令发送给家电设备控制模块；
    所述家电设备控制模块，用于根据接收到的家电设备信息查找对应的家电设备，并将所述控制命令发送给该家电设备执行，以实现对家电设备状态的控制。
  9. 根据权利要求8所述的智能家居控制系统，其中，所述命令解析模块，从接收的控制报文中解析出家电设备的唯一标识ID，将解析得到的家电设备ID以及控制命令发送给家电设备控制模块；
    所述家电设备控制模块，接收到家电设备ID以及控制命令后，在保存的家电设备信息列表中查 找是否存在该家电设备ID；若存在，则将控制命令发送至该家电设备ID对应的家电设备执行；
    以及，接收家电设备反馈的执行结果，将该执行结果经所述连接控制模块发送至可穿戴设备，使得所述可穿戴设备根据执行结果向用户输出提醒信息。
  10. 一种可穿戴设备的控制方法，其中，所述可穿戴设备中设置有传感器，该方法包括：
    通过传感器采集佩戴者的待识别特征数据，识别出佩戴者当前的手势动作；
    利用预先保存的相应手势动作与家电设备的控制命令间的对应关系，对当前的手势动作进行匹配，根据匹配到的家电设备信息以及控制命令生成控制报文；
    将生成的控制报文无线发送至智能家居控制服务器，以使得智能家居控制服务器根据所述控制报文控制家电设备的状态。
  11. 根据权利要求10所述的方法，其中，所述传感器为三轴加速度传感器或三轴角速度传感器；
    所述通过传感器采集佩戴者的待识别特征数据，识别出佩戴者当前的手势动作包括：
    通过三轴加速度传感器或三轴角速度传感器采集得到佩戴者的待识别三轴加速度数据序列或三轴角速度数据序列；
    利用主成分分析对所述三轴加速度数据序列或三轴角速度数据序列进行特征提取，降低所述三轴加速度数据序列或三轴角速度数据序列的数据维数至一维；
    将降维后的一维加速度数据序列或一维角速度数据序列与对应的模板特征数据序列进行比较，识别出佩戴者当前的手势动作；其中，所述模板特征数据序列包括加速度模板数据序列和角速度模板数据序列，并且加速度模板数据序列的数据维数和角速度模板数据序列的数据维数也为一维。
  12. 根据权利要求10所述的方法，其中，所述相应手势动作包括：默认手势动作和自选手势动作；
    通过如下方式设置自选手势动作与家电设备的控制命令间的对应关系：
    在可穿戴设备的交互界面上接收用户输入的自选手势动作，并建立自选手势动作与家电设备的控制命令间的对应关系；
    该方法包括：通过如下方式设置默认手势动作与家电设备的控制命令间的对应关系：
    将顺时针方向的画矩形的手势动作和逆时针方向的画矩形的手势动作分别对应于第一类型家电设备的开启控制命令和关闭控制命令；
    将顺时针方向的画圆形的手势动作和逆时针方向的画圆形的手势动作分别对应于第二类型家电设备的开启控制命令和关闭控制命令；
    将从上到下方向的画折线的手势动作和从下到上方向的画折线的手势动作分别对应于第三类型家电设备的开启控制命令和关闭控制命令。
  13. 根据权利要求10所述的方法，其中，所述方法还包括：
    在首次连接到智能家居控制服务器时，发送可穿戴设备的注册信息以及佩戴者的身份信息给所述智能家居控制服务器，以使得该智能家居控制服务器对该可穿戴设备以及佩戴者进行验证；
    以及在验证成功后再次连接到智能家居控制服务器时，发送登录信息至智能家居控制服务器。
  14. 根据权利要求10所述的方法，其中，该方法还包括：通过如下方式建立相应手势动作与家电设备的控制命令间的对应关系：
    接收佩戴者在可穿戴设备的交互界面呈现的家电设备信息列表中选择添加或删除家电设备的指令，并根据佩戴者的添加指令建立添加的家电设备的控制命令与手势动作间的对应关系；或者，根据佩戴者的删除指令，解除删除的家电设备的控制指令与手势动作间的对应关系。
PCT/CN2016/098082 2015-12-31 2016-09-05 可穿戴设备及其控制方法、智能家居控制系统 Ceased WO2017113871A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/540,808 US20180006840A1 (en) 2015-12-31 2016-09-05 Wearable device and controlling method thereof, and system for controlling smart home

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201511031455.0A CN105549408B (zh) 2015-12-31 2015-12-31 可穿戴设备、智能家居服务器及其控制方法和系统
CN201511031455.0 2015-12-31

Publications (1)

Publication Number Publication Date
WO2017113871A1 true WO2017113871A1 (zh) 2017-07-06

Family

ID=55828659

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/098082 Ceased WO2017113871A1 (zh) 2015-12-31 2016-09-05 可穿戴设备及其控制方法、智能家居控制系统

Country Status (3)

Country Link
US (1) US20180006840A1 (zh)
CN (1) CN105549408B (zh)
WO (1) WO2017113871A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112799306A (zh) * 2019-11-14 2021-05-14 原相科技股份有限公司 智能型家庭控制系统
CN113126772A (zh) * 2021-05-07 2021-07-16 深圳电目科技有限公司 移动开关的手势控制方法和系统
CN116449720A (zh) * 2023-03-31 2023-07-18 深圳开鸿数字产业发展有限公司 智能家居控制方法、装置、设备及介质

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105549408B (zh) * 2015-12-31 2018-12-18 歌尔股份有限公司 可穿戴设备、智能家居服务器及其控制方法和系统
CN105955041A (zh) * 2016-05-25 2016-09-21 北京行云时空科技有限公司 可穿戴设备与智能家居交互控制方法、系统及可穿戴设备
CN106037433A (zh) * 2016-05-28 2016-10-26 苏州众天力信息科技有限公司 基于三轴传感的窗帘控制系统及方法
CN106019959B (zh) * 2016-06-01 2019-04-23 深圳市共进电子股份有限公司 一种智能家居设备控制方法、装置及系统
CN106054627B (zh) * 2016-06-12 2020-02-11 珠海格力电器股份有限公司 基于手势识别的控制方法、装置及空调
CN106137167A (zh) * 2016-07-21 2016-11-23 浙江师范大学 一种基于光电容积脉搏波信号的运动噪声检测方法
US20180088671A1 (en) * 2016-09-27 2018-03-29 National Kaohsiung University Of Applied Sciences 3D Hand Gesture Image Recognition Method and System Thereof
CN106395198B (zh) * 2016-11-23 2019-02-12 北京小米移动软件有限公司 智能垃圾桶的控制方法及装置
CN106527598B (zh) * 2016-12-15 2020-09-22 公安部第三研究所 一种用于公安执法的警用腕式穿戴设备及应用系统
CN106793397B (zh) * 2016-12-19 2019-10-22 北京小米移动软件有限公司 照明控制方法及终端
CN106774934A (zh) * 2017-01-06 2017-05-31 广东小天才科技有限公司 多媒体播放进度控制方法及系统
CN108429722B (zh) * 2017-02-15 2021-01-05 飞天联合（北京）系统技术有限公司 机舱的控制方法、控制系统和可穿戴设备
CN106950927B (zh) * 2017-02-17 2019-05-17 深圳大学 一种控制智能家居的方法和智能穿戴设备
CN106899509A (zh) * 2017-03-16 2017-06-27 普联技术有限公司 一种路由器管理方法与路由器
CN109213309A (zh) * 2017-06-30 2019-01-15 中兴通讯股份有限公司 一种手势识别方法及装置、系统
CN107318175A (zh) * 2017-08-23 2017-11-03 上海摩软通讯技术有限公司 无线音频再现装置及其配对方法
US10887125B2 (en) 2017-09-15 2021-01-05 Kohler Co. Bathroom speaker
US11093554B2 (en) 2017-09-15 2021-08-17 Kohler Co. Feedback for water consuming appliance
US11314214B2 (en) 2017-09-15 2022-04-26 Kohler Co. Geographic analysis of water conditions
US11099540B2 (en) 2017-09-15 2021-08-24 Kohler Co. User identity in household appliances
CN107885089A (zh) * 2017-11-06 2018-04-06 四川长虹电器股份有限公司 基于自定义语音指令库的智慧家居语音操控方法
CN108255297A (zh) * 2017-12-29 2018-07-06 青岛真时科技有限公司 一种可穿戴设备应用控制方法和装置
CN108400914A (zh) * 2018-02-11 2018-08-14 张戈零 基于蓝牙通信的物联网控制方法
US10713935B2 (en) * 2018-02-23 2020-07-14 Nokia Technologies Oy Control service for controlling devices with body-action input devices
CN108513065A (zh) * 2018-03-23 2018-09-07 云谷（固安）科技有限公司 一种手势帖遥控操作的方法及手势帖遥控装置
CN108600057A (zh) * 2018-03-29 2018-09-28 深圳大学 一种基于WiFi感知控制家用电器的方法及系统
CN108632373B (zh) * 2018-05-09 2021-11-30 方超 设备控制方法和系统
CN108717271A (zh) * 2018-05-30 2018-10-30 辽东学院 人机交互控制方法、装置、系统及可读存储介质
CN109189209A (zh) * 2018-07-24 2019-01-11 中国联合网络通信集团有限公司 房屋设备的操作方法及装置
CN110837227A (zh) * 2018-08-15 2020-02-25 格力电器（武汉）有限公司 电器控制方法及装置
CN110874131A (zh) * 2018-08-29 2020-03-10 杭州海康威视数字技术股份有限公司 楼宇对讲室内机及其控制方法、存储介质
CN109245972B (zh) * 2018-09-30 2021-09-03 中山乐心电子有限公司 训练宠物控制家居设备的方法及控制家居设备的宠物设备
CN109212996A (zh) * 2018-11-13 2019-01-15 奇瑞汽车股份有限公司 智能家居设备控制方法及装置
CN109870984B (zh) * 2018-12-26 2020-09-11 浙江大学 一种基于可穿戴设备的多家电控制方法
CN109946986B (zh) * 2019-03-25 2023-09-19 努比亚技术有限公司 家电控制方法、可穿戴设备及计算机可读存储介质
CN110083234A (zh) * 2019-03-28 2019-08-02 上海微阱电子科技有限公司 一种物品智能管理系统
CN110136706A (zh) * 2019-04-11 2019-08-16 北京宙心科技有限公司 一种可穿戴智能设备及其工作方法
CN109996371A (zh) * 2019-04-24 2019-07-09 深圳尚一互联技术有限公司 用于智能手环的手势控制灯光的方法
CN112176669A (zh) * 2019-07-05 2021-01-05 青岛海尔洗衣机有限公司 一种智能晾衣架的控制方法
KR102732364B1 (ko) * 2019-07-25 2024-11-25 애플 인크. 기계 학습 기반 제스처 인식
CN110657386A (zh) * 2019-10-12 2020-01-07 上海理工大学 一种降低无线控制延时的智能舞台莲花艺术灯具
CN110865731A (zh) * 2019-10-23 2020-03-06 深圳英众世纪智能科技有限公司 辅助触控装置、方法和电子设备
CN111158246A (zh) * 2019-12-06 2020-05-15 珠海格力电器股份有限公司 一种智能家电控制系统、装置、方法、介质和设备
US20210390957A1 (en) * 2020-06-11 2021-12-16 Orcam Technologies Ltd. Systems and methods for processing audio and video
CN112055275A (zh) * 2020-08-24 2020-12-08 江西台德智慧科技有限公司 一种基于云平台的智能交互音响系统
CN112187714A (zh) * 2020-08-25 2021-01-05 珠海格力电器股份有限公司 设备控制方法、装置、设备及计算机可读介质
CN112217699A (zh) * 2020-10-09 2021-01-12 珠海格力电器股份有限公司 智能家居设备的控制方法和装置
CN112558762A (zh) * 2020-12-10 2021-03-26 珠海格力电器股份有限公司 家电设备控制方法、家电设备、管理系统及存储介质
CN112965391A (zh) * 2021-01-29 2021-06-15 青岛海尔空调器有限总公司 用于家电控制的方法、家电控制系统和可穿戴设备
CN115840371A (zh) * 2021-06-18 2023-03-24 苏州触达信息技术有限公司 利用指向命令实现智能设备快捷控制的方法
CN115604672B (zh) * 2021-07-08 2025-08-29 Oppo广东移动通信有限公司 设备控制方法、装置、控制系统、设备及存储介质
CN113630454A (zh) * 2021-08-02 2021-11-09 胜斗士(上海)科技技术发展有限公司 物联网管理方法和系统
CN114047709B (zh) * 2021-11-09 2023-12-08 杭州逗酷软件科技有限公司 设备控制方法、装置、智能手表、芯片及存储介质
CN114488831B (zh) * 2022-01-10 2023-09-08 锋芒科技南京有限公司 一种基于人机交互的物联网家居智能控制系统及方法
CN116094861A (zh) * 2022-08-30 2023-05-09 荣耀终端有限公司 遥控电子设备的方法、设备及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104102183A (zh) * 2013-04-13 2014-10-15 王斌 一种智能家居手势控制方法及装置
US20150072619A1 (en) * 2013-09-10 2015-03-12 Playtabase, LLC Wireless motion activated user device with bi-modality communication
US20150100323A1 (en) * 2013-10-04 2015-04-09 Panasonic Intellectual Property Corporation Of America Wearable terminal and method for controlling the same
CN104639966A (zh) * 2015-01-29 2015-05-20 小米科技有限责任公司 遥控方法及装置
CN105184325A (zh) * 2015-09-23 2015-12-23 歌尔声学股份有限公司 一种人体动作识别方法和移动智能终端
CN105549408A (zh) * 2015-12-31 2016-05-04 歌尔声学股份有限公司 可穿戴设备、智能家居服务器及其控制方法和系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7427024B1 (en) * 2003-12-17 2008-09-23 Gazdzinski Mark J Chattel management apparatus and methods
US9891718B2 (en) * 2015-04-22 2018-02-13 Medibotics Llc Devices for measuring finger motion and recognizing hand gestures
KR20150135330A (ko) * 2013-04-01 2015-12-02 도요탄소 가부시키가이샤 베어링용 탄소 재료 및 상기 베어링용 탄소 재료로 이루어진 슬라이딩 부재
WO2015079436A1 (en) * 2013-11-26 2015-06-04 Kytera Technologies Ltd. Systems and methods for analysis of subject activity
CN105830475B (zh) * 2013-12-18 2019-07-16 苹果公司 附近的设备之间的基于手势的信息交换
US20160328604A1 (en) * 2014-01-07 2016-11-10 Arb Labs Inc. Systems and methods of monitoring activities at a gaming venue
US10222868B2 (en) * 2014-06-02 2019-03-05 Samsung Electronics Co., Ltd. Wearable device and control method using gestures
KR102287160B1 (ko) * 2014-07-31 2021-08-06 엘지전자 주식회사 웨어러블 디바이스 및 그것의 제어방법
KR102287949B1 (ko) * 2014-12-01 2021-08-09 삼성전자주식회사 디바이스를 관리하는 방법 및 장치
WO2016100368A1 (en) * 2014-12-16 2016-06-23 Somatix, Inc. Methods and systems for monitoring and influencing gesture-based behaviors
CN104867311A (zh) * 2015-05-14 2015-08-26 连宁 通过第三方终端配置无线遥控终端的方法和装置
CN105303371A (zh) * 2015-11-24 2016-02-03 小米科技有限责任公司 账单处理方法、装置和终端设备
US9939910B2 (en) * 2015-12-22 2018-04-10 Intel Corporation Dynamic effects processing and communications for wearable devices
CN105467852A (zh) * 2015-12-29 2016-04-06 惠州Tcl移动通信有限公司 一种基于智能手表的智能家居控制方法及智能手表

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104102183A (zh) * 2013-04-13 2014-10-15 王斌 一种智能家居手势控制方法及装置
US20150072619A1 (en) * 2013-09-10 2015-03-12 Playtabase, LLC Wireless motion activated user device with bi-modality communication
US20150100323A1 (en) * 2013-10-04 2015-04-09 Panasonic Intellectual Property Corporation Of America Wearable terminal and method for controlling the same
CN104639966A (zh) * 2015-01-29 2015-05-20 小米科技有限责任公司 遥控方法及装置
CN105184325A (zh) * 2015-09-23 2015-12-23 歌尔声学股份有限公司 一种人体动作识别方法和移动智能终端
CN105549408A (zh) * 2015-12-31 2016-05-04 歌尔声学股份有限公司 可穿戴设备、智能家居服务器及其控制方法和系统

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112799306A (zh) * 2019-11-14 2021-05-14 原相科技股份有限公司 智能型家庭控制系统
CN113126772A (zh) * 2021-05-07 2021-07-16 深圳电目科技有限公司 移动开关的手势控制方法和系统
CN113126772B (zh) * 2021-05-07 2023-05-09 深圳电目科技有限公司 移动开关的手势控制方法和系统
CN116449720A (zh) * 2023-03-31 2023-07-18 深圳开鸿数字产业发展有限公司 智能家居控制方法、装置、设备及介质

Also Published As

Publication number Publication date
CN105549408A (zh) 2016-05-04
CN105549408B (zh) 2018-12-18
US20180006840A1 (en) 2018-01-04

Similar Documents

Publication Publication Date Title
WO2017113871A1 (zh) 可穿戴设备及其控制方法、智能家居控制系统
CN111937351B (zh) 通过集线器将多个电子装置连接到服务器的方法和电子装置
CN110535732B (zh) 一种设备控制方法、装置、电子设备及存储介质
CN103529762B (zh) 一种基于传感器技术的智能家居控制方法及系统
US10952267B2 (en) Terminal and method for connecting to target devices
CN105045140A (zh) 智能控制受控设备的方法和装置
CN104579873B (zh) 对智能家居设备进行控制的方法及系统
JP5024495B1 (ja) ジェスチャ入力装置およびジェスチャ入力装置の制御方法
US20200026939A1 (en) Electronic device and method for controlling the same
JP4676303B2 (ja) 端末装置
KR20190099586A (ko) 전자 장치, 전자 장치의 제어방법 및 서버
CN108139856B (zh) 签名认证方法、终端、手写笔及系统
CN105629747A (zh) 智能家居系统的语音控制方法及装置
US20210410201A1 (en) Mobile terminal
CN104766456A (zh) 以便携式智能设备为控制中枢的智能交互系统
EP3610738A1 (en) Method and system for unlocking electronic cigarette
CN112908321A (zh) 设备控制方法、装置、存储介质及电子装置
CN112286070A (zh) 设备控制方法、装置和电子设备
WO2017035963A1 (zh) 指纹识别方法及指纹识别系统
WO2017028654A1 (zh) 显示装置、遥控装置、显示系统和节目推送方法
CN105635093A (zh) 一种访问方法、可穿戴智能设备、鉴权方法及终端
CN110874131A (zh) 楼宇对讲室内机及其控制方法、存储介质
EP4601345A2 (en) Home appliance and method for operating home appliance
KR102102396B1 (ko) 이동 단말기
CN108415572B (zh) 应用于移动终端的模块控制方法、装置及存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 15540808

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16880664

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16880664

Country of ref document: EP

Kind code of ref document: A1