WO2017142390A1 - A type of an auxiliary smart device for human to operate smart device interactively - Google Patents

A type of an auxiliary smart device for human to operate smart device interactively Download PDF

Info

Publication number
WO2017142390A1
WO2017142390A1 PCT/MY2016/050014 MY2016050014W WO2017142390A1 WO 2017142390 A1 WO2017142390 A1 WO 2017142390A1 MY 2016050014 W MY2016050014 W MY 2016050014W WO 2017142390 A1 WO2017142390 A1 WO 2017142390A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
smart device
mentioned
human
control message
Prior art date
Application number
PCT/MY2016/050014
Other languages
French (fr)
Inventor
Hao Lin
Li Zhong
Original Assignee
Linkdood Technologies Sdn Bhd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Linkdood Technologies Sdn Bhd filed Critical Linkdood Technologies Sdn Bhd
Publication of WO2017142390A1 publication Critical patent/WO2017142390A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4185—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by the network communication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/141—Setup of application sessions

Definitions

  • smart device manufacturers will not invest huge fund to improve the intelligence of smart device, as well as major upgrade to smart device control port.
  • Human requires more flexible ways of controlling smart devices; on the other hand, smart devices can achieve higher intelligence due to limited development cost and computing resources of the smart devices.
  • the current invention discloses a type of an auxiliary smart device for human to operate smart device interactively to become the mentor for smart device interaction with human.
  • the objective of the invention is to add auxiliary smart device in between the interaction of human and smart devices, allowing human to be more direct, easy and flexibly control smart devices and have convenient interaction with human without adding complicity to smart device control port.
  • the current invention assisting smart device to understand the irregularly changing messages that human sent without changing the smart device but increase the intelligence and controllability of the smart device.
  • This invention discloses a type of an auxiliary smart device for human to operate smart device interactively, are consisting of IM, smart analysis and security management module.
  • the IM module is used for the network connection for the mentioned device and smart device, to communicate with each other by IM method;
  • Smart analysis module are used to analyze control message from smart device, assisting smart device to understand the control message sent by means of human in natural language or formatted form;
  • Security management module is used in the management and configuration of the mentioned device itself, enables the mentioned device to blend into the interactive system amongst human and smart devices;
  • a mentioned device includes a IM module, a security management module and one or more smart analysis module;
  • a mentioned device can provide service to one or more smart devices.
  • the mentioned device can have communication with human and smart device through IM, in process of human operating smart devices, when smart device can't understand control message, smart device will send the control message to the mentioned device to request for analysis, the mentioned device analyze the control message to command, then revert the command to smart device to execute.
  • the smart device When the mentioned can't understand the smart device forwarded control message sent by human, the smart device will send error message to the human.
  • the mentioned IM module handles the network communication with smart device, receives analysis request and control message from smart device, then revert the control message to smart analysis module, obtain the command or error message to send to smart device after smart analysis module analyses control message and acquire command or creates error message on unable to analyze control message.
  • the mentioned smart analysis module are used to analyze control message sent from IM module that smart device can't understand, analyzes the control message to smart device executable command, revert it to IM module; if not able to analyze control message, will revert error message to IM module.
  • the mentioned smart analysis module can be categorized, designed and materialized based on various means of application, professional use of smart device type, thus design to materialize different types of the mentioned device.
  • the mentioned control message is the message used by human to control smart device, to make smart device to perform functional actions, including message expressed in natural language format and formatted message.
  • the mentioned security management module can be access through network or local dedicated management port, to manage and configure the mentioned device, including own Internet Protocol(IP) address, own IM account, smart device's identification, IP address and IM account list, as well as own update.
  • IP Internet Protocol
  • the mentioned human refers to the user of smart devices, operating the smart device interactively using IM client and application installed through network connection.
  • the mentioned smart device refers to device equipped with computing ability, IoT capability, can bind with IM account and be operated interactively with human and the mentioned device through network or IM.
  • smart devices gained higher intelligence by simplifying or without altering the smart device design smart device design, able to understand smart interaction control messages sent by human, thus greatly improve the controllability and interactive experience.
  • FIG.1 is the structural diagram of the invention - auxiliary smart device
  • the mentioned device is consisting of IM, smart analysis and security management module.
  • the IM module is used for the network connection for the mentioned device and smart device, to communicate with each other by IM method;
  • Smart analysis module are used to analyze control message from smart device, assisting smart device to understand the control message sent by means of human in natural language or formatted form;
  • Security management module is used in the management and configuration if the mentioned device itself, enables the mentioned device to blend into the interactive system amongst human and smart devices;
  • a mentioned device includes a IM module, a security management module and one or more smart analysis module;
  • Various multiple smart analysis module can be design to be realized in a device according to the user and market needs, thus creates a composite auxiliary smart device.
  • the mentioned IM module handles the network communication with smart device, receives analysis request and control message from smart device, then revert the control message to smart analysis module, obtain the command or error message to send to smart device after smart analysis module analyses control message and acquire command or creates error message on unable to analyze control message.
  • the device supports network connection to connect with smart device, as well as highly efficient interactive method of IM.
  • the mentioned smart analysis module are used to analyze control message sent from IM module that smart device can't understand, analyzes the control message to smart device executable command, revert it to IM module; if not able to analyze control message, will revert error message to IM module. This is equivalent to increasing the intelligence level of smart devices.
  • the mentioned smart analysis module can be categorized, designed and materialized based on various means of application, professional use of smart device type, thus design to materialize different types of the mentioned device.
  • auxiliary smart device can be design to realize accordingly: Smart home auxiliary smart device, wearable smart device auxiliary smart device, remote security surveillance auxiliary smart device and more.
  • various types of auxiliary smart device can be designed to realize: sport & fitness type of auxiliary smart device, probing robot type of auxiliary smart device and smart lighting type of auxiliary smart device.
  • the difference in various types of auxiliary smart device is mainly the different smart analysis module equipped.
  • the mentioned control message is the message used by human to control smart device, to make smart device to perform functional actions, including message expressed in natural language format and formatted message.
  • Air-conditioner set to 26°C
  • Living room television tune in to channel 5.
  • control message usually is verbal message that adhere to basic natural language, but does not have strict format, for example, "It's hot, turn the air-conditioner to 26°C", "There is a live football match, watch CCTV5 high definition channel now”.
  • the objective of the device is to improve the flexibility of human controlling smart devices, while minimizing the alteration to the smart device itself.
  • the mentioned security management module can be access through network or local dedicated management port, to manage and configure the mentioned device, including own Internet Protocol(IP) address, own IM account, smart device's identification, IP address and IM account list, as well as own update.
  • IP Internet Protocol
  • a device will provide service to multiple smart devices in a smart network.
  • the mentioned human in the description of the device structure refers to the user of smart devices, operating the smart device interactively using IM client and application installed through network connection.
  • the mentioned smart device refers to device equipped with computing ability, IoT capability, can bind with IM account and be operated interactively with human and the mentioned device through network or IM.
  • FIG.2 is the deployment schematics of the invention - auxiliary smart device
  • each family member has an IM account, 3 persons in the family, smart security surveillance, smart home appliance, smart car and wearable smart devices, and the device mentioned in current invention to form a smart home control network.
  • human and smart devices are connected by network, smart devices are connected with the device mentioned in current invention, and family members can operate smart devices through internet.
  • Human will bind to a IM account to every smart devices, the mentioned device of current invention will have a IM account as well, every IM account of human and smart devices in the smart home control network will be in a same IM chat group, human are able to use means of natural language to control smart devices.
  • IM is merely an efficient and direct communication method, the system supports the use of other methods to have network connection with smart devices.
  • the device can be added into the IM chat group of human and smart devices, to become a member to communicate with smart devices, as well as an invisible IM robot, merely assisting smart devices to analyze control messages.
  • FIG.3 is the working principals of the invention - auxiliary smart device
  • the device of current invention does not directly participate in the network communication in between human and smart devices, or becoming a middle person for human and smart device, it fulfills the role of mentor or translator, assisting smart device to understand control message sent to smart device by human, only has network communication with smart devices.
  • the working principles of the device of current invention are consisting:
  • the device can have communication with human and smart device through IM, in process of human operating smart devices, when smart device can't understand control message, smart device will send the control message to the mentioned device to request for analysis, the mentioned device analyze the control message to command, then revert the command to smart device to execute. When the mentioned can't understand the smart device forwarded control message sent by human, the smart device will send error message to the human.
  • FIG.4 is the data flow diagram of the invention - auxiliary smart device When the device performs the role of mentor or translator, able to understand various complex control messages, it supports human in controlling smart device by imputing text or voice control message in natural language form, as well as supporting the formatted control message that smart devices required.
  • the data flow amongst human, smart devices and the device of current invention are consisting of:
  • IM module of the device sends the control messages in natural language form to smart analysis module of the device;
  • Smart analysis module analyze the control message in natural language form, acquire formatted command, revert the command to IM module; if not able to analyze, will create error message, and revert error message to IM module;
  • IM module of the device revert formatted command or error message to smart device.
  • Smart device executes the formatted command, revert execution result and status message or error message to human.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Information Transfer Between Computers (AREA)
  • Selective Calling Equipment (AREA)

Abstract

This invention discloses a type of an auxiliary smart device for human to operate smart device interactively, are consisting of Instant Messaging(IM), smart analysis and security management module. The IM module is used for the network connection for the mentioned device and smart device, to communicate with each other by IM method; smart analysis module are used to analyze control message from smart device, assisting smart device to understand the control message sent by means of human in natural language or formatted form; Security management module is used to manage the security of the mentioned device itself. Through this invention, smart devices gained higher intelligence by simplifying or without altering the smart device design, able to understand smart interaction control messages sent by human, thus greatly improve the controllability and interactive experience.

Description

Title: A type of an auxiliary smart device for human to operate smart device interactively Technical Field This invention is classified as messaging technology and Internet-of-Thing(IoT) field, involving the area of how human controlling smart devices interactively
Background Art In light of rapid development in mobile internet, IoT and AI(Artificial intelligence), more smart devices are connecting to network to receive control from human, assisting human to achieve imaginative works, improve lifestyle and work quality, for example remote surveillance camera, smart home, smart car, air drones, robot and wearable devices. At the moment, human usually go through menus, icons in apps and physically to control smart devices, some can accept simple voice control.
The integration of smart device and human are still in preliminary stage, the high intelligence of human and low intelligence of smart devices does not jive properly, limiting the controllability and interactive experience.
Especially at the preliminary stage of developing smart devices, smart device manufacturers will not invest huge fund to improve the intelligence of smart device, as well as major upgrade to smart device control port. Human requires more flexible ways of controlling smart devices; on the other hand, smart devices can achieve higher intelligence due to limited development cost and computing resources of the smart devices.
Thus the current invention discloses a type of an auxiliary smart device for human to operate smart device interactively to become the mentor for smart device interaction with human.
Through this invention, human (users) will noticed that intelligence of smart devices has significantly improved, people can flexibly control smart device using text or voice by means of natural language; looking at smart devices, the smart devices themselves doesn't have much changes, once it encounter control message that it can't understand, it will seek help from smart CPU, the smart CPU will understand what kind of command that the human sent.
Disclosure of Invention
The objective of the invention is to add auxiliary smart device in between the interaction of human and smart devices, allowing human to be more direct, easy and flexibly control smart devices and have convenient interaction with human without adding complicity to smart device control port.
The current invention assisting smart device to understand the irregularly changing messages that human sent without changing the smart device but increase the intelligence and controllability of the smart device.
This invention discloses a type of an auxiliary smart device for human to operate smart device interactively, are consisting of IM, smart analysis and security management module.
The IM module is used for the network connection for the mentioned device and smart device, to communicate with each other by IM method; Smart analysis module are used to analyze control message from smart device, assisting smart device to understand the control message sent by means of human in natural language or formatted form;
Security management module is used in the management and configuration of the mentioned device itself, enables the mentioned device to blend into the interactive system amongst human and smart devices; A mentioned device includes a IM module, a security management module and one or more smart analysis module;
A mentioned device can provide service to one or more smart devices. For external connection, The mentioned device can have communication with human and smart device through IM, in process of human operating smart devices, when smart device can't understand control message, smart device will send the control message to the mentioned device to request for analysis, the mentioned device analyze the control message to command, then revert the command to smart device to execute.
When the mentioned can't understand the smart device forwarded control message sent by human, the smart device will send error message to the human.
The mentioned IM module handles the network communication with smart device, receives analysis request and control message from smart device, then revert the control message to smart analysis module, obtain the command or error message to send to smart device after smart analysis module analyses control message and acquire command or creates error message on unable to analyze control message.
The mentioned smart analysis module are used to analyze control message sent from IM module that smart device can't understand, analyzes the control message to smart device executable command, revert it to IM module; if not able to analyze control message, will revert error message to IM module.
The mentioned smart analysis module can be categorized, designed and materialized based on various means of application, professional use of smart device type, thus design to materialize different types of the mentioned device.
The mentioned control message is the message used by human to control smart device, to make smart device to perform functional actions, including message expressed in natural language format and formatted message. The mentioned security management module can be access through network or local dedicated management port, to manage and configure the mentioned device, including own Internet Protocol(IP) address, own IM account, smart device's identification, IP address and IM account list, as well as own update.
The mentioned human refers to the user of smart devices, operating the smart device interactively using IM client and application installed through network connection.
The mentioned smart device refers to device equipped with computing ability, IoT capability, can bind with IM account and be operated interactively with human and the mentioned device through network or IM.
Through this invention, smart devices gained higher intelligence by simplifying or without altering the smart device design smart device design, able to understand smart interaction control messages sent by human, thus greatly improve the controllability and interactive experience.
Description Of Drawings and Best Mode for Carrying Out The Invention
The following will further elaborate the appendix and detailed description of this invention.
FIG.1 is the structural diagram of the invention - auxiliary smart device
The mentioned device is consisting of IM, smart analysis and security management module.
The IM module is used for the network connection for the mentioned device and smart device, to communicate with each other by IM method;
Smart analysis module are used to analyze control message from smart device, assisting smart device to understand the control message sent by means of human in natural language or formatted form; Security management module is used in the management and configuration if the mentioned device itself, enables the mentioned device to blend into the interactive system amongst human and smart devices; A mentioned device includes a IM module, a security management module and one or more smart analysis module;
Various multiple smart analysis module can be design to be realized in a device according to the user and market needs, thus creates a composite auxiliary smart device.
the mentioned IM module handles the network communication with smart device, receives analysis request and control message from smart device, then revert the control message to smart analysis module, obtain the command or error message to send to smart device after smart analysis module analyses control message and acquire command or creates error message on unable to analyze control message. The device supports network connection to connect with smart device, as well as highly efficient interactive method of IM.
The mentioned smart analysis module are used to analyze control message sent from IM module that smart device can't understand, analyzes the control message to smart device executable command, revert it to IM module; if not able to analyze control message, will revert error message to IM module. This is equivalent to increasing the intelligence level of smart devices.
The mentioned smart analysis module can be categorized, designed and materialized based on various means of application, professional use of smart device type, thus design to materialize different types of the mentioned device.
For example, depending on types of smart devices, various types of auxiliary smart device can be design to realize accordingly: Smart home auxiliary smart device, wearable smart device auxiliary smart device, remote security surveillance auxiliary smart device and more. Based on different applications, various types of auxiliary smart device can be designed to realize: sport & fitness type of auxiliary smart device, probing robot type of auxiliary smart device and smart lighting type of auxiliary smart device. The difference in various types of auxiliary smart device is mainly the different smart analysis module equipped. The mentioned control message is the message used by human to control smart device, to make smart device to perform functional actions, including message expressed in natural language format and formatted message.
Usually smart device can understand formatted control message, but helpless to irregularly changing natural language in control messages, then requires the help from auxiliary smart device.
The definitions of formatted control message are strictly defined data format messages: Control message: = device ID + action + parameters
For example, Air-conditioner set to 26°C, Living room television tune in to channel 5.
The definition of natural language type of control message usually is verbal message that adhere to basic natural language, but does not have strict format, for example, "It's hot, turn the air-conditioner to 26°C", "There is a live football match, watch CCTV5 high definition channel now".
The objective of the device is to improve the flexibility of human controlling smart devices, while minimizing the alteration to the smart device itself.
Human can send control message by inputting text or voice by means of natural language, that usually smart device won't understand, the device are used to analyze this type of control messages, converting them into smart device understandable command.
For human inputting formatted control message, due to the strict format requirement, smart device can usually understand and perform relevant actions, in this case the smart device doesn't need the help from the device. The mentioned security management module can be access through network or local dedicated management port, to manage and configure the mentioned device, including own Internet Protocol(IP) address, own IM account, smart device's identification, IP address and IM account list, as well as own update.
Here is involved the standard configuration of the device, in order to function properly. Usually a device will provide service to multiple smart devices in a smart network.
The mentioned human in the description of the device structure refers to the user of smart devices, operating the smart device interactively using IM client and application installed through network connection.
The mentioned smart device refers to device equipped with computing ability, IoT capability, can bind with IM account and be operated interactively with human and the mentioned device through network or IM.
The relationship among human, smart device and the device mentioned in current invention is: Human operate smart device interactively, making smart device to perform functions required by human; when smart device not able to understand the control message sent by human, it will seek help from the device, the device will inform smart device on what command the human sent; human and the device does not have direct operational interaction.
FIG.2 is the deployment schematics of the invention - auxiliary smart device
To illustrate the application of the device mentioned in current invention, we take a smart home control network of a simple family as example.
Here, each family member has an IM account, 3 persons in the family, smart security surveillance, smart home appliance, smart car and wearable smart devices, and the device mentioned in current invention to form a smart home control network. In the mentioned network, human and smart devices are connected by network, smart devices are connected with the device mentioned in current invention, and family members can operate smart devices through internet. Human will bind to a IM account to every smart devices, the mentioned device of current invention will have a IM account as well, every IM account of human and smart devices in the smart home control network will be in a same IM chat group, human are able to use means of natural language to control smart devices. Here, IM is merely an efficient and direct communication method, the system supports the use of other methods to have network connection with smart devices.
The device can be added into the IM chat group of human and smart devices, to become a member to communicate with smart devices, as well as an invisible IM robot, merely assisting smart devices to analyze control messages.
FIG.3 is the working principals of the invention - auxiliary smart device
The device of current invention does not directly participate in the network communication in between human and smart devices, or becoming a middle person for human and smart device, it fulfills the role of mentor or translator, assisting smart device to understand control message sent to smart device by human, only has network communication with smart devices. Thus the working principles of the device of current invention are consisting:
The device can have communication with human and smart device through IM, in process of human operating smart devices, when smart device can't understand control message, smart device will send the control message to the mentioned device to request for analysis, the mentioned device analyze the control message to command, then revert the command to smart device to execute. When the mentioned can't understand the smart device forwarded control message sent by human, the smart device will send error message to the human. FIG.4 is the data flow diagram of the invention - auxiliary smart device When the device performs the role of mentor or translator, able to understand various complex control messages, it supports human in controlling smart device by imputing text or voice control message in natural language form, as well as supporting the formatted control message that smart devices required. In the process of human controlling smart devices, the data flow amongst human, smart devices and the device of current invention are consisting of:
(1) Human sends out control message to smart devices in natural language format or formatted control message.
(2) Smart device can understand formatted control message, it will send the control message in natural language format that it can't understand to the IM module of the device;
(3) IM module of the device sends the control messages in natural language form to smart analysis module of the device;
(4) Smart analysis module analyze the control message in natural language form, acquire formatted command, revert the command to IM module; if not able to analyze, will create error message, and revert error message to IM module;
(5) IM module of the device revert formatted command or error message to smart device. (6) Smart device executes the formatted command, revert execution result and status message or error message to human.

Claims

CLAIMS:
1. A type of an auxiliary smart device for human to operate smart device interactively, are consisting of Instant Messaging(IM), smart analysis and security management module, details consisting of:
The IM module is used for the network connection for the mentioned device and smart device, to communicate with each other by IM method;
Smart analysis module will analyze control message from smart device, to understand complicated control messages sent from human;
Security management module is used in the management and configuration if the mentioned device itself, enables the mentioned device to blend into the interactive system amongst human and smart devices;
A mentioned device includes a IM module, a security management module and one or more smart analysis module;
A mentioned device can provide service to one or more smart devices.
2. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the mentioned device can have communication with human and smart device through IM, in process of human operating smart devices, when smart device can't understand control message, smart device will send the control message to the mentioned device to request for analysis, the mentioned device analyze the control message to command, then revert the command to smart device to execute.
3. Referring to the "auxiliary smart device" in claim 1 or 2 of the claim statement, the features consisting of: when the mentioned can't understand the smart device forwarded control message sent by human, the smart device will send error message to the human.
4. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned IM module handles the network communication with smart device, receives analysis request and control message from smart device, then revert the control message to smart analysis module, obtain the command or error message to send to smart device after smart analysis module analyses control message and acquire command or creates error message on unable to analyze control message.
5. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned smart analysis module are used to analyze control message sent from IM module that smart device can't understand, analyzes the control message to smart device executable command, revert it to IM module; if not able to analyze control message, will revert error message to IM module.
6. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned smart analysis module can be categorized, designed and materialized based on various means of application, professional use of smart device type, thus design to materialize different types of the mentioned device.
7. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned control message is the message used by human to control smart device, to make smart device to perform functional actions, including message expressed in natural language format and formatted message.
8. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned security management module can be access through network or local dedicated management port, to manage and configure the mentioned device, including own Internet Protocol(IP) address, own IM account, smart device's identification, IP address and IM account list, as well as own update.
9. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned human refers to the user of smart devices, operating the smart device interactively using IM client and application installed through network connection.
10. Referring to the "auxiliary smart device" in claim 1 of the claim statement, the features consisting of:
the mentioned smart device refers to device equipped with computing ability, Internet of Things(IoT)capability, can bind with IM account and be operated interactively with human and the mentioned device through network or IM.
PCT/MY2016/050014 2016-02-15 2016-03-14 A type of an auxiliary smart device for human to operate smart device interactively WO2017142390A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610085785.6A CN107086949A (en) 2016-02-15 2016-02-15 It is a kind of to be used for people and the auxiliary intelligent apparatus of smart machine interactive operation
CN201610085785.6 2016-02-15

Publications (1)

Publication Number Publication Date
WO2017142390A1 true WO2017142390A1 (en) 2017-08-24

Family

ID=59614409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2016/050014 WO2017142390A1 (en) 2016-02-15 2016-03-14 A type of an auxiliary smart device for human to operate smart device interactively

Country Status (2)

Country Link
CN (1) CN107086949A (en)
WO (1) WO2017142390A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110250931A (en) * 2019-06-26 2019-09-20 广东美的厨房电器制造有限公司 Smart accessories, household appliance and oven
CN110875940A (en) * 2018-08-31 2020-03-10 比亚迪股份有限公司 Application program calling method, device and equipment based on virtual robot
CN113159749A (en) * 2021-03-09 2021-07-23 北京极智数仓科技有限公司 Financial management method and service platform for smart home

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108471434B (en) * 2018-01-30 2020-09-08 阿里巴巴集团控股有限公司 Method and device for associating equipment with account, electronic equipment and system
CN114237453A (en) * 2020-09-09 2022-03-25 华为技术有限公司 Method for controlling equipment, electronic equipment and system
CN115242742B (en) * 2020-09-29 2023-07-14 支付宝(杭州)信息技术有限公司 Service control method, device and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003046657A (en) * 2001-07-30 2003-02-14 Victor Co Of Japan Ltd Communication equipment for remote control
US20050015446A1 (en) * 2003-05-28 2005-01-20 Samsung Electronics Co., Ltd. Method and apparatus to remotely control electronic apparatuses over a network
JP2005266192A (en) * 2004-03-18 2005-09-29 Matsushita Electric Ind Co Ltd Apparatus and method for speech recognition
WO2014048133A1 (en) * 2012-09-26 2014-04-03 Tencent Technology (Shenzhen) Company Limited A device control method and apparatus

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103472994B (en) * 2013-09-06 2017-02-08 网易乐得科技有限公司 Operation control achieving method, device and system based on voice
CN105072143B (en) * 2015-07-02 2018-11-20 百度在线网络技术（北京）有限公司 The interactive system of intelligent robot and client based on artificial intelligence

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003046657A (en) * 2001-07-30 2003-02-14 Victor Co Of Japan Ltd Communication equipment for remote control
US20050015446A1 (en) * 2003-05-28 2005-01-20 Samsung Electronics Co., Ltd. Method and apparatus to remotely control electronic apparatuses over a network
JP2005266192A (en) * 2004-03-18 2005-09-29 Matsushita Electric Ind Co Ltd Apparatus and method for speech recognition
WO2014048133A1 (en) * 2012-09-26 2014-04-03 Tencent Technology (Shenzhen) Company Limited A device control method and apparatus

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110875940A (en) * 2018-08-31 2020-03-10 比亚迪股份有限公司 Application program calling method, device and equipment based on virtual robot
CN110250931A (en) * 2019-06-26 2019-09-20 广东美的厨房电器制造有限公司 Smart accessories, household appliance and oven
CN113159749A (en) * 2021-03-09 2021-07-23 北京极智数仓科技有限公司 Financial management method and service platform for smart home
CN113159749B (en) * 2021-03-09 2023-07-04 北京极智数仓科技有限公司 Financial management method and service platform for smart home

Also Published As

Publication number Publication date
CN107086949A (en) 2017-08-22

Similar Documents

Publication Publication Date Title
WO2017142390A1 (en) A type of an auxiliary smart device for human to operate smart device interactively
CN104270468B (en) A kind of system of wechat control internet of things equipment
WO2017206493A1 (en) Implementation system and method for internet of things based on artificial intelligence
Salvi et al. Jamura: a conversational smart home assistant built on Telegram and Google Dialogflow
WO2017086772A1 (en) A smart home management device and humanized interaction method based on instant messaging (im)
Kubitza et al. Towards a toolkit for the rapid creation of smart environments
WO2017142389A1 (en) A type of smart device control system and method that supports natural language message interaction
US20230409837A1 (en) Systems and methods for a virtual agent in a cloud computing environment
WO2011006364A1 (en) System and method for remote cooperation
US20240206041A1 (en) Edge-based system architecture for building-scale interactive lighting
WO2023098002A1 (en) Method, system and apparatus for controlling household appliance, and storage medium and electronic apparatus
Shi et al. Construction of industrial internet of things based on MQTT and OPC UA protocols
CN113986349A (en) Data processing method, data processing device, computer readable storage medium and computer equipment
CN115525302A (en) Deployment method and device of large-scale digital object warehouse cluster
JP2021121564A (en) Elevator control method, device, electronic apparatus, storage medium, and system
Devi et al. Smart home system using voice command with integration of esp8266
CN108572555A (en) Kitchen ventilator and family's intarconnected cotrol method based on kitchen ventilator
CN108389574A (en) A kind of devices, systems, and methods for supporting IOT device intelligences to interconnect
CN104243252B (en) A kind of intelligent domestic system for supporting IGRS agreements
CN105141435A (en) IOT heterogeneous network management technology based on Restful architecture
CN112612735A (en) Unity-based multi-platform multi-form VR hardware interface management system
CN105323273B (en) For controlling the methods, devices and systems of energy consumption monitoring system
Boldu et al. Insight: a systematic approach to create dynamic human-controller-interactions
An et al. Design and implementation of YANG based wireless access point controller using RPC
Kaur et al. Using Augmented Reality to enhance the experience of IoT-based Home Automation Systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16890785

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16890785

Country of ref document: EP

Kind code of ref document: A1