WO2017142389A1 - A type of smart device control system and method that supports natural language message interaction - Google Patents

A type of smart device control system and method that supports natural language message interaction Download PDF

Info

Publication number
WO2017142389A1
WO2017142389A1 PCT/MY2016/050012 MY2016050012W WO2017142389A1 WO 2017142389 A1 WO2017142389 A1 WO 2017142389A1 MY 2016050012 W MY2016050012 W MY 2016050012W WO 2017142389 A1 WO2017142389 A1 WO 2017142389A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
smart device
control
message
cpu
Prior art date
Application number
PCT/MY2016/050012
Other languages
French (fr)
Inventor
Hao Lin
Li Zhong
Xi GAO
Original Assignee
Linkdood Technologies Sdn Bhd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Linkdood Technologies Sdn Bhd filed Critical Linkdood Technologies Sdn Bhd
Publication of WO2017142389A1 publication Critical patent/WO2017142389A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4185—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by the network communication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house

Definitions

  • This invention is classified as messaging technology and Internet-of-Things(IoT) field, involving the area of controlling smart devices, especially involving the area of how human able to interact with smart devices through natural language form.
  • IoT Internet-of-Things
  • IoT and Artificial intelligence(AI) In light of rapid development in mobile internet, IoT and Artificial intelligence(AI), more smart devices are connecting to network to receive control from human, assisting human to achieve imaginative works, improve lifestyle and work quality, for example remote surveillance camera, smart home, smart car, drone, robot and wearable devices.
  • AI Artificial intelligence
  • the current invention discloses a type of smart device control system and method that supports natural language message interaction, through adding auxiliary smart device in between the interaction of human and smart devices, to form an interactive system consisting of human, smart device and smart CPU; using smart CPU to improve the intelligence level of smart device, allowing smart device to understand more complicated control message from human, therefore improve the controllability and interactive experience in between human and smart devices.
  • the objective of the invention is to add auxiliary smart device in between the interaction of human and smart devices, to form an interactive system by human, smart device and smart CPU, allowing human to be more direct, easy and flexibly control smart devices and have convenient interaction with human without adding complicity to smart device control port.
  • the current invention assisting smart device to understand the irregularly changing messages that human sent without changing the smart device but increase the intelligence and controllability of the smart device.
  • the current invention discloses a type of smart device control system and method that supports natural language message interaction, to be used for human controlling smart devices, formed by client, smart device and smart CPU, details consisting of: (1) Client
  • Client operates in smart phone, tablet, laptop computer, desktop computer and other terminals, which includes a IM(Instant messaging)module, a voice recognition module, and at least one application module; the IM module supports input of control messages through text and voice, voice recognition module will convert control message by voice input to text messages, application module will operate on IM module, supports fine- grained remote control of smart device.
  • IM Instant messaging
  • voice recognition module will convert control message by voice input to text messages
  • application module will operate on IM module, supports fine- grained remote control of smart device.
  • IoT Internet of Things
  • the IM module receives control message from client, forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client.
  • Control message analysis module is used to obtain commands from analyzing control message, able to analyze formatted control message; function module are used to execute respective smart device functionality according to commands.
  • the mentioned smart device can be made by adding in mentioned IM module and control message analysis module to normal IoT devices.
  • Smart CPU is used to assist smart device to understand complicated control messages, which include IM module and smart analysis module;
  • the IM module receives control message from client, forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client, smart analysis module are used to analyze control message and convert control message into command Smart CPU can be categorized, designed and materialized based on various means of application, professional use or smart device type, different types of smart CPU has different smart analysis module.
  • smart CPU assist smart device to understand the control message sent from client.
  • smart device and smart CPU are communicated through a network.
  • smart device and smart CPU Before the client, smart device and smart CPU establishing a smart device control system through a network, in between client and smart device, smart device and smart CPU shall undergo two-way authentication.
  • the key data in the mentioned system includes formatted control messages and control messages in natural language.
  • a type of Smart device control system and method that supports natural language message interaction consisting of the following steps:
  • FIG.1 is the structural diagram of the invention - smart device control system and method that supports natural language message interaction, used by human to control smart device, are consisting of client, smart device and smart CPU, details are as folio wings:
  • client operates in smart phone, tablet, laptop computer, desktop computer and other terminals, which includes a IM(Instant messaging)module, a voice recognition module, and at least one application module;
  • IM Intelligent messaging
  • voice recognition module will convert control message by voice input to text messages
  • application module will operate on IM module, supports remote granularity control of smart device.
  • the IM module used to receive control message received from client and forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client.
  • Control message analysis module is used to obtain commands from analyzing control message, able to analyze formatted control message; function module are used to execute respective smart device functionality according to commands.
  • the mentioned smart device can be made by adding in mentioned IM module and control message analysis module to normal IoT devices.
  • a device with higher intelligence than the smart device used to assist smart device to interact with human.
  • Smart CPU is used to assist smart device to understand complicated control messages, which include IM module and smart analysis module;
  • Smart CPU can be categorized, designed and materialized based on various means of application, professional use or smart device type, different types of smart CPU has different smart analysis module.
  • smart CPU assist smart device to understand the control message sent from client.
  • smart device and smart CPU are communicated through a network.
  • smart device and smart CPU Before the client, smart device and smart CPU establishing a smart device control system through a network, in between client and smart device, smart device and smart CPU will undergo two-way authentication.
  • the key data in the mentioned system includes formatted control messages and control messages in natural language.
  • smart device can understand formatted control message, but helpless to irregularly changing natural language in control messages, then requires the help from a smart CPU.
  • Control message: device ID + action + parameters
  • Air-conditioner set to 26°C
  • Living room television tune in to channel 5.
  • FIG.2 is the deployment schematics of the invention - Smart device
  • each family member has an IM account, 3 persons in the family, smart security surveillance, smart home appliance, smart car and wearable smart devices, and a smart CPU for smart home to form a smart home control network.
  • human and smart devices are connected by network, smart devices are connected with smart CPU, and family members can operate smart devices through internet.
  • Human will bind to a IM account to every smart devices, smart CPU will have a IM account as well, every IM account of human and smart devices in the smart home control network will be in a same IM chat group, human are able to use means of natural language to control smart devices, as well as controlling smart devices using formatted commands.
  • IM is an efficient and direct communication method
  • the system supports to use other methods to have network connection with smart devices.
  • Smart CPU can be added into the IM chat group of human and smart devices, to become a member to communicate with smart devices, as well as an invisible IM robot, merely assisting smart devices to analyze control messages.
  • FIG.3 is the logical diagram of the invention - Smart device control system and method that supports natural language message interaction, actual steps are as follows:

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Human Resources & Organizations (AREA)
  • General Engineering & Computer Science (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Business, Economics & Management (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Marketing (AREA)
  • Health & Medical Sciences (AREA)
  • Operations Research (AREA)
  • General Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Game Theory and Decision Science (AREA)
  • Educational Administration (AREA)
  • Development Economics (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Manufacturing & Machinery (AREA)
  • Primary Health Care (AREA)
  • Data Mining & Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)

Abstract

This invention discloses a type of Smart device control system that supports natural language message interaction, consisting of client, smart home device and smart Central Processing Unit(CPU). Client are being used to receive control message input in natural language expression or format by the humans; smart CPU will be used to assist smart device to understand these control messages. A type of smart device control method that supports natural language message interaction, further describes the human operating smart device and actual steps of smart CPU assisting the smart device. Through this invention, people are able to flexibly control smart device of lower intelligence through control message consisting text or voice in natural language form, in order to greatly improve the controllability and interactive experience while lower the complexity in manufacturing smart device. Smart device control system that supports natural language message interaction

Description

Title: A type of Smart device control system and method that supports natural language message interaction
Technical Field
This invention is classified as messaging technology and Internet-of-Things(IoT) field, involving the area of controlling smart devices, especially involving the area of how human able to interact with smart devices through natural language form. Background Art
In light of rapid development in mobile internet, IoT and Artificial intelligence(AI), more smart devices are connecting to network to receive control from human, assisting human to achieve imaginative works, improve lifestyle and work quality, for example remote surveillance camera, smart home, smart car, drone, robot and wearable devices.
At the moment, human usually go through menus, icons in apps and physically to control smart devices, some can accept simple voice control, but usually command message in certain format.
The integration of smart device and human are still in preliminary stage, the high intelligence of human and low intelligence of smart devices does not jive properly, limiting the controllability and interactive experience. Especially at the preliminary stage of developing smart devices, smart device manufacturers will not invest huge fund to improve the intelligence of smart device, as well as major upgrade to smart device control port.
Human requires more flexible ways of controlling smart devices; on the other hand, smart devices can achieve higher intelligence due to limited development cost and computing resources of the smart devices. Thus the current invention discloses a type of smart device control system and method that supports natural language message interaction, through adding auxiliary smart device in between the interaction of human and smart devices, to form an interactive system consisting of human, smart device and smart CPU; using smart CPU to improve the intelligence level of smart device, allowing smart device to understand more complicated control message from human, therefore improve the controllability and interactive experience in between human and smart devices.
Through this invention, human(users) will noticed that intelligence of smart devices has significantly improved, people can flexibly control smart device using text or voice by means of natural language; looking at smart devices, the smart devices themselves doesn't have much changes, once it encounter control message that it can't understand, it will seek help from smart CPU, the smart CPU will understand what kind of command that the human sent.
Disclosure of Invention
The objective of the invention is to add auxiliary smart device in between the interaction of human and smart devices, to form an interactive system by human, smart device and smart CPU, allowing human to be more direct, easy and flexibly control smart devices and have convenient interaction with human without adding complicity to smart device control port.
The current invention assisting smart device to understand the irregularly changing messages that human sent without changing the smart device but increase the intelligence and controllability of the smart device.
The current invention discloses a type of smart device control system and method that supports natural language message interaction, to be used for human controlling smart devices, formed by client, smart device and smart CPU, details consisting of: (1) Client
Provide interactive interface for human and machine, human send control message to control smart device via the client. Client operates in smart phone, tablet, laptop computer, desktop computer and other terminals, which includes a IM(Instant messaging)module, a voice recognition module, and at least one application module; the IM module supports input of control messages through text and voice, voice recognition module will convert control message by voice input to text messages, application module will operate on IM module, supports fine- grained remote control of smart device.
(2) Smart device
Device equipped with computing ability, Internet of Things (IoT) capability and smart characteristics, to complete functionalities required by human.
Consisting of IM module, control message analysis module and function module;
The IM module receives control message from client, forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client.
Control message analysis module is used to obtain commands from analyzing control message, able to analyze formatted control message; function module are used to execute respective smart device functionality according to commands.
The mentioned smart device can be made by adding in mentioned IM module and control message analysis module to normal IoT devices.
(3) Smart CPU
A device with higher intelligence than smart devices, to assist smart device to interact with human. Smart CPU is used to assist smart device to understand complicated control messages, which include IM module and smart analysis module;
The IM module receives control message from client, forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client, smart analysis module are used to analyze control message and convert control message into command Smart CPU can be categorized, designed and materialized based on various means of application, professional use or smart device type, different types of smart CPU has different smart analysis module.
In the system, human interact with smart device through client, smart CPU assist smart device to understand the control message sent from client. In between client and smart device, smart device and smart CPU are communicated through a network.
Before the client, smart device and smart CPU establishing a smart device control system through a network, in between client and smart device, smart device and smart CPU shall undergo two-way authentication.
The key data in the mentioned system, the mentioned control messages that human sent through client to control smart device, includes formatted control messages and control messages in natural language.
A type of Smart device control system and method that supports natural language message interaction, consisting of the following steps:
(1) Human send control message to smart device through client;
(2) Smart device receives and analyze control message;
(3) If smart device able to analyze control message, it will obtain command; (4) If smart device can't analyze control message, it will divert the control message to smart CPU;
(5) Smart CPU receives and analyze control message;
(6) If smart CPU able to analyze control message, it will obtain command and send the command to smart device;
(7) If smart CPU can't analyze control message, it will create error message and send to smart device;
(8) Smart device perform relevant task according to command.
(9) Smart device revert execution result and relevant status message or error message to client.
Through this invention, people are able to use method of higher intelligent level to flexibly control smart device of lower intelligence through control message consisting text or voice in natural language form, in order to lower the complexity in smart device manufacturing process and greatly improve the controllability and interactive experience.
Description Of Drawings and Best Mode for Carrying Out The Invention
The following will further elaborate the appendix and detailed description of this invention.
FIG.1 is the structural diagram of the invention - smart device control system and method that supports natural language message interaction, used by human to control smart device, are consisting of client, smart device and smart CPU, details are as folio wings:
(1) Client
Provide interactive interface for human and machine, human send control message to control smart device via the client; client operates in smart phone, tablet, laptop computer, desktop computer and other terminals, which includes a IM(Instant messaging)module, a voice recognition module, and at least one application module; The IM module supports input of control messages through text and voice, voice recognition module will convert control message by voice input to text messages, application module will operate on IM module, supports remote granularity control of smart device.
(2) Smart device
Equipped with computing ability and IoT equipment with smart characteristics, to complete functionalities that required by human. Consisting of IM module, control message analysis module and function module;
The IM module used to receive control message received from client and forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client.
Control message analysis module is used to obtain commands from analyzing control message, able to analyze formatted control message; function module are used to execute respective smart device functionality according to commands.
The mentioned smart device can be made by adding in mentioned IM module and control message analysis module to normal IoT devices.
(3) Smart CPU
A device with higher intelligence than the smart device, used to assist smart device to interact with human.
Smart CPU is used to assist smart device to understand complicated control messages, which include IM module and smart analysis module;
The IM module used to receive control message received from client and forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client, smart analysis module are used to analyze control message and convert control message into command.
Smart CPU can be categorized, designed and materialized based on various means of application, professional use or smart device type, different types of smart CPU has different smart analysis module.
In the system, human interact with smart device through client, smart CPU assist smart device to understand the control message sent from client. In between client and smart device, smart device and smart CPU are communicated through a network.
Before the client, smart device and smart CPU establishing a smart device control system through a network, in between client and smart device, smart device and smart CPU will undergo two-way authentication.
The key data in the mentioned system, the mentioned control messages that human sent through client to control smart device, includes formatted control messages and control messages in natural language. Usually smart device can understand formatted control message, but helpless to irregularly changing natural language in control messages, then requires the help from a smart CPU.
The definition of formatted control messages are strictly defined data format messages: Control message: = device ID + action + parameters
For example, Air-conditioner set to 26°C, Living room television tune in to channel 5.
The definition of natural language type of control message usually is verbal message that adhere to basic natural language, but does not have strict format, for example, "It's hot, turn the air-conditioner to 26°C", "There is a live football match, watch CCTV5 high definition channel now". FIG.2 is the deployment schematics of the invention - Smart device
control system and method that supports natural language message interaction.
To illustrate the application of the current patent, we take a smart home control network of a simple family as example.
Here, each family member has an IM account, 3 persons in the family, smart security surveillance, smart home appliance, smart car and wearable smart devices, and a smart CPU for smart home to form a smart home control network.
In the mentioned network, human and smart devices are connected by network, smart devices are connected with smart CPU, and family members can operate smart devices through internet. Human will bind to a IM account to every smart devices, smart CPU will have a IM account as well, every IM account of human and smart devices in the smart home control network will be in a same IM chat group, human are able to use means of natural language to control smart devices, as well as controlling smart devices using formatted commands.
Here, IM is an efficient and direct communication method, the system supports to use other methods to have network connection with smart devices.
Smart CPU can be added into the IM chat group of human and smart devices, to become a member to communicate with smart devices, as well as an invisible IM robot, merely assisting smart devices to analyze control messages.
FIG.3 is the logical diagram of the invention - Smart device control system and method that supports natural language message interaction, actual steps are as follows:
( 1) Human send control message to smart device through client;
(2) Smart device receives and analyze control message;
(3) If smart device able to analyze control message, it will obtain command; (4) If smart device can't analyze control message, it will divert the control message to smart CPU;
(5) Smart CPU receives and analyze control message;
(6) If smart CPU able to analyze control message, it will obtain command and send the command to smart device;
(7) If smart CPU can't analyze control message, it will create error message and send to smart device;
(8) Smart device perform relevant task according to command.
(9) Smart device revert execution result and relevant status message or error message to client.

Claims

CLAIMS:
1. A type of smart device control system that supports natural language message interaction, used by human to control smart device, consisting of client, smart device and smart Central Processing Unit(CPU), details consisting of: Client: provide interactive interface for human and machine, human send control message to control smart device via the client.
Smart device: device equipped with computing ability, Internet of Things (IoT)capability and smart characteristics, to complete functionalities required by human. Smart CPU: a device with higher intelligence than the smart device, to assist smart device to interact with human
2. Referring to the "smart device control system" in claim 1 of the claim statement, the features consisting of:
human operate smart device interactively through client, smart CPU assist smart device to understand the control message sent from client. In between client and smart device, smart device and smart CPU are communicated through a network.
3. Referring to the "smart device control system" in claim 1 or 2 of the claim statement, the features consisting of: before the client, smart device and smart CPU establishing a smart device control system through a network, in between client and smart device, smart device and smart CPU shall undergo two-way authentication.
4. Referring to the "smart device control system" in claim 1 or 2 of the claim statement, the features consisting of: the mentioned client operates in smart phone, tablet, laptop computer, desktop computer and other terminals, which includes a Instant messaging(IM) module, a voice recognition module, and at least one application module;
The IM module supports input of control messages through text and voice, voice recognition module will convert control message by voice input to text messages, application module will operate on IM module, supports fine-grained remote control of smart device.
5. Referring to the "smart device control system" in claim 1, 2 or 4 of the claim statement, the features consisting of: the mentioned control messages that uses to control smart device, includes formatted control messages and control messages in natural language.
6. Referring to the "smart device control system" in claim 1 or 2 of the claim statement, the features consisting of: the mentioned smart device includes IM module, control message analysis module and function module;
The IM module receive controls message from client, forward control message to smart CPU, receive control message or error message from smart CPU, receive execution result message or status message from function module, sends execution result and status message or error message to client.
Control message analysis module is used to obtain commands by analyzing control message, able to analyze formatted control message; function module are used to execute respective smart device functionalities according to commands.
7. Referring to the "smart device control system" in claim 1,2 or 6 of the claim statement, the features consisting of: the mentioned smart device can be made by adding in mentioned IM module and control message analysis module to normal IoT devices.
8. Referring to the "smart device control system" in claim 1 or 2 of the claim statement, the features consisting of: the mentioned smart CPU is used to assist smart device to understand complicated control messages, consisting of IM module and smart analysis module;
The IM module is used to receive control message from smart device and send command after analyzing or error message, smart analysis module will analyze control message to convert them into commands.
9. Referring to the "smart device control system" in claim 1,2 or 8 of the claim statement, the features consisting of:
The mentioned smart CPU can be categorized, designed and materialized based on various means of application, professional use or smart device type, different types of smart CPU has different smart analysis module.
10. Referring to the "smart device control system" in claim 1 or 2 of the claim statement, the features consisting of the following steps:
Human send control message to smart device through client;
Smart device receives and analyze control message;
If smart device able to analyze control message, it will obtain command;
If smart device can't analyze control message, it will divert the control message to smart
CPU;
Smart CPU receives and analyze control message;
If smart CPU able to analyze control message, it will obtain command and send the command to smart device;
If smart CPU can't analyze control message, it will create error message and send to smart device;
Smart device perform relevant task according to command.
Smart device revert execution result and relevant status message or error message to client.
PCT/MY2016/050012 2016-02-15 2016-03-11 A type of smart device control system and method that supports natural language message interaction WO2017142389A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610085784.1A CN107085463A (en) 2016-02-15 2016-02-15 A kind of the smart machine control system and method for supporting natural language information to interact
CN201610085784.1 2016-02-15

Publications (1)

Publication Number Publication Date
WO2017142389A1 true WO2017142389A1 (en) 2017-08-24

Family

ID=59614402

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2016/050012 WO2017142389A1 (en) 2016-02-15 2016-03-11 A type of smart device control system and method that supports natural language message interaction

Country Status (2)

Country Link
CN (1) CN107085463A (en)
WO (1) WO2017142389A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113329092A (en) * 2021-06-04 2021-08-31 厦门致上信息科技有限公司 Intelligent equipment communication and control internet of things platform system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108040111A (en) * 2017-12-13 2018-05-15 北京北信源软件股份有限公司 A kind of apparatus and method for supporting natural language interaction
CN108389574A (en) * 2018-03-30 2018-08-10 北京北信源软件股份有限公司 A kind of devices, systems, and methods for supporting IOT device intelligences to interconnect
CN111479007A (en) * 2019-01-24 2020-07-31 郭建志 Mechanism for controlling physical machine by using talking software
CN113127609A (en) * 2019-12-31 2021-07-16 华为技术有限公司 Voice control method, device, server, terminal equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030233424A1 (en) * 2002-06-12 2003-12-18 Samsung Electronics Co., Ltd. Instant messenger based interface apparatus in information apparatuses
JP2005266192A (en) * 2004-03-18 2005-09-29 Matsushita Electric Ind Co Ltd Apparatus and method for speech recognition
US20140359018A1 (en) * 2014-03-12 2014-12-04 Tencent Technology (Shenzhen) Company Limited Method and device for controlling peripheral devices via a social networking platform

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882752A (en) * 2012-10-19 2013-01-16 天津光宏科技有限公司 Internet-of-things and android system based intelligent home system and control method
CN103051734A (en) * 2013-01-23 2013-04-17 广东志高空调有限公司 Remote voice control method and system for household electrical appliance and communication terminal
CN105137789A (en) * 2015-08-28 2015-12-09 青岛海尔科技有限公司 Control method and device of intelligent IoT electrical appliances, and related devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030233424A1 (en) * 2002-06-12 2003-12-18 Samsung Electronics Co., Ltd. Instant messenger based interface apparatus in information apparatuses
JP2005266192A (en) * 2004-03-18 2005-09-29 Matsushita Electric Ind Co Ltd Apparatus and method for speech recognition
US20140359018A1 (en) * 2014-03-12 2014-12-04 Tencent Technology (Shenzhen) Company Limited Method and device for controlling peripheral devices via a social networking platform

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113329092A (en) * 2021-06-04 2021-08-31 厦门致上信息科技有限公司 Intelligent equipment communication and control internet of things platform system

Also Published As

Publication number Publication date
CN107085463A (en) 2017-08-22

Similar Documents

Publication Publication Date Title
WO2017142389A1 (en) A type of smart device control system and method that supports natural language message interaction
WO2017142390A1 (en) A type of an auxiliary smart device for human to operate smart device interactively
WO2018005216A1 (en) Fog enabled telemetry embedded in real time multimedia applications
EP3217283A1 (en) Multi-module compilation system, multi-module compilation method, and non-transitory computer-readable storage medium
CN109377995B (en) Method and device for controlling equipment
US11934175B2 (en) Robotic process automation for remote assistance
CN106504748A (en) Voice control method and device
US11348583B2 (en) Data processing method and apparatus for intelligent device, and storage medium
CN109215651A (en) A kind of speech control system and method for intelligent closestool
CN112382294B (en) Speech recognition method, device, electronic equipment and storage medium
CN103838375B (en) Terminal input method and terminal
Zaidi et al. Redefining home automation through voice recognition system
CN106326087B (en) Web page experience method and system based on robot operating system
CN110659330A (en) Data processing method, device and storage medium
AU2020240106A1 (en) Systems and methods for a virtual agent in a cloud computing environment
CN102983889A (en) Method of information cooperative processing between smart mobile phone and computer through Bluetooth wireless pairing
JP2021121564A (en) Elevator control method, device, electronic apparatus, storage medium, and system
CN107844363B (en) Business transaction processing method, device, storage medium and equipment
Devi et al. Smart home system using voice command with integration of esp8266
KR101694011B1 (en) Method and apparatus for voice dialogue on multiple application softwares
CN105608774A (en) Intelligent entrance guard control system and control method thereof
Patil et al. AI based Home Automation System using Raspberry Pi
Chakraborty et al. Let Us Create an Alexa-Enabled IoT Device Using C#, AWS Lambda and ESP Module
Chakraborty et al. Alexa Enabled IoT Device Simulation Using C# And AWS Lambda
Passinhas et al. Integration of mobile devices in home automation with use of machine learning for object recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16890784

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16890784

Country of ref document: EP

Kind code of ref document: A1