CN112071320A - Intelligent equipment voice control system and method - Google Patents
Intelligent equipment voice control system and method Download PDFInfo
- Publication number
- CN112071320A CN112071320A CN202010904051.2A CN202010904051A CN112071320A CN 112071320 A CN112071320 A CN 112071320A CN 202010904051 A CN202010904051 A CN 202010904051A CN 112071320 A CN112071320 A CN 112071320A
- Authority
- CN
- China
- Prior art keywords
- voice
- intelligent
- control
- server
- controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000009471 action Effects 0.000 claims abstract description 6
- 230000005540 biological transmission Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 4
- 239000000284 extract Substances 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 abstract description 8
- 230000004044 response Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 9
- 230000006872 improvement Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G10L15/1822—Parsing for meaning understanding
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
- H04L63/0435—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload wherein the sending and receiving network entities apply symmetric encryption, i.e. same key used for encryption and decryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/26—Special purpose or proprietary protocols or architectures
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Artificial Intelligence (AREA)
- Telephonic Communication Services (AREA)
Abstract
A voice control system and method for intelligent equipment belongs to the technical field of intelligent equipment control and solves the problems that a communication link of a voice control system of the intelligent equipment is too long, the system response is slow, and a control server is accessed into equipment and multiple servers are overloaded; the voice controller receives the voice command and sends the voice command to the voice server; the voice server identifies and analyzes a control instruction contained in the voice instruction, judges the unique identifier of the intelligent equipment and then returns the information to the voice controller; the voice controller generates a protocol instruction based on the returned information and sends the protocol instruction to the intelligent gateway; the intelligent gateway analyzes the unique identifier of the intelligent equipment and sends the protocol instruction to the corresponding intelligent equipment; the intelligent equipment executes the control action contained in the protocol instruction; by the system and the method, the voice control of the intelligent equipment does not depend on the control server, the time from the voice instruction request to the equipment response is shortened, the speed of the voice control equipment is high, and the user experience is improved.
Description
Technical Field
The invention belongs to the technical field of intelligent equipment control, and particularly relates to a voice control system and method for intelligent equipment.
Background
With the rapid development of the internet of things technology and the application of the voice recognition technology, more and more intelligent devices can be controlled through voice. At present, as shown in fig. 10, the control process of the existing voice control system for intelligent devices is complex, and first, a voice command needs to be sent to a special voice server through a network to perform recognition of the voice command, and then the recognition result is sent to a control server, so as to control the intelligent device through the control server. The specific control flow is as follows: the voice controller uploads the voice command to the voice server, the voice server identifies the voice command and then sends the analyzed control command to the control server, and the control server generates a protocol command according to the received control command and a control protocol corresponding to the intelligent equipment and sends the protocol command to the intelligent equipment; the voice server functions only to recognize and understand voice commands and does not store any information related to the smart device, and the control server functions to remotely control the device.
The problems of the above control method are: firstly, the transmission path of the control command in the wan is too long, and once one of the communication links is blocked or fails, the control effect is affected, for example: communication connection cannot be established between the voice server and the control server or between the control server and the intelligent equipment; secondly, the excessive number of the intelligent devices controlling the access of the server may cause the server to be overloaded and fail to work normally.
Disclosure of Invention
The invention aims to solve the problems that in the prior art, the voice control mode of intelligent equipment is complex, a communication link is too long, the control effect of a system is influenced by the blockage or the fault of the link, and the server is overloaded and cannot work normally when the intelligent equipment accessed by a control server is too much.
The invention solves the technical problems through the following technical scheme:
a smart device voice control system comprising: the system comprises a voice controller, a voice server, an intelligent gateway, a control server and a plurality of intelligent devices; the voice controller is used for receiving the voice instruction, sending the voice instruction to the voice server, generating a protocol instruction according to the returned unique identifier of the intelligent device and the control instruction, and then sending the protocol instruction to the intelligent gateway; the voice server is used for identifying the voice command, analyzing the control information, judging the unique identifier of the intelligent equipment to be controlled, and returning the unique identifier of the intelligent equipment and the control command to the voice controller; the intelligent gateway is used for receiving and analyzing the unique identification of the intelligent equipment contained in the protocol instruction, and then sending the received protocol instruction to the corresponding intelligent equipment; the control server is used for establishing an association relationship between the intelligent equipment and the voice controller, including establishing a binding relationship between the intelligent gateway and the intelligent equipment and between the intelligent gateway and the voice controller, and synchronizing the binding relationship to the voice server; the intelligent device is used for executing the control action contained in the protocol instruction.
The intelligent equipment voice control system further comprises the following control processes: the voice controller uploads the voice command to the voice server, the voice server stores information of the intelligent gateway and the intelligent equipment bound/associated with the voice controller, the voice server identifies the voice command and analyzes the control command, then sends the control command and the corresponding unique identifier of the intelligent equipment to the voice controller, the voice controller generates a protocol command according to the received information and sends the protocol command to the intelligent gateway, and the intelligent gateway forwards the protocol command to the intelligent equipment.
The control system and the process solve a plurality of problems in the voice control method of the intelligent equipment in the prior art, and firstly: only voice recognition needs to rely on an external network, and equipment control does not depend on the external network, so that the degree of dependence on an external network environment is reduced; secondly, the intelligent device is controlled through the intelligent gateway which exists under the same local area network/intranet, the time from the voice instruction request sent by a user to the response of the device is shortened, the speed of the voice control device is high, and the user experience is improved.
As a further improvement of the technical solution of the present invention, the method for establishing the association relationship between the intelligent device and the voice controller comprises:
step 101: the control server sends the binding relationship between the intelligent gateway and the voice controller to a voice server corresponding to the voice controller;
step 102: the control server sends the binding relationship between the intelligent gateway and the intelligent equipment to a voice server corresponding to the voice controller bound with the intelligent gateway;
step 103: and the voice server establishes the association relationship between the intelligent equipment and the voice controller according to the received binding relationship between the intelligent gateway and the voice controller and the binding relationship between the intelligent gateway and the intelligent equipment.
As a further improvement of the technical scheme of the present invention, the number of the intelligent gateways is multiple, and the multiple intelligent gateways respectively receive and analyze the unique identifier of the intelligent device contained in the protocol instruction, and then send the received protocol instruction to the corresponding intelligent device; the number of the control servers is multiple, the control servers respectively and correspondingly establish the binding relations between the intelligent gateways and the intelligent equipment and between the intelligent gateways and the voice controllers, and meanwhile, the binding relations are synchronized to the voice servers.
The method applied to the intelligent device voice control system comprises the following steps:
step 110: the voice controller sends a recognition request of a voice instruction to the voice server; the voice instruction is a voice signal which is received by the voice controller and used for controlling the intelligent equipment;
step 120: the voice server judges the unique identification of the intelligent equipment to be controlled based on the control information contained in the received voice command, and returns the control command, the unique identification of the intelligent equipment and the intelligent gateway information to the voice controller;
step 130: the voice controller generates a protocol instruction based on the returned unique identifier of the intelligent equipment and the control instruction, and then sends the protocol instruction to an intelligent gateway bound with the equipment;
step 140: the intelligent gateway analyzes the unique identifier of the intelligent equipment contained in the received protocol instruction and sends the received protocol instruction to the corresponding intelligent equipment.
As a further improvement of the technical solution of the present invention, before the voice controller sends the recognition request of the voice command to the voice server, the method further includes: the voice controller sends a connection request to the voice server, and the voice controller sends the MAC address and the identity identification to the voice server so that the voice server can check whether the information is consistent with the pre-stored information or not, and if so, the connection is successful.
As a further improvement of the technical solution of the present invention, the determining, by the voice server, the unique identifier of the intelligent device to be controlled based on the control information included in the received voice command specifically includes:
step 121: the voice server identifies voice signals and extracts semantic information from the received voice command, and control information contained in the voice command is extracted;
step 122: the voice server acquires intelligent equipment information associated with the voice controller according to the voice controller identity identification;
step 123: and judging the unique identifier of the intelligent equipment to be controlled and the intelligent gateway information bound with the equipment based on the intelligent equipment name and the attribute contained in the control information and the intelligent equipment information associated with the voice controller.
As a further improvement of the technical solution of the present invention, before the voice controller generates a protocol instruction based on the returned unique identifier of the intelligent device and the control instruction, and then sends the protocol instruction to the intelligent gateway bound to the device, the method further includes: the method comprises the steps that a voice controller sends a connection request to an intelligent gateway, the voice controller sends an MAC address and an identity mark of the voice controller to the intelligent gateway, the intelligent gateway reports received information to a control server so that the control server can check whether the information is consistent with pre-stored information, if so, a binding relation between the intelligent gateway and the voice controller is established, and the intelligent gateway stores the identity mark of the voice controller to finish binding.
As a further improvement of the technical solution of the present invention, before the intelligent gateway analyzes the unique identifier of the intelligent device included in the received protocol instruction, and sends the received protocol instruction to the corresponding intelligent device, the method further includes: the intelligent device sends a connection request to the intelligent gateway, the intelligent device sends the MAC address and the unique identifier of the intelligent device to the intelligent gateway, the intelligent gateway reports the received information to the control server, the control server checks whether the information is consistent with the pre-stored information, if so, a binding relationship between the intelligent gateway and the intelligent device is established, and the intelligent gateway stores the unique identifier of the intelligent device to finish binding.
As a further improvement of the technical scheme of the invention, the voice controller adopts an HTTPS protocol to establish a data transmission channel with the voice server and encrypts the transmitted data.
As a further improvement of the technical scheme of the invention, the data transmitted between the intelligent gateway and the control server, between the intelligent gateway and the voice controller and between the intelligent gateway and the intelligent equipment are encrypted by adopting an MQTT protocol and an AES encryption algorithm.
The invention also includes: a non-transitory computer readable storage medium storing a computer program for implementing the method of the smart device voice control system, wherein the computer program, when executed by a processor, implements the method of the smart device voice control system.
The invention has the advantages that:
(1) the voice control of the intelligent equipment does not need to depend on a control server, so that the degree of dependence on the control server is reduced; only the recognition of the voice command needs to depend on an external network, and the equipment control does not depend on the external network, so that the dependence degree on the external network environment is reduced, the time from the voice command request to the equipment response is greatly reduced, the speed of the voice control equipment is high, and the user experience is improved.
(2) The voice controller is communicated with the intelligent gateway and the intelligent gateway is communicated with the intelligent equipment through the home router or the local area network, and the intelligent gateway plays a role as the home router.
(3) The data message between the intelligent gateway and other devices adopts an MQTT message queue telemetering transmission protocol, has simple protocol, small header and low requirements on bandwidth and calculated amount, is suitable for the Internet of things and small-sized devices, and simultaneously has a message confirmation mechanism to ensure the delivery of the message.
(4) Through intelligent gateway and speech controller communication connection, solved equipment control server and the unable problem of establishing the connection and the remote control failure that leads to of smart machine.
(5) Through intelligent gateway and intelligent device communication connection, the problem that the server can not respond because the connection quantity of the device control server is too much is solved.
(6) By adopting the message queue telemetry protocol, the problem of low response speed of small Internet of things equipment to the control instruction is solved.
Drawings
FIG. 1 is a schematic diagram of a speech control system for a smart device according to the present invention;
FIG. 2 is a block diagram of a voice control system for an intelligent device according to the present invention;
FIG. 3 is a control schematic diagram of a speech control system of an intelligent device provided by the invention;
FIG. 4 is an expanded implementation schematic diagram of a speech control system of an intelligent device provided by the invention;
FIG. 5 is a flow chart of a method for controlling a smart device according to the present invention;
fig. 6 is a schematic flowchart of a method for determining a unique identifier of an intelligent device by a voice server of a voice control method of an intelligent device according to the present invention;
FIG. 7 is a flowchart illustrating a method for associating a voice controller with an intelligent device according to a voice control method for an intelligent device of the present invention;
FIG. 8 is a schematic diagram illustrating a method for binding a voice controller with an intelligent gateway according to a voice control method for an intelligent device provided in the present invention;
FIG. 9 is a schematic diagram of a method for binding an intelligent device and an intelligent gateway according to a voice control method for an intelligent device provided by the present invention;
fig. 10 is a schematic diagram of a smart device control method in the prior art.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical scheme of the invention is further described by combining the drawings and the specific embodiments in the specification:
as shown in fig. 1, a speech control system for smart devices includes: the system comprises a voice controller, a voice server, an intelligent gateway and a plurality of intelligent devices; the voice controller is used for receiving the voice instruction, sending the voice instruction to the voice server, generating a protocol instruction according to the returned unique identifier of the intelligent device and the control instruction, and then sending the protocol instruction to the intelligent gateway; the voice server is used for identifying the voice command, analyzing the control information, judging the unique identifier of the intelligent equipment to be controlled, and returning the unique identifier of the intelligent equipment and the control command to the voice controller; the intelligent gateway is used for receiving and analyzing the unique identification of the intelligent equipment contained in the protocol instruction, and then sending the received protocol instruction to the corresponding intelligent equipment; the intelligent device is used for executing the control action contained in the protocol instruction.
As shown in fig. 2 and fig. 3, the voice control system for intelligent devices further includes a control server, where the control server is configured to establish an association relationship between the intelligent device and the voice controller, including establishing a binding relationship between the intelligent gateway and the intelligent device and between the intelligent gateway and the voice controller, and synchronize the binding relationship to the voice server.
As shown in fig. 4, the number of the intelligent gateways is multiple, and the multiple intelligent gateways respectively receive and analyze the unique identifier of the intelligent device included in the protocol instruction, and then send the received protocol instruction to the corresponding intelligent device; the number of the control servers is multiple, the control servers respectively and correspondingly establish the binding relations between the intelligent gateways and the intelligent equipment and between the intelligent gateways and the voice controllers, and meanwhile, the binding relations are synchronized to the voice servers.
As shown in fig. 5, the flow of the intelligent device voice control method includes the following steps:
step 110: the voice controller sends a recognition request of a voice instruction to the voice server; the voice instruction is a voice signal which is received by the voice controller and used for controlling the intelligent equipment;
in the embodiment of the invention, the voice controller has a far-field voice acquisition function, is used for controlling the remote voice of the intelligent equipment (within a range of several meters), and generally adopts the microphone array and the related technologies of noise reduction, echo cancellation, sound source positioning and the like to process the acquired voice signals before recognition, so that the accuracy of voice recognition is improved; the voice controller compresses the collected and processed voice signals, uploads the compressed voice signals to a special voice server through a network, identifies the voice signals through a voice identification algorithm, analyzes a control intention through a semantic understanding algorithm, and converts the voice instructions into specific control instructions. The algorithm of the voice recognition can be an algorithm based on a neural network, and the specific algorithm of the voice recognition is not limited by the invention; the semantic understanding algorithm may be a method based on information extraction, and the specific algorithm for semantic understanding is not limited in the present invention.
Before the voice controller sends the recognition request of the voice command to the voice server, the method further comprises the following steps:
the voice controller sends a connection request to the voice server, and the voice controller sends the MAC address and the identity identification to the voice server so that the voice server can check whether the information is consistent with the pre-stored information or not, and if so, the connection is successful.
As an embodiment of the present invention, the voice controller may be a smart speaker, and the voice controller needs to be activated before being used, specifically, the voice controller is activated by a short-range wireless communication technology, such as: the Bluetooth is in communication connection with the mobile phone APP and sends a user name and a password of the home wireless network to the voice controller through the mobile phone APP so as to enable the controller to be networked; after the voice controller is successfully networked, a connection request is sent to the voice server, the identity of the controller is encrypted into a cipher text through an encryption algorithm and sent to the voice server; the voice server receives controller-related information such as: judging a cipher key for decrypting a cipher text sent by the controller according to the brand, the model, the MAC address and the like of the controller, and decrypting the cipher text through the prestored cipher key to obtain the identity of the controller; and the voice server checks the received controller MAC address and the decrypted acquired controller identity identification with the prestored information, and if the received controller MAC address and the decrypted controller identity identification are consistent with the prestored information, connection is established.
Step 120: the voice server judges the unique identification of the intelligent equipment to be controlled based on the control information contained in the received voice command, and returns the control command, the unique identification of the intelligent equipment and the intelligent gateway information to the voice controller;
the voice server judges the unique identifier of the intelligent device to be controlled based on the control information contained in the received voice command, and the method specifically comprises the following steps:
step 121: the voice server identifies voice signals and extracts semantic information from the received voice command, and control information contained in the voice command is extracted;
step 122: the voice server acquires intelligent equipment information associated with the voice controller according to the voice controller identity identification;
step 123: and judging the unique identifier of the intelligent equipment to be controlled and the intelligent gateway information bound with the equipment based on the intelligent equipment name and the attribute contained in the control information and the intelligent equipment information associated with the voice controller.
In an embodiment of the present invention, the control information includes: smart device name and attributes, control category and control action, such as: the voice instruction received by the voice server is "turn on the bedroom air conditioner", then the "air conditioner" corresponds to the device name, the "bedroom" corresponds to the device attribute, the device attribute is used for distinguishing devices of the same category, and the device name may also be a self-defined name, for example: "little fly," a device attribute may also be a serial number or brand of the device, such as: the invention discloses a number 1 lamp, a Haler air conditioner and the like, and does not limit the definition range of the name and the attribute of the intelligent equipment.
In the embodiment of the present invention, the voice server stores intelligent device information associated with the voice controller, where the intelligent device information includes: the information of the intelligent gateway bound with the intelligent equipment, the unique identification of the intelligent equipment, and the name and the attribute of the intelligent equipment. The unique identification of the intelligent equipment is an equipment identification burnt during equipment production, is used for distinguishing different equipment, and has uniqueness. The voice server obtains the intelligent device information associated with the controller according to the voice controller identity, and determines the unique identifier of the intelligent device to be controlled, such as the unique identifier of the device corresponding to the "bedroom air conditioner", according to the control information in step 121. The name and attribute of the intelligent device and the corresponding relationship of the unique identifier of the intelligent device can be completed through the APP of the intelligent device, and the setting can also be completed through the APP of the voice controller, which is not repeated herein.
In the above embodiment, when there are a plurality of intelligent gateways bound to the voice controller, the information returned from the voice server includes, in addition to the unique identifier of the intelligent device, information of the intelligent gateway bound to the intelligent device, where the information of the intelligent gateway includes a MAC address of the intelligent gateway.
In the embodiment of the present invention, after the voice server completes the action of associating the voice controller with the intelligent device in the above steps 101 to 103, the voice server issues the associated data to the voice controller; thus, the voice controller stores information of the intelligent gateway/intelligent device to which it is bound/associated.
in the embodiment of the invention, the data transmitted between the voice controller and the voice server adopts an HTTPS protocol, and the data transmitted between the voice controller and the intelligent gateway adopts an MQTT protocol, so that after the voice controller receives the unique identification of the intelligent equipment and the control instruction returned from the voice server, the received data needs to be converted into the form of the MQTT protocol and then sent to the intelligent gateway. Meanwhile, when there are a plurality of intelligent gateways bound to the voice controller, the voice controller needs to determine to which intelligent gateway the control command is forwarded, and specifically, the control command can be determined by the intelligent gateway information bound to the intelligent device returned from the voice server.
And 140, the intelligent gateway analyzes the unique identifier of the intelligent equipment contained in the received protocol instruction and sends the received protocol instruction to the corresponding intelligent equipment.
In the embodiment of the invention, the data sent by the voice controller to the intelligent gateway and the data sent by the intelligent gateway to the intelligent equipment are encrypted by an encryption algorithm; the intelligent gateway stores the controller information bound with the intelligent gateway, and the method comprises the following steps: the controller MAC address, the identity and the decryption key; the intelligent gateway decrypts the received protocol command through a pre-stored secret key, and then obtains a unique identifier of the equipment to be controlled; the intelligent gateway stores the intelligent device information bound with it at the same time, including: the intelligent device comprises an MAC address, a unique identifier and an encryption key; the intelligent gateway re-encrypts the protocol instruction according to a pre-stored secret key of the intelligent device and then sends the protocol instruction to the intelligent device; the intelligent equipment decrypts the data sent by the intelligent gateway, acquires a protocol instruction therein and executes corresponding control operation; meanwhile, the intelligent device returns the execution result of the protocol instruction to the intelligent gateway so that the intelligent gateway can synchronize the running state of the device to the device control server.
As shown in fig. 7, the method for establishing an association relationship between an intelligent device and a voice controller provided by the present invention includes:
102, the control server sends the binding relationship between the intelligent gateway and the intelligent equipment to a voice server corresponding to a voice controller bound with the intelligent gateway;
and 103, the voice server establishes an association relationship between the intelligent device and the voice controller according to the received binding relationship between the intelligent gateway and the voice controller as well as the intelligent device.
As shown in fig. 8, a schematic diagram of a method for binding an intelligent gateway and a voice controller provided in the embodiment of the present invention specifically includes: the method comprises the steps that a voice controller sends a connection request to an intelligent gateway, the voice controller sends an MAC address and an identity mark of the voice controller to the intelligent gateway, the intelligent gateway reports received information to a control server so that the control server can check whether the information is consistent with pre-stored information, if so, a binding relation between the intelligent gateway and the voice controller is established, and the intelligent gateway stores the identity mark of the voice controller to finish binding.
Further, the control server stores voice controller information in advance, including: the voice controller MAC address, the identification, and a key for decrypting data sent by the controller.
In this embodiment of the present invention, the connection request data sent by the voice controller includes the type and model of the voice controller, for example: the feier box X1 may also include a device MAC address, which is a clear text transmission used by the recipient to determine the key to decrypt the encrypted data. The identity identifier sent to the intelligent gateway by the voice controller is encrypted, and if the intelligent gateway does not store a decryption key corresponding to the voice controller in advance, the intelligent gateway sends the received encrypted information to the control server. It should be noted that, the data sent by the intelligent gateway to the control server also needs to be encrypted, and particularly, the intelligent gateway encrypts the information received from the voice controller into a ciphertext by using the encryption algorithm of the intelligent gateway and reports the ciphertext to the control server; after the control server decrypts the received encrypted data, whether the corresponding relation between the MAC address and the identity of the voice controller is consistent with the pre-stored information or not is verified, if so, the binding relation between the intelligent gateway and the voice controller is established, meanwhile, the control server returns the binding information to the intelligent gateway, and the intelligent gateway stores the voice controller information and completes binding.
As shown in fig. 9, a schematic diagram of a method for binding an intelligent gateway and an intelligent device provided in the embodiment of the present invention specifically includes: the intelligent device sends a connection request to the intelligent gateway, the intelligent device sends the MAC address and the unique identifier of the intelligent device to the intelligent gateway, the intelligent gateway reports the received information to the control server, the control server checks whether the information is consistent with the pre-stored information, if so, a binding relationship between the intelligent gateway and the intelligent device is established, and the intelligent gateway stores the information of the intelligent device to finish binding.
Further, the control server stores information of the intelligent device in advance, including: the smart device MAC address, the unique identifier and a key for decrypting data sent by the smart device.
In the embodiment of the present invention, the connection request data sent by the intelligent device includes the type and model of the intelligent device, for example: the hair air conditioner S1, the above information is a plaintext transmission, which is used by the receiving party to determine the key needed to decrypt the encrypted data. And after decrypting the received encrypted data sent by the intelligent equipment by using a pre-stored secret key, the control server verifies whether the received MAC address and the unique identifier of the intelligent equipment are consistent with the pre-stored information, if so, a binding relationship between the intelligent equipment and the intelligent gateway is established, and meanwhile, the information of the intelligent equipment is returned to the intelligent gateway.
It should be noted that the key corresponding to the smart device may set different keys according to different MAC addresses; considering that the management of the secret keys is inconvenient due to the excessive number of the secret keys, different secret keys can be set according to different equipment types and models; or setting a key according to the serial number of the product, specifically, the same key is used for the serial numbers of the products in a specific range.
Further, the method provided by the present invention is characterized in that the voice controller establishes a data transmission channel with the voice server by using an HTTPS protocol, and encrypts the transmitted data.
In the embodiment of the invention, the HTTPS protocol is a network protocol which is constructed by HTTP and SSL protocol and can carry out encryption transmission and identity authentication, and the encryption of internet data transmission is mainly completed by technologies such as digital certificates, encryption algorithms, asymmetric secret keys and the like, so that the security protection of internet transmission is realized.
In the embodiment of the invention, the voice command sent to the voice server by the voice controller comprises a voice signal; considering that the voice signal data packet is large, but the speed of the algorithm of the asymmetric encryption is too low, therefore, the voice signal is encrypted by adopting the algorithm of the symmetric encryption, and the invention does not limit the encryption algorithm of the voice signal; the voice server may pre-store a key for decrypting the voice signal, and may also send the key through the voice controller, which is not limited in the present invention; when the secret key for decrypting the voice signal is sent through the voice controller, the secret key is encrypted and then transmitted by adopting an asymmetric encryption algorithm, such as an RSA algorithm, so as to ensure the security of the secret key, and detailed steps are not described herein.
Furthermore, the method provided by the invention is characterized in that the transmitted data is encrypted by adopting an MQTT protocol and an AES encryption algorithm for data transmission between the intelligent gateway and the control server, between the intelligent gateway and the voice controller and between the intelligent gateway and the intelligent equipment.
In the embodiment of the invention, data transmission between the intelligent gateway and the control server, between the intelligent gateway and the voice controller and between the intelligent gateway and the intelligent equipment adopts an MQTT protocol to transmit data; MQTT (message queue telemetry transport) is an instant messaging, messaging protocol. The protocol is simple, light and convenient, has low requirements on bandwidth and calculated amount, and is suitable for the Internet of things and small equipment; MQTT defaults to providing network connectivity using the TCP/IP protocol. The MQTT protocol has a connection keeping mechanism, namely heartbeat request and heartbeat response, so that long connection between the intelligent gateway and the intelligent equipment can be maintained; therefore, the intelligent gateway can send the protocol instruction to the intelligent equipment, and meanwhile, the intelligent equipment can report the running state of the equipment to the intelligent gateway and the control server in real time, so that the control server can conveniently carry out remote management and control on the intelligent equipment.
In the embodiment of the invention, the data transmitted between the intelligent gateway and the control server, between the intelligent gateway and the voice controller and between the intelligent gateway and the intelligent equipment are encrypted by adopting an AES encryption algorithm; the AES stands for an advanced encryption system, and is a symmetric encryption algorithm which is most widely applied and has higher speed, and the symmetric encryption algorithm uses the same secret key in encryption and decryption; the intelligent gateway stores a secret key of the voice controller and also stores a secret key of the intelligent equipment; when the intelligent gateway sends the protocol command to the intelligent equipment, the protocol command data is encrypted by using the secret key of the intelligent equipment and then transmitted, and after the intelligent equipment receives the ciphertext, the ciphertext is decrypted by using the secret key of the intelligent equipment to obtain the protocol command.
The above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (12)
1. A smart device voice control system, comprising: the system comprises a voice controller, a voice server, an intelligent gateway and a plurality of intelligent devices; the voice controller is used for receiving the voice instruction, sending the voice instruction to the voice server, generating a protocol instruction according to the returned unique identifier of the intelligent device and the control instruction, and then sending the protocol instruction to the intelligent gateway; the voice server is used for identifying the voice command, analyzing the control information, judging the unique identifier of the intelligent equipment to be controlled, and returning the unique identifier of the intelligent equipment and the control command to the voice controller; the intelligent gateway is used for receiving and analyzing the unique identification of the intelligent equipment contained in the protocol instruction, and then sending the received protocol instruction to the corresponding intelligent equipment; the intelligent device is used for executing the control action contained in the protocol instruction.
2. The voice control system of claim 1, further comprising a control server, wherein the control server is configured to establish the association relationship between the intelligent device and the voice controller, including establishing the binding relationship between the intelligent gateway and the intelligent device and between the intelligent gateway and the voice controller, and synchronizing the binding relationship to the voice server.
3. The intelligent device voice control system according to claim 2, wherein the method for establishing the association relationship between the intelligent device and the voice controller comprises:
step 101: the control server sends the binding relationship between the intelligent gateway and the voice controller to a voice server corresponding to the voice controller;
step 102: the control server sends the binding relationship between the intelligent gateway and the intelligent equipment to a voice server corresponding to the voice controller bound with the intelligent gateway;
step 103: and the voice server establishes the association relationship between the intelligent equipment and the voice controller according to the received binding relationship between the intelligent gateway and the voice controller as well as the intelligent equipment.
4. The intelligent device voice control system according to claim 1, wherein the number of the intelligent gateways is plural, and the plural intelligent gateways respectively receive and analyze the intelligent device unique identifier included in the protocol instruction, and then send the received protocol instruction to the corresponding intelligent device; the number of the control servers is multiple, the control servers respectively and correspondingly establish the binding relations between the intelligent gateways and the intelligent equipment and between the intelligent gateways and the voice controllers, and meanwhile, the binding relations are synchronized to the voice servers.
5. A method applied to the intelligent device voice control system of any one of claims 1-4, characterized by comprising the following steps:
step 110: the voice controller sends a recognition request of a voice instruction to the voice server; the voice instruction is a voice signal which is received by the voice controller and used for controlling the intelligent equipment;
step 120: the voice server judges the unique identification of the intelligent equipment to be controlled based on the control information contained in the received voice command, and returns the control command, the unique identification of the intelligent equipment and the intelligent gateway information to the voice controller;
step 130: the voice controller generates a protocol instruction based on the returned unique identifier of the intelligent equipment and the control instruction, and then sends the protocol instruction to an intelligent gateway bound with the equipment;
step 140: the intelligent gateway analyzes the unique identifier of the intelligent equipment contained in the received protocol instruction and sends the received protocol instruction to the corresponding intelligent equipment.
6. The method of claim 5, wherein before the speech controller sends the voice command recognition request to the speech server, the method further comprises: the voice controller sends a connection request to the voice server, and the voice controller sends the MAC address and the identity identification to the voice server so that the voice server can check whether the information is consistent with the pre-stored information or not, and if so, the connection is successful.
7. The method of the voice control system of the intelligent device according to claim 5, wherein the voice server determines the unique identifier of the intelligent device to be controlled based on the control information included in the received voice command, and specifically includes:
step 121: the voice server identifies voice signals and extracts semantic information from the received voice command, and control information contained in the voice command is extracted;
step 122: the voice server acquires intelligent equipment information associated with the voice controller according to the voice controller identity identification;
step 123: and judging the unique identifier of the intelligent equipment to be controlled and the intelligent gateway information bound with the equipment based on the intelligent equipment name and the attribute contained in the control information and the intelligent equipment information associated with the voice controller.
8. The method of claim 5, wherein before the voice controller generates the protocol command based on the returned unique identifier of the smart device and the control command, and then sends the protocol command to the smart gateway bound to the device, the method further comprises: the method comprises the steps that a voice controller sends a connection request to an intelligent gateway, the voice controller sends an MAC address and an identity mark of the voice controller to the intelligent gateway, the intelligent gateway reports received information to a control server so that the control server can check whether the information is consistent with pre-stored information, if so, a binding relation between the intelligent gateway and the voice controller is established, and the intelligent gateway stores the identity mark of the voice controller to finish binding.
9. The method of claim 5, wherein before the intelligent gateway parses the unique identifier of the intelligent device contained in the received protocol command and sends the received protocol command to the corresponding intelligent device, the method further comprises: the intelligent device sends a connection request to the intelligent gateway, the intelligent device sends the MAC address and the unique identifier of the intelligent device to the intelligent gateway, the intelligent gateway reports the received information to the control server, the control server checks whether the information is consistent with the pre-stored information, if so, a binding relationship between the intelligent gateway and the intelligent device is established, and the intelligent gateway stores the unique identifier of the intelligent device to finish binding.
10. The method of claim 5, wherein the voice controller establishes a data transmission channel with the voice server using HTTPS protocol, and encrypts the transmitted data.
11. The method for the intelligent device voice control system according to the claims 8 to 9, wherein the data transmitted between the intelligent gateway and the control server, between the intelligent gateway and the voice controller and between the intelligent gateway and the intelligent device are encrypted by using MQTT protocol and AES encryption algorithm.
12. A non-transitory computer readable storage medium storing a computer program implementing the method of the smart device voice control system according to any one of claims 5 to 11, wherein the computer program, when executed by a processor, implements the steps of the method of the smart device voice control system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010904051.2A CN112071320A (en) | 2020-09-01 | 2020-09-01 | Intelligent equipment voice control system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010904051.2A CN112071320A (en) | 2020-09-01 | 2020-09-01 | Intelligent equipment voice control system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112071320A true CN112071320A (en) | 2020-12-11 |
Family
ID=73665953
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010904051.2A Pending CN112071320A (en) | 2020-09-01 | 2020-09-01 | Intelligent equipment voice control system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112071320A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112689010A (en) * | 2020-12-23 | 2021-04-20 | 青岛海尔科技有限公司 | Equipment message transmission method and device, storage medium and electronic device |
| CN112767936A (en) * | 2021-01-06 | 2021-05-07 | 镁佳(北京)科技有限公司 | Voice conversation method, device, storage medium and electronic equipment |
| CN113422814A (en) * | 2021-06-16 | 2021-09-21 | 青岛易来智能科技股份有限公司 | Method and system for sending device control command, storage medium and electronic device |
| CN114244879A (en) * | 2021-12-15 | 2022-03-25 | 北京声智科技有限公司 | Industrial control system, industrial control method and electronic equipment |
| CN114442537A (en) * | 2022-01-29 | 2022-05-06 | 深圳市智慧湾科技有限公司 | Device intelligentization method, device and readable storage medium |
| WO2023040678A1 (en) * | 2021-09-16 | 2023-03-23 | Oppo广东移动通信有限公司 | Information transmission method and apparatus, and electronic device, chip, storage medium, program and program product |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104079653A (en) * | 2014-07-03 | 2014-10-01 | 上海积谕信息科技有限公司 | Smart home control method and system based on B/S framework |
| CN106850362A (en) * | 2017-01-16 | 2017-06-13 | 黄修文 | Wireless transmitting system and method based on technology of Internet of things |
| WO2018040595A1 (en) * | 2016-08-29 | 2018-03-08 | 珠海格力电器股份有限公司 | Intelligent gateway control method and apparatus, and intelligent gateway |
| CN109933029A (en) * | 2019-03-11 | 2019-06-25 | 王祎凡 | A kind of intelligent home control system based on Cloud Server |
| KR20190105757A (en) * | 2018-03-06 | 2019-09-18 | 이효열 | IoT ENGINE ALGORITHM AND SOFTWARE FOR SMART GATEWAY INTERWORKING WITH LOCAL SERVER |
| US20190342112A1 (en) * | 2017-01-20 | 2019-11-07 | Alibaba Group Holding Limited | Method and apparatus for controlling smart device |
| CN110517686A (en) * | 2019-09-26 | 2019-11-29 | 合肥飞尔智能科技有限公司 | Intelligent sound box end voice opens the method and system of application |
| CN110716441A (en) * | 2019-11-08 | 2020-01-21 | 北京金茂绿建科技有限公司 | Method for controlling intelligent equipment, intelligent home system, equipment and medium |
| CN111583928A (en) * | 2020-05-09 | 2020-08-25 | 宁波奥克斯电气股份有限公司 | Equipment control method and related device |
-
2020
- 2020-09-01 CN CN202010904051.2A patent/CN112071320A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104079653A (en) * | 2014-07-03 | 2014-10-01 | 上海积谕信息科技有限公司 | Smart home control method and system based on B/S framework |
| WO2018040595A1 (en) * | 2016-08-29 | 2018-03-08 | 珠海格力电器股份有限公司 | Intelligent gateway control method and apparatus, and intelligent gateway |
| CN106850362A (en) * | 2017-01-16 | 2017-06-13 | 黄修文 | Wireless transmitting system and method based on technology of Internet of things |
| US20190342112A1 (en) * | 2017-01-20 | 2019-11-07 | Alibaba Group Holding Limited | Method and apparatus for controlling smart device |
| KR20190105757A (en) * | 2018-03-06 | 2019-09-18 | 이효열 | IoT ENGINE ALGORITHM AND SOFTWARE FOR SMART GATEWAY INTERWORKING WITH LOCAL SERVER |
| CN109933029A (en) * | 2019-03-11 | 2019-06-25 | 王祎凡 | A kind of intelligent home control system based on Cloud Server |
| CN110517686A (en) * | 2019-09-26 | 2019-11-29 | 合肥飞尔智能科技有限公司 | Intelligent sound box end voice opens the method and system of application |
| CN110716441A (en) * | 2019-11-08 | 2020-01-21 | 北京金茂绿建科技有限公司 | Method for controlling intelligent equipment, intelligent home system, equipment and medium |
| CN111583928A (en) * | 2020-05-09 | 2020-08-25 | 宁波奥克斯电气股份有限公司 | Equipment control method and related device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112689010A (en) * | 2020-12-23 | 2021-04-20 | 青岛海尔科技有限公司 | Equipment message transmission method and device, storage medium and electronic device |
| CN112689010B (en) * | 2020-12-23 | 2023-03-28 | 青岛海尔科技有限公司 | Equipment message transmission method and device, storage medium and electronic device |
| CN112767936A (en) * | 2021-01-06 | 2021-05-07 | 镁佳(北京)科技有限公司 | Voice conversation method, device, storage medium and electronic equipment |
| CN113422814A (en) * | 2021-06-16 | 2021-09-21 | 青岛易来智能科技股份有限公司 | Method and system for sending device control command, storage medium and electronic device |
| WO2023040678A1 (en) * | 2021-09-16 | 2023-03-23 | Oppo广东移动通信有限公司 | Information transmission method and apparatus, and electronic device, chip, storage medium, program and program product |
| CN114244879A (en) * | 2021-12-15 | 2022-03-25 | 北京声智科技有限公司 | Industrial control system, industrial control method and electronic equipment |
| CN114442537A (en) * | 2022-01-29 | 2022-05-06 | 深圳市智慧湾科技有限公司 | Device intelligentization method, device and readable storage medium |
| CN114442537B (en) * | 2022-01-29 | 2024-06-04 | 深圳市智慧湾科技有限公司 | Equipment intelligent method, equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112071320A (en) | Intelligent equipment voice control system and method | |
| CN111565218B (en) | Data processing method and electronic equipment | |
| CN110995665A (en) | Network distribution method and device, electronic equipment and storage medium | |
| US10536848B2 (en) | Anti-takeover systems and methods for network attached peripherals | |
| US10375492B2 (en) | Method of fitting a hearing assistance device | |
| CN109391634A (en) | Establish method, terminal and the computer readable storage medium of communication | |
| EP3157195B1 (en) | Communication protocol testing method, and tested device and testing platform thereof | |
| CN101938485B (en) | Bidirectional safety certification based IP (internet protocol) Camera service realization method of point-to-point protocol | |
| JP2017539163A (en) | Conversation analysis method and system based on SSH protocol | |
| CN110740084B (en) | Voice control method and related device | |
| CN112383881B (en) | Information reporting method, device, equipment and storage medium | |
| CN108449357B (en) | Authorized login method and device, intelligent device and storage medium | |
| CN112533206A (en) | Network distribution method and device, storage medium and electronic equipment | |
| CN108092958B (en) | Information authentication method and device, computer equipment and storage medium | |
| CN112383531B (en) | Monitoring system and monitoring system configuration method | |
| CN109617867B (en) | Intelligent gateway system for controlling household equipment | |
| CN113766019A (en) | Internet of things system based on combination of cloud and edge calculation | |
| CN112235308A (en) | Data transmission method and system for industrial equipment with different communication protocols | |
| CN113068163A (en) | Bluetooth networking method and system | |
| CN105612723A (en) | Method and device for distributing traffic by using plurality of network interfaces in wireless communication system | |
| CN102045343B (en) | DC (Digital Certificate) based communication encrypting safety method, server and system | |
| WO2022166775A1 (en) | Elevator accessory authentication method and system, and server and storage medium | |
| CN110968882A (en) | IC card remote operation system and method | |
| WO2019242256A1 (en) | Communication method, device, storage medium, voice board, detection board, and air conditioner | |
| WO2020133085A1 (en) | Information transmission method, storage medium, information transmission system and unmanned aerial vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |