CN116192554A - Voice-based Internet of things equipment control method and system - Google Patents

Voice-based Internet of things equipment control method and system Download PDF

Info

Publication number
CN116192554A
CN116192554A CN202310449405.2A CN202310449405A CN116192554A CN 116192554 A CN116192554 A CN 116192554A CN 202310449405 A CN202310449405 A CN 202310449405A CN 116192554 A CN116192554 A CN 116192554A
Authority
CN
China
Prior art keywords
voice
internet
control
parameters
things
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310449405.2A
Other languages
Chinese (zh)
Inventor
刘娜娜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Engineering Vocational and Technical University
Original Assignee
Shandong Engineering Vocational and Technical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Engineering Vocational and Technical University filed Critical Shandong Engineering Vocational and Technical University
Priority to CN202310449405.2A priority Critical patent/CN116192554A/en
Publication of CN116192554A publication Critical patent/CN116192554A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/283—Processing of data at an internetworking point of a home automation network
    • H04L12/2834—Switching of information between an external network and a home network
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Automation & Control Theory (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention is applicable to the technical field of equipment control, and particularly relates to a voice-based Internet of things equipment control method and system, wherein the method comprises the following steps: acquiring gateway data, and inquiring the Internet of things equipment in the current local area network; acquiring a first control voice, performing content recognition on the first control voice, and determining the equipment of the Internet of things and the task type to be controlled; the method comprises the steps of calling setting parameters required by task types corresponding to an analog system corresponding to the Internet of things equipment, and filling the setting parameters based on a recognition result of first control voice; and generating interactive voice according to the missing set parameters, receiving a second control voice, supplementing the set parameters, and controlling the corresponding Internet of things equipment to execute the corresponding tasks. According to the method and the device for controlling the Internet equipment, the corresponding control instruction is generated, so that the Internet equipment can execute corresponding tasks according to the control instruction, the control of the Internet equipment with complicated operations such as a washing machine and the like through voice is realized, and the application range of voice control is improved.

Description

Voice-based Internet of things equipment control method and system
Technical Field
The invention belongs to the technical field of equipment control, and particularly relates to a voice-based Internet of things equipment control method and system.
Background
The internet of things, IOT for short, refers to billions of devices worldwide connected to the internet through sensors or Wi-Fi, which is basically a huge network of devices, each device collects data, and these data (collectively referred to as big data) are exchanged and analyzed.
The internet of things device may be a daily commodity such as a telephone, car, watch, washing machine or refrigerator. The internet of things device may also be a component of a machine and system, such as a component on an oil rig or aircraft engine; for the internet of things equipment in the current home environment, the control is usually performed through a voice assistant, and for the internet of things equipment such as a washing machine and the like, the voice assistant can only perform simple voice operation, but cannot perform specific tasks.
Disclosure of Invention
The embodiment of the invention aims to provide a voice-based control method for Internet of things equipment, and aims to solve the problem that the Internet of things equipment such as a washing machine and the like can only perform simple voice operation through a voice assistant and cannot execute specific tasks.
The embodiment of the invention is realized in such a way that the method for controlling the equipment of the Internet of things based on voice comprises the following steps:
acquiring gateway data, and inquiring the Internet of things equipment in the current local area network based on the gateway data;
acquiring a first control voice, performing content recognition on the first control voice, and determining the equipment of the Internet of things and the task type to be controlled;
the method comprises the steps of calling setting parameters required by task types corresponding to an analog system corresponding to the Internet of things equipment, and filling the setting parameters based on a recognition result of first control voice;
and generating interactive voice according to the missing set parameters, receiving a second control voice, supplementing the set parameters, and controlling the corresponding Internet of things equipment to execute the corresponding tasks.
Preferably, the step of obtaining the first control voice, performing content recognition on the first control voice, and determining the internet of things equipment and task type to be controlled specifically includes:
acquiring a first control voice, calling a preset voice recognition engine, performing voice recognition on the first control voice, and generating a voice recognition result;
extracting voice keywords from the voice recognition result, matching the voice keywords with preset attribute keywords of all the Internet of things equipment, and determining corresponding Internet of things equipment;
and matching the voice keywords with task keywords corresponding to the Internet of things equipment, and determining the corresponding task types.
Preferably, the step of retrieving a setting parameter required by a task type corresponding to an analog system corresponding to the internet of things device and filling the setting parameter based on a recognition result of the first control voice specifically includes:
according to the Internet of things equipment, a corresponding simulation system is called, and all task types matched with the simulation system are inquired;
performing parameter decomposition on the task of the task type, and determining all parameters required to be set at the time;
and determining disclosed parameters according to the recognition result of the first control voice, and determining filled parameters and unfilled parameters.
Preferably, the step of generating the interactive voice according to the missing setting parameters, receiving the second control voice, supplementing the setting parameters, and controlling the corresponding internet of things device to execute the corresponding task specifically includes:
determining the input sequence of unfilled parameters according to the simulation system, generating interactive voice for prompting a user and playing the interactive voice;
receiving a second control voice in real time, and filling unfilled parameters according to a recognition result of the second control voice until all unfilled parameters are filled;
and importing all the setting parameters into a simulation system, generating corresponding control instructions, and sending the control instructions to corresponding Internet of things equipment through a gateway.
Preferably, when the control instruction is transmitted, it is subjected to encryption processing.
Preferably, the acquiring is performed again when the content of the first control voice is empty.
Another object of an embodiment of the present invention is to provide a voice-based control system for an internet of things device, where the system includes:
the device query module is used for acquiring gateway data and querying the Internet of things devices in the current local area network based on the gateway data;
the task identification module is used for acquiring a first control voice, carrying out content identification on the first control voice and determining the equipment of the Internet of things and the task type which need to be controlled;
the basic parameter filling module is used for calling the setting parameters required by the task types corresponding to the simulation system corresponding to the Internet of things equipment and filling the setting parameters based on the recognition result of the first control voice;
the missing parameter filling module is used for generating interactive voice according to the missing setting parameters, receiving second control voice, supplementing the setting parameters and controlling corresponding Internet of things equipment to execute corresponding tasks.
Preferably, the task identification module includes:
the first voice recognition unit is used for acquiring a first control voice, calling a preset voice recognition engine, performing voice recognition on the first control voice and generating a voice recognition result;
the device identification unit is used for extracting voice keywords from the voice identification result, matching the voice keywords with preset attribute keywords of all the Internet of things devices, and determining corresponding Internet of things devices;
and the task type identification unit is used for matching the voice keywords with the task keywords corresponding to the Internet of things equipment and determining the corresponding task types.
Preferably, the base parameter filling module includes:
the data query unit is used for retrieving a corresponding simulation system according to the Internet of things equipment and querying all task types matched with the simulation system;
the task decomposition unit is used for carrying out parameter decomposition on the task of the task type and determining all parameters required to be set at the time;
and the parameter identification unit is used for determining the disclosed parameters for the identification result of the first control voice and determining the filled parameters and the unfilled parameters.
Preferably, the missing parameter filling module includes:
the voice prompt unit is used for determining the input sequence of unfilled parameters according to the simulation system, generating interactive voice for prompting a user and playing the interactive voice;
the data filling unit is used for receiving the second control voice in real time, and filling the unfilled parameters according to the recognition result of the second control voice until all the unfilled parameters are filled;
the device control unit is used for importing all the setting parameters into the simulation system, generating corresponding control instructions and sending the control instructions to corresponding Internet of things devices through the gateway.
According to the voice-based Internet of things equipment control method, the controlled Internet of things equipment and tasks required to be executed by the Internet of things equipment are determined by acquiring the first control voice, further, required parameters are determined according to the voice recognition result obtained at this time, interaction is performed with a user according to the missing parameters, the second control voice is recognized so as to complement the missing parameters of the tasks, and after the parameters are all collected, a corresponding control instruction is generated, so that the Internet of things equipment can execute the corresponding tasks according to the control instruction, control of the Internet equipment with complicated operation such as a washing machine through voice is achieved, and the application range of voice control is improved.
Drawings
Fig. 1 is a flowchart of a method for controlling an internet of things device based on voice according to an embodiment of the present invention;
fig. 2 is a flowchart of steps for acquiring a first control voice, performing content recognition on the first control voice, and determining an internet of things device and a task type to be controlled according to the embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps for retrieving setting parameters required by a task type corresponding to an analog system corresponding to an Internet of things device and filling the setting parameters based on a recognition result of a first control voice according to an embodiment of the present invention;
fig. 4 is a flowchart of steps for generating an interactive voice according to missing setting parameters, receiving a second control voice, supplementing the setting parameters, and controlling corresponding internet of things equipment to execute corresponding tasks according to the embodiment of the present invention;
fig. 5 is a schematic diagram of a control system of an internet of things device based on voice according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a task identification module according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a basic parameter filling module according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a missing parameter filling module according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, a flowchart of a method for controlling an internet of things device based on voice according to an embodiment of the present invention is provided, where the method includes:
s100, acquiring gateway data, and inquiring the Internet of things equipment in the current local area network based on the gateway data.
In this step, gateway data are obtained, for a home environment, a plurality of intelligent households are usually provided, networking is required for all intelligent households, so that data connection can be established with each intelligent household through a gateway, gateway data are obtained, the gateway data are analyzed, the internet of things equipment which is connected with a network in the current local area network can be known, different internet of things equipment has different requirements for control instructions, such as the start-up or the shutdown of an intelligent television, only one instruction is required, intelligent equipment such as a washing machine is controlled, a plurality of instructions are usually required to be input, such as the start-up, the switching to a washing mode, the washing temperature is set at 50 ℃ and the speed is changed to three, and the like, therefore, for the washing machine, voice control cannot be directly performed, a user can only perform touch operation on a corresponding APP, and therefore, the control cannot be performed through a voice assistant.
S200, acquiring a first control voice, performing content recognition on the first control voice, and determining the Internet of things equipment and task types to be controlled.
In this step, a first control voice is obtained, where the first control voice is a first control instruction sent when a user needs to control intelligent devices such as a washing machine, and includes a name of an internet of things device to be controlled and a task type to be executed by the first control voice.
S300, the setting parameters required by the task types corresponding to the simulation system corresponding to the Internet of things equipment are called, and the setting parameters are filled based on the recognition result of the first control voice.
In this step, the setting parameters required by the task type corresponding to the analog system corresponding to the internet of things device are called, for example, for the washing mode of the washing machine, not only the corresponding specific parameters need to be set according to the type of clothes, but also the water inflow amount needs to be set, the amount of detergent to be added, the spin-drying time, the soaking time and whether drying is needed, the parameters required by the corresponding task are determined by running the analog system corresponding to the internet device, for example, for the washing machine, the first control voice determines that the washing mode is entered, the analog system is controlled to execute the washing mode, and then the required setting parameters are determined according to the parameters required by the analog system.
S400, generating interactive voice according to the missing setting parameters, receiving second control voice, supplementing the setting parameters, and controlling corresponding Internet of things equipment to execute corresponding tasks.
In this step, generating an interactive voice according to the missing set parameters, when entering a certain mode, all the required parameters are listed as a list, removing the parameters recorded in the first control voice, extracting the remaining undetermined parameters, namely, the set parameters required to be supplemented, generating the interactive voice to remind the user through the interactive voice, setting which parameters are required to be set and then receiving the second control voice from the user, extracting the text data recorded therein in a voice recognition mode, further supplementing the set parameters according to the extracted text data until all the parameters required to execute the task are determined, and sending a control instruction to the corresponding internet of things equipment to enable the corresponding internet of things equipment to execute the corresponding task.
As shown in fig. 2, as a preferred embodiment of the present invention, the steps of obtaining a first control voice, performing content recognition on the first control voice, and determining an internet of things device and a task type to be controlled specifically include:
s201, acquiring a first control voice, calling a preset voice recognition engine, performing voice recognition on the first control voice, and generating a voice recognition result.
In the step, a first control voice is acquired, a preset voice recognition engine is called, voice recognition is carried out on the first control voice by utilizing the voice recognition engine, a corresponding voice recognition result is obtained, and data in the voice recognition result are displayed through texts, namely, the voice is converted into texts.
S202, extracting voice keywords from the voice recognition result, matching the voice keywords with preset attribute keywords of all the Internet of things equipment, and determining corresponding Internet of things equipment.
In the step, voice keywords are extracted from the voice recognition result, adjacent words in the voice recognition result are combined to obtain a plurality of voice keywords, a preset database is queried, a preset attribute keyword corresponding to each Internet of things device is obtained, the voice keywords are compared with the attribute keywords, and the Internet of things device to be controlled at this time is judged according to the matching result.
And S203, matching the voice keywords with task keywords corresponding to the Internet of things equipment, and determining corresponding task types.
In this step, the voice keyword is matched with the task keyword corresponding to the internet of things device, because the internet of things device is determined at present, the task to be executed by the current internet of things device needs to be further determined, so the voice keyword is matched with the task keyword, and if the voice keyword is matched with the task keyword, the corresponding task needs to be executed by the internet of things device can be determined.
As shown in fig. 3, as a preferred embodiment of the present invention, the step of retrieving the setting parameters required by the task type corresponding to the analog system corresponding to the internet of things device, and filling the setting parameters based on the recognition result of the first control voice specifically includes:
s301, a corresponding simulation system is called according to the Internet of things equipment, and all task types matched with the simulation system are queried.
In the step, the corresponding simulation system is called according to the Internet of things equipment, the corresponding simulation system is a washing machine if the Internet of things equipment is a washing machine, and the two are provided with the same control system, namely, the input of the same data can obtain the same output, so that the types of all tasks which can be executed by the Internet of things equipment can be known according to the simulation system.
S302, carrying out parameter decomposition on the task of the task type, and determining all parameters required to be set at this time.
In this step, the task of the task type is subjected to parameter decomposition, and a plurality of parameters are required to be input for any task to execute the corresponding task, and as described above, whether the dehydration, the drying time, the drying temperature, the dehydration rotation speed and the like are required to be set for the drying mode, the parameters required to be set for the task are determined.
S303, determining disclosed parameters for the recognition result of the first control voice, and determining filled parameters and unfilled parameters.
In this step, the recognition result of the first control voice and the parameters of which the voice recognition result has been disclosed are called, after the task type is determined, all the parameters required for executing the task have been determined, and part of the parameters have been recorded in the recognition result of the first control voice, so that the filled parameters and the unfilled parameters can be determined according to the parameters.
As shown in fig. 4, as a preferred embodiment of the present invention, the steps of generating the interactive voice according to the missing setting parameters, receiving the second control voice, supplementing the setting parameters, and controlling the corresponding internet of things device to execute the corresponding tasks specifically include:
s401, determining the input sequence of unfilled parameters according to a simulation system, generating interactive voice for prompting a user and playing the interactive voice.
In this step, the input sequence of unfilled parameters is determined according to the simulation system, the amount of detergent is input first, then the dehydration rotational speed is input, and finally the water consumption is input, when the interactive voice is generated, the interactive voice is generated according to the sequence and played, and the user speaks the second control voice after hearing the interactive voice.
S402, receiving the second control voice in real time, and filling the unfilled parameters according to the recognition result of the second control voice until all unfilled parameters are filled.
In the step, the second control voice is received in real time, the content of the second control voice is identified by using a preset voice identification engine to obtain an identification result, the characters contained in the identification result are extracted by keywords, and all unset parameters are filled until all unset parameters are determined.
S403, importing all the setting parameters into a simulation system, generating corresponding control instructions, and sending the control instructions to corresponding Internet of things equipment through a gateway.
In this step, all the setting parameters are imported into the simulation system, and since the simulation system and the actual internet equipment will have the same output after running, it can be determined whether all the required parameters are obtained, the parameters are packaged to obtain control instructions, the control instructions are sent to the corresponding internet of things equipment through the gateway, the internet of things equipment analyzes the control instructions, and the corresponding operation is executed, so that the task is completed.
As shown in fig. 5, a voice-based control system for an internet of things device according to an embodiment of the present invention includes:
the device query module 100 is configured to obtain gateway data, and query the internet of things device in the current local area network based on the gateway data.
In the system, the device query module 100 acquires gateway data, for a home environment, a plurality of intelligent households are usually arranged, and all intelligent households need to be connected with each intelligent household for use, so that data connection can be established between the gateway and each intelligent household, the gateway data are analyzed, the internet of things devices which are connected with the network in the current local area network can be known, different internet of things devices have different requirements on control instructions, such as the start-up or the shutdown of an intelligent television, only one instruction is needed, and intelligent devices such as a washing machine are controlled, a plurality of instructions are usually needed to be input, such as the start-up, the switching to a washing mode, the washing temperature is set at 50 ℃ and the rotation speed is changed to three, and the like, therefore, for the washing machine, voice control cannot be directly performed, and a user can only perform touch operation on the corresponding APP and cannot be controlled by a voice assistant.
The task recognition module 200 is configured to obtain a first control voice, perform content recognition on the first control voice, and determine an internet of things device and a task type that need to be controlled.
In the system, the task recognition module 200 obtains a first control voice, wherein the first control voice is a first control instruction sent when a user needs to control intelligent equipment such as a washing machine, the first control voice comprises the name of the equipment of the internet of things needing to be controlled and the task type needing to be executed, the name of the equipment of the internet of things is extracted and matched with the equipment of the internet of things extracted from gateway data, if the corresponding equipment of the internet of things exists, the equipment of the internet of things is used as an object of the voice control, and then the recorded task type is recognized, for example, the washing machine comprises a washing mode, a drying mode or a dehydration mode.
The basic parameter filling module 300 is configured to call a setting parameter required by a task type corresponding to an analog system corresponding to the internet of things device, and fill the setting parameter based on a recognition result of the first control voice.
In the present system, the basic parameter filling module 300 invokes the setting parameters required by the task type corresponding to the analog system corresponding to the internet of things device, for example, for the washing mode of the washing machine, it is required to set not only the corresponding specific parameters according to the type of clothes, but also the water intake, the dosage of the added detergent, the spin-drying time, the soaking time and whether the drying is required, and determines the parameters required by the task by operating the analog system corresponding to the internet device, for example, for the washing machine, if the entering washing mode is determined in the first control voice, the analog system is controlled to execute the washing mode, and then the setting parameters required at this time are determined according to the parameters required by the analog system, and because the user may have given some parameters in the first control voice, the first control voice is subjected to voice recognition, and the setting parameters are filled according to the result of the voice recognition.
The missing parameter filling module 400 is configured to generate an interactive voice according to the missing setting parameters, receive a second control voice, supplement the setting parameters, and control the corresponding internet of things device to execute the corresponding task.
In the system, the missing parameter filling module 400 generates an interactive voice according to the missing setting parameters, when entering a certain mode, all the required parameters are listed, the parameters which are recorded in the first control voice are removed, the remaining undetermined parameters are extracted to be the setting parameters which need to be supplemented, the interactive voice is generated to remind a user through the interactive voice, which parameters are required to be set to further receive a second control voice from the user, text data recorded in the interactive voice are extracted in a voice recognition mode, the setting parameters are further supplemented according to the extracted text data until all the parameters required for executing the task are determined, and the corresponding internet of things equipment sends out a control instruction to enable the corresponding internet of things equipment to execute the corresponding task.
As shown in fig. 6, as a preferred embodiment of the present invention, the task identification module 200 includes:
the first voice recognition unit 201 is configured to obtain a first control voice, invoke a preset voice recognition engine, perform voice recognition on the first control voice, and generate a voice recognition result.
In this module, the first speech recognition unit 201 obtains the first control speech, invokes a preset speech recognition engine, and performs speech recognition on the first control speech by using the speech recognition engine to obtain a corresponding speech recognition result, where data in the speech recognition result is displayed through text, that is, speech is converted into text.
The device recognition unit 202 is configured to extract a voice keyword from the voice recognition result, match the voice keyword with preset attribute keywords of each internet of things device, and determine a corresponding internet of things device.
In this module, the device recognition unit 202 extracts a voice keyword from the voice recognition result, combines adjacent words in the voice recognition result to obtain a plurality of voice keywords, queries a preset database, obtains a preset attribute keyword corresponding to each internet of things device, compares the voice keyword with the attribute keyword, and determines the internet of things device to be controlled according to the matching result.
The task type recognition unit 203 is configured to match a voice keyword with a task keyword corresponding to the internet of things device, and determine a corresponding task type.
In this module, the task type recognition unit 203 matches the voice keyword with the task keyword corresponding to the internet of things device, because the internet of things device is already determined at present, the task that needs to be executed by the current internet of things device needs to be further determined, so the voice keyword is matched with the task keyword, and if the voice keyword is matched with the task keyword, the internet of things device needs to execute the corresponding task can be determined.
As shown in fig. 7, as a preferred embodiment of the present invention, the basic parameter filling module 300 includes:
the data query unit 301 is configured to retrieve a corresponding simulation system according to the internet of things device, and query all task types matched with the simulation system.
In this module, the data query unit 301 invokes a corresponding simulation system according to the internet of things device, where the internet of things device is a washing machine, and the corresponding simulation system is also a washing machine, and the two have the same control system, i.e. inputting the same data will obtain the same output, so that the type of all tasks that can be executed by the internet of things device can be known according to the simulation system.
The task decomposition unit 302 is configured to perform parameter decomposition on the task of the task type, and determine all parameters that need to be set at this time.
In this module, the task decomposition unit 302 performs parameter decomposition on the task of the task type, and for any task, a plurality of parameters need to be input to execute the corresponding task, and as described above, whether to perform dehydration, drying time, drying temperature, dehydration rotation speed, and the like need to be set for the drying mode, and the parameters that need to be set for the task are determined.
The parameter identification unit 303 is configured to determine parameters that have been disclosed for the identification result of the first control voice, and determine filled parameters and unfilled parameters.
In this module, the parameter recognition unit 303 invokes the recognition result of the first control voice and the parameters of which the voice recognition result has been disclosed, after determining the task type, all the parameters required for executing the task have been determined, and part of the parameters have been recorded in the recognition result of the first control voice, so that the filled parameters and the unfilled parameters can be determined according to the parameters.
As shown in fig. 8, as a preferred embodiment of the present invention, the missing parameter filling module 400 includes:
the voice prompting unit 401 is configured to determine an input order of unfilled parameters according to the simulation system, generate an interactive voice for prompting a user, and play the interactive voice.
In this module, the voice prompt unit 401 determines the input sequence of unfilled parameters according to the simulation system, firstly inputs the dosage of the detergent, then inputs the dehydration rotation speed, finally inputs the water consumption, and when generating the interactive voice, generates and plays the interactive voice according to the sequence, and the user speaks the second control voice after hearing the interactive voice.
And the data filling unit 402 is configured to receive the second control voice in real time, and fill the unfilled parameters according to the recognition result of the second control voice until all the unfilled parameters are filled.
In this module, the data filling unit 402 receives the second control voice in real time, and performs content recognition on the second control voice by using a preset voice recognition engine to obtain a recognition result, extracts keywords from characters included in the recognition result, and fills all unset parameters until all unset parameters are determined.
The device control unit 403 is configured to import all the setting parameters into the simulation system, generate a corresponding control instruction, and send the control instruction to the corresponding internet of things device through the gateway.
In this module, the device control unit 403 imports all the setting parameters into the simulation system, and since the simulation system and the actual internet device will have the same output after running, it can determine whether all the required parameters are obtained, package the parameters to obtain a control instruction, send the control instruction to the corresponding internet of things device through the gateway, and the internet of things device analyzes the control instruction, executes the corresponding operation, and completes the task.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in various embodiments may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or other steps.
Those skilled in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by a computer program for instructing relevant hardware, where the program may be stored in a non-volatile computer readable storage medium, and where the program, when executed, may include processes in the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the invention and are described in detail herein without thereby limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.

Claims (10)

1. The method for controlling the equipment of the Internet of things based on the voice is characterized by comprising the following steps:
acquiring gateway data, and inquiring the Internet of things equipment in the current local area network based on the gateway data;
acquiring a first control voice, performing content recognition on the first control voice, and determining the equipment of the Internet of things and the task type to be controlled;
the method comprises the steps of calling setting parameters required by task types corresponding to an analog system corresponding to the Internet of things equipment, and filling the setting parameters based on a recognition result of first control voice;
and generating interactive voice according to the missing set parameters, receiving a second control voice, supplementing the set parameters, and controlling the corresponding Internet of things equipment to execute the corresponding tasks.
2. The method for controlling the internet of things equipment based on voice according to claim 1, wherein the steps of obtaining the first control voice, performing content recognition on the first control voice, and determining the internet of things equipment and task type to be controlled specifically include:
acquiring a first control voice, calling a preset voice recognition engine, performing voice recognition on the first control voice, and generating a voice recognition result;
extracting voice keywords from the voice recognition result, matching the voice keywords with preset attribute keywords of all the Internet of things equipment, and determining corresponding Internet of things equipment;
and matching the voice keywords with task keywords corresponding to the Internet of things equipment, and determining the corresponding task types.
3. The method for controlling the internet of things device based on voice according to claim 1, wherein the step of retrieving the setting parameters required by the task type corresponding to the analog system corresponding to the internet of things device and filling the setting parameters based on the recognition result of the first control voice specifically comprises:
according to the Internet of things equipment, a corresponding simulation system is called, and all task types matched with the simulation system are inquired;
performing parameter decomposition on the task of the task type, and determining all parameters required to be set at the time;
and determining disclosed parameters according to the recognition result of the first control voice, and determining filled parameters and unfilled parameters.
4. The method for controlling a voice-based internet of things device according to claim 3, wherein the step of generating the interactive voice according to the missing set parameters, receiving the second control voice, supplementing the set parameters, and controlling the corresponding internet of things device to execute the corresponding task specifically comprises:
determining the input sequence of unfilled parameters according to the simulation system, generating interactive voice for prompting a user and playing the interactive voice;
receiving a second control voice in real time, and filling unfilled parameters according to a recognition result of the second control voice until all unfilled parameters are filled;
and importing all the setting parameters into a simulation system, generating corresponding control instructions, and sending the control instructions to corresponding Internet of things equipment through a gateway.
5. The voice-based internet of things device control method of claim 4, wherein the control command is encrypted when transmitted.
6. The voice-based internet of things device control method of claim 1, wherein the acquiring is resumed when the content of the first control voice is empty.
7. A voice-based internet of things device control system, the system comprising:
the device query module is used for acquiring gateway data and querying the Internet of things devices in the current local area network based on the gateway data;
the task identification module is used for acquiring a first control voice, carrying out content identification on the first control voice and determining the equipment of the Internet of things and the task type which need to be controlled;
the basic parameter filling module is used for calling the setting parameters required by the task types corresponding to the simulation system corresponding to the Internet of things equipment and filling the setting parameters based on the recognition result of the first control voice;
the missing parameter filling module is used for generating interactive voice according to the missing setting parameters, receiving second control voice, supplementing the setting parameters and controlling corresponding Internet of things equipment to execute corresponding tasks.
8. The voice-based internet of things device control system of claim 7, wherein the task identification module comprises:
the first voice recognition unit is used for acquiring a first control voice, calling a preset voice recognition engine, performing voice recognition on the first control voice and generating a voice recognition result;
the device identification unit is used for extracting voice keywords from the voice identification result, matching the voice keywords with preset attribute keywords of all the Internet of things devices, and determining corresponding Internet of things devices;
and the task type identification unit is used for matching the voice keywords with the task keywords corresponding to the Internet of things equipment and determining the corresponding task types.
9. The voice-based internet of things device control system of claim 7, wherein the base parameter filling module comprises:
the data query unit is used for retrieving a corresponding simulation system according to the Internet of things equipment and querying all task types matched with the simulation system;
the task decomposition unit is used for carrying out parameter decomposition on the task of the task type and determining all parameters required to be set at the time;
and the parameter identification unit is used for determining the disclosed parameters for the identification result of the first control voice and determining the filled parameters and the unfilled parameters.
10. The voice-based internet of things device control system of claim 9, wherein the missing parameter filling module comprises:
the voice prompt unit is used for determining the input sequence of unfilled parameters according to the simulation system, generating interactive voice for prompting a user and playing the interactive voice;
the data filling unit is used for receiving the second control voice in real time, and filling the unfilled parameters according to the recognition result of the second control voice until all the unfilled parameters are filled;
the device control unit is used for importing all the setting parameters into the simulation system, generating corresponding control instructions and sending the control instructions to corresponding Internet of things devices through the gateway.
CN202310449405.2A 2023-04-25 2023-04-25 Voice-based Internet of things equipment control method and system Pending CN116192554A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310449405.2A CN116192554A (en) 2023-04-25 2023-04-25 Voice-based Internet of things equipment control method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310449405.2A CN116192554A (en) 2023-04-25 2023-04-25 Voice-based Internet of things equipment control method and system

Publications (1)

Publication Number Publication Date
CN116192554A true CN116192554A (en) 2023-05-30

Family

ID=86442654

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310449405.2A Pending CN116192554A (en) 2023-04-25 2023-04-25 Voice-based Internet of things equipment control method and system

Country Status (1)

Country Link
CN (1) CN116192554A (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855872A (en) * 2012-09-07 2013-01-02 深圳市信利康电子有限公司 Method and system for controlling household appliance on basis of voice interaction between terminal and internet
US20160111091A1 (en) * 2014-10-20 2016-04-21 Vocalzoom Systems Ltd. System and method for operating devices using voice commands
WO2017016288A1 (en) * 2015-07-30 2017-02-02 北京智网时代科技有限公司 Intelligent control system
CN107689904A (en) * 2017-10-23 2018-02-13 深圳市敢为软件技术有限公司 Sound control method, device, Internet of things system and readable storage medium storing program for executing
CN108831448A (en) * 2018-03-22 2018-11-16 北京小米移动软件有限公司 The method, apparatus and storage medium of voice control smart machine
CN108880961A (en) * 2018-07-19 2018-11-23 广东美的厨房电器制造有限公司 Appliances equipment control method and device, computer equipment and storage medium
US10366692B1 (en) * 2017-05-15 2019-07-30 Amazon Technologies, Inc. Accessory for a voice-controlled device
CN111696534A (en) * 2019-03-15 2020-09-22 阿里巴巴集团控股有限公司 Voice interaction device and system, device control method, computing device, and medium
CN113555018A (en) * 2021-07-20 2021-10-26 海信视像科技股份有限公司 Voice interaction method and device
WO2022125085A1 (en) * 2020-12-09 2022-06-16 Electrolux Home Products, Inc. System for computing network-independent appliance control using natural language processing and user feedback
US20230113524A1 (en) * 2021-10-07 2023-04-13 International Business Machines Corporation Reactive voice device management

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855872A (en) * 2012-09-07 2013-01-02 深圳市信利康电子有限公司 Method and system for controlling household appliance on basis of voice interaction between terminal and internet
US20160111091A1 (en) * 2014-10-20 2016-04-21 Vocalzoom Systems Ltd. System and method for operating devices using voice commands
WO2017016288A1 (en) * 2015-07-30 2017-02-02 北京智网时代科技有限公司 Intelligent control system
US10366692B1 (en) * 2017-05-15 2019-07-30 Amazon Technologies, Inc. Accessory for a voice-controlled device
CN107689904A (en) * 2017-10-23 2018-02-13 深圳市敢为软件技术有限公司 Sound control method, device, Internet of things system and readable storage medium storing program for executing
CN108831448A (en) * 2018-03-22 2018-11-16 北京小米移动软件有限公司 The method, apparatus and storage medium of voice control smart machine
CN108880961A (en) * 2018-07-19 2018-11-23 广东美的厨房电器制造有限公司 Appliances equipment control method and device, computer equipment and storage medium
CN111696534A (en) * 2019-03-15 2020-09-22 阿里巴巴集团控股有限公司 Voice interaction device and system, device control method, computing device, and medium
WO2022125085A1 (en) * 2020-12-09 2022-06-16 Electrolux Home Products, Inc. System for computing network-independent appliance control using natural language processing and user feedback
CN113555018A (en) * 2021-07-20 2021-10-26 海信视像科技股份有限公司 Voice interaction method and device
US20230113524A1 (en) * 2021-10-07 2023-04-13 International Business Machines Corporation Reactive voice device management

Similar Documents

Publication Publication Date Title
CN111666296B (en) SQL data real-time processing method and device based on Flink, computer equipment and medium
KR20200127058A (en) Authentication method, device and authentication client
JP2006107498A (en) Execution of object oriented function in automation systems
CN110471585A (en) Function of application icon methods of exhibiting, device and computer equipment
CN106326099B (en) A kind of method, apparatus and electronic equipment for program tracking
CN110597709B (en) Interactive debugging method and device for mixed-mode mobile application and computer equipment
CN102957622A (en) Method, device and system for data processing
CN114139839B (en) Machine learning method based on working conditions and related device
CN116192554A (en) Voice-based Internet of things equipment control method and system
CN109213775B (en) Search method, search device, computer equipment and storage medium
CN114237736A (en) Page resource loading method, system, device, computer equipment and storage medium
EP3637273A1 (en) Ontology management method and m2m platform
CN116360809B (en) Remote firmware upgrading method, system and medium for embedded intelligent terminal
CN111381935A (en) DSL configuration expression-based function implementation method and system
KR20110017760A (en) System for extracting multimedia contents descriptor and method therefor
CN113595938B (en) Virtual network performance acceleration method, device, equipment and storage medium
CN113259214B (en) Driving data monitoring system
CN115271503A (en) Automatic operation and maintenance method and device, electronic equipment and storage medium
CN115294979A (en) Method, apparatus, storage medium, and voice device for reducing voice response time
CN110888860B (en) Model feature processing method and device, computer equipment and storage medium
CN108256957A (en) Vehicle source search result based on user's history behavior shows method and device
CN103443766B (en) The coverage setting device of program, and using the device coverage ad hoc approach and the extracting method of impacted program
CN103034661A (en) Electronic device and method for rapidly opening webpage by electronic device
CN111176930A (en) Component operation data processing method and device, computer equipment and storage medium
CN110008028A (en) Computational resource allocation method, apparatus, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination