CN113674749A - Control method, control device, electronic equipment and storage medium - Google Patents
Control method, control device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113674749A CN113674749A CN202110988253.4A CN202110988253A CN113674749A CN 113674749 A CN113674749 A CN 113674749A CN 202110988253 A CN202110988253 A CN 202110988253A CN 113674749 A CN113674749 A CN 113674749A
- Authority
- CN
- China
- Prior art keywords
- control instruction
- information
- determining
- voice information
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 238000005516 engineering process Methods 0.000 claims abstract description 27
- 238000003058 natural language processing Methods 0.000 claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 18
- 230000004044 response Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 10
- 230000006399 behavior Effects 0.000 description 6
- 238000007405 data analysis Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013475 authorization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000009897 systematic effect Effects 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a control method, which comprises the following steps: acquiring voice information acquired by acquisition equipment; recognizing the voiceprint of the voice information; determining a first control instruction based on the voice information; under the condition that the voiceprint belongs to an authorized user, sending a first control instruction to a corresponding first execution device so as to enable the first execution device to execute the first control instruction, wherein the determining of the first control instruction based on the voice information comprises the following steps: processing the voice information by adopting a natural language processing technology, and determining semantic information and intention information of the voice information; a first control instruction is determined based on the semantic information and the intent information.
Description
Technical Field
The present invention relates to the field of control, and in particular, to a control method, apparatus, electronic device, and storage medium.
Background
The development of smart homes is increasingly rapid, the interconnection and intercommunication of smart appliances are also the trend, but the current control methods for smart homes all depend on the app in the mobile phone for control, and the unified control for smart homes cannot be directly realized. Although some electrical appliances have voice control functions, the voice control functions are limited to specific voice control commands, and intelligent voice control cannot be realized.
Disclosure of Invention
To solve one or more of the above technical problems, the present invention provides a control method, including:
acquiring voice information acquired by acquisition equipment;
recognizing the voiceprint of the voice information;
determining a first control instruction based on the voice information;
in the case that the voiceprint belongs to an authorized user, sending the first control instruction to a corresponding first execution device to enable the first execution device to execute the first control instruction,
wherein the determining a first control instruction based on the voice information comprises:
processing the voice information by adopting a natural language processing technology, and determining semantic information and intention information of the voice information;
determining the first control instruction based on the semantic information and the intent information.
In some embodiments, the method further comprises:
acquiring use information of household equipment;
determining lifestyle information of an authorized user based on the usage information;
determining a topological relation among application scenes of the household equipment based on the life habit information;
and storing the topological relation.
In some embodiments, the method further comprises:
determining whether a first scene of the execution device executing the first control instruction belongs to an application scene in a topological relation;
sending prompt information based on the topological relation when the first scene is determined to belong to the application scene in the topological relation, wherein the prompt information is used for prompting the user whether to execute the next application scene behind the first scene in the topological relation;
determining a second control instruction under the condition that response information of the user for the prompt information is received, wherein the response information refers to a next application scene after the user confirms to execute the first scene in the topological relation, and the second control instruction is to execute the next application scene;
and sending the second control instruction to corresponding second execution equipment so as to enable the second execution equipment to execute the second control instruction.
In some embodiments, in the case that the first control instruction is plural, the method further includes:
determining the priority of each first control instruction;
the sending the first control instruction to the corresponding first execution device includes:
and sequentially sending each first control instruction to corresponding first execution equipment based on the priority.
In some embodiments, where the voiceprint comprises a plurality of voiceprints, the method further comprises:
determining the authorized user level corresponding to each voiceprint;
the sending the first control instruction to the corresponding first execution device includes:
and sending the first control instruction to the corresponding first execution equipment based on the authorized user level.
In some embodiments, the method further comprises:
determining whether the first control instruction satisfies a safety condition,
under the condition that the first control instruction meets a safety condition, the first control instruction is sent to corresponding first execution equipment, so that the first execution equipment executes the first control instruction;
and in the case that the first control instruction does not meet the safety condition, abandoning the first control instruction.
The present application also provides a control device, which includes:
the first acquisition module is used for acquiring the voice information acquired by the acquisition equipment;
the recognition module is used for recognizing the voiceprint of the voice information;
the first determining module is used for determining a first control instruction based on the voice information;
a first sending module, configured to send the first control instruction to a corresponding first execution device to enable the first execution device to execute the first control instruction when the voiceprint belongs to a user,
wherein the first determining module comprises:
the first determining unit is used for processing the voice information by adopting a natural language processing technology and determining semantic information and intention information of the voice information;
a second determination unit to determine the first control instruction based on the semantic information and the intention information.
In some embodiments, the apparatus further comprises:
the second acquisition module is used for acquiring the use information of the household equipment;
a second determination module for determining lifestyle habit information of an authorized user based on the usage information;
the third determining module is used for determining a topological relation among application scenes of the household equipment based on the life habit information;
and the storage module is used for storing the topological relation.
The present application also provides an electronic device comprising a memory and a processor, the memory having stored thereon a computer program which, when executed by the processor, performs the control method as described above.
The present application also provides a storage medium storing a computer program executable by one or more processors and operable to implement the control method as described above.
Compared with the prior art, one or more embodiments in the above scheme can have the following advantages or beneficial effects:
according to the control method, the control device, the electronic equipment and the storage medium, the voice information is collected and analyzed in a centralized mode through the collection equipment, and the analyzed control command is issued to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; by applying the natural language processing technology, the voice data of the authorized user can be intelligently analyzed, and the method is not limited to specific control instructions.
Drawings
The scope of the present disclosure may be better understood by reading the following detailed description of exemplary embodiments in conjunction with the accompanying drawings. Wherein the included drawings are:
fig. 1 is a schematic flow chart illustrating an implementation process of a control method according to an embodiment of the present application;
fig. 2 is a schematic flow chart illustrating an implementation of a control method according to an embodiment of the present application;
fig. 3 is a schematic flow chart illustrating an implementation of a control method according to an embodiment of the present application;
fig. 4 is a schematic flow chart illustrating an implementation of a control method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the attached drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.
To the extent that a similar description of "first/second/third" appears in this document, and where the description below refers to the term "first/second/third" merely to distinguish between similar items and not to imply a particular order of presentation of the items, it is to be understood that "first/second/third" may, where permissible, be interchanged of a particular order or sequence so that the embodiments of the application described herein may be practiced in other than the order illustrated or described herein.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.
Based on the problems in the related art, the embodiments of the present application provide a control method, where the method is applied to an electronic device, where the electronic device may be a computer, a mobile terminal, and the like, and functions implemented by the control method provided in the embodiments of the present application may be implemented by a processor of the electronic device calling a program code, where the program code may be stored in a computer storage medium.
An embodiment of the present application provides a control method, and fig. 1 is a schematic flow chart illustrating an implementation of the control method provided in the embodiment of the present application, and as shown in fig. 1, the control method includes the following steps.
Step S101: and acquiring voice information acquired by the acquisition equipment.
In the embodiment of the present application, the main body that executes the control method may be an electronic device. The electronic device may include a central processor that centrally processes the primary commands, issues execution commands, and performs data analysis.
In the embodiment of the present application, the acquisition device may be a self-contained voice acquisition device in a household device (such as an air conditioner, a television, a water heater, etc.), or may be a voice acquisition device that is separately equipped as a standby option, and is not limited to a device under a home local area network. Since the smart home devices are basically distributed in each room of the home, the control method disclosed by the application can realize the intelligent voice control of the whole home.
The connection mode between the electronic equipment and the acquisition equipment can be wired connection or wireless connection. The wireless connection can comprise multiple connection modes such as tcp/ip, wifi, mesh networking, Bluetooth and the like.
Step S201: and recognizing the voiceprint of the voice information.
Voiceprints have two features: first, after an adult, human voice can be kept relatively stable and unchanged for a long time; secondly, everyone has his own voiceprint, even if the simulated sound size and tone are different all the time.
In the embodiment of the application, the voice operation permission is opened only to the authorized user by applying the voiceprint recognition technology, so that the safety of the smart home is ensured.
Step S301: a first control instruction is determined based on the voice information.
In the embodiment of the application, the recognition of the voice information can adopt a Natural Language Processing (NLP) technology which is rapidly developing at present, the technology can perform corresponding digital Processing on the voice, tone, adage and the like of people to convert the voice, tone, adage and the like into a Language which can be recognized by a machine, and the voice data of an authorized user can be intelligently analyzed without being limited to a specific control instruction.
In some embodiments, fig. 2 is a schematic flow chart of an implementation of a control method provided in an embodiment of the present application, and as shown in fig. 2, the step S301 "determining a first control instruction based on the voice information" may be implemented by the following steps.
Step S311: and processing the voice information by adopting a natural language processing technology, and determining semantic information and intention information of the voice information.
In the embodiment of the application, the recognition of the voice information can adopt a Natural Language Processing (NLP) technology which is rapidly developing at present, and the technology can perform corresponding digital Processing on the voice, tone, adage and the like of people so as to convert the voice, tone, adage and the like into a Language which can be recognized by a machine and intelligently analyze the semantic information and intention information of a user.
Step S321: determining the first control instruction based on the semantic information and the intent information.
In the embodiment of the present application, the first control instruction is not limited to a specific control instruction. The natural language processing technology who combines this application to adopt can carry out corresponding digital processing to user's sound, tone, adage etc. and turn into the language that the machine can discern, makes this central control system become a "similar humanized intelligent steward".
Step S401: and under the condition that the voiceprint belongs to an authorized user, sending the first control instruction to a corresponding first execution device so as to enable the first execution device to execute the first control instruction.
In the embodiment of the application, the voiceprint of the authorized user can be stored in advance, and after the voiceprint is identified from the voice information, the voiceprint of the authorized user is compared with the stored voiceprint of the authorized user. Executing a first control instruction when the voice information is determined to belong to an authorized user; and when the voice information is determined not to belong to the authorized user, giving up the execution of the first control instruction. The first execution device may be a home device in a home.
Based on the above, the control method provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; by applying the voiceprint recognition technology, only the voice operation authority is opened for authorized users, the safety of the intelligent home is ensured, and meanwhile, noise can be filtered; by applying the natural language processing technology, the voice data of the authorized user can be intelligently analyzed, and the method is not limited to specific control instructions.
In some embodiments, fig. 3 is a schematic flow chart of an implementation of a control method provided in an embodiment of the present application, and as shown in fig. 3, after step S401 "in a case that the voiceprint belongs to an authorized user, the method further includes sending the first control instruction to a corresponding first execution device, so that the first execution device executes the first control instruction".
S11: and acquiring the use information of the household equipment.
In the embodiment of the application, the use information data of the household equipment can be acquired, and the household equipment can also be set to actively upload the use information data. The collected use information may include use duration, time period, category, and other information that may be used to analyze the lifestyle habits of the authorized user, and may also record what family scenario the authorized user is under when issuing the instruction.
S12: determining lifestyle information of an authorized user based on the usage information.
In the embodiment of the application, the collected daily communication information can be analyzed and recorded, so that the living habits of the user can be obtained. For example, the living habits of the user can be analyzed by collecting the use duration, the use time period, the use period, the type of the smart home and the like of the smart device within a certain time.
S13: and determining a topological relation among application scenes of the household equipment based on the life habit information.
In this application embodiment, the household equipment can be intelligent audio amplifier, intelligent air conditioner, intelligent TV, intelligent refrigerator, intelligent washing machine, intelligent switch, intelligent closestool, intelligent electromagnetism stove, intelligent electric rice cooker etc..
S14: and storing the topological relation.
S15: determining whether a first scene of the execution device executing the first control instruction belongs to an application scene in a topological relation;
s16: sending prompt information based on the topological relation when the first scene is determined to belong to the application scene in the topological relation, wherein the prompt information is used for prompting the user whether to execute the next application scene behind the first scene in the topological relation;
s17: determining a second control instruction under the condition that response information of the user for the prompt information is received, wherein the response information refers to a next application scene after the user confirms to execute the first scene in the topological relation, and the second control instruction is to execute the next application scene;
s18: and sending the second control instruction to corresponding second execution equipment so as to enable the second execution equipment to execute the second control instruction.
In this embodiment, the second execution device may be a home device in a home. One example of steps S11-S18 may be: the user opens the intelligent sound box to play music when going to the toilet at a certain time at night, and the system analyzes the behavior through the topological structure and then determines the behavior as one of the life categories. Then, each time the authorizer enters such a scenario, the intelligent voice system prompts the authorizer whether to execute the instructions of the following scenario. After authorization is obtained, it can be executed. Therefore, by means of high integration of the system, corresponding hardware cost and software development cost can be reduced. The safety coefficient can be improved by data integration processing; and the response efficiency of the equipment is improved through systematic control.
Based on the above, the control method provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; the life habits of the authorized users are analyzed by combining the use data of the smart home and the voice data analysis of the authorized users, and the use experience of the users is improved.
In some embodiments, where there are a plurality of first control instructions, the method may further comprise determining a priority of each first control instruction.
On this basis, the sending the first control instruction to the corresponding first execution device includes:
and sequentially sending each first control instruction to corresponding first execution equipment based on the priority.
In the embodiment of the present application, the setting of the priority is to distinguish the importance degree of the control instruction, so as to clarify the sequence of executing the control instruction.
In some embodiments, where the voiceprint comprises a plurality of voiceprints, the method may further comprise determining an authorized user level for each voiceprint.
On this basis, the sending the first control instruction to the corresponding first execution device includes:
and sending the first control instruction to the corresponding first execution equipment based on the authorized user level.
In the embodiment of the present application, the setting of the authorized user level is to clarify the sequence of executing the control instruction.
Based on the above, the control method provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; the household safety is analyzed by combining the use data of the smart home and the voice data analysis of the authorized user, and the safety of the authorized user is guaranteed.
In some embodiments, after step S401 "in a case that the voiceprint belongs to an authorized user, the first control instruction is sent to the corresponding first execution device, so that the first execution device executes the first control instruction", the method may further include determining whether the first control instruction satisfies a security condition.
In some embodiments, the determining whether the first control instruction satisfies a safety condition comprises:
under the condition that the first control instruction meets a safety condition, sending the first control instruction to corresponding first execution equipment so as to enable the first execution equipment to execute the first control instruction;
and in the case that the first control instruction does not meet the safety condition, abandoning the first control instruction.
Based on the above, the control method provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; when the behavior of the authorized user has risk, a prompt is sent out, so that the safety of the authorized user is ensured.
The embodiment of the application also provides a control device. Fig. 4 is a schematic structural diagram of a control device according to an embodiment of the present application. As shown in fig. 4, the control device 400 includes:
a first obtaining module 401, configured to obtain voice information collected by a collection device;
in the embodiment of the present application, the control device 400 may be an electronic device. The central processing unit may be specifically configured to centrally process the main command, issue the execution command, and perform data analysis.
In the embodiment of the present application, the acquisition device may be a self-contained voice acquisition device in a household device (such as an air conditioner, a television, a water heater, etc.), or may be a voice acquisition device that is separately equipped as a standby option, and is not limited to a device under a home local area network. Since the smart home devices are basically distributed in each room of the home, the control method disclosed by the application can realize the intelligent voice control of the whole home.
The specific collection connection mode may be a wired connection or a wireless connection. The wireless connection can comprise multiple connection modes such as tcp/ip, wifi, mesh networking, Bluetooth and the like.
A recognition module 402, configured to recognize a voiceprint of the voice information;
voiceprints have two features: first, after an adult, human voice can be kept relatively stable and unchanged for a long time; secondly, everyone has his own voiceprint, even if the simulated sound size and tone are different all the time.
In the embodiment of the application, the voice operation permission is opened only to the authorized user by applying the voiceprint recognition technology, so that the safety of the smart home is ensured.
A first determining module 403, configured to determine a first control instruction based on the voice information;
in the embodiment of the application, the recognition of the voice information can adopt a Natural Language Processing (NLP) technology which is rapidly developing at present, the technology can perform corresponding digital Processing on the voice, tone, adage and the like of people to convert the voice, tone, adage and the like into a Language which can be recognized by a machine, and the voice data of an authorized user can be intelligently analyzed without being limited to a specific control instruction.
In some embodiments, the first determining module 403 may include:
a first determination unit: processing the voice information by adopting a natural language processing technology, and determining semantic information and intention information of the voice information;
in the embodiment of the application, the recognition of the voice information can adopt a Natural Language Processing (NLP) technology which is rapidly developing at present, and the technology can perform corresponding digital Processing on the voice, tone, adage and the like of people so as to convert the voice, tone, adage and the like into a Language which can be recognized by a machine and intelligently analyze the voice data semantic information and intention information of an authorized user.
A second determination unit: for determining the first control instruction based on the semantic information and the intent information.
In the embodiment of the present application, the first control instruction is not limited to a specific control instruction. The natural language processing technology who combines this application to adopt can carry out corresponding digital processing to user's sound, tone, adage etc. and turn into the language that the machine can discern, makes this central control system become a "similar humanized intelligent steward".
In the embodiment of the application, the recognition of the voice information can adopt a Natural Language Processing (NLP) technology which is rapidly developing at present, the technology can perform corresponding digital Processing on the voice, tone, adage and the like of people to convert the voice, tone, adage and the like into a Language which can be recognized by a machine, and the semantic information and intention information of an authorized user can be intelligently analyzed without being limited to a specific control instruction.
A first sending module 404, configured to send the first control instruction to a corresponding first execution device to enable the first execution device to execute the first control instruction, if the voiceprint belongs to a user.
In the embodiment of the application, the voiceprint of the authorized user can be stored in advance, and after the voiceprint is identified from the voice information, the voiceprint of the authorized user is compared with the stored voiceprint of the authorized user. Executing a first control instruction when the voice information is determined to belong to an authorized user; and when the voice information is determined not to belong to the authorized user, giving up the execution of the first control instruction. The first execution device may be a home device in a home.
Based on the above, the control device provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; by applying the voiceprint recognition technology, only the voice operation authority is opened for authorized users, the safety of the intelligent home is ensured, and meanwhile, noise can be filtered; by applying the natural language processing technology, the voice data of the authorized user can be intelligently analyzed, and the method is not limited to specific control instructions.
In some embodiments, the control device may further include:
and the second acquisition module is used for acquiring the use information of the household equipment.
In the embodiment of the application, the use information data of the household equipment can be acquired, and the household equipment can also be set to actively upload the use information data. The collected use information may include use duration, time period, category, and other information that may be used to analyze the lifestyle habits of the authorized user, and may also record what family scenario the authorized user is under when issuing the instruction.
A second determination module for determining lifestyle habit information of an authorized user based on the usage information;
in the embodiment of the application, the collected daily communication information can be analyzed and recorded, so that the living habits of the user can be obtained. For example, the living habits of the user can be analyzed by collecting the use duration, the use time period, the use period, the type of the smart home and the like of the smart device within a certain time.
The third determining module is used for determining a topological relation among application scenes of the household equipment based on the life habit information;
in the embodiment of the application, the application scene of the household equipment can be an intelligent sound box, an intelligent air conditioner, an intelligent television, an intelligent refrigerator, an intelligent washing machine, an intelligent switch, an intelligent closestool, an intelligent induction cooker, an intelligent electric cooker and the like.
The storage module is used for storing the topological relation;
a fourth determining module, configured to determine whether a first scenario in which the executing device executes the first control instruction belongs to an application scenario in a topological relation;
a prompting module, configured to send a prompting message based on the topological relation when it is determined that the first scene belongs to an application scene in the topological relation, where the prompting message is used to prompt the user whether to execute a next application scene after the first scene in the topological relation;
a fifth determining module, configured to determine a second control instruction when response information of the user for the prompt information is received, where the response information refers to a next application scenario after the user confirms execution of the first scenario in the topological relation, and the second control instruction is to execute the next application scenario;
and the second sending module is used for sending the second control instruction to corresponding second execution equipment so as to enable the second execution equipment to execute the second control instruction.
In the embodiment of the application, the use information data of the household equipment can be acquired, and the household equipment can also be set to actively upload the use information data. The collected use information may include use duration, time period, category, and other information that may be used to analyze the lifestyle habits of the authorized user, and may also record what family scenario the authorized user is under when issuing the instruction.
In the embodiment of the application, the collected daily communication information can be analyzed and recorded.
In this embodiment, the second execution device may be a home device in a home. Examples of the use of the above modules may be: the user opens the intelligent sound box to play music when going to the toilet at a certain time at night, and the system analyzes the behavior through the topological structure and then determines the behavior as one of the life categories. Then, each time the authorizer enters such a scenario, the intelligent voice system prompts the authorizer whether to execute the instructions of the following scenario. After authorization is obtained, it can be executed. Therefore, by means of high integration of the system, corresponding hardware cost and software development cost can be reduced. The safety coefficient can be improved by data integration processing; and the response efficiency of the equipment is improved through systematic control.
Based on the above, the control device provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; the life habits of the authorized users are analyzed by combining the use data of the smart home and the voice data analysis of the authorized users, and the use experience of the users is improved.
In some embodiments, in the case that the first control instruction is plural, the apparatus may further include:
and the sixth determining module is used for determining the priority of each first control instruction.
On this basis, the first sending module 404 includes:
and the first sending unit is used for sequentially sending each first control instruction to the corresponding first execution equipment based on the priority.
In the embodiment of the present application, the setting of the priority is to distinguish the importance degree of the control instruction, so as to clarify the sequence of executing the control instruction.
In some embodiments, where the voiceprint comprises a plurality of voiceprints, the apparatus may further comprise:
and the seventh determining module is used for determining the authorized user level corresponding to each voiceprint.
On this basis, the first sending module 404 includes:
and the second sending unit is used for sending the first control instruction to the corresponding first execution equipment based on the authorized user level.
In the embodiment of the present application, the setting of the authorized user level is to clarify the sequence of executing the control instruction.
Based on the above, the control device provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; the household safety is analyzed by combining the use data of the smart home and the voice data analysis of the authorized user, and the safety of the authorized user is guaranteed.
In some embodiments, the apparatus may further comprise:
and the eighth determining module is used for determining whether the first control instruction meets a safety condition.
In some embodiments, the eighth determining module comprises:
a third sending unit, configured to send the first control instruction to a corresponding first execution device when the first control instruction satisfies a safety condition, so that the first execution device executes the first control instruction;
and the fourth sending unit is used for giving up the first control instruction under the condition that the first control instruction does not meet the safety condition.
Based on the above, the control device provided by the application collects and analyzes the voice information in a centralized manner through the collection equipment, and then issues the analyzed control instruction to the corresponding household equipment, so that the centralized control of the household equipment is realized, and the use of authorized users is facilitated; when the behavior of the authorized user has risk, a prompt is sent out, so that the safety of the authorized user is ensured.
In addition, the control device provided by the embodiment of the application can also perform security analysis on the household equipment: when the voice information is recognized, whether the instruction can threaten or injure the family is judged. In the specific judgment process, the current life situation of the family needs to be combined, and if no abnormity exists, the judgment is normally carried out; if an unexpected event occurs, such as burglary, fire, etc., the control device takes corresponding measures.
When burglary occurs, the control device can take measures of sending alarm information to nearby public security at the first time after triggering alarm, then protecting the rooms of family members and starting security measures. In case of a fire and the user is not convenient to extinguish the fire autonomously, the measures taken by the control device may be to trigger corresponding fire extinguishing measures. The application scenario of the above measures is mainly for accidents and emergencies.
In a specific execution process, the control device analyzes the family condition through the natural language processing technology system and executes a corresponding safety measure instruction.
It should be noted that, in the embodiment of the present application, if the positioning method of the above object is implemented in the form of a software functional module and is sold or used as a standalone product, it may also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof contributing to the prior art may be embodied in the form of a software product stored in a storage medium, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.
Accordingly, an embodiment of the present application provides a storage medium, on which a computer program is stored, wherein the computer program is implemented to realize the steps in the positioning method of the object provided in the above embodiment when executed by a processor.
The embodiment of the application also provides the electronic equipment. Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 5, the electronic device 500 includes: a processor 501, at least one communication bus 502, a user interface 503, at least one external communication interface 504, and a memory 505.
The communication bus 502 may be configured to enable, among other things, connectivity communications between these components.
The user interface 503 may include a display screen, and the external communication interface 504 may include a standard wired interface and a wireless interface, among others. The processor 501 is configured to execute a program of a positioning method of an object stored in the memory to implement the steps in the positioning method of an object provided in the above-described embodiments.
The above description of the display device and storage medium embodiments is similar to the description of the method embodiments above, with similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the computer device and the storage medium of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.
Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium and apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read Only Memory (ROM), a magnetic disk, or an optical disk.
Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a controller to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.
The above description is only for the embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A control method, comprising:
acquiring voice information acquired by acquisition equipment;
recognizing the voiceprint of the voice information;
determining a first control instruction based on the voice information;
in the case that the voiceprint belongs to an authorized user, sending the first control instruction to a corresponding first execution device to enable the first execution device to execute the first control instruction,
wherein the determining a first control instruction based on the voice information comprises:
processing the voice information by adopting a natural language processing technology, and determining semantic information and intention information of the voice information;
determining the first control instruction based on the semantic information and the intent information.
2. The method of claim 1, further comprising:
acquiring use information of household equipment;
determining lifestyle information of an authorized user based on the usage information;
determining a topological relation among application scenes of the household equipment based on the life habit information;
and storing the topological relation.
3. The method of claim 2, further comprising:
determining whether a first scene of the execution device executing the first control instruction belongs to an application scene in a topological relation;
sending prompt information based on the topological relation when the first scene is determined to belong to the application scene in the topological relation, wherein the prompt information is used for prompting the user whether to execute the next application scene behind the first scene in the topological relation;
determining a second control instruction under the condition that response information of the user for the prompt information is received, wherein the response information refers to a next application scene after the user confirms to execute the first scene in the topological relation, and the second control instruction is to execute the next application scene;
and sending the second control instruction to corresponding second execution equipment so as to enable the second execution equipment to execute the second control instruction.
4. The method according to claim 1, wherein in a case where the first control instruction is plural, the method further comprises:
determining the priority of each first control instruction;
the sending the first control instruction to the corresponding first execution device includes:
and sequentially sending each first control instruction to corresponding first execution equipment based on the priority.
5. The method of claim 1, where the voiceprint comprises a plurality of voiceprints, the method further comprising:
determining the authorized user level corresponding to each voiceprint;
the sending the first control instruction to the corresponding first execution device includes:
and sending the first control instruction to the corresponding first execution equipment based on the authorized user level.
6. The method of claim 1, further comprising:
determining whether the first control instruction satisfies a safety condition,
under the condition that the first control instruction meets a safety condition, the first control instruction is sent to corresponding first execution equipment, so that the first execution equipment executes the first control instruction;
and in the case that the first control instruction does not meet the safety condition, abandoning the first control instruction.
7. A control device, comprising:
the first acquisition module is used for acquiring the voice information acquired by the acquisition equipment;
the recognition module is used for recognizing the voiceprint of the voice information;
the first determining module is used for determining a first control instruction based on the voice information;
a first sending module, configured to send the first control instruction to a corresponding first execution device to enable the first execution device to execute the first control instruction when the voiceprint belongs to a user,
wherein the first determining module comprises:
the first determining unit is used for processing the voice information by adopting a natural language processing technology and determining semantic information and intention information of the voice information;
a second determination unit to determine the first control instruction based on the semantic information and the intention information.
8. The apparatus of claim 7, further comprising:
the second acquisition module is used for acquiring the use information of the household equipment;
a second determination module for determining lifestyle habit information of an authorized user based on the usage information;
the third determining module is used for determining a topological relation among application scenes of the household equipment based on the life habit information;
and the storage module is used for storing the topological relation.
9. An electronic device, comprising a memory and a processor, the memory having stored thereon a computer program which, when executed by the processor, performs the method of any of claims 1 to 6.
10. A storage medium storing a computer program executable by one or more processors and operable to implement a method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110988253.4A CN113674749A (en) | 2021-08-26 | 2021-08-26 | Control method, control device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110988253.4A CN113674749A (en) | 2021-08-26 | 2021-08-26 | Control method, control device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113674749A true CN113674749A (en) | 2021-11-19 |
Family
ID=78546634
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110988253.4A Pending CN113674749A (en) | 2021-08-26 | 2021-08-26 | Control method, control device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113674749A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024036804A1 (en) * | 2022-08-18 | 2024-02-22 | 青岛海尔科技有限公司 | Intent instruction determining method and apparatus, storage medium, and electronic device |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105099835A (en) * | 2014-04-21 | 2015-11-25 | 青岛海尔智能家电科技有限公司 | Linkage establishing method and device |
| CN107707436A (en) * | 2017-09-18 | 2018-02-16 | 广东美的制冷设备有限公司 | Terminal control method, device and computer-readable recording medium |
| CN108510986A (en) * | 2018-03-07 | 2018-09-07 | 北京墨丘科技有限公司 | Voice interactive method, device, electronic equipment and computer readable storage medium |
| CN109412910A (en) * | 2018-11-20 | 2019-03-01 | 三星电子（中国）研发中心 | The method and apparatus for controlling smart home device |
| CN109754804A (en) * | 2019-02-21 | 2019-05-14 | 珠海格力电器股份有限公司 | A kind of sound control method, device, storage medium and smart home system |
| CN109863722A (en) * | 2019-01-15 | 2019-06-07 | 深圳市汇顶科技股份有限公司 | Wireless control method, apparatus and system |
| US20190206412A1 (en) * | 2017-12-31 | 2019-07-04 | Midea Group Co., Ltd. | Method and system for controlling home assistant devices |
| CN110149618A (en) * | 2019-05-09 | 2019-08-20 | 腾讯科技（深圳）有限公司 | Smart machine cut-in method, device, equipment and medium based on vocal print authorization |
| CN110673940A (en) * | 2019-09-27 | 2020-01-10 | 杭州迪普科技股份有限公司 | Task execution method and device of application program, electronic device and storage medium |
| CN111046071A (en) * | 2019-11-28 | 2020-04-21 | 南京邮电大学 | Intelligent home decision method based on Markov logic network |
| CN111143061A (en) * | 2019-12-18 | 2020-05-12 | 海尔优家智能科技（北京）有限公司 | Multi-device linkage control method and device and storage medium |
| CN111421556A (en) * | 2020-05-29 | 2020-07-17 | 商玉婷 | Intelligent control system of robot |
| CN113225237A (en) * | 2021-04-13 | 2021-08-06 | 芜湖美的厨卫电器制造有限公司 | Control method and processor of household appliance |
| US20210256979A1 (en) * | 2018-06-29 | 2021-08-19 | Huawei Technologies Co., Ltd. | Voice Control Method, Wearable Device, and Terminal |
-
2021
- 2021-08-26 CN CN202110988253.4A patent/CN113674749A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105099835A (en) * | 2014-04-21 | 2015-11-25 | 青岛海尔智能家电科技有限公司 | Linkage establishing method and device |
| CN107707436A (en) * | 2017-09-18 | 2018-02-16 | 广东美的制冷设备有限公司 | Terminal control method, device and computer-readable recording medium |
| US20190206412A1 (en) * | 2017-12-31 | 2019-07-04 | Midea Group Co., Ltd. | Method and system for controlling home assistant devices |
| CN108510986A (en) * | 2018-03-07 | 2018-09-07 | 北京墨丘科技有限公司 | Voice interactive method, device, electronic equipment and computer readable storage medium |
| US20210256979A1 (en) * | 2018-06-29 | 2021-08-19 | Huawei Technologies Co., Ltd. | Voice Control Method, Wearable Device, and Terminal |
| CN109412910A (en) * | 2018-11-20 | 2019-03-01 | 三星电子（中国）研发中心 | The method and apparatus for controlling smart home device |
| CN109863722A (en) * | 2019-01-15 | 2019-06-07 | 深圳市汇顶科技股份有限公司 | Wireless control method, apparatus and system |
| CN109754804A (en) * | 2019-02-21 | 2019-05-14 | 珠海格力电器股份有限公司 | A kind of sound control method, device, storage medium and smart home system |
| CN110149618A (en) * | 2019-05-09 | 2019-08-20 | 腾讯科技（深圳）有限公司 | Smart machine cut-in method, device, equipment and medium based on vocal print authorization |
| CN110673940A (en) * | 2019-09-27 | 2020-01-10 | 杭州迪普科技股份有限公司 | Task execution method and device of application program, electronic device and storage medium |
| CN111046071A (en) * | 2019-11-28 | 2020-04-21 | 南京邮电大学 | Intelligent home decision method based on Markov logic network |
| CN111143061A (en) * | 2019-12-18 | 2020-05-12 | 海尔优家智能科技（北京）有限公司 | Multi-device linkage control method and device and storage medium |
| CN111421556A (en) * | 2020-05-29 | 2020-07-17 | 商玉婷 | Intelligent control system of robot |
| CN113225237A (en) * | 2021-04-13 | 2021-08-06 | 芜湖美的厨卫电器制造有限公司 | Control method and processor of household appliance |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024036804A1 (en) * | 2022-08-18 | 2024-02-22 | 青岛海尔科技有限公司 | Intent instruction determining method and apparatus, storage medium, and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9530306B2 (en) | Information notification method, information terminal, and program | |
| EP3070557B1 (en) | Smart home scenario switching method and system | |
| JP2020144375A (en) | System control method, system, and program | |
| CN105843051A (en) | Smart home system, control device and control method of smart home | |
| JP2003289587A (en) | Appliance control apparatus and method therefor | |
| CN105182786A (en) | Intelligent household management device and system | |
| CN107770013A (en) | A kind of intelligent sound and intelligent domestic system | |
| CN105629762B (en) | The control device and method of smart home | |
| US11240058B2 (en) | System and method to view occupant status and manage devices of building | |
| CN111487884A (en) | Storage medium, and intelligent household scene generation device and method | |
| CN110716444A (en) | Sound control method and device based on smart home and storage medium | |
| CN113674749A (en) | Control method, control device, electronic equipment and storage medium | |
| CN104378596B (en) | A kind of method and device carrying out distance communicating with picture pick-up device | |
| CN114326423A (en) | Automatic generation method of scene control scheme and scene control equipment | |
| CN113531844A (en) | Control method and system for noise reduction of air conditioner, electronic equipment and storage medium | |
| US9830901B1 (en) | Bodily function sound anonymization | |
| CN110989390A (en) | Smart home control method and device | |
| CN108037699B (en) | Robot, control method of robot, and computer-readable storage medium | |
| WO2023138097A1 (en) | Method and apparatus for controlling air conditioner, and air conditioner | |
| CN116386623A (en) | Voice interaction method of intelligent equipment, storage medium and electronic device | |
| CA2905401A1 (en) | A method of integrating a home entertainment system with life style systems which include searching and playing music using voice commands based upon humming or singing | |
| CN115826418A (en) | Intelligent household control method | |
| CN113589699A (en) | Intelligent household scene control method and device | |
| CN110491425A (en) | A kind of intelligent music play device | |
| CN113033336A (en) | Home device control method, apparatus, device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |