CN114967491A - Intelligent household equipment control method and device, electronic equipment and storage medium - Google Patents
Intelligent household equipment control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114967491A CN114967491A CN202210625417.1A CN202210625417A CN114967491A CN 114967491 A CN114967491 A CN 114967491A CN 202210625417 A CN202210625417 A CN 202210625417A CN 114967491 A CN114967491 A CN 114967491A
- Authority
- CN
- China
- Prior art keywords
- target
- instruction information
- determining
- voice instruction
- intelligent household
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000000605 extraction Methods 0.000 claims description 13
- 230000004044 response Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
Abstract
The disclosure relates to an intelligent household equipment control method, which comprises the following steps: responding to the trigger operation of the first object, and acquiring the voiceprint characteristics of the second object; responding to the configuration operation of the first object, and determining the control authority of the second object on the intelligent household equipment; receiving voice instruction information, and determining a target second object and target intelligent household equipment according to the voice instruction information; when the control authority corresponding to the target second object comprises the control authority of the target intelligent home equipment, the control instruction information corresponding to the voice instruction information is output to the target intelligent home equipment, and the safety of voice control of the intelligent home equipment is improved.
Description
Technical Field
The present disclosure relates to the field of intelligent control technologies, and in particular, to a method and an apparatus for controlling smart home devices, an electronic device, and a storage medium.
Background
With the improvement of the technological level, smart home devices are accepted by more and more families, smart home devices (home automation) take a house as a platform, and integrate facilities related to home life by utilizing a comprehensive wiring technology, a network communication technology, a safety precaution technology, an automatic control technology and an audio and video technology, so that a high-efficiency management system for home facilities and family schedule affairs is constructed, the home safety, convenience, comfort and artistry are improved, and the environment-friendly and energy-saving living environment is realized.
The existing intelligent household equipment is generally controlled and used in a voice control mode, the voice control mode is widely applied to intelligent mobile phone terminals, wearing accessories and intelligent household equipment, the work of the intelligent household equipment can be controlled by speaking control instructions, a user does not need to manually control the intelligent household equipment, and the intelligent household equipment is convenient for the user to use. However, potential safety hazards easily appear when the existing intelligent household equipment uses voice control.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, the present disclosure provides a method and an apparatus for controlling smart home devices, an electronic device, and a storage medium, so as to improve the security of voice control of smart home devices.
In a first aspect, an embodiment of the present disclosure provides a method for controlling smart home devices, including:
responding to the trigger operation of the first object, and acquiring the voiceprint characteristics of the second object;
responding to the configuration operation of the first object, and determining the control authority of the second object on the intelligent household equipment;
receiving voice instruction information, and determining a target second object and target intelligent household equipment according to the voice instruction information;
and when the control authority corresponding to the target second object comprises the control authority of the target intelligent home equipment, outputting control instruction information corresponding to the voice instruction information to the target intelligent home equipment.
Optionally, the configuration operation includes home category configuration and operation option configuration;
the determining the control authority of the second object to the smart home device in response to the configuration operation of the first object includes:
responding to the household type configuration operation of the first object, and determining the intelligent household equipment which can be operated by the second object;
and responding to the option configuration operation corresponding to the first object in the operable intelligent household equipment, and determining the operable option of the second object in the operable intelligent household equipment.
Optionally, the configuration operation further includes time configuration;
the determining the control authority of the second object to the smart home device in response to the configuration operation of the first object includes:
and responding to the time configuration operation of the first object, and determining that the second object can operate at different time periods.
Optionally, the receiving voice instruction information, and determining a target second object and a target smart home device according to the voice instruction information includes:
receiving voice instruction information, performing feature extraction on the voice instruction information, and determining target voiceprint features and target text information included in the voice instruction information;
determining a target second object according to the target voiceprint features;
and determining target intelligent household equipment according to the target text information.
Optionally, the performing feature extraction on the voice instruction information, and determining the target voiceprint feature and the target text information included in the voice instruction information includes:
performing audio feature extraction on the voice instruction information, and determining a target voiceprint feature according to the audio feature;
and decoding the audio features based on a language model and an acoustic module to determine target text information.
Optionally, the determining a target second object corresponding to the target voiceprint feature includes:
and when the voiceprint features comprise the target voiceprint features, determining a target second object corresponding to the target voiceprint features by adopting a template matching method.
Optionally, the method further includes:
and when the control authority corresponding to the target second object does not comprise the control authority of the target intelligent household equipment, outputting prompt information to a mobile terminal of the second object comprising the control authority of the target intelligent household equipment.
In a second aspect, an embodiment of the present disclosure provides an intelligent home device control apparatus, including:
the voiceprint feature acquisition module is used for responding to the trigger operation of the first object and acquiring the voiceprint feature of the second object;
the control authority determining module is used for responding to the configuration operation of the first object and determining the control authority of the second object to the intelligent household equipment;
the information determining module is used for receiving voice instruction information and determining a target second object and target intelligent household equipment according to the voice instruction information;
and the control module is used for outputting control instruction information corresponding to the voice instruction information to the target intelligent household equipment when the control authority corresponding to the target second object comprises the control authority of the target intelligent household equipment.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including:
one or more processors;
a storage device to store one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method as in any one of the first aspects.
In a fourth aspect, the embodiments of the present disclosure provide a computer storage medium on which a computer program is stored, which when executed by a processor, implements the method according to any one of the first aspect.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:
the method, the device, the electronic equipment and the storage medium for controlling the intelligent household equipment, which are provided by the embodiment of the disclosure, firstly respond to the triggering operation of a first object, obtain the voiceprint characteristics of a second object, determine the control authority of the second object to the intelligent household equipment based on the configuration operation of the first object, receive voice instruction information, determine a target second object and target intelligent household equipment according to the voice instruction information, and output a control instruction to the target intelligent household equipment when the target second object comprises the control authority of the target intelligent household equipment, according to the control authority of the target intelligent household equipment, the method for controlling the intelligent household equipment, wherein the control authority of the second object to the intelligent household equipment is determined based on the configuration operation of the first object, different second objects have different control authorities to the intelligent household equipment, after receiving the voice instruction information, the target second object and the target intelligent household equipment requested to be controlled by the voice instruction information are determined according to the voice instruction information, only under the condition that the target second object comprises the control authority of the target intelligent household equipment, the target second object sending the voice instruction information can realize the control operation of the target intelligent household equipment, and the safety of the voice control of the intelligent household equipment is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a smart home device control method according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of another smart home device control method provided in the embodiment of the present disclosure;
fig. 3 is a schematic flowchart of another smart home device control method provided in the embodiment of the present disclosure;
fig. 4 is a schematic flowchart of another smart home device control method provided in the embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an intelligent household equipment control device provided in the embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.
Based on the problems existing in the prior art, the embodiment of the present disclosure provides a smart home device control method, including: responding to the trigger operation of the first object, and acquiring the voiceprint characteristics of the second object; responding to the configuration operation of the first object, and determining the control authority of the second object on the intelligent household equipment; receiving voice instruction information, and determining a target second object and target intelligent household equipment according to the voice instruction information; the control authority corresponding to the target second object comprises the control authority of the target intelligent household equipment, the control instruction information corresponding to the voice instruction information is output to the target intelligent household equipment, namely, the second object corresponding to different voiceprint characteristics is determined by collecting the voiceprint characteristics, and then the control authority of different second objects to the intelligent household equipment is different through configuration operation of the first object, namely, the control authority of the second object to the intelligent household equipment is configured by the first object, so that the first object can configure the control authority of the second object to the intelligent household equipment according to attribute information of the second object, such as age and the like, for example, children cannot control a television to be opened, and the old people cannot control a water heater and the like, and the safety of voice control of the intelligent household equipment is improved.
The intelligent household equipment control method provided by the embodiment of the disclosure is executed by electronic equipment or an application program in the electronic equipment. The electronic device may be a tablet computer, a mobile phone, a wearable device, an in-vehicle device, an Augmented Reality (AR)/Virtual Reality (VR), a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), a smart screen, a high definition television, a smart speaker, etc., and the present disclosure does not set any limit to a specific type of the electronic device.
The electronic equipment is in communication connection with each intelligent household equipment, the intelligent household equipment comprises an air conditioner, a television, a water heater and the like, the electronic equipment is in network connection with the air conditioner, the television and the water heater through a local area network protocol, and an information channel between the electronic equipment and the intelligent household equipment is established.
The present disclosure does not limit the type of operating system of the electronic device. For example, an Android system, a Linux system, a Windows system, an iOS system, etc.
The technical solution of the present disclosure is described in detail in the following with several specific embodiments.
Fig. 1 is a schematic flowchart of a method for controlling smart home devices provided in an embodiment of the present disclosure, and as shown in fig. 1, the method for controlling smart home devices includes:
and S10, responding to the trigger operation of the first object, and acquiring the voiceprint characteristics of the second object.
Voiceprint (Voiceprint), a spectrum of sound waves carrying verbal information displayed by an electroacoustical instrument. Modern scientific research shows that the voiceprint not only has specificity, but also has the characteristic of relative stability. The voice of a person can be kept relatively stable for a long time, and experiments prove that whether a speaker deliberately imitates the voice and tone of other people or speaks with whisper and whisper, even if the imitation is vivid, the voiceprint of the speaker is always different.
In order to ensure the personal safety of children, old people and special crowds when using the intelligent home equipment, firstly, the voiceprint registration is carried out on the children using the intelligent home equipment, the old people and the special crowds, in the process of carrying out the voiceprint registration on the children, the old people and the special crowds, the voiceprint information of the children, the old people and the special crowds needs to be input, at the moment, the first object is the highest authority user of the intelligent home equipment, namely, the first object can be controlled on any one intelligent home equipment through a voice instruction.
The first object logs in the electronic equipment and triggers voiceprint recording operation on the electronic equipment to realize voiceprint information recording of children, old people and special people, and after the voiceprint recording operation is triggered on the electronic equipment by the first object, the electronic equipment collects voice information and analyzes and determines voiceprint characteristics corresponding to the voice information based on the collected voice information.
The objects corresponding to different voiceprint features are different, and because the object corresponding to the currently entered voiceprint can be determined in the process that the first object executes voiceprint entry on the electronic device, the second object corresponding to the voiceprint feature can be determined after the voiceprint feature is obtained.
For example, the second object corresponding to the first voiceprint feature is zhangxx, and the second object corresponding to the second voiceprint feature is zhangyy.
And S20, responding to the configuration operation of the first object, and determining the control authority of the second object to the intelligent household equipment.
The method comprises the steps that a first object triggers voice input operation on electronic equipment, the electronic equipment obtains voice information, voiceprint features corresponding to the voice information are extracted, corresponding relations are established between the obtained voiceprint features and second objects, and after the corresponding relations between the voiceprint features and the second objects are determined on the electronic equipment, control authority of each second object on the intelligent home equipment is determined through configuration operation of the first object on the electronic equipment.
The configuration operation of the first object on the electronic device may be, for example, whether each second object has an authority to operate a certain smart home device, or whether each second object has an operation authority of a certain operation option on the basis of operating a certain smart home device, and the like, and the embodiment of the present disclosure is not particularly limited thereto.
It should be noted that, in the foregoing embodiment, in response to the triggering operation of the first object, the process of acquiring the voiceprint features of the second object may only acquire one voiceprint feature of the second object, that is, configure the controller authority for the second object corresponding to the voiceprint feature, or configure the control authority for the second objects corresponding to different voiceprint features after all the voiceprint features of the second object are recorded.
And S30, receiving the voice instruction information, and determining a target second object and target intelligent household equipment according to the voice instruction information.
In implementation, taking the example that the method for controlling the smart home device of the present invention is applied to an electronic device, the electronic device is provided with a device capable of collecting a sound signal, such as a microphone, and the like, and the system obtains the voice instruction information of the second object through the sound information collection device on the electronic device, specifically, in order to distinguish the ordinary speech and the voice instruction information of the user, the electronic device may further set a voice wakeup word, taking the voice wakeup word as an "smart housekeeper" as an example, when the user speaks at ordinary times, the electronic device may not collect the sound information of the user, when the user wants to voice control the smart home device, for example, the voice control air conditioner is turned on, the user speaks the "smart housekeeper" and turns on the air conditioner ", and when the electronic device monitors the voice wakeup word, the" turn on the air conditioner "is automatically taken as the voice instruction information of the user.
After the voice instruction information is acquired, the user terminal identifies the voiceprint feature included in the voice instruction information, and determines a target second object corresponding to the voiceprint feature, for example, the electronic device acquires voice instruction information "intelligent housekeeper, turns on an air conditioner", at this time, the user terminal processes the acquired voice instruction information "intelligent housekeeper, turns on the air conditioner" to obtain the voiceprint feature, and identifies the voiceprint feature to determine that the second object corresponding to the voiceprint feature is a page XX.
After the voice instruction information of the user is obtained, the electronic device locates the intelligent home equipment which the user wants to perform voice control according to the voice instruction information, taking the voice instruction information as 'turning on the television' as an example, the electronic device extracts keywords in the voice instruction information to determine that the intelligent home equipment which the user wants to perform voice control is the television. In a specific embodiment, a preset keyword database may be used to search for a keyword in the voice instruction information, where the keyword database stores a plurality of (e.g., 100) keywords, and the keyword may be obtained through network resources, for example, if the system finds that "television" in the voice instruction information of "turning on television" is a keyword, it is determined that the smart home device that the user wants to perform voice control is a television.
And S40, outputting control instruction information corresponding to the voice instruction information to the target intelligent household equipment when the control authority corresponding to the target second object comprises the control authority of the target intelligent household equipment.
After a target second object corresponding to the sent voice instruction information and target intelligent home equipment which the target second object wants to perform voice control are determined, if the control authority of the target second object corresponding to the sent voice instruction information comprises the control authority of the target intelligent home equipment, at the moment, the control instruction information is output to the target intelligent home equipment according to the voice instruction information, and the target intelligent home equipment is controlled.
The method for controlling the smart home equipment includes the steps of firstly responding to trigger operation of a first object, obtaining voiceprint characteristics of a second object, determining control authority of the second object on the smart home equipment based on configuration operation of the first object, receiving voice instruction information, determining a target second object and target smart home equipment according to the voice instruction information, enabling the control authority corresponding to the target second object to include control authority of the target smart home equipment, and outputting control instruction information corresponding to the voice instruction information to the target smart home equipment And the equipment can realize the control operation on the target intelligent household equipment only by the target second object sending the voice instruction information under the condition that the control authority corresponding to the target second object comprises the control authority of the target intelligent household equipment, so that the safety of the voice control of the intelligent household equipment is improved.
Fig. 2 is a schematic flow chart of another smart home device control method provided in the embodiment of the present disclosure, where on the basis of the embodiment of the present disclosure, as shown in fig. 2, a specific implementation manner of step S20 includes:
s201, responding to home category configuration operation of the first object, and determining the smart home equipment with the second object operable.
In this embodiment, the configuration operation of the first object includes home category configuration and operation option configuration.
After acquiring voiceprint features of second objects, the first object performs configuration operation of control authority on each second object on the electronic equipment, wherein the configuration operation comprises home category configuration operation and operation option configuration operation, the home category configuration operation is used for configuring intelligent home equipment categories which can be controlled by the second object through voice, for example, the second object can control a television and an air conditioner at home through voice but cannot control an electric cooker and a computer through voice; the operation option configuration operation is for configuring the operational option information in the smart home device in which the second object can perform voice control, such as: the second object can control the television in the home by voice and can only start and stop the television and can not play the television program.
In a specific embodiment, during the configuration operation of the first object, the configuration of the corresponding control authority may be performed based on the attribute information of the second object, for example, the age of the second object.
After the first object performs the home category configuration operation on the electronic device, the smart home devices operable by the second objects can be determined.
S202, responding to option configuration operation corresponding to the first object in the operable intelligent household equipment, and determining an operable option of the second object in the operable intelligent household equipment.
After the first object executes home category configuration operation on the electronic device, it may be determined that each second object may pass through the smart home device controlled by voice, and in order to implement that the second object may pass through voice control of some smart home devices but cannot pass through voice control of operation options of some smart home devices, after the home category configuration operation is completed, the first object may configure, at an option configuration position corresponding to the smart home device that the second object may operate, an operable option of the second object in the operable smart home device.
Specifically, the smart home device operable if the first object configures the second object on the electronic device includes a smart television and a smart door lock, and the first object configures the operable options of the second object on the smart television at the option configuration corresponding to the smart television, for example, the operating options of the smart television are opened and the operating options of the smart television are closed, that is, the first object configures the second object to be capable of controlling the smart television by voice, but only controlling the opening and closing functions of the smart television by voice, but not controlling the playing of the animation by voice.
Illustratively, taking the example that the method for controlling the smart home device of the present invention is applied to a home of a person who is a member of the family, the person who is a member of the family has 4 persons, including a wife who is a member of the family, a daughter who is a member of the family XX and a son who is a member of the family, wherein the wife who is a member of the family and a member of the family is the highest authority user of the smart home device, i.e., the first object, the wife who is a member of the family and a member of the family can log in the electronic device and trigger the voiceprint entry operation on the electronic device, so as to implement the entry of the voiceprint information of the member XX and the member of the family, and the wife who is a member of the family and the member of the family can perform the configuration operation on the electronic device, and configure the control authority of the member XX and the member of the member YY on the smart home device. For example, Zhang and Zhang wife can perform configuration operation on the electronic device, and the configured Zhang XX and YY can control all the smart home devices in the home, or the configured Zhang XX and YY can control some smart home devices in the home (for example, a television, an air conditioner, a smart door lock, and the like), or the configured Zhang XX and YY can control all the smart home devices in the home, but only have some functions in the smart home devices (for example, the smart door lock can be controlled by voice, but only the opening and closing functions of the smart door lock can be controlled, and the authority of the smart door lock cannot be modified and set, and the like).
It should be noted that, in the foregoing embodiment, it is exemplarily indicated that after the first object performs the home category configuration operation on the electronic device, the option configuration operation corresponding to the operable smart home device configures the operable option of the second object in the operable smart home device, in other possible embodiments, the first object may perform the home category configuration operation only on the electronic device, and does not perform the operation option configuration operation, which is not specifically limited in the embodiment of the present disclosure.
The method for controlling the smart home devices, provided by the embodiment of the disclosure, includes responding to configuration operations of a first object, and in a process of determining a control authority of a second object to the smart home devices, the configuration operations of the first object include home type configuration operations and operation option configuration operations, and the control authority of the second object to the smart home devices can be determined through the configuration operations of the first object on the electronic devices, and then when voice instruction information of the second object is received, the control authority of the smart home devices is included in the second object, and the control instruction information is output to the smart home devices, so that the control of the smart home devices is realized, and the control safety of the smart home devices is improved.
Fig. 3 is a schematic flowchart of another smart home device control method provided in an embodiment of the present disclosure, where on the basis of the foregoing embodiment, as shown in fig. 3, another implementation manner of step S20 includes:
s203, responding to the time configuration operation of the first object, and determining the smart home devices of the second object which can be operated in different time periods.
In this embodiment, the configuration operation of the first object includes a time configuration operation.
After obtaining the voiceprint features of the second objects, the first object performs configuration operation of control authority, such as time configuration operation, on the electronic device for each second object, that is, the first object configures a time period during which the second object can control the smart home device by voice. For example, if the first object configures the smart home devices operable by the second object on the electronic device for a time period of 12:00-14:00, the second object controls the smart home devices only through voice in the time period of 12:00-14:00, and may not control the smart home devices through voice in other time periods.
In other possible implementation manners, the first object may configure both the home category and the operation option that the second object can operate, and also configure the operation time period at the same time, which is not specifically limited in the embodiments of the present disclosure.
Fig. 4 is a schematic flowchart of another smart home device control method provided in an embodiment of the present disclosure, where on the basis of the foregoing embodiment, as shown in fig. 4, a specific implementation manner of step S30 includes:
s301, receiving the voice instruction information, performing feature extraction on the voice instruction information, and determining target voiceprint features and target text information included in the voice instruction information.
The voice instruction information is a voice signal of a second object acquired by the electronic equipment, and after the voice instruction information of the second object is acquired by the electronic equipment, the target voiceprint feature and the target text information contained in the sent voice instruction information are determined by extracting the features of the voice instruction information.
As an implementation manner, optionally, audio feature extraction is performed on the voice instruction information, and the target voiceprint feature is determined according to the audio feature.
And decoding the audio features based on the language model and the acoustic module to determine target text information.
Specifically, when the electronic device acquires the voice instruction information through the microphone, audio feature extraction is performed on the voice instruction information through a self-adaptive filter noise reduction algorithm and an enhanced voice processing algorithm, and then a target voiceprint feature is determined according to the audio feature. In addition, the electronic equipment decodes the audio features based on the constructed language model and the acoustic module, and determines target text information.
And S302, determining a target second object according to the target voiceprint characteristics.
And after the voice instruction information is subjected to audio feature extraction to determine the target voiceprint features, matching the target voiceprint features with the voiceprint features of the second object stored in the voiceprint library, and determining the target second object corresponding to the target voiceprint features based on the matching result.
In a specific embodiment, when a matching value between the target voiceprint feature and a voiceprint feature of a second object stored in the voiceprint library meets a preset threshold, a target second object corresponding to the target voiceprint feature may be determined.
And S303, determining the target intelligent household equipment according to the target text information.
After the voice instruction information of the user is obtained, the electronic device decodes the voice instruction information to determine target text information, and then the intelligent home equipment which the user wants to perform voice control is located according to the determined target text information.
As an implementable manner, optionally, when the control authority corresponding to the target second object does not include the control authority of the target smart home device, the prompt information is output to the mobile terminal of the second object including the controller authority of the target smart home device.
In order to further improve the safety of the intelligent home equipment, after the voice instruction information is received, when it is determined that the target second object for voice control does not include the control authority of the target intelligent home equipment, at this time, the prompt information may be output to a mobile terminal of a second object including the control authority of the target intelligent home equipment, for example, a first object, which is used for sending the prompt information to the first object, so that the first object pays attention to the requirements of special people in the house, and the like.
Fig. 5 is a schematic structural diagram of an intelligent household equipment control device provided in an embodiment of the present disclosure, and as shown in fig. 5, the intelligent household equipment control device includes:
a voiceprint feature obtaining module 510, configured to obtain a voiceprint feature of a second object in response to a trigger operation of a first object;
the control authority determining module 520 is configured to determine, in response to the configuration operation of the first object, a control authority of the second object on the smart home device;
the information determining module 530 is configured to receive the voice instruction information, and determine a target second object and a target smart home device according to the voice instruction information;
and the control module 540 is configured to, when the control right corresponding to the target second object includes the control right of the target smart home device, output control instruction information corresponding to the voice instruction information to the target smart home device.
The intelligent home equipment control device provided by the embodiment of the disclosure, firstly, in response to the trigger operation of a first object, obtains the voiceprint characteristics of a second object, determines the control authority of the second object to the intelligent home equipment based on the configuration operation of the first object, receives voice instruction information, determines a target second object and target intelligent home equipment according to the voice instruction information, outputs a control instruction to the target intelligent home equipment when the target second object comprises the control authority of the target intelligent home equipment, and determines the control authority of the second object to the intelligent home equipment based on the configuration operation of the first object, different second objects have different control authorities to the intelligent home equipment, and after receiving the voice instruction information, determines the target second object and the target intelligent home equipment requested to be controlled by the voice instruction information, only under the condition that the target second object comprises the control authority of the target intelligent household equipment, the target second object sending the voice instruction information can realize the control operation of the target intelligent household equipment, and the safety of the voice control of the intelligent household equipment is improved.
As an implementable manner, optionally, a specific implementation manner of the control authority determination module includes:
responding to the household type configuration operation of the first object, and determining the intelligent household equipment which can be operated by the second object;
and in response to the option configuration operation corresponding to the first object in the operable intelligent household equipment, determining the operable option of the second object in the operable intelligent household equipment.
As an implementable manner, optionally, another specific implementation manner of the control authority determination module includes:
and responding to the time configuration operation of the first object, and determining that the second object can operate at different time periods.
As an implementation manner, optionally, a specific implementation manner of the information determining module includes:
the characteristic extraction unit is used for receiving the voice instruction information, extracting the characteristics of the voice instruction information and determining target voiceprint characteristics and target text information which are included in the voice instruction information;
the target second object determining unit is used for determining a target second object according to the target voiceprint characteristics;
and the target intelligent household equipment determining unit is used for determining the target intelligent household equipment according to the target text information.
As an implementation manner, optionally, a specific implementation manner of the feature extraction unit includes:
performing audio feature extraction on the voice instruction information, and determining a target voiceprint feature according to the audio feature;
and decoding the audio features based on the language model and the acoustic module to determine target text information.
As an implementation manner, optionally, a specific implementation manner of the target second object determining unit includes:
and when the voiceprint features comprise the target voiceprint features, determining a target second object corresponding to the target voiceprint features by adopting a template matching method.
As an implementable manner, optionally, further comprising:
and the prompt module is used for outputting prompt information to the mobile terminal of the second object including the control authority of the target intelligent home equipment when the control authority corresponding to the target second object does not include the control authority of the target intelligent home equipment.
The device provided by the embodiment of the invention can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that, in the embodiment of the apparatus, the included units and modules are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
Fig. 6 is a schematic structural diagram of an electronic device provided by the present disclosure, and fig. 6 shows a block diagram of an exemplary electronic device suitable for implementing embodiments of the present invention. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 6, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: one or more processors 610, a system memory 620, and a bus 630 that couples the various system components (including the system memory 620 and the processors).
The system memory 620 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)640 and/or cache memory 650. The electronic device 600 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 660 may be used to read from and write to non-removable, nonvolatile magnetic media (commonly referred to as a "hard disk drive"). A magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 630 by one or more data media interfaces. System memory 620 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 680 having a set (at least one) of program modules 670 may be stored, for example, in system memory 620, such program modules 670 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may comprise an implementation of a network environment. Program modules 670 generally perform the functions and/or methodologies of embodiments described herein.
The processor 610 executes various functional applications and information processing, such as implementing method embodiments provided by embodiments of the present invention, by executing at least one program of the programs stored in the system memory 620.
The present disclosure also provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The present disclosure also provides a computer program product which, when run on a computer, causes the computer to perform the steps of implementing the above-described method embodiments.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the term "comprises/comprising" is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The foregoing are merely exemplary embodiments of the present disclosure, which enable those skilled in the art to understand or practice the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. The intelligent household equipment control method is characterized by comprising the following steps:
responding to the trigger operation of the first object, and acquiring the voiceprint characteristics of the second object;
responding to the configuration operation of the first object, and determining the control authority of the second object on the intelligent household equipment;
receiving voice instruction information, and determining a target second object and target intelligent household equipment according to the voice instruction information;
and when the control authority corresponding to the target second object comprises the control authority of the target intelligent home equipment, outputting control instruction information corresponding to the voice instruction information to the target intelligent home equipment.
2. The method of claim 1, wherein the configuration operation comprises a home category configuration and an operation option configuration;
the determining the control authority of the second object to the smart home device in response to the configuration operation of the first object includes:
responding to the household type configuration operation of the first object, and determining the intelligent household equipment which can be operated by the second object;
and responding to the option configuration operation corresponding to the first object in the operable intelligent household equipment, and determining the operable option of the second object in the operable intelligent household equipment.
3. The method of claim 1 or 2, wherein the configuration operation further comprises a time configuration;
the determining the control authority of the second object to the smart home device in response to the configuration operation of the first object includes:
and responding to the time configuration operation of the first object, and determining that the second object can operate at different time periods.
4. The method according to claim 1, wherein the receiving voice instruction information and determining the target second object and the target smart home device according to the voice instruction information comprises:
receiving voice instruction information, performing feature extraction on the voice instruction information, and determining target voiceprint features and target text information included in the voice instruction information;
determining a target second object according to the target voiceprint features;
and determining target intelligent household equipment according to the target text information.
5. The method according to claim 4, wherein the performing feature extraction on the voice instruction information and determining the target voiceprint feature and the target text information included in the voice instruction information comprises:
performing audio feature extraction on the voice instruction information, and determining a target voiceprint feature according to the audio feature;
and decoding the audio features based on a language model and an acoustic module to determine target text information.
6. The method of claim 4, wherein the determining the target second object corresponding to the target voiceprint feature comprises:
and when the voiceprint features comprise the target voiceprint features, determining a target second object corresponding to the target voiceprint features by adopting a template matching method.
7. The method of claim 4, further comprising:
and when the control authority corresponding to the target second object does not include the control authority of the target intelligent home equipment, outputting prompt information to the mobile terminal of the second object including the control authority of the target intelligent home equipment.
8. The utility model provides an intelligence house equipment controlling means which characterized in that includes:
the voiceprint feature acquisition module is used for responding to the trigger operation of the first object and acquiring the voiceprint feature of the second object;
the control authority determining module is used for responding to the configuration operation of the first object and determining the control authority of the second object to the intelligent household equipment;
the information determining module is used for receiving voice instruction information and determining a target second object and target intelligent household equipment according to the voice instruction information;
and the control module is used for outputting control instruction information corresponding to the voice instruction information to the target intelligent household equipment when the control authority corresponding to the target second object comprises the control authority of the target intelligent household equipment.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method of any one of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210625417.1A CN114967491A (en) | 2022-06-02 | 2022-06-02 | Intelligent household equipment control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210625417.1A CN114967491A (en) | 2022-06-02 | 2022-06-02 | Intelligent household equipment control method and device, electronic equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114967491A true CN114967491A (en) | 2022-08-30 |
Family
ID=82959429
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210625417.1A Pending CN114967491A (en) | 2022-06-02 | 2022-06-02 | Intelligent household equipment control method and device, electronic equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114967491A (en) |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN205068531U (en) * | 2015-09-29 | 2016-03-02 | 深圳市智慧易联科技有限公司 | Intelligent lock |
US20170142230A1 (en) * | 2015-11-17 | 2017-05-18 | Xiaomi Inc. | Smart device control method and apparatus |
CN109712625A (en) * | 2019-02-18 | 2019-05-03 | 珠海格力电器股份有限公司 | Intelligent equipment control method and system based on gateway and intelligent gateway |
CN110213138A (en) * | 2019-04-23 | 2019-09-06 | 深圳康佳电子科技有限公司 | Intelligent terminal user authentication method, intelligent terminal and storage medium |
CN110798318A (en) * | 2019-09-18 | 2020-02-14 | 云知声智能科技股份有限公司 | Equipment management method and device |
CN111968633A (en) * | 2020-07-16 | 2020-11-20 | 深圳市鸿合创新信息技术有限责任公司 | Management control method and device of interactive equipment |
CN114090997A (en) * | 2021-11-24 | 2022-02-25 | 北京邮电大学 | Voice instruction process scheduling method and device |
CN114155848A (en) * | 2021-10-29 | 2022-03-08 | 青岛海尔科技有限公司 | Operation execution method and device, storage medium and electronic device |
CN114220442A (en) * | 2022-01-27 | 2022-03-22 | 美的集团(上海)有限公司 | Control method of intelligent home system and intelligent home system |
CN114446299A (en) * | 2022-01-24 | 2022-05-06 | 珠海格力电器股份有限公司 | Control method and control device of household equipment, storage medium and electronic device |
-
2022
- 2022-06-02 CN CN202210625417.1A patent/CN114967491A/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN205068531U (en) * | 2015-09-29 | 2016-03-02 | 深圳市智慧易联科技有限公司 | Intelligent lock |
US20170142230A1 (en) * | 2015-11-17 | 2017-05-18 | Xiaomi Inc. | Smart device control method and apparatus |
CN109712625A (en) * | 2019-02-18 | 2019-05-03 | 珠海格力电器股份有限公司 | Intelligent equipment control method and system based on gateway and intelligent gateway |
CN110213138A (en) * | 2019-04-23 | 2019-09-06 | 深圳康佳电子科技有限公司 | Intelligent terminal user authentication method, intelligent terminal and storage medium |
CN110798318A (en) * | 2019-09-18 | 2020-02-14 | 云知声智能科技股份有限公司 | Equipment management method and device |
CN111968633A (en) * | 2020-07-16 | 2020-11-20 | 深圳市鸿合创新信息技术有限责任公司 | Management control method and device of interactive equipment |
CN114155848A (en) * | 2021-10-29 | 2022-03-08 | 青岛海尔科技有限公司 | Operation execution method and device, storage medium and electronic device |
CN114090997A (en) * | 2021-11-24 | 2022-02-25 | 北京邮电大学 | Voice instruction process scheduling method and device |
CN114446299A (en) * | 2022-01-24 | 2022-05-06 | 珠海格力电器股份有限公司 | Control method and control device of household equipment, storage medium and electronic device |
CN114220442A (en) * | 2022-01-27 | 2022-03-22 | 美的集团(上海)有限公司 | Control method of intelligent home system and intelligent home system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10514881B2 (en) | Information processing device, information processing method, and program | |
CN109410952B (en) | Voice awakening method, device and system | |
CN108133707B (en) | Content sharing method and system | |
CN112074900B (en) | Audio analysis for natural language processing | |
CN112820291B (en) | Smart home control method, smart home control system and storage medium | |
US20200035241A1 (en) | Method, device and computer storage medium for speech interaction | |
CN108306797A (en) | Sound control intelligent household device, method, system, terminal and storage medium | |
CN109240107B (en) | Control method and device of electrical equipment, electrical equipment and medium | |
CN108831477B (en) | Voice recognition method, device, equipment and storage medium | |
CN108922525B (en) | Voice processing method, device, storage medium and electronic equipment | |
CN109215646B (en) | Voice interaction processing method and device, computer equipment and storage medium | |
TW201543467A (en) | Voice input method, device and system | |
CN111640434A (en) | Method and apparatus for controlling voice device | |
KR20190068133A (en) | Electronic device and method for speech recognition | |
CN111683317A (en) | Prompting method and device applied to earphone, terminal and storage medium | |
CN109361995A (en) | A kind of volume adjusting method of electrical equipment, device, electrical equipment and medium | |
KR101995443B1 (en) | Method for verifying speaker and system for recognizing speech | |
CN106251871A (en) | A kind of Voice command music this locality playing device | |
CN111710339A (en) | Voice recognition interaction system and method based on data visualization display technology | |
CN111540357A (en) | Voice processing method, device, terminal, server and storage medium | |
CN111400463B (en) | Dialogue response method, device, equipment and medium | |
US20180182393A1 (en) | Security enhanced speech recognition method and device | |
CN114967491A (en) | Intelligent household equipment control method and device, electronic equipment and storage medium | |
CN108922523B (en) | Position prompting method and device, storage medium and electronic equipment | |
CN110197663A (en) | A kind of control method, device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |