CN112417923A - System, method and apparatus for controlling smart devices - Google Patents

System, method and apparatus for controlling smart devices Download PDF

Info

Publication number
CN112417923A
CN112417923A CN201910770447.XA CN201910770447A CN112417923A CN 112417923 A CN112417923 A CN 112417923A CN 201910770447 A CN201910770447 A CN 201910770447A CN 112417923 A CN112417923 A CN 112417923A
Authority
CN
China
Prior art keywords
user
intelligent
control
target
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910770447.XA
Other languages
Chinese (zh)
Inventor
易奇
刘豫川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yunding Network Technology Beijing Co Ltd
Original Assignee
Yunding Network Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yunding Network Technology Beijing Co Ltd filed Critical Yunding Network Technology Beijing Co Ltd
Priority to CN201910770447.XA priority Critical patent/CN112417923A/en
Publication of CN112417923A publication Critical patent/CN112417923A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Abstract

The embodiment of the application discloses a system, a method and a device for controlling intelligent equipment. One embodiment of the system comprises: the system comprises a control device and a plurality of intelligent devices; the control device is configured to perform biometric identification on a user, determine a target smart device from the plurality of smart devices based on a biometric identification result, generate a control instruction corresponding to the target smart device, and send the control instruction to the target smart device; the target intelligent device is configured to execute the operation corresponding to the control instruction. According to the implementation mode, the linkage control of the control equipment and the intelligent equipment based on the Internet of things technology is realized, so that the control equipment and the intelligent equipment can work in a systematic and cooperative mode, the diversification of functions is realized, and the user experience is improved.

Description

System, method and apparatus for controlling smart devices
Technical Field
The embodiment of the application relates to the technical field of Internet of things, in particular to a system, a method and a device for controlling intelligent equipment.
Background
The internet of things is a network technology which is popularized in daily life in recent years. The important idea of the internet of things is to access various intelligent devices into a network, and further realize more diversified functions of device control, information transmission, analysis and the like based on the network. Smart home is a branch direction closely related to daily life in the field of Internet of things.
Many intelligent devices using internet of things technology are currently on the market. For example, common electrical appliances such as an intelligent television, an air conditioner and a floor sweeping robot, and common devices such as an intelligent door lock, an electronic cat eye and a monitoring system. Most of the various internet of things intelligent devices can be connected to a home wireless network and controlled and monitored through management devices such as mobile phones and internet of things gateways.
However, in the prior art, the internet of things intelligent devices are isolated from each other and cannot perform systematic cooperative work, so the use experience is still to be improved.
Disclosure of Invention
The embodiment of the application provides a system, a method and a device for controlling intelligent equipment.
In a first aspect, an embodiment of the present application provides a system for controlling a smart device, where the system includes a control device and a plurality of smart devices;
the control device is configured to perform biometric identification on a user, determine a target smart device from the plurality of smart devices based on a biometric identification result, generate a control instruction corresponding to the target smart device, and send the control instruction to the target smart device;
the target intelligent device is configured to execute the operation corresponding to the control instruction.
In some embodiments, the biometric identification comprises face recognition, the control device comprising an image acquisition apparatus; and
the control device is further configured to:
acquiring a face image of a user by using the image acquisition device;
determining the identity information of the user according to the face image of the user;
and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information.
In some embodiments, the biometric identification further comprises motion recognition, the control device being communicatively coupled to the motion recognition means; and
the control device is further configured to:
after the identity information is determined, if the user is a legal user, further recording the action video of the user by using the image acquisition device;
sending the recorded action video to the action recognition device so that the action recognition device performs action recognition on the action video;
receiving an action recognition result returned by the action recognition device;
and determining a target intelligent device from the plurality of intelligent devices based on the identity information and the action recognition result.
In some embodiments, the biometric identification further comprises voice recognition, the control device further comprises a voice acquisition device, and the control device is communicatively coupled to the voice recognition device; and
the control device is further configured to:
after the identity information is determined, if the user is a legal user, the voice information of the user is further acquired by using the voice acquisition device;
sending the voice information to the voice recognition device so that the voice recognition device performs voice recognition on the voice information;
receiving a voice recognition result returned by the voice recognition device;
and determining a target intelligent device from the plurality of intelligent devices based on the identity information and the voice recognition result.
In some embodiments, the control device is further configured to:
searching target configuration information matched with the biological identification result in preset configuration information, wherein the preset configuration information is used for representing the corresponding relation among the biological identification result, the intelligent devices and the control instruction;
and based on the target configuration information, determining a target intelligent device from the plurality of intelligent devices, and generating a control instruction corresponding to the target intelligent device.
In some embodiments, the system further comprises a management device configured to:
and acquiring the equipment information of the control equipment and the plurality of intelligent equipment, and sending the equipment information to a server so that the server binds the control equipment and the plurality of intelligent equipment to the same user account by using the equipment information.
In some embodiments, the management device is further configured to:
and receiving the control instruction sent by the control equipment by adopting a preset first protocol, and sending the control instruction to the target intelligent equipment by adopting a preset second protocol corresponding to the target intelligent equipment.
In a second aspect, an embodiment of the present application provides a method for controlling a smart device, where the method is applied to a control device, and includes:
performing biometric identification on a user;
determining a target intelligent device from the plurality of intelligent devices based on the biological recognition result, and generating a control instruction corresponding to the target intelligent device;
and sending the control instruction to the target intelligent equipment so as to enable the target intelligent equipment to execute the operation corresponding to the control instruction.
In a third aspect, an embodiment of the present application provides an apparatus for controlling an intelligent device, where the apparatus is applied to a control device, and the apparatus includes:
a biometric authentication module configured to biometrically identify a user;
an instruction generation module configured to determine a target smart device from the plurality of smart devices based on the biometric recognition result and generate a control instruction corresponding to the target smart device;
and the sending module is configured to send the control instruction to the target intelligent device so as to enable the target intelligent device to execute the operation corresponding to the control instruction.
In a fourth aspect, the present application provides a computer-readable medium, on which a computer program is stored, where the program, when executed by a processor, implements the method as described in any implementation manner of the second aspect.
In a fifth aspect, the present application provides a processor, configured to execute a program, where the program executes to perform the method described in any implementation manner of the second aspect.
In a sixth aspect, an embodiment of the present application provides an apparatus, including: one or more processors; a storage device having one or more programs stored thereon; the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method as described in any implementation of the second aspect.
According to the system, the method and the device for controlling the intelligent equipment, the target intelligent equipment is determined through the control equipment based on the biological recognition result, and the control instruction is sent to the target intelligent equipment, so that the target intelligent equipment executes the operation corresponding to the control instruction, the linkage control of the control equipment and the intelligent equipment based on the internet of things technology is realized, the control equipment and the intelligent equipment can systematically cooperate, the diversification of functions is realized, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is obvious that the drawings in the following description are only some examples or embodiments of the present application, and that for a person skilled in the art, other drawings can be obtained from the provided drawings without inventive effort, and that the present application can also be applied to other similar scenarios from the provided drawings. Unless otherwise apparent from the context, or otherwise indicated, like reference numbers in the figures refer to the same structure or operation.
FIG. 1 is an exemplary system architecture diagram to which some embodiments of the present application may be applied;
FIG. 2 is a timing diagram of one embodiment of a system for controlling smart devices according to the present application;
FIG. 3 is a timing diagram of yet another embodiment of a system for controlling smart devices according to the present application;
FIG. 4 is a timing diagram of yet another embodiment of a system for controlling smart devices according to the present application;
FIG. 5 is a timing diagram of yet another embodiment of a system for controlling smart devices according to the present application;
FIG. 6 is a flow diagram of one embodiment of a method for controlling a smart device according to the present application;
FIG. 7 is a block diagram illustrating an embodiment of an apparatus for controlling a smart device according to the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. The described embodiments are only some embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings. The embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be understood that "system", "apparatus", "unit" and/or "module" as used herein is a method for distinguishing different components, elements, parts or assemblies at different levels. However, other words may be substituted by other expressions if they accomplish the same purpose.
As used in this application and the appended claims, the terms "a," "an," "the," and/or "the" are not intended to be inclusive in the singular, but rather are intended to be inclusive in the plural unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that steps and elements are included which are explicitly identified, that the steps and elements do not form an exclusive list, and that a method or apparatus may include other steps or elements. An element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
Flow charts are used herein to illustrate operations performed by systems according to embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed in the exact order in which they are performed. Rather, the various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or several steps of operations may be removed from the processes.
Fig. 1 illustrates an exemplary system architecture 100 to which some embodiments of the present system, method, or apparatus for controlling a smart device may be applied.
As shown in fig. 1, the system architecture 100 may include a control device 101 and smart devices 102, 103.
The user may use the control device 101 to interact with the smart devices 102, 103 over a network to receive or send messages or the like. Various client applications, such as a monitoring application, a biometric authentication application, etc., may be installed on the control device 101 and the smart devices 102, 103.
The control device 101 and the smart devices 102 and 103 may be hardware or software. When the control device 101 is hardware, it can be various electronic devices including but not limited to a smart phone, a tablet computer, a smart cat eye, and the like; when the control device 101 is software, it may be installed in the electronic devices listed above, it may be implemented as a plurality of software or software modules (for example, to provide distributed services), or it may be implemented as a single software or software module. And is not particularly limited herein.
When the smart devices 102, 103 are hardware, they may be various electronic devices including, but not limited to, laptop portable computers, desktop computers, smart refrigerators, smart air conditioners, smart speakers, smart doorbells, and the like. When the smart devices 102, 103 are software, they may be installed in the electronic devices listed above, may be implemented as a plurality of software or software modules (e.g., to provide distributed services), or may be implemented as a single software or software module. And is not particularly limited herein.
It should be noted that the method for controlling the smart device provided in the embodiment of the present application is generally executed by the control device 101, and accordingly, the apparatus for controlling the smart device is generally disposed in the control device 101.
It should be understood that the number of control devices and smart devices in fig. 1 is merely illustrative. There may be any number of control devices and smart devices, as desired for implementation.
With continued reference to FIG. 2, a timing diagram of one embodiment of a system for controlling a smart device in accordance with the present application is shown. The system specifically comprises:
comprises a control device (such as the control device 101 shown in figure 1) and a plurality of intelligent devices (such as the intelligent devices 102 and 103 shown in figure 1); the control device is configured to perform biological recognition on the user, determine a target intelligent device from the plurality of intelligent devices based on a biological recognition result, generate a control instruction corresponding to the target intelligent device, and send the control instruction to the target intelligent device; and the target intelligent device is configured to execute the operation corresponding to the control instruction.
As shown in fig. 2, in step 201, the control device performs biometric identification on the user.
In this embodiment, the control device may perform biometric identification on the user. For example, the control device may perform biometric recognition based on biometric information to be recognized in response to receiving the biometric information. For another example, the control apparatus may include an image capture device, and the control apparatus may capture biometric information of the user using the image capture device to perform biometric identification of the user. The biometric information may include, but is not limited to, fingerprint information, face image, voice information, iris information, and the like, and is not limited herein.
It should be noted that the control device may locally store a biometric model, and the biometric model may be used to characterize the correspondence between the biometric information and the biometric result. In addition, the biometric Model may be obtained by training using a Naive Bayesian Model (NBM), a Support Vector Machine (SVM), an xgboost (subtreme Gradient boosting), a Convolutional Neural Network (CNN), or other models. After obtaining the biometric information to be recognized, the control device may input the biometric information into a corresponding biometric model to obtain a biometric result corresponding to the biometric information. It is noted that the biometric result may be used to indicate whether the user is a legitimate user or an illegitimate user. Furthermore, the biometric result may also be used to indicate a specific identity of the user, such as a name of the user, a relationship with the user to which the control device belongs, and the like, and is not limited in this regard.
It should be understood that the control device may adopt various methods to realize the biometric identification of the user, and the present embodiment does not limit the biometric identification method in any way.
In step 202, the control device determines a target smart device from the plurality of smart devices based on the biometric recognition result, and generates a control command corresponding to the target smart device.
In this embodiment, the control device may determine the target smart device from the plurality of smart devices based on the biometric recognition result, and then generate the control instruction corresponding to the target smart device. In practice, the control device may determine one or more target smart devices from a plurality of smart devices.
In this embodiment, the control device may find out target configuration information matching the biometric identification result among the preset configuration information. The preset configuration information can be used for representing the corresponding relation between the biological recognition result, the intelligent devices and the control instruction. The control device may determine a target smart device from the plurality of smart devices based on the target configuration information, and generate a control instruction corresponding to the target smart device.
It should be noted that the configuration information may be set manually, or may be set automatically by the control device or the server based on a specific rule, and is not limited specifically herein. That is, the correspondence between the biometric result, the plurality of smart devices, and the control instruction may be determined in advance as needed. And setting the corresponding relation as configuration information. And determining the target intelligent equipment by utilizing the configuration information and generating a corresponding instruction.
In step 203, the control device sends a control instruction to the target smart device.
In this embodiment, the control device may send the control instruction to the corresponding target smart device. Here, the control device may directly transmit the control instruction to the corresponding target smart device through a wired connection manner or a wireless connection manner, for example.
In step 204, the target smart device performs an operation corresponding to the control instruction.
In this embodiment, the target smart device may perform an operation corresponding to the control instruction. Such as determining the smart door lock as the target smart device. And then the control equipment generates an unlocking instruction corresponding to the intelligent door lock. And after the intelligent door lock receives the unlocking instruction, executing the instruction to unlock the intelligent door lock.
In this embodiment, the control device may specifically be a biometric authentication device, and further specifically may specifically be any one of a face recognition device, a voice recognition device, a fingerprint recognition device, a pupil recognition device, a human body recognition device, or a combination of any of a plurality of devices. Such as intelligent cameras, electronic cat eyes, building interphones, fingerprint machines and so on. From the viewpoint of hardware structure, the control device may include a camera, a microphone, and other sensing units for acquiring biological data; and a processing unit (i.e., a processor or a chip) that supports a correlation algorithm, performs arithmetic processing on biological data, and generates a control instruction.
In addition, in some cases, because some biometric authentication algorithms are relatively complex, the biometric authentication data can also be uploaded to a network server for calculation processing, and a processing result returned by the network server is received. The processing unit is only responsible for communication with the network server and provides some basic data processing functions.
The specific form of the control device in this embodiment is not limited, and any hardware device that can implement the same or similar functions may be combined with the overall technical solution of this embodiment.
The plurality of intelligent devices can be intelligent devices supporting the Internet of things function, such as an intelligent door lock, an Internet of things air conditioner, an Internet of things illuminating lamp and the like. The target smart device is one or more smart devices determined from the plurality of smart devices according to the biometric authentication result.
For example, when the biometric authentication result judges that the user is a legal user, the intelligent door lock is determined as the target intelligent device. And then the control equipment generates an unlocking instruction corresponding to the intelligent door lock. And after the intelligent door lock receives the unlocking instruction, executing the instruction to unlock the intelligent door lock.
The system that above-mentioned embodiment of this application provided carries out biological identification to the user through controlgear, then confirm target smart machine based on the biological identification result, and generate the control command that corresponds with target smart machine, then send control command to target smart machine, so that target smart machine carries out the operation corresponding with control command, the coordinated control of controlgear and smart machine based on internet of things has been realized, make controlgear and smart machine realize the systematized collaborative work, realize the diversification of function, improve user experience.
With further reference to FIG. 3, a timing diagram of yet another embodiment of a system for controlling a smart device is shown.
In this embodiment, a system for controlling smart devices includes a control device (e.g., the control device 101 shown in fig. 1) and a plurality of smart devices (e.g., the smart devices 102, 103 shown in fig. 1), the control device including an image capture apparatus;
the control equipment is configured to acquire a face image of a user by using the image acquisition device, determine identity information of the user according to the face image of the user, determine target intelligent equipment from the intelligent equipment based on the identity information, generate a control instruction corresponding to the target intelligent equipment and send the control instruction to the target intelligent equipment; and the target intelligent device is configured to execute the operation corresponding to the control instruction.
As shown in fig. 3, in step 301, the control apparatus acquires a face image of a user using an image acquisition device.
In this embodiment, the image capturing device may be, for example, a camera, and the control apparatus may capture a face image of the user by using the image capturing device.
In step 302, the control device determines identity information of the user according to the face image of the user, determines a target smart device from the plurality of smart devices based on the identity information, and generates a control instruction corresponding to the target smart device.
In this embodiment, the control device may determine the identity information of the user according to the face image of the user, then determine a target smart device from the plurality of smart devices based on the identity information, and generate a control instruction corresponding to the target smart device. Here, for the explanation of step 302, refer to the related explanation of step 201 and step 202 in the embodiment shown in fig. 2, and are not described herein again.
In step 303, the control device sends a control instruction to the target smart device.
In this embodiment, the control device may send the generated control instruction to the corresponding target smart device. Here, the control device may adopt any transmission method, and is not particularly limited herein.
In step 304, the target smart device performs an operation corresponding to the control instruction.
In this embodiment, the target smart device may perform an operation corresponding to the control instruction. Such as determining the smart door lock as the target smart device. And when the user is determined to be a legal user according to the face image identification, the equipment is further controlled to generate an unlocking instruction corresponding to the intelligent door lock. And after the intelligent door lock receives the unlocking instruction, executing the instruction to unlock the intelligent door lock.
As can be seen from fig. 3, compared with the embodiment corresponding to fig. 2, the system for controlling a smart device in the present embodiment discloses a specific manner of biometric authentication and an authentication process. Therefore, the scheme described in the embodiment can realize intelligent device control based on face recognition.
With further reference to FIG. 4, a timing diagram of yet another embodiment of a system for controlling a smart device is shown.
In this embodiment, the system for controlling the smart device includes a control device (e.g., the control device 101 shown in fig. 1) and a plurality of smart devices (e.g., the smart devices 102 and 103 shown in fig. 1), the control device includes an image capturing apparatus, and the control device is connected to the motion recognition apparatus in a communication manner;
a control device configured to acquire a face image of a user using an image acquisition apparatus; determining identity information of a user according to a face image of the user; if the user is a legal user, further recording the action video of the user by using the image acquisition device, and sending the recorded action video to the action recognition device so as to enable the action recognition device to recognize the action of the action video; receiving an action recognition result returned by the action recognition device; determining a target intelligent device from the plurality of intelligent devices based on the identity information and the action recognition result of the user, and generating a control instruction corresponding to the target intelligent device; sending the control instruction to the target intelligent equipment;
and the target intelligent device is configured to execute the operation corresponding to the control instruction.
As shown in fig. 4, in step 401, the control apparatus acquires a face image of a user using an image acquisition device.
In this embodiment, the image capturing device may be, for example, a camera, and the control apparatus may capture a face image of the user by using the image capturing device.
In step 402, the control device determines identity information of the user from the facial image of the user.
In this embodiment, the control device may determine the identity information of the user according to the face image of the user.
In particular, biometric recognition may specifically include face recognition. Specifically, the facial features of the user may be identified, and whether the facial features match with the facial features of a valid user that is stored in advance is determined. It can be determined whether the identified user is a valid user of the intelligent device. I.e. to determine identity information of the user.
In step 403, if the user is a legal user, the control device further records a motion video of the user by using the image capturing device, and sends the recorded motion video to the motion recognition device, so that the motion recognition device performs motion recognition on the motion video.
In this embodiment, the biometric identification may also include motion identification. After the control device determines the identity information, if the user is determined to be a legal user, the control device can further record the action video of the user by using the image acquisition device, and then send the recorded action video to the action recognition device, so that the action recognition device performs action recognition on the action video.
In this embodiment, the motion recognition device and the control device may be independent from each other, or the motion recognition device may be integrated into the control device. This is not limited in this embodiment.
In the motion recognition, the motion recognition device performs image analysis on the motion video, and determines the meaning of the motion information of the user (e.g., a gesture, a body motion, or the like) as a motion recognition result. And then determining corresponding target intelligent equipment for control according to the action recognition result.
In step 404, the control device receives the motion recognition result returned by the motion recognition means.
In this embodiment, the control device may receive the motion recognition result returned by the motion recognition apparatus through a wired connection manner or a wireless connection manner.
In step 405, the control device determines a target smart device from the plurality of smart devices based on the identity information of the user and the action recognition result, and generates a control instruction corresponding to the target smart device.
In this embodiment, the control device may determine the target intelligent device from the plurality of intelligent devices based on the identity information and the action recognition result of the user, and generate the control instruction corresponding to the target intelligent device. For example, the control device may determine, from the plurality of smart devices, a smart device that the user has permission to control based on the identity information of the user, then determine, from the smart devices that the user has permission to control based on the action recognition result, a smart device that the user currently wants to control, and determine the determined smart device that the user currently wants to control as the target smart device. And, the control device may generate a control instruction corresponding to the target smart device based on the motion recognition result.
In step 406, the control device sends control instructions to the target smart device.
In this embodiment, the control device may send the generated control instruction to the corresponding target smart device. Here, the control device may adopt any transmission method, and is not particularly limited herein.
In step 407, the target smart device performs an operation corresponding to the control instruction.
In this embodiment, the target smart device may perform an operation corresponding to the received control instruction.
For example, if the gesture made by the user is judged to mean "turn on the light", the action recognition result is obtained, and the corresponding intelligent device is determined to be an "intelligent lighting lamp". And then a control instruction with the content of 'turning on' is generated, so that the intelligent illuminating lamp is turned on. Or judging that the meaning of the body action of the user is 'leaving', obtaining an action recognition result, and determining that the corresponding intelligent equipment is 'intelligent door lock'. And then a control command with the content of closing the door lock is generated, so that the intelligent door lock is automatically locked when the user leaves.
As can be seen from fig. 4, compared with the embodiment corresponding to fig. 2, the system for controlling a smart device in the present embodiment discloses a specific manner of biometric authentication and an authentication process. Therefore, the scheme described in the embodiment can realize intelligent device control based on motion recognition.
With further reference to FIG. 5, a timing diagram of yet another embodiment of a system for controlling a smart device is shown.
In the embodiment, the system for controlling the intelligent device comprises a control device (for example, a control device 101 shown in fig. 1) and a plurality of intelligent devices (for example, intelligent devices 102 and 103 shown in fig. 1), wherein the control device comprises an image acquisition device and a voice acquisition device, and is in communication connection with the voice recognition device;
the control equipment is configured to collect a face image of a user by using the image collecting device, and identity information of the user is determined according to the face image of the user; if the user is a legal user, further acquiring voice information of the user by using the voice acquisition device, and sending the voice information to the voice recognition device so that the voice recognition device performs voice recognition on the voice information; receiving a voice recognition result returned by the voice recognition device; determining a target intelligent device from the plurality of intelligent devices based on the identity information and the voice recognition result of the user, and generating a control instruction corresponding to the target intelligent device; sending the control instruction to the target intelligent equipment;
and the target intelligent device is configured to execute the operation corresponding to the control instruction.
As shown in fig. 5, in step 501, the control apparatus acquires a face image of a user using an image acquisition device.
In this embodiment, the image acquisition device may be a camera, and the control device may acquire a face image of the user by using the image acquisition device.
In step 502, the control device determines identity information of the user from the facial image of the user.
In this embodiment, the control device may determine the identity information of the user according to the face image of the user. Here, for the explanation of step 502, refer to the related explanation of step 402 in the embodiment shown in fig. 4, and no further description is provided here.
In step 503, if the user is a legal user, the control device further uses the voice collecting device to collect voice information of the user, and sends the voice information to the voice recognition device, so that the voice recognition device performs voice recognition on the voice information.
In this embodiment, if the control device determines that the user is a valid user based on the identified identity information, the control device may further collect voice information of the user by using the voice collecting device, send the voice information to the voice recognition device, and recognize the voice information of the user by using the voice recognition device. The voice collecting device may be a microphone, for example.
In this embodiment, the voice recognition device and the control device may be independent from each other, or the voice recognition device may be integrated into the control device. This is not limited in this embodiment.
The voice recognition is to analyze the audio frequency of the voice mailbox through a voice recognition device, and further judge the meaning of the voice information of the user to be used as a voice recognition result. And then determining corresponding target intelligent equipment according to the voice recognition result for control.
In step 504, the control device receives the speech recognition result returned by the speech recognition means.
In this embodiment, the control device may receive the voice recognition result returned by the voice recognition apparatus through a wired connection manner or a wireless connection manner.
In step 505, the control device determines a target smart device from the plurality of smart devices based on the identity information of the user and the voice recognition result, and generates a control instruction corresponding to the target smart device.
In this embodiment, the control device may determine the target intelligent device from the plurality of intelligent devices based on the identity information of the user and the voice recognition result, and generate the control instruction corresponding to the target intelligent device.
For example, if the meaning of the voice information of the user is judged to be 'turn on the air conditioner', a voice recognition result is obtained, and the corresponding intelligent device is determined to be 'intelligent air conditioner'. If the user is determined to have the right to control the intelligent air conditioner based on the identity information of the user, the control equipment can further generate a control instruction with the content of 'starting'.
In step 506, the control device sends the control instructions to the target smart device.
In this embodiment, the control device may send the generated control instruction to the corresponding target smart device. Here, the control device may adopt any transmission method, and is not particularly limited herein.
In step 507, the target smart device performs an operation corresponding to the control instruction.
In this embodiment, the target smart device may perform an operation corresponding to the received control instruction.
For example, the target intelligent device includes an intelligent air conditioner, and if the intelligent air conditioner receives an "on" control instruction, the intelligent air conditioner may turn on the intelligent air conditioner according to the "on" control instruction.
As can be seen from fig. 5, compared with the embodiment corresponding to fig. 2, the system for controlling a smart device in the present embodiment discloses a specific manner of biometric authentication and an authentication process. Therefore, the scheme described in the embodiment can realize intelligent device control based on voice recognition.
In some optional implementations of various embodiments of the system for controlling a smart device provided herein, the system may further include a management device configured to: and acquiring the equipment information of the control equipment and the plurality of intelligent equipment, and sending the equipment information to a server so that the server binds the control equipment and the plurality of intelligent equipment to the same user account by using the equipment information.
The management device may be further configured to:
and receiving the control instruction sent by the control equipment by adopting a preset first protocol, and sending the control instruction to the target intelligent equipment by adopting a preset second protocol corresponding to the target intelligent equipment.
It should be noted that the control device and the plurality of intelligent devices may be bound to the same user account in advance, so that the user can conveniently and uniformly manage the control device and the plurality of intelligent devices.
The management device can be a smart phone, a tablet computer, an internet of things gateway and the like. The management device can support a plurality of wireless communication protocols, such as bluetooth, ZigBee, 2.4G, WiFi, LoRa, or the like. The management device may acquire device information of the control device and the plurality of smart devices, and transmit the device information to the server. The device information may specifically be identification information such as a device model, a hardware address, and a hardware serial number. The server can bind the control device and the intelligent devices to the same user account according to the device information, so that the control device and the intelligent devices can realize communication of the Internet of things.
The wireless communication protocols used by the control device and the intelligent devices may be different, and communication and signaling interaction between the control device and the intelligent devices of different protocols can be realized through the management device supporting multiple wireless communication protocols. Specifically, the control instruction sent by the control device is received by using a preset first protocol, and the control instruction is sent to the target intelligent device by using a preset second protocol corresponding to the target intelligent device.
For example, the communication protocol used by the controlling device is 2.4G communication, while the communication protocol used by the target smart device is ZigBee communication. The control device sends the control instruction to the management device according to 2.4G communication, the management device carries out communication protocol conversion, and then sends the control instruction to the intelligent device by utilizing ZigBee communication so as to enable the intelligent device to execute.
With further reference to fig. 6, as an implementation manner of the systems shown in the above figures, the present application provides an embodiment of a method for controlling an intelligent device, where the embodiment of the method corresponds to the embodiment of the system shown in fig. 2, and the method specifically includes the following steps:
step 601, performing biometric identification on the user.
Step 602, determining a target intelligent device from the plurality of intelligent devices based on the biometric identification result, and generating a control instruction corresponding to the target intelligent device.
Step 603, sending the control instruction to the target intelligent device, so that the target intelligent device executes an operation corresponding to the control instruction.
In this embodiment, the detailed processing of step 601-603 and the technical effects thereof can refer to the related descriptions in the corresponding embodiment of fig. 2, which are not repeated herein.
In some optional implementations of this embodiment, the biometric identification includes face recognition, and the control device includes an image acquisition device; and performing biometric identification on the user, including: acquiring a face image of a user by using an image acquisition device; determining identity information of a user according to a face image of the user; and determining a target smart device from the plurality of smart devices based on the biometric identification result, including: and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information of the user.
In some optional implementations of this embodiment, the biometric identification further includes motion identification, and the control device is in communication connection with the motion identification apparatus; after the identity information of the user is determined according to the face image of the user, the method further comprises the following steps: if the user is a legal user, further recording the action video of the user by using the image acquisition device; sending the recorded action video to an action recognition device so that the action recognition device can perform action recognition on the action video; receiving an action recognition result returned by the action recognition device; and determining a target intelligent device from the plurality of intelligent devices based on the identity information of the user, including: and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information and the action recognition result of the user.
In some optional implementation manners of this embodiment, the biometric recognition further includes voice recognition, the control device further includes a voice acquisition device, and the control device is in communication connection with the voice recognition device; after the identity information of the user is determined according to the face image of the user, the method further comprises the following steps: if the user is a legal user, further acquiring the voice information of the user by using a voice acquisition device; sending the voice information to a voice recognition device so that the voice recognition device performs voice recognition on the voice information; receiving a voice recognition result returned by the voice recognition device; and determining a target intelligent device from the plurality of intelligent devices based on the identity information of the user, including: and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information and the voice recognition result of the user.
In some optional implementations of this embodiment, determining a target smart device from the plurality of smart devices based on the biometric recognition result, and generating a control instruction corresponding to the target smart device includes: searching target configuration information matched with the biological identification result in preset configuration information, wherein the preset configuration information is used for representing the corresponding relation among the biological identification result, the intelligent devices and the control instruction; and based on the target configuration information, determining a target intelligent device from the plurality of intelligent devices and generating a control instruction corresponding to the target intelligent device.
With further reference to fig. 7, as an implementation of the methods shown in some of the above figures, the present application provides an embodiment of an apparatus for controlling an intelligent device, where the embodiment of the apparatus corresponds to the embodiment of the method shown in fig. 6, and the apparatus may be specifically applied to a control device.
As shown in fig. 7, the apparatus for controlling a smart device of the present embodiment includes:
a biometric authentication module 701 configured to perform biometric identification on a user.
The instruction generating module 702 is configured to determine a target smart device from the plurality of smart devices based on the biometric identification result, and generate a control instruction corresponding to the target smart device.
A sending module 703 configured to send the control instruction to the target smart device, so that the target smart device executes an operation corresponding to the control instruction.
In this embodiment, the specific processes of the biometric authentication module 701, the instruction generation module 702, and the sending module 703 and the technical effects thereof can be respectively described with reference to the embodiment corresponding to fig. 2 and the embodiment corresponding to fig. 6, and are not repeated herein.
In some optional implementations of this embodiment, the biometric identification includes face recognition, and the control device includes an image acquisition device; and the biometric authentication module 701 may be further configured to: acquiring a face image of a user by using an image acquisition device; determining identity information of a user according to a face image of the user; and the instruction generation module 702 may be further configured to: and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information of the user.
In some optional implementations of this embodiment, the biometric identification further includes motion identification, and the control device is in communication connection with the motion identification apparatus; and the biometric authentication module 701 is further configured to: after the identity information of the user is determined according to the face image of the user, if the user is determined to be a legal user, further recording the action video of the user by using an image acquisition device; sending the recorded action video to an action recognition device so that the action recognition device can perform action recognition on the action video; receiving an action recognition result returned by the action recognition device; and the instruction generation module 702 may be further configured to: and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information and the action recognition result of the user.
In some optional implementation manners of this embodiment, the biometric recognition further includes voice recognition, the control device further includes a voice acquisition device, and the control device is in communication connection with the voice recognition device; and the biometric authentication module 701 is further configured to: after the identity information of the user is determined according to the face image of the user, if the user is determined to be a legal user, voice information of the user is further acquired by using a voice acquisition device; sending the voice information to a voice recognition device so that the voice recognition device performs voice recognition on the voice information; receiving a voice recognition result returned by the voice recognition device; and the instruction generation module 702 may be further configured to: and determining the target intelligent equipment from the plurality of intelligent equipment based on the identity information and the voice recognition result of the user.
In some optional implementations of this embodiment, the instruction generation module 702 may be further configured to: searching target configuration information matched with the biological identification result in preset configuration information, wherein the preset configuration information is used for representing the corresponding relation among the biological identification result, the intelligent devices and the control instruction; and based on the target configuration information, determining a target intelligent device from the plurality of intelligent devices and generating a control instruction corresponding to the target intelligent device.
It should be noted that the apparatus for controlling the smart device may include a processor and a memory, and the biometric authentication module 701, the instruction generation module 702, the transmission module 703, and the like are all stored in the memory as program units, and the processor executes the program units stored in the memory to implement corresponding functions.
The processor may include a kernel, which calls the corresponding program unit from the memory. One or more kernels can be set, and linkage control of the control equipment and the intelligent equipment based on the Internet of things technology is achieved by adjusting kernel parameters.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The device for pushing information, provided by the above embodiment of the application, carry out biological identification to the user through control device, then confirm target smart machine based on biological identification result, and generate the control command that corresponds with target smart machine, then send control command to target smart machine, so that target smart machine carries out the operation corresponding with control command, the coordinated control of controlgear and smart machine based on internet of things has been realized, make controlgear and smart machine realize systematized collaborative work, realize the diversification of function, improve user experience.
The embodiment of the application provides a computer readable medium, on which a computer program is stored, wherein the program is executed by a processor to realize the method for controlling the intelligent device provided by the above method embodiment.
The embodiment of the application provides a processor, which is used for running a program, wherein the program runs to implement the method for controlling the intelligent device provided by the method embodiment.
The embodiment of the application provides equipment, which comprises a processor, a memory and a program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the method for controlling the intelligent equipment provided by the method embodiment.
The present application also provides a computer program product which, when executed on a data processing device, causes the data processing device to implement the method for controlling a smart device provided by the above method embodiments.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above description is only for the purpose of illustrating the preferred embodiments of the present application and the technical principles applied, and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. The scope of the invention according to the present application is not limited to the specific combinations of the above-described features, and may also cover other embodiments in which the above-described features or their equivalents are arbitrarily combined without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

Claims (12)

1. A system for controlling smart devices, the system comprising a control device and a plurality of smart devices;
the control device is configured to perform biological recognition on a user, determine a target intelligent device from the plurality of intelligent devices based on a biological recognition result, generate a control instruction corresponding to the target intelligent device, and send the control instruction to the target intelligent device;
the target intelligent device is configured to execute the operation corresponding to the control instruction.
2. The system of claim 1, wherein biometric recognition comprises face recognition, and the control device comprises an image capture device; and
the control device is further configured to:
acquiring a face image of a user by using the image acquisition device;
determining the identity information of the user according to the face image of the user;
and determining a target intelligent device from the plurality of intelligent devices based on the identity information.
3. The system of claim 2, wherein the biometric identification further comprises motion recognition, the control device being communicatively coupled to the motion recognition device; and
the control device is further configured to:
after the identity information is determined, if the user is a legal user, further recording an action video of the user by using the image acquisition device;
sending the recorded action video to the action recognition device so that the action recognition device performs action recognition on the action video;
receiving an action recognition result returned by the action recognition device;
and determining a target intelligent device from the plurality of intelligent devices based on the identity information and the action recognition result.
4. The system of claim 2, wherein the biometric recognition further comprises voice recognition, the control device further comprises a voice capture device, and the control device is communicatively coupled to the voice recognition device; and
the control device is further configured to:
after the identity information is determined, if the user is a legal user, the voice information of the user is further acquired by using the voice acquisition device;
sending the voice information to the voice recognition device so that the voice recognition device performs voice recognition on the voice information;
receiving a voice recognition result returned by the voice recognition device;
and determining a target intelligent device from the plurality of intelligent devices based on the identity information and the voice recognition result.
5. The system of one of claims 1-4, wherein the control device is further configured to:
finding out target configuration information matched with the biological identification result from preset configuration information, wherein the preset configuration information is used for representing the corresponding relation among the biological identification result, the intelligent devices and the control instruction;
and determining target intelligent equipment from the plurality of intelligent equipment based on the target configuration information, and generating a control instruction corresponding to the target intelligent equipment.
6. The system of claim 1, further comprising a management device configured to:
and acquiring the equipment information of the control equipment and the intelligent equipment, and sending the equipment information to a server so that the server binds the control equipment and the intelligent equipment to the same user account by using the equipment information.
7. The system of claim 6, wherein the management device is further configured to:
and receiving the control instruction sent by the control equipment by adopting a preset first protocol, and sending the control instruction to the target intelligent equipment by adopting a preset second protocol corresponding to the target intelligent equipment.
8. A method for controlling a smart device, applied to a control device, comprising:
performing biometric identification on a user;
determining a target intelligent device from a plurality of intelligent devices based on a biological recognition result, and generating a control instruction corresponding to the target intelligent device;
and sending the control instruction to the target intelligent equipment so as to enable the target intelligent equipment to execute the operation corresponding to the control instruction.
9. An apparatus for controlling a smart device, applied to a control device, comprising:
a biometric authentication module configured to biometrically identify a user;
the instruction generation module is configured to determine a target intelligent device from a plurality of intelligent devices based on a biological recognition result and generate a control instruction corresponding to the target intelligent device;
a sending module configured to send the control instruction to the target smart device so as to cause the target smart device to execute an operation corresponding to the control instruction.
10. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method of claim 8.
11. A processor for running a program, wherein the program when running performs the method of claim 8.
12. An apparatus, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of claim 8.
CN201910770447.XA 2019-08-20 2019-08-20 System, method and apparatus for controlling smart devices Pending CN112417923A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910770447.XA CN112417923A (en) 2019-08-20 2019-08-20 System, method and apparatus for controlling smart devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910770447.XA CN112417923A (en) 2019-08-20 2019-08-20 System, method and apparatus for controlling smart devices

Publications (1)

Publication Number Publication Date
CN112417923A true CN112417923A (en) 2021-02-26

Family

ID=74779503

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910770447.XA Pending CN112417923A (en) 2019-08-20 2019-08-20 System, method and apparatus for controlling smart devices

Country Status (1)

Country Link
CN (1) CN112417923A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107121938A (en) * 2017-06-30 2017-09-01 北京金茂绿建科技有限公司 Intelligent home equipment control method, the device and system of identity-based identification
CN108052079A (en) * 2017-12-12 2018-05-18 北京小米移动软件有限公司 Apparatus control method, device, plant control unit and storage medium
CN108563941A (en) * 2018-07-02 2018-09-21 信利光电股份有限公司 A kind of intelligent home equipment control method, intelligent sound box and intelligent domestic system
CN109634132A (en) * 2019-01-03 2019-04-16 深圳壹账通智能科技有限公司 Smart home management method, device, medium and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107121938A (en) * 2017-06-30 2017-09-01 北京金茂绿建科技有限公司 Intelligent home equipment control method, the device and system of identity-based identification
CN108052079A (en) * 2017-12-12 2018-05-18 北京小米移动软件有限公司 Apparatus control method, device, plant control unit and storage medium
CN108563941A (en) * 2018-07-02 2018-09-21 信利光电股份有限公司 A kind of intelligent home equipment control method, intelligent sound box and intelligent domestic system
CN109634132A (en) * 2019-01-03 2019-04-16 深圳壹账通智能科技有限公司 Smart home management method, device, medium and electronic equipment

Similar Documents

Publication Publication Date Title
US20220317641A1 (en) Device control method, conflict processing method, corresponding apparatus and electronic device
AU2019101579A4 (en) User identity verification method, apparatus and system
JP6620230B2 (en) Rapid identification method and intelligent robot for home use
US9323912B2 (en) Method and system for multi-factor biometric authentication
CN104767963B (en) Participant's information demonstrating method in video conference and device
US11031008B2 (en) Terminal device and method for controlling thereof
CN111081234B (en) Voice acquisition method, device, equipment and storage medium
CN109032039A (en) A kind of method and device of voice control
CN108469772B (en) Control method and device of intelligent equipment
CN104102181A (en) Intelligent home control method, device and system
CN109726674A (en) A kind of face identification method and device
CN110546627A (en) Video integration with home assistants
WO2018208365A1 (en) Methods and systems for presenting image data for detected regions of interest
CN108063909A (en) Video conferencing system, image trace acquisition method and device
CN108713346A (en) Channel monitoring method, apparatus, system and storage medium
CN110705356B (en) Function control method and related equipment
CN104378596B (en) A kind of method and device carrying out distance communicating with picture pick-up device
US11115630B1 (en) Custom and automated audio prompts for devices
CN109343481B (en) Method and device for controlling device
CN113205802B (en) Updating method of voice recognition model, household appliance and server
US20190327128A1 (en) Using a local hub device as a substitute for an unavailable backend device
CN103870735A (en) Unlocking processing method and device
CN112417923A (en) System, method and apparatus for controlling smart devices
US10920356B2 (en) Optimizing processing methods of multiple batched articles having different characteristics
CN112349282A (en) Voice control system, voice processing method and external equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination