CN112037787A - Wake-up control method, device and computer readable storage medium - Google Patents
Wake-up control method, device and computer readable storage medium Download PDFInfo
- Publication number
- CN112037787A CN112037787A CN202011128066.0A CN202011128066A CN112037787A CN 112037787 A CN112037787 A CN 112037787A CN 202011128066 A CN202011128066 A CN 202011128066A CN 112037787 A CN112037787 A CN 112037787A
- Authority
- CN
- China
- Prior art keywords
- equipment
- awakening
- wake
- target
- candidate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/2821—Avoiding conflicts related to the use of home appliances
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The present disclosure relates to a wake-up control method, apparatus, and computer-readable storage medium. The method is applied to a first device with a voice interaction function and comprises the following steps: responding to the received voice signal, and detecting whether a second device with a voice interaction function exists in the same local area network; responding to the detection result of the second equipment, acquiring the microphone state of the second equipment, and determining candidate awakening equipment from the second equipment according to the microphone state of the second equipment; and determining the target awakening equipment at least according to the received first information sent by the candidate awakening equipment. Therefore, the simultaneous awakening rate can be reduced, the disordered situation caused by simultaneously awakening and responding a plurality of devices is avoided, and the user experience is improved. And when the first device wakes up the device at the decision target, the first device does not need to wait for the first information sent by the second device of which the microphone state does not meet the preset condition, so that the waiting time can be shortened, the wake-up decision can be carried out in advance, and the wake-up response speed and the user experience can be improved.
Description
Technical Field
The present disclosure relates to the field of artificial intelligence technologies, and in particular, to a wake-up control method and apparatus, and a computer-readable storage medium.
Background
With the continuous development of voice interaction technology, more and more devices are configured with voice interaction functions. For example, a smart sound box, a smart air conditioner, a smart television, a smart air purifier, etc. can be configured with a voice interaction function to realize voice control and interaction. However, when a plurality of devices with voice interaction function exist in a space at the same time (usually connected through a lan) and their wake-up words are the same, if a user initiates a wake-up operation, a plurality of devices will wake up and respond at the same time. Therefore, mutual crosstalk between different devices and an interaction scene can be disordered, and user experience is seriously influenced.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides a wake-up control method, apparatus, and computer-readable storage medium.
According to a first aspect of the embodiments of the present disclosure, there is provided a wake-up control method, including:
responding to the received voice signal, and detecting whether a second device with a voice interaction function exists in the same local area network;
responding to the detection result of the second equipment, acquiring the microphone state of the second equipment, and determining candidate awakening equipment from the second equipment according to the microphone state of the second equipment;
and determining target awakening equipment at least according to received first information sent by the candidate awakening equipment, wherein the target awakening equipment is used for carrying out awakening response, and the first information is used for representing the distance between the candidate awakening equipment and the sound source of the voice signal.
Optionally, the determining a target wake-up device according to at least the received first information sent by the candidate wake-up device includes:
taking the first information received within a preset time length as effective first information;
and determining the target awakening equipment at least according to the effective first information which is received in the preset time and sent by the candidate awakening equipment.
Optionally, the determining a target wake-up device according to at least the received first information sent by the candidate wake-up device includes:
determining second information according to the voice signal, wherein the second information is used for representing the distance between the first equipment and a sound source of the voice signal;
and determining target awakening equipment from the first equipment and the candidate awakening equipment according to the second information and the received first information sent by the candidate awakening equipment.
Optionally, the determining, according to the second information and the received first information sent by the candidate wake-up device, a target wake-up device from the first device and the candidate wake-up device includes:
determining target information representing that the distance between the corresponding equipment and the sound source is minimum from the second information and the received first information sent by each candidate awakening equipment;
and determining the equipment corresponding to the target information as target awakening equipment.
Optionally, the method further comprises:
if the target awakening equipment is the first equipment, awakening response is carried out;
and if the target awakening device is not the first device, sending an awakening message to the target awakening device, so that the target awakening device carries out awakening response after receiving the awakening message.
Optionally, the method further comprises:
if the target awakening equipment is the first equipment, awakening response is carried out;
and if the target awakening equipment is not the first equipment, continuously keeping the dormant state.
Optionally, the method further comprises:
when detecting that the microphone state of the second device changes, sending the current microphone state of the second device to the second device, so that the second device receiving the voice signal determines whether the first device is a candidate awakening device according to the current microphone state of the first device when determining whether to awaken the second device.
Optionally, before the step of detecting whether the second device having the voice interaction function exists in the same local area network, the method further includes:
detecting whether the voice signal contains a preset awakening word or not;
and under the condition that the voice signal contains the preset awakening word, executing the step of detecting whether a second device with a voice interaction function exists in the same local area network.
Optionally, the method further comprises:
and responding to the detection result that the second equipment is not detected, and performing awakening response.
Optionally, the determining a candidate wake-up device from the second device according to the microphone state of the second device includes:
and determining the second equipment with the microphone in the on state as candidate awakening equipment.
According to a second aspect of the embodiments of the present disclosure, there is provided a wake-up control apparatus, including:
the detection module is configured to respond to the received voice signal and detect whether a second device with a voice interaction function exists in the same local area network;
a first determining module, configured to, in response to the detection module detecting the detection result of the second device, obtain a microphone state of the second device, and determine a candidate wake-up device from the second device according to the microphone state of the second device;
a second determining module, configured to determine a target wake-up device at least according to received first information sent by the candidate wake-up device determined by the first determining module, where the target wake-up device is configured to perform a wake-up response, and the first information is used to characterize a distance between the candidate wake-up device and a sound source of the voice signal.
According to a third aspect of the embodiments of the present disclosure, there is provided a wake-up control apparatus, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
responding to the received voice signal, and detecting whether a second device with a voice interaction function exists in the same local area network;
responding to the detection result of the second equipment, acquiring the microphone state of the second equipment, and determining candidate awakening equipment from the second equipment according to the microphone state of the second equipment;
and determining target awakening equipment at least according to received first information sent by the candidate awakening equipment, wherein the target awakening equipment is used for carrying out awakening response, and the first information is used for representing the distance between the candidate awakening equipment and the sound source of the voice signal.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the steps of the wake-up control method provided by the first aspect of the present disclosure.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: under the condition that a voice signal is received and second equipment with a voice interaction function exists in the same local area network, firstly, candidate awakening equipment is determined from the second equipment according to the microphone state of the second equipment; and then, determining target awakening equipment for awakening response at least according to the second information sent by the candidate awakening equipment. Therefore, the simultaneous awakening rate can be reduced, the disordered situation caused by simultaneously awakening and responding a plurality of devices is avoided, and the user experience is improved. In addition, the first device decides the target awakening device at least according to the first information sent by the second device (namely, the candidate awakening device) with the microphone state meeting the preset condition, so that the first information sent by the second device with the microphone state not meeting the preset condition does not need to be waited, the waiting time can be shortened, the awakening decision can be made in advance, the awakening response speed is improved, and the user experience is further improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a schematic diagram illustrating one implementation environment in accordance with an example embodiment.
Fig. 2 is a flow chart illustrating a wake-up control method according to an example embodiment.
Fig. 3 is a flow chart illustrating a wake-up control method according to another exemplary embodiment.
Fig. 4 is a flow chart illustrating a wake-up control method according to another exemplary embodiment.
Fig. 5 is a flow chart illustrating a wake-up control method according to another exemplary embodiment.
Fig. 6 is a block diagram illustrating a wake-up control apparatus according to an example embodiment.
Fig. 7 is a block diagram illustrating a wake-up control apparatus according to an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
An environment for implementing the present disclosure is first described. FIG. 1 is a schematic diagram illustrating one implementation environment in accordance with an example embodiment. As shown in fig. 1, the implementation environment may include devices with voice interaction functions, such as an air purifier 10, a smart tv 20, and a smart sound box 30. The air purifier 10, the smart television 20 and the smart sound box 30 are respectively connected to the router 40 and are located in the same local area network. Among them, there may be a case where the air purifier 10, the smart tv 20, and the smart sound box 30 are awakened and responded at the same time when receiving a voice signal for awakening the device sent by the user. Therefore, mutual crosstalk between different devices and an interaction scene can be disordered, and user experience is seriously influenced. To this end, the present disclosure provides a wake-up control method, apparatus, and computer-readable storage medium.
In addition, the devices with the voice interaction function may form a local area network by using a router, or may form a local area network by using technologies such as bluetooth and near field communication.
Fig. 2 is a flowchart illustrating a wake-up control method according to an exemplary embodiment, wherein the wake-up control method is applied to a first device with a voice interaction function, where the first device may be any device with a voice interaction function in a current local area network (i.e., a local area network where the first device is located) and a function of determining a target wake-up device (where the target wake-up device is used for making a wake-up response), such as the air purifier 10, the smart tv 20, or the smart speaker 30 shown in fig. 1. As shown in fig. 2, the method includes S201 to S203.
In S201, in response to receiving the voice signal, it is detected whether a second device having a voice interaction function exists in the same lan.
In the present disclosure, the second device may be any device having a voice interaction function in the current local area network except the first device. Illustratively, as shown in fig. 1, the first device is a smart sound box 30, and the second device includes an air purifier 10 and a smart television 20.
In addition, the voice signal is a voice uttered by the user for waking up the device having the voice interaction function, for example, "favorite classmates". When receiving the voice signal, the first device may detect whether a second device having a voice interaction function exists in the same local area network. If a second device with a voice interaction function exists in the same local area network, S202 is executed. One or more second devices which belong to the same local area network as the first device and have the voice interaction function can be provided; and if the second equipment with the voice interaction function does not exist in the same local area network, the first equipment directly performs awakening response or continuously keeps the dormant state.
In S202, in response to detecting the detection result of the second device, the microphone state of the second device is acquired, and a candidate wake-up device is determined from the second device according to the microphone state of the second device.
In the present disclosure, the microphone state may include an on state and an off state. Wherein the microphone state of the second device may be acquired in a variety of ways. In one embodiment, when detecting that the microphone state of each device (including the first device and the at least one second device) having a voice interaction function in the current local area network changes, the device sends the current microphone state of each device to the server, so that the server updates and stores the microphone state corresponding to the device. Therefore, each device can acquire the microphone states of other devices in the local area network by sending the acquisition request to the server.
To reduce the processing pressure of a server and to reduce the cost of building the server. Meanwhile, the method prevents the current microphone state of a certain device from being notified to the server due to the phenomenon of packet loss when the network is unstable, or the server cannot smoothly send the microphone states of other devices to the corresponding devices, so that the accuracy of the microphone states of other devices acquired by each device is improved. In another embodiment, when each device (the first device and the at least one second device) having a voice interaction function in the local area network detects that the microphone state of the device changes, the device sends the current microphone state of the device to other devices through the local area network.
In a further embodiment, the first device sends a request message for acquiring its microphone state to the second device upon detecting the presence of the second device with voice interaction functionality within the same local area network. And after receiving the request information, the second equipment acquires the microphone state of the second equipment and sends the microphone state to the first equipment. The first device receives the microphone status.
In such an embodiment, each second device in the local area network transmits its own microphone state to the first device each time it wakes up. Therefore, even if the first device does not receive the microphone state sent by a certain second device due to packet loss when awakening for the next time, the microphone state can be received when awakening for the next time, so that the accuracy of the microphone state of other currently acquired devices can be improved, and further the awakening response speed can be improved.
After the microphone state of the second device is acquired, the second device with the microphone state being in the on state may be determined as a candidate wake-up device. That is, the second device with the microphone in the on state has the capability of responding, and the second device with the microphone in the off state does not have the capability of responding, so that the second device is removed from all the second devices, and thus, the second information sent by the second device with the microphone in the off state does not need to be waited, so that the waiting time can be shortened, the awakening decision can be made in advance, the awakening response speed is increased, and the user experience is further improved.
In S203, the target wake-up device is determined at least according to the received first information sent by the candidate wake-up device.
In the present disclosure, the target wake-up device is configured to perform a wake-up response; the first information is used to characterize the distance between the candidate wake-up device and the sound source of the speech signal, which may be, for example, the sound field strength or the distance. After receiving the voice signal, each candidate awakening device determines first information according to the voice signal and sends the first information to the first device; the first device receives first information sent by each candidate awakening device.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: under the condition that a voice signal is received and second equipment with a voice interaction function exists in the same local area network, firstly, candidate awakening equipment is determined from the second equipment according to the microphone state of the second equipment; and then, determining target awakening equipment for awakening response at least according to the second information sent by the candidate awakening equipment. Therefore, the simultaneous awakening rate can be reduced, the disordered situation caused by simultaneously awakening and responding a plurality of devices is avoided, and the user experience is improved. In addition, the first device decides the target awakening device at least according to the first information sent by the second device (namely, the candidate awakening device) with the microphone state meeting the preset condition, so that the first information sent by the second device with the microphone state not meeting the preset condition does not need to be waited, the waiting time can be shortened, the awakening decision can be made in advance, the awakening response speed is improved, and the user experience is further improved.
A detailed description will be given below of a specific implementation manner of determining the target wake-up device according to at least the received first information sent by the candidate wake-up device in S203.
In one embodiment, the first device is a decider of the target wake-up device (i.e. the first device has the function of determining the target wake-up device), but is not a wake-up device (i.e. the first wake-up device cannot perform a wake-up response), and at this time, the target wake-up device may be determined from the candidate wake-up devices according to the received first information sent by the candidate wake-up devices. Specifically, this can be achieved by:
firstly, determining target information representing the minimum distance between corresponding equipment and a sound source from first information sent by each candidate awakening equipment; and then, determining the device corresponding to the target information as a target awakening device.
In the present disclosure, the first information may be a distance or a sound field intensity. In one embodiment, the first information is a distance, that is, the first information is a distance between the candidate wake-up devices and a sound source of the voice signal, so that a minimum value of the distances between each candidate wake-up device and the sound source of the voice signal can be used as the target information; and then, determining the device corresponding to the target information as a target awakening device.
Exemplarily, as shown in fig. 1, the first device is a smart sound box 30, and the second device in the same lan as the smart sound box 30 includes an air purifier 10 and a smart tv 20, wherein microphone states of the air purifier 10 and the smart tv 20 are both in an on state, that is, the candidate wake-up device includes the air purifier 10 and the smart tv 20. Wherein, the distance between the air purifier 10 and the sound source of the voice signal is 23cm, and the distance between the smart television 20 and the sound source of the voice signal is 33 cm. It can be seen that the distance between the air purifier 10 and the sound source of the voice signal is the minimum of the above distances, i.e., the minimum distance. The distance between the air purifier 10 and the sound source of the voice signal is the target information, and the device corresponding to the target information (i.e., the minimum value) is the air purifier 10, and thus, the air purifier 10 can be determined as the target wake-up device, i.e., the wake-up response by the air purifier 10.
In another embodiment, the first information is sound field intensity, that is, the first information is sound field intensity of the voice signal received by the candidate wake-up apparatuses, so that a maximum value of the sound field intensity of the voice signal received by each candidate wake-up apparatus can be used as the target information; and then, determining the device corresponding to the target information as a target awakening device. Wherein the greater the sound field intensity, the closer the distance between the sound source representing the respective device and the speech signal.
Illustratively, as shown in fig. 1, a first device is a smart sound box 30, and a second device in the same lan as the first device includes an air purifier 10 and a smart tv 20, where a microphone state of the air purifier 10 is an off state and a microphone state of the smart tv 20 is an on state, that is, the candidate wake-up device includes the smart tv 20. The sound field intensity of the voice signal collected by the smart television 20 is 43 DB. At this time, the smart tv 20 may be directly determined as the target wake-up device, i.e., the smart tv 20 performs the wake-up response.
Further exemplarily, as shown in fig. 1, the first device is a smart sound box 30, and the second device in the same lan as the first device includes the air purifier 10 and the smart tv 20, wherein the microphone state of the air purifier 10 and the microphone state of the smart tv 20 are both in an on state, that is, the candidate wake-up devices include the air purifier 10 and the smart tv 20. The sound field intensity of the voice signal collected by the air purifier 10 is 59DB, and the sound field intensity of the voice signal collected by the smart television 20 is 43 DB. It can be seen that the sound field intensity of the voice signal collected by the air purifier 10 is the maximum value of the above sound field intensities, that is, the sound field intensity of the voice signal collected by the air purifier 10 is the target information, and the device corresponding to the target information is the air purifier 10, so that the air purifier 10 can be determined as the target wake-up device, that is, the air purifier 10 performs the wake-up response.
In another embodiment, the first device is a decision maker of the target wake-up device and also serves as the wake-up device, and in this case, the target wake-up device may be determined by:
first, second information may be determined from the speech signal, wherein the second information is used to characterize a distance between the first device and a sound source of the speech signal, illustratively, the first information is a distance or a sound field strength; and then, according to the second information and the received first information sent by the candidate awakening device, determining a target awakening device from the first device and the candidate awakening device.
A detailed description is given below to a specific implementation manner of determining the target wake-up device from the first device and the candidate wake-up device according to the second information and the first information sent by the candidate wake-up device. Specifically, this can be achieved by:
firstly, determining target information representing the minimum distance between corresponding equipment and a sound source from second information and first information sent by each candidate awakening equipment; and then, determining the device corresponding to the target information as a target awakening device.
In one embodiment, the first information and the second information are both distances, that is, the first information is a distance between the candidate wake-up device and a sound source of the voice signal, and the second information is a distance between the first device and the sound source of the voice signal, so that a minimum value of a distance between each candidate wake-up device and the sound source of the voice signal and a distance between the first device and the sound source of the voice signal may be used as the target information, and then a device corresponding to the target information may be determined as the target wake-up device.
Exemplarily, as shown in fig. 1, the first device is a smart sound box 30, and the second device in the same lan as the smart sound box 30 includes an air purifier 10 and a smart tv 20, wherein the microphone states of the air purifier 10 and the smart tv 20 are both in an on state, that is, the candidate wake-up device includes the air purifier 10 and the smart tv 20. The distance between the smart sound box 30 and the sound source of the voice signal is 29cm, the distance between the air purifier 10 and the sound source of the voice signal is 23cm, and the distance between the smart television 20 and the sound source of the voice signal is 33 cm. It can be seen that the distance between the air cleaner 10 and the sound source of the voice signal is the minimum of the above distances. That is, the distance between the air purifier 10 and the sound source of the voice signal is the target information, and the device corresponding to the target information (i.e., the minimum value) is the air purifier 10, and thus, the air purifier 10 can be determined as the target wake-up device, i.e., the wake-up response by the air purifier 10.
In another embodiment, the first information and the second information are sound field intensities, that is, the first information is the sound field intensity of the voice signal received by the candidate wake-up device, and the second information is the sound field intensity of the voice signal received by the first device, so that the maximum value of the sound field intensity of the voice signal received by each candidate wake-up device and the sound field intensity of the voice signal received by the first device can be used as the target information, and then the device corresponding to the target information is determined as the target wake-up device. Wherein the greater the sound field intensity, the closer the distance between the sound source representing the respective device and the speech signal.
Illustratively, as shown in fig. 1, a first device is a smart sound box 30, and a second device in the same lan as the first device includes an air purifier 10 and a smart tv 20, where a microphone state of the air purifier 10 is an on state and a microphone state of the smart tv 20 is an off state, that is, the candidate wake-up device includes the air purifier 10. Wherein, the sound field intensity of the voice signal collected by the smart speaker 30 is 50DB, and the sound field intensity of the voice signal collected by the air purifier 10 is 43 DB. It can be seen that the sound field intensity of the voice signal collected by the smart sound box 30 is the maximum value of the sound field intensities, that is, the sound field intensity of the voice signal collected by the smart sound box 30 is the target information, and the device corresponding to the target information is the smart sound box 30, so that the smart sound box 30 can be determined as the target wake-up device, that is, the smart sound box 30 performs the wake-up response.
In addition, when the candidate wake-up device determined in S202 is empty (that is, the acquired microphone states of the second devices are all in the off state), or when it is detected in S201 that no second device with the voice interaction function exists in the same lan: if the first device is used as the awakening device, the awakening response can be directly carried out; and if the first equipment is not awakened equipment, continuously keeping the dormant state.
In addition, due to network instability, the first device may not receive the first information sent by one or more candidate wake-up devices for a long time, which may cause a long wait and affect the wake-up response speed. Therefore, a time limit is set, if the first information sent by the corresponding second equipment is not received when the time limit is reached, the equipment is not required to be awakened, and the equipment is directly awakened according to the currently received first information at least, so that the first equipment is prevented from waiting for a long time, and the awakening response speed is improved. Specifically, S203 may include: taking the first information received within a preset time length as effective first information; and determining the target awakening equipment at least according to the effective first information which is received in the preset time and sent by the candidate awakening equipment.
In addition, in the present disclosure, the current lan may include a decider of one target wake-up device, and may also include deciders of a plurality of target wake-up devices. In one embodiment, the present local area network includes a decision maker of the target wake-up device, i.e. the first device, and in this case, the method further includes S204 and S205 shown in fig. 3.
In S204, if the target wake-up device is the first device, a wake-up response is performed.
In S205, if the target wake-up device is not the first device, a wake-up message is sent to the target wake-up device, so that the target wake-up device performs a wake-up response after receiving the wake-up message.
In this disclosure, after determining the target wake-up device, the first device determines whether itself is the target wake-up device (i.e., determines whether the first device is the target wake-up device). If the self is the target awakening equipment, directly carrying out awakening response; and if the target awakening device is not the target awakening device, sending an awakening message to the target awakening device, and after receiving the awakening message, carrying out awakening response by the target awakening device.
In another embodiment, the current lan includes a decision maker for waking up a plurality of target devices, where each device in the lan is in an equal status, and at this time, each device (including the first device and the at least one second device) in the current lan can be used as the decision maker, so that each device in the current lan respectively determines whether it is a target wake-up device after receiving the voice signal, that is, decides whether to wake up itself. At this time, the method further includes S204 and S206 shown in fig. 4.
In S204, if the target wake-up device is the first device, a wake-up response is performed.
In S206, if the target wake-up device is not the first device, the target wake-up device continues to maintain the sleep state.
In this disclosure, after determining the target wake-up device, the first device determines whether itself is the target wake-up device (i.e., determines whether the first device is the target wake-up device). If the self is the target awakening equipment, directly carrying out awakening response; if the first device is not the target wake-up device, since each candidate wake-up device is also a decision maker of the target wake-up device, it can determine whether to wake up the first device, and thus the first device can continue to maintain the sleep state, i.e. does not perform the wake-up response. Each candidate wake-up device may determine the target wake-up device in the same manner as the first device determines the target wake-up device, so as to decide whether to wake up itself.
Fig. 5 is a flow chart illustrating a wake-up control method according to another exemplary embodiment. As shown in fig. 5, before the step of detecting whether the second device having the voice interaction function exists in the same lan, the method further includes S207.
In S207, it is detected whether the voice signal includes a preset wake-up word.
In the present disclosure, in a case that the voice signal includes a preset wake-up word, a step of detecting whether a second device having a voice interaction function exists in the same lan is performed. And under the condition that the voice signal does not contain the preset awakening word, continuously keeping the dormant state. Therefore, false awakening can be avoided, and user experience is improved.
Fig. 6 is a block diagram illustrating a wake-up control apparatus according to an exemplary embodiment, wherein the apparatus 600 is applied to a first device having a voice interaction function. As shown in fig. 6, the apparatus 600 includes: a detection module 601 configured to detect whether a second device having a voice interaction function exists in the same local area network in response to receiving a voice signal; a first determining module 602, configured to, in response to the detection module 601 detecting the detection result of the second device, obtain a microphone state of the second device, and determine a candidate wake-up device from the second device according to the microphone state of the second device; a second determining module 603, configured to determine a target wake-up device at least according to received first information sent by the candidate wake-up device determined by the first determining module 602, where the target wake-up device is configured to perform a wake-up response, and the first information is used to characterize a distance between the candidate wake-up device and a sound source of the voice signal.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: under the condition that a voice signal is received and second equipment with a voice interaction function exists in the same local area network, firstly, candidate awakening equipment is determined from the second equipment according to the microphone state of the second equipment; and then, determining target awakening equipment for awakening response at least according to the second information sent by the candidate awakening equipment. Therefore, the simultaneous awakening rate can be reduced, the disordered situation caused by simultaneously awakening and responding a plurality of devices is avoided, and the user experience is improved. In addition, the first device decides the target awakening device at least according to the first information sent by the second device (namely, the candidate awakening device) with the microphone state meeting the preset condition, so that the first information sent by the second device with the microphone state not meeting the preset condition does not need to be waited, the waiting time can be shortened, the awakening decision can be made in advance, the awakening response speed is improved, and the user experience is further improved.
Optionally, the second determining module 603 includes: the first determining submodule is configured to take the first information received within the preset time length as effective first information; and the second determining submodule is configured to determine the target awakening equipment at least according to the effective first information which is received within the preset time and sent by the candidate awakening equipment.
Optionally, the second determining module 603 includes: a third determining submodule configured to determine second information according to the voice signal, wherein the second information is used for representing a distance between the first equipment and a sound source of the voice signal; a fourth determining submodule configured to determine a target wake-up device from the first device and the candidate wake-up device according to the second information and the received first information sent by the candidate wake-up device.
Optionally, the fourth determining sub-module includes: a target information determining submodule configured to determine, from the second information and the received first information sent by each of the candidate wake-up devices, target information representing that a distance between a corresponding device and the sound source is minimum; and the awakening device determining submodule is configured to determine the device corresponding to the target information as a target awakening device.
Optionally, the apparatus 600 further comprises: a first response module configured to perform a wake-up response if the target wake-up device is the first device; a first sending module, configured to send a wake-up message to the target wake-up device if the target wake-up device is not the first device, so that the target wake-up device performs a wake-up response after receiving the wake-up message.
Optionally, the apparatus 600 further comprises: a second response module configured to perform a wake-up response if the target wake-up device is the first device; and the sleep module is configured to continuously keep a sleep state if the target wake-up device is not the first device.
Optionally, the apparatus 600 further comprises: the second sending module is configured to send the current microphone state of the second equipment to the second equipment when detecting that the microphone state of the second equipment changes, so that the second equipment receiving the voice signal determines whether the first equipment is a candidate awakening equipment according to the current microphone state of the first equipment when determining whether to awaken the second equipment.
Optionally, the apparatus 600 further comprises: a wakeup word detection module configured to detect whether the voice signal includes a preset wakeup word before the detection module 601 detects whether a second device with a voice interaction function exists in the same local area network; the detecting module 601 is configured to detect whether a second device with a voice interaction function exists in the same local area network under the condition that the voice signal includes the preset wake-up word.
Optionally, the apparatus 600 further comprises: a third response module configured to respond to the detection result that the second device is not detected, and perform a wake-up response.
Optionally, the first determining module 602 is configured to determine the second device with the microphone in the on state as a candidate wake-up device.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
The present disclosure also provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the wake-up control method provided by the present disclosure.
Fig. 7 is a block diagram illustrating a wake-up control apparatus 700 according to an example embodiment. For example, the apparatus 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 7, apparatus 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.
The processing component 702 generally controls overall operation of the device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or some of the steps of the wake-up control method described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.
The memory 704 is configured to store various types of data to support operations at the apparatus 700. Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power component 706 provides power to the various components of the device 700. The power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the apparatus 700.
The multimedia component 708 includes a screen that provides an output interface between the device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 710 is configured to output and/or input audio signals. For example, audio component 710 includes a Microphone (MIC) configured to receive external audio signals when apparatus 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.
The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 714 includes one or more sensors for providing status assessment of various aspects of the apparatus 700. For example, sensor assembly 714 may detect an open/closed state of device 700, the relative positioning of components, such as a display and keypad of device 700, sensor assembly 714 may also detect a change in position of device 700 or a component of device 700, the presence or absence of user contact with device 700, orientation or acceleration/deceleration of device 700, and a change in temperature of device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 716 is configured to facilitate wired or wireless communication between the apparatus 700 and other devices. The apparatus 700 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the wake-up control method described above.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In another exemplary embodiment, a computer program product is also provided, which contains a computer program executable by a programmable apparatus, the computer program having code portions for performing the wake-up control method described above when executed by the programmable apparatus.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (13)
1. A wake-up control method is applied to a first device with a voice interaction function, and is characterized by comprising the following steps:
responding to the received voice signal, and detecting whether a second device with a voice interaction function exists in the same local area network;
responding to the detection result of the second equipment, acquiring the microphone state of the second equipment, and determining candidate awakening equipment from the second equipment according to the microphone state of the second equipment;
and determining target awakening equipment at least according to received first information sent by the candidate awakening equipment, wherein the target awakening equipment is used for carrying out awakening response, and the first information is used for representing the distance between the candidate awakening equipment and the sound source of the voice signal.
2. The method of claim 1, wherein the determining a target wake-up device according to at least the received first information sent by the candidate wake-up device comprises:
taking the first information received within a preset time length as effective first information;
and determining the target awakening equipment at least according to the effective first information which is received in the preset time and sent by the candidate awakening equipment.
3. The method according to claim 1 or 2, wherein the determining a target wake-up device according to at least the received first information sent by the candidate wake-up device comprises:
determining second information according to the voice signal, wherein the second information is used for representing the distance between the first equipment and a sound source of the voice signal;
and determining target awakening equipment from the first equipment and the candidate awakening equipment according to the second information and the received first information sent by the candidate awakening equipment.
4. The method of claim 3, wherein the determining a target wake-up device from the first device and the candidate wake-up device according to the second information and the received first information sent by the candidate wake-up device comprises:
determining target information representing that the distance between the corresponding equipment and the sound source is minimum from the second information and the received first information sent by each candidate awakening equipment;
and determining the equipment corresponding to the target information as target awakening equipment.
5. The method of claim 3, further comprising:
if the target awakening equipment is the first equipment, awakening response is carried out;
and if the target awakening device is not the first device, sending an awakening message to the target awakening device, so that the target awakening device carries out awakening response after receiving the awakening message.
6. The method of claim 3, further comprising:
if the target awakening equipment is the first equipment, awakening response is carried out;
and if the target awakening equipment is not the first equipment, continuously keeping the dormant state.
7. The method of claim 6, further comprising:
when detecting that the microphone state of the second device changes, sending the current microphone state of the second device to the second device, so that the second device receiving the voice signal determines whether the first device is a candidate awakening device according to the current microphone state of the first device when determining whether to awaken the second device.
8. The method of claim 3, wherein prior to the step of detecting whether the second device with voice interaction functionality is present in the same local area network, the method further comprises:
detecting whether the voice signal contains a preset awakening word or not;
and under the condition that the voice signal contains the preset awakening word, executing the step of detecting whether a second device with a voice interaction function exists in the same local area network.
9. The method of claim 3, further comprising:
and responding to the detection result that the second equipment is not detected, and performing awakening response.
10. The method of claim 1 or 2, wherein determining the candidate wake-up device from the second device according to the microphone state of the second device comprises:
and determining the second equipment with the microphone in the on state as candidate awakening equipment.
11. A wake-up control device applied to a first device with a voice interaction function, comprising:
the detection module is configured to respond to the received voice signal and detect whether a second device with a voice interaction function exists in the same local area network;
a first determining module, configured to, in response to the detection module detecting the detection result of the second device, obtain a microphone state of the second device, and determine a candidate wake-up device from the second device according to the microphone state of the second device;
a second determining module, configured to determine a target wake-up device at least according to received first information sent by the candidate wake-up device determined by the first determining module, where the target wake-up device is configured to perform a wake-up response, and the first information is used to characterize a distance between the candidate wake-up device and a sound source of the voice signal.
12. A wake-up control apparatus, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
responding to the received voice signal, and detecting whether a second device with a voice interaction function exists in the same local area network;
responding to the detection result of the second equipment, acquiring the microphone state of the second equipment, and determining candidate awakening equipment from the second equipment according to the microphone state of the second equipment;
and determining target awakening equipment at least according to received first information sent by the candidate awakening equipment, wherein the target awakening equipment is used for carrying out awakening response, and the first information is used for representing the distance between the candidate awakening equipment and the sound source of the voice signal.
13. A computer-readable storage medium, on which computer program instructions are stored, which program instructions, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011128066.0A CN112037787A (en) | 2020-10-20 | 2020-10-20 | Wake-up control method, device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011128066.0A CN112037787A (en) | 2020-10-20 | 2020-10-20 | Wake-up control method, device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112037787A true CN112037787A (en) | 2020-12-04 |
Family
ID=73573110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011128066.0A Pending CN112037787A (en) | 2020-10-20 | 2020-10-20 | Wake-up control method, device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112037787A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112750433A (en) * | 2020-12-09 | 2021-05-04 | 珠海格力电器股份有限公司 | Voice control method and device |
| CN113096658A (en) * | 2021-03-31 | 2021-07-09 | 歌尔股份有限公司 | Terminal equipment, awakening method and device thereof and computer readable storage medium |
| CN113689857A (en) * | 2021-08-20 | 2021-11-23 | 北京小米移动软件有限公司 | Voice collaborative awakening method and device, electronic equipment and storage medium |
| CN113891440A (en) * | 2021-10-21 | 2022-01-04 | 北京小米移动软件有限公司 | Equipment response control method, equipment response control device and storage medium |
| CN115242571A (en) * | 2021-04-25 | 2022-10-25 | 佛山市顺德区美的电热电器制造有限公司 | Distributed voice interaction method and device, readable storage medium and household appliance |
| WO2022252938A1 (en) * | 2021-05-31 | 2022-12-08 | 华为技术有限公司 | Voice interactive response method and electronic device |
| WO2023231894A1 (en) * | 2022-05-31 | 2023-12-07 | 四川虹美智能科技有限公司 | Wake-up method, apparatus and system based on collaborative error correction, and medium and device |
| EP4345581A1 (en) * | 2022-09-28 | 2024-04-03 | Nokia Technologies Oy | Apparatus, methods, and computer programs for controlling devices |
| CN113689857B (en) * | 2021-08-20 | 2024-04-26 | 北京小米移动软件有限公司 | Voice collaborative wake-up method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109391528A (en) * | 2018-08-31 | 2019-02-26 | 百度在线网络技术（北京）有限公司 | Awakening method, device, equipment and the storage medium of speech-sound intelligent equipment |
| CN110085233A (en) * | 2019-04-08 | 2019-08-02 | 广东美的制冷设备有限公司 | Sound control method and its device, electronic equipment and computer readable storage medium |
| CN110211580A (en) * | 2019-05-15 | 2019-09-06 | 海尔优家智能科技（北京）有限公司 | More smart machine answer methods, device, system and storage medium |
| CN110223684A (en) * | 2019-05-16 | 2019-09-10 | 华为技术有限公司 | A kind of voice awakening method and equipment |
-
2020
- 2020-10-20 CN CN202011128066.0A patent/CN112037787A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109391528A (en) * | 2018-08-31 | 2019-02-26 | 百度在线网络技术（北京）有限公司 | Awakening method, device, equipment and the storage medium of speech-sound intelligent equipment |
| CN110085233A (en) * | 2019-04-08 | 2019-08-02 | 广东美的制冷设备有限公司 | Sound control method and its device, electronic equipment and computer readable storage medium |
| CN110211580A (en) * | 2019-05-15 | 2019-09-06 | 海尔优家智能科技（北京）有限公司 | More smart machine answer methods, device, system and storage medium |
| CN110223684A (en) * | 2019-05-16 | 2019-09-10 | 华为技术有限公司 | A kind of voice awakening method and equipment |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112750433A (en) * | 2020-12-09 | 2021-05-04 | 珠海格力电器股份有限公司 | Voice control method and device |
| CN112750433B (en) * | 2020-12-09 | 2021-11-23 | 珠海格力电器股份有限公司 | Voice control method and device |
| CN113096658A (en) * | 2021-03-31 | 2021-07-09 | 歌尔股份有限公司 | Terminal equipment, awakening method and device thereof and computer readable storage medium |
| CN115242571A (en) * | 2021-04-25 | 2022-10-25 | 佛山市顺德区美的电热电器制造有限公司 | Distributed voice interaction method and device, readable storage medium and household appliance |
| WO2022252938A1 (en) * | 2021-05-31 | 2022-12-08 | 华为技术有限公司 | Voice interactive response method and electronic device |
| CN113689857A (en) * | 2021-08-20 | 2021-11-23 | 北京小米移动软件有限公司 | Voice collaborative awakening method and device, electronic equipment and storage medium |
| CN113689857B (en) * | 2021-08-20 | 2024-04-26 | 北京小米移动软件有限公司 | Voice collaborative wake-up method and device, electronic equipment and storage medium |
| CN113891440A (en) * | 2021-10-21 | 2022-01-04 | 北京小米移动软件有限公司 | Equipment response control method, equipment response control device and storage medium |
| CN113891440B (en) * | 2021-10-21 | 2024-04-09 | 北京小米移动软件有限公司 | Device response control method, device response control apparatus, and storage medium |
| WO2023231894A1 (en) * | 2022-05-31 | 2023-12-07 | 四川虹美智能科技有限公司 | Wake-up method, apparatus and system based on collaborative error correction, and medium and device |
| EP4345581A1 (en) * | 2022-09-28 | 2024-04-03 | Nokia Technologies Oy | Apparatus, methods, and computer programs for controlling devices |
| WO2024068154A1 (en) * | 2022-09-28 | 2024-04-04 | Nokia Technologies Oy | Apparatus, methods, and computer programs for controlling devices |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112037787A (en) | Wake-up control method, device and computer readable storage medium | |
| CN105050115B (en) | Method and device for waking up MCU | |
| KR101837333B1 (en) | Method and apparatus for awakening electronic device | |
| CN110233934B (en) | Electronic equipment control method and device and computer readable storage medium | |
| CN107204883B (en) | Network fault processing method and device | |
| US10088889B2 (en) | Method and device for waking up a controller | |
| RU2632319C2 (en) | Methods and apparatus for controlling wireless access point | |
| CN107919124B (en) | Equipment awakening method and device | |
| CN108810866B (en) | Method and device for connecting intelligent equipment and storage medium | |
| CN110262692B (en) | Touch screen scanning method, device and medium | |
| CN106507282B (en) | Wireless connection control method and device | |
| US20210307104A1 (en) | Method and apparatus for controlling intelligent voice control device and storage medium | |
| CN112201242A (en) | Method and device for waking up equipment, electronic equipment and storage medium | |
| CN109522058B (en) | Wake-up method, device, terminal and storage medium | |
| CN105227426B (en) | Application interface switching method and device and terminal equipment | |
| CN113361305B (en) | Fingerprint acquisition method, electronic device and computer readable storage medium | |
| CN106506808B (en) | Method and device for prompting communication message | |
| CN105786561B (en) | Method and device for calling process | |
| CN111857849A (en) | Wake-up processing method and device, electronic equipment and storage medium | |
| CN111966412A (en) | Method, device and storage medium for waking up terminal | |
| CN108874450B (en) | Method and device for waking up voice assistant | |
| CN107948876B (en) | Method, device and medium for controlling sound box equipment | |
| CN107677363B (en) | Noise prompting method and intelligent terminal | |
| CN107979695B (en) | Network message receiving method and device and storage medium | |
| CN110928589A (en) | Information processing method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |