CN116524919A - Equipment awakening method, related device and communication system - Google Patents

Abstract

The application provides a device wake-up method, a related device and a communication system. The plurality of voice wake-up devices may detect whether the collected sound contains a pre-wake-up word. The pre-wake word is part of the wake word. When the pre-wake-up word is detected, the multiple voice wake-up devices can negotiate and determine the response device according to the audio energy of the pre-wake-up word corresponding to the pre-wake-up word. The answering device may enter an awake state after detecting the wake word, responding to the user. The method can start negotiating to determine the response equipment when the user does not speak the wake-up word yet, and the response equipment enters the wake-up state after detecting the wake-up word. The method can improve the response speed of the voice awakening device after detecting the awakening word under the condition of not reducing the awakening rate in the scene of a plurality of voice awakening devices.

Description

Equipment wake-up method, related device and communication system

technical field

The present application relates to the technical field of terminals, and in particular to a method for waking up a device, a related device and a communication system.

Background technique

With the development of electronic devices such as mobile phones, tablet computers, and smart home devices, more and more electronic devices have voice wake-up capabilities. An electronic device with a voice wake-up capability can enter a wake-up state after detecting a wake-up voice, recognize a user's voice command, and perform an operation corresponding to the voice command. The wake-up voice is a voice containing a wake-up word.

However, in a scenario where there are multiple electronic devices capable of waking up by voice, and the wake-up words used to wake up the multiple electronic devices are the same, the multiple electronic devices need to negotiate after detecting the wake-up voice, and determine one electronic device as the An answering device to respond to the user's voice commands. The above-mentioned negotiation process takes time, which makes the response speed of the electronic devices slow and the user experience poor when there are multiple electronic devices capable of waking up by voice in the environment.

Contents of the invention

The present application provides a device wake-up method, a related device and a communication system. In the device wake-up method provided by this application, after the electronic device detects the pre-wake-up voice containing the pre-wake-up word, the energy of the pre-wake-up audio determined by itself and other electronic devices after detecting the pre-wake-up voice containing the pre-wake-up word Determine the audio energy to determine which device is responding. The above-mentioned pre-wake-up word may be a part of the wake-up word. When the wake-up voice containing the wake-up word is detected, the above-mentioned determined answering device may respond to the user. The above method can advance the process of negotiating among multiple electronic devices with the same wake-up word to determine the answering device, thereby reducing the time for the user to wait for the electronic device to respond after speaking the wake-up word. This can improve the response speed of the electronic device after detecting the wake-up voice, and improve user experience.

In a first aspect, the present application provides a method for waking up a device. Wherein, the first electronic device may detect the first pre-wake-up voice containing the pre-wake-up word, and obtain the first audio energy according to the first pre-wake-up voice. The first electronic device can receive M audio energies sent by M electronic devices, one of the M audio energies is obtained by one of the M electronic devices based on the detected pre-wake-up voice containing the pre-wake-up word , M is a positive integer. The first electronic device may determine that the first electronic device is the responding device according to the first audio energy and the M audio energies. When the first wake-up voice containing the wake-up word is detected, the first application in the first electronic device may enter a wake-up state. Wherein, the pre-wake-up word is a part of the wake-up word, and the first application is used to detect and respond to voice commands in the wake-up state to perform operations corresponding to the voice commands.

Wherein, the wake-up words of the first electronic device and the M electronic devices are the same. The above-mentioned first pre-wake-up voice for determining the first audio energy and the pre-wake-up voice for determining M audio energies may be detected by the first electronic device and the M electronic devices based on a pre-wake-up word spoken by the user of.

The aforementioned first audio energy may be the largest of the first audio energy and the M audio energies. It can be understood that the greater the audio energy determined by the electronic device according to the detected pre-awakening voice, the closer the electronic device is to the user. In the above process of negotiating and determining the answering device, the electronic device closest to the user may be selected to respond to the wake-up word and/or voice command spoken by the user.

In some embodiments, the first electronic device may also combine the first audio energy, the M audio energies and the device information of each electronic device (such as device type, device usage, etc.) frequency, device capabilities, etc.) to identify the responding device. For example, when it is determined that there are multiple first audio energies and the largest audio energy among the M audio energies, the first electronic device may compare device capabilities of the electronic devices corresponding to the multiple largest audio energies to determine the answering device. The above-mentioned device capability may be, for example, a sound effect of a microphone. The first electronic device may select an electronic device with the best sound effect from the plurality of electronic devices corresponding to the largest audio energy as the answering device.

In some embodiments, the above-mentioned wake-up word may contain multiple syllables. The syllables contained in the above pre-awakening words may be intercepted from the awakening words. For example, the syllables contained in the pre-wake-up word may be the first few syllables of the wake-up word.

It can be seen that the above method can determine the timing for starting the above negotiation process by detecting the pre-awakening voice. The above-mentioned pre-awakening voice may be a voice containing a pre-awakening word. The first electronic device and other voice wake-up devices may start to negotiate to determine the answering device before the user finishes speaking the wake-up words. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the voice wake-up device after detecting the wake-up voice, but also the responding device responds after the wake-up voice is detected, without affecting the wake-up rate. This can effectively improve the user experience of voice wake-up in a scenario where there are multiple voice wake-up devices with the same wake-up word.

With reference to the first aspect, in some embodiments, after the first electronic device detects the first pre-wake-up voice containing the pre-wake-up word, when it is detected that the collected sound does not contain the wake-up word, the first electronic device in the first electronic device Apps don't have to go into the awake state. That is to say, after detecting the pre-awakening voice, the first electronic device may start to negotiate with the M electronic devices to determine the answering device. When the wake-up voice containing the wake-up word is not detected, even if it is determined that the answering device is the first electronic device, the first application in the first electronic device may not respond to the user.

The above method can reduce the probability of false wake-up and improve the user experience of the voice control device.

Wherein, the first application in the first electronic device enters the wake-up state, which may mean that the first electronic device invokes an application program of the first application. When the first application in the first electronic device is in the wake-up state, the program run by the first electronic device includes the process of the first application. In the aforementioned wake-up state, the first electronic device can detect and recognize voice commands through the first application, and perform operations corresponding to the voice commands.

The fact that the first application in the first electronic device does not enter the wake-up state may mean that the programs run by the first electronic device do not include the process of the first application. Alternatively, the fact that the first application in the first electronic device does not enter the wake-up state may mean that the program running on the first electronic device includes the process of the first application, but the first application does not respond to the user. That is to say, when the first application is not in the wake-up state, the first electronic device will not respond to the wake-up word and/or voice command spoken by the user. It can be understood that, in other electronic devices including the first application in this application, the situation that the first application enters the wake-up state may refer to the above-mentioned situation that the first application enters the wake-up state in the first electronic device. For other situations in which the first application in the electronic device containing the first application does not enter the wake-up state, reference may be made to the above-mentioned situation in which the first application in the first electronic device does not enter the wake-up state.

With reference to the first aspect, in some embodiments, the first electronic device may detect the second pre-wake-up voice containing the pre-wake-up word, and obtain the second audio energy according to the second pre-wake-up voice. The first electronic device can receive K audio energies sent by K electronic devices, one of the K audio energies is obtained by one of the K electronic devices based on the detected pre-wake-up voice containing the pre-wake-up word , K is a positive integer. The first electronic device may determine, according to the second audio energy and the K audio energies, that the second electronic device among the K electronic devices is the responding device. In a case where it is determined that the second electronic device is the device that responds, the first application in the first electronic device may not enter the wake-up state.

Wherein, the wake-up words of the first electronic device and the K electronic devices are the same. The above-mentioned second pre-awakening voice used to determine the second audio energy and the pre-awakened voice used to determine the K audio energies may be detected by the first electronic device and the K electronic devices based on a sentence of pre-awakened words spoken by the user of.

It can be seen that the above method can determine the timing for starting the above negotiation process by detecting the pre-awakening voice. The above-mentioned pre-awakening voice may be a voice containing a pre-awakening word. The first electronic device and other voice wake-up devices may start to negotiate to determine the answering device before the user finishes speaking the wake-up words. When it is determined that the answering device is not the first electronic device, the first application in the first electronic device may not enter the wake-up state. In this way, it can be ensured that only after the answering device detects the wake-up voice, the first application of the answering device enters the wake-up state. The above method can reduce the probability of false wake-up, and prevent multiple electronic devices from responding to the user after detecting the wake-up voice, thereby causing interference to the user.

With reference to the first aspect, in some embodiments, when it is determined that the second electronic device is the responding device, the first electronic device may send a first message to the second electronic device, the first message includes the first result, and the second electronic device may send a first message to the second electronic device. A result is used to indicate that the second electronic device is the device that responds, and the first message is used to indicate that the second electronic device causes the first application in the second electronic device to enter the wake-up state after detecting the wake-up voice containing the wake-up word.

With reference to the first aspect, in some embodiments, after obtaining the first audio energy according to the first pre-wake-up voice, the first electronic device may further send the first audio energy to the M electronic devices. Wherein, the above M electronic devices may also notify each other of the audio energy determined according to the detected pre-awakening voice.

It can be seen that in the scenario where there are multiple electronic devices with the same wake-up word, the negotiation process of these multiple electronic devices after detecting the pre-wake-up voice can be: one electronic device (such as the first electronic device) determines the response equipment. The other electronic devices may send the audio energy determined according to the detected pre-wake-up voice to the first electronic device. The first electronic device may send the determination result of the answering device to other electronic devices. Alternatively, the negotiation process of the multiple electronic devices after detecting the pre-wake-up voice may be: the multiple electronic devices may notify each other of audio energy determined according to the detected pre-wake-up voice. Each of the plurality of electronic devices can determine an answering device. When it is determined that it is the answering device, the electronic device may enter a wake-up state after detecting the wake-up voice. When it is determined that it is not the answering device, the electronic device may not enter the wake-up state after detecting the wake-up voice.

In some embodiments, the negotiation process of the multiple electronic devices after detecting the pre-wake-up voice may be: the multiple electronic devices may send audio energy determined according to the detected pre-wake-up voice to a master device. The master device may not be one of the multiple electronic devices with the same wakeup word. This master device can also be a cloud server. The master device can determine the answering device, and send the determination result of the answering device to the plurality of electronic devices. Alternatively, the master device may only transmit the determination result of the answering device to the answering device.

With reference to the first aspect, in some embodiments, the first electronic device may collect the first sound, and the first sound does not contain the pre-wake-up word. The first electronic device can obtain the third audio energy according to the first sound. The first electronic device obtains fourth audio energy according to the first pre-wake-up voice. The first electronic device may subtract the third audio energy from the fourth audio energy to obtain the first audio energy. Wherein, the above-mentioned first sound may be collected by the first electronic device within a preset time range when the above-mentioned first pre-wake-up voice is detected. It can be understood that the above-mentioned first pre-wake-up voice usually includes environmental noise. Then, the above-mentioned four-tone energy includes energy generated by environmental noise. The first sound collected by the first electronic device within the preset time range of detecting the pre-awakening voice is close to the environmental noise contained in the first pre-awakening voice. The first electronic device may use the above-mentioned third audio energy to reduce energy generated by environmental noise in the first audio energy.

The above M electronic devices may also reduce the energy generated by the wake-up noise in the audio energy obtained according to the detected pre-wake-up voice. For a specific method, reference may be made to a method for the first electronic device to reduce energy generated by environmental noise in the first audio energy.

It can be seen that, in the above process of negotiating and determining the answering device, the first electronic device and the M electronic devices can remove the audio energy generated by the environmental noise in the audio energy determined by the pre-awakening voice. This can reduce the influence of environmental noise on the determination of the answering device, and improve the accuracy of the determination result of the answering device. By reducing the audio energy affected by the environmental noise, the first electronic device and the M electronic devices can start negotiating to determine the answering device before the user finishes speaking the wake-up word. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the answering device after detecting the wake-up voice, but also the above-mentioned answering device responds only when the wake-up voice is detected, which will not affect the wake-up rate. This can effectively improve the user experience of using the voice wake-up function in a scenario where there are multiple electronic devices with the same wake-up word.

In a second aspect, the present application provides a method for waking up a device. The method can be applied to a voice wake-up system. The voice wake-up system includes H electronic devices, the H electronic devices include the first electronic device, and H is a positive integer greater than 1. The first electronic device detects a first pre-wake-up voice containing a pre-wake-up word, and obtains first audio energy according to the first pre-wake-up voice. H1 electronic devices among the H electronic devices send H1 audio energies to the first electronic device, H1 electronic devices do not contain the first electronic device, one audio energy of the H1 audio energies is, one electronic device among the H1 electronic devices It is obtained by the device based on the detected pre-wake-up voice containing the pre-wake-up word; H1 is a positive integer smaller than H. The first electronic device determines, according to the first audio energy and the H1 audio energy, that the first electronic device is a device that responds. When the first wake-up voice containing the wake-up word is detected, the first application in the first electronic device enters a wake-up state. Wherein, the pre-wake-up word is a part of the wake-up word, and the first application is used to detect and respond to voice commands in the wake-up state to perform operations corresponding to the voice commands.

It can be seen that the above method can determine the timing for starting the above negotiation process by detecting the pre-awakening voice. The above-mentioned pre-awakening voice may be a voice containing a pre-awakening word. The first electronic device and other voice wake-up devices may start to negotiate to determine the answering device before the user finishes speaking the wake-up words. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the voice wake-up device after detecting the wake-up voice, but also the responding device responds after the wake-up voice is detected, without affecting the wake-up rate. This can effectively improve the user experience of voice wake-up in a scenario where there are multiple voice wake-up devices with the same wake-up word.

With reference to the second aspect, in some embodiments, the first application in each of the H1 electronic devices does not enter the wake-up state.

It can be seen that, when the first electronic device is determined to be the answering device, the first applications in other electronic devices in the voice wake-up system except the first electronic device may not enter the wake-up state. This can reduce the probability of false wake-up, and prevent multiple electronic devices from responding to the user after detecting the wake-up voice, thereby causing interference to the user.

With reference to the second aspect, in some embodiments, after the first electronic device detects the first pre-wake-up voice containing the pre-wake-up word, when it is detected that the collected sound does not contain the wake-up word, the first electronic device in the first electronic device The application does not enter the wake state.

It can be seen that, when the wake-up voice containing the wake-up word is not detected, even if the answering device is determined to be the first electronic device, the first application in the first electronic device may not respond to the user. This can reduce the probability of false wake-up and improve the user experience of voice-controlled devices.

With reference to the second aspect, in some embodiments, the first electronic device detects the second pre-wake-up voice containing the pre-wake-up word, and obtains the second audio energy according to the second pre-wake-up voice. H2 electronic devices in the H electronic devices send H2 audio energies to the first electronic device, the H2 electronic devices do not contain the first electronic device, one audio energy in the H2 audio energies is, and one electronic device in the H2 electronic devices It is obtained by the device based on the detected pre-wake-up voice containing the pre-wake-up word; H2 is a positive integer smaller than H. The first electronic device determines, according to the second audio energy and the H2 audio energies, that the second electronic device among the H2 electronic devices is the responding device. When the second wake-up voice containing the wake-up word is detected, the first application in the second electronic device enters the wake-up state, and the first application in the first electronic device and each of the electronic devices in (H2-1) electronic devices None of the first applications enters the wake-up state, wherein the (H2-1) electronic devices are devices except the second electronic device among the H2 electronic devices.

With reference to the second aspect, in some embodiments, the first electronic device may send a first message to the second electronic device after determining that the second electronic device is the responding device, the first message includes the first result, and the first result Used to indicate that the second electronic device is the answering device. Based on the first message, when the second wake-up voice is detected, the first application in the second electronic device enters into a wake-up state.

With reference to the second aspect, in some embodiments, the first electronic device sends the second audio energy to the second electronic device. The (H2-1) electronic device sends (H2-1) audio energy to the second electronic device, and the (H2-1) audio energy is the audio energy obtained by the (H2-1) electronic device in the H2 audio energy . The second electronic device determines the second electronic device based on the second audio energy, (H2-1) audio energy, and the fifth audio energy obtained by the second electronic device based on the detected third pre-wake-up voice containing the pre-wake-up word For the responding device, the fifth audio energy is included in the H2 audio energy.

With reference to the second aspect, in some embodiments, the first electronic device collects the first sound, and the first sound does not contain the pre-wake-up word. The first electronic device obtains the third audio energy according to the first sound. The first electronic device obtains fourth audio energy according to the first pre-wake-up voice. The first electronic device subtracts the third audio energy from the fourth audio energy to obtain the first audio energy.

It can be seen that, in the above process of negotiating and determining the answering device, the electronic device contained in the voice wake-up system can remove the audio energy generated by the environmental noise in the audio energy determined by the pre-wake-up voice. This can reduce the influence of environmental noise on the determination of the answering device, and improve the accuracy of the determination result of the answering device. By reducing the audio energy affected by environmental noise, the electronic device included in the voice wake-up system can start to negotiate and determine the answering device before the user has finished speaking the wake-up word. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the answering device after detecting the wake-up voice, but also the above-mentioned answering device responds only when the wake-up voice is detected, which will not affect the wake-up rate. This can effectively improve the user experience of using the voice wake-up function in a scenario where there are multiple electronic devices with the same wake-up word.

In a third aspect, the present application provides an electronic device, which may include a microphone, a communication device, a memory, and a processor, wherein the microphone may be used to collect sound, the memory may be used to store computer programs, and the processor may be used to call The computer program enables the electronic device to execute any possible implementation method in the first aspect.

In a fourth aspect, the present application provides a computer-readable storage medium, including instructions. When the instructions are run on an electronic device, the electronic device executes any possible implementation method in the first aspect.

In a fifth aspect, the present application provides a computer program product. The computer program product may include computer instructions. When the computer instructions are run on an electronic device, the electronic device executes any possible implementation method in the first aspect.

In a sixth aspect, the present application provides a chip, the chip is applied to an electronic device, the chip includes one or more processors, and the processor is used to invoke computer instructions to make the electronic device perform any possible Implementation.

It can be understood that the electronic device provided in the third aspect, the computer-readable storage medium provided in the fourth aspect, the computer program product provided in the fifth aspect, and the chip provided in the sixth aspect are all used to execute the method. Therefore, the beneficial effects that it can achieve can refer to the beneficial effects in the corresponding method, and will not be repeated here.

Description of drawings

FIG. 1 is a schematic diagram of the distribution of a voice wake-up device provided in an embodiment of the present application;

Fig. 2 is a schematic diagram of the time distribution from the user uttering the wake-up word to the voice wake-up device determining the answering device provided by the embodiment of the present application;

FIG. 3A is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application;

FIG. 3B is a software structural block diagram of the electronic device 100 provided by the embodiment of the present application;

FIG. 4 is a schematic structural diagram of a voice wake-up device 10 provided in an embodiment of the present application;

FIG. 5 is a flow chart of a method for waking up a device provided in an embodiment of the present application;

Fig. 6 is another schematic diagram of the time distribution from the user uttering the wake-up word to the voice wake-up device determining the answering device provided by the embodiment of the present application;

FIG. 7 is a flow chart of another method for waking up a device provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a master device 200 provided in an embodiment of the present application;

FIG. 9 is a flow chart of another method for waking up a device provided by an embodiment of the present application;

Fig. 10 is a schematic diagram of a voice wake-up system provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application are described below with reference to the drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to limit the present application. As used in the specification and appended claims of this application, the singular expressions "a", "the", "above", "the" and "this" are intended to also include, for example, "a or more" unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of the present application, "at least one" and "one or more" refer to one or more than two (including two). The term "and/or" is used to describe the association relationship of associated objects, indicating that there may be three types of relationships; for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists alone, Wherein A and B can be singular or plural. The character "/" generally indicates that the contextual objects are an "or" relationship.

Reference to "one embodiment" or "some embodiments" or the like in this specification means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically stated otherwise. The terms "including", "comprising", "having" and variations thereof mean "including but not limited to", unless specifically stated otherwise. The term "connected" includes both direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only, and should not be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.

In the embodiments of the present application, words such as "exemplarily" or "for example" are used as examples, illustrations or descriptions. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a concrete manner.

At present, many electronic devices, such as mobile phones, tablet computers, speakers, televisions, etc., have a voice wake-up capability. The aforementioned electronic device with voice wake-up capability may be called a voice wake-up device. An application program (Application, APP) for voice recognition, such as a voice assistant APP, may be installed in the above-mentioned voice wake-up device. Wherein, when the voice wake-up function is turned on, the voice wake-up device can collect the sound in the environment in real time, and detect whether the sound contains a wake-up word (that is, detect whether there is a wake-up voice). When the wake-up word is detected, the voice wake-up device can be woken up and enter the wake-up state. In a possible implementation method, the wake-up of the voice wake-up device may more specifically be that the voice assistant APP in the voice wake-up device is woken up. That is to say, the above-mentioned wake-up state may represent a state in which the voice assistant APP in the voice wake-up device is woken up.

In some embodiments, after the voice assistant APP is woken up, it may respond to the wake-up word spoken by the user. The response may be a voice response. For example, after the user speaks the wake word, a voice-wake device can voice-answer "I'm here." In some embodiments, after the voice assistant APP is woken up, it can recognize the voice command in the sound collected by the voice wake-up device, and execute the operation corresponding to the voice command.

It can be seen that the above wake-up word can be used to wake up the voice assistant APP in the voice wake-up device. In order to ensure the wake-up rate of the voice wake-up device being woken up, the wake-up word usually has multiple syllables. For example, the wake word "Xiaoyi Xiaoyi" has four syllables. The wake word "heySiri" has three syllables. Compared with the single-syllable wake-up word, the wake-up word with multiple syllables can effectively improve the wake-up rate of the voice wake-up device. For example, if the wake word is "hey", the wake word has only one syllable. Users may often say "hey" in their daily life, but the purpose is not to wake up the voice wake device. This may cause the voice wake-up device to be awakened by mistake. In addition, in order to facilitate the user to say the wake-up word, the wake-up word should not be too complicated and contain too many syllables. Exemplarily, the wake-up word may contain 4-6 syllables. This can not only ensure the wake-up rate of the wake-up voice to wake up the device, but also facilitate the user to say the wake-up word. The embodiment of the present application does not limit the number of syllables of the wake-up word. In the following embodiments, the wake-up word "Xiaoyi Xiaoyi" containing multiple syllables is used as an example for illustration.

The method is not limited to waking up the above-mentioned voice assistant APP, and the above-mentioned wake-up word can also be used to wake up other modules or other APPs in the voice-activated device. In the subsequent embodiments of the present application, the specific example of waking up the voice assistant APP will be described.

With the development of electronic devices, a family (or other environments, such as offices, etc.) may be equipped with multiple voice wake-up devices.

Please refer to FIG. 1 , which exemplarily shows the distribution of voice wake-up devices in a user's home.

As shown in FIG. 1 , a voice wake-up device 10 , a voice wake-up device 11 , and a voice wake-up device 12 are arranged in the living room. The master bedroom is equipped with a voice wake-up device 13 and a voice wake-up device 14 . A voice wake-up device 15 is configured in the second bedroom. The wake-up words used to wake up the voice wake-up devices 10-15 may be the same. For example, the wake word is "Xiaoyi Xiaoyi".

In a possible implementation method, multiple voice wake-up devices with the same wake-up word configured in a family can form a voice wake-up system. Wherein, a voice wake-up device included in the voice wake-up system can detect other voice wake-up devices included in the voice wake-up system, and communicate with other voice wake-up devices. The method for communicating with each voice wake-up device included in the voice wake-up system may be, for example, Bluetooth communication, wireless fidelity (wirelessfidelity, Wi-Fi) communication, and the like. This embodiment of the present application does not limit it.

For example, there is a voice wake-up system A in the family shown in FIG. 1 . The voice wake-up system A includes the above-mentioned voice wake-up devices 10-15. The voice wake-up devices 10-15 can communicate with each other and perceive each other's status (such as the activation status of the voice wake-up function, working status, etc.). Not limited to the voice wake-up devices 10-15, the voice wake-up system A may also include more or less voice wake-up devices.

The embodiment of the present application does not limit the implementation manner of establishing the above-mentioned voice wake-up system A. In a possible implementation method, the voice wake-up system A may be composed of voice wake-up devices located in the same local area network and having the same wake-up word. Specifically, the voice wake-up device 10 is connected to the network through a router. Electronic devices connected to the router can be in the same local area network. The voice wake-up device 10 can detect which electronic devices are voice wake-up devices among the electronic devices in the same local area network as itself, and whether the wake-up word is the same as its own wake-up word. When it is detected that there are voice wake-up devices 11-15 in the local area network, and the wake-up words of the voice wake-up devices 11-15 are the same as its own wake-up words, the voice wake-up device 10 can establish a communication connection with the voice wake-up devices 11-15. Similarly, any one of the voice wake-up devices 11-15 can also discover the existence of other voice wake-up devices in the voice wake-up system A, so as to establish a communication connection with them. In this way, the voice wake-up devices 10-15 can form a voice wake-up system, that is, the voice wake-up system A. Optionally, the voice wake-up system A may also be composed of voice wake-up devices logged in with the same account and with the same wake-up words.

In some embodiments, each voice wake-up device in the voice wake-up system A can detect the existence of the voice wake-up device in the voice wake-up system A every preset time period. For example, voice wake-up devices 10-15 are all in the same local area network. In response to a user operation acting on the voice wake-up device 15 for triggering the voice wake-up device 15 to exit the local area network, the voice wake-up device 15 may exit the local area network. The voice wake-up device 15 can then be removed from the voice wake-up system A. The voice wake-up devices 10 - 14 may determine that the voice wake-up system A no longer includes the voice wake-up device 15 .

In some embodiments, each voice wake-up device in the voice wake-up system A can detect the activation status of the voice wake-up function of the voice wake-up device in the voice wake-up system A every preset time period. For example, in response to a user operation acting on the voice wake-up device 15 for triggering the voice wake-up device 15 to disable the voice wake-up function, the voice wake-up device 15 may disable the voice wake-up function. When receiving a message from other voice wake-up devices asking whether the voice wake-up function is turned on, the voice wake-up device 15 may send a reply message indicating that the voice wake-up function is turned off. In this way, the voice wake-up devices 10-14 can determine that the voice wake-up function in the voice wake-up device 15 is disabled.

The embodiment of the present application does not limit the foregoing preset time period. Wherein, each voice wake-up device in the voice wake-up system A can regularly or irregularly detect the existence of the voice wake-up device in the voice wake-up system A, the activation status of the voice wake-up function in the voice wake-up device, and the like.

The following introduces a method for waking up the voice wake-up device when there are multiple voice wake-up devices with the same wake-up word.

In a possible implementation method, when there are multiple voice wake-up devices with the same wake-up word, the multiple voice wake-up devices can negotiate after detecting the wake-up voice, and select a voice wake-up device closest to the user as a response equipment. The above-mentioned answering device can enter the wake-up state, and the voice assistant APP in the answering device can be woken up to respond to the user. Other voice wake-up devices other than the answering device will not enter the wake-up state. In this way, one voice wake-up device among the multiple voice wake-up devices can execute the user's voice command, so as to avoid the situation that after the user speaks the wake-up word, multiple voice wake-up devices respond, causing trouble to the user.

Specifically, when the user speaks a wake-up word, the voice wake-up devices 10-15 in the voice wake-up system A shown in FIG. 1 all detect the wake-up voice. The aforementioned detection of the wake-up voice may indicate that the voice wake-up device detects a wake-up word from the collected sound. Wherein, when the voice wake-up device 10 detects the wake-up voice, the voice wake-up device 10 can determine the audio energy of the wake-up word corresponding to the audio containing the wake-up word according to the audio obtained by the voice collected by the voice wake-up device 10 . The voice wake-up device 10 may send the audio energy of the wake-up word determined by itself to other voice wake-up devices in the voice wake-up system A, and receive the audio energy of the wake-up word determined by other voice wake-up devices in the voice wake-up system A. That is to say, after the voice wake-up devices 10-15 detect the wake-up voice, they can notify each other of the audio energy of the wake-up word determined by themselves. Optionally, when it is determined that there is a voice wake-up device with the voice wake-up function disabled in the voice wake-up system A, the voice wake-up device 10 may not send the wake-up word audio energy determined by itself to the voice wake-up device with the voice wake-up function disabled.

The audio energy of the wake-up word may be a sound intensity or a sound pressure of the audio containing the wake-up word. The embodiment of the present application does not limit the method for calculating the audio energy of the wake word. It can be understood that the closer the voice wake-up device is to the user, the shorter the time it takes for the voice of the user to speak the wake-up word to reach the voice wake-up device, and the voice wake-up device can detect the wake-up voice faster. Moreover, since the sound will gradually attenuate during transmission, the closer the voice wake-up device is to the user, the greater the audio energy of the wake-up word determined by the voice wake-up device. Each voice wake-up device in the voice wake-up system A can compare the audio energy of the wake-up word determined by each voice wake-up device to determine the voice wake-up device that responds.

Since the wake-up word audio energy determined by each voice wake-up device in the voice wake-up system A needs to be used to determine the answering device, the voice wake-up device 10 usually needs to wait for the wake-up word audio energy sent by other voice wake-up devices in the voice wake-up system A. In this way, the situation of waking up the device by voice can be reduced, and the accuracy rate of the determination result of the answering device can be improved.

In some embodiments, the voice wake-up device 10 may estimate which voice wake-up devices should wait for the audio energy of the wake-up word according to the number of voice wake-up devices existing in the voice wake-up system A and whose voice wake-up function is turned on. When the voice wake-up device 10 receives the wake-up word audio energy (such as the wake-up word audio energy sent by the voice wake-up devices 11-14) sent by the voice wake-up device with all voice wake-up functions enabled in the voice wake-up system A except itself, the voice The wake-up device 10 may determine the voice wake-up device that responds according to the audio energy of the wake-up word determined by itself and other voice wake-up devices. Exemplarily, the voice wake-up device 10 may compare the wake-up word audio energy determined by itself and other voice wake-up devices, and determine the voice wake-up device corresponding to the largest wake-up word audio energy as the answering device. That is, the voice wake-up device corresponding to the largest wake-up word audio energy is the voice wake-up device that responds.

In some other embodiments, the voice wake-up device 10 waits for the wake-up word audio energy sent by other voice wake-up devices in the voice wake-up system A within a preset waiting period. When the waiting time reaches the above-mentioned preset waiting time period, the voice wake-up device 10 has not yet received the wake-up word audio energy sent by the voice wake-up device whose voice wake-up function is enabled in the voice wake-up system A except itself, and the voice wake-up The device 10 may stop waiting, and start to determine the voice wake-up device that responds according to its own wake-up word audio energy and the received wake-up word audio energy of other voice wake-up devices. The voice wake-up devices 11-15 can also determine the voice wake-up device that responds according to the audio energy of the wake-up word. For a specific method, refer to the implementation method of the above-mentioned voice wake-up device 10 determining the voice wake-up device that responds.

Please refer to FIG. 2 . FIG. 2 exemplarily shows a schematic diagram of time distribution from when the user speaks a wake-up word to when the voice wake-up device determines the answering device.

As shown in Figure 2, the user starts to say the wake-up word "Xiaoyi Xiaoyi" from time t11. Understandably, the wake-up word has multiple syllables, and it takes a certain amount of time for the user to speak the wake-up word. Wherein, the user finishes speaking the wake-up word at time t12. That is, the time period from time t11 to time t12 is the time period when the user speaks the wake-up word. When the user speaks a wake-up word, the voice wake-up device 10 in the voice wake-up system A collects a sound containing the wake-up word, and it takes a certain amount of time to detect the wake-up word from the sound. Then, the voice wake-up device 10 detects the wake-up voice at time t13, and time t13 is later than time t12. When a wake-up voice is detected, the voice wake-up device 10 may negotiate with other voice wake-up devices in the voice wake-up system A. Wherein, the time period from time t13 to time t14 is the time period during which the responding device is determined through the negotiation. That is to say, the voice wake-up device in the voice wake-up system A may not determine the answering device until time t14. Then, the voice assistant APP in the answering device is awakened to respond to the user.

It can be known from the above embodiments that the voice wake-up device in the voice wake-up system A needs to start negotiation after detecting the wake-up voice to determine the answering device. During the above negotiation process, a voice wake-up device needs to wait for the audio energy of the wake-up word sent by other voice wake-up devices. Then, when there are more voice wake-up devices in the voice wake-up system A, the above-mentioned negotiation process is more complicated, and the voice wake-up devices may need longer time to wait for the audio energy of the wake-up word determined by other voice wake-up devices. This leads to the more voice wake-up devices, the slower the voice wake-up device responds to the user after the user speaks the wake-up word.

In a possible implementation method, the voice wake-up device may use a wake-up word recognition model with a lower complexity and a smaller calculation load. Then, the voice wake-up device can detect the wake-up word from the collected sound more quickly, so as to start the process of negotiating with other voice wake-up devices and determining the answering device more quickly. This can improve the responsiveness of wake-on-voice devices after detecting a wake-up voice. However, the recognition accuracy rate of the wake-up word recognition model with lower complexity and less computational load will be reduced. That is, using a wake-up word recognition model with less complexity and less computation to detect the wake-up voice will lead to a higher probability of false wake-up of the voice wake-up device. For example, the user speaks a wake-up word, but the voice wake-up device does not detect the wake-up word using the above-mentioned wake-up word recognition model. Or, the user does not say the wake-up word, but the voice wake-up device detects the wake-up word by using the above-mentioned wake-up word recognition model, and enters the wake-up state. Although the above method can improve the response speed of the voice wake-up device after detecting the wake-up voice, the wake-up rate is reduced, and the user experience is still poor.

This application provides a method for waking up a device. Each voice wake-up device in the voice wake-up system can detect whether the collected sound contains a pre-wake-up word. The above-mentioned pre-wake-up word may be a part of the wake-up word. When the pre-wake-up voice is detected, the voice wake-up device can determine the audio energy of the pre-wake-up word corresponding to the audio containing the pre-wake-up word according to the audio obtained by the voice collected by itself. The foregoing detection of the pre-wake-up voice may indicate that the voice wake-up device detects a pre-wake-up word from the collected sound. That is, the pre-wake-up voice is a voice containing a pre-wake-up word. Each voice wake-up device in the voice wake-up system can notify each other of the audio energy of the pre-wake-up word determined by itself, so as to determine a responding device in the voice wake-up system according to the audio energy of the pre-wake-up word. After the answering device detects the wake-up voice, it can enter the wake-up state and respond to the user.

It can be seen that the above method can determine the timing for starting the above negotiation process by detecting the pre-awakening voice. The voice wake-up device can start to negotiate and determine the answering device before the user has finished speaking the wake-up word. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the voice wake-up device after detecting the wake-up voice, but also the responding device responds after the wake-up voice is detected, without affecting the wake-up rate. This can effectively improve the user experience of voice wake-up in a scenario where there are multiple voice wake-up devices with the same wake-up word.

For ease of understanding, some concepts involved in the embodiments of the present application are introduced here.

1. Pre-wake word

The pre-wake word can be part of the wake word. It can be known from the foregoing embodiments that the wake-up word usually has multiple syllables. The voice wake-up device can intercept a part of the wake-up word as a pre-wake-up word. Usually the first few syllables in the wake-up word can be intercepted as the pre-wake-up word. For example, the wake word is "Xiaoyi Xiaoyi". Then the voice wake-up device can use "Xiaoyi" and "Xiaoyixiao" as pre-wake words. For another example, if the wake-up word is "heySiri", then the voice wake-up device can use "hey" as the pre-wake-up word.

It can be understood that when the wake-up voice is detected, the voice wake-up device may determine that the user needs voice interaction, and needs to wake up one of the multiple voice wake-up devices. When the pre-wake-up voice is detected, the voice wake-up device can determine that the user may need to wake up one of multiple voice wake-up devices, and the user may be about to finish speaking a complete wake-up word. Then, when it is determined that the user may need to wake up one of the multiple voice wake-up devices, the multiple voice wake-up devices may start negotiation to select an answering device. After the wake-up voice is detected, the answering device can directly enter the wake-up state to respond to the user. This can effectively improve the response speed after the voice wake-up device detects the wake-up voice.

2. Pre-awakening state

When the pre-wake-up voice is detected, the voice wake-up device can enter the pre-wake-up state. When in the pre-awakening state, the voice-activated device can determine the audio energy of the pre-awakening word corresponding to the audio containing the pre-awakening word according to the audio obtained by the voice collected by itself. The voice wake-up device can also send its own pre-wake-up word audio energy to other voice wake-up devices in the voice wake-up system, and receive the pre-wake-up word audio energy determined by other voice wake-up devices. That is to say, the voice wake-up devices in the voice wake-up system can notify each other of the pre-wake-up word audio energy determined by themselves in the pre-wake-up state, so as to determine a responding device in the voice wake-up system according to the audio energy of the pre-wake-up word.

3. Wake up state

When in the awake state, the voice wake-up device can respond to the user. Specifically, the wake-up state of the voice wake-up device may indicate a state in which the voice assistant APP in the voice wake-up device is woken up. That is, the response of the voice wake-up device to the user may be that the voice assistant APP in the voice wake-up device responds to the user.

When the wake-up voice is detected and the voice command has not been detected, the voice assistant APP can call the audio output module (such as a speaker) of the voice wake-up device, and the voice answers "I am". That is, the voice assistant APP can respond to the wake-up words spoken by the user. The implementation method of the voice assistant APP responding to the wake-up word uttered by the user is not limited in the embodiment of the present application.

The voice assistant APP can perform voice command recognition on the voice that is located after the wake-up word in the collected sound, so as to recognize the voice command spoken by the user. When the voice command is recognized, the voice assistant APP can perform the operation corresponding to the voice command. The above-mentioned voice instruction may be a voice instructing the voice-activated device to complete a specified task. That is, the voice assistant APP can respond to the voice commands spoken by the user. For example, the voice command is "turn on the air conditioner". When the voice instruction is recognized, the voice wake-up device can send an instruction to turn on the air conditioner to turn on the air conditioner. For another example, the voice command is "play music". When the voice command is recognized and the voice-activated device has the ability to play music, the voice-activated device can play music.

The voice wake-up device that responds to the user may be an answering device determined through negotiation in the voice wake-up system.

It should be noted that, when the voice wake-up device detects the wake-up voice and determines that it is the answering device, it can call the voice assistant APP. For example, a voice-activated device can run an application program of a voice assistant APP. That is to say, the voice assistant APP in the voice wake-up device can enter the wake-up state. When the voice assistant APP is in the above-mentioned wake-up state, the program running on the voice wake-up device includes the process of the voice assistant APP. In the above wake-up state, the voice assistant APP can detect and recognize voice commands, and perform operations corresponding to the voice commands.

When the voice wake-up device detects the wake-up voice but determines that it is not the answering device, the voice assistant APP of the voice wake-up device may not enter the wake-up state. For example, the program running on the voice-activated device does not include the process of the voice assistant APP. Alternatively, the program running on the voice-activated device includes the process of the voice assistant APP, but the voice assistant APP does not respond to the user. That is, the voice assistant APP will not respond to the user unless it enters the wake-up state. In addition, when the voice wake-up device determines that it is an answering device (such as determining that it is an answering device according to the detected pre-wake-up voice), but does not detect the wake-up voice, the voice assistant APP of the voice wake-up device may not enter the wake-up state .

It can be understood that, in the scenario where there are multiple voice wake-up devices with the same wake-up word, when the user speaks the wake-up word, the multiple voice wake-up devices detect the pre-wake-up voice, and use the pre-wake-up voice from the multiple voices. Identify an answering device in Wake Devices. Further, when the wake-up voice is detected, the voice assistant APP in the above-mentioned determined answering device can enter the wake-up state, detect and recognize the voice command, and execute the operation corresponding to the voice command. Among the multiple voice wake-up devices mentioned above, the voice assistant APPs in the voice wake-up devices other than the answering device may not enter the wake-up state. This can reduce the trouble caused to the user by the voice assistant APP in multiple voice wake-up devices responding to the user after the user speaks the wake-up word, and improves the user experience of controlling the device by voice.

In order to improve the response speed of the voice wake-up device without affecting the wake-up rate of the voice wake-up device, an embodiment of the present application provides an electronic device 100 . The electronic device 100 may be the voice wake-up device (such as the voice wake-up devices 10-15) in the foregoing embodiments.

Electronic device 100 may be equipped with Or electronic devices with other operating systems, such as mobile phones, tablet computers, smart watches, smart bracelets, speakers, TVs, etc. The embodiment of the present application does not limit the specific type of the electronic device 100 .

A schematic structural diagram of the electronic device 100 will be introduced below.

As shown in FIG. 3A, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.

It can be understood that, the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

Wherein, the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

In some embodiments, the processor 110 may include a voice wake-up module and a voice command recognition module. Wherein, the voice wake-up module and the voice command recognition module can be integrated in different processor chips and executed by different chips. For example, the voice wake-up module can be integrated in a coprocessor or DSP chip with low power consumption, and the voice command recognition module can be integrated in an AP or NPU or other chips. In this way, after the voice wake-up module recognizes the preset wake-up word, the chip where the voice command recognition module is located can be activated to trigger the voice command recognition function, thereby saving the power consumption of the electronic device. Alternatively, the voice wake-up module and the voice command recognition module can be integrated in the same processor chip, and the same chip performs related functions. For example, both the voice wake-up module and the voice command recognition module can be integrated in an AP chip or an NPU or other chips.

The processor 110 may also include a voice command execution module. After the speech instruction recognition module recognizes the speech instruction, the speech instruction execution module can execute the operation corresponding to the speech instruction. For example, play music, make calls, send text messages, and more.

It can be understood that the electronic device including the above-mentioned voice wake-up module, voice command recognition module and voice command execution module is an electronic device with voice interaction capability. Having the voice interaction capability mentioned above may mean that the electronic device 100 can respond to a user's voice command and perform an operation corresponding to the voice command.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.

The USB interface 130 is an interface conforming to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100 , and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through them.

The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .

The wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves and radiate them through the antenna 1 .

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

The electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.

The display screen 194 is used to display images, videos and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

The electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.

The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.

Camera 193 is used to capture still images or video. In some embodiments, the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

The NPU is a neural-network (NN) computing processor. By referring to the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process input information and continuously learn by itself. Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The internal memory 121 may be used to store computer-executable program codes including instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 . The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

The electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .

Speaker 170A, also referred to as a "horn", is used to convert audio electrical signals into sound signals.

Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. In some embodiments, the electronic device 100 can be provided with two microphones 170C, which can also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.

The earphone interface 170D is used for connecting wired earphones.

The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

The keys 190 include a power key, a volume key and the like. The motor 191 can generate a vibrating reminder. The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.

The SIM card interface 195 is used for connecting a SIM card. The SIM card can be connected and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 . The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calling and data communication. In some embodiments, the electronic device 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 .

FIG. 3B is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, the application program layer, the application program framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

The application layer can consist of a series of application packages.

As shown in FIG. 3B , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, short message, and voice assistant.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in FIG. 3B, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, activity manager, and so on.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device 100 . For example, the management of call status (including connected, hung up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminder, etc. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.

The activity manager is used to manage activities, and is responsible for the starting, switching, scheduling of each component in the system, and the management and scheduling of application programs. The activity manager can be called by the upper application to open the corresponding activity.

Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

A system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

Please refer to FIG. 4 . FIG. 4 exemplarily shows a schematic structural diagram of a voice wake-up device 10 provided by an embodiment of the present application.

As shown in Figure 4, the voice wake-up device 10 may include: a pre-wake-up module 410 coupled to each other via a bus, an arbitration module 420, a wake-up module 430, a voice assistant APP 440, a communication module 450, an audio input module 460, an audio output module 470, a storage Module 480. in:

The storage module 480 may store a pre-wakeup model 481 and a wakeup model 482 . The above-mentioned pre-awakening model 481 can be used to detect whether a pre-awakening word is contained in the sound. The wake model 482 described above can be used to detect whether a wake word is contained in a sound. The embodiment of the present application does not limit the implementation methods of the above-mentioned pre-wake-up model 481 and wake-up model 482 .

Exemplarily, the voice-activated device 10 may collect ambient sound through a microphone. Wherein, when the user speaks a pre-awakening word (such as "Xiaoyi") near the voice-activated device 10, the ambient sound may include the pre-awakened voice. After collecting the environmental sound, the voice wake-up device 10 may use the pre-awakening model 481 to separate the user's voice from the environmental sound, and decode the phoneme sequence from the user's voice. When the phoneme sequence is obtained, the voice awakening device 10 can use the pre-awakening model 481 to determine whether the decoded phoneme sequence matches the stored pre-awakening word phoneme sequence. If yes, the voice wake-up device 10 may determine that the user's voice includes pre-wake-up voice.

Optionally, the aforementioned pre-awakening model 481 may also be a model based on a neural network. The realization method of the wake-up model 482 may be the same as or different from the realization method of the pre-wake-up model 481 .

In some embodiments, the above-mentioned pre-wake-up model 481 and the above-mentioned wake-up model 482 may be the same model. Understandably, the pre-wakeup word is a part of the wakeup word. The voice wake-up device 10 can use a model to identify whether the collected sound contains a pre-wake-up word. When it is determined that the pre-wake word is contained in the sound, this model can output the result that there is a pre-wake word. Further, the voice wake-up device 10 may use this model to continue identifying whether the collected sound contains wake-up words. When it is determined that the sound contains the wake word, this model can output the result that the wake word is present.

Not limited to storing the pre-wakeup model 481 and the wakeup model 482, the storage module 480 can also store more content. The storage module 480 may be equivalent to the aforementioned internal memory 121 shown in FIG. 3A .

The audio input module 460 can be used to collect sound. The audio input module 460 may include a microphone. When the voice wake-up function in the voice wake-up device 10 is turned on, the audio input module 460 can convert the collected sound into an audio electrical signal, and send it to the pre-wake-up module 410 and the wake-up module 430 .

The audio output module 470 can be used to convert audio electrical signals into sound, thereby playing the sound. The audio output module 470 may include one or more of the following: speaker, receiver. For example, when a wake-up voice is detected, the voice assistant APP440 can call the audio output module 470 to answer "I am" by voice.

The pre-awakening module 410 can be configured to acquire the pre-awakening model 481 from the storage module 480 to detect whether there is a pre-awakening word in the case of receiving the electrical audio signal from the audio input module 460 . When detecting that there is a pre-awakening word in the sound collected by the audio input module 460, the pre-awakening module 410 may instruct the arbitration module 420 to determine the answering device.

In a possible implementation method, the pre-awakening module 410 may determine the audio energy of the pre-awakening word corresponding to the audio containing the pre-awakening word according to the audio obtained from the sound collected by the audio input module 460 . The pre-awakening module 410 may send the above-mentioned audio energy of the pre-awakening word to the arbitration module 420 . In addition, the pre-awakening module 410 may also send the audio energy of the pre-awakening word to other voice-activated devices (such as voice-activated devices 11-15) in the voice-activated system through the communication module 450.

In another possible implementation method, the pre-awakening module 410 may also send the audio containing the pre-awakening word to the arbitration module 420 . The arbitration module 420 may determine the audio energy of the pre-awakening word, and send the audio energy of the pre-awakening word to other voice-activating devices in the voice-activating system.

It should be noted that when each voice wake-up device in the voice wake-up system notifies each other of the pre-wake-up word audio energy determined by itself, the audio energy of the pre-wake-up word sent to other voice wake-up devices may be normalized. That is to say, the audio energy of the pre-wake words from different voice wake-up devices used to determine the answering device is calculated according to the same measurement standard. In the same measurement standard as above, the audio energy of the pre-awakening word can reflect the distance between the voice awakening device and the user. Wherein, the greater the audio energy of the pre-awakening word may indicate that the distance between the voice awakening device corresponding to the audio energy of the pre-awakening word is closer to the user. The voice wake-up device corresponding to the audio energy of the pre-wake-up word may be a voice wake-up device that determines the audio energy of the pre-wake-up word. In this way, each voice wake-up device in the voice wake-up system can determine the answering device according to the audio energy of the pre-wake-up word.

The embodiment of the present application does not limit the implementation method of normalizing the audio energy of the pre-awakening word.

The decision module 420 can be configured to determine which voice wake-up device has the largest audio energy of the pre-wake word after obtaining the audio energy of the pre-wake word determined by the voice wake-up device 10 and other voice wake-up devices in the voice wake-up system. The arbitration module 420 may determine a voice wake-up device corresponding to the largest pre-wake-up word audio energy as the answering device.

The arbitration module 420 described above is optional.

In some embodiments, each voice wake-up device in the voice wake-up system includes the aforementioned arbitration module 420 . That is to say, the process of each voice wake-up device in the voice wake-up system negotiating to determine the answering device may include: each voice wake-up device can notify each other of the pre-wake-up word audio energy determined by itself, and each voice wake-up device can pass its own The arbitration module uses the pre-wake word audio energy to determine the answering device.

In some embodiments, the voice wake-up device 10 may not include the arbitration module 420 . For example, a voice wake-up device (such as the voice wake-up device 11 ) in the voice wake-up system is the master device. After the voice wake-up device 10 detects the pre-wake-up word through the pre-wake-up module 410, it may send the audio energy of the pre-wake-up word to the above-mentioned main device. The above-mentioned master device may include an arbitration module 420 . The above-mentioned master device can acquire the audio energy of the pre-awakening word determined by multiple voice-activating devices in the voice-activating system, and use the audio energy of the pre-awakening word to determine the answering device through the arbitration module 420 . Optionally, the above-mentioned master device may also be an electronic device other than each voice wake-up device. Or, each voice wake-up device in the voice wake-up system can send the audio energy of the pre-wake-up word determined respectively to a server (such as a cloud server). The cloud server can determine the answering device and instruct the answering device to respond to the user after detecting the wake-up tone.

The wake-up module 430 can be configured to acquire the wake-up model 482 from the storage module 480 to detect whether there is a wake-up word when receiving the audio electrical signal from the audio input module 460 . When it is detected that there is a wake-up word in the sound collected by the audio input module 460 , the wake-up module 430 may obtain a determination result of the answering device from the arbitration module 420 . When the wake-up voice is detected and the answering device is the voice wake-up device 10 , the wake-up module 430 can wake up the voice assistant APP 440 . The wake-up module 430 may include the voice wake-up module in the embodiment described above in FIG. 3A .

In some embodiments, the above-mentioned pre-wake-up module 410 and wake-up module 430 may be the same module.

The voice assistant APP 440 can be used to respond to the user after waking up. For example, the voice assistant APP 440 may call the audio input module 460 to respond to the wake-up words spoken by the user. The voice assistant APP440 can recognize the user's voice command, and execute the operation corresponding to the voice command. The voice assistant APP440 may include the voice command recognition module and the voice command execution module in the aforementioned embodiment shown in FIG. 3A .

The communication module 450 can be used for the voice wake-up device 10 to communicate with other electronic devices. For example, the voice wake-up device 10 can discover voice wake-up devices with the same wake-up word as itself through the communication module 450, and determine the status of these voice wake-up devices (such as the activation status of the voice wake-up function, the working status, etc.). When the pre-wake-up voice is detected, the voice wake-up device 10 can also send the pre-wake-up word audio energy determined by itself to other voice wake-up devices in the voice wake-up system through the communication module 450, and receive the pre-wake-up words determined by other voice wake-up devices audio energy. The communication module 450 may send the audio energy of the pre-wake word determined by other voice wake-up devices to the arbitration module 420 .

Not limited to the modules shown in FIG. 4 , the voice wake-up device 10 may also include more or fewer modules. It can be understood that, for the structure of other voice wake-up devices in the embodiment of the present application, reference may be made to the schematic structural diagram of the voice wake-up device 10 shown in FIG. 4 . I won't go into details here.

The following introduces a method for waking up a device provided by an embodiment of the present application based on the voice waking up device 10 shown in FIG. 4 .

Here, the voice wake-up system composed of the above-mentioned voice wake-up device 10 and the voice wake-up device 11 is taken as an example for introduction. It can be understood that when the voice wake-up system includes more voice wake-up devices (such as voice wake-up devices 10-15 included in the voice wake-up system A), the voice wake-up device 10 and the voice wake-up device 11 can also be connected with the voice wake-up devices in the voice wake-up system A respectively. The other voice wake-up devices communicate to negotiate and select the voice wake-up device closest to the user in the voice wake-up system A. The process of pairwise communication between the voice wake-up devices included in the voice wake-up system A may refer to the communication process between the voice wake-up device 10 and the voice wake-up device 11 . It will not be expanded here.

Please refer to FIG. 5 . FIG. 5 exemplarily shows a flow chart of a method for waking up a device provided by an embodiment of the present application.

The method may include steps S510-S560. in:

S510. The voice wake-up device 10 detects the pre-wake-up voice, enters the pre-wake-up state, and determines the audio energy of the pre-wake-up word corresponding to the pre-wake-up word detected by itself, and the pre-wake-up word is a part of the wake-up word.

S520. The voice wake-up device 11 detects the pre-wake-up voice, enters the pre-wake-up state, and determines the audio energy of the pre-wake-up word corresponding to the pre-wake-up word detected by itself, and the pre-wake-up word is a part of the wake-up word.

In the process of the user uttering the wake-up word (such as "Xiaoyi Xiaoyi"), the voice wake-up device 10 and the voice wake-up device 11 can enter the pre-wake-up state as soon as the pre-wake-up voice is detected, to negotiate and determine the answer equipment. It can be understood that since the pre-wake-up word is a part of the wake-up word, the voice wake-up device 10 and the voice wake-up device 11 may start the above negotiation process before the user has finished speaking the wake-up word.

For the implementation method of detecting the pre-awakening voice and determining the audio energy of the pre-awakening word, reference may be made to the introduction of the foregoing embodiments. I won't go into details here.

S530, the voice wake-up device 10 and the voice wake-up device 11 notify each other of their respective pre-wake-up word audio energy.

Wherein, the voice wake-up device 10 may determine that the voice wake-up devices having the same wake-up word as itself include the voice wake-up device 11 . The voice wake-up device 10 may send the audio energy of the pre-wake-up word determined by itself to the voice wake-up device 11 , and wait for the audio energy of the pre-wake-up word from the voice wake-up device 11 .

The voice wake-up device 11 may determine that voice wake-up devices having the same wake-up word as itself include the voice wake-up device 10 . The voice wake-up device 11 may send the audio energy of the pre-wake-up word determined by itself to the voice wake-up device 10 , and wait for the audio energy of the pre-wake-up word from the voice wake-up device 10 .

S540, the voice wake-up device 10 determines that its own pre-wake-up word audio energy is the largest according to the audio energy of the pre-wake-up word between itself and the voice wake-up device 11, and determines itself as the answering device.

When receiving the pre-wake-up word audio energy from the voice wake-up device 11, the voice wake-up device 10 can determine which voice wake-up device has the largest pre-wake-up word audio energy by itself and the pre-wake-up word audio energy of the voice wake-up device 11. When it is determined that the audio energy of the pre-wake word of the voice wake-up device 10 is the largest, the voice wake-up device 10 may determine itself as the answering device.

S550. The voice wake-up device 11 determines that the audio wake-up word of the voice wake-up device 10 has the largest audio energy according to the audio energy of the pre-wake-up word between itself and the voice wake-up device 10, and determines the voice wake-up device 10 as the answering device.

When receiving the pre-wake-up word audio energy from the voice wake-up device 10, the voice wake-up device 11 can determine which voice wake-up device has the largest pre-wake-up word audio energy by itself and the pre-wake-up word audio energy of the voice wake-up device 10. When it is determined that the audio energy of the pre-wake word of the voice wake-up device 10 is the largest, the voice wake-up device 11 may determine the voice wake-up device 10 as the answering device.

In some embodiments, after the voice wake-up device 10 and the voice wake-up device 11 respectively determine the answering device, they may also notify each other of the determination result of their answering device.

In some embodiments, in addition to the pre-wake-up word audio energy determined by each voice wake-up device, the voice wake-up device 10 and the voice wake-up device 11 can also combine the device information (such as device type, device usage frequency, device capability, etc.) of each voice wake-up device etc.) to identify the answering device. For example, the voice wake-up device 10 can first compare the audio energy of its own pre-wake-up word with the audio energy of the pre-wake-up word of the voice wake-up device 11, and determine which voice wake-up device is the largest from the user's pre-wake-up word audio energy. Wherein, if the audio energy of the pre-awakening word of multiple voice wake-up devices is the same, it may indicate that the distances between the multiple voice wake-up devices and the user are the same. In the case that it is determined that the audio energy of the pre-wake word of the voice wake-up device 10 and the voice wake-up device 11 are the same, the voice wake-up device 10 may determine the answering device according to the device capability. If the capability of the voice wake-up device 10 is higher than that of the voice wake-up device 11 (for example, the sound effect of the voice wake-up device 10 is better), the voice wake-up device 10 can determine itself as the answering device. Similarly, the voice wake-up device 11 may also determine the voice wake-up device 10 as the answering device according to the above method. The embodiment of the present application does not limit the implementation method for the voice wake-up device to determine the answering device in combination with the audio energy of the pre-wake-up word determined by each voice wake-up device and the device information of each voice wake-up device.

S560. When the voice wake-up device 10 detects the wake-up voice, it enters the wake-up state according to the determination result of the answering device in step S540, and the voice assistant APP is woken up and responds to the user.

Based on the method shown in FIG. 5 , the time distribution from the time when the user speaks the wake-up word to the voice wake-up device is determined to determine the answering device in the above-mentioned method is introduced below.

Please refer to FIG. 6 . FIG. 6 exemplarily shows a schematic diagram of time distribution from when the user speaks a wake-up word to when the voice wake-up device determines the answering device.

As shown in Figure 6, the user starts to say the wake-up word "Xiaoyi Xiaoyi" from time t1. Understandably, the wake-up word has multiple syllables, and it takes a certain amount of time for the user to speak the wake-up word. Wherein, the user finishes speaking the wake-up word at time t3. That is, the time period from time t1 to time t3 is the time period when the user speaks the wake-up word. Wherein, the pre-wake-up word is a part of the wake-up word. The user may have finished speaking the pre-awakening word (such as "Xiaoyi") within the time period from time t1 to time t2. The voice wake-up device 10 detects the pre-wake-up voice at time t2, and enters the pre-wake-up state. In the above-mentioned pre-wake-up state, the voice wake-up device 10 can wait to receive the audio energy of the pre-wake-up word from other voice wake-up devices. The voice wake-up device 10 determines the answering device at time t4. That is to say, the time period from time t2 to time t4 is the time period from when the voice wake-up device 10 detects the pre-awakening voice to when it determines the answering device.

Wherein, different voice wake-up devices have different computing capabilities. If the computing capability of the voice wake-up device is strong, the time required for the voice wake-up device to determine the answering device according to the audio energy of the pre-wake word is relatively short. If the computing power of the voice wake-up device is weak, it takes a long time for the voice wake-up device to determine the answering device according to the audio energy of the pre-wake word. Therefore, the above-mentioned time t4 may be before the time t3. That is, before the user finishes speaking the wake-up word, the voice wake-up device 10 has already obtained the determination result of the answering device. The above-mentioned time t4 may be after the time t3. That is, after the user finishes speaking the wake-up word, the voice wake-up device 10 obtains the determination result of the answering device.

The voice wake-up device 10 detects the wake-up voice at time t5. When a wake-up voice is detected and the voice wake-up device 10 is an answering device, the voice wake-up device 10 may enter a wake-up state. Wherein, the voice wake-up device 10 determines the answering device and detects whether there is a wake-up word in the collected sound may be processed in parallel. The above determination of the answering device and the detection of whether there is a wake-up word in the collected sound require a certain amount of processing time. The above-mentioned time t5 may be after the time t4. That is, the voice wake-up device 10 detects the wake-up voice after determining the answering device. Then, in the case that the voice wake-up device 10 is an answering device, the voice wake-up device 10 may enter the wake-up state as soon as it detects the wake-up voice. The above-mentioned time t5 may be before the time t4. That is, when the voice wake-up device 10 detects the wake-up voice, no answering device has been determined. When it is determined that it is the answering device after detecting the wake-up voice, the voice wake-up device 10 may enter the wake-up state. It can be seen that no matter whether the above-mentioned time t5 is before or after the above-mentioned time t4, compared with negotiating with other voice wake-up devices to determine the answering device after detecting the wake-up voice, the method shown in FIG. The time it takes for the answering device to respond to the user.

It can be known from the above implementation method that each voice wake-up device in the voice wake-up system can determine the timing for starting the above negotiation process by detecting the pre-wake-up voice. The voice wake-up device can start to negotiate and determine the answering device before the user has finished speaking the wake-up word. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the voice wake-up device after detecting the wake-up voice, but also the answering device responds only when the wake-up voice is detected, which will not affect the wake-up rate. This can effectively improve the user experience of using the voice wakeup function in a scenario where there are multiple voice wakeup devices with the same wakeup word.

In some embodiments, when the user speaks the wake-up word, the sound collected by the voice wake-up device usually includes environmental noise in addition to the user's voice. The foregoing environmental noise may refer to sounds other than the speech corresponding to the wake-up word. For example, the sound of the user walking, the sound of the TV playing video, the sound of the speaker playing music, and so on. Noise sources in the vicinity of different wake-on-voice devices may vary. For example, the voice wake-up device 10 is very close to the air conditioner, and the ambient noise generated by the air conditioner running in the sound collected by the voice wake-up device 10 is relatively loud. The voice wake-up device 11 is far away from the air conditioner, and the volume of ambient noise generated by the operation of the air conditioner in the sound collected by the voice wake-up device 11 is relatively small. Then, using the audio energy of the pre-wake-up word determined by the audio containing the voice corresponding to the pre-wake-up word and the ambient noise to judge the distance between the voice-wake-up device and the user may cause relatively large errors.

In order to improve the determination accuracy of the answering device, so that after the user speaks the wake-up word, the voice wake-up device closest to the user enters the wake-up state, and the voice wake-up device can reduce the energy generated by the environmental noise in the audio energy of the pre-wake-up word. Still taking the voice wake-up system composed of the voice wake-up device 10 and the voice wake-up device 11 as an example, another device wake-up method provided by the embodiment of the present application is introduced below.

Please refer to FIG. 7 , which exemplarily shows a flowchart of another method for waking up a device provided by an embodiment of the present application.

The method may include steps S710-S780. in:

S710. The voice wake-up device 10 collects ambient sound, and determines ambient audio energy corresponding to the ambient sound.

S720. The voice wake-up device 11 collects the environmental sound, and determines the environmental audio energy corresponding to the environmental sound.

In a possible implementation method, the voice wake-up device 10 and the voice wake-up device 11 may process the collected environmental sound regularly or irregularly to determine the environmental audio energy. The above ambient sound may represent the sound that can be collected by the audio input device of the voice wake-up device. The above environmental audio energy may include parameters such as sound intensity and sound pressure of the environmental sound. The embodiment of the present application does not limit the calculation method of the ambient audio energy.

S730, the voice wake-up device 10 detects the pre-wake-up voice, enters the pre-wake-up state, determines the pre-wake-up word audio energy corresponding to the pre-wake-up word detected by itself, and obtains the denoising pre-wake-up word audio according to the pre-wake-up word audio energy and the environmental audio energy Energy, the pre-wake word is part of the wake word.

S740, the voice wake-up device 11 detects the pre-wake-up voice, enters the pre-wake-up state, determines the pre-wake-up word audio energy corresponding to the pre-wake-up word detected by itself, and obtains the denoising pre-wake-up word audio according to the pre-wake-up word audio energy and the environmental audio energy Energy, the pre-wake word is part of the wake word.

The voice wake-up device 10 and the voice wake-up device 11 can also perform voice recognition on the collected environmental sound, and judge whether the environmental sound contains a pre-awakening word. When the pre-wake-up voice is detected, the voice wake-up device 10 and the voice wake-up device 11 can enter a pre-wake-up state.

Wherein, the voice awakening device 10 may determine the audio energy of the pre-awakening word corresponding to the pre-awakening word according to the audio obtained from the sound containing the pre-awakening word. Since there is environmental noise in the sound containing the pre-awakening word, the audio energy of the above-mentioned pre-awakening word includes the audio energy of the environmental noise. The voice wake-up device 10 may acquire ambient audio energy determined according to the latest collected ambient sound that does not contain a pre-wake word. Then, the voice wake-up device 10 may subtract the ambient audio energy from the audio energy of the pre-wake-up word to obtain the audio energy of the denoised pre-wake-up word. That is to say, the voice awakening device 10 can determine the audio energy of the denoising pre-awakening word according to the following formula:

Denoising pre-awakening word audio energy = pre-awakening word audio energy - ambient audio energy

It can be understood that since the above-mentioned environmental sound that does not contain the pre-wake-up word is collected last time by the voice wake-up device 10 before detecting the pre-wake-up voice, then the above-mentioned environmental sound that does not contain the wake-up word is collected from the voice wake-up device 10, and the user says In the process of issuing the pre-wake-up word, except for the user's pre-wake-up voice, the sound in the environment can be considered to be almost unchanged. The above-mentioned sound containing the pre-wake-up word may be equivalent to being composed of the user's pre-wake-up voice and the above-mentioned environmental sound not containing the pre-wake-up word. In this way, the audio energy of the denoising pre-awakening word may be equivalent to the audio energy generated by the above-mentioned pre-awakening speech. Compared with the audio energy of the pre-wake-up word, the audio energy of the denoising pre-wake-up word can more accurately reflect the distance between the voice wake-up device and the user.

In a possible implementation manner, before determining the audio energy of the pre-wake word, the voice wake-up device 10 may perform noise cancellation processing on the audio obtained from the sound containing the pre-wake word. Before determining the ambient audio energy, the voice wake-up device 10 may perform noise cancellation processing on the above-mentioned ambient sound that does not contain the pre-wake-up words. The noise removal process described above can be used to remove part of the noise signal in the audio. That is to say, both the audio energy of the pre-awakening word and the audio energy of the environment may be obtained through noise reduction processing. The noise elimination processing performed by the voice wake-up device 10 on the audio obtained from the above-mentioned ambient sound not containing the wake-up word and the above-mentioned sound containing the pre-wake-up word may be the same. In this way, the same noise signal in the audio obtained by the ambient sound not containing the wake-up word and the sound containing the pre-wake-up word can be eliminated. The implementation method of the foregoing noise elimination processing is not limited in the embodiment of the present application.

For the method for the voice wake-up device 11 to determine the audio energy of the denoising pre-wake word, refer to the above-mentioned method for the voice wake-up device 10 to determine the audio energy of the de-noise pre-wake word.

S750, the voice wake-up device 10 and the voice wake-up device 11 notify each other of the audio energy of the denoising pre-wake word.

S760. The voice wake-up device 10 determines that its own audio energy of the denoising pre-wake-up word is the largest according to the audio energy of the denoising pre-wake-up word between itself and the voice wake-up device 11, and determines itself as the answering device.

S770. The voice wake-up device 11 determines that the audio energy of the denoising pre-wake-up word of the voice wake-up device 10 is the largest according to the audio energy of the denoising pre-wake-up word of itself and the voice wake-up device 10, and determines the voice wake-up device 10 as the answering device.

Voice wake-up device 10 and voice wake-up device 11 use the audio energy of the denoising pre-wake-up word to determine the implementation process of the response device. You can refer to the aforementioned method shown in FIG. implementation of the device. I won't go into details here.

S780. When the voice wake-up device 10 detects the wake-up voice, it enters the wake-up state according to the determination result of the answering device in step S760, and the voice assistant APP is woken up and responds to the user.

As can be seen from the method shown in FIG. 7 , each voice wake-up device in the voice wake-up system can remove the audio energy generated by environmental noise in the audio energy of the pre-wake-up word during the process of negotiating and determining the answering device using the audio energy of the pre-wake-up word. This can reduce the influence of environmental noise on the determination of the answering device, and improve the accuracy of the determination result of the answering device. By denoising the audio energy of the pre-awakening word, the voice wake-up device can start to negotiate and determine the answering device before the user finishes speaking the wake-up word. In this way, when the wake-up voice is detected, that is, after the user finishes speaking the wake-up word, the answering device can enter the wake-up state. The above method not only improves the response speed of the voice wake-up device after detecting the wake-up voice, but also the answering device responds only when the wake-up voice is detected, which will not affect the wake-up rate. This can effectively improve the user experience of using the voice wakeup function in a scenario where there are multiple voice wakeup devices with the same wakeup word.

In some embodiments, a master device may be included in the voice wake-up system. The master device may be one of multiple voice wake-up devices included in the voice wake-up system with the same wake-up word. Alternatively, the main device may be an electronic device other than the above-mentioned multiple voice-activated devices. The master device can be used to receive the pre-wake-up word audio energy determined by each voice-wake-up device in the voice-wake-up system, and determine a response device from the voice-wake-up system according to the audio energy of the pre-wake-up word.

Please refer to FIG. 8 . FIG. 8 exemplarily shows a schematic structural diagram of a master device 200 provided by an embodiment of the present application.

As shown in FIG. 8 , the main device 200 may include: an arbitration module 810 , a communication module 820 , and a storage module 830 coupled through a bus. in:

The communication module 820 can be used to establish a communication connection with the voice wake-up device in the voice wake-up system. The communication connection mentioned above may include: a wired communication connection, a wireless communication connection (such as a Bluetooth communication connection, a Wi-Fi communication connection, etc.). The embodiment of the present application does not limit the specific method of the foregoing communication connection. The main device 200 may receive the audio energy of the pre-wake word determined from the voice wake-up device through the communication module 820, and send the determination result of the answering device to each voice wake-up device.

The communication module 820 may send the received audio energy of the pre-wake word to the arbitration module 810 .

The decision module 810 may determine which voice wake-up device has the highest audio energy of the pre-wake word according to the audio energy of the pre-wake word determined by different voice wake-up devices. The arbitration module 810 may determine a voice wake-up device corresponding to the largest pre-wake-up word audio energy as the answering device.

For the arbitration module 810, reference may be made to the aforementioned arbitration module 420 shown in FIG. 4 .

The storage module 830 can be used to store computer programs. For example, a computer program for determining an answering device using pre-wake word audio energy, etc.

Not limited to the modules shown in FIG. 8 , the main device 200 may also include more or fewer modules. For example, a voice wake-up device in the master device 200-bit voice wake-up system. Then, the main device 200 may also include a pre-wake-up module, a wake-up module, a voice assistant APP, a voice input module and an audio output module. The above-mentioned storage module 830 may also store a pre-wake-up model and a wake-up model. When the main device 200 determines that it is the responding device according to the audio energy of the pre-wake-up word determined by itself and the audio energy of the pre-wake-up word determined by other voice wake-up devices, the main device 200 may enter the wake-up state after detecting the wake-up voice.

In some embodiments, the voice wake-up system may also include a cloud server in addition to multiple voice wake-up devices with the same wake-up word. The cloud server can be used to receive the pre-wake-up word audio energy determined by each voice-wake-up device in the voice-wake-up system, and determine an answering device from the voice-wake-up system according to the audio energy of the pre-wake-up word. The cloud server can send the determination result of the answering device to each voice wake-up device in the voice wake-up system.

Based on the voice wake-up system including multiple voice wake-up devices with the same wake-up word (such as voice wake-up device 10, voice wake-up device 11, etc.) and the main device 200, another device wake-up method provided by the embodiment of the present application is introduced below.

FIG. 9 exemplarily shows a flow chart of another method for waking up a device provided by an embodiment of the present application.

As shown in FIG. 9, the method may include steps S910-S980. in:

S910. The voice wake-up device 10 detects the pre-wake-up voice, enters the pre-wake-up state, and determines the audio energy of the pre-wake-up word corresponding to the pre-wake-up word detected by itself, and the pre-wake-up word is a part of the wake-up word.

S920. The voice wake-up device 11 detects the pre-wake-up voice, enters the pre-wake-up state, and determines the audio energy of the pre-wake-up word corresponding to the pre-wake-up word detected by itself, and the pre-wake-up word is a part of the wake-up word.

Step S910 and step S920 may refer to the aforementioned step S510 and step S520 shown in FIG. 5 . Not limited to the voice wake-up device 10 and the voice wake-up device 11 , more voice wake-up devices may be included in the voice wake-up system. When the user speaks the wake-up word, multiple voice wake-up devices in the voice wake-up system detect the pre-wake-up voice, and determine the audio energy of the pre-wake-up word corresponding to the detected pre-wake-up word.

S930. The voice wake-up device 10 sends the audio energy of the pre-wake-up word to the main device 200 .

S940, the voice wake-up device 11 sends the audio energy of the pre-wake-up word to the master device 200 .

Multiple voice wake-up devices in the voice wake-up system can send the audio energy of the pre-wake-up word determined by themselves to the main device 200 .

S950. The main device 200 determines that the audio energy of the pre-wake word of the voice wake-up device 10 is the largest according to the audio energy of the pre-wake word of the multiple voice wake-up devices, and determines the voice wake-up device 10 as the answering device.

In a possible implementation manner, the master device 200 may determine the number of voice wake-up devices included in the voice wake-up system. The main device 200 may start to determine the answering device according to the audio energy of the pre-wake word after receiving the audio energy of the pre-wake word sent by all the voice-wake-up devices included in the voice-wake-up system. This can reduce the situation that the voice wakes up the device due to missed voice, resulting in inaccurate determination results of the answering device.

Alternatively, the main device 200 may wait for the voice wake-up device to send audio energy of the pre-wake word within a preset waiting period. If the master device 200 receives the pre-wake word audio energy sent by some voice wake-up devices in the voice wake-up system within the above-mentioned preset waiting time period. The master device 200 may use the audio energy of the pre-wake word received within the preset waiting period to select a response device from the voice wake-up devices to which the received audio energy of the pre-wake word belongs. It can be understood that the voice wake-up device that does not send the audio energy of the pre-wake-up word to the master device 200 within the above-mentioned preset waiting period can be regarded as a device that has not detected the pre-wake-up voice. For example, when the user speaks the wake-up word, it may be difficult for the voice-activated device far away from the user to collect the sound containing the pre-wake-up word. Then, the master device 200 does not have to wait for the audio energy of the pre-wake word sent by all the voice wake-up devices in the voice wake-up system before starting to determine the answering device. This can improve the efficiency of determining the answering device, thereby improving the response speed of the voice wake-up device in the voice wake-up system after detecting the wake-up voice.

For the specific method for the main device 200 to determine the answering device, reference may be made to the foregoing embodiments. I won't go into details here.

S960, the main device 200 sends the determination result of the answering device to the voice wake-up device 11 .

S970, the main device 200 sends the determination result of the answering device to the voice wake-up device 10 .

When the answering device is determined, the main device 200 may send the determination result of the answering device to multiple voice-activating devices in the voice-activating system. For example, the determination result of the answering device indicates that the voice wake-up device 10 is the answering device. Wherein, the master device 200 may send the determination result of the answering device to the voice wake-up device that has sent the voice wake-up audio energy to the master device 200 .

S980. When the voice wake-up device 10 detects the wake-up voice, it may enter the wake-up state according to the received determination result of the answering device, and the voice assistant APP of the voice wake-up device 10 is woken up and responds to the user.

In the case that the determination result of the answering device indicates that the voice wake-up device 10 is the answering device, the voice wake-up device 10 may enter the wake-up state after detecting the wake-up voice.

The above step S960 is optional. In some embodiments, the master device 200 may also only send the determination result of the responding device to the responding device. For example, when it is determined that the answering device is the voice wake-up device 10 , the master device 200 may send the determination result of the answering device to the voice wake-up device 10 . After the voice wake-up device 10 detects the wake-up voice, it can enter the wake-up state according to the determination result of the answering device. After the voice wake-up device 11 detects the wake-up voice, it may wait for the determination result of the answering device. When waiting for timeout, the voice wake-up device 11 may stop waiting. That is to say, the voice wake-up device that has not received the determination result sent by the master device 200 from the answering device will not enter the wake-up state even if the wake-up voice is detected.

In some embodiments, multiple voice wake-up devices in the voice wake-up system may determine the audio energy of the denoised pre-wake word based on the audio energy of the pre-wake word, and send the audio energy of the denoised pre-wake word to the main device 200 . That is, the main device 200 can use the audio energy of the denoising pre-wake word to determine the answering device.

In some embodiments, the main device 200 shown in FIG. 9 can also be replaced by a cloud server. That is, the cloud server can determine the answering device according to the audio energy of the pre-awakening word, and send the determination result of the answering device to multiple voice wake-up devices in the voice wake-up system.

It can be known from the above method shown in FIG. 9 that each voice wake-up device in the voice wake-up system can send the audio energy of the pre-wake-up word to the main device 200 when detecting the pre-wake-up voice. The master device 200 may utilize the pre-wake word audio energy to determine the answering device. Compared with determining the answering device after the wake-up voice is detected, the above method can advance the process of determining the answering device. Then each voice wake-up device may obtain the determination result of the answering device before detecting the wake-up voice. The voice wake-up device indicated by the determination result of the answering device may enter the wake-up state immediately after detecting the wake-up voice. The above method not only improves the response speed of the voice wake-up device after detecting the wake-up voice, but also the answering device responds only when the wake-up voice is detected, which will not affect the wake-up rate. This can effectively improve the user experience of using the voice wakeup function in a scenario where there are multiple voice wakeup devices with the same wakeup word.

Please refer to FIG. 10 . FIG. 10 exemplarily shows a schematic diagram of a voice wake-up system 1000 provided by an embodiment of the present application.

As shown in FIG. 10 , in some embodiments, the voice wake-up system 1000 may include one or more voice wake-up devices (eg, voice wake-up device 10 , voice wake-up device 11 , etc.). In some other embodiments, the voice wake-up system 1000 may further include a master device 200 in addition to including one or more voice wake-up devices. In some other embodiments, besides including one or more voice wake-up devices, the voice wake-up system 1000 may also include a cloud server 201 . That is to say, the above-mentioned master device 200 and cloud server 201 are optional.

Exemplarily, the voice wake-up system 1000 may include one or more voice wake-up devices. The one or more voice wake-up devices may determine a voice wake-up device to respond to the user after detecting the wake-up voice according to the aforementioned method shown in FIG. 5 .

Optionally, the voice wake-up system 1000 may include one or more voice wake-up devices, and the main device 200 . The voice wake-up system 1000 may determine a voice wake-up device to respond to the user after detecting the wake-up voice according to the aforementioned method shown in FIG. 9 . Wherein, the main device 200 may also be a voice wake-up device.

Optionally, the voice wake-up system 1000 may include one or more voice wake-up devices, and a cloud server 201 . The voice wake-up system 1000 may determine a voice wake-up device to respond to the user after detecting the wake-up voice according to the aforementioned method shown in FIG. 9 .

It should be noted that, in the absence of contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature can be combined, and the combined technical solution is also within the scope of the embodiments of the present application .

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions described in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the various embodiments of the application.

Claims (16)

1. A method of waking up a device, the method comprising:

the method comprises the steps that first electronic equipment detects first pre-awakening voice containing pre-awakening words, and first audio energy is obtained according to the first pre-awakening voice;

The first electronic device receives M audio energies sent by M electronic devices, wherein one audio energy in the M audio energies is obtained by one electronic device in the M electronic devices according to the detected pre-wake-up voice containing the pre-wake-up word, and M is a positive integer;

the first electronic device determines the first electronic device as a device for responding according to the first audio energy and the M audio energies;

when a first wake-up voice containing a wake-up word is detected, a first application in the first electronic equipment enters a wake-up state;

the pre-wake word is a part of the wake word, and the first application is used for detecting and responding to a voice instruction in the wake state to execute an operation corresponding to the voice instruction.

2. The method of claim 1, wherein after the first electronic device detects a first pre-wake-up speech that includes a pre-wake-up word, the method further comprises:

and when the collected sound is detected not to contain the wake-up word, the first application in the first electronic equipment does not enter the wake-up state.

3. The method according to claim 1 or 2, characterized in that the method further comprises:

The first electronic device detects a second pre-wake-up speech comprising the pre-wake-up word, obtains a second audio energy based on the second pre-wake-up speech,

the first electronic device receives K pieces of audio energy sent by K pieces of electronic devices, wherein one piece of audio energy in the K pieces of audio energy is obtained by one piece of electronic device in the K pieces of electronic devices according to detected pre-wake-up voice containing the pre-wake-up word, and K is a positive integer;

the first electronic device determines that a second electronic device in the K electronic devices is a device for responding according to the second audio energy and the K audio energies;

and under the condition that the second electronic device is determined to be a device for responding, the first application in the first electronic device does not enter the awakening state.

4. A method according to claim 3, characterized in that the method further comprises:

and under the condition that the second electronic equipment is determined to be the equipment for responding, the first electronic equipment sends a first message to the second electronic equipment, wherein the first message comprises a first result, the first result is used for indicating the second electronic equipment to be the equipment for responding, and the first message is used for indicating the second electronic equipment to enable the first application in the second electronic equipment to enter the awakening state after the second electronic equipment detects awakening voice containing the awakening word.

5. A method according to any of claims 1-3, wherein after the deriving first audio energy from the first pre-wake-up speech, the method further comprises:

the first electronic device sends the first audio energy to the M electronic devices.

6. The method according to any one of claims 1-5, further comprising:

the first electronic equipment collects first sound, wherein the first sound does not contain the pre-awakening words;

the first electronic device obtains third audio energy according to the first sound;

the first electronic device obtains fourth audio energy according to the first pre-awakening voice;

the obtaining the first audio energy according to the first pre-wake-up voice specifically includes:

the first electronic device subtracts the third audio energy from the fourth audio energy to obtain the first audio energy.

7. A device wake-up method, wherein the method is applied to a voice wake-up system, the voice wake-up system includes H electronic devices, the H electronic devices include a first electronic device, and H is a positive integer greater than 1, the method includes:

The first electronic equipment detects first pre-awakening voice containing a pre-awakening word, and obtains first audio energy according to the first pre-awakening voice;

the H1 pieces of electronic equipment in the H pieces of electronic equipment send H1 pieces of audio energy to the first electronic equipment, the H1 pieces of electronic equipment do not contain the first electronic equipment, and one piece of audio energy in the H1 pieces of audio energy is obtained by one piece of electronic equipment in the H1 pieces of electronic equipment according to detected pre-wake-up voice containing the pre-wake-up word; the H1 is a positive integer smaller than H;

the first electronic device determines the first electronic device as a device for responding according to the first audio energy and the H1 audio energy;

when a first wake-up voice containing a wake-up word is detected, a first application in the first electronic equipment enters a wake-up state;

the pre-wake word is a part of the wake word, and the first application is used for detecting and responding to a voice instruction in the wake state to execute an operation corresponding to the voice instruction.

8. The method of claim 7, wherein the method further comprises:

the first application in each of the H1 electronic devices does not enter the awake state.

9. The method of any of claims 7 or 8, wherein after the first electronic device detects a first pre-wake speech comprising a pre-wake word, the method further comprises:

and when the collected sound is detected not to contain the wake-up word, the first application in the first electronic equipment does not enter the wake-up state.

10. The method according to any one of claims 7-9, further comprising:

the first electronic device detects second pre-awakening voice containing the pre-awakening word, and second audio energy is obtained according to the second pre-awakening voice;

the H2 electronic devices in the H electronic devices send H2 audio energy to the first electronic device, the H2 electronic devices do not contain the first electronic device, and one audio energy in the H2 audio energy is obtained by one electronic device in the H2 electronic devices according to the detected pre-wake-up voice containing the pre-wake-up word; the H2 is a positive integer less than H;

the first electronic device determines that a second electronic device in the H2 electronic devices is a device for response according to the second audio energy and the H2 audio energy;

When a second wake-up voice containing the wake-up word is detected, the first application in the second electronic device enters the wake-up state, and neither the first application in the first electronic device nor the first application in each of (H2-1) electronic devices enters the wake-up state, wherein the (H2-1) electronic devices are devices of the H2 electronic devices except the second electronic device.

11. The method according to claim 10, wherein the first application in the second electronic device enters the wake state when a second wake speech comprising the wake word is detected, in particular comprising:

the first electronic device sends a first message to the second electronic device, wherein the first message comprises a first result, and the first result is used for indicating that the second electronic device is a device for responding;

based on the first message, when the second wake-up voice is detected, the first application in the second electronic device enters the wake-up state.

12. The method according to claim 10, wherein the method further comprises:

the first electronic device transmitting the second audio energy to the second electronic device;

The (H2-1) electronic equipment sends (H2-1) audio energy to the second electronic equipment, wherein the (H2-1) audio energy is audio energy obtained by the (H2-1) electronic equipment in the H2 audio energy;

the second electronic device determines that the second electronic device is a device for responding according to the second audio energy, the (H2-1) audio energy and the fifth audio energy obtained by the second electronic device according to the detected third pre-awakening voice containing the pre-awakening word, wherein the fifth audio energy is contained in the H2 audio energy.

13. The method according to any one of claims 7-12, further comprising:

the first electronic equipment collects first sound, wherein the first sound does not contain the pre-awakening words;

the first electronic device obtains third audio energy according to the first sound;

the first electronic device obtains fourth audio energy according to the first pre-awakening voice;

the obtaining the first audio energy according to the first pre-wake-up voice specifically includes:

the first electronic device subtracts the third audio energy from the fourth audio energy to obtain the first audio energy.

14. An electronic device comprising a microphone for capturing sound, a communication means, a memory for storing a computer program, and a processor for invoking the computer program to cause the electronic device to perform the method of any of claims 1-6.

15. A computer readable storage medium comprising instructions which, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-6.

16. A computer program product comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any of claims 1-6.