CN111857849A

CN111857849A - Wake-up processing method and device, electronic equipment and storage medium

Info

Publication number: CN111857849A
Application number: CN202010700673.3A
Authority: CN
Inventors: 程思; 宋明星
Original assignee: Beijing Xiaomi Pinecone Electronic Co Ltd
Current assignee: Beijing Xiaomi Pinecone Electronic Co Ltd
Priority date: 2020-07-20
Filing date: 2020-07-20
Publication date: 2020-10-30

Abstract

The embodiment of the disclosure discloses a wake-up processing method, a wake-up processing device, an electronic device and a storage medium, wherein the method is applied to a first device and comprises the following steps: receiving first awakening information at a first time; determining a first awakening judgment result based on the first awakening information; receiving second awakening information at a second moment, wherein the second moment is later than the first moment; if the second awakening information is received, determining a second awakening judgment result based on the first awakening information and the second awakening information; and executing a wakeup response event according to the first wakeup judgment result and the second wakeup judgment result. The awakening processing method provided by the embodiment of the disclosure can reduce the probability that a plurality of devices all respond to a user, thereby improving the user experience.

Description

Wake-up processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of communications technologies, and in particular, to a wake-up processing method and apparatus, an electronic device, and a storage medium.

Background

With the continuous development of artificial intelligence, the voice assistant provides great convenience for users through intelligent interaction such as intelligent conversation and the like; voice assistants have been overlaid on cell phones, televisions, internet of things devices, and the like. For example, many internet companies already have their own voice assistants, such as google, apple, amazon, hundredth, arbiba, millet, and hua, etc.

The general voice assistant only has one awakening word, and when a plurality of voice assistants are arranged in a user home, one awakening of the user can awaken a plurality of devices at times; thus, the user experience is greatly affected.

Disclosure of Invention

The disclosure provides a wake-up processing method and device, electronic equipment and a storage medium.

According to a first aspect of the present disclosure, there is provided a wake-up processing method, an application and a first device, including:

receiving first awakening information at a first time;

determining a first awakening judgment result based on the first awakening information;

receiving second awakening information at a second moment, wherein the second moment is later than the first moment;

if the second awakening information is received, determining a second awakening judgment result based on the first awakening information and the second awakening information;

and executing a wakeup response event according to the first wakeup judgment result and the second wakeup judgment result.

In the above scheme, the method further comprises:

when receiving a first piece of first awakening information, starting a first timer;

the first time is any time within the timing time of the first timer.

In the above scheme, the method further comprises:

When the first awakening judgment result is determined, starting a second timer;

the second time is any time within the timing time of the second timer.

In the foregoing solution, the first wake-up message includes:

the first wake-up information of the first device and/or the first wake-up information of at least one second device;

the second wake-up information includes:

the second wake-up information of at least one of the second devices.

In the foregoing solution, the determining a first wake-up decision result based on the first wake-up information includes:

determining the first wake-up decision result based on at least one of the first wake-up information.

In the foregoing solution, the executing a wake-up response event according to the first wake-up decision result and the second wake-up decision result includes:

comparing whether the first awakening judgment result and the second awakening judgment result are the same;

and if the first awakening judgment result and the second awakening judgment result are the same and indicate that the first equipment is awakened, continuously outputting response information responding to awakening.

Judging whether the equipment wakened by the second wakening judgment result is the first equipment or not;

when the second awakening judgment result indicates that the awakened equipment is not the first equipment, monitoring whether the first equipment outputs response information responding to awakening;

and if the first equipment does not output the response information responding to the awakening, the first equipment is prohibited from outputting the response information responding to the awakening.

In the above scheme, the method further comprises:

if the first equipment outputs all the response information responding to awakening, indicating the first equipment to enter a dormant state;

the sleep state is a state in which the first device prohibits receiving the interactive request or prohibits outputting the interactive information determined based on the interactive request.

In the above scheme, the method further comprises:

if the first equipment outputs the response information responding to the awakening, adding specific audio data in the rest response information to prohibit the first equipment from outputting the rest response information.

According to a second aspect of the present disclosure, there is provided a wake-up processing apparatus, applied to a first device, including:

the receiving module is used for receiving first awakening information at a first moment;

A determining module, configured to determine a first wake-up decision result based on the first wake-up information;

the receiving module is configured to receive second wake-up information at a second time, where the second time is later than the first time;

the determining module is configured to determine a second wake-up decision result based on the first wake-up information and the second wake-up information if the second wake-up information is received;

and the processing module is used for executing the awakening response event according to the first awakening judgment result and the second awakening judgment result.

In the above scheme, the processing module is further configured to start a first timer when receiving a first piece of the first wake-up information;

the first time is any time within the timing time of the first timer.

In the above scheme, the processing module is further configured to start a second timer when the first wake-up decision result is determined;

the second time is any time within the timing time of the second timer.

In the foregoing solution, the first wake-up message includes:

The second wake-up information includes:

the second wake-up information of at least one of the second devices.

In the foregoing solution, the determining module is configured to determine the first wake-up decision result based on at least one piece of the first wake-up information.

In the above scheme, the processing module is configured to compare whether the first wake-up decision result and the second wake-up decision result are the same;

In the foregoing solution, the processing module is configured to determine whether the device wakened by the second wake-up decision result indicates the first device;

In the foregoing solution, the processing module is configured to instruct the first device to enter a sleep state if the first device has output all the response messages responding to wake-up;

In the foregoing solution, the processing module is configured to add, if the first device has output a part of the response information responding to wake-up, specific audio data to the remaining part of the response information to prohibit the first device from outputting the remaining part of the response information.

According to a third aspect of the present disclosure, there is provided an electronic device comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to: when the executable instructions are executed, the wake-up processing method according to any embodiment of the disclosure is implemented.

According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium storing an executable program, wherein the executable program, when executed by a processor, implements a wake-up processing method according to any embodiment of the present disclosure.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

the embodiment of the disclosure receives first awakening information at a first moment, and determines a first awakening judgment result based on the first awakening information; receiving second awakening information at a second moment later than the first moment, and determining a second awakening judgment result based on the first awakening information and the second awakening information if the second awakening information is received; and executing a wakeup response event according to the first wakeup judgment result and the second wakeup judgment result. Therefore, in the embodiment of the present disclosure, the second wake-up decision may be performed after the first wake-up decision is performed, so that when the first wake-up information received in the first wake-up decision is incomplete, the wake-up information may be received again, and the second wake-up decision may be performed based on the relatively comprehensive first wake-up information and the second wake-up information; and executing a wake-up response event based on the first wake-up decision result and the second wake-up decision result.

Therefore, the embodiment of the disclosure can receive more comprehensive wake-up information as much as possible when network transmission fluctuation is large, triggering time of wake-up of each device is different, and the like, and determine to execute the response event based on the wake-up information. That is to say, the embodiment of the present disclosure can reduce the situation of multi-device response caused by the fact that the first wake-up decision result is different from the second wake-up decision result due to incomplete wake-up information received during the first wake-up decision, that is, reduce the probability that a plurality of devices all respond to the user, thereby improving the user experience.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Fig. 1 is a diagram illustrating a wake-up processing method according to an example embodiment.

Fig. 2 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 3 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 4 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 5 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 6 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 7 is a diagram illustrating a wake-up processing method according to an example embodiment.

Fig. 8 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 9 is a flow chart illustrating a wake-up processing method according to an example embodiment.

Fig. 10 is a block diagram illustrating a wake-up processing apparatus according to an example embodiment.

FIG. 11 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

As shown in fig. 1, there is provided a wake-up processing method in the prior art, which includes the following steps: the electronic equipment receives a wake-up word sent by a user, obtains a local wake-up result according to a detection result of the wake-up word, and sends the local wake-up result to the router; the router sends the external awakening result to each electronic device; and each electronic device carries out awakening judgment according to the local awakening result and the external awakening result, and if the local awakening result is matched with the external awakening result, the electronic device is awakened.

However, the external wake-up results received by the electronic devices are different due to the time length of waking up the electronic devices, the fluctuation of network transmission, and the like, so that the determination results of the electronic devices are inconsistent, and the electronic devices are simultaneously woken up.

As shown in fig. 2, an embodiment of the present disclosure provides a flowchart of a wake-up processing method, and as shown in fig. 2, the method includes the following steps:

step S21: receiving first awakening information at a first time;

step S22: determining a first awakening judgment result based on the first awakening information;

step S23: receiving second awakening information at a second moment, wherein the second moment is later than the first moment;

Step S24: if the second awakening information is received, determining a second awakening judgment result based on the first awakening information and the second awakening information;

step S25: and executing a wakeup response event according to the first wakeup judgment result and the second wakeup judgment result.

The wake-up processing method according to the embodiment of the present disclosure is applied to a first device, which may be various types of mobile devices or fixed devices. For example, the first device may be an electronic device such as a mobile phone, a computer, a server, or a tablet computer; for another example, the first device may be an electronic device such as a television or a sound box; for another example, the first device may be an electronic device such as a wearable bracelet, a watch, or the like.

The wake-up processing method in the embodiment of the disclosure may be applied to a distributed system, and may also be applied to a centralized system. If the wake-up processing method is applied to a distributed system, the first device may be any one node in the distributed system, or the first device may also be a device that manages multiple nodes in the distributed system. If the wake-up processing method is applied to a centralized system, the first device may be a central node in the centralized system, and the central node is configured to centrally manage each node in the centralized system.

Of course, in other embodiments, the wake-up processing method may also be applied to any wake-up system, and only the first device needs to acquire local wake-up information or receive wake-up information sent by other devices.

In an embodiment, the first device is an electronic device capable of being woken up. For example, any one of the nodes in the distributed system of the above example.

In another embodiment, the first device is an electronic device that is not capable of being woken up. E.g. the central node in the centralized system of the example above.

In an application scenario, the step S22 may be considered as a first wake-up decision, and the step S24 may be considered as a second wake-up decision. In another application scenario, the steps S21 and S22 may be considered as a first wake-up decision, and the steps S23 and S24 may be considered as a second wake-up decision.

In some embodiments, the first wake-up information includes:

the second wake-up information includes:

the second wake-up information of at least one of the second devices.

Here, the second device may be various types of mobile devices or fixed devices; for example, the second device may be a mobile phone, a computer, a server, a wearable watch, a television, a sound box, or the like.

In one embodiment, the step S21 includes:

the method includes the steps that first awakening information generated by first equipment based on awakening words is obtained at a first moment and/or first awakening information generated by at least one second equipment based on the awakening words is received. As such, in this example, one first device or a plurality of second devices may be triggered to generate wake-up information based on the received one wake-up word.

In some embodiments, the step S22 includes:

The first wake decision result is determined, for example, based on first wake information of the first device.

In another example, the first wake-up decision result is determined based on first wake-up information of a second device.

For another example, the first wake-up decision result is determined based on first wake-up information of a plurality of second devices.

For another example, the first wake-up decision result is determined based on the first wake-up information of the first device and the first wake-up information of a second device.

For another example, the first wake-up decision result is determined based on the first wake-up information of the first device and the first wake-up information of the plurality of second devices.

In some embodiments, the first wake-up message and the second wake-up message may both receive status information for a wake-up word. Here, the wakeup word reception status information is generated based on a wakeup word. For example, the sound box receives the audio signal strength information of the wake-up word, or information related to the audio signal strength information of the wake-up word.

For example, the wake-up word reception condition information may represent a first distance, where the first distance is a distance between the user who sent the wake-up word and the first device or the second device. As another example, the wake-up word reception condition information may represent a signal strength of a signal at which the wake-up word is received. Therefore, an accurate awakening judgment result can be obtained according to the awakening information. In some embodiments, the first wake decision result and the second wake decision result may both indicate a device that needs to be woken up.

For example, the first wake-up decision result is used to indicate an alternative device that needs to be woken up, and the second wake-up decision result is used to indicate a target device that needs to be woken up.

In one embodiment, the step S22 includes:

and determining, based on a first distance in at least one piece of the first wake-up information, that the first device or the second device corresponding to the shortest first distance is a candidate device that needs to be woken up in the first wake-up decision result.

In another embodiment, the step S22 includes:

and determining, based on signal strength information in at least one of the first wake-up messages, that the first device or the second device corresponding to the signal strength information with the strongest signal is the candidate device that needs to be woken up in the first wake-up decision result.

In another embodiment, the step S24 includes:

and determining that the first device or the second device corresponding to the shortest first distance is the target device to be awakened in the second awakening judgment result based on the first distance in the at least one first awakening message and the first distance in the second awakening message.

In another embodiment, the step S24 includes:

and determining the first device or the second device corresponding to the signal strength information with the strongest signal as the target device to be awakened in the second awakening judgment result based on the signal strength in at least one piece of first awakening information and the signal strength information in the second awakening information.

In some embodiments, the first wake-up message and the second wake-up message may be wake-up data messages that are woken up by an engine of the first device and/or the second device. The awakening data information result comprises front-end engine awakening information or front-end engine un-awakening information.

Of course, in other embodiments, the first wake-up message and the second wake-up message may also be wake-up results carrying whether to prepare for the wake-up parameter. For example, characterizing by a "1" is ready to be woken up, characterizing by a "0" is not ready to be woken up; and if the first equipment receives the first awakening information of '1' carried by the ith second equipment, determining that the first equipment needs to be awakened. In this way, the first wake-up decision result or the second wake-up decision result may also be determined based on whether the parameter is woken up and the performance parameters of the first device and the second devices carried in the wake-up result, or based on whether the parameter is woken up and the reception status information of the wake-up words respectively received by the first device and the second devices carried in the wake-up result.

Here, the execution of the wake response event includes at least one of, but is not limited to:

Outputting response information responding to the awakening;

forbidding to output response information responding to awakening;

forbidding outputting the residual response information responding to the awakening;

forbidding to output the interactive information based on the interactive request;

and outputting an instruction for prohibiting the output of response information responding to the awakening to the second equipment.

The embodiment of the disclosure receives first awakening information at a first moment, and determines a first awakening judgment result based on the first awakening information; receiving second awakening information at a second moment later than the first moment, and determining a second awakening judgment result based on the first awakening information and the second awakening information if the second awakening information is received; and executing a wake-up response event based on the first wake-up decision result and the second wake-up decision result.

Therefore, in the embodiment of the present disclosure, the second wake-up decision may be performed after the first wake-up decision is performed, so that when the first wake-up information received in the first wake-up decision is incomplete, the wake-up information may be received again, and the second wake-up decision may be performed based on the relatively comprehensive first wake-up information and the second wake-up information. Therefore, the embodiment of the disclosure can receive relatively comprehensive wake-up results as much as possible when network transmission fluctuation is large, triggering time of wake-up of each device is different, and the like, and determine to execute the response event based on the wake-up results.

That is to say, the embodiment of the present disclosure can reduce the situation of multi-device response caused by the fact that the first wake-up decision result is different from the second wake-up decision result due to incomplete wake-up results received during the first wake-up decision, that is, the probability of multiple devices waking up simultaneously can be reduced, thereby improving the user experience.

In some embodiments, the method further comprises:

the first time is any time within the timing time of the first timer.

In one embodiment, the step S22 includes:

and determining a first awakening judgment result based on the first awakening information at the end of the period of the first timer.

In this embodiment of the disclosure, the first time is any time within the timing time of the first timer, and the received first wake-up information is within the timing time of the first timer. Therefore, the time required by the first awakening judgment result can be reasonably determined by setting the period of the first timer. For example, if the period of the first timer is set to be less than the first threshold; the time length of the first awakening judgment result can be shortened, so that the awakening response speed is correspondingly shortened, and the awakening response efficiency is improved.

In some embodiments, the method further comprises:

the second time is any time within the timing time of the second timer.

In one embodiment, the step S24 includes:

and when the period of the second timer is over, determining a second awakening judgment result based on the first awakening information and the second awakening information.

In some embodiments, the determining the second wake-up decision result at the end of the second timer period may be determining the second wake-up decision result based on the first wake-up information and the second wake-up information at the end of the second timer period after waiting for all the received second wake-up information in the second timer period.

In other embodiments, the determining the second wake-up decision result at the end of the second timer period may be that, every time a second wake-up message is received in the second timer period, a wake-up decision is made based on the first wake-up message and the received second wake-up message, until the end of the second timer period, the determining the second wake-up decision result.

In this embodiment of the disclosure, the second time is any time within the timing time of the second timer, and the received second wake-up information is within the timing time of the second timer. Therefore, the time required by the second awakening judgment result can be reasonably determined by setting the period of the second timer. For example, if the period of the second timer is set to be smaller than the second threshold, the duration of the second wake-up decision result can be shortened, so that the response speed of wake-up is correspondingly shortened, and the response efficiency of wake-up is improved. If the timing time of the second timer is set to be larger than a second threshold value; the second awakening information can be received in a longer time, and the awakening results of the multiple devices can be received as far as possible, so that the accuracy of the awakening results can be improved, and the probability of awakening the multiple devices at the same time can be reduced. If the timing time of the second timer is set to be less than the second threshold, when the second threshold is the preset time for playing the response tone, the time difference between the timing time of the second timer and the second threshold time can be set, and accordingly, the timing time of the first timer can be correspondingly shortened.

As shown in fig. 3, in some embodiments, the step S25 includes:

step S251: comparing whether the first awakening judgment result and the second awakening judgment result are the same;

step S252: and if the first awakening judgment result and the second awakening judgment result are the same and indicate that the first equipment is awakened, continuously outputting response information responding to awakening.

Here, the response message responding to the wake-up output in step S252 may be a response message played based on a voice module. For example, the response message may be a response tone, and the voice module based playback response message may be a response tone played by a speaker of the first device.

Here, the step S252 outputs response information in response to the wake-up, which may be response information in response to a user instruction. For example, in an application scenario, there are a plurality of voice assistants, which are an intelligent air conditioner, an intelligent television, a floor cleaning robot, an intelligent sound box, an intelligent window, and the like; and determining that the intelligent television is the first equipment, and when the intelligent television receives the awakening word 'in' the intelligent television, playing the response information 'in'.

In the embodiment of the present disclosure, if multiple devices are woken up, when receiving a user instruction to prepare to respond to a user output wake-up information based on the multiple devices, the first wake-up decision result and the second wake-up decision result may be determined based on a logic of a nearby wake-up, that is, a logic of a device closest to the user to respond to the user, respectively. And comparing the first wake-up information with the second wake-up information, if the first wake-up decision result and the second wake-up decision result are the same and both point to the first device, it can be accurately determined that the first device is a device most suitable for responding to the user, for example, the first device is a device closest to the user who sent the wake-up word. Therefore, the embodiment of the disclosure can realize that only the device closest to the user responds, and prevent the situation that a plurality of devices all respond to the user instruction.

Of course, in other embodiments, the step S25 includes:

if the first awakening judgment result and the second awakening judgment result are the same and indicate that target equipment in at least one piece of second equipment is awakened, sending a first instruction to the target equipment; wherein the first instruction is used for instructing the target device to output response information responding to awakening.

In this embodiment of the present disclosure, the first device may also determine whether the second device is the final wake-up device, and send the first instruction to the second device to notify the second device of wake-up. For example, in some application scenarios, in order to reduce the processing load of the second device, etc., a wake-up decision or the like may be performed by the first device.

As shown in fig. 4, in some embodiments, the step S25 includes:

step S253: judging whether the equipment wakened by the second wakening judgment result is the first equipment or not;

step S254: when the second awakening judgment result indicates that the awakened equipment is not the first equipment, monitoring whether the first equipment outputs response information responding to awakening;

Step S255: and if the first equipment does not output the response information responding to the awakening, the first equipment is prohibited from outputting the response information responding to the awakening.

In an embodiment, the step S253 includes:

and if the first awakening judgment result is different from the second awakening judgment result, judging whether the equipment awakened by the second awakening judgment result indication is the first equipment.

In another embodiment, the step S253 includes:

and if the first awakening judgment result is the same as the second awakening judgment result, judging whether the equipment awakened by the second awakening judgment result indication is the first equipment.

In practical application, when a first wake-up decision result determined by first equipment indicates that the first equipment is woken up, the first equipment starts to execute an operation of outputting response information; however, since a certain time interval is required from the start of the output of the response message to the actual output of the response message, the second wake-up decision result may be determined based on the received second wake-up message and the first wake-up message received at the first time in the time interval, and whether the first device is woken up may be further checked based on the second wake-up decision result. Here, the sum of the period of the second timer and the time for performing the determination of the second wake-up decision result needs to be set smaller than the time interval.

In this way, in this embodiment of the present disclosure, when it is determined that the first device does not respond to the user based on the second wake-up decision result, it may also be intercepted that the first device outputs response information responding to wake-up. Therefore, on one hand, resources of the first equipment for outputting the response information can be saved; on the other hand, the probability that the first device and the target device which actually needs to respond both respond to the user can be reduced.

Of course, in other embodiments, the step S25 may also be:

if the first awakening judgment result is different from the second awakening judgment result, and the first awakening judgment result indicates that the alternative equipment in at least one piece of second equipment is awakened and the second awakening judgment result indicates that the first equipment is awakened, sending a second instruction to the alternative equipment; wherein the second instruction is used for instructing the alternative device to prohibit outputting response information responding to awakening.

Thus, in the embodiment of the present disclosure, it may also be determined that the notification is not the target device to be woken up, and then output of the response message is prohibited, so that resource consumption of the second device may be reduced, and probability of multiple devices being woken up at the same time and interference to the wakening up may be reduced.

In some application scenarios, since the period of the set second timer is greater than the time interval or other reasons, and the first device has already output the response information or has already partially output the response information, it is necessary to prohibit further output of the interaction information or the remaining portion of the response information.

As shown in fig. 5, in some embodiments, the method further comprises:

step S256: if the first equipment outputs all the response information responding to awakening, indicating the first equipment to enter a dormant state; the sleep state is a state in which the first device prohibits receiving the interactive request or prohibits outputting the interactive information determined based on the interactive request.

For example, when the first device does not successfully intercept the response message, that is, the first device has output the response message of "at" based on the received wakeup word "at is"; the first device needs to further intercept interactions with the device that issued the wake-up word. For example, an interactive request of "please output weather forecast" sent by a device sending a wakeup word cannot be received; alternatively, even if the interactive request is received, outputting of "weather forecast information" in response to the interactive request is prohibited.

In the embodiment of the disclosure, if the response message output responding to the awakening is not successfully intercepted, the output of other interactive messages can be further intercepted or the interactive request message is forbidden to be received; therefore, the resource consumption of the first device can be saved as much as possible, and the interaction between the multiple devices and the device sending the interaction request in the subsequent interaction process and the interference caused by the output of the interaction information by the first device in the interaction process can be reduced.

As shown in fig. 6, in some embodiments, the method further comprises:

step S257: if the first equipment outputs the response information responding to the awakening, adding specific audio data in the rest response information to prohibit the first equipment from outputting the rest response information.

Here, the specific audio data is data that is not audible to the human ear.

Here, in the step S257, the response information of the outputted part may include: the response message that cannot be heard by human ears, or may include: and the part of the response information which can not be heard by human ears or the part of the response information which can be heard by human ears.

In practical application, when the first device outputs the response information, the response information is audio data, and the audio data comprises first-class audio data and second-class audio data; wherein the first type of audio data precedes the second type of audio data; the first type of audio data is data that is not audible to the human ear, for example, the first type of data is 0; the second type of audio data is data that can be heard by the human ear. If the first device monitors that the first device outputs part of the response information responding to the awakening, namely the first device outputs part or all of the first type of audio data, specific audio data can be added before the second type of audio data; the specific audio data is also inaudible to human ears; and informing a processor of the first device to inhibit converting the second type of audio data from digital signals to analog signals. As such, the present example may inhibit the first device from outputting the second type of audio data by adding specific data that is not audible to the human ear before the second type of audio data.

In the above embodiment, if the first device detects that the part of the response information that the first device has output the response wakeup is all the first type audio data and part of the second type audio data, specific audio data may be added before the second type audio data that is not output; and informing the processor of the first device to inhibit converting the remaining portion of the audio data of the second type from digital signals to analog signals. In this way, in this example, although part of the second type audio data that can be heard by human ears has been output, the remaining part of the second type audio data can be intercepted, and the loss and the interference caused by the first device can be reduced to some extent.

Of course, in the above example, the specific audio data may be added before the second type of audio data, so that when the first device monitors that the response information cannot be output by some of the existing ears, the time that the response information cannot be output by the ears may be continuously prolonged, so that the first device can reach to intercept the output of the remaining response information.

In the embodiment of the disclosure, the response information of the part which is already output can be intercepted, so that the response information of the rest part which is not output can be forbidden; therefore, the loss of the first device can be reduced to a certain extent, and the probability that a plurality of devices simultaneously respond to awakening and the interference caused by the first device to responding to awakening can be reduced.

In addition, since the embodiment of the disclosure can perform interception in the process of playing the response message, the interception time is longer than that performed before playing the response message, so that the interception success rate can be improved. If the interception duration is longer, the time reserved for the first device to execute the awakening judgment is longer, and if the awakening judgment duration is shortened, the whole awakening response time is shortened, so that the awakening response speed can be improved.

In some embodiments, the method further comprises:

when the second wake-up information is not received, a wake-up response event is executed based on the first wake-up decision result.

Here, performing a wake response event based on the first wake decision result includes:

if the first awakening judgment result indicates that the first equipment is awakened, continuously outputting response information responding to awakening;

alternatively, the first and second electrodes may be,

and if the first awakening judgment result indicates that an alternative device in the second device is awakened, sending a third instruction to the alternative device, wherein the third instruction is used for indicating the alternative device to output response information responding to awakening.

In the embodiment of the present disclosure, since the second wake-up message is not received at the second time, it indicates that a relatively complete wake-up message has been received as far as possible at the first time, so that a wake-up response event can be directly executed based on the first wake-up decision result, and the probability that multiple devices are simultaneously wakened up can also be reduced.

One specific example is provided below in connection with any of the embodiments described above:

FIG. 7 discloses a wake-up processing system; the system is a distributed system; the distributed system comprises a router and a plurality of electronic devices, wherein the electronic devices comprise a sound box, a notebook, a television, a wearable watch, a mobile phone and the like.

Fig. 8 discloses a wake-up processing method, as shown in fig. 8, the wake-up device is applied to a first device, and the wake-up processing method includes the following steps:

step S401: starting a wake-up engine;

in an alternative embodiment, the first device starts a wake-up engine.

Here, the first device may trigger starting a wake engine based on receiving a wake word.

Here, the second device also starts the wake-up engine. Here, the second device is a device in the same system as the first device, and both the first device and the second device are devices that can be woken up.

Here, the second device may trigger starting of a wake-up engine based on receiving the wake-up word.

Step S402: receiving a wakeup notification;

in an optional embodiment, the nearby wake-up module of the first device receives a wake-up notification.

Here, the nearby wake-up module of the second device receives a wake-up notification.

Step S403: determining local wake-up information;

in an optional embodiment, the first device determines local wake-up information of the first device.

Here, the second device determines local wake-up information of the second device.

Here, the local wake-up information of the first device and the second device is the first wake-up information or the second wake-up information in the above embodiment.

Step S404: collecting awakening information;

in an optional embodiment, the first device obtains wake-up information of the first device and the second device.

Here, the wake-up information includes first wake-up information and/or second wake-up information.

Here, in the timing time of the first timer, the collected wake-up information is first wake-up information of the first device and/or the second device; and in the timing time of the second timer, the collected wake-up information is second wake-up information of the first device and/or the second device.

Here, the operation of collecting the wake-up information in step S404 is performed until the operation of collecting the wake-up information is finished when the period of the second timer is finished.

Step S405: determining whether a first wake-up message is received; if yes, go to step S406; if not, executing step S404;

in an optional embodiment, the first device determines whether a first wake-up message is received; if yes, go to step S406; if not, go to step S404.

Step S406: starting a first timer;

in an alternative embodiment, the first device starts a first timer for timing.

Step S407: determining whether the first timer has timed out; if yes, go to step S408; if not, executing step S404;

in an alternative embodiment, the first device determines whether a period of the first timer has ended; if yes, go to step S408; if not, go to step S404.

Step S408: carrying out first awakening judgment;

in an optional embodiment, the first device performs the first wake-up decision based on the first wake-up information at the end of the period of the first timer to obtain a first wake-up decision result.

Step S409: starting a second timer;

in an optional embodiment, the first device starts a second timer for timing.

Step S410: determining whether the second timer has expired: if yes, go to step S411; if not, executing step S404;

In an alternative embodiment, the first device determines whether a period of the second timer has ended; if yes, go to step S411; if not, go to step S404.

Step S411: performing a second awakening judgment;

in an optional embodiment, when the period of the second timer of the first device ends, a second wake-up decision is performed based on the first wake-up information and the second wake-up information to obtain a second wake-up decision result.

Step S412: determining whether the wake-up decision results match; if yes, go to step S416; if not, executing step S417;

in an optional embodiment, the first device determines whether a first wake-up decision result and a second wake-up decision result match based on the first wake-up decision result of a first wake-up decision and the second wake-up decision result of a second wake-up decision; if yes, go to step S416; if not, go to step S417.

Here, in an application scenario, the first wake-up decision result indicates that the first device wakes up; the first wake-up decision result and the second wake-up decision result are matched as follows: the first awakening judgment result and the second awakening judgment result both indicate that the first device is awakened; the first wake-up decision result and the second wake-up decision result are not matched as follows: the second wake decision result indicates that the first device is not to be woken up.

After the above step S408 is performed, in addition to the step S409, a step S413 is performed.

Step S413: determining whether to wake up; if yes, go to step S414; if not, go to step S415;

in an optional embodiment, the first device determines whether the first device is woken up based on the first wake-up decision result; if yes, go to step S414; if not, go to step S415.

Step S414: starting a voice recognition function;

in an alternative embodiment, the first device turns on a voice recognition function in preparation for outputting a reply message in response to the wake-up.

In another optional embodiment, the first device further activates a human interaction interface (UI).

Step S415: ignoring;

in an optional embodiment, if the first device determines that the first device is not woken up, no processing is performed by the first device.

Step S416: determining that the awakening judgment is finished;

in an optional embodiment, the first device determines that the wake-up decision is over.

In an application scenario, before the step S416, the method may further include: determining whether the judgment is finished, if so, executing step S146; if not, go to step S404. Thus, in this example, once the first device receives new wake-up information, the first device makes a wake-up decision again, so as to determine whether the first device is woken up again according to a subsequent wake-up decision.

Step S417: determining whether to stop waking; if yes, go to step S418; if not, executing S419;

in an optional embodiment, the first device determines whether to cease waking; if yes, go to step S418; if not, go to S419.

Step S418: determining to close the voice recognition function to prohibit outputting of the response message;

in an alternative embodiment, the first device determines to turn off the voice recognition function to disable the output of the reply message in response to the wake-up.

In an optional embodiment, the method further comprises: the first device deactivates the UI.

In an alternative embodiment, the step S418 includes one of the following steps:

if monitoring that the response information does not start to be played, the first equipment determines to close the voice recognition function so as to forbid the output of the response information;

and if monitoring that the played part of the response information is played, the first equipment determines to close the voice recognition function so as to forbid outputting the rest part of the response information.

In another optional embodiment, after the step S418, the method further includes:

and if monitoring that the response information is completely played, the first equipment determines to close the voice recognition function so as to forbid outputting of the interactive information.

Here, the interactive information is information for responding to an interactive request, and the interactive request is sent by a device sending an answer word.

As shown in fig. 9, in an application scenario, a flow chart of voice playing response information is disclosed:

step S4181: copying the response information to a cache space for caching;

step S4182: determining whether the cached data reaches a predetermined threshold; if yes, go to step S4183;

step S4183: copying the buffered data to a first-in first-out memory;

step S4184: detecting the cached data;

step S4185: converting the buffered data from digital signals to analog signals;

step S4186: output through a speaker of the first device.

In the above example, if the remaining part of the response information is prohibited from being output, the buffered data may be prohibited from being converted into an analog signal for output. Further, specific audio data, which is not recognized by human ears, may be added in front of the buffered data.

Step S419: playing the response information;

in an optional embodiment, if the first device determines not to stop waking up, the first device plays and responds to the wake-up response message.

In the embodiment of the present disclosure, the first wake-up decision may be performed, and then the second wake-up decision may be performed, so that when the wake-up information received by the first wake-up decision is not complete, the wake-up information may be received again, and the second wake-up decision may be performed based on more comprehensive wake-up information, so that when the situation that the first wake-up decision obtains the first wake-up information and the second wake-up information obtained by the second wake-up decision is the same due to a large network transmission fluctuation or inconsistent wake-up durations of the devices is reduced, the situation that the multiple devices all respond to the user may be reduced, and the probability that the multiple devices wake-up at the same time may also be reduced by the second wake-up decision.

And, because can set up the cycle of the first timer and/or second timer, thus can confirm and wake up the decision time rationally, can respond to and shorten and wake up the decision time, thus can improve and wake up the response speed.

In the embodiment of the disclosure, when the second wake-up decision determines that the first device is not woken up, the intercepted first device outputs response information responding to wake-up, or outputs the remaining response information, so that the loss of the first device can be reduced and the interference caused by the output of the response information by the first device can be reduced.

And if the first device is not the awakened device and outputs the response information, the first device can be further intercepted to output the interaction information, so that the loss of the first device can be reduced to a certain extent, and the interference of the first device on the interaction of subsequent awakening can be reduced.

Fig. 10 provides a wake-up processing apparatus according to an exemplary embodiment, as shown in fig. 10, the apparatus includes: a receiving module 61, a determining module 62 and a processing module; wherein the content of the first and second substances,

the receiving module 61 is configured to receive first wake-up information at a first time;

the determining module 62 is configured to determine a first wake-up decision result based on the first wake-up information;

The receiving module 61 is configured to receive second wake-up information at a second time, where the second time is later than the first time;

the determining module 62 is configured to determine a second wake-up decision result based on the first wake-up information and the second wake-up information if the second wake-up information is received;

and a processing module 63, configured to execute a wakeup response event according to the first wakeup decision result and the second wakeup decision result.

In some embodiments, the processing module 63 is further configured to start a first timer when receiving a first one of the first wake-up messages;

the first time is any time within the timing time of the first timer.

In some embodiments, the processing module 64 is further configured to start a second timer when the first wake-up decision result is determined;

the second time is any time within the timing time of the second timer.

In some embodiments, the first wake-up information includes:

the second wake-up information includes:

The second wake-up information of at least one of the second devices.

In some embodiments, the determining module 62 is configured to determine the first wake decision result based on at least one of the first wake information.

In some embodiments, the processing module 63 is configured to compare whether the first wake-up decision result and the second wake-up decision result are the same;

In some embodiments, the processing module 63 is configured to determine whether the second wake-up decision result indicates that the woken-up device is the first device;

In some embodiments, the processing module 63 is configured to instruct the first device to enter a sleep state if the first device has output all of the response messages in response to waking up;

In some embodiments, the processing module 63 is configured to, if the first device has output a part of the response information responding to the wake-up, add specific audio data to the remaining part of the response information to prohibit the first device from outputting the remaining part of the response information.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

An embodiment of the present disclosure further provides a server, including:

a processor;

a memory for storing processor-executable instructions;

The memory may include various types of storage media, which are non-transitory computer storage media capable of continuing to remember the information stored thereon after a communication device has been powered down.

The processor may be connected to the memory via a bus or the like for reading the executable program stored on the memory, for example, for implementing at least one of the methods shown in fig. 2 to 6, fig. 8.

Embodiments of the present disclosure also provide a computer-readable storage medium, which stores an executable program, where the executable program, when executed by a processor, implements the wake-up processing method according to any embodiment of the present disclosure. For example, at least one of the methods shown in fig. 2 to 6, fig. 8 is implemented.

Fig. 11 is a block diagram illustrating an electronic device 800 according to an example embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 11, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the electronic device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A wake-up processing method applied to a first device includes:

receiving first awakening information at a first time;

2. The method of claim 1, further comprising:

the first time is any time within the timing time of the first timer.

3. The method of claim 1, further comprising:

the second time is any time within the timing time of the second timer.

4. The method of claim 1,

the first wake-up information includes:

the second wake-up information includes:

the second wake-up information of at least one of the second devices.

5. The method according to any of claims 1 to 4, wherein the determining a first wake decision result based on the first wake information comprises:

6. The method according to any of claims 1 to 4, wherein the performing a wake response event according to the first wake decision result and the second wake decision result comprises:

7. The method according to any of claims 1 to 4, wherein the performing a wake response event according to the first wake decision result and the second wake decision result comprises:

8. The method of claim 7, further comprising:

9. The method of claim 7, further comprising:

10. A wake-up processing apparatus applied to a first device, comprising:

11. The apparatus of claim 10, wherein the processing module is further configured to start a first timer when receiving a first one of the first wake-up messages;

the first time is any time within the timing time of the first timer.

12. The apparatus of claim 10, wherein the processing module is further configured to start a second timer when the first wake-up decision result is determined;

the second time is any time within the timing time of the second timer.

13. The apparatus of claim 10,

the first wake-up information includes:

the second wake-up information includes:

the second wake-up information of at least one of the second devices.

14. The apparatus according to any of claims 9 to 13, wherein the determining module is configured to determine the first wake decision result based on at least one of the first wake information.

15. The apparatus according to any one of claims 9 to 13, wherein the processing module is configured to compare whether the first wake-up decision result and the second wake-up decision result are the same;

16. The apparatus according to any one of claims 9 to 13, wherein the processing module is configured to determine whether the second wake-up decision result indicates that the woken-up device is the first device;

17. The apparatus of claim 16,

the processing module is configured to indicate the first device to enter a sleep state if the first device has output all the response messages responding to wake-up;

18. The apparatus of claim 16, wherein the processing module is configured to add specific audio data to the remaining portion of the response message to prohibit the first device from outputting the remaining portion of the response message if the first device has output a portion of the response message in response to waking up.

19. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to: for implementing the wake-up handling method of any of claims 1-9 when executing the executable instructions.

20. A computer-readable storage medium, characterized in that the readable storage medium stores an executable program, wherein the executable program, when executed by a processor, implements the wake-up processing method of any of claims 1-9.