CN117690426A

CN117690426A - Voice awakening method, mobile terminal and vehicle

Info

Publication number: CN117690426A
Application number: CN202311675457.8A
Authority: CN
Inventors: 黄风云; 赵见星; 李亚明; 袁海涛
Original assignee: Beijing Xiaomi Mobile Software Co Ltd; Beijing Xiaomi Pinecone Electronic Co Ltd; Xiaomi Technology Wuhan Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd; Beijing Xiaomi Pinecone Electronic Co Ltd; Xiaomi Technology Wuhan Co Ltd
Priority date: 2023-12-06
Filing date: 2023-12-06
Publication date: 2024-03-12

Abstract

The disclosure relates to a voice awakening method, a mobile terminal and a vehicle. The method comprises the following steps: the second equipment receives part of contents in a target wake-up word included in the voice wake-up instruction and sends a second target broadcast; the method comprises the steps that a first device receives a voice awakening instruction, a target perception state of the first device and a target awakening decision duration corresponding to the target perception state are determined, wherein the target perception state comprises a first state used for representing that a second device is perceived and a second state used for representing that the second device is not perceived; the first device monitors a second target broadcast within the target wake-up decision period, and the first device is not awakened by the received voice wake-up instruction. Therefore, according to different perception states, the second target broadcast is monitored in different wake-up decision time periods, the flexibility of the first equipment in monitoring the second target broadcast is improved, the problem that a plurality of equipment is simultaneously awakened up can be effectively avoided, and the use experience of a user is improved.

Description

Voice awakening method, mobile terminal and vehicle

Technical Field

The disclosure relates to the field of computer technology, and in particular relates to a voice wake-up method, a mobile terminal and a vehicle.

Background

With the development of electronic devices, more and more electronic devices support a voice wake-up function. When a plurality of electronic devices supporting a voice wake-up function and having the same wake-up words are located in the same area, a problem of one hundred times of response is likely to occur, wherein the wake-up words are preset words for waking up the electronic devices. For example, when a plurality of users get on a car with a mobile phone or get home, shouting for a little college, the little college on a plurality of electronic devices such as a sound box, a television, a car set, a mobile phone and the like can be awakened at the same time. In the related art, the cooperative wake-up function can inhibit part of electronic devices from being simultaneously woken up, so that the problem of one hundred-call is solved.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a voice wake-up method, a mobile terminal, and a vehicle.

According to a first aspect of an embodiment of the present disclosure, there is provided a voice wake-up method, including:

the second equipment receives part of contents in a target wake-up word included in the voice wake-up instruction and sends a second target broadcast;

the method comprises the steps that a first device receives a voice awakening instruction, and a target perception state of the first device and a target awakening decision duration corresponding to the target perception state are determined, wherein the target perception state comprises a first state used for representing that the second device is perceived and a second state used for representing that the second device is not perceived;

The first device monitors the second target broadcast within the target wake-up decision time, and the first device is not awakened by the received voice wake-up instruction.

Optionally, determining the target wake-up decision duration corresponding to the target perception state includes:

the target perception state is the first state, and the target wake-up decision time length is determined to be a first wake-up decision time length;

the target perception state is the second state, the target wake-up decision time length is determined to be a second wake-up decision time length, and the first wake-up decision time length is longer than the second wake-up decision time length.

Optionally, the method further comprises:

the second device periodically transmits heartbeat packets;

the first device monitors a heartbeat packet sent by the second device and updates the target perception state to the first state;

and the first equipment does not monitor the heartbeat packet sent by the second equipment within a preset time period, and updates the target perception state to the second state.

Optionally, the second target broadcast includes a first time when the second device next transmits a heartbeat packet, and the method further includes:

And the first equipment receives the second target broadcast and monitors the heartbeat packet according to the first time when the second equipment transmits the heartbeat packet next time.

Optionally, the first device receives the second target broadcast, monitors the heartbeat packet according to the first time when the second device next sends the heartbeat packet, and includes:

the first equipment receives the second target broadcast and starts a first timing device;

and starting a Bluetooth monitoring function when the timing time of the first timing device reaches the first time so as to monitor the heartbeat packet.

Optionally, the heartbeat packet includes a second time when the second device next transmits the heartbeat packet; the method further comprises the steps of:

the first equipment receives the heartbeat packet and starts a second timing device;

and when the timing time of the second timing device reaches the second time, starting a Bluetooth monitoring function to continuously monitor the heartbeat packet.

Optionally, the method further comprises:

the second device wakes up in response to the received voice wake-up instruction and sends a first target broadcast;

the first device monitors the second target broadcast within the target wake-up decision time, the first device is not awakened by the received voice wake-up instruction, and the method comprises the following steps:

The first device monitors the second target broadcast within the target wake-up decision time, monitors the first target broadcast within a first preset time from the current moment, and is not awakened by the received voice wake-up instruction.

Optionally, the method further comprises:

the first device does not monitor the first target broadcast within the first preset time period, and the first device is awakened in response to the received voice awakening instruction.

Optionally, the first device is a mobile terminal, the second device is a vehicle, and a vehicle machine is arranged in the vehicle.

According to a second aspect of embodiments of the present disclosure, there is provided a mobile terminal,

the mobile terminal receives a voice awakening instruction, and determines a target perception state of the mobile terminal and a target awakening decision duration corresponding to the target perception state, wherein the target perception state comprises a first state used for representing a vehicle machine of a perceived vehicle and a second state used for representing a vehicle machine of an unaware vehicle;

the mobile terminal monitors a second target broadcast within the target wake-up decision time, and is not waken by the received voice wake-up instruction;

The second target broadcast is a broadcast sent by part of contents in a target wake-up word included in the voice wake-up instruction received by the vehicle.

Optionally, when the target sensing state is the first state, the mobile terminal determines that the target wake-up decision time is a first wake-up decision time, and when the target sensing state is the second state, the mobile terminal determines that the target wake-up decision time is a second wake-up decision time, where the first wake-up decision time is longer than the second wake-up decision time.

Optionally, the vehicle periodically transmits heartbeat packets,

the mobile terminal monitors a heartbeat packet sent by the vehicle machine and updates the target perception state to the first state;

and the mobile terminal does not monitor the heartbeat packet sent by the vehicle machine within a preset time period, and updates the target perception state to the second state.

Optionally, the second target broadcast includes a first time when the vehicle next transmits a heartbeat packet,

and the mobile terminal receives the second target broadcast and monitors the heartbeat packet according to the first time when the vehicle machine sends the heartbeat packet next time.

Optionally, the mobile terminal receives the second target broadcast, starts a first timing device, and starts a bluetooth monitoring function to monitor the heartbeat packet when the timing time of the first timing device reaches the first time.

Optionally, the heartbeat packet includes a second time when the vehicle machine sends the heartbeat packet next time;

and the mobile terminal receives the heartbeat packet, starts a second timing device, and starts a Bluetooth monitoring function when the timing time of the second timing device reaches the second time so as to continuously monitor the heartbeat packet.

Optionally, the mobile terminal monitors the second target broadcast within the target wake-up decision time, monitors the first target broadcast within a first preset time from the current moment, and is not waken by the received voice wake-up instruction;

the first target broadcast is a broadcast that the vehicle is awakened to transmit in response to the received voice wake instruction.

Optionally, the mobile terminal does not monitor the first target broadcast within the first preset duration, and is awakened in response to the received voice awakening instruction.

According to a third aspect of embodiments of the present disclosure, there is provided a vehicle having a vehicle machine disposed therein;

And the vehicle receives part of contents in a target wake-up word included in the voice wake-up instruction, and sends a second target broadcast, so that the mobile terminal responds to the fact that the second target broadcast is monitored to be not awakened by the received voice instruction within a target wake-up decision duration corresponding to the target perception state.

Optionally, the second target broadcast includes a first time when the vehicle sends the heartbeat packet next time, so that when the mobile terminal receives the second target broadcast, the mobile terminal monitors the heartbeat packet according to the first time when the vehicle sends the heartbeat packet next time.

Optionally, the heartbeat packet includes a second time when the vehicle machine sends the heartbeat packet next time, so that when the mobile terminal receives the heartbeat packet, the mobile terminal starts a second timing device, and when the timing time of the second timing device reaches the second time, a heartbeat packet monitoring device is started to monitor the heartbeat packet continuously.

Optionally, the vehicle is awakened in response to the received voice awakening instruction, and sends a first target broadcast, so that the mobile terminal is not awakened by the received voice instruction in response to the second target broadcast being monitored within the target awakening decision time, and the first target broadcast being monitored within a first preset time from the current moment.

By adopting the technical scheme, the first equipment receives the voice awakening instruction, determines the target perception state of the first equipment and the target awakening decision duration corresponding to the target perception state, monitors the second target broadcast within the target awakening decision duration, and the first equipment is not awakened by the received voice awakening instruction. Therefore, according to different perception states, the second target broadcast is monitored in different wake-up decision time periods, the flexibility of the first equipment in monitoring the second target broadcast is improved, the problem that a plurality of equipment is simultaneously awakened up can be effectively avoided, and the use experience of a user is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic diagram of an application scenario of a voice wake method according to an exemplary embodiment.

Fig. 2 is a flow chart illustrating a method of voice wakeup according to an example embodiment.

Fig. 3 is an interactive diagram illustrating a voice wakeup method according to an example embodiment.

Fig. 4 is a block diagram of a mobile terminal according to an exemplary embodiment.

FIG. 5 is a block diagram of a vehicle, according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

It should be noted that, all actions for acquiring signals, information or data in the present disclosure are performed under the condition of conforming to the corresponding data protection rule policy of the country of the location and obtaining the authorization given by the owner of the corresponding device.

The collaborative wake-up function is to form a collaborative wake-up networking by the electronic devices belonging to the same account, and then decide which electronic device is to wake up in the networking. The collaborative wake-up function is used for networking a plurality of electronic devices depending on a public network, and when the public network is abnormal, the plurality of electronic devices cannot be networked, so that collaborative wake-up failure among the plurality of electronic devices can be caused. For example, after a user brings a mobile phone onto the vehicle, the user can wake up the vehicle and the mobile phone simultaneously because the vehicle passes through a bridge hole, a tunnel, a remote area and other places with poor public network signals in the driving process, so that the cooperative wake-up networking between the mobile phone and the vehicle of the vehicle is disconnected.

In the related art, in order to avoid a plurality of devices from waking up at the same time, a broadcast notification is transmitted to other devices in a case where one of the devices wakes up, so that the other devices are not woken up after receiving the broadcast. Assuming that the device a and the device B are located in the same area, the device a wakes up after receiving the voice wake-up instruction, transmits a broadcast, and the device B does not wake up after receiving the broadcast. However, because the wake-up speed of the mobile phone of the part machine type is too high, the mobile phone does not receive the broadcast sent by other equipment when the mobile phone is waken up, and the mobile phone is not successfully restrained from waking up, so that the wake-up rate of the part machine type is higher at the same time. And the mobile phone wake-up library is updated iteratively all the time, so that the mobile phone wake-up speed is faster and faster along with the iterative update of the wake-up library, and meanwhile, the wake-up problem is more prominent. For example, if the duration from the time when the device a receives the voice wake-up instruction to the time when the device B receives the broadcast is longer than the duration when the device B receives the voice wake-up instruction and performs the wake-up operation, the time when the device B is woken up in response to the received voice wake-up instruction is earlier than the time when the device B receives the broadcast, which results in that both the device a and the device B are woken up in response to the voice wake-up instruction, that is, the device a and the device B are woken up simultaneously. Accordingly, in the related art, there is still a problem in that a plurality of devices wake up at the same time.

In view of the above, the present disclosure provides a voice wake-up method, a mobile terminal and a vehicle, so as to reduce the probability of simultaneous wake-up of a plurality of devices, effectively avoid the problem of simultaneous wake-up of a plurality of devices, and improve the use experience of a user.

First, an application scenario of the voice wake method provided by the present disclosure is described. The scenario includes a first device and a second device. The first device may or may not establish a communication connection with the second device, where the communication connection may refer to a public network connection, a bluetooth connection, and a wireless local area network connection. In addition, the first device and the second device both support a voice wake-up function and have the same wake-up word, and the first device and the second device are located in the same area, the area can be determined according to the maximum range in which the devices can detect voice, and the first device and the second device located in the area can both receive voice output by a voice output object, wherein the voice output object can be an electronic device for outputting voice, or a user, for example, a driver.

Illustratively, fig. 1 is a schematic diagram of an applicable scenario of a voice wake method according to an exemplary embodiment. As shown in fig. 1, the first device is a mobile terminal 10, the second device is a vehicle 20, and the mobile terminal 10 is located within the vehicle 20. In fig. 1, a vehicle 201 is disposed in a vehicle 20, and a voice wake-up function of the vehicle 20 refers to a voice wake-up function of the vehicle 201, and a vehicle being woken-up refers to the vehicle being woken-up, that is, the vehicle implementing the voice wake-up function through the vehicle. The mobile terminal 10 may be a tablet computer (Pad), a mobile phone, a computer, etc. having a bluetooth listening function. The present disclosure is not limited in this regard.

It is understood that in the present disclosure, the number of the first devices may be multiple, and the plurality of first devices and the plurality of second devices may be different devices under the same account, or may be different devices under different accounts, that is, the number of mobile terminals shown in fig. 1 may be multiple, and the plurality of mobile terminals and the vehicle may belong to the same account, or may belong to different accounts, which is not specifically limited in this disclosure.

In addition, the applicable scenario of the voice wake-up method may also be a home scenario, for example, the first device may be a mobile phone, a television, the second device may be a sound device, etc., which is not limited in detail in this disclosure.

Fig. 2 is a flow chart illustrating a method of voice wakeup according to an example embodiment. As shown in fig. 2, the voice wakeup method may be applied to the scenario shown in fig. 1. As shown in fig. 2, the voice wakeup method may include the following steps.

In step S21, the second device receives a part of the content in the target wake-up word included in the voice wake-up instruction, and sends a second target broadcast.

In the present disclosure, the wake-up priority may be determined according to the importance levels of the first device and the second device. For example, if the importance level of the second device is higher than that of the first device, the wake-up priority of the second device is higher than that of the first device, that is, the second device receives part of the content in the target wake-up word, and sends the second target broadcast, so that the second device is not woken up by the received voice wake-up instruction when receiving the second target broadcast. As another example, if the importance level of the first device is higher than that of the second device, the wake-up priority of the first device is higher than that of the second device, that is, the first device receives part of the content in the target wake-up word, and sends the second target broadcast, so that the second device is not woken up by the received voice wake-up instruction when receiving the second target broadcast. The present disclosure is described with respect to the wake-up priority of the second device being higher than the wake-up priority of the first device. By way of example, the first device may be a mobile terminal, the second device may be a vehicle, and the vehicle is provided with a vehicle body.

In the present disclosure, the voice wake instruction includes a target wake word, which may be a preset word. For example, the target wake word is "little loving college", and part of the content in the target wake word may be "little loving" or "little loving same". Taking the example that part of the content in the target wake-up word is "love together", generating a second target broadcast when the second device receives the "love together", and then transmitting the second target broadcast. Wherein the second targeted broadcast is used to characterize that the second device is about to wake up.

Illustratively, a microphone is disposed within the second device for capturing voice audio. When the voice output object outputs voice, a microphone of the second device collects voice audio and sends the voice audio to a collaborative wakeup module of the second device, so that the wake engine in the collaborative wakeup module can recognize the voice audio, when part of content in a target wake word is recognized from the voice audio, a pre-wakeup event is reported to the collaborative wakeup module, and then the collaborative wakeup module generates a second target broadcast for representing pre-wakeup of the second device when receiving the pre-wakeup event. For example, the co-wakeup module may generate the second targeted broadcast based on a preset format.

It should be appreciated that the co-wakeup module does not perform a wakeup operation when a pre-wakeup event is received, the wakeup operation being performed when a complete wakeup word is received, i.e., the second device is not awakened when a portion of the content in the target wakeup word is received.

In one embodiment, the second device actively generates and transmits a second target broadcast to the first device upon receiving a portion of the content in the target wake word included in the voice wake instruction. In another embodiment, the second device generates a second target broadcast when receiving a part of the content in the target wake word included in the voice wake instruction, and the third party device, for example, the third device, the server, etc. acquires the second target broadcast from the second device, and forwards the second target broadcast. It should be appreciated that in this embodiment, the second targeted broadcast may also be generated by a third party device, such that the third party device generates and transmits the second targeted broadcast to the first device upon determining that the second device received some of the content in the targeted wake word.

In step S22, the first device receives the voice wake-up instruction, and determines a target perception state of the first device and a target wake-up decision duration corresponding to the target perception state.

Wherein the target perceived state includes perceived and not perceived the second device. In addition, the target wake-up decision time lengths corresponding to different perception states are also different.

In step S23, the first device monitors the second target broadcast within the target wake-up decision period, and the first device is not woken up by the received voice wake-up instruction.

Illustratively, the first device is not awakened by the received voice wake instruction, comprising:

and switching the voice wake-up state of the first equipment into a suppressed wake-up state so that the first equipment is not awakened by the received voice wake-up instruction.

And if the first equipment monitors the second target broadcast within the target wake-up decision time, switching the voice wake-up state of the first equipment into a wake-up inhibition state. Thus, the first device receives the voice wake-up instruction, sends a wake-up event to the cooperative wake-up module of the first device, and the cooperative wake-up module judges the wake-up event. For example, the decision strategy is: the cooperative wake-up module detects that the voice wake-up state of the first device is the suppressed wake-up state, and judges that the first device is not awakened by the received voice wake-up instruction.

In different perception states, the first device monitors the second target broadcast in different wake-up decision time periods, namely, the time period for monitoring the second target broadcast can be dynamically adjusted according to the perception states, so that the flexibility of the first device in monitoring the second target broadcast is improved.

In one embodiment, determining a target wake-up decision duration corresponding to a target perceived state includes:

the target perception state is that the second equipment is perceived, and the target wake-up decision time length is determined to be the first wake-up decision time length;

the target perception state is that the second device is not perceived, the target wake-up decision time length is determined to be the second wake-up decision time length, and the first wake-up decision time length is longer than the second wake-up decision time length.

In the present disclosure, considering that if the first device senses the second device, the first device and the second device are represented to be in the same area, at this time, if a voice wake-up instruction is input in the area, the probability that the first device and the second device wake up simultaneously is high, at this time, in order to avoid the simultaneous wake-up, the wake-up decision duration of the first device may be prolonged, so that the first device receives the second target broadcast before being wake-up, and further the first device is not wake-up. If the first device does not sense the second device, the first device and the second device are not in the same area, and the probability of simultaneous wake-up in the area is low.

For example, assuming that the second wake-up decision duration is 300ms, when the first device does not sense the second device, the second target broadcast is monitored within 300ms, if the second target broadcast is monitored, the first device is not woken up by the received voice wake-up instruction, and if the second target broadcast is not monitored, the first device is woken up in response to the received second target broadcast. Thus, the voice wake-up efficiency can be improved. And when the sensing state of the first device is that the second device is sensed, prolonging the second wake-up decision time to the first wake-up decision time. Wherein the first wake-up decision time period is greater than 300ms and less than or equal to 500ms. That is, when a plurality of devices may wake up simultaneously, the wake-up decision duration of the first device is prolonged, so as to monitor the second broadcast in a longer period of time, reduce the probability of the first device and the second device waking up simultaneously, effectively avoid the problem that the plurality of devices wake up simultaneously, and promote the use experience of the user.

In one embodiment, the method may further comprise: the second device periodically transmits heartbeat packets; the first equipment monitors a heartbeat packet sent by the second equipment and updates the target perception state to be perceived by the second equipment; the first device does not monitor the heartbeat packet sent by the second device within a preset time period, and the target perception state is updated to be that the second device is not perceived. Wherein, the preset time length can be determined according to the period of sending the heartbeat packet. For example, the period of sending the heartbeat packet is 10min, and the value range of the preset duration may be [10min,20min ].

In the present disclosure, the second device periodically transmits a heartbeat packet, and the first device determines the perceived status by whether the heartbeat packet is received. For example, if the first device receives the heartbeat packet sent by the second device, the first device and the second device are characterized as being in the same area, and it is further determined that the first device can sense the second device. If the first device does not receive the heartbeat packet sent by the second device, the first device and the second device are characterized as not being in the same area, and further it is determined that the first device does not sense the second device. For example, when the user leaves the vehicle with the mobile phone, the heartbeat packet sent by the vehicle machine of the vehicle cannot be received because the mobile phone is far away from the vehicle, so that the perception state is updated to be that the vehicle machine is not perceived, and the mobile phone can be directly awakened in response to the received voice awakening instruction when receiving the voice awakening instruction.

In view of the first device not determining when the second device transmits the heartbeat packet, the first device may keep the bluetooth scanning state all the time in order to avoid missing reception of the heartbeat packet, thereby increasing bluetooth power consumption. Thus, in one implementation of this embodiment, to reduce power consumption, the second target broadcast includes a first time at which the second device next transmits a heartbeat packet. That is, the second target broadcast may indicate the first time for the next transmission of the heartbeat packet in addition to indicating that the second device is about to wake up. Accordingly, the method may include: the first device receives the second target broadcast and monitors the heartbeat packet according to the first time when the second device transmits the heartbeat packet next time.

For example, the second time may be a duration from the next sending of the heartbeat packet, for example, the first time is 6min, and when the first device receives the second target broadcast, the first device determines that the second device will send the heartbeat packet after 6min, and then starts scanning to monitor the heartbeat packet after 6 min.

Optionally, the first device receives the second target broadcast, and monitors the heartbeat packet according to the first time when the second device next sends the heartbeat packet, which may include: the first equipment receives the second target broadcast and starts a first timing device; and starting a Bluetooth monitoring function when the timing time of the first timing device reaches the first time so as to monitor the heartbeat packet.

For example, the first device receives the second target broadcast and analyzes the first time from the second target broadcast, then starts the first timing device, and starts the bluetooth monitor function when the timing time of the first timing device reaches the first time, so as to monitor the heartbeat packet. Therefore, when the second device sends the heartbeat packet, the first device starts the Bluetooth monitoring function to monitor the heartbeat packet, so that Bluetooth power consumption is effectively reduced.

In the present disclosure, the first device monitors the second target broadcast for the target wake-up decision period by turning on the bluetooth monitoring function. For example, the first device turns on a bluetooth listening function to listen for the second target broadcast when receiving a voice wake-up instruction. It should be appreciated that the first device may also listen for heartbeat packets while listening for the second targeted broadcast.

In another implementation of this embodiment, the heartbeat packet includes a second time at which the second device next transmitted the heartbeat packet; accordingly, the method may further comprise: the first equipment receives the heartbeat packet and starts a second timing device; the timing time of the second timing device reaches the second time, and the Bluetooth monitoring function is started to monitor heartbeat packets continuously.

For example, the first device, upon receiving the heartbeat packet, determines that it perceives the second device itself. And simultaneously, analyzing a second time of next sending the heartbeat packet by the second equipment from the heartbeat packet, and starting a second timing device. And when the timing time of the second timing device reaches the second time, starting the Bluetooth monitoring function to continuously monitor the heartbeat packet. And by analogy, the first device can start the Bluetooth monitoring function when the second device sends the heartbeat packet, so that the heartbeat packet can be ensured to be monitored, and the Bluetooth power consumption can be reduced.

It should be understood that, after determining, based on the second target broadcast or the heartbeat packet that is currently monitored, the time when the second device next sends the heartbeat packet, the first device may also start the bluetooth monitor function before the time when the second device next sends the heartbeat packet, so as to start the bluetooth monitor function in advance, thereby further avoiding the problem of missing the heartbeat packet.

If the heartbeat packet is received according to the scheme, the first device is determined to sense the second device, and then the first device monitors the second target broadcast by utilizing the Bluetooth monitoring function within the first wake-up decision duration when receiving the voice wake-up instruction. If the heartbeat packet is not received, the first equipment is determined to not sense the second equipment, and then the second equipment monitors a second target broadcast by utilizing a Bluetooth monitoring function within a second wake-up decision duration when receiving a voice wake-up instruction, wherein the second wake-up decision duration is smaller than the first wake-up decision duration.

Therefore, under the condition that the first equipment senses the second equipment, the duration of monitoring the second target broadcast is prolonged, the probability that the second equipment is awakened before the second target broadcast is not received is effectively reduced, the problem that a plurality of pieces of equipment are awakened at the same time can be effectively avoided, and the use experience of a user is improved.

In one embodiment, the method may further comprise:

the second device wakes up in response to the received voice wake-up instruction, and sends a first target broadcast;

the first device monitors a second target broadcast within a target wake-up decision period, the first device is not woken up by the received voice wake-up instruction, and the method comprises the following steps:

The first device monitors a second target broadcast in a target wake-up decision time period, monitors a first target broadcast in a first preset time period from the current moment, and is not awakened by the received voice wake-up instruction.

In the disclosure, after the second device receives a part of the content in the target wake-up word, the second device sends a second target broadcast, and at the same time, the microphone continues to collect the voice audio, the wake-up engine continues to detect whether the remaining part of the content in the target wake-up word exists in the voice audio, if the remaining part of the content exists, the second device receives the complete target wake-up word, that is, receives the voice wake-up instruction to wake up, and sends the first target broadcast.

For example, assuming that the target wake word is "little lover", the voice output object outputs "little lover" first, and accordingly, the second device receives part of the content "little lover" in the target wake word first, and transmits the second target broadcast. The voice output object continues to output "school", and the second device continues to detect "school", that is, the second device receives the complete target wake-up word "little college", at which time the second device receives the voice wake-up instruction to wake up and sends the first target broadcast.

The first device considers the second device to be pre-awakened when the second target broadcast is monitored within a first preset duration, but does not determine whether the second device is awakened, so in the present disclosure, after the first device monitors the second target broadcast within the first preset duration, the first device continues to monitor the broadcast within the second preset duration from the current moment to determine whether to monitor the first target broadcast, and if the first target broadcast is monitored within the first preset duration, the first device is not awakened by the received voice awakening instruction.

By adopting the technical scheme, under the condition that the second equipment is determined to be awakened, the first equipment is not awakened by the received voice awakening instruction, so that the reliability of voice awakening is improved.

In addition, the voice wake-up method further comprises the following steps:

the first device does not monitor the first target broadcast within a first preset time period, and the first device is awakened in response to the received voice awakening instruction.

The first device does not monitor the first target broadcast to indicate that the second device is not awakened within a first preset duration, and the first device is awakened in response to the received voice awakening instruction in order to avoid the problem that neither the first device nor the second device is awakened. Thus, the requirement of waking up the electronic equipment by the voice of the user is met.

Fig. 3 is an interactive diagram illustrating a voice wakeup method according to an example embodiment. As shown in fig. 3, the voice wakeup method may include the following steps.

In step S31, the second device receives a part of the content in the target wake-up word included in the voice wake-up instruction, and sends a second target broadcast.

In step S32, the first device receives a voice wake-up instruction, and determines a target perception state.

In step S33, if the target awareness status is a first status for indicating that the second device is aware, the second target broadcast is monitored within the first wake-up decision period.

In step S34, if the first device monitors the second target broadcast within the first wake-up decision period, the first device is not woken up by the received voice wake-up instruction.

In step S35, the second device periodically transmits a heartbeat packet to the first device.

In step S36, the first device determines, according to the second target broadcast, a first time when the second device next transmits the heartbeat packet, and when the first time arrives, starts a bluetooth listening function to listen for the heartbeat packet.

In step S37, if the heartbeat packet is monitored, it is determined that the target sensing state is still the first state.

In step S38, if the heartbeat packet is not detected within the preset time period, the target perceived state is updated to be used for representing the second state that the second device is not perceived.

In step S39, when the first device receives the voice wake-up instruction, the first device listens to the second target broadcast for a second wake-up decision duration.

In step S310, if the first device monitors the second target broadcast within the second wake-up decision period, the first device is not woken up by the received voice wake-up instruction.

Based on the same inventive concept, the present disclosure further provides a mobile terminal, which receives a voice wake-up instruction, determines a target perception state of the mobile terminal and a target wake-up decision duration corresponding to the target perception state, where the target perception state includes a first state for representing a vehicle machine of a perceived vehicle and a second state for representing a vehicle machine of an unaware vehicle;

Optionally, the vehicle periodically transmits heartbeat packets,

Optionally, the heartbeat packet includes a second time when the second device sends the heartbeat packet next time;

Fig. 4 is a block diagram of a mobile terminal according to an exemplary embodiment. For example, the mobile terminal may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, or the like.

Referring to fig. 4, a mobile terminal may include one or more of the following components: a first processing component 702, a first memory 704, a first power component 706, a first multimedia component 708, a first audio component 710, a first input/output interface 712, a first sensor component 714, and a first communication component 716.

The first processing component 702 generally controls overall operation of the mobile terminal, such as operations associated with display, telephone call, data communication, camera operations, and recording operations. The first processing component 702 may include one or more first processors 720 to execute instructions to perform all or part of the steps of the methods described above. Further, the first processing component 702 can include one or more modules that facilitate interaction between the first processing component 702 and other components. For example, the first processing component 702 may include a multimedia module to facilitate interaction between the first multimedia component 708 and the first processing component 702.

The first memory 704 is configured to store various types of data to support operations at the mobile terminal. Examples of such data include instructions for any application or method operating on the mobile terminal, contact data, phonebook data, messages, pictures, video, targeted wake-up words, and the like. The first memory 704 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The first power supply component 706 provides power to the various components of the mobile terminal. The first power component 706 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the mobile terminal.

The first multimedia component 708 includes a screen between the mobile terminal and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the first multimedia component 708 includes a front-facing camera and/or a rear-facing camera. When the mobile terminal is in an operation mode, such as a photographing mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The first audio component 710 is configured to output and/or input an audio signal. For example, the first audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the mobile terminal is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. In some embodiments, the received audio signal may be further stored in the first memory 704 or transmitted via the first communication component 716. In other embodiments, the microphone collects voice audio and sends the collected voice audio to the co-wakeup module, and the wake-up engine in the co-wakeup module detects whether a voice wake-up instruction exists in the voice audio, and when the voice wake-up instruction is detected, the mobile terminal performs the following steps:

the method comprises the steps of receiving a voice awakening instruction, and determining a target perception state of a mobile terminal and a target awakening decision time length corresponding to the target perception state, wherein the target perception state comprises a first state used for representing a vehicle machine of a perceived vehicle and a second state used for representing a vehicle machine of an unaware vehicle; the mobile terminal monitors a second target broadcast within the target wake-up decision time, and is not waken by the received voice wake-up instruction; the second target broadcast is a broadcast sent by part of contents in a target wake-up word included in the voice wake-up instruction received by the vehicle.

In some embodiments, the first audio component 710 further comprises a speaker for outputting audio signals. For example, after the mobile terminal is awakened, the mobile terminal may output a corresponding response through the speaker. The response may be a response to a voice wake-up instruction or a response to a request input by a user after waking up, which is not limited in the present disclosure.

The first input/output interface 712 provides an interface between the first processing component 702 and a peripheral interface module, which may be a keyboard, click wheel, button, or the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The first sensor assembly 714 includes one or more sensors for providing status assessment of various aspects for the mobile terminal. For example, the first sensor assembly 714 may detect an on/off state of the mobile terminal, a relative positioning of the components, such as a display and keypad of the mobile terminal, the first sensor assembly 714 may also detect a change in position of the mobile terminal or a component of the mobile terminal, the presence or absence of user contact with the mobile terminal, an orientation or acceleration/deceleration of the mobile terminal, and a change in temperature of the mobile terminal. The first sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The first sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the first sensor assembly 714 can also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The first communication component 716 is configured to facilitate communication between the mobile terminal and other devices, either wired or wireless. The mobile terminal may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the first communication component 716 does not establish a bluetooth or wireless local area network connection with the vehicle's vehicle chassis and receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the first communication component 716 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the mobile terminal may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as a first memory 704 including instructions executable by the processor 720 of the mobile terminal to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Based on the same inventive concept, the present disclosure also provides a vehicle, in which a vehicle machine is provided;

Optionally, the second target broadcast includes a first time when the vehicle machine sends the heartbeat packet next, so that when the mobile terminal receives the second target broadcast, the mobile terminal monitors the heartbeat packet according to the first time when the second device sends the heartbeat packet next.

FIG. 5 is a block diagram of a vehicle, according to an exemplary embodiment. For example, a car machine is provided in a vehicle, and the car machine is a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like. In the method, the vehicle realizes system wake-up through the vehicle machine and the mobile terminal.

Referring to fig. 5, the vehicle may include one or more of the following components: a second processing component 802, a second memory 804, a second power component 806, a second multimedia component 808, a second audio component 810, a second input/output interface 812, a second sensor component 814, and a second communication component 816.

The second processing component 802 generally controls overall operation of the vehicle, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The second processing component 802 may include one or more second processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the second processing component 802 may include one or more modules that facilitate interactions between the second processing component 802 and other components. For example, the second processing component 802 may include a multimedia module to facilitate interaction between the second multimedia component 808 and the second processing component 802.

The second memory 804 is configured to store various types of data to support operation at the vehicle. Examples of such data include instructions for any application or method operating on the vehicle, contact data, phonebook data, messages, pictures, videos, target wake-up words, as well as portions of the content of the target wake-up words, and the like. The second memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The second power supply assembly 806 provides power to the various components of the vehicle. The second power supply component 806 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the vehicle.

The second multimedia component 808 includes a screen between the vehicle and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the second multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the vehicle is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The second audio component 810 is configured to output and/or input audio signals. For example, the second audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the vehicle is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. In some embodiments, the received audio signal may be further stored in the second memory 804 or transmitted via the second communication component 816. In other embodiments, the microphone collects voice audio and sends the collected voice audio to the co-wakeup module, and a wakeup engine in the co-wakeup module detects whether a voice wakeup instruction exists in the voice audio, and when the voice wakeup instruction is detected, the following steps are executed: the vehicle receives part of the content in the target wake-up word included in the voice wake-up instruction, and sends a second target broadcast, so that the mobile terminal can not wake up the second target broadcast by the received voice instruction in response to monitoring the second target broadcast within the target wake-up decision time. In some embodiments, the second audio component 810 further comprises a speaker for outputting audio signals. For example, after the vehicle has been awakened, the vehicle can output a corresponding response via the loudspeaker. The response may be a response to a voice wake-up instruction or a response to a request input by a user after waking up, which is not limited in the present disclosure.

The second input/output interface 812 provides an interface between the second processing component 802 and a peripheral interface module, which may be a keyboard, click wheel, button, or the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The second sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the vehicle. For example, the second sensor assembly 814 may detect an on/off state of the vehicle, a relative positioning of the assemblies, such as a display and keypad of the vehicle, the second sensor assembly 814 may also detect a change in position of the vehicle or a component of the vehicle, the presence or absence of user contact with the vehicle, vehicle orientation or acceleration/deceleration, and a change in temperature of the vehicle. The second sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The second sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the second sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The second communication component 816 is configured to facilitate communication between the vehicle and other devices, either wired or wireless. The vehicle may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the second communication component 816 does not establish a bluetooth or wireless local area network connection with the mobile terminal and transmits broadcast signals or broadcast related information via a broadcast channel. In an exemplary embodiment, the second communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the vehicle may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the above method.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as second memory 804, including instructions executable by second processor 820 of the vehicle to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

In another exemplary embodiment, a computer program product is also provided, comprising a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-described voice wake-up method when executed by the programmable apparatus.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method of waking up speech, comprising:

2. The method of claim 1, wherein determining a target wake-up decision duration corresponding to the target perceived state comprises:

3. The method according to claim 1, wherein the method further comprises:

the second device periodically transmits heartbeat packets;

4. The method of claim 3, wherein the second targeted broadcast includes a first time at which the second device next transmitted a heartbeat packet, the method further comprising:

5. The method of claim 4, wherein the first device receiving the second targeted broadcast and listening for the heartbeat packet based on the first time at which the second device next transmitted the heartbeat packet, comprises:

6. The method of claim 3, wherein the heartbeat packet includes a second time at which the second device next transmitted a heartbeat packet; the method further comprises the steps of:

7. The method according to any one of claims 1-6, further comprising:

8. The method of claim 7, wherein the method further comprises:

9. The method of any one of claims 1-6, wherein the first device is a mobile terminal and the second device is a vehicle having a vehicle mounted therein.

10. A mobile terminal, characterized in that,

11. The mobile terminal of claim 10, wherein the mobile terminal comprises a mobile terminal,

and when the target perception state is the first state, the mobile terminal determines that the target wake-up decision time is a first wake-up decision time, and when the target perception state is the second state, the mobile terminal determines that the target wake-up decision time is a second wake-up decision time, and the first wake-up decision time is longer than the second wake-up decision time.

12. The mobile terminal of claim 10, wherein the vehicle periodically transmits heartbeat packets,

13. The mobile terminal of claim 12, wherein the second targeted broadcast includes a first time when the vehicle next transmits a heartbeat packet,

14. The mobile terminal of claim 13, wherein the mobile terminal comprises a mobile terminal,

and the mobile terminal receives the second target broadcast, starts a first timing device, and starts a Bluetooth monitoring function when the timing time of the first timing device reaches the first time so as to monitor the heartbeat packet.

15. The mobile terminal according to claim 12, wherein the heartbeat packet includes a second time when the vehicle sends the heartbeat packet next time;

16. The mobile terminal according to any of the claims 10-15, characterized in that,

the mobile terminal monitors the second target broadcast in the target wake-up decision time, monitors the first target broadcast in a first preset time from the current moment, and is not waken by the received voice wake-up instruction;

17. The mobile terminal of claim 16, wherein the mobile terminal comprises a mobile terminal,

and the mobile terminal does not monitor the first target broadcast within the first preset time period and is awakened in response to the received voice awakening instruction.

18. A vehicle, characterized in that a vehicle body is provided in the vehicle;

19. The vehicle of claim 18, wherein the second target broadcast includes a first time at which the vehicle next transmits a heartbeat packet, such that the mobile terminal listens for the heartbeat packet based on the first time at which the vehicle next transmits a heartbeat packet when the second target broadcast is received.

20. The vehicle of claim 19, wherein the heartbeat packet includes a second time when the vehicle next transmits the heartbeat packet, such that the mobile terminal turns on a second timing device when receiving the heartbeat packet, and turns on a heartbeat packet monitor device to continue monitoring the heartbeat packet when a timing time of the second timing device reaches the second time.

21. The vehicle according to any one of claims 18-20, characterized in that,

the vehicle machine is awakened in response to the received voice awakening instruction, and sends a first target broadcast so that the mobile terminal is not awakened by the received voice instruction in response to the fact that the second target broadcast is monitored within the target awakening decision time, and the first target broadcast is monitored within a first preset time from the current moment.