CN116994581A

CN116994581A - Voice wakeup method, voice wakeup device, vehicle, mobile terminal and storage medium

Info

Publication number: CN116994581A
Application number: CN202310914933.0A
Authority: CN
Inventors: 黄风云
Original assignee: Beijing Xiaomi Pinecone Electronic Co Ltd; Xiaomi Automobile Technology Co Ltd
Current assignee: Beijing Xiaomi Pinecone Electronic Co Ltd; Xiaomi Automobile Technology Co Ltd
Priority date: 2023-07-24
Filing date: 2023-07-24
Publication date: 2023-11-03

Abstract

The disclosure relates to a voice awakening method, a voice awakening device, a vehicle, a mobile terminal and a storage medium. The voice wake-up method comprises the following steps: detecting a target event of the second equipment and sending out an ultrasonic signal; the first equipment receives the ultrasonic signal, and the first equipment is not awakened by the received voice awakening instruction; the second device wakes up in response to the received voice wake instruction. Therefore, the first equipment is not awakened by the received voice awakening instruction through the ultrasonic signal, the second equipment is awakened when receiving the voice awakening instruction, a plurality of equipment is prevented from being awakened simultaneously, the intelligent degree of equipment voice awakening is improved, and the user experience is improved.

Description

Voice wakeup method, voice wakeup device, vehicle, mobile terminal and storage medium

Technical Field

The disclosure relates to the field of computer technology, and in particular relates to a voice wake-up method, a device, a vehicle, a mobile terminal and a storage medium.

Background

With the development of electronic devices, more and more electronic devices support a voice wake-up function. When a plurality of electronic devices supporting a voice wake-up function and having the same wake-up words are located in the same area, a problem of one hundred times of response is likely to occur, wherein the wake-up words are preset words for waking up the electronic devices. For example, the user shouts a sound of "colleagues", and then the colleagues on a plurality of electronic devices such as a mobile phone, a computer, a vehicle terminal and the like can be awakened at the same time. In the related art, the problem of one hundred kinds of response is solved through the collaborative wake-up function.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a voice wake-up method, a device, a vehicle, a mobile terminal and a storage medium.

According to a first aspect of embodiments of the present disclosure, there is provided a voice wake-up method, including:

detecting a target event of the second equipment and sending out an ultrasonic signal;

the first equipment receives the ultrasonic signal, and the first equipment is not awakened by the received voice awakening instruction;

the second device wakes up in response to the received voice wake instruction.

Optionally, the ultrasound signal comprises an ultrasound heartbeat packet; the first device receives the ultrasonic signal, the first device is not awakened by the received voice awakening instruction, and the method comprises the following steps:

the first device receives the ultrasonic heartbeat packet, and the first device is not awakened by the received voice awakening instruction within the effective duration of the ultrasonic heartbeat packet.

Optionally, the voice wake-up method further includes:

the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and the first device wakes up in response to the received voice wake-up instruction.

Optionally, the first device is a vehicle, a vehicle machine is arranged in the vehicle, and the target event comprises at least one of the following events: a door open event, a door close event, a door start event, and a door close event.

Optionally, the detecting the target event of the second device, sending out an ultrasonic signal, includes:

detecting any one of the door opening event, the door closing event and the vehicle-machine starting event of the vehicle, and sending out a first ultrasonic heartbeat packet;

and detecting the vehicle machine closing event of the vehicle, and sending out a second ultrasonic heartbeat packet.

Optionally, the effective time period of the first ultrasonic heartbeat packet is longer than the period of sending the ultrasonic heartbeat packet; and/or

The effective duration of the second ultrasonic heartbeat packet is smaller than the period of sending the ultrasonic heartbeat packet.

Optionally, the first device receives the ultrasonic heartbeat packet, and in the effective duration of the ultrasonic heartbeat packet, the first device is not awakened by the received voice awakening instruction, including:

the first equipment receives the ultrasonic heartbeat packet, and the voice awakening state of the first equipment is kept to be a suppressed awakening state within the effective duration of the ultrasonic heartbeat packet so that the first equipment is not awakened by the received voice awakening instruction;

Accordingly, the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and the first device wakes up in response to the received voice wake-up instruction, including:

the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and the voice wake-up state of the first device is switched to a normal wake-up state so as to be woken up by the first device in response to the received voice wake-up instruction.

Optionally, the first device and the second device remain in a network-free communication connection state.

According to a second aspect of embodiments of the present disclosure, there is provided a voice wake-up device comprising:

the sending module is configured to detect a target event of the second equipment and send out an ultrasonic signal;

the first wake-up module is configured to enable the first device to receive the ultrasonic signal, wherein the first device is not woken up by the received voice wake-up instruction;

and a second wake-up module configured to wake up the second device in response to the received voice wake-up instruction.

According to a third aspect of embodiments of the present disclosure, there is provided a vehicle having a vehicle body disposed therein,

The vehicle machine detects a target event of the vehicle and sends out an ultrasonic signal so that the ultrasonic signal is received by the mobile terminal and is not awakened by the received voice awakening instruction;

the vehicle is awakened in response to the received voice awakening instruction.

Optionally, the ultrasound signal comprises an ultrasound heartbeat packet;

the vehicle machine detects any event of a door opening event, a door closing event and a vehicle machine starting event of the vehicle and sends out a first ultrasonic heartbeat packet;

the vehicle detects the vehicle-to-machine closure event of the vehicle and sends out a second ultrasonic heartbeat packet.

Optionally, the vehicle and the mobile terminal maintain a network-free communication connection state.

According to a fourth aspect of embodiments of the present disclosure, there is provided a mobile terminal that receives an ultrasonic signal and is not awakened by a received voice wake-up instruction;

the vehicle machine sends out the ultrasonic signal when detecting the target event of the vehicle.

Optionally, the ultrasound signal comprises an ultrasound heartbeat packet;

the mobile terminal receives the ultrasonic heartbeat packet, and is not awakened by the received voice awakening instruction within the effective duration of the ultrasonic heartbeat packet.

Optionally, the mobile terminal does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and wakes up in response to the received voice wake-up instruction.

Optionally, the mobile terminal receives the ultrasonic heartbeat packet, and maintains the voice wake-up state as a suppressed wake-up state within the effective duration of the ultrasonic heartbeat packet so as not to be awakened by the received voice wake-up instruction;

and the mobile terminal does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, switches the voice awakening state into a normal awakening state, and awakens in response to the received voice awakening instruction.

Optionally, the mobile terminal and the vehicle machine maintain a network-free communication connection state.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the voice wake method provided by the first aspect of the present disclosure.

By adopting the technical scheme, the target event of the second equipment is detected to send out the ultrasonic signal, the first equipment receives the ultrasonic signal and is not awakened by the received voice awakening instruction, and the second equipment is awakened in response to the received voice awakening instruction. Therefore, the first equipment is not awakened by the received voice awakening instruction through the ultrasonic signal, the second equipment is awakened when receiving the voice awakening instruction, a plurality of equipment is prevented from being awakened simultaneously, the intelligent degree of equipment voice awakening is improved, and the user experience is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic diagram of an application scenario of a voice wake method according to an exemplary embodiment.

Fig. 2 is a flow chart illustrating a method of voice wakeup according to an example embodiment.

Fig. 3 is a schematic diagram illustrating voice wake-up of a mobile terminal and a car machine according to an exemplary embodiment.

Fig. 4 is a block diagram illustrating a voice wake apparatus in accordance with an exemplary embodiment.

FIG. 5 is a block diagram of a vehicle, according to an exemplary embodiment.

Fig. 6 is a block diagram of a mobile terminal according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

It should be noted that, all actions of acquiring signals, information or data in the present application are performed under the condition of conforming to the corresponding data protection rule policy of the country of the location and obtaining the authorization given by the owner of the corresponding device.

The collaborative wake-up function is to form a collaborative wake-up networking by the electronic devices belonging to the same account, and then decide which electronic device is to wake up in the networking. The collaborative wake-up function is used for networking a plurality of electronic devices depending on a public network, and when the public network is abnormal, the plurality of electronic devices cannot be networked, so that collaborative wake-up failure among the plurality of electronic devices can be caused. For example, after a user brings a mobile phone onto the vehicle, the user can wake up the vehicle and the mobile phone simultaneously because the vehicle passes through a bridge hole, a tunnel, a remote area and other places with poor public network signals in the driving process, so that the cooperative wake-up networking between the mobile phone and the vehicle of the vehicle is disconnected.

In addition, when a plurality of users carry mobile phones to get on the car, under the condition of shouting wake-up words, the collaborative wake-up networking is utilized, so that equipment located in the same networking can only be prevented from being simultaneously awakened, and mobile phones carried by the plurality of users are not located in the same networking, so that a plurality of equipment, such as car machines and mobile phones not located in the same networking, can be caused to be simultaneously awakened.

It should be appreciated that a device waking up simultaneously not only characterizes multiple devices waking up at the same time, but also characterizes multiple devices all in a wake-up state during the same time period, e.g., the multiple devices are in the same zone of time.

In view of the above, the present disclosure provides a voice wake-up method, apparatus, vehicle, mobile terminal and storage medium, which avoid multiple devices to wake up simultaneously, and improve the user experience.

First, an application scenario of the voice wake method provided by the present disclosure is described. The scenario includes a first device and a second device. The first device and the second device both support a voice wake-up function and wake-up words are the same, and the first device and the second device are located in the same area, where the area may be determined according to a maximum range in which the devices can detect voice, so that the first device and the second device located in the area can both receive voice output by a voice output object, where the voice output object may be an electronic device for outputting voice, or may be a user, for example, a driver.

Illustratively, fig. 1 is a schematic diagram of an applicable scenario of a voice wake method according to an exemplary embodiment. As shown in fig. 1, the first device is a mobile terminal 10 and the second device is a vehicle 20. The mobile terminal 10 is located within a vehicle 20. The mobile terminal 10 may be a tablet computer (Pad), a mobile phone, a computer, etc. having an ultrasonic detection function. The present disclosure is not limited in this regard. As shown in fig. 2, a vehicle machine 201 is further disposed in the vehicle 20, and the vehicle 20 can wake up by voice through the vehicle machine 201. Further, a device that emits an ultrasonic signal is provided in the vehicle 20, for example, a speaker through which an ultrasonic signal is emitted is provided in the vehicle 20.

It should be understood that, in the present disclosure, the number of the first devices may be one or more, and the first devices and the second devices may be different devices under the same account number, or may be different devices under different account numbers, which is not specifically limited in this disclosure.

Fig. 2 is a flow chart illustrating a voice wakeup method according to an example embodiment, which may be applied to the scenario shown in fig. 1. As shown in fig. 2, the voice wakeup method may include the following steps.

In step S21, a target event of the second device is detected, and an ultrasonic signal is emitted.

In step S22, the first device receives the ultrasonic signal, and the first device is not awakened by the received voice wake instruction.

In step S23, the second device wakes up in response to the received voice wake instruction.

In the present disclosure, the wake-up priority may be determined according to the importance levels of the first device and the second device. For example, if the importance level of the second device is higher than that of the first device, the wake-up priority of the second device is higher than that of the first device, that is, the second device wakes up directly when receiving the voice wake-up instruction, and in the case that the second device wakes up, the first device is controlled not to wake up by the received voice wake-up instruction. As another example, if the importance level of the first device is higher than that of the second device, the wake-up priority of the first device is higher than that of the second device, that is, the first device wakes up directly when receiving the voice wake-up instruction, and in the case that the first device wakes up, the second device is controlled not to wake up by the received voice wake-up instruction. The present disclosure is described with respect to the wake-up priority of the second device being higher than the wake-up priority of the first device. The voice wake-up instruction comprises a preset wake-up word.

In the example of taking the first device as the mobile terminal and taking the second device as the vehicle as an example, the priority of the vehicle is generally higher than that of the mobile terminal in consideration of the safety problem during the running of the vehicle, so that the vehicle is generally defaulted to be woken up directly in response to the voice wake-up instruction when receiving the voice wake-up instruction. In order to avoid simultaneous wake-up of the mobile terminal and the vehicle, an ultrasonic signal is sent out when a target event of the vehicle is detected, and the mobile terminal is not awakened by a received voice wake-up instruction when receiving the ultrasonic signal. Wherein, be provided with car machine in the vehicle, the vehicle realizes the pronunciation awakening through this car machine.

In one embodiment, the voice wakeup method shown in FIG. 2 may be performed by a third party device. For example, the third device or the server may send out an ultrasonic signal when detecting a target event of the second device, and when the first device receives the ultrasonic signal, control the first device not to wake up by the received voice wake-up instruction, and control the second device to wake up in response to the received voice wake-up instruction.

In another embodiment, the first device and the second device each perform a respective step. For example, the second device emits an ultrasonic signal when detecting the target event, the first device is not awakened by the received voice wake-up instruction when receiving the ultrasonic signal, and the second device is awakened when receiving the voice wake-up instruction. For convenience of description, the following will be described by taking an example in which the first device and the second device perform the respective steps, respectively.

It should be understood at first that the first device has an ultrasonic detection function, and the ultrasonic detection function can be in an on state or an off state by a user's operation, and in this disclosure, the user may previously turn on the ultrasonic detection function of the first device, and thus the ultrasonic detection function thereof is already in an on state when the mobile terminal approaches the vehicle.

It should be further appreciated that embodiments in which the second device wakes up upon receipt of a voice wake instruction are well established techniques, which are not specifically limited by the present disclosure.

It should again be appreciated that the present disclosure does not specifically limit the execution steps of step S22 and step S23. For example, as shown in fig. 2, step S22 may be performed first and then step S23 may be performed. For another example, step S22 and step S23 may be performed simultaneously. For another example, step S23 may be performed first and then step S22 may be performed.

To facilitate a better understanding of the voice wakeup method provided by the present disclosure, a complete embodiment of the voice wakeup method is described below.

In one embodiment, in the case of weak network signals or no network, the first device and the second device cannot be networked, and the first device and/or the second device cannot use bluetooth, that is, cannot realize co-wakeup through network communication connection such as networking or bluetooth broadcasting to avoid simultaneous wakeup of multiple devices. At this time, the voice wake-up method provided by the present disclosure can avoid that a plurality of devices wake up at the same time.

Thus, in this embodiment, the voice wake-up method shown in fig. 2 is performed when the first device and the second device cannot establish a network communication connection, that is, when the first device and the second device remain in a network communication connection-free state. In this way, when the network signal is poor, the first device and the second device can be ensured not to wake up at the same time, that is, the problem that a plurality of devices wake up at the same time is further avoided.

In one embodiment, the ultrasonic signal is periodically transmitted upon detection of a target event of the vehicle. For example, the ultrasound signal includes an ultrasound heartbeat packet that is periodically transmitted upon detection of a target event of the vehicle.

Accordingly, the specific implementation manner of step S22 is as follows: the first device receives the ultrasonic heartbeat packet, and the first device is not awakened by the received voice awakening instruction within the effective duration of the ultrasonic heartbeat packet.

The first device may acquire the effective duration of the ultrasonic heartbeat packet from the ultrasonic heartbeat packet when the first device receives the ultrasonic heartbeat packet. Also for example, the effective duration of the ultrasonic heartbeat packet may be pre-agreed, and when the first device receives the ultrasonic heartbeat packet, the effective duration of the ultrasonic heartbeat packet may be determined according to the pre-agreed effective duration of the ultrasonic heartbeat packet. Thus, when the first device receives the ultrasonic heartbeat packet, the first device is not awakened by the received voice awakening instruction within the effective duration of the ultrasonic heartbeat packet. The effective duration of the ultrasonic heartbeat packet may be a customized value, for example, the effective duration of the ultrasonic heartbeat packet ranges from 5min to 10min. And, the effective durations of the different ultrasonic heartbeat packages may be the same or different, which is not particularly limited by the present disclosure.

In one embodiment, the first device may not be awakened by the received voice wake instruction by: the first equipment receives the ultrasonic heartbeat packet, and the voice awakening state of the first equipment is kept to be the inhibited awakening state within the effective duration of the ultrasonic heartbeat packet, so that the first equipment is not awakened by the received voice awakening instruction.

For example, when receiving an ultrasonic heartbeat packet, the first device switches its voice wake-up state to a wake-up suppression state, and keeps the voice wake-up state in the wake-up suppression state all the time within the effective duration of the ultrasonic heartbeat packet, so that when the first device recognizes a voice wake-up instruction from voice audio according to the voice wake-up engine, the co-wake-up module of the first device determines that the first device is not woken up.

In another embodiment, the voice wake method further comprises: the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and the first device wakes up in response to the received voice wake-up instruction.

Considering that after the user gets off with the mobile terminal, the user may need to wake up the mobile terminal by voice, or wake up an application in the mobile terminal by voice, therefore, when the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, the vehicle machine and the mobile terminal are considered not to be in the same area, and at this time, in order to meet the user requirement, the first device can be waken up under the voice wake-up instruction output by the user.

In one embodiment, the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and switches the voice wake state of the first device to a normal wake state to wake by the first device in response to the received voice wake instruction.

By adopting the technology, when the first equipment does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, the first equipment is awakened in response to the received voice awakening instruction, so that when the first equipment and the second equipment are not in the same area, the first equipment can be awakened normally by the voice awakening instruction, the requirement of voice awakening of the first equipment of a user is met, and the user experience is improved.

It should be appreciated that, due to the limited duration of the validity period of the ultrasonic heartbeat packet, in order to avoid the problem of the vehicle machine and the mobile terminal waking up at the same time due to the failure of the ultrasonic heartbeat packet when the mobile terminal is in the vehicle, in the present disclosure, the vehicle periodically transmits the ultrasonic heartbeat packet when detecting its own target event. For example, assuming that the period of transmitting the ultrasonic heartbeat packet is 5 minutes, the vehicle transmits the ultrasonic heartbeat packet every 5 minutes when detecting the own target event.

In addition, it is considered that if the period of sending the ultrasonic heartbeat packet is longer than the valid period of the ultrasonic heartbeat packet, before the next ultrasonic heartbeat packet is not received, the current ultrasonic heartbeat packet is invalid, which may cause a problem that the first device is awakened by receiving the voice awakening instruction. For example, in the period from the termination time of the effective duration of the current ultrasonic heartbeat packet to the time period when the next ultrasonic heartbeat packet is received, the mobile terminal is awakened if receiving a voice awakening instruction, which never causes multiple devices to be awakened at the same time. Therefore, in order to further avoid that a plurality of devices wake up at the same time, in an embodiment, when the mobile terminal and the vehicle are located in the same area, the valid period of the ultrasonic heartbeat packet is longer than or equal to the period of sending the ultrasonic heartbeat packet, so as to ensure that the ultrasonic heartbeat packet is received again before the failure of the ultrasonic heartbeat packet, and avoid the situation that the mobile terminal is in the vehicle and the ultrasonic heartbeat packet fails. For example, the validity period of the ultrasonic heartbeat packet is 10min, and the period of transmitting the ultrasonic heartbeat packet is 5min.

In the present disclosure, the target event is an event capable of reflecting a change in the number of devices supporting the voice wakeup function existing in the same area. It should be appreciated that when a user carries a mobile terminal into a vehicle, the operations of opening and closing the door are typically performed, i.e., the opening and closing of the door may vary the number of devices supporting the voice wake function that are present in the same area. In addition, when the vehicle is turned on and off, the number of devices supporting the voice wake-up function in the same area may be affected, for example, when the vehicle is turned on, the number of devices supporting the voice wake-up function in the same area may be increased, and when the vehicle is turned off, the number of devices supporting the voice wake-up function in the same area may be decreased.

Thus, in one embodiment, the second device is a vehicle and the vehicle has a vehicle mounted therein, and the target event may include at least one of the following events: a door open event, a door close event, a door start event, and a door close event.

In this embodiment, upon detection of any one of a door open event, a door close event, a door start event, and a door close event of the vehicle, an ultrasonic signal is emitted for a period of time. For example, a door open event of a vehicle is detected and an ultrasonic signal is emitted for a period of time.

In one embodiment, the ultrasonic signal may be emitted through a speaker disposed within the vehicle. It should be appreciated that a plurality of speakers are typically provided within the vehicle, and in this embodiment, some of the plurality of speakers may be controlled to emit ultrasonic signals. For example, a loudspeaker is arranged at each door of the vehicle, when a door opening event or a door closing event is detected, the loudspeaker arranged at the opened door or the closed door can be controlled to emit ultrasonic signals, so that the distance between a mobile terminal for detecting the ultrasonic signals and the loudspeaker emitting the ultrasonic signals is relatively short, the mobile terminal can accurately receive the ultrasonic signals, and on the other hand, the ultrasonic signals are generated by using part of the loudspeakers, so that mutual interference of the ultrasonic signals is avoided.

Furthermore, it is contemplated that different target events reflect different changes in the number of devices supporting the voice wakeup function that are present within the same area. For example, the door opening event, the door closing event and the door machine starting event may increase the number of devices supporting the voice wake-up function existing in the same area, that is, the probability that multiple devices wake up simultaneously is large, and thus any one of the door opening event, the door closing event and the door machine starting event of the vehicle is detected, and the first ultrasonic heartbeat packet is sent out. The vehicle-machine closing event can reduce the number of devices supporting the voice wake-up function existing in the same area, namely, the probability of simultaneous wake-up of multiple devices is reduced, so that the vehicle-machine closing event of a vehicle is detected, and a second ultrasonic heartbeat packet is sent out. Wherein the second ultrasound heartbeat packet is different from the first ultrasound heartbeat packet.

To further avoid simultaneous wake-up of multiple devices, the effective time period of the first ultrasonic heartbeat packet is longer than the period of sending the ultrasonic heartbeat packet. And/or, in order to facilitate the mobile terminal to quickly recover to the normal wake-up state after the vehicle is turned off so as to meet the requirement of the user on waking up the first device by voice, the effective duration of the second ultrasonic heartbeat packet is smaller than the period of sending the ultrasonic heartbeat packet. Illustratively, the effective duration of the second ultrasonic heartbeat packet is 0 or a value slightly greater than 0, e.g., the effective duration of the second ultrasonic heartbeat packet is in the range of 0s-5s.

It should be understood that, in practical applications, a door opening event and a door closing event may also occur to a vehicle when the user gets off with the mobile terminal, but in order to avoid misjudging that the event that the user gets on with the mobile terminal is the event that the user gets off with the mobile terminal, the door opening event and/or the door closing event are determined as events that increase the number of devices supporting the voice wake function existing in the same area, so in this disclosure, preferably, the first ultrasonic heartbeat packet is sent when the door opening event and/or the door closing event of the vehicle is detected. Therefore, the problem that the mobile terminal and the vehicle machine are simultaneously awakened can be further avoided.

Fig. 3 is a schematic diagram illustrating voice wake-up of a mobile terminal and a car machine according to an exemplary embodiment. As shown in fig. 3, the vehicle detects that the door is open, periodically transmits a first ultrasonic heartbeat packet, and the vehicle detects that the door is closed, periodically transmits a first ultrasonic heartbeat packet, and the mobile terminal receives the first ultrasonic heartbeat packet. When the mobile terminal receives the first ultrasonic heartbeat packet, the voice awakening state is kept to be the awakening inhibition state within the effective duration of the ultrasonic heartbeat packet. Then, the car machine detects the voice wake-up instruction, and the mobile terminal also detects the voice wake-up instruction.

It should be understood that the detection rate of the voice wake instruction by the wake engines of the car set and the mobile terminal may be the same or different. For example, in fig. 3, the rate of detection of a voice wake instruction by the wake engine of the vehicle is greater than the rate of detection of a voice wake instruction by the wake engine of the mobile terminal, so the time when the wake engine of the vehicle detects a voice wake instruction is earlier than the time when the wake engine of the mobile terminal detects a voice wake instruction.

And then, the vehicle-mounted device sends the detected voice wake-up instruction to a cooperative wake-up module of the vehicle-mounted device, and the cooperative wake-up module of the vehicle-mounted device judges that the vehicle-mounted device is awakened, namely, the vehicle-mounted device is awakened. Meanwhile, the mobile terminal sends a wake-up event to a cooperative wake-up module of the mobile terminal to judge, and when the cooperative wake-up module determines that the voice wake-up state of the mobile terminal is the inhibited wake-up state, the mobile terminal is judged not to be awakened by the voice wake-up instruction, namely, the mobile terminal is not awakened. And finally, the mobile terminal does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and the voice awakening state is switched to the normal awakening state.

Based on the same inventive concept, the present disclosure also provides a voice wake-up device. Fig. 4 is a block diagram illustrating a voice wake apparatus in accordance with an exemplary embodiment. As shown in fig. 4, the voice wakeup apparatus 400 includes:

a transmitting module 401 configured to detect a target event of the second device and transmit an ultrasonic signal;

a first wake-up module 402 configured to receive the ultrasonic signal by a first device that is not woken up by the received voice wake-up instruction;

a second wake-up module 403 configured to wake-up the second device in response to the received voice wake-up instruction.

Optionally, the ultrasound signal comprises an ultrasound heartbeat packet; the first wake-up module 402 is configured to: the first device receives the ultrasonic heartbeat packet, and the first device is not awakened by the received voice awakening instruction within the effective duration of the ultrasonic heartbeat packet.

Optionally, the voice wake apparatus 400 further includes:

and the third awakening module is configured to enable the first device to respond to the received voice awakening instruction without receiving the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet.

Optionally, the sending module 401 is configured to: detecting any one of the door opening event, the door closing event and the vehicle-machine starting event of the vehicle, and sending out a first ultrasonic heartbeat packet;

Optionally, the effective time period of the first ultrasonic heartbeat packet is longer than the period of sending the ultrasonic heartbeat packet; and/or the effective duration of the second ultrasonic heartbeat packet is less than the period of sending the ultrasonic heartbeat packet.

Optionally, the first wake-up module 402 is configured to: the first equipment receives the ultrasonic heartbeat packet, and the voice awakening state of the first equipment is kept to be a suppressed awakening state within the effective duration of the ultrasonic heartbeat packet so that the first equipment is not awakened by the received voice awakening instruction;

accordingly, the third wake-up module is configured to: the first device does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet, and the voice wake-up state of the first device is switched to a normal wake-up state so as to be woken up by the first device in response to the received voice wake-up instruction.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

The present disclosure also provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the voice wakeup method provided by the present disclosure.

Based on the same inventive concept, the present disclosure also provides a vehicle, in which a vehicle body is provided,

Optionally, the ultrasound signal comprises an ultrasound heartbeat packet;

FIG. 5 is a block diagram of a vehicle, according to an exemplary embodiment. For example, the vehicle may be a hybrid vehicle, but may also be a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other type of vehicle. The vehicle may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

Referring to fig. 5, a vehicle may include various subsystems, such as an infotainment system 510, a perception system 520, a decision control system 530, a drive system 540, and a computing platform 550. Wherein the vehicle may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, interconnections between each subsystem and each component of the vehicle may be made by wired or wireless means.

In some embodiments, the infotainment system 510 may include a communication system, an entertainment system, a navigation system, and the like.

The sensing system 520 may include several sensors for sensing information of the environment surrounding the vehicle. For example, the sensing system 520 may include a global positioning system (which may be a GPS system, a beidou system, or other positioning system), an inertial measurement unit (inertial measurement unit, IMU), a lidar, millimeter wave radar, an ultrasonic radar, and a camera device. In addition, the perception system 520 may also detect whether a target event has occurred with the vehicle, the target event including at least one of: a door open event, a door close event, a door start event, and a door close event.

Decision control system 530 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

The drive system 540 may include components that provide powered movement of the vehicle. In one embodiment, the drive system 540 may include an engine, an energy source, a transmission, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, an air compression engine. The engine is capable of converting energy provided by the energy source into mechanical energy.

Some or all of the functions of the vehicle are controlled by the computing platform 550. The computing platform 550 may include at least one processor 551 and memory 552, and the processor 551 may execute instructions 553 stored in the memory 552.

The processor 551 may be any conventional processor, such as a commercially available CPU. The processor may also include, for example, an image processor (Graphic Process Unit, GPU), a field programmable gate array (Field Programmable Gate Array, FPGA), a System On Chip (SOC), an application specific integrated Chip (Application Specific Integrated Circuit, ASIC), or a combination thereof.

The memory 552 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

In addition to instructions 553, the memory 552 may also store data such as road maps, route information, vehicle position, direction, speed, preset voice wake words, ultrasound signals, and the like. The data stored by memory 552 may be used by computing platform 550.

In an embodiment of the present disclosure, the processor 551 may execute instructions 553 to complete all or part of the steps of the voice wakeup method described above.

Based on the same inventive concept, the present disclosure also provides a mobile terminal, which receives an ultrasonic signal and is not awakened by a received voice awakening instruction;

Optionally, the ultrasound signal comprises an ultrasound heartbeat packet;

Fig. 6 is a block diagram of a mobile terminal according to an exemplary embodiment. For example, the mobile terminal may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, or the like.

Referring to fig. 6, a mobile terminal may include one or more of the following components: a processing component 602, a memory 604, a power component 606, a multimedia component 608, an audio component 610, an input/output interface 612, a sensor component 614, and a communication component 616.

The processing component 602 generally controls overall operation of the mobile terminal, such as operations associated with display, telephone call, data communication, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 602 can include one or more modules that facilitate interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.

The memory 604 is configured to store various types of data to support operations at the mobile terminal. Examples of such data include instructions for any application or method operating on the mobile terminal, contact data, phonebook data, messages, pictures, video, preset voice wake-up words, and the like. The memory 604 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply component 606 provides power to the various components of the mobile terminal. The power supply components 606 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the mobile terminal.

The multimedia component 608 comprises a screen between the mobile terminal and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and/or a rear camera. When the mobile terminal is in an operation mode, such as a photographing mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 610 is configured to output and/or input audio signals. For example, the audio component 610 includes a Microphone (MIC) configured to receive external audio signals when the mobile terminal is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 604 or transmitted via the communication component 616. In some embodiments, audio component 610 further includes a speaker for outputting audio signals.

The input/output interface 612 provides an interface between the processing component 602 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 614 includes one or more sensors for providing status assessment of various aspects of the mobile terminal. For example, the sensor assembly 614 may detect the open/closed state of the mobile terminal, the relative positioning of the components, such as the display and keypad of the mobile terminal, the sensor assembly 614 may also detect the change in position of the mobile terminal or one of the components of the mobile terminal, the presence or absence of user contact with the mobile terminal, the orientation or acceleration/deceleration of the mobile terminal, and the change in temperature of the mobile terminal. The sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 616 is configured to facilitate communication between the mobile terminal and other devices, either wired or wireless. The mobile terminal may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 616 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 616 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the mobile terminal may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 604, including instructions executable by processor 620 of the mobile terminal to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

In another exemplary embodiment, a computer program product is also provided, comprising a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-described voice wake-up method when executed by the programmable apparatus.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A voice wakeup method, characterized in that the voice wakeup method comprises:

the second device wakes up in response to the received voice wake instruction.

2. The voice wakeup method of claim 1, wherein the ultrasonic signal includes an ultrasonic heartbeat packet; the first device receives the ultrasonic signal, the first device is not awakened by the received voice awakening instruction, and the method comprises the following steps:

3. The voice wakeup method according to claim 2, wherein the voice wakeup method further includes:

4. The voice wakeup method of claim 2, wherein the first device is a vehicle, the vehicle having a vehicle mounted therein, the target event comprising at least one of: a door open event, a door close event, a door start event, and a door close event.

5. The method of claim 4, wherein detecting the target event of the second device, emitting the ultrasonic signal, comprises:

6. The voice wakeup method of claim 5, wherein the active time period of the first ultrasonic heartbeat packet is longer than the period of sending the ultrasonic heartbeat packet; and/or

7. The voice wakeup method of claim 3, wherein the first device receiving the ultrasonic heartbeat packet is not awakened by the received voice wakeup instruction for a valid duration of the ultrasonic heartbeat packet, comprising:

8. The voice wakeup method according to any one of claims 1 to 7, wherein the first device and the second device remain in a network-free communication connection state.

9. A voice wakeup device, the voice wakeup device comprising:

10. A vehicle is characterized in that a vehicle body is arranged in the vehicle,

11. The vehicle of claim 10, wherein the ultrasonic signal comprises an ultrasonic heartbeat packet;

12. A vehicle according to claim 10 or 11, characterized in that,

and the vehicle machine and the mobile terminal are kept in a network-free communication connection state.

13. The mobile terminal is characterized in that the mobile terminal receives an ultrasonic signal and is not awakened by a received voice awakening instruction;

14. The mobile terminal of claim 13, wherein the ultrasound signal comprises an ultrasound heartbeat packet;

15. The mobile terminal of claim 14, wherein the mobile terminal comprises a mobile terminal,

and the mobile terminal does not receive the ultrasonic heartbeat packet within the effective duration of the ultrasonic heartbeat packet and wakes up in response to the received voice wake-up instruction.

16. The mobile terminal of claim 15, wherein the mobile terminal comprises a mobile terminal,

the mobile terminal receives the ultrasonic heartbeat packet, and keeps the voice awakening state as the inhibited awakening state within the effective duration of the ultrasonic heartbeat packet so as not to be awakened by the received voice awakening instruction;

17. The mobile terminal according to any of the claims 13-16, characterized in that,

and the mobile terminal and the vehicle machine are kept in a network-free communication connection state.

18. A computer readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the steps of the method of any of claims 1-8.