CN116682428A

CN116682428A - Voice wakeup method and device, mobile terminal, vehicle and storage medium

Info

Publication number: CN116682428A
Application number: CN202310781145.9A
Authority: CN
Inventors: 黄风云
Original assignee: Beijing Xiaomi Pinecone Electronic Co Ltd; Xiaomi Automobile Technology Co Ltd
Current assignee: Beijing Xiaomi Pinecone Electronic Co Ltd; Xiaomi Automobile Technology Co Ltd
Priority date: 2023-06-28
Filing date: 2023-06-28
Publication date: 2023-09-01

Abstract

The disclosure relates to a voice awakening method, a voice awakening device, a mobile terminal, a vehicle and a storage medium. The first device is in communication connection with the second device, the method comprising: determining a voice wake-up state of the second device; if the voice wake-up state of the second device is a response prohibition state, the first device is awakened in response to the received voice wake-up instruction, and the second device keeps the response prohibition state; if the voice wake-up state of the second device is not the forbidden response state, the first device is not woken up by the received voice wake-up instruction, and the second device is woken up in response to the received voice wake-up instruction. Thus, the problem that the first device and the second device wake up simultaneously is avoided. Thus, the intelligent degree of equipment voice awakening is improved, and the user experience of voice awakening is improved.

Description

Voice wakeup method and device, mobile terminal, vehicle and storage medium

Technical Field

The disclosure relates to the field of computer technology, and in particular relates to a voice wake-up method, a device, a mobile terminal, a vehicle and a storage medium.

Background

With the development of electronic devices, more and more electronic devices support a voice wake-up function. When a plurality of electronic devices supporting a voice wake-up function and having the same wake-up words are located in the same area, a problem of one hundred times of response is likely to occur, wherein the wake-up words are preset words for waking up the electronic devices. For example, the user shouts a sound of "colleagues", and then the colleagues on a plurality of electronic devices such as a mobile phone, a computer, a vehicle terminal and the like can be awakened at the same time. In the related art, the problem of one hundred kinds of response is solved through the collaborative wake-up function.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a voice wake-up method, a device, a mobile terminal, a vehicle and a storage medium.

According to a first aspect of embodiments of the present disclosure, there is provided a voice wake-up method, where a first device and a second device are in a communication connection state, the voice wake-up method including:

determining a voice wake-up state of the second device;

if the voice wake-up state of the second device is a response prohibition state, the first device is awakened in response to the received voice wake-up instruction, and the second device keeps the response prohibition state;

If the voice wake-up state of the second device is not the forbidden response state, the first device is not woken up by the received voice wake-up instruction, and the second device is woken up in response to the received voice wake-up instruction.

Optionally, the inhibit response state includes at least one of a voice wake function being in an off state, a microphone being in a disabled state, and the second device being in a mute state.

Optionally, the first device and the second device have a near field communication function, and the voice wake-up method further includes:

a near field communication connection is established between the first device and the second device.

Optionally, the establishing a near field communication connection between the first device and the second device includes:

starting Bluetooth functions of a first device and a second device to establish Bluetooth connection between the first device and the second device;

the first device and the second device perform bluetooth communication to establish a wireless local area network connection between the first device and the second device.

Optionally, if the voice wake state of the second device is not the disable response state, the first device is not woken up by the received voice wake instruction, including:

And if the voice wake-up state of the second equipment is not the forbidden response state, switching the voice wake-up state of the first equipment into the forbidden wake-up state so that the first equipment is not awakened by the received voice wake-up instruction.

Optionally, the voice wake-up method further includes:

and if the near field communication connection between the first equipment and the second equipment is disconnected, communication is carried out through a public network so that the first equipment and the second equipment are in a communication connection state.

Optionally, the first device is a mobile terminal, the second device is a vehicle, and a vehicle machine is arranged in the vehicle.

According to a second aspect of embodiments of the present disclosure, there is provided a voice wake-up apparatus, in which a first device and a second device are in a communication connection state, the voice wake-up apparatus including:

a first determination module configured to determine a voice wake state of the second device;

the first wake-up module is configured to wake up the first device in response to the received voice wake-up instruction if the state of the second device is a forbidden response state, and the second device keeps the forbidden response state;

and the second wake-up module is configured to enable the first device to wake up in response to the received voice wake-up instruction if the voice wake-up state of the second device is not the forbidden response state.

According to a third aspect of embodiments of the present disclosure, there is provided a mobile terminal,

the mobile terminal is in a communication connection state with a vehicle, and a voice awakening state of a vehicle machine of the vehicle is determined;

if the state of the vehicle is a forbidden response state, the mobile terminal is awakened in response to the received voice awakening instruction; and

if the voice wake-up state of the vehicle is not the forbidden response state, the mobile terminal is not woken up by the received voice wake-up instruction.

Optionally, the mobile terminal has a near field communication function, and a near field communication connection is established with the vehicle.

Optionally, the mobile terminal starts a bluetooth function to establish bluetooth connection with the vehicle machine;

and the mobile terminal establishes wireless local area network connection with the vehicle machine through Bluetooth communication with the vehicle.

Optionally, if the voice wake-up state of the vehicle is not the forbidden response state, the mobile terminal switches the voice wake-up state of the mobile terminal to the forbidden wake-up state so as not to be awakened by the received voice wake-up instruction.

According to a third aspect of embodiments of the present disclosure, there is provided a vehicle provided with an in-vehicle machine,

The vehicle is in a communication connection state with the mobile terminal through the vehicle machine, and the voice awakening state of the vehicle machine is determined;

if the voice awakening state of the vehicle is a forbidden response state, the vehicle keeps the forbidden response state, and the mobile terminal is determined to be awakened; and

and if the voice wake-up state of the vehicle is not the forbidden response state, the vehicle is woken up in response to the received voice wake-up instruction, and the mobile terminal is judged not to be woken up.

Optionally, the vehicle has a near field communication function, and a near field communication connection is established with the mobile terminal.

Optionally, the car machine starts a bluetooth function to establish bluetooth connection with the mobile terminal;

and the vehicle machine establishes wireless local area network connection with the mobile terminal through Bluetooth communication with the mobile terminal.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the voice wake method provided by the first aspect of the present disclosure.

The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:

By adopting the technical scheme, when the voice awakening state of the second equipment is the forbidden response state, the first equipment is awakened in response to the received voice awakening instruction, and the second equipment keeps the forbidden response state, namely, the first equipment is awakened by the voice awakening instruction under the condition that the second equipment is not awakened by the voice awakening instruction, so that the problem that the first equipment and the second equipment are not awakened is avoided. In addition, when the second equipment is awakened by the voice awakening instruction, the first equipment is not awakened by the voice awakening instruction, so that the problem that the first equipment and the second equipment are awakened simultaneously is avoided. Thus, the intelligent degree of equipment voice awakening is improved, and the user experience of voice awakening is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic diagram of an application scenario of a voice wake method according to an exemplary embodiment.

Fig. 2 is a schematic diagram of an application scenario illustrating another voice wakeup method according to an example embodiment.

Fig. 3 is a flow chart illustrating a method of voice wakeup according to an example embodiment.

Fig. 4 is a schematic diagram illustrating a mobile terminal and a car wake-up according to an exemplary embodiment.

Fig. 5 is a block diagram illustrating a voice wake apparatus in accordance with an exemplary embodiment.

Fig. 6 is a block diagram of a mobile terminal according to an exemplary embodiment.

Fig. 7 is a block diagram of a vehicle, according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

It should be noted that, all actions for acquiring signals, information or data in the present disclosure are performed under the condition of conforming to the corresponding data protection rule policy of the country of the location and obtaining the authorization given by the owner of the corresponding device.

The collaborative wake-up function is to form a collaborative wake-up networking by the electronic devices belonging to the same account, and then decide which electronic device is to wake up in the networking. The collaborative wake-up function is used for networking a plurality of electronic devices depending on a public network, and when the public network is abnormal, the plurality of electronic devices cannot be networked, so that collaborative wake-up failure among the plurality of electronic devices can be caused. For example, after a user brings a mobile phone onto the vehicle, the user can wake up the vehicle and the mobile phone simultaneously because the vehicle passes through a bridge hole, a tunnel, a remote area and other places with poor public network signals in the driving process, so that the cooperative wake-up networking between the mobile phone and the vehicle of the vehicle is disconnected.

It should be appreciated that the device waking up simultaneously is not only an indication that multiple devices are waking up at the same time, but also that multiple devices are all in a wake-up state for the same period of time, e.g., a period of time that the multiple devices are in the same area.

In view of this, the disclosure provides a voice wake-up method, a device, a mobile terminal, a vehicle and a storage medium, which avoid a plurality of devices to wake up simultaneously when a public network signal is poor, and promote the use experience of a user.

First, an application scenario of the voice wake method provided by the present disclosure is described. Fig. 1 is a schematic diagram of an application scenario of a voice wake method according to an exemplary embodiment. As shown in fig. 1, the scenario includes a first device and a second device. The first device and the second device are in a communication connection state. The first device and the second device both support a voice wake-up function and wake-up words are the same, and the first device and the second device are located in the same area, where the area may be determined according to a maximum range in which the devices can detect voice, so that the first device and the second device located in the area can both receive voice output by a voice output object, where the voice output object may be an electronic device for outputting voice, or may be a user, for example, a driver.

Illustratively, as shown in FIG. 1, the first device is a mobile terminal 10 and the second device is a vehicle 20. Wherein the mobile terminal 10 is located in an area proximate to the vehicle 20, as shown in fig. 1. Fig. 2 is a schematic diagram of an application scenario illustrating another voice wakeup method according to an example embodiment. As shown in fig. 2, the mobile terminal 10 is located within a vehicle 20. In fig. 1 and 2, a car machine 201 is provided in a vehicle 20, a voice wake-up function of the vehicle 20 refers to a voice wake-up function of the car machine 201, a vehicle wake-up refers to a car machine wake-up, and the vehicle 20 communicates with a mobile terminal 10 through the car machine 201. The mobile terminal 10 may be a tablet computer (Pad), a mobile phone, a computer, etc. having a communication function. The present disclosure is not limited in this regard.

It should be understood that, in the present disclosure, the number of the first devices may be multiple, and the number of the first devices and the second devices may be different devices under the same account number, or may be different devices under different account numbers, that is, the number of the mobile terminals shown in fig. 1 and fig. 2 may be multiple, and the mobile terminals and the vehicle may belong to the same account number or may belong to different account numbers, which is not specifically limited in the present disclosure. In this disclosure, a first device and a second device are described as different devices under the same account.

Fig. 3 is a flowchart illustrating a voice wakeup method according to an exemplary embodiment, which may be applied to the scenario shown in fig. 1 or fig. 2, with the first device and the second device in a communication connection state. As shown in fig. 3, the voice wakeup method may include the following steps.

In step S21, a voice awake state of the second device is determined.

In the present disclosure, the wake-up priority may be determined according to the importance levels of the first device and the second device. For example, if the importance level of the second device is higher than that of the first device, the wake-up priority of the second device is higher than that of the first device, that is, the voice wake-up state of the second device is obtained, and whether the first device is woken up is determined based on the voice wake-up state of the second device. As another example, if the importance level of the first device is higher than that of the second device, the wake-up priority of the first device is higher than that of the second device, that is, the voice wake-up state of the first device is obtained, and then whether the second device is woken up is determined based on the voice wake-up state of the first device. The present disclosure is described with respect to the wake-up priority of the second device being higher than the wake-up priority of the first device.

In the present disclosure, a first device needs to determine a voice wake state of a second device, and likewise, the second device needs to determine its own voice wake state. For example, the second device may send a signal or event to the first device that characterizes its own voice wake state, and the first device may then determine the voice wake state of the second device based on the received signal or event.

It should be understood at first that the voice wake-up state of the second device may be set by the user, that is, the user may set the voice wake-up state of the second device according to actual requirements. It should be further appreciated that in the case where the second device is a vehicle, the voice wake state of the second device is by default a responsive state, i.e. the second device will wake up in response to the voice wake instruction after receiving the voice wake instruction by default.

In step S22, if the voice wake-up state of the second device is the disable response state, the first device is woken up in response to the received voice wake-up instruction, and the second device maintains the disable response state.

In step S23, if the voice wake-up state of the second device is not the disable response state, the first device is not woken up by the received voice wake-up instruction, and the second device is woken up in response to the received voice wake-up instruction.

In the present disclosure, the disable response state may include at least one of a voice wake function being in an off state, a microphone being in a disabled state, and a second device being in a mute state.

By way of example, a first device is taken as a mobile terminal, and a second device is taken as a vehicle. The mobile terminal is located in the vehicle, and the vehicle and the mobile terminal are in a communication connection state. The first device receives a voice wake instruction when the voice output object, e.g., a user, outputs the voice wake instruction. In addition, the second device may also receive the voice wake instruction when the second device is not in the disabled response state.

The following describes a specific embodiment of the first device receiving a voice wake instruction, taking the first device receiving the voice wake instruction as an example.

Illustratively, first, the user shouts a piece of speech, and the microphone of the first device captures the speech audio. And then, a wake-up engine in a collaborative wake-up module of the first device recognizes voice audio collected by the microphone and determines whether the voice audio comprises a voice wake-up instruction. And finally, determining that a voice wake-up instruction is received when the voice audio is recognized to comprise the voice wake-up instruction. For example, the voice wake instruction includes a target wake word, and if the target wake word is "college classmates", the wake engine determines that the voice wake instruction is received when it recognizes that the "college classmates" field is included in the voice audio.

When the second device is not in the response prohibition state, the manner in which the second device receives the voice wake-up instruction is the same as the manner in which the first device receives the voice wake-up instruction, which is not described in detail in this disclosure.

In one embodiment, the voice wake state of the second device is a disable response state, i.e., the second device is not woken up by the voice wake instruction, in order to avoid that neither the first device nor the second device is woken up, at which time the first device is woken up in response to the received voice wake instruction, and the second device remains in the disable response state.

For example, when receiving a voice wake instruction, the first device sends a wake event to a co-wake module of the first device, and the co-wake module makes a decision on the wake event. And when the voice wake-up state of the second device is a response prohibition state, the cooperative wake-up module judges that the first device is awakened, namely, the first device is awakened. Meanwhile, the cooperative wakeup module of the second device judges that the cooperative wakeup module is in a response keeping state.

In another embodiment, the voice wake state of the second device is not a disable response state, i.e., the second device is woken up in response to the received voice wake instruction, in order to avoid that the first device and the second device wake up simultaneously, the first device is not woken up by the received voice wake instruction.

For example, when the second device receives the voice wake instruction, the second device sends a wake event to a co-wake module of the second device, and the co-wake module makes a decision on the wake event. And when the voice wake-up state of the second equipment is not the response prohibition state, the cooperative wake-up module of the second equipment judges that the second equipment is awakened. Meanwhile, when the first device receives a voice wake-up instruction, a wake-up event is sent to a collaborative wake-up module of the first device, and the collaborative wake-up module judges the wake-up event. And when the voice wake-up state of the second device is not the response prohibition state, the cooperative wake-up module of the first device judges that the first device is not woken up.

By adopting the technical scheme, when the voice awakening state of the second equipment is the forbidden response state, the first equipment is awakened in response to the received voice awakening instruction, and the second equipment keeps the forbidden response state, namely, under the condition that the second equipment is not awakened by the voice awakening instruction, the first equipment is awakened by the voice awakening instruction, so that the problem that neither the first equipment nor the second equipment is awakened is avoided. In addition, when the second equipment is awakened by the voice awakening instruction, the first equipment is not awakened by the voice awakening instruction, so that the first equipment and the second equipment are prevented from being awakened simultaneously. Thus, the intelligent degree of equipment voice awakening is improved, and the user experience is improved.

To facilitate a better understanding of the voice wakeup method provided by the present disclosure, a complete embodiment of the voice wakeup method is described below.

In one embodiment, the first device and the second device have near field communication functionality. The voice wake-up method may further include: a near field communication connection is established between the first device and the second device.

For example, a near field communication connection may be established between the first device and the second device through an interconnection application or an underlying interconnection module on the mobile terminal, on-board the vehicle.

By adopting the technical scheme, the first equipment and the second equipment establish near field communication connection, when the public network is abnormal, the first equipment and the second equipment communicate through the near field communication technology, the problem that the first equipment and the second equipment are awakened simultaneously due to networking failure is avoided, and the user experience is improved.

In one implementation in this embodiment, the near field communication connection is a bluetooth connection. The first device and the second device have bluetooth functionality. The specific implementation mode of establishing the near field communication connection between the first device and the second device is as follows: the bluetooth functions of the first device and the second device are turned on to establish a bluetooth connection between the first device and the second device.

It should be understood that when a user brings the mobile terminal close to the vehicle, a bluetooth connection is established through an interconnection application or an underlying interconnection module on the mobile terminal and on the vehicle.

In this embodiment, after bluetooth connection is established between the mobile terminal and the vehicle, the mobile terminal sends a communication connection event to the co-wakeup module of the mobile terminal, and the vehicle sends the communication connection event to the co-wakeup module of the vehicle, so that the co-wakeup module of the mobile terminal and the co-wakeup module of the vehicle can learn that the mobile terminal and the vehicle are in a communication connection state.

In another implementation in this embodiment, the near field communication connection is a wireless local area network connection. In consideration of instability of Bluetooth communication, after Bluetooth connection is established between the first device and the second device, wireless local area network connection is established between the first device and the second device. Illustratively, bluetooth functions of the first device and the second device are turned on to establish a bluetooth connection between the first device and the second device; the first device and the second device communicate via bluetooth to establish a wireless local area network connection between the first device and the second device. In this embodiment, after the bluetooth connection is established, the first device and the second device perform bluetooth communication, i.e., data is transmitted through bluetooth, to establish a wireless local area network connection between the first device and the second device.

In this embodiment, after the wireless lan connection is established between the first device and the second device, the first device sends the communication connection event to the cooperative wake-up module of the first device, and the second device sends the communication connection event to the cooperative wake-up module of the second device, so that the cooperative wake-up module of the first device and the cooperative wake-up module of the second device can learn that the mobile terminal and the vehicle are in a communication connection state.

It should be appreciated that in other embodiments, the first device and the second device do not establish a bluetooth connection but instead establish a wireless local area network connection directly between the two. The present disclosure is not particularly limited thereto.

By adopting the technical scheme, the wireless local area network connection is established between the first equipment and the second equipment, and the first equipment and the second equipment are communicated through the wireless local area network, so that the stability of the communication between the first equipment and the second equipment is improved, the problem that the first equipment and the second equipment are awakened simultaneously or neither of the first equipment and the second equipment is awakened is further avoided, and the use experience of a user is improved.

In another embodiment, if the near field communication connection between the first device and the second device is disconnected, communication is performed through the public network, so that the first device and the second device are in a communication connection state.

In this embodiment, the first device and the second device prefer a near field communication connection, and in case the near field communication connection is broken, the first device and the second device communicate via the public network in order to enable co-wakeup. The first device and the second device are devices under the same account, and the cooperative wake-up networking is performed through the public network, so that the first device and the second device are in a communication connection state, and the purpose of cooperative wake-up is achieved.

Therefore, when the near field communication connection of the first equipment and the second equipment is disconnected, the first equipment and the second equipment communicate through the public network, so that collaborative wakeup is realized, and the flexibility of voice wakeup is improved.

In the following, in step S23 of fig. 3, a specific embodiment is described in which the first device is not awakened by the received voice wake-up instruction if the voice wake-up state of the second device is not the disable response state.

For example, if the voice wake state of the second device is not the disable response state, the specific implementation manner that the first device is not woken up by the received voice wake instruction is: if the voice wake-up state of the second device is not the response prohibition state, the voice wake-up state of the first device is switched to the wake-up suppression state, so that the first device is not awakened by the received voice wake-up instruction.

After the first equipment receives the voice wake-up instruction, the first equipment sends a wake-up event to a cooperative wake-up module of the first equipment, and the cooperative wake-up module judges the wake-up event. When the voice wake-up state of the first device is the wake-up suppression state, the cooperative wake-up module of the first device judges that the first device is not woken up. It will be appreciated that the inhibited wake-up state of the first device will be released when the first device and the second device are disconnected from communication.

Fig. 4 is a schematic diagram illustrating a mobile terminal and a car wake-up according to an exemplary embodiment. As shown in fig. 4, first, the vehicle sets up a communication connection with the mobile terminal, that is, the vehicle sets up an interconnection link with the mobile terminal, and the mobile terminal can sense a vehicle event. Then, the car machine detects the voice wake-up instruction, and the mobile terminal also detects the voice wake-up instruction.

It should be understood that the detection rate of the voice wake instruction by the wake engines of the car set and the mobile terminal may be the same or different. For example, in fig. 4, the rate of detection of a voice wake instruction by the wake engine of the vehicle is greater than the rate of detection of a voice wake instruction by the wake engine of the mobile terminal, so the time when the wake engine of the vehicle detects a voice wake instruction is earlier than the time when the wake engine of the mobile terminal detects a voice wake instruction.

And then, the vehicle-mounted device sends the detected voice wake-up instruction to a cooperative wake-up module of the vehicle-mounted device, and the cooperative wake-up module of the vehicle-mounted device judges that the vehicle-mounted device is awakened, namely, the vehicle-mounted device is awakened. Meanwhile, the mobile terminal sends a wake-up event to a cooperative wake-up module of the mobile terminal to judge, and when the cooperative wake-up module determines that the voice wake-up state of the mobile terminal is the inhibited wake-up state, the mobile terminal is judged not to be awakened by the voice wake-up instruction, namely, the mobile terminal is not awakened. And finally, after the interconnection link between the vehicle machine and the mobile terminal is disconnected, the mobile terminal cannot sense a vehicle event.

Based on the same inventive concept, the present disclosure also provides a voice wake-up device. Fig. 5 is a block diagram illustrating a voice wake apparatus in accordance with an exemplary embodiment. As shown in fig. 5, the voice wakeup apparatus 400 may include:

a first determining module 401 configured to determine a voice awake state of the second device;

a first wake-up module 402 configured to wake up the first device in response to the received voice wake-up instruction if the state of the second device is a disable response state, the second device maintaining the disable response state;

A second wake module 403, configured to, if the voice wake state of the second device is not the disable response state, cause the first device to not wake up by the received voice wake instruction, and cause the second device to wake up in response to the received voice wake instruction.

Optionally, the first device and the second device have a near field communication function, and the apparatus further includes:

the apparatus comprises a first communication module configured to establish a near field communication connection between a first device and a second device.

Optionally, the first communication module is configured to: starting Bluetooth functions of a first device and a second device to establish Bluetooth connection between the first device and the second device;

Optionally, the second wake-up module 403 is configured to: and if the voice wake-up state of the second equipment is not the forbidden response state, switching the voice wake-up state of the first equipment into the forbidden wake-up state so that the first equipment is not awakened by the received voice wake-up instruction.

Optionally, the apparatus further comprises:

and the second communication module is configured to communicate through a public network if the near field communication connection between the first device and the second device is disconnected, so that the first device and the second device are in a communication connection state.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

The present disclosure also provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the voice wakeup method provided by the present disclosure.

Based on the same inventive concept, the present disclosure further provides a mobile terminal, where the mobile terminal is in a communication connection state with a vehicle, and determines a voice wake-up state of a vehicle machine of the vehicle;

Fig. 6 is a block diagram of a mobile terminal according to an exemplary embodiment. For example, the mobile terminal may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, or the like.

Referring to fig. 6, a mobile terminal may include one or more of the following components: the system comprises a first processing component 502, a first memory 504, a first power component 506, a first multimedia component 508, a first audio component 510, a first input/output interface 512, a first sensor component 514, and a first communication component 516.

The first processing component 502 generally controls overall operation of the mobile terminal, such as operations associated with display, telephone call, data communication, camera operations, and recording operations. The first processing component 502 may include one or more first processors 520 to execute instructions to perform all or part of the steps of the methods described above. Further, the first processing component 502 can include one or more modules that facilitate interaction between the first processing component 502 and other components. For example, the first processing component 502 may include a multimedia module to facilitate interaction between the first multimedia component 508 and the processing component 502.

The first memory 504 is configured to store various types of data to support operations at the mobile terminal. Examples of such data include instructions for any application or method operating on the mobile terminal, contact data, phonebook data, messages, pictures, videos, preset target wake-up words, account numbers to which the mobile terminal belongs, etc. The first memory 504 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The first power supply component 506 provides power to the various components of the mobile terminal. The first power component 506 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the mobile terminal.

The first multimedia component 508 comprises a screen between the mobile terminal and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the first multimedia component 508 includes a front camera and/or a rear camera. When the mobile terminal is in an operation mode, such as a photographing mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The first audio component 510 is configured to output and/or input an audio signal. For example, the first audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the mobile terminal is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. In some embodiments, the received audio signal may be further stored in the first memory 504 or transmitted via the first communication component 516. In other embodiments, the microphone is configured to collect voice audio and send the collected voice audio to the co-wakeup module, and the wake-up engine in the co-wakeup module detects whether a voice wake-up instruction exists in the voice audio, and performs the following steps when the voice wake-up instruction is detected: determining a voice wake-up state of a vehicle machine of the vehicle; if the state of the vehicle is a forbidden response state, the mobile terminal is awakened in response to the received voice awakening instruction; and if the voice wake-up state of the vehicle is not the forbidden response state, the mobile terminal is not waken by the received voice wake-up instruction. In some embodiments, the first audio component 510 further comprises a speaker for outputting audio signals. For example, after the mobile terminal is awakened, the mobile terminal may output a corresponding response through the speaker. The response may be a response to a voice wake-up instruction or a response to a request input by a user after waking up, which is not limited in the present disclosure.

The first input/output interface 512 provides an interface between the first processing component 502 and a peripheral interface module, which may be a keyboard, click wheel, button, or the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The first sensor assembly 514 includes one or more sensors for providing status assessment of various aspects for the mobile terminal. For example, the first sensor assembly 514 may detect the open/closed state of the mobile terminal, the relative positioning of the components, such as the display and keypad of the mobile terminal, the first sensor assembly 514 may also detect the change in position of the mobile terminal or one of the components of the mobile terminal, the presence or absence of user contact with the mobile terminal, the orientation or acceleration/deceleration of the mobile terminal, and the change in temperature of the mobile terminal. The first sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The first sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the first sensor assembly 514 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The first communication component 516 is configured to facilitate communication between the mobile terminal and other devices, either wired or wireless. Illustratively, the mobile terminal establishes a communication connection with the vehicle's machine via the first communication component 516. The mobile terminal may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the first communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the first communication component 516 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the mobile terminal establishes a near field communication connection with the vehicle's body part via the first communication component 516. Among other things, NFC modules may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the mobile terminal may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as first memory 504, including instructions executable by first processor 520 of the mobile terminal to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Based on the same inventive concept, the present disclosure also provides a vehicle provided with an in-vehicle machine,

Fig. 7 is a block diagram of a vehicle, according to an exemplary embodiment. For example, a car machine is provided in a vehicle, and the car machine may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

Referring to fig. 7, the vehicle may include one or more of the following components: the second processing component 602, the second memory 604, the second power component 606, the second multimedia component 608, the second audio component 610, the second input/output interface 612, the second sensor component 614, and the second communication component 616.

The second processing component 602 generally controls overall operation of the vehicle, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The second processing component 602 may include one or more second processors 620 to execute instructions to perform all or part of the steps of the methods described above. Further, the second processing component 602 may include one or more modules that facilitate interactions between the second processing component 602 and other components. For example, the second processing component 602 may include a multimedia module to facilitate interaction between the second multimedia component 608 and the second processing component 602.

The second memory 604 is configured to store various types of data to support operation at the vehicle. Examples of such data include instructions for any application or method operating on the vehicle, contact data, phonebook data, messages, pictures, videos, preset target wake-up words, account numbers to which the vehicle is attached, etc. The second memory 604 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The second power supply assembly 606 provides power to the various components of the vehicle. The second power supply component 606 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the vehicle.

The second multimedia component 608 includes a screen between the vehicle and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the second multimedia component 608 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the vehicle is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The second audio component 610 is configured to output and/or input audio signals. For example, the second audio component 610 includes a Microphone (MIC) configured to receive external audio signals when the vehicle is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. In some embodiments, the received audio signal may be further stored in the second memory 604 or transmitted via the second communication component 616. In other embodiments, the microphone is configured to collect voice audio and send the collected voice audio to a cooperative wake-up module thereof, where a wake-up engine in the cooperative wake-up module detects whether a voice wake-up instruction exists in the voice audio, and when the voice wake-up instruction is detected, the following steps are performed: determining a voice wake-up state of the vehicle; if the voice wake-up state of the vehicle is a forbidden response state, the vehicle keeps the forbidden response state; and if the voice wake-up state of the vehicle is not the forbidden response state, the vehicle is woken up in response to the received voice wake-up instruction. In some embodiments, the second audio component 610 further comprises a speaker for outputting audio signals. For example, after the vehicle is awakened, the vehicle may output a corresponding response through the speaker. The response may be a response to a voice wake-up instruction or a response to a request input by a user after waking up, which is not limited in the present disclosure.

The second input/output interface 612 provides an interface between the second processing component 602 and a peripheral interface module, which may be a keyboard, click wheel, button, or the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The second sensor assembly 614 includes one or more sensors for providing status assessment of various aspects of the vehicle. For example, the second sensor assembly 614 may detect an on/off condition of the vehicle, a relative positioning of the assemblies, such as a display and keypad of the vehicle, the second sensor assembly 614 may also detect a change in position of the vehicle or a component of the vehicle, the presence or absence of user contact with the vehicle, vehicle orientation or acceleration/deceleration, and a change in temperature of the vehicle. The second sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The second sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the second sensor assembly 614 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The second communication component 616 is configured to facilitate wired or wireless communication between the vehicle and other devices. Illustratively, the vehicle's machine establishes a communication connection with the mobile terminal via the second communication component 616. The vehicle may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the second communication component 616 transmits broadcast signals or broadcast related information via a broadcast channel. In an exemplary embodiment, the second communication component 616 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the vehicle's machine establishes a near field communication connection with the mobile terminal through the second communication component 616. Among other things, NFC modules may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the vehicle may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the above method.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as a second memory 604, including instructions executable by the second processor 620 of the vehicle to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

In another exemplary embodiment, a computer program product is also provided, comprising a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-described voice wake-up method when executed by the programmable apparatus.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A voice wakeup method, wherein a first device is in a communication connection state with a second device, the voice wakeup method comprising:

determining a voice wake-up state of the second device;

2. The voice wakeup method of claim 1, wherein the inhibit response state includes at least one of a voice wakeup function being in an off state, a microphone being in a disabled state, and the second device being in a mute state.

3. The voice wakeup method of claim 1, wherein the first device and the second device have near field communication functionality, the voice wakeup method further comprising:

4. A method of waking up speech according to claim 3, wherein the establishing a near field communication connection between the first device and the second device comprises:

5. The method of claim 1, wherein if the voice wake state of the second device is not the disable response state, the first device is not woken up by the received voice wake instruction, comprising:

6. The voice wakeup method of claim 3, further comprising:

7. The voice wakeup method according to any one of claims 1 to 6, wherein the first device is a mobile terminal, the second device is a vehicle, and a car machine is provided in the vehicle.

8. A voice wakeup apparatus, wherein a first device is in a communication connection with a second device, the voice wakeup apparatus comprising:

9. A mobile terminal, characterized in that,

10. The mobile terminal of claim 9, wherein the mobile terminal comprises a mobile terminal,

the mobile terminal has a near field communication function, and establishes near field communication connection with the vehicle machine.

11. The mobile terminal of claim 10, wherein the mobile terminal comprises a mobile terminal,

the mobile terminal starts a Bluetooth function to establish Bluetooth connection with the vehicle machine;

12. The mobile terminal of claim 9, wherein the mobile terminal comprises a mobile terminal,

if the voice wake-up state of the vehicle is not the forbidden response state, the mobile terminal switches the voice wake-up state of the mobile terminal to the forbidden wake-up state so as not to be awakened by the received voice wake-up instruction.

13. A vehicle is characterized in that the vehicle is provided with a vehicle body,

14. The vehicle of claim 13, wherein the vehicle is further characterized by,

the vehicle has a near field communication function, and establishes near field communication connection with the mobile terminal.

15. The vehicle of claim 14, wherein the vehicle is further characterized by,

the car machine starts a Bluetooth function to establish Bluetooth connection with the mobile terminal;

16. A computer readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the steps of the method of any of claims 1-7.