CN115810356A - Voice control method, device, storage medium and electronic equipment - Google Patents

Abstract

The embodiment of the present application discloses a voice control method, device, storage medium and electronic equipment. First, when it is detected that the user's voice meets the voice wake-up condition, if it is determined that the current device is in the first preset device state, then the first device state information corresponding to the first preset device state is sent to the candidate device; The second device state information determines whether the current device performs voice interaction according to the first preset device state and the second preset device state corresponding to the second device state information. When the user's voice is detected to meet the voice wake-up condition, the first preset device status of the current device and the second preset device status of the candidate device can be obtained. Since the device status can represent the user's usage of the device, according to the device status of each device The status can determine which device the user wants to use for voice interaction, which effectively improves the accuracy of voice control.

Description

Voice control method, device, storage medium and electronic equipment

technical field

The present application relates to the technical field of voice control, and in particular to a voice control method, device, storage medium and electronic equipment.

Background technique

With the development of voice technology and people's pursuit of intelligent life, people's dependence on electronic devices is increasing. Among them, an electronic device with a voice control function often has a scene of voice interaction, that is, a user issues a voice control command, and the electronic device performs a related operation according to the control command. However, when the user has multiple electronic devices with voice control functions, it is necessary to determine which electronic device will execute the voice command.

Contents of the invention

Embodiments of the present application provide a voice control method, device, storage medium, and electronic device, which can accurately determine which electronic device will execute a voice command when a user owns multiple electronic devices with a voice control function.

In the first aspect, the embodiment of the present application provides a voice control method, the method comprising:

When it is detected that the user's voice meets the voice wake-up condition, it is determined whether the current device is in the first preset device state;

If the current device is in the first preset device state, the first device state information corresponding to the first preset device state is sent to a candidate device, and the candidate device is in the same multiple as the current device. In the equipment scene;

If the second device state information sent by the candidate device is received, determine whether the current device performs voice according to the first preset device state and the second preset device state corresponding to the second device state information interact.

In a second aspect, the embodiment of the present application provides a voice control method, the method comprising:

When it is detected that the user's voice meets the voice wake-up condition, it is judged whether the current master device is in the first preset device state;

If the current master device is in the first preset device state and receives the second device state information sent by the slave device, according to the first device state information corresponding to the first preset device state and the second device State information, determining a target interactive device for voice interaction from the current master device and the slave device;

The target interaction device is controlled to perform voice interaction based on the interaction instruction.

In a third aspect, the embodiment of the present application provides a voice control method, the method comprising:

When it is detected that the user's voice meets the voice wake-up condition, it is determined whether the current slave device is in the second preset device state;

If the current slave device is in the second preset device state, sending the second device state information of the current device to the master device;

If the interaction instruction sent by the master device is received, the current slave device is controlled to perform voice interaction, wherein the interaction instruction is that the master device according to the first device status information of the master device, the current slave device Second device state information of the device and second device state information of other slave devices are generated.

In a fourth aspect, the embodiment of the present application provides a voice control device, the device comprising:

The voice wake-up module is used to determine whether the current device is in the first preset device state when it is detected that the user's voice meets the voice wake-up condition;

A device state sending module, configured to send the first device state information corresponding to the first preset device state to a candidate device if the current device is in the first preset device state, and the candidate device is the same as the first preset device state The current device is in the same multi-device scenario;

A voice interaction determining module, configured to determine, according to the first preset device status and the second preset device status corresponding to the second device status information, if the second device status information sent by the candidate device is received Whether the current device performs voice interaction.

In a fifth aspect, the embodiment of the present application provides a voice control device, the device comprising:

The master device voice wake-up module is used to determine whether the current master device is in the first preset device state when the user's voice meets the voice wake-up condition;

The master device voice interaction determination module is configured to: if the current master device is in the first preset device state and receives the second device state information sent by the slave device, according to the first preset device state corresponding to the first The device state information and the second device state information determine the target interaction device for voice interaction from the current master device and the slave device;

An instruction control module, configured to control the target interaction device to perform voice interaction based on the interaction instruction.

In a sixth aspect, the embodiment of the present application provides a voice control device, the device comprising:

The slave device voice wake-up module is used to determine whether the current slave device is in the second preset device state when the user's voice meets the voice wake-up condition;

A slave device status sending module, configured to send second device status information of the current device to a master device if the current slave device is in the second preset device status;

The voice interaction module of the slave device is configured to control the current slave device to perform voice interaction if an interaction instruction sent by the master device is received, wherein the interaction instruction is the master device according to the first Device status information, second device status information of the current slave device, and second device status information of other slave devices are generated.

In a seventh aspect, the embodiment of the present application provides a computer storage medium, where a plurality of instructions are stored in the computer storage medium, and the instructions are suitable for being loaded by a processor and executing the steps of the above method.

In an eighth aspect, the embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and operable on the processor.

The beneficial effects brought by the technical solutions provided by some embodiments of the embodiments of the present application at least include:

In this embodiment of the application, firstly, when the user's voice is detected to meet the voice wake-up condition, it is judged whether the current device is in the first preset device state; then if the current device is in the first preset device state, the first preset device state is set to The corresponding first device state information is sent to the candidate device, and the candidate device and the current device are in the same multi-device scene; finally, if the second device state information sent by the candidate device is received, according to the first preset device state and the second The second preset device state corresponding to the device state information determines whether the current device performs voice interaction. When the user's voice is detected to meet the voice wake-up condition, the first preset device status of the current device and the second preset device status of the candidate device can be obtained. Since the device status can represent the user's usage of the device, according to the device status of each device The status can determine which device the user wants to use for voice interaction, which effectively improves the accuracy of voice control.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the embodiments of the present application. For those skilled in the art, other drawings can also be obtained according to these drawings without creative work.

FIG. 1 is a device interaction method in the related art provided by the embodiment of the present application;

FIG. 2 is an exemplary system architecture diagram of a voice control method provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of a voice control method provided in an embodiment of the present application;

FIG. 4 is a device interaction method provided by an embodiment of the present application;

FIG. 5 is a schematic flowchart of a voice control method provided by another embodiment of the present application;

FIG. 6 is a schematic flowchart of a voice control method provided by another embodiment of the present application;

FIG. 7 is a structural block diagram of a voice control device provided by another embodiment of the present application;

FIG. 8 is a schematic flowchart of a voice control method provided by another embodiment of the present application;

FIG. 9 is a structural block diagram of a voice control device provided by another embodiment of the present application;

FIG. 10 is a schematic flowchart of a voice control method provided in another embodiment of the present application;

FIG. 11 is a structural block diagram of a voice control device provided by another embodiment of the present application;

FIG. 12 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In order to make the features and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of this application.

When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

In addition, it should be noted that the information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application and signals are authorized by users or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the object characteristics, interaction behavior characteristics and user information involved in this application are all obtained under the condition of full authorization.

Voice assistants are an important application of artificial intelligence in electronic devices. Electronic devices can interact intelligently with users through intelligent dialogue and instant question-and-answer through voice assistants. It is also possible to recognize the voice command input by the user, and trigger the electronic device to automatically execute the event corresponding to the voice command. Usually, the voice assistant is in a dormant state, and the user can wake up the voice assistant before using the voice assistant. Only after the voice assistant is woken up can it receive and recognize voice commands input by the user. The voice data used for wake-up can be called a wake-up word. For example, if the wake-up word is "Xiaobu Xiaobu" as an example, if the user wants to use the voice assistant to inquire about the weather in place A, he can say "Xiaobu Xiaobu, After the voice assistant receives the semantic command, the voice command of "weather in place A" can be awakened based on the wake-up word "Xiaobu Xiaobu", and then the electronic device can use the voice assistant to recognize the voice command and trigger the electronic device to query A The weather of the place A, and broadcast the weather of the place A to the user through voice or text.

In related technologies, voice control is more and more widely used with the development of technology. For example, many home appliances now support voice control. For example, the voice control function can be realized by installing a voice assistant in the household equipment. In this way, there will be a scenario where the user's environment (such as the user's home) includes multiple devices supporting the voice control function, that is, a multi-device scenario. In this multi-device scenario, if there are devices with the same wake-up word among the multiple devices, after the user speaks the wake-up word, the voice assistants of the devices with the same wake-up word will all be woken up, and they will all follow up with the user. recognizes and responds to voice commands.

Please refer to FIG. 1 . FIG. 1 is a device interaction method in the related art provided by the embodiment of the present application.

As shown in Figure 1, the user's living room is considered as a multi-device scenario. In the living room of the user's home, there are four devices: a speaker 101, a TV 102, a mobile phone 103, and a wearable watch 104. These four devices are all equipped with voice assistants, and wake up The words are "Xiaobu Xiaobu". Then when the user speaks the voice control command containing the wake-up word "Xiaobu Xiaobu", the voice assistant 101, the TV 102, the mobile phone 103 and the watch 104 will all be awakened and recognize the voice command, and respond to the voice command Identify and respond.

In a multi-device scenario, the user may only need a certain device to respond. For example, when the user is using a mobile phone and needs to interact with the voice assistant at this time, since the interaction with the mobile phone is more convenient, the user often It is more hoped that the voice assistant in the mobile phone can be awakened and respond to the user's control commands for voice interaction, but if multiple devices respond at the same time, the experience brought to the user is poor.

In view of the above technical problems, in the embodiment of the present application, firstly, when it is detected that the user's voice meets the voice wake-up condition, it is judged whether the current device is in the first preset device state; and then if the current device is in the first preset device state, the second The first device state information corresponding to a preset device state is sent to the candidate device, and the candidate device and the current device are in the same multi-device scene; finally, if the second device state information sent by the candidate device is received, the first preset The device state and the second preset device state corresponding to the second device state information determine whether the current device performs voice interaction. When the user's voice is detected to meet the voice wake-up condition, the first preset device status of the current device and the second preset device status of the candidate device can be obtained. Since the device status can represent the user's usage of the device, according to the device status of each device The status can determine which device the user wants to use for voice interaction, which effectively improves the accuracy of voice control.

Please refer to FIG. 2 . FIG. 2 is an exemplary system architecture diagram of a voice control method provided by an embodiment of the present application.

As shown in FIG. 2 , the system architecture may include an electronic device 201 , a network 202 and a server 203 . The network 202 is a medium for providing a communication link between the electronic device 201 and the server 203 . The network 202 may include various types of wired communication links or wireless communication links, for example: wired communication links include optical fiber, twisted pair or coaxial cables, wireless communication links include Bluetooth communication links, Wi-Fi ( Wireless-Fidelity, Wi-Fi) communication link or microwave communication link, etc.

The electronic device 201 may interact with the server 203 through the network 202 to receive messages from the server 203 or send messages to the server 203, or the electronic device 201 may interact with the server 203 through the network 202 to receive messages sent by other users to the server 203 or data. The electronic device 201 may be hardware or software. When the electronic device 201 is hardware, it may be various electronic devices, including but not limited to smart watches, smart phones, tablet computers, smart TVs, laptop computers, and desktop computers. When the electronic device 201 is software, it can be installed in the electronic devices listed above, and it can be implemented as multiple software or software modules (for example: used to provide distributed services), or can be implemented as a single software or software module , not specifically limited here.

The server 203 may be a service server providing various services. It should be noted that the server 203 may be hardware or software. When the server 203 is hardware, it can be implemented as a distributed server cluster composed of multiple servers, or as a single server. When the server 203 is software, it may be implemented as multiple software or software modules (for example, for providing distributed services), or as a single software or software module, which is not specifically limited here.

In this embodiment of the application, the number of electronic devices 201 may be multiple, and multiple electronic devices 201 may be in the same multi-device scene, and multiple electronic devices 201 in the same multi-device scene may also directly communicate through the network 202 Connection, that is, multiple electronic devices 201 can also directly perform data transmission based on the network 202 . Therefore, the system architecture may not include the server 203. In other words, the server 203 may be an optional device in the embodiment of this specification, that is, the method provided in the embodiment of this specification may be applied to a system structure that only includes the electronic device 201. This application The embodiment does not limit this.

In the embodiment of the present application, if a certain electronic device 201 in the system architecture is used as the current device, if the current device detects that the user's voice meets the voice wake-up condition, it is judged whether the current device is in the first preset device state, and if the current If the device is in the first preset device state, the first device state information corresponding to the first preset device state is sent to the candidate device, and the candidate device and the current device are in the same multi-device scene; if the first device status information sent by the candidate device is received The second device state information determines whether the current device performs voice interaction according to the first preset device state and the second preset device state corresponding to the second device state information.

It should be understood that the numbers of electronic devices, networks, and servers in FIG. 2 are only illustrative, and may be any number of electronic devices, networks, and servers according to implementation requirements.

Please refer to FIG. 3 . FIG. 3 is a schematic flowchart of a voice control method provided by an embodiment of the present application. The executor of this embodiment of the present application may be an electronic device that executes voice control, a processor in an electronic device that executes a voice control method, or a voice control service in an electronic device that executes a voice control method. For the convenience of description, the specific execution process of the voice control method is introduced below by taking the execution subject as an example of a processor in an electronic device.

As shown in Figure 3, the voice control method may at least include:

S302. When it is detected that the user's voice meets the voice wake-up condition, determine whether the current device is in the first preset device state.

It can be understood that in the embodiment of the present application, the voice control method is mainly applied in a multi-device scenario, where there are at least two electronic devices, and each electronic device in the same multi-device scenario belongs to the same device group, Electronic devices in the same device group have the same device level (that is, electronic devices in the same device group do not distinguish between affiliation or primary and secondary relationships), and data transmission between electronic devices can be performed directly or based on server-based data forwarding. . Further, each electronic device may be connected to the same wireless access point (such as a WiFi access point), log in to the same user account, etc., so that each electronic device is in the same multi-device scene.

Furthermore, each electronic device in the same multi-device scene is equipped with a program similar to a voice assistant, which can monitor the voices of users around the electronic device in real time based on the voice data collected by the microphone, and determine whether the user needs to perform voice interaction.

One way of judging whether the user needs to perform voice interaction is to set the voice wake-up condition in each electronic device in advance, and if it is detected that the user's voice meets the voice wake-up condition, it can be confirmed that the user needs to perform voice interaction. In this embodiment of the application, the voice wake-up condition may be that the user's voice includes a preset wake-up word and/or the voiceprint corresponding to the user's voice is a preset voiceprint. Therefore, after the voice assistant collects the user's voice through the microphone, it can The user's voice performs wake-up word detection and/or voiceprint detection. When the user's voice includes a preset wake-up word and/or the voiceprint corresponding to the user's voice is a preset voiceprint, it can be considered that the detected user's voice meets the voice wake-up condition . The voice wake-up condition can also be that the electronic device is in a preset state. For example, if the electronic device is a smart watch, in order to reduce power consumption, the smart watch is in the off-screen state most of the time, then if the smart watch is in the bright screen state, you can Make sure the smart watch meets the voice wake-up conditions.

When the user uses the electronic device or performs related operations on the electronic device, the device status of the electronic device will change. For example, the device status can refer to static or dynamic status such as device placement status, screen lighting status, standby status, and video playback status. Therefore, the device state of the electronic device is associated with the user's operation. Therefore, when the user needs to perform voice interaction in a multi-device scenario, he often wants the electronic device he is operating to respond more.

Based on the above idea, in the embodiment of the present application, when each electronic device in the same multi-device scene detects that the user's voice satisfies the voice wake-up condition, it may first determine whether its own device is in the preset device state.

Specifically, if the electronic devices in the same multi-device scene are of different types, their corresponding preset states are also different. Therefore, the corresponding preset states of different electronic devices can be set in advance according to the device type of each electronic device. If the electronic device is in the preset device state, it means that the electronic device may be being operated or used by the user, and the user is more likely to need to interact with the electronic device. In order to facilitate the integration of different devices The preset device status is distinguished. In the embodiment of the present application, the preset device status corresponding to the current device is determined as the first preset device status.

For the current device, if the current device detects that the user's voice meets the voice wake-up condition, it can determine whether the current device is in the first preset device state, wherein the method of judging whether the previous device is in the first preset device state can be omitted For example, it may be determined whether the current device is in the first preset device state by acquiring data collected by a preset sensor in the current device.

S304. If the current device is in the first preset device state, send the first device state information corresponding to the first preset device state to the candidate device, where the candidate device and the current device are in the same multi-device scenario.

If it is judged that the current device is in the first preset device state, it can be determined that the current device may be a device being used or operated by the user, but since there are multiple electronic devices in the multi-device scene, there may also be other Electronic devices in the preset device state, in order to facilitate determining the electronic device that the user wants to perform voice interaction from multiple electronic devices in the preset device state, the electronic devices in the same multi-device scene determine that they are in the After the device state is preset, the state information corresponding to the preset device state can be synchronized to other electronic devices.

Furthermore, since the preset device status is not entity data, it cannot be directly transmitted, so the current device can acquire the first device status information representing the first preset device status, and send the first device status to the At least one candidate device in a multi-device scenario, where the candidate device may be all electronic devices in the same multi-device scenario as the current device, or may be an electronic device specified by the user in the same multi-device scenario as the current device.

S306. If the second device state information sent by the candidate device is received, determine whether the current device performs voice interaction according to the first preset device state and the second preset device state corresponding to the second device state information.

Since there are multiple electronic devices in the multi-device scenario, there may also be other electronic devices in the preset device state in the multi-device scenario, that is, the current device sends the first device state information corresponding to the first device state to the candidate device , it is possible that the candidate device will also send the device state information of its corresponding preset device state. Here, in order to distinguish it from the first preset device state that the current device is in, in this embodiment of the application, the Assuming that the device state is recorded as the second preset device state, then after the first device state information corresponding to the first preset device state of the current device is sent to the candidate device, the current device can wait for the first preset time. Assuming that the second device state information sent by at least one candidate device is received within a certain period of time, it means that there may be other electronic devices that are also in the preset device state in the multi-device scenario.

Further, after receiving the second device state information sent by at least one candidate device, the second preset device state corresponding to each candidate device can be determined respectively according to the second device state information, and then according to the combination of the first preset device state and The states of the second preset devices are compared, and then it is determined whether the current device performs voice interaction. Wherein, the manner of comparing the first preset device state with each second preset device state is not limited, and may be compared according to rules set by the user or when the electronic device leaves the factory to determine the comparison result. Wherein, if it is determined that the current device is performing voice interaction, it may analyze the voice control command corresponding to the user's voice, and respond to the voice control command.

Since each electronic device in the multi-device scenario will execute the above-mentioned voice control method, it is possible to determine an electronic device for voice interaction from among the multiple electronic devices in the multi-device scenario, so as to improve the voice interaction of the user. experience.

Please refer to FIG. 4 . FIG. 4 is a device interaction method provided by an embodiment of the present application.

As shown in Figure 4, the user's living room is used as a multi-device scene, wherein the user's living room has four devices: a speaker 101, a TV 102, a mobile phone 103, and a wearable watch 104. These four devices are all equipped with voice assistants, and wake up The words are "Xiaobu Xiaobu". Then when the user speaks the user's voice containing the wake-up word "Xiaobu Xiaobu", the speaker 101, the voice assistant of the TV 102, the mobile phone 103 and the watch 104 may all detect that the user's voice meets the voice wake-up condition, then the speaker 101 , the television 102, the mobile phone 103 and the wearable watch 104 will respectively determine whether they are in the default device state. If the mobile phone 103 all judges that it is in the first default device state, it will set the The status information is sent to the speaker 101, the TV 102 and the wearable watch 104. If the mobile phone 103 receives the status information of the second device of the speaker 101, the TV 102 and the wearable watch 104, then the mobile phone 103 will compare the first preset device of the mobile phone 103 state and the second preset device state corresponding to the second device state information of other devices, and then determine whether the mobile phone 103 performs voice interaction, then the speaker 101, the TV 102 and the wearable watch 104 will also determine whether they perform voice interaction, and finally from The speaker 101, the television 102, the mobile phone 103 and the wearable watch 104 determine an electronic device for interaction.

In FIG. 4 , the mobile phone 103 determines to perform voice interaction, then the mobile phone 103 can analyze the voice control command corresponding to the user's voice, and affect the voice control command.

Since it is more convenient to interact with the mobile phone, users often hope that the voice assistant in the mobile phone can be awakened and respond to the user's control commands for voice interaction, and if multiple devices respond at the same time, the experience brought to the user is poor.

In this embodiment of the application, firstly, when the user's voice is detected to meet the voice wake-up condition, it is judged whether the current device is in the first preset device state; then if the current device is in the first preset device state, the first preset device state is set to The corresponding first device state information is sent to the candidate device, and the candidate device and the current device are in the same multi-device scene; finally, if the second device state information sent by the candidate device is received, according to the first preset device state and the second The second preset device state corresponding to the device state information determines whether the current device performs voice interaction. When the user's voice is detected to meet the voice wake-up condition, the first preset device status of the current device and the second preset device status of the candidate device can be obtained. Since the device status can represent the user's usage of the device, according to the device status of each device The status can determine which device the user wants to use for voice interaction, which effectively improves the accuracy of voice control.

Please refer to FIG. 5 . FIG. 5 is a schematic flowchart of a voice control method provided by another embodiment of the present application. As shown in Figure 5, the voice control method may at least include:

S502. When it is detected that the user's voice meets the voice wake-up condition, determine whether the current device is in the first preset device state.

Since users use or operate different types of electronic devices in different ways when using electronic devices or performing related operations on electronic devices, resulting in different preset device states for different types of electronic devices, so when judging the current In the process of whether the device is in the first preset device state, a feasible implementation method is to obtain the device type of the current device first, and the device type is used to distinguish different types of devices. For example, the device types can be divided into handheld devices, Wearable devices, speaker devices, and TV devices, etc., the device types can be divided according to user needs, or can be divided directly at the factory; then the preset device states corresponding to different types of electronic devices are also different, for example, when the electronic device When the device type of the electronic device is a handheld device, its corresponding preset device state can be a handheld state; when the device type of an electronic device is a wearable device, its corresponding preset device state can be a limb-lifted state; When the type is a sound box device, its corresponding preset device state may be a music playing state; when the device type of the electronic device is a TV device, its corresponding preset device state may be a video playing state, etc.

Furthermore, some state parameters in the device are different under different device states, then the specified state parameters corresponding to the current device can be obtained according to the device type of the current device, wherein the specified state parameters can be obtained through specified sensors and other devices, and finally according to The specified state parameter determines whether the current device is in the first preset device state.

For example, if the device type of the current device is a handheld device, for example, the current device is a smart phone, then for the handheld device, if the user is using or operating the handheld device, the handheld device will generally not be blocked by objects such as pockets, and the handheld device will not be blocked. It will not be completely level, and the handheld device will not be very stable, so if the device type of the current device is a handheld device, at least one of the occlusion state parameters, placement angle state parameters, and shaking state parameters corresponding to the current device can be obtained, so that The method is to determine whether the current device is in a hand-held state according to at least one of the occlusion parameter, the placement angle parameter, and the shaking parameter.

Specifically, if it is judged whether the current device is in a hand-held state according to the occlusion parameter, the placement angle parameter, and the shaking parameter, then firstly, it can be judged whether the current device is occluded based on the occlusion state parameter, wherein the occlusion state parameter can include the illumination value collected by the illumination sensor And the proximity distance value collected by the proximity sensor, if the illumination value is less than the preset illumination value, and the proximity distance value is less than the preset proximity distance value, it can be determined that the current device is blocked, that is, it is determined that the current device is not in the handheld state (the first preset device state); otherwise, it can be determined that the current device is not blocked, then it can be determined whether the current device is in a flat state based on the placement angle state parameter, wherein the placement angle parameter can include geomagnetic values collected by the geomagnetic sensor and acceleration values collected by the acceleration sensor , if the angle calculated based on the geomagnetic value and the acceleration value is less than the preset horizontal angle, it can be determined that the current device is in the horizontal state, that is, it is determined that the current device is not in the handheld state (the first preset device state); otherwise, it can be determined The current device is not in the flat state. It can be judged whether the current device is in the shaking state based on the shaking state parameter. The shaking state parameter can include the angular velocity value collected by the angular velocity sensor. According to the angular velocity value, the average angular velocity value in the time sliding window can be calculated. If The current real-time angular velocity value is greater than the preset maximum angular velocity value, or the current real-time angular velocity value is greater than the preset minimum angular velocity value, less than the preset maximum angular velocity value and the average angular velocity value is greater than the preset average angular velocity value, then it can be determined that the current device is in a shaking state , then it can be determined that the current device is in the handheld state (the first preset device state), otherwise it can be determined that the current device is not in the shaking state, then it can be determined that the current device is not in the handheld state (the first preset device state).

S504. If the current device is in the first preset device state, send the first device state information corresponding to the first preset device state to the candidate device, where the candidate device and the current device are in the same multi-device scenario.

Regarding step S504, reference may be made to the description in the above step S304, which will not be repeated here.

S506. If the second device state information sent by the candidate device is received, compare the priority of the first preset device state with the priority of the second preset device state corresponding to the second device state information, and determine according to the priority comparison result Whether the current device performs voice interaction.

In the embodiment of the present application, after receiving the second device state information sent by the candidate device, the first preset device state can be compared with the second preset device state corresponding to the second device state information. During the comparison process Among them, a feasible implementation manner is to determine the priorities of the first preset device state and the second preset device states respectively, and then determine whether the current device performs voice interaction according to the priority comparison result.

Specifically, the priority order of the preset device states corresponding to each electronic device in the same multi-device scene can be set according to the user's instruction or preset when the device leaves the factory, and then the preset priority order of the device states determines the first preset priority order. Set the first state priority corresponding to the device state, and determine the second state priority corresponding to the second preset device state corresponding to the second device state information. If the first state priority is greater than the second state priority, it means that the current device If you have a higher priority voice interaction control right, then determine the current device to perform voice interaction; if the first state priority is less than the second state priority, it means that other candidate devices have a higher priority voice interaction control right, then determine the current device The device does not have voice interaction.

S508. If the second device state information sent by the candidate device is not received, determine that the current device performs voice interaction.

If the current device does not receive the second device state information sent by the candidate device within the first preset time, it means that there is no candidate device that is also in the preset device state in the multi-device scenario. At this time, the voice interaction of the current device can be directly determined It has the highest priority and controls the current device for voice interaction.

S510. If the current device is not in the first preset device state and the second device state information sent by the candidate device is received, determine that the current device does not perform voice interaction.

If the current device is not in the first preset device state, but receives the second device state information sent by the candidate device, which means that there are candidate devices that are also in the preset device state in the multi-device scenario, then the voice interaction priority of the candidate device High, at this time, the current device can be controlled not to perform voice interaction.

If the current device is not in the first preset device state and has not received the second device state information sent by the candidate device, it means that the interaction priority of all electronic devices in the multi-device scene is low, and each electronic device may not make a voice Interaction, continue to monitor whether the user's voice meets the wake-up condition, or continue to screen electronic devices for voice interaction from all electronic devices in the multi-device scene through other judgment conditions.

In the embodiment of the present application, by comparing the device types of each electronic device in a multi-device scenario, it is determined whether each electronic device meets the preset device status, and then the priority of the preset device status of each electronic device in a multi-device scenario is determined, so as to Determining whether the current device performs voice interaction can improve the accuracy of judging the voice interaction device.

Please refer to FIG. 6 . FIG. 6 is a schematic flowchart of a voice control method provided by another embodiment of the present application. As shown in Figure 6, the voice control method may at least include:

S602. When it is detected that the user's voice meets the voice wake-up condition, determine whether the current device is in the first preset device state.

S604. If the current device is in the first preset device state, send the first device state information corresponding to the first preset device state to the candidate device, where the candidate device and the current device are in the same multi-device scenario.

S606. If the second device state information sent by the candidate device is received, determine whether the current device performs voice interaction according to the first preset device state and the second preset device state corresponding to the second device state information.

Regarding steps S602 to S606, reference may be made to the descriptions in the foregoing embodiments, and details are not repeated here.

S608. If the current device is not in the first preset device state and has not received the second device state information sent by the candidate device, obtain the first general speech characteristic value corresponding to the current device according to the user voice, and convert the first general speech characteristic value to The value is sent to the candidate device.

If the current device is not in the first preset device state and has not received the second device state information sent by the candidate device, it means that all electronic devices in the multi-device The electronic device performs voice interaction, and the electronic device for voice interaction can be selected according to the general voice feature value corresponding to each electronic device.

Among them, the general speech feature value is used to represent the wake-up priority between the sound source and the device, and there are many factors that represent the wake-up priority between the sound source and the device, so the general speech feature parameter can be used to represent the wake-up priority between the sound source and the device. The wake-up priority between the two, that is, the general speech feature value may be represented by various general speech feature parameters. It is easy to understand that since the user tends to approach the device and utters the user's voice towards the device when performing voice interaction with the device, the general voice feature parameters may include but not limited to: the distance parameter between the sound source and the device and the relative distance between the device and the device. The orientation parameter of the sound source.

Specifically, the distance parameter between the sound source and the device can be calculated based on the audio energy of the wake-up word in the user's voice. The greater the energy, the closer the distance, the smaller the distance parameter between the sound source and the device, and the higher the wake-up priority. higher. Specifically, the audio energy of the wake-up word needs to reduce the impact of environmental noise as much as possible. The voice activity detection (VoiceActivityDetection, VAD) method can be used to segment the wake-up word and environmental noise based on the user's voice containing the wake-up word, and further can The energy and duration of the wake-up word and the energy and duration of the environmental noise are obtained, then the energy of the wake-up word after removing the influence of noise can be calculated as follows:

可以看做是唤醒词的功率，

可以看做是环境噪声的功率，那么

与

之差可以认为是去除噪声影响的唤醒词的功率，进而可以通过去除噪声影响的唤醒词的功率去表示去除噪声影响的唤醒词能量。Among them, the energy and duration of the wake-up word are counted as es and ts respectively, and the energy and duration of the environmental noise are counted as en and tn respectively, then

It can be regarded as the power of the wake-up word,

can be regarded as the power of ambient noise, then

and

The difference can be considered as the power of the wake-up word without the influence of noise, and then the power of the wake-up word without the influence of noise can be used to represent the energy of the wake-up word without the influence of noise.

Furthermore, the method for calculating the orientation parameters of the current device relative to the sound source can train a sound orientation decision model through pre-recorded audio data, and then input the user's voice into the decision model to obtain the sound orientation result, that is, the current device relative to the sound source. The orientation parameters of the sound source, where the pre-recorded audio data may include: 1. Spectrum feature data. The reason for selecting the spectrum feature data is that the orientation parameter of the sound source to the sound source increases, and more sound will reach the current device through reflection. Then the high-frequency part of the user's voice received by the current device will be attenuated more than the low-frequency part. 2. Reverberation feature data. The reason for choosing reverberation feature data is that if the direction parameter of the sound source relative to the sound source increases, the reverberation energy will be greater, then the current device can calculate the voice direct-mixing ratio and autocorrelation features of the user's voice. If the reverberation is larger, the peak of the autocorrelation result will be more and larger. 3. Multi-microphone feature data. The reason for choosing multi-microphone feature data is that if the current device has multiple microphones participating in voice control, the sound direction characteristics of multiple microphones can also be calculated to assist in determining the orientation parameters of the current device relative to the sound source.

Further, since there may be multiple first general speech characteristic parameters, different first general speech characteristic parameters have different influences on the wake-up priority between the sound source and the device, so preset The first general speech feature weight corresponding to the general speech feature parameter is set, wherein, the greater the impact of the first general speech feature parameter on the wake-up priority between the sound source and the device, the corresponding first general speech feature weight The value is also larger. For example, if the first general speech characteristic parameter includes: the distance parameter between the sound source and the current device and the orientation parameter of the current device relative to the sound source, then the first general speech feature parameter corresponding to the distance parameter between the sound source and the current device can be set The voice feature weight is 0.6, and the first voice feature weight corresponding to the orientation parameter of the current device relative to the sound source is set to 0.4.

Then, after obtaining the first general speech characteristic parameters corresponding to the current device, the first general speech characteristic weights corresponding to each first general speech characteristic parameter can also be obtained, and then based on each first general speech characteristic parameter and each first general speech characteristic weight Feature weights, calculating the first general speech feature value corresponding to the current device, that is, multiplying each first general speech feature parameter with its corresponding first general speech feature weight, and adding the product results as the current device corresponding The first common speech feature value.

Further, after obtaining the first universal speech feature value corresponding to the current device according to the user voice, it is necessary to synchronize the first universal speech feature value to other electronic devices in the multi-device scene. Similarly, other electronic devices in the multi-device scene The same method as that of the current device is also used to obtain the second common speech feature value corresponding to the user's voice, and the second common speech feature value is synchronized to the current device.

S610. If the second common voice feature value sent by the candidate device is received, determine whether the current device performs voice interaction according to the first common voice feature value and the second common voice feature value.

In the embodiment of the present application, after the current device sends the first universal voice feature value to all candidate devices in the multi-device field, it may wait for the second preset time, if at least one candidate device receives the candidate The second general speech characteristic value sent by the device can be based on the first general speech characteristic value and the second general speech characteristic value, that is, compare the first general speech characteristic value and the second general speech characteristic value, and determine the current device according to the comparison result Whether to perform voice interaction.

Specifically, the first common speech feature value and the second common speech feature value may be compared, and if the first common speech feature value is greater than the second common speech feature value, it means that the current device has a higher interaction priority with the user, and the current The device performs voice interaction; if the first common voice feature value is smaller than the second common voice feature value, it means that the current device does not have a higher interaction priority with the user, that is, other candidate devices have a higher interaction priority with the user, then Determine that the current device does not perform voice interaction; if the first common voice feature value is equal to the second common voice feature value, it means that the current device and other candidate devices do not have a higher interaction priority, and at this time it can be judged whether the current device is preset Priority interaction devices, wherein the priority interaction devices are user-defined settings or electronic devices are set at the factory, so that when multiple devices have the same general voice feature value, one of the electronic devices is selected for interaction to avoid user voice interaction In case of failure, if it is determined that the current device is the preset priority interaction device, it is determined that the current device performs voice interaction.

S612. If the second common voice characteristic value sent by the candidate device is not received, determine that the current device performs voice interaction.

In the embodiment of the present application, after the current device sends the first universal voice feature value to all candidate devices in the multi-device field, it may wait for the second preset time, and if it does not receive the message sent by the candidate device within the second preset time The second general speech feature value means that no other candidate devices in the multi-scenario device have obtained the general speech feature value except the current device. At this time, the current device can be directly determined to perform voice interaction.

In the embodiment of the present application, when it is determined that each electronic device in the multi-device scene is not in the preset state, the general voice characteristics acquired by each electronic device for the user's voice can be obtained respectively, and then the user for voice interaction can be selected according to the general voice characteristics. The electronic device effectively improves the accuracy of determining the device for voice interaction.

Please refer to FIG. 7 . FIG. 7 is a structural block diagram of a voice control device provided by another embodiment of the present application. As shown in Figure 7, the voice control device 700 includes:

The voice wake-up module 710 is configured to determine whether the current device is in the first preset device state when it is detected that the user's voice meets the voice wake-up condition;

The device state sending module 720, configured to send the first device state information corresponding to the first preset device state to the candidate device if the current device is in the first preset device state, and the candidate device and the current device are in the same multi-device scene middle;

The first voice interaction determination module 730 is configured to, if receiving the second device state information sent by the candidate device, determine whether the current device is Perform voice interaction.

Optionally, the first voice interaction determining module 730 is further configured to compare the priority of the first preset device state with the priority of the second preset device state corresponding to the second device state information, and determine the current Whether the device performs voice interaction.

Optionally, the first voice interaction determination module 730 is further configured to determine the first state priority corresponding to the first preset device state according to the preset device state priority order, and determine the second state priority corresponding to the second device state information. Preset the second state priority corresponding to the device state; if the first state priority is greater than the second state priority, then determine the current device for voice interaction; if the first state priority is less than the second state priority, then determine the current device No voice interaction.

Optionally, the voice wake-up module 710 is also used to obtain the device type of the current device, and obtain specified state parameters corresponding to the current device according to the device type; judge whether the current device is in the first preset device state according to the specified state parameters.

Optionally, the voice wake-up module 710 is also used to obtain the occlusion state parameters, placement angle state parameters and shaking state parameters corresponding to the current device if the device type is a handheld device; Whether the device is in a handheld state.

Optionally, the voice control apparatus 700 further includes: a second voice interaction determining module, configured to determine that the current device performs voice interaction if the second device state information sent by the candidate device is not received.

Optionally, the voice control apparatus 700 further includes: a third voice interaction determining module, configured to determine that the current device does not perform the interaction if the current device is not in the first preset device state and the second device state information sent by the candidate device is received. voice interaction.

Optionally, the voice control apparatus 700 further includes: a fourth voice interaction determination module, configured to obtain the information according to the user voice if the current device is not in the first preset device state and has not received the second device state information sent by the candidate device. The first general speech feature value corresponding to the current device, and the first general speech feature value is sent to the candidate device; if the second general speech feature value sent by the candidate device is received, according to the first general speech feature value and the second general Voice feature value, which determines whether the current device performs voice interaction.

Optionally, the fourth voice interaction determination module is also used to obtain the first general voice feature parameters corresponding to the current device and the first general voice feature weights corresponding to each first general voice feature parameter according to the user voice; The speech feature parameters and the first general speech feature weights are used to calculate the first general speech feature value corresponding to the current device.

Optionally, the first general voice feature parameter includes, but is not limited to: a distance parameter between the sound source and the current device, and an orientation parameter of the current device relative to the sound source.

Optionally, the fourth voice interaction determination module is also used to determine that the current device performs voice interaction if the first common voice feature value is greater than the second common voice feature value; if the first common voice feature value is smaller than the second common voice feature value value, it is determined that the current device does not perform voice interaction; if the first common voice feature value is equal to the second common voice feature value, and it is determined that the current device is a preset priority interaction device, then it is determined that the current device performs voice interaction.

Optionally, the voice control apparatus 700 further includes: a fifth voice interaction determining module, configured to determine that the current device performs voice interaction if the second general voice characteristic value sent by the candidate device is not received.

In the embodiment of the present application, the voice control device includes: a voice wake-up module, configured to determine whether the current device is in the first preset device state when detecting that the user's voice meets the voice wake-up condition; In the first preset device state, the first device state information corresponding to the first preset device state is sent to the candidate device, and the candidate device and the current device are in the same multi-device scene; the voice interaction determination module is used to determine if received To the second device state information sent by the candidate device, determine whether the current device performs voice interaction according to the first preset device state and the second preset device state corresponding to the second device state information. When the user's voice is detected to meet the voice wake-up condition, the first preset device status of the current device and the second preset device status of the candidate device can be obtained. Since the device status can represent the user's usage of the device, according to the device status of each device The status can determine which device the user wants to use for voice interaction, which effectively improves the accuracy of voice control.

Please refer to FIG. 8 . FIG. 8 is a schematic flowchart of a voice control method provided by another embodiment of the present application.

As shown in Figure 8, voice control methods include:

S802. When it is detected that the user's voice meets the voice wake-up condition, determine whether the current master device is in the first preset device state.

In the embodiment of the present application, there are at least two electronic devices in the multi-device scene, and the electronic devices in the same multi-device scene belong to the same device group, and the electronic devices in the same device group have a subordinate relationship or a primary and secondary relationship. That is to say, there is at least one master device and at least one slave device in a multi-device scenario. For example, a multi-device environment includes speakers, TVs, mobile phones, and wearable watches. Then the mobile phone with better data processing performance can be used as the master device, and the Speakers with poor data processing performance, TV sets, and wearable watches are used as slave devices. For the convenience of description, the voice control method is firstly applied to the master device for description.

When the main device detects that the user's voice meets the voice wake-up condition, it may first determine whether the current main device itself is in the first preset device state.

S804. If the current master device is in the first preset device state and receives the second device state information sent by the slave device, according to the first device state information and the second device state information corresponding to the first preset device state, slave A target interactive device for voice interaction is determined among the current master device and the slave device.

If the current device is in the first preset device state, it can be determined that the current device may be a device being used or operated by the user. However, since there are multiple electronic devices in the multi-device scene, there may be other electronic devices in the multi-device scene. If the electronic device is in the preset device state, in order to facilitate the determination of the electronic device that the user wants to perform voice interaction from among the multiple electronic devices in the preset device state, the slave devices in the same multi-device scene determine that they are in the preset state After the device state is set, the state information corresponding to the preset device state that it is in can be synchronized to the master device.

Therefore, after the master device receives the second device state information sent by the slave device, it can determine the voice from the current master device and the slave device according to the first device state information and the second device state information corresponding to the first preset device state. The target interaction device for the interaction. For a specific method of determining the target interactive device according to the device state information, reference may be made to the description in the foregoing embodiments, and details are not repeated here.

S806. Control the target interaction device to perform voice interaction based on the interaction instruction.

After determining the target interactive device, the master device can generate an interaction command. If the target interactive device is the current master device, it will directly control the current master device to perform voice interaction based on the interaction command; if the target interactive device is a slave device, the interaction command will be sent to For the target interaction device, the interaction instruction is used to instruct the target interaction device to perform voice interaction, that is, the target interaction device controls the target interaction device itself to perform voice interaction after receiving the interaction instruction.

Further, if the current master device is in the first preset device state and has not received the second device state information sent by the slave device, the current master device is controlled to perform voice interaction.

Optionally, if the current master device is not in the first preset device state, it means that the current master device does not have voice interaction priority in terms of device status. At this time, if the second device status information sent by the slave device is received, you can Determine the target interactive device for voice interaction from the slave devices according to the state information of the second device, and control the target interactive device to perform voice interaction based on the interaction instruction.

Optionally, if the current master device is not in the first preset device state and has not received the second device state information sent by the slave device, it means that the interaction priority of all electronic devices in the multi-device scenario is low, if at this time It is still necessary to select an electronic device for voice interaction. The electronic device for voice interaction can be selected through the universal voice feature value corresponding to each electronic device. At this time, the first universal voice feature value corresponding to the current main device can be obtained according to the user voice; If the second universal voice feature value sent by the slave device is received, then according to the first universal voice feature value and the second universal voice feature value, determine the target interactive device for voice interaction from the current master device and the slave device, and based on the interaction The command controls the target interactive device to perform voice interaction.

Optionally, if the current master device does not detect that the user's voice meets the voice wake-up condition, and receives the second device status information sent by the slave device, then determine the target interaction for voice interaction from the slave device according to the second device status information device, and control the target interaction device to perform voice interaction based on the interaction instruction.

Optionally, if the current master device does not detect that the user's voice meets the voice wake-up condition and receives the second general voice feature value sent by the slave device, then determine the target interaction for voice interaction from the slave device according to the second general voice feature value device, and control the target interaction device to perform voice interaction based on the interaction instruction.

In the embodiment of this application, the work of determining the target interaction device according to the state information or the target interaction device according to the voice feature value is set in the master device. On the one hand, because the performance of the master device is better, it can improve the determination of the target interaction The speed of the device, on the other hand, because the performance of the slave device is poor, then the data processing amount of the slave device can be reduced, and the power consumption of the slave device can be reduced.

Please refer to FIG. 9 . FIG. 9 is a structural block diagram of a voice control device provided by another embodiment of the present application. As shown in Figure 9, the voice control device 900 includes:

The master device voice wake-up module 910 is used to determine whether the current master device is in the first preset device state when it is detected that the user's voice meets the voice wake-up condition;

The master device voice interaction determining module 920 is configured to: if the current master device is in the first preset device state and receives the second device state information sent by the slave device, according to the first device state information corresponding to the first preset device state and the status information of the second device, determining the target interactive device for voice interaction from the current master device and the slave device;

The instruction control module 930 is configured to control the target interaction device to perform voice interaction based on the interaction instruction.

Optionally, the master device voice interaction determination module 920 is also used to control the current master device to perform voice interaction based on the interaction instruction if the target interaction device is the current master device; if the target interaction device is a slave device, then send the interaction instruction to For the target interaction device, the interaction instruction is used to instruct the target interaction device to perform voice interaction.

Optionally, the master device voice interaction determining module 920 is further configured to control the current master device to perform voice interaction if the current master device is in the first preset device state and has not received the second device state information sent by the slave device.

Optionally, the voice interaction determining module 920 of the master device is further configured to: if the current master device is not in the first preset device state and receives the second device state information sent by the slave device, then according to the second device state information from the slave A target interactive device for voice interaction is determined in the device; and the target interactive device is controlled to perform voice interaction based on the interactive instruction.

Optionally, the voice interaction determination module 920 of the master device is further configured to obtain the corresponding The first universal voice feature value; if the second universal voice feature value sent by the slave device is received, then according to the first universal voice feature value and the second universal voice feature value, determine the voice interaction from the current master device and the slave device The target interactive device; based on the interactive command, the target interactive device is controlled to perform voice interaction.

Optionally, the voice interaction determination module 920 of the master device is further configured to, if it is not detected that the user's voice satisfies the voice wake-up condition, and the second device state information sent by the slave device is received, then slave the slave device according to the second device state information In the process, the target interactive device for voice interaction is determined; and the target interactive device is controlled to perform voice interaction based on the interactive instruction.

Optionally, the voice interaction determination module 920 of the master device is further configured to, if it is not detected that the user's voice satisfies the voice wake-up condition and the second universal voice feature value sent by the slave device is received, then slave the slave device according to the second universal voice feature value In the process, the target interactive device for voice interaction is determined; and the target interactive device is controlled to perform voice interaction based on the interactive instruction.

Please refer to FIG. 10 , which is a schematic flowchart of a voice control method provided by another embodiment of the present application.

As shown in Figure 10, the voice control method includes:

S1002. When it is detected that the user's voice meets the voice wake-up condition, determine whether the current slave device is in the second preset device state.

In the embodiment of the present application, there are at least two electronic devices in the multi-device scene, and the electronic devices in the same multi-device scene belong to the same device group, and the electronic devices in the same device group have a subordinate relationship or a primary and secondary relationship. That is to say, there is at least one master device and at least one slave device in a multi-device scenario. For example, a multi-device environment includes speakers, TVs, mobile phones, and wearable watches. Then the mobile phone with better data processing performance can be used as the master device, and the Speakers with poor data processing performance, TV sets, and wearable watches are used as slave devices. For the convenience of description, the voice control method is firstly applied to the slave device for description.

S1004. If the current slave device is in the second preset device state, send the second device state information of the current device to the master device.

S1006. If the interaction instruction sent by the master device is received, control the current slave device to perform voice interaction, wherein the interaction instruction is based on the first device status information of the master device, the second device status information of the current slave device, and other slave devices. Second device state information of the device is generated.

Optionally, if the current slave device is not in the second preset device state, and does not receive the interaction instruction sent by the master device, then obtain the second general speech feature value corresponding to the current slave device according to the user voice, and set the second general The voice feature value is sent to the master device; if the interaction command sent by the master device is received, the current slave device is controlled to perform voice interaction, wherein the interaction command is based on the second voice feature value corresponding to the master device and the second voice feature value of the current slave device. Voice feature values and second voice feature values of other slave devices are generated.

In the embodiment of this application, the work of determining the target interaction device according to the state information or the target interaction device according to the voice feature value is set in the master device. On the one hand, because the performance of the master device is better, it can improve the determination of the target interaction The speed of the device, on the other hand, because the performance of the slave device is poor, then the data processing amount of the slave device can be reduced, and the power consumption of the slave device can be reduced.

Please refer to FIG. 11 . FIG. 11 is a structural block diagram of a voice control device provided by another embodiment of the present application. As shown in Figure 11, the voice control device 1100 includes:

The voice wake-up module 1110 of the slave device is used to determine whether the current slave device is in the second preset device state when the user's voice meets the voice wake-up condition;

The slave device state sending module 1120, configured to send the second device state information of the current device to the master device if the current slave device is in the second preset device state;

The voice interaction module 1130 of the slave device is configured to control the current slave device to perform voice interaction if an interaction instruction sent by the master device is received, wherein the interaction instruction for the master device is based on the first device state information of the master device, the first device state information of the current slave device, and the first device state information of the current slave device. Second device status information and second device status information for other slave devices are generated.

Optionally, the voice interaction module 1130 of the slave device is further configured to obtain the second preset status corresponding to the current slave device according to the user voice if the current slave device is not in the second preset device state and does not receive an interaction instruction sent by the master device. a common speech characteristic value, and sending the second common speech characteristic value to the master device.

Optionally, the voice interaction module 1130 of the slave device is also configured to control the current slave device to perform voice interaction if an interaction instruction sent by the master device is received, wherein the interaction instruction of the master device is based on the second voice feature value corresponding to the master device, The second voice feature value of the current slave device and the second voice feature values of other slave devices are generated.

The embodiment of the present application also provides a computer storage medium, and the computer storage medium can store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the steps of any one of the methods in the foregoing embodiments.

Please refer to FIG. 12 , which is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in FIG. 12 , an electronic device 1200 may include: at least one electronic device processor 1201 , at least one network interface 1204 , a user interface 1203 , a memory 1205 , and at least one communication bus 1202 .

Wherein, the communication bus 1202 is used to realize connection and communication between these components.

Wherein, the user interface 1203 may include a display screen (Display) and a camera (Camera), and the optional user interface 1203 may also include a standard wired interface and a wireless interface.

Wherein, the network interface 1204 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).

Wherein, the electronic device processor 1201 may include one or more processing cores. The electronic device processor 1201 uses various interfaces and lines to connect various parts of the entire electronic device 1200, by running or executing instructions, programs, code sets or instruction sets stored in the memory 1205, and calling data stored in the memory 1205 , to execute various functions of the electronic device 1200 and process data. Optionally, the electronic device processor 1201 may use at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable GateArray, FPGA), Programmable Logic Array (Programmable Logic Array, PLA) A form of hardware to achieve. The electronic device processor 1201 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the electronic device processor 1201, but may be realized by a single chip.

Wherein, the memory 1205 may include a random access memory (Random Access Memory, RAM), and may also include a read-only memory (Read-Only Memory, ROM). Optionally, the storage 1205 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The memory 1205 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 1205 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the above method embodiments; the storage data area can store the data and the like involved in the above method embodiments. Optionally, the memory 1205 may also be at least one storage device located far away from the aforementioned electronic device processor 1201 . As shown in FIG. 12 , the memory 1205 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a voice control program.

In the electronic device 1200 shown in FIG. 12 , the user interface 1203 is mainly used to provide the user with an input interface to obtain the data input by the user; and the electronic device processor 1201 can be used to call the voice control program stored in the memory 1205, and Specifically perform the following operations:

When it is detected that the user's voice meets the voice wake-up condition, it is determined whether the current device is in the first preset device state;

If the current device is in the first preset device state, sending the first device state information corresponding to the first preset device state to the candidate device, where the candidate device and the current device are in the same multi-device scenario;

If the second device state information sent by the candidate device is received, it is determined whether the current device performs voice interaction according to the first preset device state and the second preset device state corresponding to the second device state information.

In one embodiment, according to the first preset device state and the second preset device state corresponding to the second device state information, determining whether the current device performs voice interaction includes: comparing the priority of the first preset device state with the priority of the second preset device state For the priority of the second preset device state corresponding to the device state information, determine whether the current device performs voice interaction according to the priority comparison result.

In one embodiment, comparing the priority of the first preset device state with the priority of the second preset device state corresponding to the second device state information, and determining whether the current device performs voice interaction according to the priority comparison result includes: according to The preset device state priority order determines the first state priority corresponding to the first preset device state, and determines the second state priority corresponding to the second preset device state corresponding to the second device state information; if the first state If the priority is greater than the second state priority, it is determined that the current device performs voice interaction; if the first state priority is less than the second state priority, it is determined that the current device does not perform voice interaction.

In one embodiment, judging whether the current device is in the first preset device state includes: obtaining the device type of the current device, and obtaining specified state parameters corresponding to the current device according to the device type; judging whether the current device is in the first preset state according to the specified state parameters. Preset device state.

In one embodiment, obtaining specified state parameters corresponding to the current device according to the device type includes: if the device type is a handheld device, obtaining the occlusion state parameters, placement angle state parameters, and shaking state parameters corresponding to the current device; according to the device state parameters Judging whether the current device is in the first preset device state includes: judging whether the current device is in the handheld state according to the occlusion parameter, the placement angle parameter and the shaking parameter.

In an embodiment, the method further includes: if the second device state information sent by the candidate device is not received, determining that the current device performs voice interaction.

In an embodiment, the method further includes: if the current device is not in the first preset device state and the second device state information sent by the candidate device is received, determining that the current device does not perform voice interaction.

In one embodiment, the method further includes: if the current device is not in the first preset device state and the second device state information sent by the candidate device has not been received, acquiring the first universal voice characteristic value corresponding to the current device according to the user voice , and send the first general speech feature value to the candidate device; if the second general speech feature value sent by the candidate device is received, then according to the first general speech feature value and the second general speech feature value, determine whether the current device performs speech interact.

In one embodiment, obtaining the first general speech feature value corresponding to the current device according to the user voice includes: obtaining the first general speech feature parameter corresponding to the current device and the first general speech feature value corresponding to each first general speech feature parameter according to the user voice Feature weights: based on each first general speech feature parameter and each first general speech feature weight, calculate a first general speech feature value corresponding to the current device.

In one embodiment, the first general voice feature parameter includes, but is not limited to: a distance parameter between the sound source and the current device, and an orientation parameter of the current device relative to the sound source.

In one embodiment, determining whether the current device performs voice interaction according to the first common voice feature value and the second common voice feature value includes: if the first common voice feature value is greater than the second common voice feature value, then determining whether the current device Carry out voice interaction; if the first common voice feature value is less than the second common voice feature value, then determine that the current device does not perform voice interaction; if the first common voice feature value is equal to the second common voice feature value, and determine that the current device is preset If the priority interaction device is selected, it is determined that the current device performs voice interaction.

In an embodiment, the method further includes: determining that the current device performs voice interaction if the second common voice characteristic value sent by the candidate device is not received.

In the electronic device 1200 shown in FIG. 12 , the user interface 1203 is mainly used to provide the user with an input interface to obtain the data input by the user; and the electronic device processor 1201 can be used to call the voice control program stored in the memory 1205, and Specifically perform the following operations:

When it is detected that the user's voice meets the voice wake-up condition, it is judged whether the current master device is in the first preset device state; if the current master device is in the first preset device state, and the second device state information sent by the slave device is received, the The first device state information and the second device state information corresponding to the first preset device state determine the target interactive device for voice interaction from the current master device and the slave device; control the target interactive device to perform voice interaction based on the interaction instruction.

In one embodiment, if the target interaction device is the current master device, the current master device is controlled to perform voice interaction based on the interaction instruction; if the target interaction device is the slave device, the interaction instruction is sent to the target interaction device, and the interaction instruction is used to indicate The target interaction device performs voice interaction.

In one embodiment, the voice control method further includes: if the current master device is in the first preset device state and has not received the second device state information sent by the slave device, controlling the current master device to perform voice interaction.

In one embodiment, the voice control method further includes: if the current master device is not in the first preset device state and receives the second device state information sent by the slave device, determining from the slave device according to the second device state information The target interactive device for voice interaction; based on the interactive command, the target interactive device is controlled to perform voice interaction.

In one embodiment, the voice control method further includes: if the current master device is not in the first preset device state and has not received the second device state information sent by the slave device, acquiring the first device corresponding to the current master device according to the user voice. General voice feature value; if the second general voice feature value sent by the slave device is received, then according to the first general voice feature value and the second general voice feature value, determine the target interaction for voice interaction from the current master device and the slave device Device; based on the interactive command, the target interactive device is controlled to perform voice interaction.

In one embodiment, the voice control method further includes: if it is not detected that the user's voice meets the voice wake-up condition, and the second device status information sent by the slave device is received, determining from the slave device according to the second device status information The target interactive device for voice interaction; control the target interactive device to perform voice interaction based on the interactive command.

In one embodiment, the voice control method further includes: if it is not detected that the user's voice satisfies the voice wake-up condition and the second universal voice characteristic value sent by the slave device is received, determining from the slave device according to the second universal voice characteristic value The target interactive device for voice interaction; control the target interactive device to perform voice interaction based on the interactive command.

In the electronic device 1200 shown in FIG. 12 , the user interface 1203 is mainly used to provide the user with an input interface to obtain the data input by the user; and the electronic device processor 1201 can be used to call the voice control program stored in the memory 1205, and Specifically perform the following operations:

When it is detected that the user's voice meets the voice wake-up condition, it is judged whether the current slave device is in the second preset device state; if the current slave device is in the second preset device state, then the second device state information of the current device is sent to the master device; If the interaction command sent by the master device is received, the current slave device is controlled to perform voice interaction. Second device status information is generated.

In one embodiment, the voice control method further includes: if the current slave device is not in the second preset device state and has not received the interaction instruction sent by the master device, acquiring the second general voice corresponding to the current slave device according to the user voice feature value, and send the second universal voice feature value to the master device; if the interaction command sent by the master device is received, the current slave device is controlled to perform voice interaction, wherein the interaction command is based on the second voice feature corresponding to the master device value, the second voice feature value of the current slave device, and the second voice feature value of other slave devices.

In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or integrated. to another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or modules may be in electrical, mechanical or other forms.

A module described as a separate component may or may not be physically separated, and a component shown as a module may or may not be a physical module, that is, it may be located in one place, or may also be distributed to multiple network modules. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional module in each embodiment of the embodiment of the present application may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.

If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage The medium includes several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods in the embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes.

It should be noted that, for the sake of simplicity of description, the aforementioned method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited by the described action sequence. Because according to the embodiment of the present application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of the present application.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

The above is the description of the voice control method, device, storage medium and electronic equipment provided by the embodiment of the present application. For those skilled in the art, based on the idea of the embodiment of the present application, they will understand both the specific implementation and the scope of application. There are changes. In summary, the contents of this specification should not be understood as limiting the embodiments of this application.

Claims (26)

1. A method for voice control, the method comprising:

when the situation that the voice of the user meets a voice awakening condition is monitored, judging whether the current equipment is in a first preset equipment state or not;

if the current equipment is in the first preset equipment state, sending first equipment state information corresponding to the first preset equipment state to candidate equipment, wherein the candidate equipment and the current equipment are in the same multi-equipment scene;

and if second equipment state information sent by the candidate equipment is received, determining whether the current equipment carries out voice interaction or not according to the first preset equipment state and a second preset equipment state corresponding to the second equipment state information.

2. The method according to claim 1, wherein the determining whether the current device performs voice interaction according to the first preset device state and a second preset device state corresponding to the second device state information includes:

and comparing the priority of the first preset equipment state with the priority of a second preset equipment state corresponding to the second equipment state information, and determining whether the current equipment carries out voice interaction or not according to a priority comparison result.

3. The method of claim 2, wherein the comparing the priority of the first preset device status with the priority of the second preset device status corresponding to the second device status information and determining whether the current device performs voice interaction according to a priority comparison result comprises:

determining a first state priority corresponding to the first preset device state and a second state priority corresponding to the second preset device state corresponding to the second device state information according to a preset device state priority sequence;

if the first state priority is greater than the second state priority, determining that the current equipment carries out voice interaction;

and if the first state priority is smaller than the second state priority, determining that the current equipment does not carry out voice interaction.

4. The method of claim 1, wherein the determining whether the current device is in a first preset device state comprises:

acquiring the equipment type of the current equipment, and acquiring the specified state parameter corresponding to the current equipment according to the equipment type;

and judging whether the current equipment is in a first preset equipment state or not according to the specified state parameters.

5. The method according to claim 4, wherein the obtaining the specified state parameter corresponding to the current device according to the device type includes:

if the equipment type is handheld equipment, acquiring at least one of a shielding state parameter, a placing angle state parameter and a shaking state parameter corresponding to the current equipment;

judging whether the current equipment is in a first preset equipment state according to the equipment state parameters, wherein the judging step comprises the following steps:

and judging whether the current equipment is in a handheld state or not according to at least one of the shielding parameter, the placing angle parameter and the shaking parameter.

6. The method of claim 1, further comprising:

and if the second equipment state information sent by the candidate equipment is not received, determining that the current equipment carries out voice interaction.

7. The method of claim 1, further comprising:

and if the current equipment is not in the first preset equipment state and second equipment state information sent by the candidate equipment is received, determining that the current equipment does not carry out voice interaction.

8. The method of claim 1, further comprising:

if the current equipment is not in the first preset equipment state and second equipment state information sent by the candidate equipment is not received, acquiring a first general voice characteristic value corresponding to the current equipment according to the user voice, and sending the first general voice characteristic value to the candidate equipment;

and if a second universal voice characteristic value sent by the candidate equipment is received, determining whether the current equipment carries out voice interaction or not according to the first universal voice characteristic value and the second universal voice characteristic value.

9. The method according to claim 8, wherein the obtaining a first generic speech feature value corresponding to the current device according to the user speech includes:

acquiring first general voice characteristic parameters corresponding to the current equipment and first general voice characteristic weights corresponding to the first general voice characteristic parameters according to the user voice;

and calculating a first general voice characteristic value corresponding to the current equipment based on each first general voice characteristic parameter and each first general voice characteristic weight.

10. The method of claim 9, wherein the first generic speech feature parameter includes, but is not limited to: a distance parameter between a sound source and the current device and an orientation parameter of the current device relative to the sound source.

11. The method of claim 8, wherein the determining whether the current device is engaged in voice interaction based on the first generic speech feature value and the second generic speech feature value comprises:

if the first general voice characteristic value is larger than the second general voice characteristic value, determining that the current equipment carries out voice interaction;

if the first general voice characteristic value is smaller than the second general voice characteristic value, determining that the current equipment does not carry out voice interaction;

and if the first general voice characteristic value is equal to the second general voice characteristic value and the current equipment is determined to be preset priority interaction equipment, determining that the current equipment carries out voice interaction.

12. The method of claim 8, further comprising:

and if the second communication voice characteristic value sent by the candidate equipment is not received, determining that the current equipment carries out voice interaction.

13. A method of voice control, the method comprising:

when the situation that the voice of the user meets a voice awakening condition is monitored, judging whether the current main equipment is in a first preset equipment state or not;

if the current master device is in the first preset device state and receives second device state information sent by the slave device, determining target interaction devices for voice interaction from the current master device and the slave device according to first device state information corresponding to the first preset device state and the second device state information;

and controlling the target interaction equipment to carry out voice interaction based on the interaction instruction.

14. The method of claim 13, wherein the controlling the target interactive device to perform voice interaction based on the interactive instruction comprises:

if the target interaction equipment is the current main equipment, controlling the current main equipment to carry out voice interaction based on an interaction instruction;

and if the target interaction equipment is the slave equipment, sending an interaction instruction to the target interaction equipment, wherein the interaction instruction is used for indicating the target interaction equipment to carry out voice interaction.

15. The method of claim 13, further comprising:

and if the current master equipment is in the first preset equipment state and does not receive second equipment state information sent by slave equipment, controlling the current master equipment to carry out voice interaction.

16. The method of claim 13, further comprising:

if the current master equipment is not in the first preset equipment state and second equipment state information sent by the slave equipment is received, determining target interactive equipment for voice interaction from the slave equipment according to the second equipment state information;

and controlling the target interaction equipment to carry out voice interaction based on the interaction instruction.

17. The method of claim 13, further comprising:

if the current master equipment is not in the first preset equipment state and does not receive second equipment state information sent by the slave equipment, acquiring a first general voice characteristic value corresponding to the current master equipment according to the user voice;

if a second universal voice characteristic value sent by the slave equipment is received, determining target interaction equipment for voice interaction from the current master equipment and the slave equipment according to the first universal voice characteristic value and the second universal voice characteristic value;

and controlling the target interaction equipment to carry out voice interaction based on the interaction instruction.

18. The method of claim 13, further comprising:

if the situation that the user voice meets the voice awakening condition is not monitored, and second equipment state information sent by the slave equipment is received, determining target interaction equipment for voice interaction from the slave equipment according to the second equipment state information;

and controlling the target interaction equipment to carry out voice interaction based on the interaction instruction.

19. The method of claim 18, further comprising:

if the situation that the user voice meets the voice awakening condition and a second communication voice characteristic value sent by the slave equipment is not monitored, determining target interaction equipment for voice interaction from the slave equipment according to the second communication voice characteristic value;

and controlling the target interaction equipment to carry out voice interaction based on the interaction instruction.

20. A method for voice control, the method comprising:

when the situation that the voice of the user meets the voice awakening condition is monitored, judging whether the current slave equipment is in a second preset equipment state or not;

if the current slave equipment is in the second preset equipment state, sending second equipment state information of the current equipment to the master equipment;

and if an interactive instruction sent by the master device is received, controlling the current slave device to perform voice interaction, wherein the interactive instruction is generated by the master device according to first device state information of the master device, second device state information of the current slave device and second device state information of other slave devices.

21. The method of claim 20, further comprising:

if the current slave equipment is not in the second preset equipment state and does not receive the interactive instruction sent by the master equipment, acquiring a second communication voice characteristic value corresponding to the current slave equipment according to the user voice, and sending the second communication voice characteristic value to the master equipment;

and if an interactive instruction sent by the master equipment is received, controlling the current slave equipment to carry out voice interaction, wherein the interactive instruction is generated by the master equipment according to a second voice characteristic value corresponding to the master equipment, a second voice characteristic value of the current slave equipment and second voice characteristic values of other slave equipment.

22. A voice control apparatus, characterized in that the apparatus comprises:

the voice awakening module is used for judging whether the current equipment is in a first preset equipment state or not when monitoring that the voice of the user meets a voice awakening condition;

the device state sending module is used for sending first device state information corresponding to the first preset device state to a candidate device if the current device is in the first preset device state, and the candidate device and the current device are in the same multi-device scene;

and the voice interaction determining module is used for determining whether the current equipment carries out voice interaction or not according to the first preset equipment state and a second preset equipment state corresponding to the second equipment state information if the second equipment state information sent by the candidate equipment is received.

23. A voice control apparatus, characterized in that the apparatus comprises:

the main equipment voice awakening module is used for judging whether the current main equipment is in a first preset equipment state or not when monitoring that the voice of the user meets the voice awakening condition;

a master device voice interaction determining module, configured to determine, according to first device state information and second device state information corresponding to a first preset device state, a target interaction device for performing voice interaction from the current master device and the slave device if the current master device is in the first preset device state and second device state information sent by the slave device is received;

and the instruction control module is used for controlling the target interaction equipment to carry out voice interaction based on the interaction instruction.

24. A voice control apparatus, characterized in that the apparatus comprises:

the slave equipment voice awakening module is used for judging whether the current slave equipment is in a second preset equipment state or not when monitoring that the voice of the user meets the voice awakening condition;

a slave device state sending module, configured to send second device state information of the current device to a master device if the current slave device is in the second preset device state;

and the slave equipment voice interaction module is used for controlling the current slave equipment to carry out voice interaction if an interaction instruction sent by the master equipment is received, wherein the interaction instruction is generated by the master equipment according to the first equipment state information of the master equipment, the second equipment state information of the current slave equipment and the second equipment state information of other slave equipment.

25. A computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the steps of the method according to any one of claims 1 to 12, 13 to 19 and 20 to 21.

26. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method according to any one of claims 1 to 12, 13 to 19 and 20 to 21 when executing the program.

Images