WO2020042490A1

WO2020042490A1 - Earphone far-field interaction method, earphone far-field interaction accessory, and wireless earphone

Info

Publication number: WO2020042490A1
Application number: PCT/CN2018/123551
Authority: WO
Inventors: 张崇兴
Original assignee: 歌尔股份有限公司
Priority date: 2018-08-30
Filing date: 2018-12-25
Publication date: 2020-03-05
Also published as: CN109120297B; CN109120297A

Abstract

The present invention relates to the technical field of portable listening devices. Disclosed is an earphone far-field interaction method, used for implementing a far-field interaction function of a wireless earphone. The method comprises: when an earphone far-field interaction accessory detects a preset event that triggers the far-field interaction function, picking up voice instruction information by means of a sound pickup device in the earphone far-field interaction accessory; sending the voice instruction information to a first wireless earphone connected to a terminal, and enabling the first wireless earphone to send the voice instruction information to the terminal and receive response information fed back by the terminal; receiving the response information sent by the first wireless earphone; and outputting the response information. The method takes the wireless earphone as a bridge between the earphone far-field interaction accessory and the terminal, and implements data interaction between the earphone far-field interaction accessory and the terminal, thereby implementing the far-field interaction function of the wireless earphone. Further disclosed are the earphone far-field interaction accessory, the wireless earphone, and a computer readable storage medium, having the above-mentioned beneficial effects.

Description

Far-field interaction method for earphones, far-field interaction accessories for earphones, and wireless earphones

This application claims priority to all Chinese patent applications filed on August 30, 2018 with the Chinese Patent Office, application number 201811003532.5, and application name "A Method for Headphone Far-Field Interaction, Headphone Far-Field Interaction Accessories, and Wireless Headphones" The contents are incorporated herein by reference.

Technical field

The present invention relates to the technical field of electronic devices, and in particular, to a method for far-field interaction of a headset, a far-field interaction accessory for a headset, a wireless headset, and a computer-readable storage medium.

Background technique

At present, wireless headphones are more and more popular due to their convenience. For example, TWS (True Wireless Wireless Stereo) headphones, the existing TWS headphones use Bluetooth technology to achieve the purpose of simultaneous playback of both ears. However, the function of the wireless headset is currently limited to being a near field interaction device of a mobile phone, and a far field interaction function cannot be implemented.

Summary of the Invention

The object of the present invention is to provide a far-field interaction method for a headset, a far-field interaction accessory for a headset, a wireless headset, and a computer-readable storage medium, which can implement the far-field interaction function of a wireless headset.

In order to solve the above technical problem, the present invention provides a far-field interaction method for a headset. The method includes:

When the headset far-field interaction accessory detects a preset event that triggers a far-field interaction function, picking up voice instruction information through a sound pickup device in the headset far-field interaction accessory;

Sending the voice instruction information to a first wireless headset connected to a terminal, so that the first wireless headset sends the voice instruction information to the terminal and receives response information fed back by the terminal;

Receiving the response information sent by the first wireless headset;

The response information is output.

Optionally, the method further includes:

The preset event is detected by determining that a wireless headset is placed in the headset far-field interaction accessory.

Optionally, picking up voice instruction information through a pickup device in the headset far-field interaction accessory includes:

Determining a motion state of the headset far-field interaction accessory;

Select a pickup mode corresponding to the motion state, and control the pickup device in the headset far-field interaction accessory to pick up voice instruction information according to the pickup mode.

Optionally, determining a motion state of the headset far-field interaction accessory includes:

Acquiring a value of an acceleration sensor of a wireless headset placed in the headset far-field interaction accessory;

Determining a motion state of the headset far-field interaction accessory according to the value.

Acquiring environmental state information of the headset far-field interactive accessory;

Select a pickup mode corresponding to the environmental state information, and control the pickup device in the headset far-field interaction accessory to pick up voice instruction information according to the pickup mode.

Optionally, outputting the response information includes:

And outputting the response information according to an output mode corresponding to the pickup mode.

Optionally, the method further includes:

Outputting prompt information sent by the terminal through the first wireless headset.

Optionally, the method further includes:

The mobile power circuit is used to charge the device connected to the headset far-field interaction accessory.

Optionally, using a mobile power circuit to charge a device connected to the headset far-field interaction accessory includes:

Determining whether the battery power of the headset far-field interactive accessory is lower than the working threshold;

If so, prohibiting the mobile power circuit from charging the device connected to the headset far-field interaction accessory;

If not, the mobile power circuit is used to charge the device connected to the headset far-field interaction accessory.

The invention also provides a headset far-field interaction accessory, comprising: a pickup device for picking up voice instruction information, a communication interface for data interaction with the first wireless headset, an output device for outputting response information, a memory, and a processor; The memory is configured to store a computer program, and the processor is configured to implement the steps of the headset far-field interaction method when the computer program is executed.

Optionally, the headset far-field interaction accessory further includes a mobile power circuit for charging a device connected to the headset far-field interaction accessory.

The invention also provides a far-field interaction method of the earphone, the method includes:

The first wireless headset receives voice instruction information sent by the headset far-field interaction accessory, where the voice instruction information is picked up when the headset far-field interaction accessory detects a preset event that triggers a far-field interaction function;

Sending the voice instruction information to a connected terminal, so that the terminal processes the voice instruction information to obtain response information;

Receiving the response information and sending the response information to the headset far-field interaction accessory.

Optionally, the method further includes:

Sending prompt information sent by the terminal to the headset far-field interaction accessory.

The invention also provides a wireless headset, which includes: a communication interface, a memory, and a processor; wherein the memory is used to store a computer program, and the processor is used to implement the above-mentioned headset far-field when executing the computer program. Steps of the interactive method.

The present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned earphone far-field interaction method are implemented.

The invention provides a headset far-field interaction method, comprising: when the headset far-field interaction accessory detects a preset event that triggers the far-field interaction function, picking up voice instruction information through a pickup device in the headset far-field interaction accessory; The voice instruction information is sent to the first wireless headset connected to the terminal, so that the first wireless headset sends the voice instruction information to the terminal and receives the response information fed back by the terminal; receives the response information sent by the first wireless headset; and outputs the response information.

It can be seen that the method uses the headset far-field interaction accessory to pick up external voice instruction information, and uses the first wireless headset connected to the terminal to send the voice instruction information to the terminal, so that the terminal responds to the voice instruction information to generate response information, and uses the The first wireless headset sends the corresponding information to the headset far-field interaction accessory, so that the headset far-field interaction accessory outputs the response information; that is, the method uses the wireless headset as a bridge between the headset far-field interaction accessory and the terminal to implement headset far-field interaction The data interaction between the accessory and the terminal further realizes the far-field interaction function of the wireless headset, so that the user can have the benefits of near-field and far-field interaction when using the wireless headset, and improve the user experience. The present invention also provides a headset far-field interaction accessory, a wireless headset, and a computer-readable storage medium, which have the above-mentioned beneficial effects, and are not repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely It is an embodiment of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without paying creative labor.

FIG. 1 is a flowchart of a headset far-field interaction method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a method for setting up a multi-microarray according to an embodiment of the present invention; FIG.

3 is a structural block diagram of a headset far-field interaction accessory according to an embodiment of the present invention;

FIG. 4 is a detailed structural diagram of a headset far-field interactive accessory according to an embodiment of the present invention; FIG.

5 is a schematic diagram of a specific structure of a mobile power circuit in a headset far-field interactive accessory according to an embodiment of the present invention;

6 is a schematic diagram of a specific structure of another headset far-field interaction accessory according to an embodiment of the present invention;

7 is a flowchart of another headset far-field interaction method according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a 5pins interface according to an embodiment of the present invention.

detailed description

In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in combination with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

In this embodiment, in order to enable a user to implement a far-field interaction function with a terminal when using a wireless headset, a headset far-field interaction accessory is used as a command input device and a result output device under the far-field interaction function to implement the wireless headset and the terminal Far-field interaction capabilities. The main body of this embodiment is the headset far-field interaction accessory. For details, please refer to FIG. 1. FIG. 1 is a flowchart of a headset far-field interaction method according to an embodiment of the present invention. The method is applied to a headset far-field interaction accessory, and may specifically include:

S100. When the headset far-field interaction accessory detects a preset event that triggers the far-field interaction function, the voice command information is picked up by a pickup device in the headset far-field interaction accessory.

This embodiment does not limit the preset event, and the user can set it according to the actual situation. For example, it is detected that a wireless headset is placed in the headset far-field interaction accessory, or it is detected that a wireless headset is connected to the headset far-field interaction accessory. Further, this embodiment does not limit the detection method of the preset event, and the user can make corresponding settings according to the set preset event. For example, when the preset event is detected that a wireless headset is placed in the headset far-field interaction accessory, the detection method of the corresponding preset event may be detecting whether the value of the pressure sensor at each position where the wireless headset is placed in the headset far-field interaction accessory is Detect a preset event for a preset value, or detect that a touch switch on each position where a wireless headset is placed in the headset far-field interaction accessory is pressed to detect the preset event. When the preset event detects that a wireless headset is connected to the headset far-field interaction accessory, the detection method of the corresponding preset event may be to detect whether the corresponding interface (such as a USB interface or a UART interface) is connected to detect the preset. event.

To improve the reliability of triggering the far-field interaction function, preferably, this embodiment detects a preset event by determining that a wireless headset is placed in the headset far-field interaction accessory. It is simply understood that as long as there is a wireless headset in the headset far-field interaction accessory, it means that the wireless headset is not in the near-field interaction state with the terminal at this time, and it can be used to implement the far-field interaction function with the terminal. Further, in order to improve the reliability of the preset event detection. Preferably, in this embodiment, it is determined that a wireless headset is placed in the headset far-field interaction accessory by touching the touch switch in a pressed state. That is, it is detected whether there is a wireless headset at the position where the wireless headset is currently placed by using the pressed state of the touch switch. This embodiment does not limit the type of the tact switch, and may be, for example, a spring-type tact switch.

When the headset far-field interaction accessory detects a preset event that triggers the far-field interaction function, the far-field interaction function can be turned on. At this time, the pickup device in the headset far-field interaction accessory is in a working state and is ready to pick up voice instruction information at any time. The corresponding voice command information pickup device in the headset far-field interaction accessory may be turned on when the far-field interaction function is turned on, or may be always on, but only when the far-field interaction function is turned on can pick up voice command information. In order to save the power of the far-field interaction accessory of the headset, it is preferable to turn on the pickup device in the far-field interaction accessory of the headset only when the far-field interaction function is enabled.

Further, in this embodiment, the type of the sound pickup device is not limited, and may be, for example, a microphone or a multi-microphone array. Users can set it according to the actual pickup requirements and cost requirements. In order to improve the adaptability of the sound pickup device to the environment and the quality of the picked-up voice instruction information, it is preferable that the sound pickup device in this embodiment may use a multi-microphone array, and an audio processing chip may be used to control the multi-microphone connected thereto. The far-field pickup of the array and noise reduction of the obtained original audio information (for example, may include a beamforming algorithm, a noise reduction algorithm, or a speech enhancement algorithm) to improve the reliability of the voice instruction information.

This embodiment does not limit the location of the pickup device in the headset far-field interaction accessory. For example, it can be set on the outer surface of the top of the headset's far-field interaction accessory, or the outer surface of the side. The user can select the setting position according to the type of the specific pickup device and the pickup characteristics actually selected. When the sound pickup device is a multi-microphone array, this embodiment does not limit the number of microphones in the multi-microphone array, the distance between each microphone, and the position where each microphone is set. In order to have a good effect of far-field pickup, it is preferable that the microphones in the Dome array must be on the same plane, and the distance between the two microphones is between 20 and 40 mm, and the microphones must be well sealed. The number of microphones in the corresponding Dome array can be two to four to achieve far-field pickup. For details, please refer to FIG. 2, and a schematic diagram of a method for setting up a multi-microphone array is shown by taking four microphones as an example.

It can be understood that this embodiment does not limit the content of specific voice instruction information, for example, it may be address query, flight information, traffic conditions, navigation prompts, short sentence translation, and so on. Of course, the specific format of the voice instruction information will not be limited. The specific process can refer to the existing specific process of sound pickup by a sound pickup device.

S110. Send the voice instruction information to the first wireless headset connected to the terminal, so that the first wireless headset sends the voice instruction information to the terminal and receives the response information fed back by the terminal.

This embodiment is to implement the far-field interaction function of the wireless headset, so the collected voice instruction information needs to be sent to the corresponding terminal, and then the terminal's response information to the voice instruction information is received. At this time, a wireless headset is needed as a bridge between the headset far-field interaction accessory and the corresponding terminal, so as to realize data interaction between the headset far-field interaction accessory and the corresponding terminal. The specific process is that the headset far-field interaction accessory sends voice instruction information to the first wireless headset connected to the terminal, the first wireless headset sends the voice instruction information to the terminal, and the terminal responds to the received voice instruction information to obtain response information, and The response information is sent to the first wireless headset. Finally, the first wireless headset sends the received response information to the headset far-field interaction accessory, and the headset far-field interaction accessory finally outputs the response information to the user.

Specifically, in this embodiment, the manner in which the headset far-field interaction accessory performs data interaction with the first wireless headset is not limited. For example, data can be exchanged through a USB interface or a UART interface. That is, optionally, the voice instruction information is sent to the first wireless headset connected to the terminal through a USB interface or a UART interface. The selection of a specific communication interface can be set according to the settings of the external interface of the specific wireless headset and the corresponding communication protocol. Generally, the interface corresponding to the current widely applicable communication protocol is selected in order to improve the adaptability of wireless headsets and headset far-field interaction accessories.

In this embodiment, the first wireless headset is a wireless headset that is connected to the terminal and can communicate with the terminal to implement data interaction. That is, when the wireless earphone is a single-ear wireless earphone, the wireless earphone is the first wireless earphone. When the wireless earphone is a binaural wireless earphone, the first wireless earphone may be determined according to a situation. For example, if only two master wireless headsets can be connected to the terminal, only when the master wireless headset is placed in the headset far-field interaction accessory (whether the slave wireless headset is placed in the headset far-field interaction accessory does not affect) Use the main wireless headset as the first wireless headset. If both wireless headsets can be connected to the terminal, if only one wireless headset is placed in the headset far-field interaction accessory at this time, the wireless headset can be used as the first wireless headset. At this time, if both wireless earphones are placed in the earphone far-field interaction accessory, the first wireless earphone can be selected according to a preset selection condition. This embodiment does not limit the preset selection conditions. For example, the first wireless headset may be selected according to the current power of the two wireless headsets; or the wireless headset connected to the terminal before being placed in the headset far-field interaction accessory may be used as the first wireless headset.

Since the first wireless headset consumes power when performing data interaction with the terminal and the headset far-field interaction accessory, in order to avoid the situation where the far-field interaction function is interrupted due to lack of power during use of the first wireless headset, it is preferable, When there are two wireless headsets, before sending the voice instruction information to the first wireless headset connected to the terminal in this embodiment, the method may further include:

Detect the battery power of two wireless headsets in the headset far-field interaction accessory;

Selecting a wireless headset with a higher battery capacity as the first wireless headset;

Determine whether the first wireless headset is connected to the terminal;

If yes, execute step S110;

If not, establish a first wireless connection with the terminal, and execute step S110.

Specifically, in the preferred embodiment, a suitable wireless earphone is selected as the first wireless earphone according to the battery power of the wireless earphone. This embodiment does not limit the detection method of the battery power of the two wireless headphones, as long as the headset far-field interaction accessory can obtain the battery power data of the two wireless headphones. For example, the headset far-field interaction accessory may send battery power acquisition information to the wireless headset, the current master wireless headset obtains the battery power from the wireless headset and itself, and sends the battery power of the two wireless headsets to the headset far-field interaction accessory. Of course, it may also be that the headset far-field interaction accessory sends the battery power acquisition information to each wireless headset separately, and then receives the corresponding battery power from each wireless headset.

When determining the first wireless headset with a higher battery level, it is necessary to determine whether it is connected to the terminal at this time, and if it is connected, directly perform step S110; if it is not connected, first establish a connection between the first wireless and the terminal, and establish the connection After success, step S110 is performed. This embodiment does not limit the process of establishing a connection between the first wireless terminal and the terminal. For example, the current first wireless headset may be switched to the primary wireless headset, and then the connection between the primary wireless headset and the terminal is established. The switching process and the process of connecting the main wireless headset to the terminal can refer to the processes in the prior art. At this point, another wireless headset with a low battery level can be put to sleep to save power.

This embodiment is not limited to the foregoing determining the execution frequency of the first wireless headset according to the battery power. For example, when the battery level of the first wireless headset decreases to a threshold during use, the execution is triggered. Of course, the above-mentioned process of determining the first wireless headset according to the battery level may continue during the working process of the headset far-field interaction accessory, so as to ensure that the first wireless headset that performs data interaction with the headset far-field interaction accessory is the battery level. Higher wireless headphones.

Further, this embodiment does not limit the type of the terminal. For example, it can be a mobile phone, a tablet, or a PC. As long as the terminal has a wireless connection module for wireless communication with the wireless headset (this embodiment does not limit the wireless connection module, such as a Bluetooth module, or a WIFI module, or a BLE module), and can process voice command information The processor that gets the response information is sufficient. That is, this embodiment does not limit the specific manner of wireless transmission between the wireless headset and the terminal. Of course, the terminal can also process the voice command information by connecting to the cloud through a wireless connection module to obtain response information, as long as the terminal can receive the response information.

S120. Receive response information sent by the first wireless headset.

S130. Output response information.

Specifically, steps S120 and S130 enable the headset far-field interaction accessory to perform data interaction with the first wireless headset, and receive and output response information sent by the first wireless headset. This embodiment does not limit the output form of the response information, for example, it may be a voice output, for example, output the response information through a speaker; of course, it may also output through a display screen. Further, this embodiment does not limit the position where the output device with the output function is set. For example, when the output device is a speaker, it can be set on the outside of the headset far-field interaction accessory. For details, please refer to FIG. 2.

This embodiment is implemented after the user does not need to take out the terminal, and uses a combination of a headset far-field interaction accessory and a wireless headset (the wireless headset may be a wireless headset when currently not needed or wants to implement a far-field interaction function). Wireless headset far-field interaction function to query online information, including address query, flight information, traffic conditions, navigation prompts, short sentence translation, etc .; or to receive some output information of the terminal, including music playback, text message prompts, equipment Control, etc.

Based on the above technical solution, the earphone far-field interaction method provided by the embodiment of the present invention can realize the far-field interaction function of the wireless earphone, so that the user can have the benefits of near-field and far-field interaction when using the wireless earphone, and improve the user experience.

Since the wireless headset is convenient to use, and the headset far-field interaction accessory needs to be used with the wireless headset, the headset far-field interaction accessory needs to be able to adapt to various use environments. For example, it can be used indoors, including homes or offices; it can also be used outdoors, such as roads, vegetable fields, or parks; and users can have a variety of sports states under various use environments, corresponding to the headset far-field interaction accessories can have multiple Sports status, such as it can adapt to the user's running status such as running, driving, cycling, etc.

In order to be able to pick up reliable voice command information in various application scenarios, and ensure the quality of the voice command information. In this embodiment, a corresponding pickup mode can be selected according to the current application scenario (where each pickup mode will have a noise reduction algorithm and / or a pickup direction algorithm for the characteristics of the application scenario) to pick up the voice. Instruction information. This embodiment does not limit the current application scenario determination method and the pickup mode corresponding to each application scenario. The user can set it according to the actual situation. For example, the current application scenario is determined according to the motion state of the far-field interaction accessory of the headset, or the current application scenario is determined according to the environmental state information, or multiple application scenarios are set, and the current application scenario is determined through user selection. The corresponding pickup mode can be set for each application scenario. This embodiment does not limit the specific algorithm selected for each pickup mode, as long as the pickup effect can be improved.

For example, in different application scenarios, the headset far-field interaction accessory can adjust the volume and noise reduction effect of the headset far-field interaction accessory. For example, in relatively noisy places, such as on the street, the volume will be appropriately increased according to the noise level; when running, the corresponding noise reduction algorithm will be selected to improve the speech recognition rate.

Based on the above embodiment, when the current application scenario is identified in a motion state, picking up the voice instruction information through the pickup device in the headset far-field interaction accessory in this embodiment may include:

Determine the motion state of the headset's far-field interaction accessory;

Select the pickup mode corresponding to the motion state, and control the pickup device in the headset's far-field interaction accessory to pick up voice command information according to the pickup mode.

Specifically, the method for determining the motion state of the headset far-field interaction accessory is not limited in this embodiment. For example, the motion state may be determined according to an acceleration sensor provided in the headset far-field interaction accessory. Since the wireless headset may be placed in the headset's far field, In the interactive accessory, the motion state of the headset far-field interactive accessory can also be determined according to the acceleration sensor of the wireless headset. Since an acceleration sensor is generally installed in the existing wireless headset, in order to improve the utilization ratio of the original device in the device, the acceleration state of the wireless headset can be directly used to determine the motion state of the headset's far-field interaction accessory. That is, preferably, determining the motion state of the headset far-field interaction accessory may include: obtaining a value of an acceleration sensor of a wireless headset placed in the headset far-field interaction accessory; and determining the motion state of the headset far-field interaction accessory according to the value.

Specifically, when the headset far-field interaction accessory is in a working state, it can receive and obtain the value of the acceleration sensor of the wireless headset placed in the headset far-field interaction accessory, and then determine the motion state of the headset far-field interaction accessory. The number of acceleration sensor values is not limited in this embodiment; when acceleration sensors are provided in both wireless earphones, the acceleration sensor values of the two earphones may be obtained, or only the acceleration sensor of the first wireless earphone may be obtained. Value.

This embodiment does not limit the number of motion states and division criteria. For example, the state of motion may be stationary, walking, running. When it is determined to be in a stationary state, a pickup mode corresponding to the stationary state is selected to pick up voice instruction information; when it is determined to be in a walking state, a voice pickup mode corresponding to a walking state is selected to pick up voice instruction information. Therefore, by selecting different pickup modes, the far-field pickup capability of the headset's far-field interactive accessories can be adjusted, so that the best direction recognition and noise reduction processing can be provided in different sports scenes, and the speech recognition rate can be improved.

Obtain the environmental status information of the headset far-field interactive accessory;

Select the pickup mode corresponding to the environmental state information, and control the pickup device in the headset's far-field interaction accessory to pick up the voice command information according to the pickup mode.

Specifically, the specific content of the environmental state information is not limited in this embodiment, and may be, for example, a value of environmental noise. This embodiment does not limit the types and division criteria of the environmental state information. For example, quiet, normal, and noisy can be determined based on the current environmental state information. When it is determined to be quiet according to the environmental state information, the quiet corresponding pickup mode is selected to pick up the voice instruction information; when the environment state information is determined to be a loud noise, the picking mode corresponding to the noise is selected to pick up the voice instruction information; Choose different pickup modes to adjust the far-field pickup capabilities of the headset's far-field interactive accessories, so as to provide the best direction recognition and noise reduction processing in different sports scenes, and improve the speech recognition rate.

Of course, in order to further improve the speech recognition rate. In this embodiment, the movement state and the environment state information can be combined to determine the pickup mode. That is to obtain the environmental state information and motion state of the headset far-field interactive accessory; select the environmental state information and the pickup mode corresponding to the motion state, and control the pickup device in the headset far-field interactive accessory to pick up voice instruction information according to the pickup mode.

Further, in various application scenarios, users also have different volume requirements for response information output through a voice such as a speaker. Therefore, in order to improve the user experience, based on the above embodiment, preferably, this embodiment can correspond to the pickup mode. The output mode outputs a response message.

Specifically, the user can check the playback volume of the far-field interaction accessory of the headset according to his own pickup capability. This embodiment does not limit the specific correspondence between the pickup mode and the output mode. For example, when it is determined whether the current is quiet, normal, or noisy according to the environmental state information, the output volume of the corresponding output mode is A, B, or C; where A is less than B and B is less than C.

Based on the above technical solution, the earphone far-field interaction method provided by the embodiment of the present invention can realize the far-field interaction function of the wireless earphone, so that the user can have the benefits of near-field and far-field interaction when using the wireless earphone, and improve the user experience, and Through the recognition of application scenarios, the effect of picking up voice instruction information and the effect of voice outputting response information are improved, thereby further improving the user experience.

Based on any of the above embodiments, in order to improve the utilization of the headset far-field interaction accessory and enable it to implement multiple functions, in this embodiment, the headset far-field interaction accessory may also output prompt information sent by the terminal through the first wireless headset.

Specifically, the prompt information output in this embodiment does not need to first pick up the voice instruction information through the headset's far-field interaction accessory, and is directly the prompt information sent by the terminal through the first wireless headset. The specific content of the prompt information is not limited in this embodiment. For example, the prompt information may be an incoming call prompt, a short message prompt, a weather prompt, a working status prompt of other smart devices (such as a smart home device), and the like. Of course, the output form of the prompt information is not limited in this embodiment, and may be a voice output, a screen output, or an indicator light. Further, the headset far-field interaction accessory may also output the status (working state or hibernation state) of the wireless headset itself and / or the wireless headset placed in the headset far-field interaction accessory. Of course, it can also provide input forms such as keys for users to set the headset far-field interaction accessories.

Based on the above technical solution, the earphone far-field interaction method provided by the embodiment of the present invention can realize the far-field interaction function of the wireless earphone, so that the user can have the benefits of near-field and far-field interaction when using the wireless earphone, and improve the user experience, and Output the prompt information to expand the functions of the headset far-field interaction accessory.

Based on any of the above embodiments, in order to improve the utilization ratio of the headset far-field interaction accessory and enable it to implement multiple functions, in this embodiment, the headset far-field interaction accessory may also include a charging function. The specific headset far-field interaction accessory uses a mobile power supply. The circuit charges the device connected to the headset's far-field interaction accessory. In this embodiment, the specific form of the mobile power circuit and the type of the connected charging device (for example, a wireless headset) are not limited. The specific form of the mobile power circuit can be specifically set according to the type of equipment it can charge. That is, the headset far-field interaction accessory can be used as a mobile charging treasure, or a mobile charging device that only charges wireless headphones.

This embodiment does not limit the interface to which the device is connected to the headset far-field interaction accessory, and it is determined according to the type of the device. For example, it can be a USB interface or a UART interface. Of course, the headset far-field interaction accessory can also have an interface for charging the headset far-field interaction accessory with an external power supply to meet the normal use of the headset far-field interaction accessory and the function of charging the device. This interface is determined according to actual needs and is generally selected. Currently commonly used interfaces, such as USB interfaces.

Based on the above technical solution, the earphone far-field interaction method provided by the embodiment of the present invention can implement the far-field interaction function of wireless earphones, so that users can have the benefits of near-field and far-field interaction when using wireless earphones, and improve the user experience, and The mobile power circuit is used to extend the mobile charging function of the headset far-field interaction accessory.

Based on any of the above embodiments, in order to ensure the normal use of the headset far-field interaction accessory, when a user needs to use the headset far-field interaction accessory, it is necessary to first check whether the battery power of the headset far-field interaction accessory meets the usage requirements. This embodiment does not limit the frequency at which the headset far-field interaction accessory detects whether its own battery power is too low. It can be the real-time detection of its own battery power, or it can be detected according to a preset period. Of course, it can also be performed when a headset far-field interactive accessory is needed.

For example, when the headset far-field interaction accessory detects a preset event that triggers the far-field interaction function, it first needs to first check whether the battery power of the headset far-field interaction accessory can meet the working requirements (for example, whether it is lower than a set power value) If it is satisfied, then the step of picking up voice instruction information through the sound pickup device in the headset far-field interaction accessory is performed, if it is not satisfied, then it is refused to perform the step of picking up voice instruction information through the sound pickup device in the headset far-field interaction accessory. Of course, this It can also prompt the user when the battery is low and needs to be charged. Or when it is detected that the connected device needs to perform the charging function, it can first determine whether the battery power of the headset far-field interactive accessory is lower than the working threshold; if not, the mobile power circuit is used to charge the device connected to the headset far-field interactive accessory. ; If yes, the mobile power circuit is forbidden to charge the device connected to the headset's far-field interaction accessory; of course, it can also prompt the user that the battery is low and needs to be charged.

This embodiment does not limit the specific manner of outputting the prompt information herein. For example, it can be an indicator light output, or a voice output, or you can use the terminal to output prompt information, that is, the headset far-field interactive accessory will actively send charging prompt information to the terminal through the first wireless headset when its battery power is too low to be charged. .

Further, under normal circumstances, when the user does not use the headset far-field interaction accessory (such as not using its far-field interaction function or charging function), in order to lower power consumption and save energy, the headset far-field interaction accessory can be set to sleep. Mode (ie power saving mode). For example, when the wireless headset is not in the headset far-field interaction accessory and the touch switch is released, the headset far-field interaction accessory immediately enters the standby state to save power. The headset far-field interaction accessory itself can charge the internal battery through the interface. When the wireless headset is in the headset far-field interaction accessory, but the battery of the headset far-field interaction accessory is insufficient, the headset far-field interaction accessory can refuse to charge the wireless headset, and at the same time, it will send a prompt message to the terminal (such as a mobile phone) and ask the user to give The headset's far-field interactive accessory is powered.

The following describes the specific process of this embodiment with a specific example:

When the wireless headset is fixed in the headset far-field interaction accessory, the touch switch on the position where the wireless headset is placed will be pressed. At this time, it is confirmed that the wireless headset is placed in the headset far-field interaction accessory and a preset event is detected. , And then detect the battery power of the two wireless headphones, and charge the two wireless headphones through the charging interfaces 2A and 2B, respectively. At this time, the far-field interaction function of the headset's far-field interaction accessory will be activated, and start to communicate with the wireless headset with higher power through the USB interface or UART interface, while another wireless headset with lower power will enter the sleep state and only charge. . When a keyword is called, a short sentence is proposed, and the voice instruction information will be transmitted to the working wireless headset, that is, the first wireless headset, and sent to the terminal (such as a mobile phone) via Bluetooth, and then to the network cloud; The result is that the response message is sent back to the headset far-field interactive accessory from the opposite path, and the speaker is broadcast. During use, when the power of the first wireless headset is <p (V), the headset far-field interactive accessory will switch to the wireless headset with high power, and the wireless headset with low power will enter the sleep state and only charge; > 0, the specific value is not limited.

Based on the above technical solution, the earphone far-field interaction method provided by the embodiment of the present invention designs a earphone far-field interaction accessory with a mobile charging function. While charging the wireless earphone, the earphone far-field interaction accessory combines with the wireless earphone. Through the above methods, the wireless headset is turned into a tool for far-field interaction. Allows users to choose the function of near-field or far-field interaction according to their needs while being convenient to carry, which improves the product's use scene, time and value. That is to say, this method realizes the enhancement of the function of the current small wireless earphones and its charging box at the same time of mobile charging. It uses a headset far-field interactive accessory with mobile charging function to combine the wireless earphones and mobile power to make it possible. Far-field interaction device used with the terminal. While extending the use of wireless headsets, users can enjoy the benefits of near-field and far-field interaction.

The following describes the earphone far-field interaction accessory, earphone far-field interaction method, wireless earphone, and computer-readable storage medium provided in the embodiments of the present invention. The earphone far-field interaction accessory, earphone far-field interaction method, wireless earphone, and computer The reading storage medium and the headphone far-field interaction method described above can be referred to each other.

Please refer to FIG. 3. FIG. 3 is a structural block diagram of a headset far-field interaction accessory according to an embodiment of the present invention. The headset far-field interaction accessory may include a pickup device 100 for picking up voice instruction information, and a first wireless headset. A communication interface 200 for data interaction, an output device 300 for outputting response information, a memory 400, and a processor 500; the memory 400 is used to store a computer program, and the processor 500 is used to implement any of the foregoing embodiments when executing a computer program Steps of a headset far-field interaction method. For example, when the processor is used to execute a computer program, the headset far-field interaction accessory detects a preset event that triggers a far-field interaction function, and picks up voice instruction information through a pickup device in the headset far-field interaction accessory; sends the voice instruction information to the The first wireless headset connected to the terminal causes the first wireless headset to send voice instruction information to the terminal and receive response information fed back by the terminal; receive the response information sent by the first wireless headset; and output response information.

Based on the above embodiment, the sound pickup device 100 may include: a multi-microphone array and an audio processing chip. The embodiment does not limit the type of the specific audio processing chip. The audio processing chip is mainly responsible for the far-field pickup and noise reduction algorithms (including beamforming, noise reduction and / or speech enhancement) of the Dome array, and outputs the processed I2S signals to the codec chip. Among them, the Dome array can be connected to an FPC (flexible circuit board) of the motherboard.

Based on the above embodiment, the microphones in the Dome array are disposed on the same plane, and the distance between the two microphones is between 20 mm and 40 mm. The specific number of microphones in the multi-microphone array is not limited in this embodiment, and may be, for example, two to four.

Based on any of the above embodiments, the communication interface 200 is specifically a USB interface or a UART interface. The number of communication interfaces is not limited in this embodiment. For example, the number of communication interfaces may be equal to the number of wireless headphones.

Based on any of the above embodiments, the output device 300 may include a power amplifier and a speaker. Wherein, this embodiment does not limit the types and numbers of specific power amplifiers and speakers.

Based on any of the above embodiments, the processor 500 is specifically a codec chip. The type of the codec chip is not limited in this embodiment, such as a USB codec chip / UART codec chip, which needs to be compatible with the type of the communication interface 200 and is responsible for conversion between USB or UART audio signals and I2S signals. As a bridge for data interaction between wireless headsets and headset far-field interaction accessories. In addition, the codec chip can also provide interfaces for key inputs and status outputs such as LEDs.

In this embodiment, there are mainly two audio transmission paths for the far-field interaction accessory of the headset:

The path of far-field pickup operation: Dome array-audio processing chip-USB / UART codec chip-interface 2A / B-the first wireless headset, and then connect to the terminal through the wireless headset.

Voice playback operation path: The response information will be transmitted wirelessly to the first wireless headset-interface 2A / B-USB / UART codec chip-headphone far-field interaction accessory amplifier-speaker to play.

Please refer to FIG. 4 below for a detailed structural diagram of a headset far-field interaction accessory. Among them, the dashed box is the part that realizes the far-field interaction function of the far-field interaction accessory of the headset, and the multiplexer refers to a multiplexer. The power amplifier is the power amplifier, and the horn is the speaker. The left BT headset and the right BT headset, which are interfaces 2A and 2B (that is, two communication interfaces 200) for data interaction with the headset far-field interaction accessory, are a type of dual wireless headset. The specific working process can be: analog-to-digital conversion, pickup and noise reduction processing according to the sound collected by the Dome Array, and the digital voice signal is transmitted to the Bluetooth headset through the interface 2A or 2B, and then transmitted to the terminal for processing through Bluetooth. ; And the terminal also transmits the voice result to the headset far-field interactive accessory for playback via Bluetooth.

Based on any of the above embodiments, the headset far-field interaction accessory may further include a mobile power circuit for charging a device connected to the headset far-field interaction accessory.

Based on the above embodiments, the mobile power circuit may include: an input interface, an output interface, a battery, a charge management chip for managing a charging current path and a charging parameter, and a method for converting power transmitted by the charge management chip into a headset far-field interaction accessory. Power management chip for the power required by the system. Among them, the charging management chip is mainly responsible for the management of the charging current path and charging parameters. It mainly sets the current between the power transmitted from the input interface to the device (such as a wireless headset), the power management chip of the headset far-field interaction accessory, and the battery. Distribution relationship. And a processor (such as a codec chip) can be responsible for setting and controlling the charge management chip through I2C. The power management chip mainly converts the power transmitted by the charge management chip into the power required by the system in the headset's far-field interaction accessory. The battery is mainly used to charge the wireless headset when no external power is connected, which lasts for a long time.

Specifically, the input interface is specifically used for external power to charge the headset far-field interaction accessory itself. The output interface is specifically used to charge external devices, and its specific model can be set according to actual needs. This embodiment is not limited to this. For example, the input interface is a standard USB interface, which is used to connect external power supply equipment and headset far-field interaction. Accessories; the output interface can be a standard USB connector (that is, a USB interface) or Pogo pins (can be 3pins or 5pins, preferably 5pins), used to connect the headset far-field interactive accessories and wireless headphones. When the device to be charged is a wireless headset, the output interface can be shared with the communication interface 200 in the above embodiment, that is, the communication interface 200 can also be used as an output interface for charging the connected device. This embodiment also does not limit the type and size of the battery, which is designed according to the actual needs of the mobile power circuit. Of course, this embodiment does not limit the specific models of the charge management chip and the power management chip.

In this embodiment, when no external power supply device is used to power the headset far-field interactive accessory through the input interface, the main power transmission paths are: battery-charge management chip-power management chip; and battery-charge management chip-output interface- Wireless Headphones.

When an external power supply device supplies power to the headset far-field interactive accessory through the input interface, the main power transmission paths are: input interface-charge management chip-output interface-wireless headset; and input interface-charge management chip-power management chip.

Please refer to FIG. 5 below for a detailed structural diagram of a mobile power circuit in a headset far-field interaction accessory. Among them, the dashed box is the part of the headset far-field interaction accessory that implements the charging function, but the codec chip can belong to the far-field interaction part interface 1 which is the input interface. The interface 2A and the interface 2B (that is, the two communication interfaces in FIG. 4 are output interfaces in this embodiment) are used to charge the left BT headset and the right BT headset. The specific working process can be: through the interface 1, can charge the battery of the headset far-field interaction accessory and the battery of the wireless headset at the same time, and ensure the normal operation of the headset far-field interaction accessory; When the headset is connected, you can also charge the wireless headset to extend the use time of the wireless headset.

When the headset far-field interaction accessory can simultaneously realize the far-field interaction function and the charging function, it can be composed of FIG. 4 and FIG. 5. That is, it can include a far-field interactive circuit, a mobile power circuit and an interface. For details, please refer to FIG. 6. For the far-field interaction circuit, refer to FIG. 4.

The main body of this embodiment is a first wireless headset, that is, a wireless headset that performs data interaction with the headset far-field interaction accessory and the terminal at the same time. Please refer to FIG. 7, which is a flowchart of another headset far-field interaction method according to an embodiment of the present invention; the method may include:

S700. The first wireless headset receives voice instruction information sent by the headset far-field interaction accessory, where the voice instruction information is picked up by the headset far-field interaction accessory when it detects a preset event that triggers the far-field interaction function;

S710. Send the voice instruction information to a connected terminal, so that the terminal processes the voice instruction information to obtain response information.

S720. Receive response information.

S730. Send the response information to the headset far-field interaction accessory.

Based on the above embodiment, the first wireless headset receiving the voice instruction information sent by the headset far-field interaction accessory may include: the first wireless headset receiving the voice instruction information sent by the headset far-field interaction accessory through a USB interface or a UART interface.

Based on any of the above embodiments, the method may further include:

Send prompt information sent by the terminal to the first wireless headset.

The invention also provides a wireless headset, which includes: a communication interface, a memory, and a processor; wherein, the memory is used to store a computer program, and the processor is configured to execute the computer program to implement the steps of the headset far-field interaction method according to any of the foregoing embodiments . For example, when the processor is used to execute a computer program, the first wireless headset receives voice instruction information sent by the headset far-field interaction accessory; wherein the voice instruction information is picked up when the headset far-field interaction accessory detects a preset event that triggers the far-field interaction function. Sending the voice instruction information to the connected terminal, so that the terminal processes the voice instruction information to obtain the response information; receives the response information; and sends the response information to the headset far-field interaction accessory.

Based on the above embodiment, the communication interface is a 5pins interface including a UART interface. For a schematic diagram of the 5pins interface, refer to FIG. 8.

The present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the steps of the far-field interaction method for an earphone according to any of the foregoing embodiments are implemented. For example, when the computer program is executed by the processor, when the headset far-field interaction accessory detects a preset event that triggers the far-field interaction function, the voice command information is picked up by the pickup device in the headset far-field interaction accessory; the voice command information is sent to the The first wireless headset connected to the terminal causes the first wireless headset to send voice instruction information to the terminal and receive response information fed back by the terminal; receive the response information sent by the first wireless headset; and output response information. And / or, for example, when the computer program is executed by the processor, the first wireless headset receives the voice instruction information sent by the headset far-field interaction accessory; wherein the voice instruction information is a preset that the headset far-field interaction accessory detects that triggers the far-field interaction function Picked up at the event; sending voice command information to the connected terminal, so that the terminal processes the voice command information to get response information; receive the response information; and send the response information to the headset far-field interaction accessory.

The computer-readable storage medium may include: U disk, mobile hard disk, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk, etc. The medium.

Each embodiment in the description is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts between the embodiments, refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part may refer to the description of the method.

Professionals may further realize that the units and algorithm steps of the examples described in connection with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the hardware and software Interchangeability. In the above description, the composition and steps of each example have been described generally in terms of functions. Whether these functions are performed by hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

The steps of the method or algorithm described in connection with the embodiments disclosed herein may be directly implemented by hardware, a software module executed by a processor, or a combination of the two. Software modules can be placed in random access memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or in technical fields Any other form of storage medium known in the art.

The foregoing has described in detail a headset far-field interaction method, a headset far-field interaction accessory, a wireless headset, and a computer-readable storage medium provided by the present invention. Specific examples are used herein to explain the principle and implementation of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core ideas. It should be noted that, for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.

Claims

A headset far-field interaction method, characterized in that the method includes:

When the headset far-field interaction accessory detects a preset event that triggers a far-field interaction function, picking up voice instruction information through a sound pickup device in the headset far-field interaction accessory;

Sending the voice instruction information to a first wireless headset connected to a terminal, so that the first wireless headset sends the voice instruction information to the terminal and receives response information fed back by the terminal;

Receiving the response information sent by the first wireless headset;

The response information is output.
The method according to claim 1, further comprising:

The preset event is detected by determining that a wireless headset is placed in the headset far-field interaction accessory.
The method according to claim 1, wherein picking up voice instruction information by using a sound pickup device in the headset far-field interaction accessory comprises:

Determining a motion state of the headset far-field interaction accessory;

Select a pickup mode corresponding to the motion state, and control the pickup device in the headset far-field interaction accessory to pick up voice instruction information according to the pickup mode.
The method according to claim 3, wherein determining a motion state of the headset far-field interaction accessory comprises:

Acquiring a value of an acceleration sensor of a wireless headset placed in the headset far-field interaction accessory;

Determining a motion state of the headset far-field interaction accessory according to the value.
The method according to claim 1, wherein picking up voice instruction information by using a sound pickup device in the headset far-field interaction accessory comprises:

Acquiring environmental state information of the headset far-field interactive accessory;

Select a pickup mode corresponding to the environmental state information, and control the pickup device in the headset far-field interaction accessory to pick up voice instruction information according to the pickup mode.
The method according to claim 5, wherein outputting the response information comprises:

And outputting the response information according to an output mode corresponding to the pickup mode.
The method according to claim 1, further comprising:

Outputting prompt information sent by the terminal through the first wireless headset.
The method according to any one of claims 1-7, further comprising:

The mobile power circuit is used to charge the device connected to the headset far-field interaction accessory.
The method according to claim 8, wherein using a mobile power circuit to charge a device connected to the headset far-field interaction accessory comprises:

Determining whether the battery power of the headset far-field interactive accessory is lower than the working threshold;

If so, prohibiting the mobile power circuit from charging the device connected to the headset far-field interaction accessory;

If not, the mobile power circuit is used to charge the device connected to the headset far-field interaction accessory.
A headset far-field interaction accessory, comprising: a pickup device for picking up voice instruction information, a communication interface for data interaction with a first wireless headset, an output device for outputting response information, a memory, and a processor; The memory is configured to store a computer program, and the processor is configured to implement the steps of the far-field interaction method of the headset according to any one of claims 1 to 9 when the computer program is executed.
The headset far-field interaction accessory according to claim 10, further comprising: a mobile power circuit for charging a device connected to the headset far-field interaction accessory.
A headset far-field interaction method, characterized in that the method includes:

The first wireless headset receives voice instruction information sent by the headset far-field interaction accessory, where the voice instruction information is picked up when the headset far-field interaction accessory detects a preset event that triggers a far-field interaction function;

Sending the voice instruction information to a connected terminal, so that the terminal processes the voice instruction information to obtain response information;

Receiving the response information and sending the response information to the headset far-field interaction accessory.
The method according to claim 12, further comprising:

Sending prompt information sent by the terminal to the headset far-field interaction accessory.
A wireless headset, comprising: a communication interface, a memory, and a processor; wherein the memory is used to store a computer program, and the processor is configured to implement the computer program according to claim 12 or 13 when executing the computer program. The steps of the far-field interaction method of the headset are described.
A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the headset far-field according to any one of claims 1 to 9 is realized Steps of the interaction method; and / or steps of the headset far-field interaction method according to 12 or 13.