WO2023087468A1

WO2023087468A1 - Method and apparatus for controlling transparency mode of earphones, and earphone device and storage medium

Info

Publication number: WO2023087468A1
Application number: PCT/CN2021/139038
Authority: WO
Inventors: 曲征
Original assignee: 歌尔科技有限公司
Priority date: 2021-11-18
Filing date: 2021-12-17
Publication date: 2023-05-25
Also published as: CN114095835A; CN114095835B

Abstract

A method and apparatus for controlling a transparency mode of earphones, and an earphone device and a storage medium. The method comprises: when an earphone device is in a transparency mode, acquiring a first signal which is played by a speaker and is picked up by a microphone, wherein the frequency of the first signal is beyond the audible sound frequency range of a user (S10); if the signal energy of the first signal, which is picked up, is less than or equal to a first energy threshold value, controlling the earphone device to perform gain processing in the transparency mode by using a gain value which is greater than or equal to a first gain threshold value (S20); and if the signal energy of the first signal, which is picked up, is greater than the first energy threshold value, controlling the earphone device to perform gain processing in the transparency mode by using a gain value which is less than a second gain threshold value, wherein the second gain threshold value is less than or equal to the first gain threshold value (S30). A squeaking sound caused by ears being covered can be prevented, and a poor transparency effect caused by a gain value being mistakenly adjusted due to a sudden loud external sound can also be avoided.

Description

Control method, device, earphone device and storage medium of earphone transparent mode

This application claims the priority of the Chinese patent application submitted to the China Patent Office on November 18, 2021, with application number 202111372479.8, and the application name is "control method, device, earphone device and storage medium for earphone transparent mode", the entire content of which Incorporated in this application by reference.

technical field

The present application relates to the technical field of earphones, and in particular to a control method, device, earphone device and storage medium for a transparent mode of an earphone.

Background technique

Transparency mode is a common technology for earphones, the purpose is to enable the wearer to hear the ambient sound clearly without taking off the earphones. A common practice is to pick up the external ambient sound through the microphone on the outside of the earphone, perform gain processing on the picked up microphone signal (to obtain a transparent sound), and then emit it to the human ear through the earphone speaker. At present, when the user covers the earphone with his hand, the transparent sound played by the speaker is picked up by the microphone again due to the leakage of the earphone, and the transparent sound forms a closed loop in the link, and the continuous gain processing will produce howling . An existing solution to howling is to reduce the gain value when it is detected that the external environment signal picked up by the microphone exceeds a certain threshold. However, there is a problem with this solution that when there is a sudden loud sound such as the door closing sound, the microphone monitoring function will be triggered by mistake, resulting in the gain value being adjusted down, and the user will obviously feel that the outside sound becomes dull with the door closing sound. , poor user experience.

Contents of the invention

The main purpose of the present application is to provide a control method, device, earphone device and storage medium for earphone transparent mode, aiming to solve the problem of howling when earphones are covered in transparent mode and avoid false touches caused by external loud sounds.

In order to achieve the above purpose, the present application provides a method for controlling the transparent mode of earphones, the method is applied to earphone equipment, the earphone equipment includes a speaker and a microphone, and the earphone equipment picks up through the microphone when it is in the transparent mode The external environment signal is played through the loudspeaker after gain processing, and the method includes the following steps:

When the earphone device is in the transparent mode, obtain a first signal played through the speaker and picked up by the microphone, the frequency of the first signal is outside the user's hearing frequency range;

If the picked-up signal energy of the first signal is less than or equal to a first energy threshold, controlling the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the see-through mode;

If the picked-up signal energy of the first signal is greater than the first energy threshold, control the earphone device to perform gain processing with a gain value less than the second gain threshold in the see-through mode, wherein the The second gain threshold is less than or equal to the first gain threshold.

Optionally, the gain value adopted by the earphone device when entering the see-through mode is greater than or equal to the first gain threshold, and the acquiring the first signal played through the speaker and picked up by the microphone Before step, also include:

When the earphone device is in the transparent mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold, acquire a first external environment signal currently picked up by the microphone;

If the signal energy of the first external environment signal is greater than a second energy threshold, the first signal is played through the speaker.

Optionally, if the picked-up signal energy of the first signal is greater than the first energy threshold, controlling the earphone device to perform gain with a gain value less than the second gain threshold in the see-through mode After the processing steps, also include:

When the earphone device is in the transparent mode and the gain value adopted by the earphone device is less than the second gain threshold, play a second signal through the speaker, and pick up the second signal through the microphone, The frequency of the second signal is outside the user's hearing frequency range;

If the picked-up signal energy of the second signal is less than or equal to the first energy threshold, controlling the earphone device to perform gain with a gain value greater than or equal to the first gain threshold in the transparent mode deal with;

If the picked-up signal energy of the second signal is greater than the first energy threshold, controlling the earphone device to perform gain processing with a gain value smaller than the second gain threshold in the see-through mode.

When the earphone device is in the transparent mode and the gain value adopted by the earphone device is smaller than the second gain threshold, acquire a second external environment signal currently picked up by the microphone;

If the signal energy of the second external environment signal is less than or equal to the second energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the transparent mode ;

If the signal energy of the second external environment signal is greater than the second energy threshold, controlling the earphone device to perform gain processing with a gain value smaller than the second gain threshold in the see-through mode.

Optionally, when the earphone device is in the see-through mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold, acquiring the first external environment signal currently picked up by the microphone After the steps, also include:

If the signal energy of the first external environment signal is less than or equal to the second energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the transparent mode .

Optionally, if the picked-up signal energy of the first signal is greater than the first energy threshold, controlling the earphone device to perform gain with a gain value less than the second gain threshold in the see-through mode The processing steps include:

If the picked-up signal energy of the first signal is greater than the first energy threshold, detecting whether the gain value currently used by the earphone device in the see-through mode is less than a second gain threshold;

If the gain value currently used by the earphone device in the see-through mode is smaller than the second gain threshold, keep the gain value currently used by the earphone device in the see-through mode unchanged;

If the gain value currently used by the earphone device in the see-through mode is greater than or equal to the second gain threshold, the gain value currently used by the earphone device in the see-through mode is stepped according to a preset step decreases to less than the second gain threshold.

Optionally, the step of acquiring the first signal played through the speaker and picked up by the microphone includes:

obtaining the sound signal picked up by the microphone;

The sound signal is filtered to obtain a first signal played through the speaker and picked up by the microphone.

In order to achieve the above purpose, the present application also provides a control device for earphone see-through mode, the device is deployed in the earphone device, the earphone device includes a speaker and a microphone, and the earphone device passes through the microphone when it is in the see-through mode After picking up the external environment signal and performing gain processing, it is played through the speaker, and the device includes:

An acquisition module, configured to acquire a first signal played through the speaker and picked up by the microphone when the earphone device is in the see-through mode, the frequency of the first signal is outside the user's hearing frequency range;

A first control module, configured to control the headphone device to adopt a gain greater than or equal to a first gain threshold in the see-through mode if the signal energy of the picked-up first signal is less than or equal to a first energy threshold value for gain processing;

The second control module is configured to control the headphone device to use a gain value less than the second gain threshold in the transparent mode to perform the operation if the picked-up signal energy of the first signal is greater than the first energy threshold Gain processing, wherein the second gain threshold is less than or equal to the first gain threshold.

In order to achieve the above purpose, the present application also provides an earphone device, which includes a memory, a processor, and a control program for earphone pass-through mode stored on the memory and operable on the processor. When the control program of the earphone see-through mode is executed by the processor, the steps of the above-mentioned control method for the earphone see-through mode are realized.

In addition, in order to achieve the above object, the present application also proposes a computer-readable storage medium, the computer-readable storage medium stores a control program for the earphone see-through mode, and the control program for the earphone see-through mode is executed by the processor The steps of the method for controlling the earphone see-through mode as described above are realized at the same time.

In this application, by acquiring the first signal played by the speaker of the earphone device and picked up by the microphone when the earphone device is in the transparent mode, the frequency of the first signal is set to be outside the frequency range of the user's hearing, and when the first When the signal energy of the signal is less than or equal to the first energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the transparent mode; when the signal energy of the first signal is greater than the first energy threshold, The headphone device is controlled to perform gain processing with a gain value less than the second gain threshold in the transparent mode, and the second gain threshold is set to be less than or equal to the first gain threshold. In the transparent mode, the speaker is used to play the signal that the user cannot hear, and the energy of the signal picked up by the microphone is judged to determine whether the user covers the ear, and then when the user covers the ear, the gain value is adjusted to a small value. When the user does not cover the ears, the normal gain value is used for gain processing, which can not only avoid the howling caused by covering the ears, but also avoid the misadjustment of the gain value caused by the sudden loud sound from the outside, resulting in poor transparency, which improves the user's awareness of The experience of earphone transparency mode.

Description of drawings

FIG. 1 is a schematic flowchart of the first embodiment of the control method of the earphone see-through mode of the present application;

FIG. 2 is a schematic diagram of a control system framework of a headphone see-through mode according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a control flow of an earphone see-through mode according to an embodiment of the present application;

FIG. 4 is a schematic diagram of functional modules of a preferred embodiment of a control device for earphone see-through mode of the present application.

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

Referring to FIG. 1 , FIG. 1 is a schematic flow chart of a first embodiment of a method for controlling an earphone see-through mode of the present application.

The embodiment of this application provides an embodiment of the control method of the headphone see-through mode. It should be noted that although the logic sequence is shown in the flow chart, in some cases, all the steps may be executed in a different order than here. steps shown or described. The control method of the earphone transparent mode in this application is applied to the earphone device. The earphone device can include one or two earphones. Since the control method of the earphone transparent mode of the two earphones is the same, the following is for the convenience of description. By default, the earphone device includes one Only earphones are taken as an example to describe the embodiment. In this embodiment, the control method of the headset transparent mode includes:

Step S10, when the earphone device is in the see-through mode, acquire a first signal played through the speaker and picked up by the microphone, the frequency of the first signal is outside the user's hearing frequency range;

The earphone device may include a speaker and a microphone, and the microphone is arranged on a side of the earphone device close to the external environment to pick up external environmental signals. Set the transparent mode in the earphone device. In the transparent mode, the earphone device can pick up the external environment signal through the microphone, and perform gain processing on the external environment signal, and then play it through the speaker, so that when the user wears the earphone, it will not be caused by Headphones block the ear canal and affect the hearing of external sounds. Gain processing generally uses a transparent filter to perform gain processing, and the specific method may not be limited here.

In order to solve the howling problem caused by covering the ears in the transparent mode, and to avoid false touches caused by overcoming the howling problem when there is a loud sound from the outside, resulting in poor experience for the user in the transparent mode, in this embodiment In , it is proposed that when the earphone device is in the transparent mode, a sound signal of a specific frequency (hereinafter referred to as the first signal) is played by the speaker, and the first signal is picked up by the microphone, and the energy level of the first signal picked up is Make judgments to accurately determine whether the user covers the ears, and then accurately adjust the gain value to avoid howling while avoiding the gain adjustment when the external loud voice accidentally touches the ears. Wherein, the specific first signal is a signal with a frequency outside the user's hearing frequency range, that is, the user of the earphone device cannot hear the first signal played by the speaker. Everyone's hearing frequency range may be different, so in a specific embodiment, the frequency of the first signal can be selected empirically to suit most users, or set for specific users, for example, playing sounds of different frequencies through speakers The signal tests the auditory frequency range of the specific user, and the frequency of the first signal is selected according to the measured auditory frequency range.

When the earphone device is in the see-through mode, the timing of playing the first signal through the loudspeaker is not limited in this embodiment. For example, in one embodiment, when the earphone device is in the see-through mode, the first signal can be continuously or regularly played through the speaker, and correspondingly, the microphone can be used to continuously or regularly pick up the first signal; wherein, when When the speaker plays the first signal at regular intervals, the first signal can be played at regular intervals, each time for a certain duration, and the time interval between two adjacent first signals can be set to be shorter to avoid unplayed During the period of time, the user covers his ears and causes howling. In another embodiment, the earphone device may only play the first signal through the speaker when it detects that the energy value of the external environment signal picked up by the microphone is greater than a threshold when it is in the see-through mode; When the energy value is less than this threshold, the gain value can remain at the normal level of the transparent mode.

It should be noted that when the speaker does not play the first signal, the sound signal picked up by the microphone includes only the external environment signal; when the speaker plays the first signal, the sound signal picked up by the microphone includes the first signal and the external environment signal. When the speaker plays the first signal, since the first signal is known, the earphone device can extract the first signal from the sound signal picked up by the microphone.

Further, in an embodiment, the step of obtaining the first signal played through the speaker and picked up by the microphone in the step S10 includes:

Step S101, acquiring the sound signal picked up by the microphone;

Step S102, filtering the sound signal to obtain a first signal played through the speaker and picked up by the microphone.

The earphone device can play the first signal through the loudspeaker, obtain the sound signal picked up by the microphone, and filter the sound signal to obtain the first signal picked up by the microphone. Wherein, the filtering may specifically be setting a filter according to the frequency of the first signal, and using the filter to filter to obtain the first signal. For example, when the frequency of the first signal is high, a high-pass filter can be set for filtering; when the frequency of the first signal is low, a low-pass filter can be set for filtering, or a band-pass filter can also be set for filtering , which is not specifically limited in this embodiment.

Step S20, if the signal energy of the picked-up first signal is less than or equal to the first energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the see-through mode ;

After the first signal is picked up by the microphone, it may be determined whether the signal energy of the picked up first signal is greater than a first energy threshold. Among them, the first energy threshold can be set through testing, so that when the signal energy of the first signal picked up is greater than the first energy threshold, it means that the user has covered his ears with his hand; when the signal energy of the first signal picked up is less than or equal to When the first energy threshold is reached, it means that the user does not cover his ears. The principle is that when the user wears the earphones and covers the ears with his hands and wear leakage occurs, the signal energy of the first signal picked up by the microphone will be greater than the signal energy of the first signal picked up by the microphone when the user does not cover the ears. Therefore, by comparing the signal energy of the first signal with the set first energy threshold, it can be determined whether the user covers the ears.

If the signal energy of the picked-up first signal is less than or equal to the first energy threshold, it means that the user has not covered the ears. At this time, the earphone device can be controlled to use a gain value greater than or equal to the first gain threshold in the transparent mode. Gain processing. Wherein, the first gain threshold can be set according to experience. The first gain threshold is a gain value that can achieve the transparent effect of external sounds without howling when the user does not cover the ears. When the user covers the ears, Howling may occur if gain processing is performed with the first gain threshold. Then, when there is a sudden loud sound outside but the user does not cover the ears, it can be determined that the user has not covered the ears by judging the signal energy of the picked-up first signal, and then the gain processing is still performed with the normal gain value , so that the user can hear more real external sounds, that is, the transparent effect is more real.

The specific implementation details of controlling the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the pass-through mode are not limited in this embodiment. For example, in one embodiment, when the earphone device detects that the signal energy of the first signal picked up is less than or equal to the first energy threshold, it may first determine whether the currently used gain value is greater than or equal to the first gain threshold; if greater than or equal to the first gain threshold, the earphone device does not need to adjust, just keep the current gain value; if it is less than the first gain threshold, the earphone device can directly set the gain value to a value greater than or equal to the first gain threshold , or, it may also be increased based on the current gain value in a certain step, and after at least one step of adjustment, the gain value reaches a level greater than or equal to the first gain threshold. As another example, in another implementation manner, the earphone device may directly set the gain value to a value greater than or equal to the first gain threshold when it detects that the signal energy of the picked-up first signal is less than or equal to the first energy threshold .

Step S30, if the picked-up signal energy of the first signal is greater than the first energy threshold, control the earphone device to perform gain processing with a gain value less than the second gain threshold in the see-through mode, wherein , the second gain threshold is less than or equal to the first gain threshold.

If the signal energy of the first signal picked up is greater than the first energy threshold, it means that the user has covered his ears. At this time, in order to avoid howling, the earphone device can be controlled to use a gain less than the second gain threshold in the transparent mode. value for gain processing. Wherein, the second gain threshold can be set according to experience. The second gain threshold is a gain value that will not cause howling due to earphone leakage when the user covers his ears. According to specific circumstances, it can be set to be less than or equal to the first gain threshold. .

Further, in an embodiment, the earphone device may first detect whether the energy value of the external environment signal picked up by the microphone is greater than the second energy threshold when detecting that the signal energy of the first signal picked up is greater than the first energy threshold. , if it is greater than the second energy threshold, the headphone device is controlled to use a gain value less than the second gain threshold for gain processing in the transparent mode; if it is greater than or equal to the second energy threshold, the headphone device can be controlled to adopt the Gain processing is performed on gain values greater than or equal to the first gain threshold. Wherein, the second energy threshold can be set as required, so that when the energy value of the external environment signal picked up by the microphone is less than or equal to the second energy threshold, no howling will occur, and when the energy value of the external environment signal picked up by the microphone When the energy value is greater than the second energy threshold, howling may occur for a period of time. That is, if the user covers his ears, but the signal energy of the external environment signal has not reached the level where howling will occur, the normal gain level can still be maintained. When the signal energy of the external environment signal reaches the level where howling will occur When the level is high, the gain value should be adjusted to a small value to avoid howling.

The specific implementation details of controlling the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the pass-through mode are not limited in this embodiment. For example, in an implementation manner, the earphone device may directly set the gain value to a value smaller than the second gain threshold when it detects that the signal energy of the picked-up first signal is greater than the first energy threshold.

Further, in another implementation manner, the step S30 includes:

Step S301, if the picked-up signal energy of the first signal is greater than the first energy threshold, then detecting whether the gain value currently used by the earphone device in the see-through mode is less than a second gain threshold;

Step S302, if the gain value currently used by the earphone device in the see-through mode is smaller than the second gain threshold, keep the gain value currently used by the earphone device in the see-through mode unchanged;

Step S303, if the gain value currently used by the earphone device in the see-through mode is greater than or equal to the second gain threshold, set the gain value currently used by the earphone device in the see-through mode according to a preset Let step decrease to less than the second gain threshold.

When the earphone device detects that the signal energy of the picked-up first signal is greater than the first energy threshold, it may first determine whether the currently used gain value is less than the second gain threshold. If the currently used gain value is less than the second gain threshold, the earphone device does not need to be adjusted, just keep the current gain value; if the currently used gain value is greater than or equal to the second gain threshold, the earphone device can directly adjust the gain value It is set to a value smaller than the second gain threshold, or it can also be reduced based on the current gain value in preset steps, and after at least one step of adjustment, the gain value reaches a level smaller than the second gain threshold. Wherein, the preset step can be set as required, which is not limited in this embodiment.

In this embodiment, by acquiring the first signal played by the speaker of the earphone device and picked up by the microphone when the earphone device is in the pass-through mode, the frequency of the first signal is set to be outside the frequency range of the user's hearing, and when When the signal energy of the first signal is less than or equal to the first energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the transparent mode; when the signal energy of the first signal is greater than the first energy threshold , the earphone device is controlled to use a gain value less than the second gain threshold to perform gain processing in the transparent mode, and the second gain threshold is set to be less than or equal to the first gain threshold. In the transparent mode, the speaker is used to play the signal that the user cannot hear, and the energy of the signal picked up by the microphone is judged to determine whether the user covers the ear, and then when the user covers the ear, the gain value is adjusted to a small value. When the user does not cover the ears, the normal gain value is used for gain processing, which can not only avoid the howling caused by covering the ears, but also avoid the misadjustment of the gain value caused by the sudden loud sound from the outside, resulting in poor transparency, which improves the user's awareness of The experience of earphone transparency mode.

Further, based on the above-mentioned first embodiment, a second embodiment of the control method of the earphone see-through mode of the present application is proposed. In this embodiment, in the step S10, the acquisition is played through the speaker and picked up by the microphone. Before the first signal step, also include:

Step S40, when the earphone device is in the transparent mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold, acquire the first external environment signal currently picked up by the microphone;

In this embodiment, in order to avoid excessive resource consumption of the earphone device caused by the earphone device sending out the first signal all the time, the first signal can be played through the speaker only when the signal energy of the external environment signal picked up by the earphone device microphone is greater than the second energy threshold. a signal.

Specifically, when the earphone device enters the transparency mode, the gain value adopted by default may be greater than or equal to the first gain threshold, so as to ensure the normal transparency function of the transparency mode. Afterwards, when the earphone device is in the transparent mode and the adopted gain value is greater than or equal to the first gain threshold, the external environment signal picked up by the current microphone (hereinafter referred to as the first external environment signal for convenience of distinction) is acquired. It should be noted that when the earphone device is in the transparent mode and the gain value adopted is greater than or equal to the first gain threshold, the earphone device will obtain the external environment signal picked up by the microphone to monitor whether there is loud sound outside in real time.

Step S50, playing the first signal through the speaker if the signal energy of the first external environment signal is greater than a second energy threshold.

After picking up the first external environment signal, it may be determined whether the signal energy of the first external environment signal is greater than the second energy threshold. If the signal energy of the first external environment signal is greater than the second energy threshold, it means that if the user continues to cover his ears at this time, howling may be caused. At this time, the earphone device can play the first signal through the speaker, and pick up the second signal through the microphone. First signal, by judging the signal energy of the first signal picked up, it is determined whether the user is covering the ears at this time; At this time, reduce the gain value to be lower than the second gain threshold to avoid howling; if it is determined that the user does not cover his ears, it means that it is a natural loud sound from the outside world. At this time, keep the gain value at the first gain threshold or above Level, to ensure normal permeability function.

When the earphone device is in the transparent mode and the gain value adopted is less than the second gain threshold, the earphone device may restore the gain value to a level greater than or equal to the second gain threshold when a certain condition is met. The method restores the gain value when it is detected that the user does not cover the ears, or it may be detected that the signal energy of the external environment signal is lower than the second energy threshold, which is not limited in this embodiment.

Further, in an implementation manner, after the step S30, it also includes:

Step A10, when the earphone device is in the transparent mode and the gain value adopted by the earphone device is less than the second gain threshold, play a second signal through the speaker, and pick up the first signal through the microphone. two signals, the frequency of the second signal is outside the user's hearing frequency range;

When the gain value adopted by the earphone device is smaller than the second gain threshold, the earphone device can play the second signal through the speaker. The second signal may be a different signal from the first signal, or the same signal, but the frequencies of the second signal and the first signal are outside the frequency range of the user's hearing, that is, the second signal picked up by the microphone Judging the energy level of the signal can also determine whether the user covers his ears.

It should be noted that when the earphone device is in the see-through mode and the gain value adopted is less than the second gain threshold, the earphone device will play the second signal through the loudspeaker to determine whether the user covers the ears in real time.

Step A20, if the picked-up signal energy of the second signal is less than or equal to the first energy threshold, controlling the earphone device to adopt a gain greater than or equal to the first gain threshold in the see-through mode value for gain processing;

After the second signal is picked up by the microphone, it may be determined whether the signal energy of the second signal is less than or equal to the first energy threshold. Similar to the first signal, when the signal energy of the second signal is less than or equal to the first energy threshold, it means that the user does not cover the ears. At this time, the earphone device can be controlled to adopt a gain greater than or equal to the first gain threshold Gain processing is performed on the gain value, that is, the gain value is restored to a normal level, so as to ensure a normal see-through function. At this time, since the previous gain value was smaller than the second gain threshold, when controlling the earphone device to use a gain value greater than or equal to the first gain threshold for gain processing, specifically, the gain value can be directly set to a value greater than or equal to the second gain threshold. The value of a gain threshold may also be increased in certain steps based on the current gain value, and after at least one adjustment, the gain value reaches a level greater than or equal to the first gain threshold.

Step A30, if the picked-up signal energy of the second signal is greater than the first energy threshold, control the earphone device to perform gain processing with a gain value smaller than the second gain threshold in the see-through mode .

When the signal energy of the second signal is greater than the first energy threshold, it means that the user is still covering his ears. At this time, the earphone device is still controlled to perform gain processing with a gain value smaller than the second gain threshold to avoid howling. Since the previous gain value was smaller than the second gain threshold, when controlling the earphone device to use a gain value smaller than the second gain threshold for gain processing, specifically, the gain value can be directly set to a value smaller than the second gain threshold, or Keep the current buff value unchanged.

If it is detected that the signal energy of the external environment signal picked up by the microphone is greater than a certain threshold, the gain value will be reduced, and the gain value will be restored if it is less than or equal to the threshold value. When the gain value is reduced, the external environment signal energy is less than the threshold value, and the gain value is restored, and then the howling is caused by a larger gain value. When the user covers his ears, the earphone howling will appear. The sound appears and then disappears, then appears and disappears again, in a continuous loop, resulting in poor user experience. However, in this embodiment, since the earphone device lowers the gain value when it detects that the ears are covered, the gain value is not restored until it is detected that the ears are not covered, so that the situation where howling suddenly appears and disappears suddenly is avoided.

Further, in an implementation manner, after the step S30, it also includes:

Step B10, when the earphone device is in the transparent mode and the gain value adopted by the earphone device is smaller than the second gain threshold, acquire the second external environment signal currently picked up by the microphone;

When the earphone device is in the transparent mode and the gain value used for gain processing is less than the second gain threshold, the earphone device obtains the external environment signal picked up by the current microphone (hereinafter referred to as the second external environment signal for easy distinction). It should be noted that when the earphone device is in the transparent mode and the gain value adopted is less than the second gain threshold, the earphone device will obtain the external environment signal picked up by the microphone to monitor in real time whether there is no loud sound outside.

Step B20, if the signal energy of the second external environment signal is less than or equal to the second energy threshold, controlling the earphone device to adopt a gain value greater than or equal to the first gain threshold in the see-through mode Perform gain processing;

After picking up the second external environment signal, it may be determined whether the signal energy of the second external environment signal is greater than a second energy threshold. If the signal energy of the second external environment signal is less than or equal to the second energy threshold, it means that howling will not occur at this time; at this time, the earphone device can be controlled to use a gain value greater than or equal to the first gain threshold in the transparent mode. Gain processing to ensure normal transparent function.

Since the previous gain value was smaller than the second gain threshold, when controlling the headphone device to use a gain value greater than or equal to the first gain threshold for gain processing, specifically, the gain value can be directly set to a value greater than or equal to the first gain threshold The value of , may also be increased in certain steps based on the current gain value, and after at least one adjustment, the gain value reaches a level greater than or equal to the first gain threshold.

Step B30, if the signal energy of the second external environment signal is greater than the second energy threshold, control the earphone device to perform gain processing with a gain value smaller than the second gain threshold in the see-through mode.

If the signal energy of the second external environment signal is greater than the second energy threshold, it means that if the user continues to cover his ears at this time, howling may be caused. At this time, the earphone device is still controlled to use a gain value smaller than the second gain threshold for gain. handling to avoid howling. Since the previous gain value was smaller than the second gain threshold, when controlling the earphone device to use a gain value smaller than the second gain threshold for gain processing, specifically, the gain value can be directly set to a value smaller than the second gain threshold, or Keep the current buff value unchanged.

Further, in one embodiment, after the step S40, it also includes:

Step S60, if the signal energy of the first external environment signal is less than or equal to the second energy threshold, control the earphone device to adopt a gain value greater than or equal to the first gain threshold in the see-through mode Perform gain processing.

If the signal energy of the first external environment signal is less than or equal to the second energy threshold, it means that howling will not occur at this time; at this time, the earphone device can be controlled to use a gain value greater than or equal to the first gain threshold in the transparent mode. Gain processing to ensure normal transparent function.

Further, in an implementation manner, as shown in FIG. 2 , it is a schematic diagram of a control system framework of a feasible earphone see-through mode. Among them, the processor is a processing platform for correlation detection processing and transparent filtering processing; the microphone is used to pick up the sound signal; the speaker is used to convert the electrical signal into a sound signal and send it out; the energy monitoring module is used to monitor the external environment signal picked up by the microphone. Energy size; filter module is used for filtering out interference, retains high-frequency signal (the first signal is exemplarily limited to the high-frequency signal outside the user's hearing frequency range in Fig. 2); High-frequency signal energy monitoring module is used for monitoring The energy of the high frequency signal picked up by the microphone; the gain control module is used to control the gain value of the transparent filter according to the output of the high frequency signal energy monitoring module; the transparent filter is used to amplify the intermediate frequency signal picked up by the microphone to achieve the The effect of non-inductive wearing; the high-frequency signal generator generates a high-frequency signal for detecting whether the user covers the ear. Further, in one embodiment, as shown in FIG. 3 , it is a schematic diagram of a control flow of an earphone see-through mode implemented according to the system framework shown in FIG. 2 .

In addition, the embodiment of the present application also proposes a control device for the earphone see-through mode, the device is deployed in the earphone device, the earphone device includes a speaker and a microphone, and the earphone device picks up through the microphone when it is in the see-through mode. The external environment signal is played through the speaker after gain processing. Referring to FIG. 4, the control device of the transparent mode of the earphone includes:

An acquisition module 10, configured to acquire a first signal played through the speaker and picked up by the microphone when the earphone device is in the see-through mode, the frequency of the first signal is outside the user's hearing frequency range ;

The first control module 20 is configured to control the headphone device to adopt a gain value greater than or equal to the first gain threshold in the see-through mode if the picked-up signal energy of the first signal is less than or equal to the first energy threshold. Gain value for gain processing;

The second control module 30 is configured to control the headphone device to adopt a gain value less than the second gain threshold in the see-through mode if the picked-up signal energy of the first signal is greater than the first energy threshold performing gain processing, wherein the second gain threshold is less than or equal to the first gain threshold.

Further, the acquiring module 10 is further configured to acquire the currently picked up by the microphone when the earphone device is in the see-through mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold. The first external environment signal;

The device also includes:

A playing module, configured to play the first signal through the speaker if the signal energy of the first external environment signal is greater than a second energy threshold.

Further, the playing module is further configured to play a second signal through the speaker when the earphone device is in the see-through mode and the gain value adopted by the earphone device is less than the second gain threshold, and pass the The microphone picks up the second signal, and the frequency of the second signal is outside the user's hearing frequency range;

The device also includes:

A third control module, configured to control the earphone device to use a power greater than or equal to the first energy threshold in the see-through mode if the picked-up signal energy of the second signal is less than or equal to the first energy threshold. Perform gain processing on the gain value of the gain threshold;

A fourth control module, configured to control the headphone device to adopt a gain less than the second gain threshold in the see-through mode if the picked-up signal energy of the second signal is greater than the first energy threshold value for gain processing.

Further, the acquiring module 10 is further configured to acquire the second gain value currently picked up by the microphone when the earphone device is in the see-through mode and the gain value adopted by the earphone device is smaller than the second gain threshold. External environment signal;

The device also includes:

A fifth control module, configured to control the earphone device to adopt a gain greater than or equal to the first gain in the see-through mode if the signal energy of the second external environment signal is less than or equal to the second energy threshold Threshold gain value for gain processing;

A sixth control module, configured to control the headphone device to use a gain value less than the second gain threshold in the see-through mode if the signal energy of the second external environment signal is greater than the second energy threshold Perform gain processing.

Further, the device also includes:

A seventh control module, configured to control the headphone device to adopt a gain greater than or equal to the first gain in the see-through mode if the signal energy of the first external environment signal is less than or equal to the second energy threshold Threshold gain value for gain processing.

Further, the second control module 30 is also used for:

Further, the acquiring module 10 is also used for:

obtaining the sound signal picked up by the microphone;

The expanded content of the specific implementation of the device for controlling the earphone see-through mode of the present application is basically the same as the embodiments of the above-mentioned control method for the earphone see-through mode, and will not be repeated here.

The earphone device of the present application may include a speaker and a microphone. When the earphone device is in the transparent mode, the external environment signal is picked up by the microphone and played through the speaker after gain processing. The earphone device also includes a memory, a processor and A control program of the earphone see-through mode stored on the memory and operable on the processor, when the control program of the earphone see-through mode is executed by the processor, the operations are as follows:

Further, the gain value adopted by the earphone device when entering the see-through mode is greater than or equal to the first gain threshold, and before acquiring the first signal played through the speaker and picked up by the microphone, When the control program of the earphone see-through mode is executed by the processor, operations such as:

Further, if the picked-up signal energy of the first signal is greater than the first energy threshold, control the earphone device to perform gain processing with a gain value less than the second gain threshold in the transparent mode Afterwards, when the control program of the earphone see-through mode is executed by the processor, operations such as:

Further, when the earphone device is in the see-through mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold, after acquiring the current first external environment signal picked up by the microphone When the control program of the earphone transparent mode is executed by the processor, operations such as:

Further, if the picked-up signal energy of the first signal is greater than the first energy threshold, control the earphone device to perform gain processing with a gain value less than the second gain threshold in the transparent mode include:

Further, the acquiring the first signal played through the speaker and picked up by the microphone includes:

obtaining the sound signal picked up by the microphone;

In addition, the embodiment of the present application also proposes a computer-readable storage medium, on which a control program of the earphone see-through mode is stored, and when the control program of the earphone see-through mode is executed by a processor, the above-mentioned The steps of the control method of the earphone see-through mode.

The various embodiments of the earphone device and the computer-readable storage medium of the present application can refer to the various embodiments of the control method of the earphone see-through mode of the present application, and details are not repeated here.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the technical solution of the present application can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present application.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Claims

A method for controlling a transparent mode of an earphone, wherein the method is applied to an earphone device, the earphone device includes a loudspeaker and a microphone, and when the earphone device is in the transparent mode, the external environment signal is picked up by the microphone and Playing through the loudspeaker after gain processing, the method includes the following steps:

When the earphone device is in the transparent mode, obtain a first signal played through the speaker and picked up by the microphone, the frequency of the first signal is outside the user's hearing frequency range;

If the picked-up signal energy of the first signal is less than or equal to a first energy threshold, controlling the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the see-through mode;

If the picked-up signal energy of the first signal is greater than the first energy threshold, control the earphone device to perform gain processing with a gain value less than the second gain threshold in the see-through mode, wherein the The second gain threshold is less than or equal to the first gain threshold.
The method for controlling the earphone transparent mode according to claim 1, wherein the gain value adopted by the earphone device when entering the transparent mode is greater than or equal to the first gain threshold, and the acquisition is obtained through the Before the step of the first signal played by the speaker and picked up by the microphone, it also includes:

When the earphone device is in the transparent mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold, acquire a first external environment signal currently picked up by the microphone;

If the signal energy of the first external environment signal is greater than a second energy threshold, the first signal is played through the speaker.
The method for controlling the earphone see-through mode according to claim 2, wherein if the signal energy of the picked-up first signal is greater than the first energy threshold, then controlling the earphone device in the After the step of performing gain processing with a gain value smaller than the second gain threshold in the transparent mode, the method further includes:

When the earphone device is in the transparent mode and the gain value adopted by the earphone device is less than the second gain threshold, play a second signal through the speaker, and pick up the second signal through the microphone, The frequency of the second signal is outside the user's hearing frequency range;

If the picked-up signal energy of the second signal is less than or equal to the first energy threshold, controlling the earphone device to perform gain with a gain value greater than or equal to the first gain threshold in the transparent mode deal with;

If the picked-up signal energy of the second signal is greater than the first energy threshold, controlling the earphone device to perform gain processing with a gain value smaller than the second gain threshold in the see-through mode.
The method for controlling the earphone see-through mode according to claim 2, wherein if the signal energy of the picked-up first signal is greater than the first energy threshold, then controlling the earphone device in the After the step of performing gain processing with a gain value smaller than the second gain threshold in the transparent mode, the method further includes:

When the earphone device is in the transparent mode and the gain value adopted by the earphone device is smaller than the second gain threshold, acquire a second external environment signal currently picked up by the microphone;

If the signal energy of the second external environment signal is less than or equal to the second energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the transparent mode ;

If the signal energy of the second external environment signal is greater than the second energy threshold, controlling the earphone device to perform gain processing with a gain value smaller than the second gain threshold in the see-through mode.
The control method of earphone transparent mode according to claim 2, characterized in that, when the earphone device is in the transparent mode and the gain value adopted by the earphone device is greater than or equal to the first gain threshold , after the step of obtaining the first external environment signal picked up by the current microphone, it also includes:

If the signal energy of the first external environment signal is less than or equal to the second energy threshold, control the earphone device to perform gain processing with a gain value greater than or equal to the first gain threshold in the transparent mode .
The method for controlling the earphone see-through mode according to claim 1, wherein if the picked-up signal energy of the first signal is greater than the first energy threshold, then controlling the earphone device in the The steps of performing gain processing with a gain value smaller than the second gain threshold in the transparent mode include:

If the picked-up signal energy of the first signal is greater than the first energy threshold, detecting whether the gain value currently used by the earphone device in the see-through mode is less than a second gain threshold;

If the gain value currently used by the earphone device in the see-through mode is smaller than the second gain threshold, keep the gain value currently used by the earphone device in the see-through mode unchanged;

If the gain value currently used by the earphone device in the see-through mode is greater than or equal to the second gain threshold, the gain value currently used by the earphone device in the see-through mode is stepped according to a preset step decreases to less than the second gain threshold.
The control method for earphone see-through mode according to any one of claims 1 to 6, wherein the step of acquiring the first signal played through the speaker and picked up by the microphone comprises:

obtaining the sound signal picked up by the microphone;

The sound signal is filtered to obtain a first signal played through the speaker and picked up by the microphone.
A control device for an earphone see-through mode, characterized in that the device is deployed on an earphone device, the earphone device includes a speaker and a microphone, and when the earphone device is in the see-through mode, the external environment signal is picked up by the microphone and Playing through the loudspeaker after gain processing, the device includes:

An acquisition module, configured to acquire a first signal played through the speaker and picked up by the microphone when the earphone device is in the see-through mode, the frequency of the first signal is outside the user's hearing frequency range;

A first control module, configured to control the headphone device to adopt a gain greater than or equal to a first gain threshold in the see-through mode if the signal energy of the picked-up first signal is less than or equal to a first energy threshold value for gain processing;

The second control module is configured to control the headphone device to use a gain value less than the second gain threshold in the transparent mode to perform the operation if the picked-up signal energy of the first signal is greater than the first energy threshold Gain processing, wherein the second gain threshold is less than or equal to the first gain threshold.
An earphone device, characterized in that the earphone device includes a memory, a processor, and a control program of an earphone see-through mode stored on the memory and operable on the processor, and the earphone see-through mode When the control program is executed by the processor, the steps of the method for controlling the earphone see-through mode according to any one of claims 1 to 7 are implemented.
A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a control program for the earphone see-through mode, and when the control program for the earphone see-through mode is executed by a processor, the following claims 1 to 1 are implemented. Steps in the method for controlling the earphone see-through mode described in any one of 7.