WO2023197474A1 - Method for determining parameter corresponding to earphone mode, and earphone, terminal and system - Google Patents

Abstract

A method for determining a parameter corresponding to an earphone mode, and an earphone, a terminal and a system. In the method, an earphone can adjust a default prompt audio signal, and can then play an adjusted prompt audio signal, so as to obtain a reference prompt audio signal; then, a target playing model is determined on the basis of the adjusted prompt audio signal and the reference prompt audio signal; then, the target playing model is matched with preset playing models in a mode setting database to determine, from the mode setting database, a preset playing model matching the target playing model, and an earphone mode corresponding to the matching preset playing model and a parameter corresponding to the earphone mode are determined; and then the earphone processes an audio signal on the basis of the earphone mode corresponding to the matching preset playing model and the parameter corresponding to the earphone mode.

Description

A parameter determination method, headset, terminal and system corresponding to a headset mode

This application claims the priority of the Chinese patent application submitted to the China Patent Office on April 11, 2022, with the application number 202210371139.1 and the application title "A parameter determination method, earphone, terminal and system corresponding to the earphone mode", all of which The contents are incorporated into this application by reference.

Technical field

The present application relates to the field of audio processing technology, and in particular, to a method for determining parameters corresponding to a headphone mode, a headset, a terminal and a system.

Background technique

With the development of science and technology, the functions of headphones are increasing and gradually improving. At present, some headphones can provide users with multiple headphone modes. When the headphones use different headphone modes to play music, they can bring different experiences to the users. Common headphone modes include one or more of active noise reduction (active noise control, ANC) mode, transparent transmission (hearthrough, HT) mode, or standard mode. When the headphone mode of the headset is active noise reduction mode, the function of filtering out ambient sound signals (can be regarded as a kind of noise) can be realized when the user wears the headset; when the headphone mode of the headset is the transparent transmission mode, the user can When putting on the earphones, the user can still feel the environmental sound signals in the same way as when not wearing the earphones, that is, the user has the same experience of the environmental sound signals before and after wearing the earphones; when the earphone mode of the earphones is the standard mode, after wearing the earphones, the user can Good listening effect when wearing headphones.

In the same headphone mode, different parameters can be corresponding. These different parameters can bring different degrees of processing effects to the same headphone mode. The different degrees of processing effects include that the headphones can realize the corresponding functions of the same headphone mode to different degrees. For example, take the active noise reduction mode as an example. The active noise reduction mode can correspond to different parameters. Different parameters can be used to filter out environmental sound signals to different degrees. That is, the degree of active noise reduction can be strong or weak. The active noise reduction mode can be strong or weak. When the noise level is stronger, the user hears fewer environmental sound signals. When the active noise reduction level is weaker, the user can hear more environmental sound signals. When the active noise reduction level is the weakest, it can be considered that the headset does not perform any reduction. Noise processing.

Since different users have different ear canal models and the same user is in different environments with different levels of environmental noise, in order to achieve the optimal listening experience in each headphone mode for different users, the parameters of the headphone mode need to be adapted. How to adapt to achieve the optimal listening experience for different users is a direction worthy of study.

Contents of the invention

This application provides a method, earphones, terminals and systems for determining parameters corresponding to the earphone mode. The earphones can determine the parameters corresponding to the earphone mode in different wearing situations and different ear canal models to achieve the target listening experience.

In a first aspect, this application provides a method for determining parameters corresponding to a headphone mode, which is applied to headphones. The method includes: the headphone acquires target environmental sound characteristics, and determines the target hearing sensation when the headphone mode is the first headphone mode; The target environmental sound characteristics are used to reflect the energy of the environmental sound signal; the headset adjusts the default prompt audio signal of the first headphone mode based on the target environmental sound characteristics to obtain an adjusted prompt audio signal; the energy of the environmental sound signal The larger it is, the greater the energy of the adjusted prompt audio signal. The smaller the energy of the environmental sound signal, the smaller the energy of the adjusted prompt audio signal. After the headset plays the adjusted prompt audio signal, it passes through the microphone. Collect the played prompt audio signal to obtain a feedback audio signal; the headset determines a target playback model based on the adjusted prompt audio signal and the feedback audio signal; the target playback model is used to reflect the user's wearing of the headset and the user's ear canal model ; The headset determines a preset playback model that matches the target playback model from all preset playback models in the mode setting database; the mode setting database includes multiple preset playback models, where each preset playback model also Corresponding to at least one parameter, each parameter in the at least one parameter corresponds to a headphone mode and a preset hearing sense; the headset determines the target parameter corresponding to the matching preset playback model; the headphone mode corresponding to the target parameter is The first earphone mode and the preset hearing sensation corresponding to the target parameter are the target hearing sensation; the earphone processes the audio signal based on the first earphone mode and the target parameter corresponding to the first earphone mode.

In the above embodiment, a mode setting database can be set in the earphones. The mode database records the first mode to be achieved based on different preset playback models (ie, different earphone wearing conditions and ear canal models) in a quiet environment. Parameters corresponding to the target listening experience in headphone mode. The first headphone mode may be an active noise reduction mode or a transparent transmission mode described in the following embodiments. Then, during actual use, the target playback model can be determined to reflect the current wearing situation of the headphones and the ear canal model, and then it is determined that the target playback model matches the preset playback model corresponding to the first headphone mode to achieve the target listening feeling. target parameters. However, if the energy of the environmental sound signal is large, it means that the environment is noisy. When the environment is noisy, the environmental sound signal will affect the accuracy of the target playback model, and the determined target parameters will be wrong. Therefore, the energy of the default prompt audio signal can be increased. This allows it to offset the impact of environmental sound signals. If the energy of the environmental sound signal is small, it means that the environment is quiet. When the environment is quiet, making the energy of the default audio signal smaller can improve the user's hearing experience and prevent the user from feeling uncomfortable when hearing the default audio signal in a quiet environment.

Combined with the first aspect, the microphone serves as a feedback microphone for the headset.

In the above embodiment, the feedback microphone can collect sound signals in the ear canal to obtain feedback audio signals with more comprehensive information.

Combined with the first aspect, the target environmental sound characteristics include one or more of absolute energy, relative energy, and energy proportions of different frequency bands of the environmental sound signal.

Combined with the first aspect, the target environmental sound characteristics include the absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal. The earphone acquires the target environmental sound characteristics, specifically including: the earphone collects the environmental sound signal to obtain the first environmental audio signal. ; The headset determines the absolute energy, relative energy, and energy proportions of different frequency bands of the environmental sound signal in the first environmental audio signal as the target environmental sound characteristics based on the first environmental audio signal.

In the above embodiment, the headset can obtain the target environmental sound characteristics based on the first environmental audio signal, without relying on the terminal to analyze the target environmental sound characteristics, and can obtain the target environmental sound characteristics more quickly. And when the headset is not connected to the terminal, it can still be ensured that the headset can obtain the target environmental sound characteristics.

Combined with the first aspect, the target environmental sound characteristics include the absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal. The earphone acquires the target environmental sound characteristics, specifically including: the earphone collects the environmental sound signal to obtain the first environmental audio. signal; the headset determines a first environmental sound characteristic based on the first environmental audio signal, the first environmental sound characteristic includes the absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal in the first environmental audio signal; the The earphone receives the second environmental sound characteristics sent by the terminal connected to the earphone. The second environmental sound characteristics include the absolute energy, relative energy and energy proportion of the environmental sound signal in the second environmental audio signal; the second environment The audio signal is an environmental sound signal collected by the terminal; when the first environmental sound characteristic and the second environmental sound characteristic are the same, the headset determines that the first environmental sound characteristic is the target environmental sound characteristic; in the first When the environmental sound characteristics are different from the second environmental sound characteristics, the headset can set different weights based on the first environmental sound characteristics and the second environmental sound characteristics for fusion, and use the fusion result as the target environmental sound. feature. In the above embodiment, the headset can determine the target environmental sound feature based on the first environmental sound feature determined by the headset and the second environmental sound feature determined by the terminal, which can enhance the accuracy of the target environmental sound feature. In the case of an error in the headset, the terminal determines Secondary ambient sound signatures can compensate.

Combined with the first aspect, the headset adjusts the default prompt audio signal of the first headset mode based on the target environmental sound characteristics, specifically including: when it is determined that the energy of the environmental sound signal is greater than or equal to the first threshold, the headset adjusts the default prompt audio signal. The energy of the prompt audio signal increases from the first energy to the second energy, and the second energy is greater than the energy of the feedback environmental sound signal; the energy of the feedback environmental sound signal is used to represent the energy size of the environmental sound signal in the ear canal; or, When it is determined that the energy of the environmental sound signal is less than or equal to the second threshold, the headset reduces the energy of the default prompt audio signal from the first energy to the third energy.

In the above embodiment, when it is determined that the environmental sound signal is greater than or equal to the first threshold, the first threshold can be the second energy threshold recorded in the embodiment, which means that the headset determines that the environment is noisy, so the default prompt audio signal can be increased. Energy to offset the impact of environmental sound signals on generating target playback models. When it is determined that the environmental sound signal is less than or equal to the second threshold, which can be the first energy threshold recorded in the embodiment, it means that the headset determines that the environment is quiet, so the energy of the default prompt audio signal can be reduced to allow the user to listen When the default prompt audio signal is reached, you will not feel uncomfortable due to the large energy of the default prompt audio signal (unadjusted).

Combined with the first aspect, the headset adjusts the default prompt audio signal of the first headphone mode based on the target environmental sound characteristics, specifically including: when it is determined that the energy of the environmental sound signal is greater than or equal to the first threshold, the headset adjusts the default prompt audio signal. The energy of the audio signal increases from the first energy to the second energy, the second energy is greater than the energy of the feedback environmental sound signal, and the energy proportion of the default prompt audio signal in different frequency bands is adjusted to be consistent with the target environmental sound characteristics. The energy proportion of the environmental sound signal in different frequency bands is related; the energy of the feedback environmental sound signal is used to represent the energy of the environmental sound signal in the ear canal; or, when it is determined that the energy of the environmental sound signal is less than or equal to the second threshold, The earphone reduces the energy of the default prompt audio signal from the first energy to the third energy.

In the above embodiment, when it is determined that the environmental sound signal is greater than or equal to the first threshold, the first threshold can be the second energy threshold recorded in the embodiment, which means that the headset determines that the environment is noisy, so the default prompt audio signal can be increased. The energy and the energy proportion of the default prompt audio signal in different frequency bands are the same as or corresponding to the environmental sound signal, which can ensure that the energy of the default prompt audio signal in each frequency band can be greater than the energy of the environmental sound signal, which can be better to offset the influence of environmental sound signals on generating target playback models. When it is determined that the environmental sound signal is less than or equal to the second threshold, which can be the first energy threshold recorded in the embodiment, it means that the headset determines that the environment is quiet, so the energy of the default prompt audio signal can be reduced to allow the user to listen When the default prompt audio signal is reached, you will not feel uncomfortable due to the large energy of the default prompt audio signal (unadjusted).

Combined with the first aspect, the energy of the environmental sound signal is one of the target energy obtained by combining the target environmental sound characteristics including absolute energy, relative energy, or absolute energy and relative energy of the environmental sound signal.

With reference to the first aspect, the target listening feeling is the listening feeling set by the user through the headset or the terminal connected to the headset; in the case where the user does not set the target listening feeling, the headset or the terminal connected to the headset sets one. The default listening feeling is used as the target listening feeling.

Combined with the first aspect, the headset determines a target playback model based on the adjusted prompt audio signal and the feedback audio signal, specifically including: the headset converts the adjusted prompt audio signal and the feedback audio signal into the frequency domain, so that The adjusted prompt audio signal and any frame audio signal in the feedback audio signal include N frequency points, where N is an integer power of 2; the headset is based on the adjusted prompt audio converted to the frequency domain. The signal and the feedback audio signal determine the target playback model; N energy ratios in the target playback model; including the first total energy ratio, the first total energy ratio is all the first frequencies in the adjusted prompt audio signal The ratio of the total energy of a frequency point to the total energy of all frequency points of the first frequency in the feedback audio signal; the first frequency is one of N frequencies corresponding to N frequency points in a frame of audio signal. In the above embodiment, the comparison relationship between the feedback audio signal and the adjusted default prompt audio signal is used to reflect the wearing condition of the earphones and the ear canal model, and the calculation process is simple.

In a second aspect, embodiments of the present application provide a communication system, which includes a terminal and an earphone, wherein: the earphone is used to collect environmental sound signals to obtain a first environmental audio signal, and based on the first environmental audio signal The signal determines the first environmental sound characteristic; the terminal is used to collect the environmental sound signal to obtain the second environmental audio signal, and determine the second environmental sound characteristic based on the second environmental audio signal; the terminal is also used to collect the second environmental audio signal. The environmental sound characteristics are sent to the earphone; the earphone is also used to determine the target environmental sound characteristics based on the first environmental sound characteristics and the second environmental sound characteristics; the earphone is also used to determine the first earphone mode based on the target environmental sound characteristics. The default prompt audio signal is adjusted; the headset is also used to collect the played prompt audio signal through the microphone to obtain a feedback audio signal after playing the adjusted prompt audio signal; the headset is also used to obtain a feedback audio signal based on the adjusted prompt audio signal The audio signal and the feedback audio signal determine the target playback model; the headset is also used to determine the preset playback model that matches the target playback model from all the preset playback models in the mode setting database; the headset is also used to determine the Target parameters corresponding to the matching preset playback model; the earphone is also used to process audio signals based on the first earphone mode and the target parameters corresponding to the first earphone mode.

In the above embodiment, a mode setting database can be set in the earphones. The mode database records the first mode to be achieved based on different preset playback models (ie, different earphone wearing conditions and ear canal models) in a quiet environment. Parameters corresponding to the target listening experience in headphone mode. The first headphone mode may be an active noise reduction mode or a transparent transmission mode described in the following embodiments. Then, during actual use, the target playback model can be determined to reflect the current wearing situation of the headphones and the ear canal model, and then it is determined that the target playback model matches the preset playback model corresponding to the first headphone mode to achieve the target listening feeling. target parameters. However, if the energy of the environmental sound signal is large, it means that the environment is noisy. When the environment is noisy, the environmental sound signal will affect the accuracy of the target playback model, and the determined target parameters will be wrong. Therefore, the energy of the default prompt audio signal can be increased. This allows it to offset the impact of environmental sound signals. If the energy of the environmental sound signal is small, it means that the environment is quiet. When the environment is quiet, making the energy of the default audio signal smaller can improve the user's hearing experience and prevent the user from feeling uncomfortable when hearing the default audio signal in a quiet environment.

In a third aspect, embodiments of the present application provide an earphone, which includes: one or more processors, a microphone, and a speaker; the memory is coupled to the one or more processors, and the memory is used to store computer program codes, The computer program code includes computer instructions that are invoked by the one or more processors to cause the terminal to perform the method of the first aspect.

In the above embodiment, a mode setting database can be set in the earphones. The mode database records the first mode to be achieved based on different preset playback models (ie, different earphone wearing conditions and ear canal models) in a quiet environment. Parameters corresponding to the target listening experience in headphone mode. The first headphone mode may be an active noise reduction mode or a transparent transmission mode described in the following embodiments. Then, during actual use, the target playback model can be determined to reflect the current wearing situation of the headphones and the ear canal model, and then it is determined that the target playback model matches the preset playback model corresponding to the first headphone mode to achieve the target listening feeling. target parameters. However, if the energy of the environmental sound signal is large, it means that the environment is noisy. When the environment is noisy, the environmental sound signal will affect the accuracy of the target playback model, and the determined target parameters will be wrong. Therefore, the energy of the default prompt audio signal can be increased. This allows it to offset the impact of environmental sound signals. If the energy of the environmental sound signal is small, it means that the environment is quiet. When the environment is quiet, making the energy of the default audio signal smaller can improve the user's hearing experience and prevent the user from feeling uncomfortable when hearing the default audio signal in a quiet environment.

In a fourth aspect, embodiments of the present application provide a computer storage medium, which is characterized in that a computer program is stored in the storage medium, and the computer program includes executable instructions that cause the processing when executed by a processor. The processor executes the method of the first aspect.

In the above embodiment, a mode setting database can be set in the earphones. The mode database records the first mode to be achieved based on different preset playback models (ie, different earphone wearing conditions and ear canal models) in a quiet environment. Parameters corresponding to the target listening experience in headphone mode. The first headphone mode may be an active noise reduction mode or a transparent transmission mode described in the following embodiments. Then, during actual use, the target playback model can be determined to reflect the current wearing situation of the headphones and the ear canal model, and then it is determined that the target playback model matches the preset playback model corresponding to the first headphone mode to achieve the target listening feeling. target parameters. However, if the energy of the environmental sound signal is large, it means that the environment is noisy. When the environment is noisy, the environmental sound signal will affect the accuracy of the target playback model, and the determined target parameters will be wrong. Therefore, the energy of the default prompt audio signal can be increased. This allows it to offset the impact of environmental sound signals. If the energy of the environmental sound signal is small, it means that the environment is quiet. When the environment is quiet, making the energy of the default audio signal smaller can improve the user's hearing experience and prevent the user from feeling uncomfortable when hearing the default audio signal in a quiet environment.

Description of the drawings

Figure 1 shows a schematic diagram of the wearing situation of the earphones;

Figure 2 shows two situations where there is a gap between the earphones and the ear canal;

Figure 3 shows a schematic diagram of the ear canal model;

Figure 4 is a schematic structural diagram of an earphone provided by an embodiment of the present application;

Figure 5 is a schematic structural diagram of a terminal provided by an embodiment of the present application;

Figure 6 is a schematic structural diagram of a communication system provided by an embodiment of the present application;

Figure 7 is a schematic flow chart of a method for determining parameters corresponding to the headphone mode in the embodiment of the present application;

Figure 8 shows the first ambient audio signal in the frequency domain;

Figure 9 is a schematic diagram of adjusting the default prompt audio signal in a noisy environment in Method 1;

Figure 10 is a schematic diagram of adjusting the default prompt audio signal in a noisy environment in method 2;

Figure 11 shows a schematic diagram of playing the headphones and collecting the adjusted prompt audio signal to obtain the feedback audio signal.

Detailed ways

The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of this application, the singular expressions "a", "an", "said", "above", "the" and "the" are intended to also Plural expressions are included unless the context clearly indicates otherwise. It will also be understood that the term "and/or" as used in this application refers to and includes any and all possible combinations of one or more of the listed items.

Hereinafter, the terms “first” and “second” are used for descriptive purposes only and shall not be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, “plurality” The meaning is two or more.

In order to facilitate understanding, the relevant terms and concepts involved in the embodiments of this application are first introduced below.

(1) Headphone wearing condition and ear canal model

The wearing condition of the earphones refers to whether the user is wearing the earphones well. With a good fit, there can be no gap between the earphones and the user's ear canal. When not worn properly, there is a gap between the earphones and the user's ear canal. The wearing situation of the headset may also be referred to as the wearing situation of the headset or the situation of the user wearing the headset in the following.

Figure 1 shows a schematic diagram of the wearing condition of the earphones.

As shown in (a) in Figure 1, it is a situation when the user wears the earphones well. At this time, there is no gap between the earphones and the ear canal. In this case, it can effectively block environmental sound signals from entering the human ear. Among them, effectively blocking environmental sound signals from entering human ears means that it can block environmental sound signals from entering human ears better than when it is not worn properly. In fact, under normal circumstances, environmental sound signals can still enter human ears.

As shown in (b) in Figure 1 , it is a situation when the user does not wear the earphones properly. At this time, there is a gap between the earphones and the ear canal. In such cases, the headphones do not block ambient sound signals as well as they do when worn properly. When there is a gap between the earphones and the ear canal, it can also cause sound leakage. Among them, sound leakage means that the audio signals played by the headphones can be transmitted from the ear canal to the external environment. The audio signal may be an audio signal played by the microphone of the headset.

Figure 2 shows two situations where there is a gap between the earphones and the ear canal.

It should be understood that the icon 101 in Figure 2 represents an environmental sound signal. The more icons 101 there are, the noisier the environment and the greater the energy of the environmental sound signal (the greater the energy, the higher the decibel of the environmental sound signal, which is manifested as hearing The greater the ambient sound signal).

When the user does not wear the earphones properly, a gap will appear between the earphones and the ear canal. The larger the gap, the worse the blocking effect on environmental sound signals, and more environmental sound signals can enter the human ear. As shown in FIG. 2 , the gap 102 is smaller than the gap 103 . When the earphones are worn as shown in (a) of Figure 2 , more environmental sound signals are transmitted from the external environment to the human ears than when the headphones are worn as shown in (b) of Figure 2 .

It should be understood that the larger the gap, the more serious the sound leakage will be. That is, when the earphones are worn as shown in (a) in Figure 2, there will be more noise than in the wearing situation as shown in (b) in Figure 2. Many environmental sound signals are transmitted from the ear canal to the external environment. For a diagram of sound leakage, please refer to the description of the environmental sound signal in Figure 2, except that the environmental sound signal is transmitted from the external environment to the ear canal, but the sound leakage is transmitted from the ear canal to the external environment.

Figure 3 shows a schematic diagram of the ear canal model.

The ear canal model refers to the corresponding ear canal shape when the ear canals of different users are divided into different types according to classification rules. Among them, an ear canal shape is an ear canal model. The audio signal played by the earphones can be transmitted in the ear canal, and then the user has a sense of hearing. When headphones play audio signals, different ear canal models can give users different hearing sensations.

Among them, the classification rules include but are not limited to one or a combination of two of the following rules.

Rule 1: Classify the ear canals of different users according to the length of the ear canal. When the length of the ear canal is different or the length of the ear canal is within a range, it can be defined as an ear canal model. As shown in Figure 3, the length of the ear canal can be the horizontal distance from the starting point on the left to the starting point on the right. For example, as shown in FIG. 3 , the length of the ear canal 301 can be expressed as L1, and the length of the ear canal 302 can be expressed as L2. In some embodiments, if L1 is not equal to L2, it can be considered that the shapes of the ear canal 301 and the ear canal 302 are different, and the ear canal 301 and the ear canal 302 are respectively different ear canal models. In other embodiments, if L1 is within one length range but L2 is within another length range, it can be considered that the ear canal 301 and the ear canal 302 have different shapes, and the ear canal 301 and the ear canal 302 are different ear canals respectively. Model.

Rule 2: Classify the ear canals of different users according to the width of the ear canal. When the width of the ear canal is different or the width of the ear canal is within a range, it can be defined as an ear canal model. Wherein, in some cases, the width of the ear canal may be the vertical distance between the lowest point of the lower side of the ear canal and the lowest point of the upper side of the ear canal. For example, as shown in (a) of FIG. 3 , the vertical distance between the lowest point on the lower side of the ear canal 301 and the lowest point on the upper side of the ear canal can be expressed as S1. In other cases, the width of the ear canal 301 may be the vertical distance between the lowest point on the lower side of the ear canal and the highest point on the upper side of the ear canal. For example, as shown in (b) of FIG. 3 , the vertical distance between the lowest point on the lower side of the ear canal 302 and the lowest point on the upper side of the ear canal can be expressed as S2. When the widths of the two ear canals are different, or when the widths of the two ear canals are at different width thresholds, the two ear canals are different ear canals.

It should be understood that different ear canals can also be classified according to other classification rules to obtain different ear canal models, such as the depth of the ear canal, etc., which are not limited in the embodiments of the present application.

(2)Headphone mode

The headphone mode of the headset can indicate how the headset processes audio signals, and the degree of processing is determined by the adjustment parameters (hereinafter referred to as parameters for short) corresponding to the headset mode. This processing may include one or more of active noise reduction or transparent transmission. After the earphones use different earphone modes to process audio signals, they can give users different listening sensations. The audio signal may include one or more of environmental sound signals or audio signals sent by the mobile phone to the earphones, such as audio signals when playing music or audio signals during calls.

Among them, common headphone modes include one or more of active noise reduction mode or transparent transmission mode.

When the user wears headphones, if the headphones adopt active noise reduction mode, the headphones can filter out environmental sound signals, which can weaken the user's perception of the current environmental sound signals. Among them, in the active noise reduction mode, the earphones can process audio signals to different degrees, that is, the earphones can weaken environmental sound signals to different degrees. You can achieve different degrees of attenuation of environmental sound signals by setting corresponding adjustment parameters (hereinafter referred to as parameters) in the active noise reduction mode. For example, the active noise reduction mode can be configured to correspond to three different sets of parameters, including first noise reduction parameters, second noise reduction parameters, and third noise reduction parameters. The corresponding three sets of adjustment parameters in the active noise reduction mode can increase the degree of attenuation of environmental sound signals in sequence.

The method for the earphones to implement the active noise reduction function corresponding to the active noise reduction mode may include: the earphones may use the first parameter corresponding to the active noise reduction mode to process the audio signal including the environmental sound signal, such as filtering to weaken the audio signal. The included environmental sound signal is then used to obtain the inverse signal of the filtered audio signal based on the filtered audio signal. The phase difference between the inverted signal and the filtered audio signal is 180°. The headphones can then play that inverted signal, which can offset the ambient sound signal that the user actually hears for active noise reduction purposes. If the first parameter is different, the earphones will weaken the environmental sound signals included in the audio signal to different degrees, and will offset the environmental sound signals actually heard by the user after playing, thereby achieving different listening sensations.

When the user wears headphones, when the headphones adopt the transparent transmission mode, the headphones can enhance the environmental sound signals, which can enhance the user's perception of the environmental sound signals. For example, one possible effect is that the user can still experience the environmental sound signals the same as without wearing the headphones when wearing the headphones, that is, the user feels the same about the environmental sound signals before and after wearing the headphones. Among them, in the transparent transmission mode, the earphones can process the audio signals carrying the environmental sound signals to different degrees, that is, the earphones can enhance the environmental sound signals to different degrees. The environmental sound signal can be enhanced to varying degrees by setting corresponding adjustment parameters (hereinafter referred to as parameters) in the transparent transmission mode. For example, it can be assumed that the transparent transmission mode corresponds to three different sets of parameters, including a first transparent transmission parameter, a second transparent transmission parameter, and a third transparent transmission parameter. The three sets of adjustment parameters corresponding to the transparent transmission mode can increase the degree of enhancement of the environmental sound signal in sequence.

The way in which the earphones implement the transparent transmission function corresponding to the transparent transmission mode may include: the earphones may use the first parameter corresponding to the transparent transmission mode to process the audio signal including the environmental sound signal, for example, enhance the environmental sound signal. Then, the earphones can play the enhanced audio signal, so that the user can hear the ambient sound signal through the earphones, and the intensity of the ambient sound signal is greater than when the transparent transmission mode is not used. If the first parameter is different, the earphones will enhance the environmental sound signals to different degrees, and the environmental sound signals heard by the user after playing will be enhanced to different degrees, thereby achieving different listening sensations.

It should be understood that in addition to the active noise reduction mode and the transparent transmission mode, other processing modes may also be included, which are not limited in the embodiments of the present application. In the following, active noise reduction mode and transparent transmission mode are used as examples for explanation.

(3) Target listening sense

The target listening feeling can be the listening feeling set by the user through headphones or terminals. In different headphone modes, the user can set a target hearing feeling, which reflects the preset processing degree of the audio signal by the headset in the headphone mode. The target hearing feeling can also be used to indicate the user's ideal hearing feeling in the headphone mode. When the user does not set a target listening feeling, the headset or terminal can set a default listening feeling as the target listening feeling. For example, the target listening feeling can be one of weak, medium or strong, or a state in the process from weak to strong.

In the active noise reduction mode, the user can set the target hearing sense, that is, the degree to which the earphones can weaken the environmental sound signal. For example, the stronger the target hearing sense set by the user, the stronger the active noise reduction processing of the earphones, and the earphones can The audio signal (including the environmental sound signal) is processed using the corresponding parameters when the degree of active noise reduction is stronger, so that the user can hear less environmental sound signals. When the degree of active noise reduction is the strongest, it can be considered that the user cannot hear the environment. Sound signal; the weaker the active noise reduction level set by the user, the headset can process the audio signal (including environmental sound signals) using the corresponding parameters when the active noise reduction level is weaker, so that the user can hear more environmental sound signals. , when the active noise reduction level is the weakest, it can be considered that the headset does not perform any noise reduction processing.

In the transparent transmission mode, the user can set the target sense of hearing, that is, the degree to which the earphones can enhance the environmental sound signal. For example, the stronger the user sets the target sense of hearing, the stronger the degree of transparent transmission processing of the earphones, and the earphones can use transparent transmission. The stronger the transmission degree, the corresponding parameters process the audio signal (including the environmental sound signal) so that the user can hear more environmental sound signals; the weaker the transparent transmission degree set by the user, the weaker the transparent transmission degree the headset can use The corresponding parameters are used to process the audio signal (including the environmental sound signal) so that the user can hear less environmental sound signal.

In the embodiment of the present application, the earphones can achieve the user's corresponding target hearing sensation in this mode by setting parameters corresponding to the earphone mode. Factors that affect the parameters corresponding to the headphone mode include but are not limited to: one or more of the user's wearing of the headset (the wearing situation of the headset) and the user's ear canal model. In the following, the wearing situation of the headset and the ear canal model are used as examples. Example to illustrate. Among them, the impact of the wearing condition of the earphones and the user's ear canal model on the user's sense of hearing can be referred to the above-mentioned description of term (1). For example, when the user selects the first level of active noise reduction in the active noise reduction mode, and when the user wears the earphones well, the environmental sound signal entering the human ear is the first environmental sound signal, and the earphones can The parameter A corresponding to the active noise reduction mode is used to perform noise reduction processing on the audio signal including the environmental sound signal, so that the environmental sound signal heard by the user achieves the first degree of noise reduction. When the user does not wear the earphones properly, the ambient sound signal entering the human ear is the second ambient sound signal. Referring to the content in Figure 2, it can be seen that the energy of the second ambient sound signal is greater than the energy of the first ambient sound signal. If the earphones are used at this time Parameter A is then used to perform noise reduction on the audio signal including the ambient sound signal. What is offset is the energy of the first ambient sound signal, while the energy of the second ambient sound signal that is more than the first ambient sound signal will not be offset. If the user does not wear the earphones properly, the earphones still use parameter A to de-noise the audio signal including the environmental sound signal, and the first degree of noise reduction cannot be achieved. This will cause the environmental sound signal heard by the user to be compared with It is clearer when worn well and cannot achieve the target listening feeling. Therefore, it is necessary to reset the earphones and apply the parameters in the active noise reduction mode so that the earphones can achieve the first degree of noise reduction. Among them, the settings of parameters corresponding to the earphone mode of the ear canal model can refer to the description of the wearing condition of the earphones.

Based on the above description, it can be seen that if you want to achieve the user's target hearing sensation, you need to set the parameters corresponding to the headphone mode. To achieve the target hearing sensation in the same headphone mode under different headphone wearing conditions and ear canal models, the headphones The parameters corresponding to the modes can be different. The headset can determine the parameters corresponding to a headset mode based on the wearing condition of the headset and the ear canal model to achieve the target listening experience in a headset mode. For details of this process, please refer to the relevant description below and will not be described here.

The following introduces exemplary earphones provided by embodiments of the present application.

Figure 4 is a schematic structural diagram of an earphone provided by an embodiment of the present application.

It should be understood that the earphones involved in the embodiments of the present application may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The earphones in the embodiments of the present application may be true wireless stereo (TWS) earphones or other types of Bluetooth earphones, which are not limited in the embodiments of the present application.

In this embodiment of the present application, the headset may include: a processor 151, a wireless communication processing module 152, a microphone set 153, and a speaker 154.

The processor 151 may be used to parse signals received by the wireless communication processing module 152. The signal includes: a request to establish a connection sent by the terminal and environmental sound characteristics. The processor 151 may also be used to generate a signal sent externally by the wireless communication processing module 152. The signal includes: notifying the terminal of a request to obtain environmental sound characteristics, etc. Among them, the environmental sound characteristics will be described in detail below and will not be described in detail here.

The processor 151 may also be provided with a memory for storing instructions. In some embodiments, the instructions may include: instructions for determining characteristics of environmental sounds using environmental sound signals, instructions for sending signals, and the like.

The wireless communication processing module 152 may include one or more of a Bluetooth (BT) communication processing module 152A and a WLAN communication processing module 152B, and is used to provide services such as establishing a connection with the terminal and performing data transmission.

The microphone set 153 may include a feedforward microphone 153A, a feedback microphone 153B, and a talk microphone 153C.

Among them, the feedforward microphone 153A can collect the environmental sound signals around the earphones and send them to the processor. This allows the processor to determine environmental sound characteristics based on the environmental sound signal.

The feedback microphone 153B can collect the sound signal in the ear canal. For example, after the audio signal played by the speaker is transmitted to the ear canal, the feedback microphone can collect the audio signal. For example, the audio signal can be the prompt audio signal mentioned below. The feedback microphone also picks up ambient sound signals around the headphones and sends them to the processor. This allows the processor to determine environmental sound characteristics based on the environmental sound signal.

The call microphone 153C can collect environmental sound signals around the headset and send them to the processor. This allows the processor to determine environmental sound characteristics based on the environmental sound signal.

Speaker 154 may be used to play audio signals, such as prompt audio signals. The headset can be used to listen to music through the speaker 154, or to listen to phone calls.

In this embodiment of the present application, the processor 151 can store computer instructions to cause the headset to execute the parameter determination method corresponding to the headset mode in the embodiment of the present application.

An exemplary terminal provided by the embodiment of this application is introduced below.

Figure 5 is a schematic structural diagram of a terminal provided by an embodiment of the present application.

The following uses a terminal as an example to describe the embodiment in detail. It should be understood that the terminal may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The terminal may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194 and user identification Module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal. In other embodiments of the present application, the terminal may include more or fewer components than shown in the figures, or some components may be combined, or some components may be separated, or may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) wait. Among them, different processing units can be independent devices or integrated in one or more processors.

Among them, the controller can be the nerve center and command center of the terminal. The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or universal serial bus (USB) interface, etc.

It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present application are only schematic illustrations and do not constitute structural limitations on the terminal. In other embodiments of the present application, the terminal may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The wireless communication function of the terminal can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in a terminal can be used to cover a single or multiple communication bands. Different antennas can also be reused to improve antenna utilization.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the terminal. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

A modem processor may include a modulator and a demodulator.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), etc. applied to the terminal. . The wireless communication module 160 may be one or more devices integrating at least one communication processing module.

The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

The terminal can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The terminal can listen to music through the speaker 170A, or listen to hands-free calls.

Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the terminal answers a call or voice message, the voice can be heard by bringing the receiver 170B close to the human ear.

Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. The microphone can collect environmental sound signals and then transmit them to the processor 110, so that the processor 110 can determine environmental sound characteristics based on the environmental sound signals, and then transmit the environmental sound characteristics to the earphones through a wireless network (such as Bluetooth).

The communication system involved in the embodiment of this application is introduced below.

Figure 6 is a schematic structural diagram of a communication system provided by an embodiment of the present application.

As shown in Figure 6, the communication system includes a headset and a terminal. For a schematic description of the earphones, reference may be made to the aforementioned description of FIG. 4 . For a schematic description of the terminal, reference may be made to the foregoing description of FIG. 5 .

The wireless network is used to provide various services, such as communication services, connection services, transmission services, etc., for the terminals and headsets involved in the embodiments of this application.

Wireless networks include: Bluetooth (BT), wireless local area network (WLAN) technology, wireless wide area network (WWAN) technology, etc.

The headset can establish a connection with the terminal through a wireless network and then transmit data.

For example, the terminal can search for the headset. When the headset is found, the terminal can send a connection establishment request to the headset. After receiving the request, the headset can establish a connection with the terminal. The headset can also transmit instructions for determining environmental sound characteristics using environmental sound signals to the terminal through the wireless network. The terminal can determine the environmental sound characteristics based on the environmental sound signals, and then transmit the environmental sound characteristics to the headset through the wireless network.

The embodiment of the present application provides a method for determining parameters corresponding to the headphone mode. In this method, a mode setting database is provided in the headset. The mode setting database may include multiple preset playback models, where each preset playback model also corresponds to a headphone mode, and the headphone mode also corresponds to a preset hearing sense and adjustment parameters (hereinafter may be referred to as parameters), The adjustment parameters are parameters when the earphone mode can give the user a preset hearing sensation under a wearing condition of the earphone and an ear canal model. It can also be said that the mode setting database includes a plurality of preset playback models, wherein each preset playback model also corresponds to at least one parameter (adjustment parameter), and each parameter in the at least one parameter corresponds to a headphone mode and A default listening experience.

Among them, the preset playback model refers to the contrast relationship between the prompt audio signal and the feedback audio signal before playback. This comparison relationship can be expressed as a set of frequency point energy ratios of the pre-playback prompt audio signal and the feedback audio signal. The frequency point energy ratio is the value of the pre-playback prompt audio signal and feedback audio signal after they are converted into the frequency domain. The ratio of the total energy of the same frequency points in the prompt audio signal and the feedback audio signal.

The preset playback model can reflect the wearing condition of the earphones and the transmission condition of the prompt audio signal (before playing) by the user's ear canal model. It can also be said that the preset playback model can reflect the wearing condition of the earphones and the type of the user's ear canal. What kind of ear canal model. Because the same prompt audio signal (before playback), when the earphones are worn or the ear canal model is different, the feedback audio signal obtained by playing the prompt audio signal (before playback, recorded as prompt audio signal 1) by the headset ( Denoted as the reference audio signal 1) is different, the preset playback model determined based on the reference audio signal 1 and the prompt audio signal 1 is different.

In some embodiments, the prompt audio signal before playing can be white noise, and the speaker of the earphone can play it. The played prompt audio signal can be transmitted in the ear canal, and at the same time, the played prompt audio signal can also be collected by the feedback microphone of the headset to obtain a feedback audio signal. The feedback audio signal may include a played prompt audio signal, and may also include an environmental sound signal. When the environmental sound signal is noisier, the feedback audio signal includes more environmental sound signals and has greater energy.

It should be understood here that the process of determining the preset playback model by the headset is usually performed in a quiet environment, so the feedback audio signal involved in the process of determining the preset playback model usually does not include environmental sound signals. Therefore, the ambient sound signal will not affect the determination of the preset playback model.

An exemplary mode setting database may be referred to Table 1 below.

Default playback model	Headphone mode	Default listening feeling	Adjustment parameters
Default playback model 1	Active noise reduction mode	middle		Parameter 1
Default playback model 1	Active noise reduction mode	powerful	Parameter 2
Default playback model 2	Active noise reduction mode	middle	Parameter 3
Default playback model 2	Active noise reduction mode	powerful	Parameter 4
…	…	…	…

Table 1

As shown in Table 1, the mode setting database includes a first preset playback model, which can reflect the first wearing situation of the earphones and the response to the prompt audio signal (before playback) when the user's ear canal is the first ear canal model. Transmission status. The first preset playback model corresponds to the first headphone mode, and the corresponding parameter when the first headphone mode achieves the target listening feeling is the first parameter. For example, the first preset playback mode is preset playback mode 1, and its corresponding adjustment parameter is parameter 1 when achieving the preset listening experience in active noise reduction mode.

Wherein, the first preset playback model is any one of all preset playback models included in the mode setting database. The headphone mode corresponding to the first preset playback model may be one or more of different headphone modes, such as active noise reduction mode or transparent transmission mode.

Based on the foregoing description, it can be known that when a mode setting database is set up in the headset, if it can be determined that the user's wearing situation of the headset and the user's ear canal model are most similar to the wearing situation of the headset and the ear canal model reflected by the preset playback model A , that is, the default playback model A is the most matching default playback model. And when the headphone mode and the target listening feeling are determined, the parameters corresponding to the headphone mode and the target listening feeling can be determined based on the most matching preset playback model as the parameters of the headphone mode to process the audio signal, so that the user can achieve the target listening feeling. feel.

For the aforementioned descriptions of headphone modes, adjustment parameters, ear canal models, headphone wearing conditions, and target listening sensations, please refer to the aforementioned descriptions of terminology.

After the user wears the headset, he usually sets the headphone mode of the headset, and then the headset plays a prompt audio signal to remind the user that the headset is worn. After the headset plays the prompt audio signal, the feedback microphone can collect the played prompt audio signal to obtain Reference audio signal. The headset can determine the target playback model based on the reference audio signal and the prompt audio signal before playback, and then determine the preset playback model in the pattern database that best matches it based on the target playback model. Then, the headset determines the parameters corresponding to the most matching preset playback model to achieve the target listening experience in the headset mode.

It should be understood that since the process of determining the preset playback model is usually carried out in a quiet environment, during actual use, the headset is often interfered by environmental sound signals when determining the target playback model. This interference is manifested in: when the headset plays the prompt audio signal, the played prompt audio signal is transmitted in the ear canal so that the feedback microphone can collect the played prompt audio signal to obtain the feedback audio signal. However, due to the environmental sound signal (external, For example, part of the ambient sound signal in the ear canal (around the earphone) will also enter the ear canal. The feedback audio signal obtained by the feedback microphone may include this part of the ambient sound signal entering the ear canal. The environmental sound signal entering the ear canal may be called feedback. Environmental sound signals. Since the feedback audio signal not only includes the played prompt audio signal but also the feedback environmental sound signal (when the environmental sound signal is noisier, the feedback audio signal includes more feedback environmental sound signals and the greater the energy), then use The feedback audio signal is inaccurate when calculating the target playback model and will be interfered by the feedback environmental sound signal. Then the energy of the prompt audio signal included in the feedback audio signal can be adjusted to make it larger than the energy of the feedback environmental sound signal, thereby reducing the feedback environmental sound signal to the reference. Adjust the energy proportion of the prompt audio signal to reduce the environmental sound signal's contribution to the reference. Generate interference in the target playback model. In the process of determining the target playback model, the default prompt audio signal can be adjusted to reduce the interference of the environmental sound signal. For this process, please refer to the following description.

The earphone can collect the environmental sound signal and convert it into a first environmental audio signal, and then determine the environmental sound characteristics based on the first environmental audio signal. The environmental sound characteristics can reflect the degree of environmental noise (that is, it can reflect the energy level of the environmental sound signal, and can also include the energy distribution of the environmental sound signal in different frequency bands). The headset can adjust the default prompt audio signal based on the environmental sound characteristics, so that The adjusted prompt audio signal can change with the degree of environmental noise (that is, it can change with the energy of the environmental sound signal). The changes include: when the environment is noisy (that is, when the energy of the environmental sound signal is greater), the adjusted The energy of the prompt audio signal may become larger relative to the default prompt audio signal, so that the adjusted prompt audio signal heard by the user has greater decibel (energy) relative to the default prompt audio signal. Then the energy of the adjusted prompt audio signal becomes larger than that of the default prompt audio signal. Then the energy of the feedback environment sound signal included in the feedback audio signal obtained by playing the adjusted prompt audio signal can be smaller than the energy of the prompt audio signal included therein. As a result, the feedback audio signal mainly includes the prompt audio signal and is not affected by the environmental sound signal. In this way, the environmental sound signal will not affect the generation of the target playback model, that is, it is ensured that the target playback model is the adjusted prompt audio signal and feedback The ratio of the total energy of frequency points of the same frequency in the audio signal without being affected by environmental sound signals to produce large errors. When the environment is quiet (that is, the energy of the ambient sound signal is smaller), the adjusted prompt audio signal can be smaller in energy relative to the default prompt audio signal, so that the decibel (energy) of the adjusted prompt audio signal heard by the user is moderate. , will not cause discomfort due to the large energy of the prompt audio signal.

The environmental sound characteristics may include one or more of the energy proportions of the environmental sound signals in different frequency bands in the first environmental audio signal, the absolute energy of the environmental sound signals, and the relative energy of the environmental sound signals. Regarding the environmental sound audio For the description of the features, please refer to the detailed description of step S102 later, which will not be described again here.

The energy of the environmental sound signal can be characterized by the absolute energy and relative energy of the environmental sound signal included in the environmental sound characteristics. Among them, energy can be used to represent the voltage corresponding to the audio signal; it can also represent the amplitude of the audio signal; or the decibel size.

It should be understood that the environmental sound characteristics referred to here are the same as the target environmental sound characteristics referred to below.

Figure 7 is a schematic flow chart of a method for determining parameters corresponding to the headphone mode in the embodiment of the present application.

In this embodiment of the present application, the headset determines the headphone mode and the parameters corresponding to the headphone mode. The process of processing the audio signal based on the headphone mode and its corresponding parameters to display the target listening feeling can refer to the following description of steps S101 to S111.

S101. After the headset determines that the headset comes out of the box, the headset obtains the first environmental audio signal.

The first environmental audio signal is an audio signal converted from the environmental sound signal collected by the microphone of the headset in the first time period. The first environmental audio signal includes X frames of audio signals, where X is a positive integer greater than or equal to 1. Then the first environmental audio signal may include an environmental sound signal.

The first time period is a period of time after the earphones are determined to be taken out of the box, such as 0.5S, 1S or 2S. The embodiment of the present application does not limit the length of the first time period and can be adjusted according to actual conditions.

The microphone may be any microphone in an earphone, for example, it may be any one of a feedforward microphone, a feedback microphone, and a call microphone, which is not limited in the embodiments of the present application.

Specifically, during the first period of time, the microphone of the headset can collect environmental sound signals, and then convert the environmental sound signals into analog electrical signals. The headphones then sample the simulated electrical signal and convert it into an audio signal in the time domain. The audio signal in this time domain is a digital audio signal, which is a sampling point of W analog electrical signals. The first environmental audio signal can be represented by an array in the headset. Any element in the array is used to represent a sampling point. Any element includes two values, one of which represents the time, and the other value represents the time corresponding to the audio signal. Amplitude, which is used to represent the voltage corresponding to the audio signal.

It should be understood that, in the case where the earphones are equipped with a charging box (which may also be called a charging compartment or a storage box, etc.), step S101 can be performed to obtain the first environmental audio signal. When the headset is not equipped with a charging box, other steps can be performed to obtain the first environmental audio signal. For example, when the headset detects an in-ear operation, the headset can be triggered to obtain the first environmental audio signal.

The headset determines that the headset has left the box when the headset detects the out-of-box operation, that is, the headset detects the operation of the headset leaving the charging box. The timing for the headset to determine that the headset leaves the charging box includes but is not limited to the following:

Opportunity 1: When the earphones are placed in the charging box, the earphones can be connected to the metal probe included in the charging box through the connection contact so that the charging box can charge the earphones. When the earphones detect that the connection contact is in contact with the metal When the probe is separated, the earphone can determine that the earphone has left the charging box. In response to the operation of taking out the box, the earphone can start to collect the environmental audio signal and convert it into an electrical signal as the first environmental audio signal. Then the first environmental audio signal Ambient audio signals are included. Among them, in some possible cases, the connection contacts can be set on the surface of the earphones, and the metal probes can be set on the inner wall of the charging box.

Opportunity 2: When the headset detects that charging has stopped, the headset can determine that the headset is out of the box, and the headset can obtain the first environmental audio signal.

This step S101 is optional. In some possible cases, when the earphone detects an in-ear operation, the earphone can be triggered to acquire the first environmental audio signal.

S102. The earphone determines the first environmental sound feature based on the first environmental audio signal.

In step S102, the earphone can convert the first environmental audio signal from the time domain to the frequency domain to obtain the first environmental audio signal in the frequency domain. Then the first environmental sound feature is calculated based on the first environmental audio signal in the frequency domain. In a possible implementation, the headset can use a fast Fourier transform (FFT) to convert the first environmental audio signal from the time domain to the frequency domain.

It should be understood that the first environmental audio signal in the time domain and the first environmental audio signal in the frequency domain only have different representation forms, but they are both the first environmental audio signal including the environmental sound signal.

Among them, any frame of the environmental audio signal in the first environmental audio signal in the frequency domain can be expressed as N (N is an integer power of 2) frequency points. For example, N can be 1024, 2048, etc., and the specific size can be expressed by The computing power of the headset determines. The N frequency points are used to represent audio signals within a certain frequency range, such as between 0khz and 15khz, or other frequency ranges. It can also be understood that the frequency point refers to the information of the first environmental audio signal at the corresponding frequency, which information includes time, frequency of the environmental sound signal, and energy (decibel or amplitude) of the environmental sound signal, Among them, energy can be used to represent the voltage corresponding to the environmental sound signal; it can also represent the amplitude of the environmental sound signal; or the decibel size of the environmental sound signal. The frequency distribution of the N frequency points in any two frames of environmental audio signals is the same, that is, the frequency of the i-th frequency point of the j-th frame audio signal in the first environmental audio signal is the same as the i-th frequency point of the j+1-th frame audio signal. The frequencies of the frequency points are the same.

Figure 8 shows the first ambient audio signal in the frequency domain.

The first environmental audio signal in the frequency domain may include audio signals in the X frame frequency domain. The audio signal in the frequency domain of any frame can be N frequency points. For example, area 801 includes N frequency points corresponding to the first frame audio signal in the first environmental audio signal, area 802 includes N frequency points corresponding to the second frame audio signal in the first environmental audio signal, and area 803 includes N frequency points corresponding to the X-th frame audio signal in the first environmental audio signal.

An exemplary ambient sound signature is described with reference to FIG. 8 .

The first environmental sound feature may include one or more of the absolute energy of the environmental sound signal in the first environmental audio signal, the energy proportion of the environmental sound signal in different frequency bands, and the relative energy of the environmental sound signal.

It should be understood that the first environmental sound characteristic may reflect the environmental noisy level. It can be expressed as: the greater the absolute energy or relative energy, the noisier the environment. The energy proportion of the environmental sound signal in different frequency bands reflects the energy distribution of the environmental sound in different frequency bands.

The absolute energy of the ambient sound signal in the first ambient audio signal includes the energy of all frequency points in the first ambient audio signal in the frequency domain, which describes the energy level of the ambient sound signal in the first ambient audio signal. The relevant formula for the earphone to determine the absolute energy of the environmental sound signal in the first environmental audio signal may refer to the following formula (1).

Wherein, T represents the absolute energy of the environmental sound signal in the first environmental audio signal. w={w∈N+|1≤w≤X}, the first environmental audio signal includes the X-frame audio signal in the frequency domain, S(w) represents the w-th frame audio signal (frequency domain) in the first environmental audio signal ) energy. The energy of the w-th frame audio signal may be the sum of the energy of each frequency point.

The energy proportion of the environmental sound signal in different frequency bands in the first environmental audio signal includes the energy proportion of the first frequency band. The first frequency band refers to one of the frequency bands after dividing the frequency of the first environmental audio signal into different frequency bands, and one frequency band is a sub-range of the frequency of the environmental audio signal. As shown in Figure 8, the first frequency band can be expressed as frequency w ₁ to frequency w _2. The energy proportion of the first frequency band represents all frequency points included in the audio signal with frequencies w ₁ to w ₂ in the first environmental audio signal. The ratio of energy to absolute energy. The audio signals with frequencies w ₁ to w ₂ include audio signals with frequencies w ₁ to w ₂ in each frame of the first environmental audio signal. Wherein, the formula for the earphone to determine the energy proportion of the environmental sound signal in the first frequency band in the first environmental audio signal can refer to the following formula (2).

In formula (2), P(w ₁ ~ w ₂ ) represents the energy proportion of the environmental sound signal in the first frequency band in the first environmental audio signal. S(w ₁ ~ w ₂ ) represents the energy of the audio signal with the frequency w ₁ to w ₂ in the first environmental audio signal, and can be each frequency of the audio signal with the frequency w ₁ to w ₂ in the first environmental audio signal. The sum of the energy of the points.

The relative energy of the environmental sound signal in the first environmental audio signal includes the weighted energy of all frequency points in the first environmental audio signal in the frequency domain. Because human ears have different sensitivity or subjective feelings to audio signals of different frequencies. Therefore, it is necessary to perform a weighted correction on the energy of audio signals of different frequencies, so that the weighting (can be understood as a weight) of the audio signal with greater human ear sensitivity is greater, then the energy of the audio signal with greater human ear sensitivity is The greater the contribution to relative energy. The relevant formula for the earphone to determine the absolute energy of the environmental sound signal in the first environmental audio signal can refer to the following formula (3).

Wherein, H represents the relative energy of the environmental sound signal in the first environmental audio signal. w={w∈N+|1≤w≤X}, the first environmental audio signal includes the audio signal in the frequency domain of the X frame, and S*F_weight(w) represents the w-th frame audio signal in the first environmental audio signal ( (frequency domain) weighted energy. The weighted energy of the w-th frame audio signal may be the sum of the weighted energy of each frequency point. F_weight is a weighting filter. The function of this weighting filter is to weight the energy of frequency points in the w-th frame audio signal and adjust the energy of frequency points at different frequencies to make the human ear more sensitive to the frequency. The energy of the frequency point above becomes larger, and the contribution to the relative energy becomes larger.

In some possible implementations, the first environmental sound feature obtained in step S102 may be used to determine the target environmental sound feature in the following step S105. The earphones can use the target environmental sound characteristics to reflect the noisy level of the environment. In order to improve the accuracy and robustness of the environmental noisy level reflected by the target environment sound characteristics. The second environmental sound characteristics can also be determined through the second environmental audio signal obtained by the terminal, and then the headset can obtain the second environmental sound characteristics, and combine the first environmental sound characteristics and the second environmental sound characteristics to determine the target environmental sound characteristics. . For this process, please refer to the following description of steps S103 to S105.

S103. The headset notifies the terminal to obtain the second environmental sound characteristics, and the terminal is connected to the headset.

This step S103 is optional.

The headset determines the terminal connected to the headset (for example, through Bluetooth or other means), and sends a notification to obtain the second environmental sound characteristics to the terminal, so that the terminal executes the following step S104.

It should be understood that there is no order of execution of step S102 and step S103. The headset can execute step S102 first and then step S103, it can execute step S103 first and then step S102, or it can also be executed at the same time. In this embodiment of the present application, Not limited.

S104. The terminal obtains the second environmental audio signal, determines the second environmental sound feature based on the second environmental audio signal, and sends the second environmental sound feature to the headset.

In the case where the aforementioned step S103 is executed, the terminal may execute step S104.

The second environmental audio signal is an audio signal converted from the environmental sound signal collected by the terminal's microphone in the second time period. The second environmental audio signal includes L frames of audio signals, where L is a positive integer greater than or equal to 1. Then the second environmental audio signal may include an environmental sound signal. The second ambient audio signal may have the same number of frames as or may be different from the audio signal included in the aforementioned first ambient audio signal.

The second time period may be the same as or different from the aforementioned first time period. The second time period is a period of time after the terminal determines that the headset comes out of the box. For example, 0.5S, 1S or 2S, etc. The embodiment of the present application does not limit the length of the second time period and can be adjusted according to the actual situation.

The microphone may be any microphone in the terminal, for example, it may be any one of a top microphone, a bottom microphone, and a back microphone, which is not limited in the embodiments of the present application.

The process by which the terminal determines the second environmental sound characteristics based on the second environmental audio signal is the same as the process by which the headset determines the first environmental sound characteristics based on the first environmental audio signal. Reference may be made to the relevant description in step S102, which will not be described again here.

It should be understood that the second environmental sound feature may include one or more of the absolute energy of the environmental sound signal in the second environmental audio signal, the energy proportion of the environmental sound signal in different frequency bands, and the relative energy of the environmental sound signal. indivual. Both the second environmental sound feature and the first environmental sound feature can reflect the level of environmental noise. For a detailed introduction to the characteristics of the second environmental sound, please refer to the foregoing exemplary description of the characteristics of the first environmental sound, which will not be described again here.

S105. The headset determines the target environmental sound feature based on the first environmental sound feature and the second environmental sound feature, or the headset determines the target environmental sound feature based on the first environmental sound feature. The target environmental sound feature can reflect the degree of environmental noise.

The target environmental sound characteristics can reflect the noisy level of the environment as follows: the greater the absolute energy and/or relative energy of the environmental sound signal in the target environmental sound characteristics, the noisier the environment. The smaller the absolute energy and/or the relative energy of the environmental sound signal in the target environmental sound feature, the quieter the environment.

If the terminal does not perform the aforementioned steps S103 and S104, then in step S105, the headset may determine the target environmental sound characteristics based on the first environmental sound characteristics. Specifically, the headset may determine the first environmental sound feature as the target environmental sound feature.

In the case where the terminal performs the aforementioned steps S103 and S104, in step S105, the headset may determine the target environmental sound characteristics based on the first environmental sound characteristics and the second environmental sound characteristics. The process of earphones determining the sound characteristics of the target environment can be referred to the following description.

In some possible cases, the earphones may determine the one with greater absolute energy or relative energy among the first environmental sound feature and the second environmental sound feature as the target environmental sound feature.

In other possible cases, the earphones can set different weights based on the first environmental sound feature and the second environmental sound feature and perform fusion, and use the fusion result as the target environmental sound feature.

Specifically, when the first environmental sound feature and the second environmental sound feature are the same, the headset may also use the first environmental sound feature or the second environmental sound feature as the target environmental sound feature.

S106. The headset detects the operation of selecting the headset mode, and determines the headset mode and the default prompt audio signal corresponding to the headset mode.

This step S106 is optional.

The default prompt audio signals corresponding to different headphone modes may be different and may be related to their corresponding headphone modes. For example, the default prompt audio signal corresponding to the active noise reduction mode can be: "Active noise reduction mode has been selected", etc. The default prompt audio signal corresponding to the transparent transmission mode can be: "Transparent transmission mode has been selected", etc. The function of the default prompt audio signal is to prompt the user that the current headset has been worn or the headset mode of the headset, and its specific content is not limited in the embodiments of this application.

In one possible implementation, the headset can provide the user with a way to select the headset mode. For example, set the contacts on the headset that are involved in selecting headphone mode. This contact can be used to detect actions involved when the user selects headphone mode. For example, the headset can be set to determine that the headphone mode selected by the user is the active noise reduction mode when it detects that the user touches the contact point twice in succession; and that it determines that the headphone mode selected by the user is transparent when it detects that the user touches the contact point three times in a row. transmission mode, etc. Continuous means that the time interval between two adjacent touches is within a preset time threshold, such as 0.5s. Wherein, the user touching the contact point may include clicking the contact point.

The headset detects the operation of selecting the headset mode, and in response to the operation, the headset mode corresponding to the operation can be determined. The headset can then determine the default prompt audio signal corresponding to that headset mode.

It should be understood that in some possible cases, if step S106 is not executed, that is, if the user does not select a headphone mode, the headset can select one headphone mode from multiple headphone modes (hereinafter may be referred to as headphone mode A). As the headphone mode of the headset, and select the default prompt audio signal corresponding to the headphone mode A. The headphone mode A may be the headphone mode selected by the user last time, or may be the headphone mode used longest by the user within a period of time (for example, 10 days).

In other possible situations, if step S106 is not executed. The headset does not need to select any headset mode. At this time, the default prompt audio signal does not need to be related to any headset mode. Its function is to remind the user that the headset has been worn. At this time, the default prompt audio signal can be "ding" or other content.

S107. The headset adjusts the default prompt audio signal based on the target environmental sound characteristics to obtain an adjusted prompt audio signal. The adjusted prompt audio signal can change with the degree of environmental noise.

The energy (decibel) of the default prompt audio signal is recorded as the first energy. This default prompt audio signal is suitable for most users when the environment is moderately noisy (that is, between a quiet environment and a noisy environment). For example, when the environment is moderately noisy, it can be considered that the energy of the environmental sound signal is greater than or equal to the first energy threshold and less than or equal to the second energy threshold. When the energy of the environmental sound signal is less than or equal to the first energy threshold, the environment is quiet. When the energy of the environmental sound signal is greater than or equal to the second energy threshold, the environment is noisy. The greater the energy of the ambient sound signal, the noisier it is, and the smaller it is, the quieter it is. Wherein, the energy of the environmental sound signal can be characterized by the absolute energy or relative energy of the environmental sound signal included in the target environmental sound feature: the energy of the environmental sound signal can be the energy of the environmental sound signal included in the target environmental sound feature. Absolute energy or relative energy. The energy of the environmental sound signal may also be the target energy obtained by combining the absolute energy and relative energy of the environmental sound signal included in the target environmental sound feature. The combination may be adding the absolute energy and the relative energy after setting different weights.

It should be understood that the adjusted prompt audio signal and the default prompt audio signal may include Y frame audio signals. Among them, Y is a positive integer greater than or equal to 1.

However, when the environment is noisy and the earphones play the environmental prompt audio signal, the environmental sound signal will affect the user's listening, so that the user cannot clearly hear the default prompt audio signal, and the default prompt audio signal will still be played when the environment is noisy. The influence of ambient sound signals makes the generated playback model inaccurate, making it impossible for the headphones to determine the parameters corresponding to the headphone mode based on the playback model to achieve the target listening experience. This part of the content is introduced in detail above and will not be repeated here. When the environment is quiet, when the earphones play the environmental prompt audio signal, the user will feel that the default prompt audio signal has too much energy, affecting the sense of hearing.

Therefore, the headset can adjust the default prompt audio signal in the following two ways.

Method 1: In a noisy environment, the headset can adapt the default prompt audio signal to the target environmental sound characteristics. The adaptation is to adjust the energy proportion of the default prompt audio signal in different frequency bands to be related to the energy proportion of the environmental sound signal included in the target environmental sound feature in different frequency bands. At the same time, the energy of the default prompt audio signal is increased from the first energy to the second energy, and the second energy is greater than the energy of the feedback environmental sound signal. One way of increasing the energy of the default prompt audio signal from the first energy to the second energy is to increase the energy of frequency points of different frequencies in the default prompt audio signal by the same value. In this method, the energy gain at different frequency points (gain here is the degree of increase) is determined by the absolute energy and relative energy of the environmental sound signal included in the target environmental sound characteristics. The greater the absolute energy and/or relative energy, the greater the energy gain. , then the greater the energy of the feedback environmental sound signal, the greater the energy gain at different frequency points. Another way is that the energy increase degree of frequency points in different frequency bands in the default prompt audio signal can also be different.

Among them, the energy proportion includes: the energy proportion of the default prompt audio signal in different frequency bands is adjusted to be the same as the energy proportion of the environmental sound signal included in the target environmental sound characteristics in different frequency bands, or the default prompt audio signal is in different frequency bands. The energy proportion is adjusted to correspond to the energy proportion of the environmental sound signal included in the target environmental sound characteristics in different frequency bands. For example, different frequency bands are divided into the first frequency band, the second frequency band or the third frequency band. The first frequency band The audio signal has the largest energy proportion in the environmental sound signal, the second frequency band is the second, and the third frequency band is the smallest. Then the energy proportion of the first frequency band in the adjusted prompt audio signal will also become the largest, but it does not need to be consistent with the environment. If the energy proportion of the first frequency band in the sound signal is the same, the energy proportion of the third frequency band in the adjusted prompt audio signal is the smallest but may not be the same as the energy proportion of the third frequency band in the environmental sound signal. It should be understood that, in addition to the first frequency band, the second frequency band and the third frequency band, different frequency bands may also include more frequency bands, which is not limited in this embodiment of the present application.

The energy of the feedback sound signal can be used to characterize the energy of the environmental sound signal in the ear canal. The energy determination method of the feedback environmental sound signal includes but is not limited to the following methods:

(1) During the third time period, the microphone of the headset (such as the feedback microphone) can collect the environmental sound signal in the ear canal to obtain the feedback environmental audio signal, and determine the energy of the feedback environmental audio signal based on the feedback environmental audio signal. The third time period may be a period of time before the headset plays the adjusted prompt audio signal.

(2) It can be determined based on the energy of the environmental sound signal. The greater the energy of the environmental sound signal, the greater the energy of the feedback environmental sound signal. For example, the headset can determine that the energy of the feedback environmental sound signal can be K times the energy of the environmental sound signal, and the value of K can be adjusted according to the actual situation. Among them, the energy of the environmental sound signal can be characterized by the absolute energy and relative energy of the environmental sound signal included in the target environmental sound feature. For example, the target energy may be obtained by combining the absolute energy and relative energy of the environmental sound signals included in the target environmental sound characteristics. The combination may be adding the absolute energy and the relative energy after setting different weights. Among them, energy can be used to represent the voltage corresponding to the audio signal; it can also represent the amplitude of the audio signal; or the decibel size.

In the case of a noisy environment, the headset adjusts the default prompt audio signal based on the target environmental sound characteristics to obtain the adjusted prompt audio signal. The relevant formula can refer to the following formula (4).

S _tishi =G(T, H)*S _pri *F_tishi[P(w ₁ ~ w ₂ )} Formula (4)

Among them, S _tishi represents the adjusted prompt audio signal, S _pri represents the default prompt audio signal, and S _pri* F_tishi[P(w ₁ ~ w ₂ )] represents the energy of different frequency bands of the default prompt audio signal according to the target environmental sound characteristics. The energy of different frequency bands in the environmental sound signal is adjusted so that the energy proportion of the adjusted prompt audio signal in different frequency bands is related to the energy proportion of the target environmental sound feature in different frequency bands. G(T,H) indicates that the energy gain of different frequency points in the default prompt audio signal is determined based on the absolute energy and relative energy of the environmental sound signal included in the target environmental sound characteristics. The greater the absolute energy and/or relative energy, the greater the energy of the feedback environmental sound signal, and the greater the energy gain at different frequency points.

Figure 9 is a schematic diagram of adjusting the default prompt audio signal in a noisy environment in Method 1.

As shown in Figure 9, the energy of the default prompt audio signal is the first energy, and the energy of the adjusted prompt audio signal is the second energy, and the second energy is greater than the first energy. The energy proportion of different frequency bands in the adjusted prompt audio signal is the same as that of the ambient sound signal. And the energy of the adjusted prompt audio signal is greater than the energy of the ambient sound signal.

When the environment is quiet, the headset can adapt the default prompt audio signal to the target environmental sound characteristics. This adaptation is to adjust the energy proportion of the default prompt audio signal in different frequency bands to be the same as the target environmental sound characteristics. At the same time, the energy of the default prompt audio signal is reduced from the first energy to the third energy.

When the environment is moderate, the headset may or may not adjust the default prompt audio signal, which is not limited in the embodiments of the present application.

Method 2: When the environment is noisy, the earphones can increase the energy of the default prompt audio signal from the first energy to the third energy, and the third energy is greater than the energy of the environmental sound signal. At this time, the energy proportion of the audio signal in different frequency bands is not adjusted by default. One way to increase the energy of the default prompt audio signal from the first energy to the third energy is to increase the energy of frequency points of different frequencies in the default prompt audio signal by the same value. In this method, the energy gain at different frequency points (gain here is the degree of increase) is determined by the absolute energy and relative energy of the environmental sound signal included in the target environmental sound characteristics. The greater the absolute energy and/or relative energy, the greater the energy gain. , the greater the energy gain at different frequency points. Another way is that the energy increase degree of frequency points in different frequency bands in the default prompt audio signal can also be different.

Figure 10 is a schematic diagram of adjusting the default prompt audio signal in a noisy environment in Method 2.

As shown in Figure 10, the energy of the default prompt audio signal is the first energy, and the energy of the adjusted prompt audio signal is the third energy, and the third energy is greater than the first energy. If the energy proportions of different frequency bands in the adjusted prompt audio signal are not adjusted, they can be the same as the default prompt audio signal in some possible implementations. And the energy of the adjusted prompt audio signal is greater than the energy of the ambient sound signal.

When the environment is quiet, the earphones can reduce the energy of the default prompt audio signal from the first energy to the third energy.

When the environment is moderate, the headset may or may not adjust the default prompt audio signal, which is not limited in the embodiments of the present application.

In this way, when the environment is noisy, the energy of the adjusted prompt audio signal can become larger and greater than the energy of the environmental sound signal. When the environment is quiet, the energy of the default prompt audio signal can be reduced.

S108. After the earphone is confirmed to be inserted into the ear, the adjusted audio prompt signal is played, and the earphone collects the played audio prompt signal through the microphone to obtain a feedback audio signal.

This microphone can be the feedback microphone of the headset, because the feedback microphone is close to the ear canal and can better pick up the sound signal transmitted in the ear canal.

Figure 11 shows a schematic diagram of playing the headphones and collecting the adjusted prompt audio signal to obtain the feedback audio signal.

In Figure 11, icon 101 is the speaker of the earphone, icon 102 is the feedback microphone of the earphone, and icon 103 is the prompt audio signal (after adjustment) transmitted in the ear canal.

After the earphone is confirmed to be inserted into the ear, the earphone can use the speaker to play the adjusted prompt audio signal, and the played prompt audio signal (after adjustment) can be transmitted in the ear canal, as shown by icon 103 in Figure 11. An exemplary situation is when the played cue audio signal (modified) can be transmitted in the ear canal. Then, the headset can collect the prompt audio signal (after adjustment) transmitted in the ear canal through the feedback microphone to obtain the feedback audio signal. In some possible cases, the feedback audio signal may also include an environmental sound signal. However, the energy of the prompt audio signal included in the feedback audio signal is greater than the energy of the ambient sound signal. In the process of determining the target playback model in the following step S109, the interference of the ambient sound signal on the target playback model can be reduced.

S109. The headset determines a target playback model based on the adjusted prompt audio signal and feedback audio signal. The target playback model can reflect the wearing condition of the headset and the user's ear canal model.

The target playback model refers to the contrast relationship between the adjusted prompt audio signal and the feedback audio signal.

In a possible implementation, the contrast relationship may be a set of energy ratios of mid-frequency points in the adjusted prompt audio signal and the feedback audio signal. The frequency point energy ratio is the ratio of the total energy of the frequency points of the same frequency in the adjusted prompt audio signal and the feedback audio signal after converting the adjusted prompt audio signal and the feedback audio signal into the frequency domain.

The headset can convert the adjusted prompt audio signal and feedback audio signal into the frequency domain. The adjusted prompt audio signal in the frequency domain and the feedback audio signal in the frequency domain are obtained. In the following, the adjusted prompt audio signal in the frequency domain may still be called the adjusted prompt audio signal, and the feedback audio signal in the frequency domain may still be called the feedback audio signal. Any frame audio signal in the adjusted prompt audio signal (in the frequency domain) and the feedback audio signal (in the frequency domain) can be expressed as N (N is an integer power of 2) frequency points. For example, N can be It is 1024, 2048, etc. The specific size can be determined by the computing power of the headset. The N frequency points are used to represent audio signals within a certain frequency range, such as between 0khz and 15khz, or other frequency ranges. It can also be understood that the frequency point refers to the information of the audio signal (including prompt audio signal and environmental sound signal) at the corresponding frequency. This information includes time, frequency of the audio signal, and energy of the audio signal (decibel or Amplitude), where energy can be used to represent the voltage corresponding to the audio signal; it can also represent the amplitude of the audio signal; or the decibel size of the audio signal. The frequency distribution of N frequency points in any two frames of audio signals is the same. For example, the frequency of the i-th frequency point of the j-th frame audio signal in the feedback audio signal is the same as the frequency of the i-th frequency point of the j+1-th frame audio signal.

Any frame audio signal in the adjusted prompt audio signal and feedback audio signal can be expressed as N (N is an integer power of 2) frequency points, then the target playback model includes N energy ratios. It includes a first total energy ratio, which is the ratio of the total energy of all frequency points of the first frequency in the adjusted prompt audio signal to the total energy of all frequency points of the first frequency in the feedback audio signal. The first frequency is one of N frequencies corresponding to N frequency points in one frame of audio signal.

It should be understood that this target playback model can reflect the wearing condition of the headset as well as the user's ear canal model. It can also be said that the target playback model can reflect the wearing situation of the headphones and what kind of ear canal model the user's ear canal belongs to. Because the same prompt audio signal (adjusted), when the headset is worn or the ear canal model is different, the feedback audio signal (after adjustment, recorded as prompt audio signal 2) obtained by the headset playing the prompt audio signal ( Denoted as the reference audio signal 2), the target playback model determined based on the reference audio signal 2 and the prompt audio signal 2 is different.

It should be understood that in other circumstances, the comparison relationship can also be other contents. For example, it may be the ratio of the total energy of all frequency points of the feedback audio signal to the total energy of all frequency points of the adjusted prompt audio signal. It can also be a set of energy ratios of mid-frequency points of the adjusted prompt audio signal and the feedback audio signal on some frequency bands. The embodiments of the present application do not limit this.

S110. Based on the target playback model matching the preset playback model in the mode setting database, the headset determines the preset playback model in the mode setting database that matches the target playback model, and determines the headset corresponding to the matching preset playback model. mode and the parameters corresponding to the headphone mode.

The mode setting database may include multiple preset playback models. Each preset playback model also corresponds to a headphone mode. The headphone mode also corresponds to a preset hearing sense and adjustment parameters. The adjustment parameters are a type of headphone. The headphone mode can give the user preset listening parameters when worn and in an ear canal model. It can also be said that the mode setting database includes a plurality of preset playback models, wherein each preset playback model also corresponds to at least one parameter (adjustment parameter), and each parameter in the at least one parameter corresponds to a headphone mode and A default listening experience.

For a detailed description of the mode setting data and the preset playback model therein, please refer to the aforementioned exemplary description of Table 1 and related content.

In the case where the aforementioned step S106 is executed, after the earphone determines the earphone mode, the target listening feeling corresponding to the earphone mode can be determined. The target listening feeling can be set by the user. If the user does not set it, a default target listening feeling can be set. For descriptions of the target listening sense, reference may be made to the foregoing exemplary description of term (3), which will not be described again here. At this time, the headset can determine parameters corresponding to the matched preset playback model based on the preset playback model matched to the target playback model, combined with the headphone mode and the target hearing sensation corresponding to the headphone mode. This parameter also corresponds to the headphone mode and target listening experience.

In the case where the aforementioned step S106 is not executed, the headset determines the headphone mode corresponding to the matching preset playback model and the parameters corresponding to the headphone mode include but are not limited to the following methods.

Method 1: The headset can select a headphone mode from multiple headphone modes to determine the target listening experience corresponding to the headphone mode. Then, the headset can determine the parameters corresponding to the matched preset playback model based on the preset playback model matched to the target playback model, combined with the headphone mode and the target hearing sensation corresponding to the headphone mode. This parameter also corresponds to the headphone mode and target listening experience.

Method 2: The headset determines all parameters corresponding to the matching preset playback model. Determine the parameters that satisfy a first preset condition. The first preset condition is: the headphone mode corresponding to the parameter satisfies the second preset condition and the preset hearing sense corresponding to the parameter satisfies the third preset condition. The second preset condition is: the headphone mode corresponding to the parameter is the headphone mode last selected by the user, or the headphone mode that the user has used the longest within a period of time (for example, 10 days). The third preset condition is that the preset hearing sense corresponding to the parameter is the target hearing sense set by the user or, if the user does not set the target hearing sense, the preset hearing sense corresponding to the parameter is the default target hearing sense.

It should be understood that the number of energy ratios included in any preset playback model and the target playback model is the same. It is assumed here that there are N energy ratios. The following description may be used to refer to the manner in which the headset determines the preset playback model in the mode setting database that matches the target playback model.

First, the headphones calculate the total difference between the N energy ratios in the target playback model and different preset playback models. The different preset playback models include a first preset playback model. The total difference between the N energy ratios in the target playback model and the first preset playback model includes: the target playback model and the first preset playback model. The sum of the absolute values of the differences between N corresponding energy ratios. Any corresponding energy ratio included in the N corresponding energy ratios is the i-th energy ratio in the target playback model and the i-th energy ratio in the first preset playback model. Wherein, the first preset playback model is any one of all preset playback models included in the mode setting database.

Then, the headset determines the total difference that satisfies the fourth preset condition from the total difference of the N energy ratios in the target playback model and all preset playback models, and the headset determines the total difference that satisfies the fourth preset condition. The default playback model corresponding to the value is the default playback model that matches the target playback model.

In some possible cases, the fourth preset condition is that the total difference between the N energy ratios in the matching preset playback model and the target playback model is the smallest total difference.

In other possible situations, the fourth preset condition is that the total difference between the N energy ratios in the matching preset playback model and the target playback model is less than or equal to the first difference threshold.

S111. The earphone processes the audio signal based on the earphone mode corresponding to the matched preset playback model and the parameters corresponding to the earphone mode.

The earphone can process the audio signal based on the earphone mode corresponding to the matched preset playback model and the parameters corresponding to the earphone mode, so that the earphone's processing level of the audio signal can reach the preset processing level, so that the user can obtain the target listening experience. The process of processing the audio signal by the earphone to obtain the target hearing sensation can be referred to the related descriptions in the aforementioned term (2) and term (3), which will not be described again here.

It should be understood that for steps in the aforementioned steps S101 to S111 where the execution subject is the headset, the execution subject can be replaced by a terminal, and the terminal can send the execution results of the steps to the headset. For example, the headset can send a first environmental audio signal to the terminal, and the terminal can determine a first environmental sound feature based on the first environmental audio signal, and then determine a target environmental sound feature based on the first environmental sound feature and the second environmental sound feature, and so on.

In the embodiment of the present application, the first energy threshold may also be called the second threshold, and the second energy threshold may also be called the first threshold.

As mentioned above, the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still make the foregoing technical solutions. The technical solutions described in each embodiment may be modified, or some of the technical features may be equivalently replaced; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to depart from the scope of the technical solutions in each embodiment of the present application.

As used in the above embodiments, the term "when" may be interpreted to mean "if..." or "after" or "in response to determining..." or "in response to detecting..." depending on the context. Similarly, depending on the context, the phrase "when determining..." or "if (stated condition or event) is detected" may be interpreted to mean "if it is determined..." or "in response to determining..." or "on detecting (stated condition or event)” or “in response to detecting (stated condition or event)”.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated. The available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, solid state drive), etc.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments are implemented. This process can be completed by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, , may include the processes of the above method embodiments. The aforementioned storage media include: ROM, random access memory (RAM), magnetic disks, optical disks and other media that can store program codes.

Claims (13)

1. A method for determining parameters corresponding to a headphone mode, characterized in that it is applied to headphones, and the method includes:

   The earphone acquires target environmental sound characteristics and determines the target listening experience when the earphone mode is the first earphone mode; the target environmental sound characteristics are used to reflect the energy of the environmental sound signal;

   The headset adjusts the default prompt audio signal of the first headphone mode based on the target environmental sound characteristics to obtain an adjusted prompt audio signal; the greater the energy of the environmental sound signal, the greater the adjusted prompt audio signal. The greater the energy of the signal and the smaller the energy of the environmental sound signal, the smaller the energy of the adjusted prompt audio signal;

   After the headset plays the adjusted prompt audio signal, the microphone collects the played prompt audio signal to obtain a feedback audio signal;

   The headset determines a target playback model based on the adjusted prompt audio signal and feedback audio signal; the target playback model is used to reflect the user's wearing of the headset and the user's ear canal model;

   The headset determines a preset playback model that matches the target playback model from all preset playback models in a mode setting database; the mode setting database includes a plurality of preset playback models, wherein each preset playback model The model also corresponds to at least one parameter, and each parameter in the at least one parameter corresponds to a headphone mode and a preset hearing sense;

   The earphone determines the target parameter corresponding to the matched preset playback model; the earphone mode corresponding to the target parameter is the first earphone mode and the preset hearing feeling corresponding to the target parameter is the target hearing feeling;

   The earphone processes audio signals based on the first earphone mode and target parameters corresponding to the first earphone mode.
2. The method according to claim 1, characterized in that:

   The microphone is a feedback microphone of the earphone.
3. The method according to claim 1, characterized in that:

   The target environmental sound characteristics include one or more of absolute energy, relative energy, and energy proportions of different frequency bands of the environmental sound signal.
4. The method according to claim 3, wherein the target environmental sound characteristics include absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal, and the earphone acquires the target environmental sound characteristics, specifically including:

   The earphone collects environmental sound signals to obtain a first environmental audio signal;

   The earphone determines the absolute energy, relative energy, and energy proportions of different frequency bands of the environmental sound signal in the first environmental audio signal as the target environmental sound feature based on the first environmental audio signal.
5. The method according to claim 3, wherein the target environmental sound characteristics include absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal, and the earphone acquires the target environmental sound characteristics, specifically including:

   The earphone collects environmental sound signals to obtain a first environmental audio signal;

   The headset determines a first environmental sound characteristic based on the first environmental audio signal. The first environmental sound characteristic includes the absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal in the first environmental audio signal. ;

   The earphone receives the second environmental sound characteristics sent by the terminal connected to the earphone, and the second environmental sound characteristics include the absolute energy, relative energy and energy proportion of different frequency bands of the environmental sound signal in the second environmental audio signal; The second environmental audio signal is an environmental sound signal collected by the terminal;

   When the first environmental sound feature is the same as the second environmental sound feature, the headset determines that the first environmental sound feature is the target environmental sound feature;

   When the first environmental sound characteristics and the second environmental sound characteristics are different, the headset sets different weights based on the first environmental sound characteristics and the second environmental sound characteristics and performs fusion. The fusion result is used as the target environmental sound feature.
6. The method according to claim 3, wherein the headset adjusts the default prompt audio signal of the first headset mode based on the target environmental sound characteristics, specifically including:

   When it is determined that the energy of the environmental sound signal is greater than or equal to the first threshold, the headset increases the energy of the default prompt audio signal from the first energy to a second energy, and the second energy is greater than the energy of the feedback environmental sound signal. ; The energy of the feedback environmental sound signal is used to represent the energy size of the environmental sound signal in the ear canal; or,

   When it is determined that the energy of the environmental sound signal is less than or equal to the second threshold, the earphone reduces the energy of the default prompt audio signal from the first energy to the third energy.
7. The method of claim 3, wherein the headset adjusts the default prompt audio signal of the first headset mode based on target environmental sound characteristics, specifically including:

   When it is determined that the energy of the environmental sound signal is greater than or equal to the first threshold, the headset increases the energy of the default prompt audio signal from the first energy to a second energy, and the second energy is greater than the energy of the feedback environmental sound signal. And the energy proportion of the default prompt audio signal in different frequency bands is adjusted to be related to the energy proportion of the environmental sound signal included in the target environmental sound characteristics in different frequency bands; the energy of the feedback environmental sound signal is used to characterize The energy level of the ambient sound signal in the ear canal; or,

   When it is determined that the energy of the environmental sound signal is less than or equal to the second threshold, the earphone reduces the energy of the default prompt audio signal from the first energy to the third energy.
8. The method according to claim 6 or 7, characterized in that:

   The energy of the environmental sound signal is one of the target energy obtained by combining the absolute energy, relative energy, or absolute energy and relative energy of the environmental sound signal including the target environmental sound feature.
9. The method according to any one of claims 1-7, characterized in that:

   The target listening feeling is the listening feeling set by the user through the earphone or a terminal connected to the earphone;

   In the case where the user does not set the target hearing feeling, the headset or the terminal connected to the headset sets a default hearing feeling as the target hearing feeling.
10. The method according to any one of claims 1 to 7, characterized in that the headset determines the target playback model based on the adjusted prompt audio signal and feedback audio signal, specifically including:

    After the headset converts the adjusted prompt audio signal and the feedback audio signal into the frequency domain, the audio signal of any frame in the adjusted prompt audio signal and the feedback audio signal includes N frequency points, the N is an integer power of 2;

    The headset determines a target playback model based on the adjusted prompt audio signal converted to the frequency domain and the feedback audio signal; N energy ratios in the target playback model; including a first total energy ratio, the The first total energy ratio is the ratio of the total energy of all frequency points of the first frequency in the adjusted prompt audio signal to the total energy of all frequency points of the first frequency in the feedback audio signal; the first The frequency is one of N frequencies corresponding to N frequency points in one frame of audio signal.
11. A communication system, characterized in that the communication system includes a terminal and a headset, wherein:

    The earphone is used to collect environmental sound signals to obtain a first environmental audio signal, and determine first environmental sound characteristics based on the first environmental audio signal;

    The terminal is used to collect environmental sound signals to obtain a second environmental audio signal, and determine second environmental sound characteristics based on the second environmental audio signal;

    The terminal is also configured to send the second environmental sound characteristics to the earphone;

    The earphone is also used to determine target environmental sound characteristics based on the first environmental sound characteristics and the second environmental sound characteristics;

    The earphone is also used to adjust the default prompt audio signal of the first earphone mode based on the target environmental sound characteristics;

    The earphone is also used to collect the played audio prompt signal through a microphone to obtain a feedback audio signal after playing the adjusted prompt audio signal;

    The earphone is also used to determine a target playback model based on the adjusted prompt audio signal and feedback audio signal;

    The earphone is also used to determine a preset playback model that matches the target playback model from all preset playback models in the mode setting database;

    The headset is also used to determine the target parameters corresponding to the matched preset playback model;

    The earphone is also used to process audio signals based on the first earphone mode and target parameters corresponding to the first earphone mode.
12. An earphone, characterized in that the earphone includes: one or more processors, memory, microphones and speakers; the memory is coupled to the one or more processors, and the memory is used to store computer program code, The computer program code includes computer instructions, which are invoked by the one or more processors to cause the terminal to perform the method according to any one of claims 1 to 10.
13. A computer storage medium, characterized in that a computer program is stored in the computer storage medium, and the computer program includes executable instructions. When executed by a processor, the executable instructions cause the processor to execute the claims. The method described in any one of 1 to 10.

Images