CN114466278B

CN114466278B - Method for determining parameters corresponding to earphone mode, earphone, terminal and system

Info

Publication number: CN114466278B
Application number: CN202210371139.1A
Authority: CN
Inventors: 韩欣宇; 韩荣; 夏日升
Original assignee: Beijing Honor Device Co Ltd
Current assignee: Beijing Honor Device Co Ltd
Priority date: 2022-04-11
Filing date: 2022-04-11
Publication date: 2022-08-16
Anticipated expiration: 2042-04-11
Also published as: CN114466278A; WO2023197474A1

Abstract

A method, an earphone, a terminal and a system for determining parameters corresponding to earphone modes are provided. In the method, the earphone can adjust the default prompting audio signal, and then play the adjusted prompting audio signal to obtain the reference prompting audio signal. And determining a target playing model based on the adjusted prompt audio signal and the reference prompt sound signal. Then, based on the matching between the target playing model and the preset playing model in the mode setting database, determining the preset playing model matched with the target playing model in the mode setting database, and determining the earphone mode corresponding to the matched preset playing model and the parameter corresponding to the earphone mode. Then, the earphone processes the audio signal based on the earphone mode corresponding to the matched preset playing model and the parameter corresponding to the earphone mode.

Description

Method for determining parameters corresponding to earphone mode, earphone, terminal and system

Technical Field

The present application relates to the field of audio processing technologies, and in particular, to a method, an earphone, a terminal, and a system for determining parameters corresponding to an earphone mode.

Background

With the development of science and technology, the functions of the earphone are more and more improved. At present, some earphones can provide multiple earphone modes for users, and different experiences can be brought to the users when the earphones adopt different earphone modes to play music. Common headphone modes include one or more of an Active Noise Control (ANC) mode, or a transparent (HT) mode, or a standard mode. When the earphone mode of the earphone is the active noise reduction mode, the function of filtering the environmental sound signal (which can be regarded as noise) can be realized when the user wears the earphone; when the earphone mode of the earphone is the transparent transmission mode, the user can still feel the environmental sound signals when wearing the earphone as the user does not wear the earphone, namely the user feels the environmental sound signals before and after wearing the earphone; when the earphone mode of the earphone is the standard mode, after the user wears the earphone, the listening effect when the user wears the earphone can be achieved well.

Different parameters can be corresponded to in the same earphone mode. The different parameters can bring different degrees of processing effects to the same earphone mode, and the different degrees of processing effects include that the earphone can realize the corresponding functions of the same earphone mode to different degrees. For example, taking the active noise reduction mode as an example for explanation, the active noise reduction mode may correspond to different parameters, and the degrees of filtering the environmental sound signals by using different parameters are different, that is, the active noise reduction degree may be strong or weak, when the active noise reduction degree is stronger, the environmental sound signals heard by the user are less, when the active noise reduction degree is weaker, the environmental sound signals heard by the user are more, and when the active noise reduction degree is weakest, the earphone may be considered not to perform any noise reduction processing.

Because the ear canal models of different users are different and the same user is in different environments, the noise degree of the environment is different, and the parameters of the earphone mode need to be adapted to the optimal listening feeling of different users in each earphone mode. How to adapt to achieve the optimal listening sensation for different users is a worthy direction to be studied.

Disclosure of Invention

The application provides a method, an earphone, a terminal and a system for determining parameters corresponding to earphone modes.

In a first aspect, the present application provides a method for determining parameters corresponding to a headset mode, where the method is applied to a headset and includes: the earphone acquires the sound characteristics of a target environment and determines the target hearing sense when the earphone mode is the first earphone mode; the target environmental sound characteristic is used for reflecting the energy of the environmental sound signal; the earphone adjusts the default prompting audio signal of the first earphone mode based on the target environment sound characteristic to obtain an adjusted prompting audio signal; the larger the energy of the environment sound signal is, the larger the energy of the adjusted prompt audio signal is, and the smaller the energy of the environment sound signal is, the smaller the energy of the adjusted prompt audio signal is; after the earphone plays the adjusted prompt audio signal, the played prompt audio signal is collected by a microphone to obtain a feedback audio signal; the earphone determines a target playing model based on the adjusted prompt audio signal and the feedback audio signal; the target playing model is used for reflecting the condition that the user wears the earphone and the ear canal model of the user; the earphone determines a preset playing model matched with the target playing model from all preset playing models in a mode setting database; the mode setting database comprises a plurality of preset playing models, wherein each preset playing model also corresponds to at least one parameter, and each parameter in the at least one parameter corresponds to one earphone mode and one preset auditory sensation; the earphone determines a target parameter corresponding to the matched preset playing model; the earphone mode corresponding to the target parameter is the first earphone mode, and the preset hearing corresponding to the target parameter is the target hearing; the earphone processes the audio signal based on the first earphone mode and the target parameter corresponding to the first earphone mode.

In the above embodiment, the earphone may be provided with a mode setting database, where the mode setting database records parameters corresponding to the target hearing sense in the first earphone mode based on different preset playing models (i.e. different wearing conditions of the earphone and ear canal models) in the quiet environment. The first headphone mode may be an active noise reduction mode or a transparent transmission mode described in the following embodiments. Then, in the actual use process, a target playing model can be determined to reflect the wearing condition of the current earphone and the ear canal model, and then a target parameter corresponding to the target listening sensation realized in the first earphone mode corresponding to the preset playing model matched with the target playing model is determined. However, if the energy of the ambient sound signal is large, the ambient sound signal may affect the accuracy of the target playing model when the ambient is noisy, so that the determined target parameter is wrong, and therefore, the energy of the default prompt audio signal may be increased, so that the influence caused by the ambient sound signal may be cancelled. If the energy of the ambient sound signal is small, the environment is quiet, and when the environment is quiet, the energy of the default prompting audio signal is made small, so that the user can hear well, and the user does not feel uncomfortable due to the fact that the default prompting audio signal is heard in the quiet environment.

In combination with the first aspect, the microphone is a feedback microphone of the headset.

In the above embodiment, the feedback microphone may collect a sound signal in the ear canal, so as to obtain a feedback audio signal with more comprehensive information.

With reference to the first aspect, the target ambient sound characteristic includes one or more of an absolute energy, a relative energy, and an energy ratio of different frequency bands of the ambient sound signal.

With reference to the first aspect, the target ambient sound feature includes absolute energy, relative energy of the ambient sound signal, and energy occupation of different frequency bands, and the earphone acquires the target ambient sound feature, specifically including: the earphone collects an environment sound signal to obtain a first environment audio signal; the earphone determines absolute energy, relative energy and energy ratio of different frequency bands of the environment sound signal in the first environment audio signal as the target environment sound characteristic based on the first environment audio signal.

In the above embodiment, the earphone may acquire the target environment sound feature based on the first environment audio signal, and may not rely on the terminal to analyze the target environment sound feature, so as to acquire the target environment sound feature more quickly. And under the condition that the earphone is not connected with the terminal, the earphone can still be ensured to acquire the target environmental sound characteristics.

With reference to the first aspect, the target ambient sound feature includes absolute energy, relative energy of the ambient sound signal, and energy occupation of different frequency bands, and the earphone acquires the target ambient sound feature, specifically including: the earphone collects an environment sound signal to obtain a first environment audio signal; the headset determines a first ambient sound characteristic based on the first ambient audio signal, the first ambient sound characteristic comprising an absolute energy, a relative energy, and an energy fraction of different frequency bands of an ambient sound signal in the first ambient audio signal; the earphone receives a second environment sound characteristic sent by a terminal connected with the earphone, wherein the second environment sound characteristic comprises absolute energy and relative energy of an environment sound signal in a second environment audio signal and energy ratios of different frequency bands; the second environment audio signal is an environment sound signal collected by the terminal; in the case that the first ambient sound characteristic is the same as the second ambient sound characteristic, the earphone determines the first ambient sound characteristic as the target ambient sound characteristic; in a case where the first ambient sound feature is different from the second ambient sound feature, the earphone may set different weights based on the first ambient sound feature and the second ambient sound feature and then perform fusion, and use a result of the fusion as the target ambient sound feature. In the above embodiment, the earphone may determine the target ambient sound feature based on the first ambient sound feature determined by the earphone and the second ambient sound feature determined by the terminal, so as to enhance the accuracy of the target ambient sound feature, and when the earphone is faulty, the terminal determines the second ambient sound feature to make up for the fault.

With reference to the first aspect, the adjusting, by the headphone, the default cue audio signal in the first headphone mode based on the target environmental sound characteristic specifically includes: upon determining that the energy of the ambient sound signal is greater than or equal to a first threshold, the headphones increase the energy of the default cue audio signal from a first energy to a second energy, the second energy being greater than the energy of the feedback ambient sound signal; the energy of the feedback environment sound signal is used for representing the energy of the environment sound signal in the ear canal; alternatively, the headphone reduces the energy of the default cue audio signal from the first energy to a third energy upon determining that the energy of the ambient sound signal is less than or equal to a second threshold.

In the above embodiment, when it is determined that the ambient sound signal is greater than or equal to the first threshold, which may be the second energy threshold recorded in the embodiment, it indicates that the earphone determines that the environment is noisy, so that the energy of the default cue audio signal may be increased to counteract the influence of the ambient sound signal on generating the target playback model. When it is determined that the ambient sound signal is less than or equal to the second threshold, which may be the first energy threshold recorded in the embodiments, then it is an indication that the headset determines that the environment is quiet, and thus the energy of the default alert audio signal may be reduced so that the user does not feel uncomfortable hearing the default alert audio signal because the default alert audio signal (unadjusted) is energetic enough.

With reference to the first aspect, the adjusting, by the headphone, the default cue audio signal in the first headphone mode based on the target environmental sound characteristic specifically includes: upon determining that the energy of the ambient sound signal is greater than or equal to a first threshold, the earpiece increases the energy of the default cue audio signal from a first energy to a second energy, the second energy being greater than the energy of the feedback ambient sound signal and adjusts the energy fraction of the default cue audio signal in the different frequency bands to correlate with the energy fraction of the ambient sound signal in the different frequency bands included in the target ambient sound characteristic; the energy of the feedback environment sound signal is used for representing the energy of the environment sound signal in the ear canal; alternatively, the earphone reduces the energy of the default cue audio signal from the first energy to a third energy upon determining that the energy of the ambient sound signal is less than or equal to a second threshold.

In the above embodiment, when it is determined that the ambient sound signal is greater than or equal to the first threshold, the first threshold may be the second energy threshold recorded in the embodiment, which indicates that the earphone determines that the environment is noisy, so that the energy of the default prompt audio signal may be increased, and the energy occupation ratio of the default prompt audio signal in different frequency bands may be the same as or corresponding to that of the ambient sound signal, which may ensure that the energy of the default prompt audio signal in each frequency band may be greater than that of the ambient sound signal, and may better offset the influence of the ambient sound signal on generating the target playing model. When it is determined that the ambient sound signal is less than or equal to the second threshold, which may be the first energy threshold recorded in the embodiments, then it is an indication that the headset determines that the environment is quiet, and thus the energy of the default alert audio signal may be reduced so that the user does not feel uncomfortable hearing the default alert audio signal because the default alert audio signal (unadjusted) is energetic enough.

With reference to the first aspect, the energy of the ambient sound signal is one of an absolute energy, a relative energy, or a target energy obtained by combining the absolute energy and the relative energy of the ambient sound signal.

With reference to the first aspect, the target hearing sensation is a hearing sensation set by the user through the earphone or a terminal connected to the earphone; in case that the user does not set the target hearing sense, the earphone or the terminal connected to the earphone sets a default hearing sense as the target hearing sense.

With reference to the first aspect, the determining, by the earphone, a target playing model based on the adjusted prompt audio signal and the adjusted feedback audio signal specifically includes: after the adjusted prompt audio signal and the adjusted feedback audio signal are converted to a frequency domain by the earphone, any frame of audio signal in the adjusted prompt audio signal and the adjusted feedback audio signal comprises N frequency points, wherein N is an integer power of 2; the earphone determines a target playing model based on the adjusted prompt audio signal and the feedback audio signal converted to the frequency domain; n energy ratios in the target playback model; the first total energy ratio is the ratio of the total energy of all frequency points of the first frequency in the adjusted prompt audio signal to the total energy of all frequency points of the first frequency in the feedback audio signal; the first frequency is one of N frequencies corresponding to N frequency points in a frame of audio signal. In the embodiment, the wearing condition of the earphone and the ear canal model are reflected by using the comparison relation between the feedback audio signal and the adjusted default prompt audio signal, and the calculation process is simple.

In a second aspect, an embodiment of the present application provides a communication system, where the communication system includes a terminal and an earphone, where: the earphone is used for acquiring an environment sound signal to obtain a first environment audio signal and determining a first environment sound characteristic based on the first environment audio signal; the terminal is used for acquiring an environment sound signal to obtain a second environment audio signal and determining a second environment sound characteristic based on the second environment audio signal; the terminal is also used for sending the second environment sound characteristic to the earphone; the headset is further configured to determine a target ambient sound characteristic based on the first ambient sound characteristic and the second ambient sound characteristic; the earphone is further used for adjusting the default prompt audio signal of the first earphone mode based on the target environment sound characteristic; the earphone is also used for acquiring the played prompt audio signal through a microphone after the adjusted prompt audio signal is played to obtain a feedback audio signal; the earphone is also used for determining a target playing model based on the adjusted prompt audio signal and the feedback audio signal; the earphone is also used for determining a preset playing model matched with the target playing model from all preset playing models in the mode setting database; the earphone is also used for determining a target parameter corresponding to the matched preset playing model; the earphone is also used for processing the audio signal based on the first earphone mode and the target parameter corresponding to the first earphone mode.

In a third aspect, an embodiment of the present application provides a headset, including: one or more processors, a microphone, and a speaker; the memory is coupled to the one or more processors for storing computer program code comprising computer instructions which are invoked by the one or more processors to cause the terminal to perform the method according to the first aspect.

In the above embodiment, the earphone may be provided with a mode setting database, where the mode setting database records parameters corresponding to the target hearing sense when the first earphone mode is to be achieved based on different preset playing models (i.e. different wearing conditions of the earphone and different ear canal models) in the quiet environment. The first headphone mode may be an active noise reduction mode or a transparent transmission mode described in the following embodiments. Then, in the actual use process, a target playing model can be determined to reflect the wearing condition of the current earphone and the ear canal model, and then a target parameter corresponding to the target listening sensation realized in the first earphone mode corresponding to the preset playing model matched with the target playing model is determined. However, if the energy of the ambient sound signal is large, the ambient sound signal may affect the accuracy of the target playing model when the ambient is noisy, so that the determined target parameter is wrong, and therefore, the energy of the default prompt audio signal may be increased, so that the influence caused by the ambient sound signal may be cancelled. If the energy of the ambient sound signal is small, the environment is quiet, and when the environment is quiet, the energy of the default prompting audio signal is made small, so that the user can hear well, and the user does not feel uncomfortable due to the fact that the default prompting audio signal is heard in the quiet environment.

In a fourth aspect, an embodiment of the present application provides a computer storage medium, where a computer program is stored in the storage medium, and the computer program includes executable instructions, which when executed by a processor, cause the processor to perform the method according to the first aspect.

Drawings

Fig. 1 shows a schematic view of the wearing of a headset;

fig. 2 shows two cases where there is a gap between the earphone and the ear canal;

FIG. 3 shows a schematic view of an ear canal model;

fig. 4 is a schematic structural diagram of an earphone according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a terminal provided in an embodiment of the present application;

fig. 6 is a schematic structural diagram of a communication system provided in an embodiment of the present application;

fig. 7 is a schematic flow chart of a parameter determination method corresponding to the earphone mode in the embodiment of the present application;

FIG. 8 shows a first ambient audio signal in the frequency domain;

FIG. 9 is a schematic diagram of adjusting the default cue audio signal in case of noisy environment in the mode 1;

FIG. 10 is a schematic diagram illustrating the adjustment of the default cue audio signal in the case of noisy environment in the mode 2;

fig. 11 shows a schematic diagram of the earphone playing and the adjusted prompt audio signal being collected to obtain the feedback audio signal.

Detailed Description

The terminology used in the following embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the listed items.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of embodiments of the application, unless stated otherwise, "plurality" means two or more.

For ease of understanding, the related terms and concepts related to the embodiments of the present application will be described below.

(1) Wearing condition of earphone and ear canal model

The wearing condition of the earphone refers to whether the user wears the earphone well. In case of good wear, there may be no gap between the earpiece and the ear canal of the user. In case of not being well worn, there is a gap between the earpiece and the ear canal of the user. The wearing condition of the headset may also be referred to as a headset wearing condition or a condition in which the user wears the headset hereinafter.

Fig. 1 shows a schematic view of the wearing of the headset.

As shown in fig. 1 (a), this is a case when the user wears the headphone well. At this time, no gap exists between the earphone and the auditory canal. In such a case, the ambient sound signal can be effectively blocked from entering the human ear. The effective blocking of the ambient sound signals from entering the human ear means that the ambient sound signals can be blocked from entering the human ear better than when the human ear is not worn well, and the ambient sound signals can still enter the human ear in a normal situation.

As shown in fig. 1 (b), this is a case when the user does not wear the headphone well. At this time, a gap exists between the earphone and the ear canal. In such a case, the earphone does not block the ambient sound signal as well as when worn well. Sound leakage can also result when there is a gap between the earpiece and the ear canal. The sound leakage refers to that the audio signal played by the earphone can be transmitted from the ear canal to the external environment. The audio signal may be an audio signal played by a microphone of the headset.

Fig. 2 shows two cases where there is a gap between the earpiece and the ear canal.

It should be understood that the icons 101 in fig. 2 represent the ambient sound signal, and the more the icons 101, the noisier the environment, and the more the energy of the ambient sound signal (the greater the energy, the higher the decibel of the ambient sound signal, the greater the ambient sound signal appears to be heard).

Under the condition that the user does not well wear the earphone, a gap can be generated between the earphone and the auditory canal, and more environment sound signals can enter human ears if the larger the gap is, the poorer the blocking effect on the environment sound signals is. As shown in fig. 2, the voids 102 are smaller than the voids 103. When the wearing condition of the headset is as shown in fig. 2 (a), there may be more ambient sound signals transmitted from the external environment to the human ear than in the wearing condition shown in fig. 2 (b).

It will be appreciated that the larger the gap, the more serious the sound leakage, i.e. when the headset is worn as shown in fig. 2 (a), there will be more ambient sound signal transmitted from the ear canal to the environment than in the worn situation shown in fig. 2 (b). For the illustration of the leakage sound reference may be made to the description of the ambient sound signal in fig. 2, except that the ambient sound signal is transmitted from the external environment into the ear canal, but the leakage sound is transmitted from the ear canal into the external environment.

Fig. 3 shows a schematic view of an ear canal model.

The ear canal model refers to corresponding ear canal shapes when the ear canals of different users are divided into different types according to classification rules, wherein one ear canal shape is the ear canal model. The audio signal played by the earphone can be transmitted in the ear canal, and then the user feels. Different ear canal models may cause the user to produce different sensations of hearing when the headset is playing audio signals.

The classification rule includes, but is not limited to, one or a combination of two of the following rules.

Rule 1: the ear canals of different users are classified according to the length of the ear canal, and when the lengths of the ear canals are different or within a range, an ear canal model can be defined. As shown in fig. 3, the length of the ear canal may be the horizontal distance from the left start to the right start. For example, as shown in fig. 3, the length of the ear canal 301 may be denoted as L1 and the length of the ear canal 302 may be denoted as L2. In some embodiments, if L1 is not equal to L2, the ear canal 301 and the ear canal 302 may be considered to be different shapes, and the ear canal 301 and the ear canal 302 are different ear canal models, respectively. In other embodiments, if L1 is within one length range but L2 is within another length range, then ear canal 301 and ear canal 302 may be considered to be different shapes and ear canal 301 and ear canal 302 are different ear canal models, respectively.

Rule 2: the ear canals of different users are classified according to the width of the ear canal, which may be defined as an ear canal model when the width of the ear canal is different or within a range. Wherein, in some cases, the width of the ear canal may be the vertical distance between the lowest point of the lower edge of the ear canal and the lowest point of the upper edge of the ear canal. For example, as shown in fig. 3 (a), the vertical distance between the lowest point of the lower edge of the ear canal 301 and the lowest point of the upper edge of the ear canal may be represented as S1. In other cases, the width of the ear canal 301 may be the vertical distance between the lowest point of the lower edge of the ear canal and the highest point of the upper edge of the ear canal. For example, as shown in fig. 3 (b), the vertical distance between the lowest point of the lower edge of the ear canal 302 and the lowest point of the upper edge of the ear canal may be represented as S2. Two ear canals are different ear canals when their widths are different, or when their widths are at different width thresholds.

It should be understood that different ear canals may also be classified according to other classification rules, so as to obtain different ear canal models, such as the depth of the ear canal, and the like, which is not limited in the embodiments of the present application.

(2) Earphone mode

The headphone mode of the headphone may indicate what processing the headphone performs on the audio signal, and the processing degree of the processing is determined by an adjustment parameter (hereinafter, simply referred to as a parameter) corresponding to the headphone mode. The processing may include one or more of active noise reduction or transparent transmission. The earphone can bring different audiences to the user after processing the audio signals by adopting different earphone modes. The audio signal may include an ambient sound signal or an audio signal transmitted by the mobile phone to the headset, such as one or more of an audio signal when music is played or an audio signal when a call is made.

The common earphone modes include one or more of an active noise reduction mode or a transparent transmission mode.

Under the condition that a user wears the earphone, if the earphone adopts an active noise reduction mode, the earphone can filter the environmental sound signals, so that the perception of the user on the current environmental sound signals can be weakened. In the active noise reduction mode, the processing degree of the earphone on the audio signal may be different, that is, the degree of the earphone weakening the ambient sound signal may be different. Different degrees of attenuation of the ambient sound signal can be achieved by setting corresponding adjustment parameters (hereinafter simply referred to as parameters) in the active noise reduction mode. For example, the active noise reduction mode may be made to correspond to three different sets of parameters, including a first noise reduction parameter, a second noise reduction parameter, and a third noise reduction parameter. The degree of attenuation of the ambient sound signal by the three corresponding sets of adjustment parameters in the active noise reduction mode may be sequentially increased.

The method for implementing the active noise reduction function corresponding to the active noise reduction mode by the earphone may include: the headphone may process the audio signal including the ambient sound signal using the first parameter corresponding to the active noise reduction mode, for example, filter to attenuate the ambient sound signal included in the audio signal, and then obtain an inverse signal of the filtered audio signal based on the filtered audio signal. The phase difference between the inverted signal and the filtered audio signal is 180 °. The headphone can then play the inverted signal, which can cancel the ambient sound signal actually heard by the user for the purpose of active noise reduction. The first parameters are different, so that the earphone has different attenuation degrees for the environmental sound signals included in the audio signals, and the attenuation degrees for canceling the environmental sound signals actually heard by the user are different after playing, thereby realizing different listening feelings.

Under the condition that a user wears the earphone, when the earphone adopts a transparent transmission mode, the earphone can enhance the environmental sound signals, so that the perception of the user on the environmental sound signals can be enhanced. For example, one possible effect is that the user can still realize the same perception of the ambient sound signal when wearing the headset as when not wearing the headset, i.e. the user feels the same with the ambient sound signal before and after wearing the headset. In the transparent transmission mode, the processing degree of the audio signal carrying the environmental sound signal by the earphone can be different, that is, the degree of the environmental sound signal enhancement by the earphone can be different. Different degrees of enhancement of the ambient sound signal can be achieved by setting corresponding adjustment parameters (hereinafter simply referred to as parameters) in the pass-through mode. For example, it may be assumed that the transparent transmission mode corresponds to three different sets of parameters, including a first transparent transmission parameter, a second transparent transmission parameter, and a third transparent transmission parameter. The enhancement degree of the three groups of adjustment parameters corresponding to the transparent transmission mode to the environmental sound signal can be sequentially increased.

The mode of the earphone for implementing the transparent transmission function corresponding to the transparent transmission mode may include: the headphone may process the audio signal including the ambient sound signal, e.g., enhance the ambient sound signal, using the first parameter corresponding to the pass-through mode. The headphones may then play the enhanced audio signal, which may enable the user to hear the ambient sound signal through the headphones with greater intensity than if the ambient sound signal were not heard in the pass-through mode. The first parameters are different, the enhancing degree of the earphone to the environmental sound signal is different, and the enhancing degree of the environmental sound signal heard by the user after playing is different, so that different hearing senses are realized.

It should be understood that other processing modes may be included besides the active noise reduction mode and the transparent transmission mode, and the embodiment of the present application is not limited thereto. Hereinafter, the active noise reduction mode and the transparent transmission mode will be described as examples.

(3) Target hearing sense

The target hearing sensation may be a hearing sensation set by a user through a headset or a terminal. In different earphone modes, a user can set a target audibility, and the target audibility is used for reflecting the preset processing degree of the earphone on the audio signal in the earphone mode. The target hearing sensation may also be used to indicate a desired hearing sensation for the user in the headphone mode. In the case where the user does not set the target audibility, the headphone or the terminal may set a default audibility as the target audibility. For example, the target hearing may be one of weak, medium, or strong, or one state in the process from weak to strong.

In the active noise reduction mode, a user may set a target listening sensation, that is, a degree of weakening an ambient sound signal by the earphone may be set, for example, the stronger the target listening sensation is set by the user, the stronger the processing degree of active noise reduction by the earphone is, the stronger the active noise reduction degree is set by the user, the earphone may process an audio signal (including the ambient sound signal) by using a corresponding parameter when the active noise reduction degree is stronger, so that the less the ambient sound signal heard by the user is, and when the active noise reduction degree is strongest, it may be considered that the ambient sound signal is not heard by the user; the weaker the active noise reduction degree set by the user is, the weaker the active noise reduction degree is, the more the user can hear the environmental sound signal, the more the audio signal (including the environmental sound signal) is processed by the earphone by using the corresponding parameter when the active noise reduction degree is weaker, and when the active noise reduction degree is the weakest, the earphone can be considered not to perform any noise reduction processing.

In the unvarnished transmission mode, a user may set a target listening sensation, that is, a degree of enhancing the ambient sound signal by the earphone may be set, for example, if the target listening sensation is set by the user to be stronger, the processing degree of unvarnished transmission by the earphone is stronger, the earphone may process the audio signal (including the ambient sound signal) by using a corresponding parameter when the unvarnished transmission degree is stronger, so that the ambient sound signal heard by the user may be more; the weaker the degree of unvarnished transmission set by the user, the less the ambient sound signal the user can hear can be the processed audio signal (including the ambient sound signal) by the earphone using the corresponding parameter when the degree of unvarnished transmission is weaker.

In the embodiment of the application, the earphone can realize the corresponding target listening feeling of the user in the earphone mode by setting the parameters corresponding to the earphone mode. Factors that affect the parameters corresponding to the headphone mode include, but are not limited to: one or more of a wearing condition of the user (wearing condition of the earphone) and an ear canal model of the user are explained below, taking the wearing condition of the earphone and the ear canal model as examples. Wherein, the wearing condition of the earphone and the influence of the ear canal model of the user on the hearing sense of the user can refer to the related description of the term (1) in the foregoing. For example, when the user selects the active noise reduction degree with the target hearing sense of the first degree in the active noise reduction mode, and when the user wears the headphone well, the ambient sound signal entering the ear of the user is the first ambient sound signal, and the headphone may perform noise reduction processing on the audio signal including the ambient sound signal using the parameter a corresponding to the active noise reduction mode, so that the ambient sound signal heard by the user is subjected to noise reduction of the first degree. When the user does not wear the earphone well, the ambient sound signal entering the ear is the second ambient sound signal, and referring to the content in fig. 2, it can be known that the energy of the second ambient sound signal is greater than the energy of the first ambient sound signal, if the earphone further uses the parameter a to perform noise reduction on the audio signal including the ambient sound signal at this time, the energy of the first ambient sound signal is cancelled, and the energy of the second ambient sound signal which is more than the energy of the first ambient sound signal is not cancelled. Then, under the condition that the user does not wear the earphone well, the earphone still uses the parameter a to reduce the noise of the audio signal including the ambient sound signal, and thus the noise reduction of the first degree cannot be realized, so that the ambient sound signal heard by the user is clearer compared with that when the user wears the earphone well, and the target hearing sense cannot be reached, and therefore, the parameter applied in the active noise reduction mode of the earphone needs to be reset, so that the noise reduction of the first degree can be realized by the earphone. The setting of the ear canal model to the parameters corresponding to the earphone mode can refer to the description of the wearing condition of the earphone.

Based on the foregoing description, if the target hearing sense of the user is to be achieved, the parameters corresponding to the earphone mode need to be set, and the parameters corresponding to the earphone mode may be different if the target hearing sense in the same earphone mode is to be achieved under different earphone wearing conditions and ear canal models. The earphone can determine a parameter corresponding to an earphone mode based on the wearing condition of the earphone and the ear canal model to achieve a target listening feeling in the earphone mode, and details related to the process can refer to the related description below, which will not be described here for a while.

An exemplary headset provided by embodiments of the present application is described below.

Fig. 4 is a schematic structural diagram of an earphone according to an embodiment of the present application.

It should be understood that the headset to which embodiments of the present application relate may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The headset in this embodiment of the present application may be a True Wireless Stereo (TWS) headset or another type of bluetooth headset, which is not limited in this embodiment of the present application.

In an embodiment of the present application, the headset may include: processor 151, wireless communication processing module 152, microphone set 153, and speaker 154.

Processor 151 may be configured to interpret signals received by wireless communication processing module 152. The signal includes: a request sent by the terminal to establish a connection and an ambient sound characteristic. Processor 151 may also be configured to generate signals for wireless communication processing module 152 to send out, the signals including: a request to notify the terminal of the acquisition of the ambient sound characteristics, and the like. Wherein, the environmental sound characteristics will be described in detail below, and will not be described in detail here.

A memory may also be provided in processor 151 for storing instructions. In some embodiments, the instructions may include: an instruction to determine an ambient sound characteristic using the ambient sound signal, an instruction to transmit a signal, and the like.

The wireless communication processing module 152 may include one or more of a Bluetooth (BT) communication processing module 152A, WLAN and a communication processing module 152B for providing services such as establishing a connection with a terminal and performing data transmission.

The microphone set 153 may include a feedforward microphone 153A, a feedback microphone 153B, and a call microphone 153C.

Wherein the feedforward microphone 153A may collect ambient sound signals around the headset and send them to the processor. Such that the processor may determine the ambient sound characteristic based on the ambient sound signal.

The feedback microphone 153B may collect a sound signal in the ear canal, for example, after an audio signal played by the speaker is transmitted to the ear canal, the feedback microphone may collect the audio signal, for example, the audio signal may be a prompt audio signal referred to below. The feedback microphone may also collect ambient sound signals around the headset and send them to the processor. Such that the processor may determine the ambient sound characteristic based on the ambient sound signal.

The call microphone 153C may collect an ambient sound signal around the headset and send it to the processor. Such that the processor may determine the ambient sound characteristic based on the ambient sound signal.

The speaker 154 may be used to play audio signals, such as cue audio signals. The headset may listen to music, or to a conversation through the speaker 154.

In this embodiment, the processor 151 may store computer instructions to enable the headset to execute a parameter determination method corresponding to a headset mode in this embodiment.

An exemplary terminal provided by the embodiments of the present application is described below.

Fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present application.

The following describes embodiments in detail by taking a terminal as an example. It should be understood that a terminal may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The terminal may include: the mobile terminal includes a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiments of the present application does not constitute a specific limitation to the terminal. In other embodiments of the present application, the terminal may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components may be used. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.

Wherein, the controller can be the neural center and the command center of the terminal. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only an exemplary illustration, and does not form a limitation on the structure of the terminal. In other embodiments of the present application, the terminal may also adopt different interface connection manners or a combination of multiple interface connection manners in the foregoing embodiments.

The wireless communication function of the terminal can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in a terminal may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication and the like applied on the terminal. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like.

The modem processor may include a modulator and a demodulator.

The wireless communication module 160 may provide a solution for wireless communication applied to a terminal, including a Wireless Local Area Network (WLAN) (e.g., a wireless fidelity (Wi-Fi) network), Bluetooth (BT), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module.

The internal memory 121 may include one or more Random Access Memories (RAMs) and one or more non-volatile memories (NVMs).

The terminal can implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The terminal can listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the terminal answers a call or voice information, it can answer a voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. The microphone may collect the ambient sound signal and then transmit to the processor 110 such that the processor 110 may determine an ambient sound signature based on the ambient sound signal and then transmit the ambient sound signature to the headset over a wireless network (e.g., bluetooth).

A communication system according to an embodiment of the present application will be described below.

Fig. 6 is a schematic structural diagram of a communication system according to an embodiment of the present application.

As shown in fig. 6, the communication system includes a headset and a terminal. Wherein the schematic description of the headset may refer to the previous description of fig. 4. The schematic description of the terminal may refer to the description of fig. 5 above.

The wireless network is used for providing various services, such as communication services, connection services, transmission services and the like, for the terminal and the headset related to the embodiment of the present application.

The wireless network includes: bluetooth (BT), Wireless Local Area Network (WLAN) technology, Wireless Wide Area Network (WWAN) technology, and the like.

The headset may establish a connection with the terminal through a wireless network and then perform data transmission.

For example, the terminal may search for the headset, and when the headset is found, the terminal may send a request for establishing connection to the headset, and after receiving the request, the headset may establish connection with the terminal. The headset may also transmit instructions to the terminal over the wireless network to determine the ambient sound characteristic using the ambient sound signal. The terminal may determine an ambient sound characteristic based on the ambient sound signal and then transmit the ambient sound characteristic to the headset over the wireless network.

The embodiment of the application provides a method for determining parameters corresponding to earphone modes. In the method, a mode setting database is provided in the headset. The mode setting database may include a plurality of preset playing models, wherein each preset playing model further corresponds to an earphone mode, the earphone mode further corresponds to a preset hearing sense and an adjustment parameter (hereinafter, may be referred to as a parameter), and the adjustment parameter is a parameter that the earphone mode can bring the preset hearing sense to the user under a wearing condition of the earphone and in an ear canal model. It can also be said that the mode setting database includes a plurality of preset playing models, wherein each preset playing model further corresponds to at least one parameter (adjustment parameter), and each parameter of the at least one parameter corresponds to one headphone mode and one preset listening sensation.

The preset playing model refers to a comparison relation between a prompt audio signal and a feedback audio signal before playing. The comparison relationship can be expressed as a set of frequency point energy ratios of the prompt audio signal and the feedback audio signal before playing, wherein the frequency point energy ratio is the ratio of the total energy of the frequency points with the same frequency in the prompt audio signal and the feedback audio signal before playing after the prompt audio signal and the feedback audio signal before playing are converted into the frequency domain.

The preset playing model can reflect the wearing condition of the earphone and the transmission condition of the auditory canal model of the user to the prompt audio signal (before playing), and can also reflect the wearing condition of the earphone and the auditory canal model of the user. Because the same prompt audio signal (before playing) is different from the feedback audio signal (denoted as reference audio signal 1) obtained by playing the prompt audio signal (denoted as prompt audio signal 1 before playing) by the earphone under the condition that the wearing condition of the earphone or the ear canal model is different, the preset playing models determined based on the reference audio signal 1 and the prompt audio signal 1 are different.

In some embodiments, the cue audio signal before playback may be white noise, which may be played back by a speaker of the headset. The played prompt audio signal can be transmitted in the auditory canal, and meanwhile, the played prompt audio signal can be collected by a feedback microphone of the earphone, so that a feedback audio signal is obtained. The feedback audio signal may include a prompt audio signal after being played, and may further include an ambient sound signal, and when the ambient sound signal is noisier, the more the ambient sound signal included in the feedback audio signal is, the larger the energy is.

It should be understood here that the process of determining the preset playback model by the headphones is typically performed in a quiet environment, and therefore the ambient sound signal is typically not included in the feedback audio signal involved in determining the preset playback model. The ambient sound signal does not affect the determination of the preset playback model.

One exemplary mode setting database may be referred to in table 1 below.

Preset playback model	Earphone mode	Presetting hearing sense	Adjusting parameters
				Preset playback model 1	Active noise reduction mode	In	Parameter 1
Preset playback model 1	Active noise reduction mode	High strength	Parameter 2
				Preset playback model 2	Active noise reduction mode	In	Parameter 3
Preset playback model 2	Active noise reduction mode	High strength	Parameter 4
				……	……	……	……

TABLE 1

As shown in table 1, the mode setting database includes a first preset playing model, which can reflect a first wearing condition of the earphone and a transmission condition of the prompt audio signal (before playing) when the ear canal of the user is the first ear canal model. The first preset playing model corresponds to a first earphone mode, and a corresponding parameter when the first earphone mode realizes the target listening sensation is a first parameter. For example, the first preset playing mode is a preset playing mode 1, and when the preset listening sensation in the active noise reduction mode is realized, the corresponding adjustment parameter is a parameter 1.

The first preset playing model is any one of all preset playing models included in the mode setting database. The earphone mode corresponding to the first preset playing model may be different earphone modes, such as one or more of an active noise reduction mode or a transparent transmission mode.

Based on the foregoing description, it can be known that, in the case that the mode setting database is set in the earphone, if it can be determined that the wearing condition of the earphone by the user and the ear canal model of the user are most similar to the wearing condition of the earphone and the ear canal model reflected by the preset playing model a, that is, the preset playing model a is the best matching preset playing model. And under the condition that the earphone mode and the target listening sensation are determined, determining parameters corresponding to the earphone mode and the target listening sensation based on the best matched preset playing model as parameters of the earphone mode to process the audio signal, so that the user can realize the target listening sensation.

The foregoing related descriptions regarding the earphone mode, the adjustment parameters, the ear canal model, the wearing condition of the earphone, and the target hearing sensation may refer to the foregoing related descriptions of terms.

After the user wears the earphone, the earphone mode of the earphone is usually set, then the earphone plays the prompt audio signal to prompt the user that the earphone is worn, and after the earphone plays the prompt audio signal, the feedback microphone can collect the played prompt audio signal to obtain the reference audio signal. The headphone may determine a target playback model based on the reference audio signal and the cue audio signal before playback, and then determine a preset playback model in the pattern database that best matches the target playback model based on the target playback model. Then, the earphone determines the corresponding parameters when the best matched preset playing model realizes the target listening sensation in the earphone mode.

It should be understood that, since the process of determining the preset playing model is usually performed in a quiet environment, the earphone is often interfered by an ambient sound signal when determining the target playing model in the actual process. This interference is manifested in: when the earphone plays the prompt audio signal, the played prompt audio signal is transmitted in the ear canal, so that the feedback microphone can collect the played prompt audio signal to obtain a feedback audio signal, but since a part of the environmental sound signal in the environmental sound signal (external, for example, around the earphone) also enters the ear canal, the feedback audio signal acquired by the feedback microphone may include the part of the environmental sound signal entering the ear canal, and the environmental sound signal entering the ear canal may be referred to as a feedback environmental sound signal. Because the feedback audio signal includes not only the played prompt audio signal but also the feedback environment sound signal (when the environment sound signal is noisier, the more the feedback environment sound signals included in the feedback audio signal are, the larger the energy is), the target playing model is calculated by using the feedback audio signal, which is inaccurate and interfered by the feedback environment sound signal. The interference of the ambient sound signal with the generation of the target playback model can be reduced by adjusting the energy of the cue audio signal included in the feedback audio signal so that it is greater than the energy of the feedback ambient sound signal, thereby reducing the energy ratio of the feedback ambient sound signal to the reference adjustment cue audio signal. The default cue audio signal may be adjusted in the process of determining the target playback model to reduce the interference of the ambient sound signal, which may be described with reference to the following description.

The headset may capture an ambient sound signal, convert it to a first ambient audio signal, and then determine an ambient sound characteristic based on the first ambient audio signal. This environment sound characteristic can reflect the noisy degree of environment (can reflect the energy size of environment sound signal, can also include the energy distribution of environment sound signal at different frequency channels), and the earphone can adjust the suggestion audio signal of acquiescence based on this environment sound characteristic for the suggestion audio signal after the adjustment can change along with the noisy degree of environment (can change along with the energy of environment sound signal), and this change includes: when the environment is noisy (i.e., the energy of the environmental sound signal is larger), the energy of the adjusted prompt audio signal may become larger relative to the energy of the default prompt audio signal, so that the decibel (energy) of the adjusted prompt audio signal heard by the user is larger relative to the default prompt audio signal. The adjusted prompt audio signal has an increased energy relative to the default prompt audio signal, and the energy of the feedback environment sound signal included in the feedback audio signal obtained by playing the adjusted prompt audio signal can be smaller than the energy of the prompt audio signal included in the feedback audio signal, so that the feedback audio signal mainly includes the prompt audio signal and is not influenced by the environment sound signal. When the environment is quiet (i.e. the energy of the ambient sound signal is smaller), the energy of the adjusted prompting audio signal can be reduced relative to the energy of the default prompting audio signal, so that the decibel (energy) of the adjusted prompting audio signal heard by the user is moderate, and discomfort caused by the large energy of the prompting audio signal can be avoided.

The environmental sound characteristics may include one or more of energy ratios of the environmental sound signals in different frequency bands in the first environmental audio signal, absolute energy of the environmental sound signals, and relative energy of the environmental sound signals, and for the description of the environmental sound audio characteristics, reference may be made to the detailed description of step S102 in the following, which is not repeated herein.

The energy of the ambient sound signal may be characterized by an absolute energy as well as a relative energy of the ambient sound signal comprised in the ambient sound feature. Wherein, the energy can be used to represent the corresponding voltage magnitude of the audio signal; may also represent the magnitude of the audio signal; or decibel magnitude.

It should be understood that the ambient sound characteristics referred to herein are the same as the target ambient sound characteristics referred to below.

Fig. 7 is a schematic flowchart of a parameter determination method corresponding to an earphone mode in the embodiment of the present application.

In the embodiment of the present application, the earphone determines an earphone mode and a parameter corresponding to the earphone mode, and reference may be made to the following description of step S101 to step S111 for a process of processing an audio signal to display a target listening sensation based on the earphone mode and the parameter corresponding to the earphone mode.

S101, after the earphone is determined to be out of the box, the earphone acquires a first environment audio signal.

The first environment audio signal is an audio signal converted from an environment sound signal collected by a microphone of the earphone in a first time period, and the first environment audio signal comprises X frames of audio signals, wherein X is a positive integer greater than or equal to 1. The first ambient audio signal may comprise an ambient sound signal.

The first time period is a period of time after the earphone determines the box, for example, 0.5S, 1S, or 2S, and the like.

The microphone may be any one of microphones in the headset, for example, any one of a feedforward microphone, a feedback microphone, and a call microphone, which is not limited in this embodiment of the present application.

Specifically, during the first time period, the microphone of the headset may collect an ambient sound signal and then convert the ambient sound signal into an analog electrical signal. The analog electrical signal is then sampled by the headset and converted to an audio signal in the time domain. The audio signal in the time domain is a digital audio signal and is sampling points of W analog electrical signals. The first ambient audio signal may be represented in an array, where any element in the array is used to represent a sampling point, and any element includes two values, where one value represents time, and the other value represents the amplitude of the audio signal corresponding to the time, and the amplitude is used to represent the voltage magnitude corresponding to the audio signal.

It should be understood that in case the headset is configured with a charging box (which may also be referred to as a charging compartment or a housing box, etc.), this step S101 may be performed to acquire the first ambient audio signal. In case the headset is not provided with a charging box, further steps may be performed to acquire the first ambient audio signal, e.g. when the headset detects an in-ear operation, the headset may be triggered to acquire the first ambient audio signal.

The earphone determining out-of-box is that the earphone detects out-of-box operation, that is, the earphone detects that the earphone leaves the charging box, and the earphone determines that the earphone leaves the charging box at the time including, but not limited to, the following:

timing 1: when the earphone is placed in the charging box, the earphone can be connected with the metal probe in the charging box through the connecting contact so as to realize that the charging box can be charged with the earphone and other operations, when the earphone detects that the connecting contact is separated from the metal probe, the earphone can determine that the earphone leaves the charging box, in response to the operation of the discharging box, the earphone can start to collect the environment audio signal, the earphone is converted into an electric signal to serve as a first environment audio signal, and then the first environment audio signal comprises the environment audio signal. Wherein, in some possible cases, the connection contact may be disposed on a surface of the earphone, and the metal probe may be disposed on an inner wall of the charging box.

Timing 2: when the headset detects that charging is stopped, the headset may determine that the headset is out of the box, and the headset may acquire the first ambient audio signal.

This step S101 is optional, and may, in some possible cases, trigger the headset to acquire the first ambient audio signal when the headset detects an in-ear operation.

S102, the earphone determines a first environment sound characteristic based on the first environment audio signal.

In step S102, the headphone may convert the first ambient audio signal from the time domain to the frequency domain, resulting in a first ambient audio signal in the frequency domain. A first ambient sound feature is then calculated based on the first ambient audio signal in the frequency domain. In one possible implementation, the headphone may convert the first ambient audio signal from the time domain to the frequency domain using a Fast Fourier Transform (FFT).

It should be understood that the first ambient audio signal in the time domain and the first ambient audio signal in the frequency domain differ only in representation form, but are both the first ambient audio signal comprising the ambient sound signal.

Any frame of the environmental audio signal in the first environmental audio signal in the frequency domain may be represented as N (N is an integer power of 2) frequency points, for example, N may be 1024, 2048, and the like, and the specific size may be determined by the computing power of the headset. The N frequency bins are used to represent audio signals within a certain frequency range, for example, between 0khz and 15khz, or other frequency ranges. It can also be understood that the frequency point refers to information of the first environmental audio signal at a corresponding frequency, where the information includes time, frequency of the environmental sound signal, and energy (decibel or amplitude) of the environmental sound signal, where the energy can be used to represent a voltage magnitude corresponding to the environmental sound signal; may also represent the magnitude of the amplitude of the ambient sound signal; or decibel magnitude of the ambient sound signal. The frequency distribution of the N frequency points in any two frames of the environmental audio signals is the same, that is, the frequency of the ith frequency point of the jth frame of the audio signal in the first environmental audio signal is the same as the frequency of the ith frequency point of the (j + 1) th frame of the audio signal.

Fig. 8 shows a first ambient audio signal in the frequency domain.

The first ambient audio signal in the frequency domain may include therein an audio signal in the X frame frequency domain. The audio signal in any frame frequency domain can be N frequency points. For example, the region 801 includes N frequency points corresponding to a first frame of audio signal in the first environmental audio signal, the region 802 includes N frequency points corresponding to a second frame of audio signal in the first environmental audio signal, and the region 803 includes N frequency points corresponding to an xth frame of audio signal in the first environmental audio signal.

An exemplary ambient sound characteristic is described in conjunction with fig. 8.

The first ambient sound characteristic may comprise one or more of an absolute energy of the ambient sound signal in the first ambient audio signal, an energy content of the ambient sound signal in different frequency bands, and a relative energy of the ambient sound signal.

It should be appreciated that the first ambient sound characteristic may reflect the degree of ambient noisiness. Can be represented as follows: the larger the absolute or relative energy, the noisier the environment. The energy ratio of the environmental sound signal in different frequency bands shows the energy distribution condition of the environmental sound in different frequency bands.

The absolute energy of the ambient sound signal in the first ambient audio signal includes energy of all frequency points in the first ambient audio signal in the frequency domain, which describes the energy of the ambient sound signal in the first ambient audio signal. Wherein the correlation formula for the earphone to determine the absolute energy of the ambient sound signal in the first ambient audio signal may refer to the following formula (1).

Where T represents the absolute energy of the ambient sound signal in the first ambient audio signal. w = { w ∈ N + |1 ≦ w ≦ X }, the first environment audio signal includes an audio signal in the X frame frequency domain, and S (w) represents energy of a w-th frame audio signal (in the frequency domain) in the first environment audio signal. The energy of the w frame audio signal may be the sum of the energy of each frequency point.

The energy content ratios of the ambient sound signal in the different frequency bands in the first ambient audio signal comprise an energy content ratio of the first frequency band. The first frequency band is one of the frequency bands obtained by dividing the frequency of the first environmental audio signal into different frequency bands, and one frequency band is a sub-interval of the frequency of the environmental audio signal. As shown in fig. 8, the first frequency band may be represented as a frequency w ₁ To a frequency w ₂ The energy ratio of the first frequency band represents the frequency w in the first environment audio signal ₁ To w ₂ The audio signal of (2) includes the ratio of the energy of all frequency points to the absolute energy. The frequency is w ₁ To w ₂ Comprises a frequency w in each frame of the first ambient audio signal ₁ To w ₂ The audio signal of (1). The formula for the earphone to determine the energy ratio of the ambient sound signal in the first frequency band in the first ambient audio signal may refer to the following formula (2).

In formula (2), P (w) ₁ ~w ₂ ) Representing the energy content of the ambient sound signal in the first frequency band in the first ambient audio signal. S (w) ₁ ~w ₂ ) Representing a frequency w in the first ambient audio signal ₁ To w ₂ May be the frequency w of the first ambient audio signal ₁ To w ₂ The sum of the energy of each frequency point in the audio signal.

The relative energy of the ambient sound signal in the first ambient audio signal includes energy weighted by all frequency points in the first ambient audio signal in the frequency domain. Because the human ear is sensitive to audio signals of different frequencies or experiences subjectively differently. Therefore, the energy of the audio signals of different frequencies needs to be weighted and corrected, so that the audio signal with higher ear sensitivity is weighted (which can be understood as weight) more, and the energy of the audio signal with higher ear sensitivity contributes to the relative energy more. Wherein the correlation formula for the earphone to determine the absolute energy of the ambient sound signal in the first ambient audio signal may refer to the following formula (3).

Where H represents the relative energy of the ambient sound signal in the first ambient audio signal. w = { w ∈ N + |1 ≦ w ≦ X }, the first environment audio signal includes an audio signal in the X frame frequency domain, and S × F _ weight (w) represents weighted energy of the w frame audio signal (in the frequency domain) in the first environment audio signal. The weighted energy of the w-th frame of audio signal may be the sum of the weighted energy of each frequency point. F _ weight is a weighting filter, and the weighting filter is used for weighting the energy of the frequency points in the w-th frame of audio signal and adjusting the energy of the frequency points with different frequencies, so that the more sensitive the human ear is, the greater the energy of the frequency points with the higher contribution to the relative energy is.

In some possible implementations, the first ambient sound characteristic acquired in step S102 may be used for determining the target ambient sound characteristic in step S105 described below. The target ambient sound characteristic may be used by the headphones to reflect the degree of ambient noisiness. The accuracy and the robustness of the noise degree of the environment reflected by the target environment sound characteristics are improved. The second environment sound characteristics can be determined through a second environment audio signal acquired by the terminal, and then the earphone can acquire the second environment sound characteristics and determine the target environment sound characteristics based on the combination of the first environment sound characteristics and the second environment sound characteristics. The process can refer to the following description of step S103 to step S105.

And S103, the earphone informs the terminal to acquire the second environment sound characteristic, and the terminal is connected with the earphone.

This step S103 is optional.

The headset determines a terminal connected to the headset (for example, connected by bluetooth or the like), and transmits a notification of acquiring the second ambient sound characteristic to the terminal, so that the terminal performs the following step S104.

It should be understood that the execution sequence of step S102 and step S103 is not sequential, the earphone may execute step S102 and then step S103, may execute step S103 and then step S102, or may execute step S103 and then step S102 at the same time, which is not limited in this embodiment of the application.

And S104, the terminal acquires a second environment audio signal, determines a second environment sound characteristic based on the second environment audio signal and sends the second environment sound characteristic to the earphone.

In the case where the aforementioned step S103 is performed, the terminal may perform step S104.

The second environment audio signal is an audio signal converted from an environment sound signal collected by a microphone of the terminal in a second time period, and the second environment audio signal includes L frames of audio signals, where L is a positive integer greater than or equal to 1. The second ambient audio signal may include an ambient sound signal. The second ambient audio signal may be the same or different from the aforementioned number of frames of audio signals comprised in the first ambient audio signal referred to.

The second time period may be the same as or different from the first time period. The second time period is a period of time after the terminal determines that the earphone is out of the box. For example, 0.5S, 1S, or 2S, etc., and the length of the second time period is not limited in the embodiments of the present application, and may be adjusted according to actual situations.

The microphone may be any one of microphones in the terminal, for example, any one of a top microphone, a bottom microphone, and a back microphone, which is not limited in this embodiment of the present application.

The process of determining the second environmental sound characteristic by the terminal based on the second environmental audio signal is the same as the process of determining the first environmental sound characteristic by the earphone based on the first environmental audio signal, and reference may be made to the related description in step S102, which is not repeated herein.

It should be understood that the second ambient sound characteristic may include one or more of an absolute energy of the ambient sound signal in the second ambient audio signal, an energy content of the ambient sound signal in different frequency bands, and a relative energy of the ambient sound signal. The second ambient sound characteristic and the first ambient sound characteristic may both reflect the degree of ambient noisiness. The detailed description of the second ambient sound characteristic may refer to the aforementioned exemplary description of the first ambient sound characteristic, and will not be described herein.

And S105, determining a target environment sound characteristic based on the first environment sound characteristic and the second environment sound characteristic or determining a target environment sound characteristic based on the first environment sound characteristic by the earphone, wherein the target environment sound characteristic can reflect the environment noisiness degree.

The target environment sound characteristics may reflect that the degree of noisiness of the environment appears as: the larger the absolute energy and/or relative energy of the ambient sound signal in the target ambient sound feature, the noisier the environment. The smaller the absolute energy and/or relative energy of the ambient sound signal in the target ambient sound signature, the quieter the environment.

In case the terminal does not perform the aforementioned steps S103 and S104, then in step S105, the headset may determine the target ambient sound characteristic based on the first ambient sound characteristic. In particular, the earpiece may determine the first ambient sound characteristic as the target ambient sound characteristic.

If the terminal performs the aforementioned steps S103 and S104, then in step S105, the headset may determine the target ambient sound characteristic based on the first ambient sound characteristic and the second ambient sound characteristic. The process of determining the target ambient sound characteristic by the headset may refer to the following description.

In some possible cases, the earphone may determine, as the target ambient sound characteristic, that the absolute energy or the relative energy is greater in the first ambient sound characteristic and the second ambient sound characteristic.

In other possible cases, the headphone may perform fusion after setting different weights based on the first ambient sound characteristic and the second ambient sound characteristic, and use the result of the fusion as the target ambient sound characteristic.

In particular, the earphone may further use the first ambient sound characteristic or the second ambient sound characteristic as the target ambient sound characteristic in a case where the first ambient sound characteristic is the same as the second ambient sound characteristic.

And S106, the earphone detects the operation of selecting the earphone mode, and determines the earphone mode and a default prompting audio signal corresponding to the earphone mode.

This step S106 is optional.

The default cue audio signals for different headphone modes may be different and may be related to their corresponding headphone modes. For example, the default cue audio signal corresponding to the active noise reduction mode may be: "selected active noise reduction mode", etc. The default prompt audio signal corresponding to the pass-through mode may be: "selected pass-through mode", etc. The default prompting audio signal is used to prompt the user that the headset is worn or the headset mode of the headset is available, and the specific content of the embodiment of the present application is not limited.

In one possible implementation, the headset may provide a way for the user to select the headset mode. For example, the contacts involved in selecting the headset mode are set on the headset. The contact may be used to detect the operation involved when the user selects the headset mode. For example, the headset may be configured such that when it is detected that the user touches the contact twice in succession, the headset mode selected by the user may be determined to be the active noise reduction mode; when the touch point is detected to be touched by the user three times continuously, the earphone mode selected by the user can be determined to be the transparent transmission mode and the like. The continuous time refers to a time interval between two adjacent touch contacts being within a preset time threshold, for example, 0.5 s. Wherein the user touching the contact point may comprise clicking the contact point.

The headset detects an operation of selecting a headset mode, and in response to the operation, a headset mode corresponding to the operation may be determined. The headset may then determine a default cue audio signal corresponding to the headset mode.

It should be understood that, in some possible cases, if step S106 is not performed, that is, the user does not select the earphone mode, the earphone may select one earphone mode (hereinafter, may be referred to as earphone mode a) from the plurality of earphone modes as the earphone mode of the earphone, and select a default prompt audio signal corresponding to the earphone mode a. The earphone mode a may be the earphone mode selected by the user last time, or may be the earphone mode used by the user for the longest time within a certain period of time (e.g., 10 days).

In other possible cases, if step S106 is not performed. The headset may not select any headset mode, and the default alert audio signal may not be associated with any headset mode, which serves to alert the user that the headset is worn. At this time, the default cue audio signal may be a "ding" or other content.

And S107, the earphone adjusts the default prompting audio signal based on the sound characteristics of the target environment to obtain an adjusted prompting audio signal, and the adjusted prompting audio signal can change along with the noisy degree of the environment.

The energy (decibel) of the default cue audio signal is recorded as the first energy, and the default cue audio signal is suitable for the hearing sense of most users when the ambient noise degree is moderate (namely between the quiet and the noisy environment). For example, when the ambient noise level is moderate, the energy of the ambient sound signal may be considered to be greater than or equal to the first energy threshold and less than or equal to the second energy threshold. The environment is quiet if the energy of the ambient sound signal is less than or equal to the first energy threshold. The environment is noisy if the energy of the ambient sound signal is greater than or equal to the second energy threshold. The larger the energy of the ambient sound signal, the noisier and quieter. Wherein the energy of the ambient sound signal may be characterized by an absolute energy or a relative energy of the ambient sound signal comprised in the target ambient sound feature: the energy of the ambient sound signal may be an absolute energy or a relative energy of the ambient sound signal included in the target ambient sound characteristic. The energy of the ambient sound signal may also be a target energy obtained by combining absolute energy and relative energy of the ambient sound signal included in the target ambient sound characteristic. The combination may be such that the absolute energy and the relative energy are added after setting different weights.

It should be understood that the adjusted cue audio signal and the default cue audio signal may include Y frames of audio signals. Wherein Y is a positive integer of 1 or more.

However, when the environment is noisy, the environment sound signal may affect listening of the user when the earphone plays the environment prompt audio signal again, so that the user cannot clearly hear the default prompt audio signal, and the default prompt audio signal is played when the environment is noisy, and the influence of the environment sound signal is also received, so that the generated playing model is inaccurate, and the earphone cannot determine the parameters corresponding to the earphone mode based on the playing model to achieve the target listening feeling. This part is described in detail above and will not be described in detail here. When the environment is quiet, the earphone plays the environment prompt audio signal again, so that the user feels that the energy of the default prompt audio signal is too large, and the hearing sense is influenced.

The earphone adjusting the default cue audio signal may thus include the following two ways.

Mode 1: in the case of a noisy environment, the headphones may adapt the default cue audio signal to the target ambient sound characteristics. The adaptation is adapted to adjust the energy content of the default prompt audio signal in the different frequency bands to correlate with the energy content of the ambient sound signal in the different frequency bands comprised in the target ambient sound characteristic. At the same time, the energy of the default cue audio signal is increased from a first energy to a second energy, the second energy being greater than the energy of the feedback ambient sound signal. One way to increase the energy of the default cue audio signal from the first energy to the second energy is to increase the energy of the frequency bins of different frequencies in the default cue audio signal by the same value. In this method, the energy gain (here, the degree of gain increase) of different frequency points is determined by the absolute energy and the relative energy of the environmental sound signal included in the target environmental sound feature, and the larger the absolute energy and/or the relative energy is, the larger the energy of the feedback environmental sound signal is, the larger the energy gain of different frequency points is. In another mode, the default prompting audio signal may have different frequency point energy increase degrees in different frequency bands.

Wherein the energy-to-energy ratio correlation comprises: the energy ratio of the default cue audio signal in the different frequency bands is adjusted to be the same as the energy ratio of the ambient sound signal in the different frequency bands included in the target ambient sound characteristic, or the default prompting audio signal energy ratio in different frequency bands is adjusted to have corresponding relation with the environment sound signal energy ratio in different frequency bands included in the target environment sound characteristic, for example, the different frequency bands are divided into a first frequency band, a second frequency band or a third frequency band, the energy ratio of the audio signal in the ambient sound signal in the first frequency band is maximum, the energy ratio in the second frequency band is minimum, and the energy ratio in the third frequency band is minimum, the energy content ratio of the first frequency band in the adjusted prompt audio signal may also become maximum but may not be the same as the energy content ratio of the first frequency band in the ambient sound signal, the energy content of the third frequency band in the adjusted prompt audio signal is minimal but may not be the same as the energy content of the third frequency band in the ambient sound signal. It should be understood that the different frequency bands may include more frequency bands besides the first frequency band, the second frequency band and the third frequency band, and the embodiment of the present application is not limited thereto.

Wherein the energy of the feedback sound signal can be used to characterize the energy level of the ambient sound signal in the ear canal, and the energy of the feedback ambient sound signal can be determined in a manner including, but not limited to, the following manners:

(1) during the third time period, a microphone (e.g., a feedback microphone) of the earphone may capture an ambient sound signal in the ear canal, resulting in a feedback ambient audio signal, and an energy level of the feedback ambient audio signal may be determined based on the feedback ambient audio signal. The third time period may be a time period before the adjusted prompt audio signal is played by the earphone.

(2) The determination may be made based on the energy of the ambient sound signal, the greater the energy of the feedback ambient sound signal. For example, the earphone may determine that the energy of the feedback environment sound signal may be K times the energy of the environment sound signal, and a value of K may be adjusted according to an actual situation. Wherein the energy of the ambient sound signal may be characterized by an absolute energy as well as a relative energy of the ambient sound signal comprised in the target ambient sound feature. For example, the target energy obtained by combining the absolute energy and the relative energy of the ambient sound signal included in the target ambient sound characteristic may be used. The combination may be such that the absolute energy and the relative energy are added after setting different weights. Wherein, the energy can be used to represent the corresponding voltage magnitude of the audio signal; may also represent the magnitude of the audio signal; or decibel magnitude.

Under the circumstance that the environment is noisy, the earphone adjusts the default prompt audio signal based on the sound characteristics of the target environment to obtain a correlation formula of the adjusted prompt audio signal, which can refer to the following formula (4).

Wherein S is _tishi Representing the adjusted prompt audio signal, S _pri Indicating a default prompt audio signal, S _pri* F_tishi[P（w ₁ ~w ₂ ）]The energy of different frequency bands of the default prompting audio signal is adjusted according to the energy of different frequency bands in the environment sound signal included by the target environment sound characteristic, so that the energy ratio of the adjusted prompting audio signal in different frequency bands is related to the energy ratio of the target environment sound characteristic in different frequency bands. And G (T, H) represents that energy gains of different frequency points in the default prompting audio signal are determined based on the absolute energy and the relative energy of the environment sound signal included in the target environment sound characteristic. The larger the absolute energy and/or the relative energy is, the larger the energy of the feedback environment sound signal is, and the larger the energy gain of different frequency points is.

Fig. 9 is a schematic diagram illustrating adjustment of the default cue audio signal in case of noisy environment in the mode 1.

As shown in fig. 9, the energy of the default cue audio signal is a first energy, and the energy of the adjusted cue audio signal is a second energy, which is greater than the first energy. The energy ratio of different frequency bands in the adjusted prompt audio signal is the same as that of the environmental sound signal. And the energy of the adjusted prompt audio signal is greater than the energy of the ambient sound signal.

In case of a quiet environment, the headphones may adapt the default cue audio signal to the target ambient sound characteristics. The adaptation is to adjust the energy content ratio of the default cue audio signal in different frequency bands to be the same as the target ambient sound characteristic. At the same time, the energy of the default cue audio signal is reduced from the first energy to the third energy.

Under the condition of moderate environment, the earphone can adjust the default prompting audio signal or not, and the embodiment of the application does not limit the default prompting audio signal.

Mode 2: in the case of a noisy environment, the headphones may increase the energy of the default cue audio signal from a first energy to a third energy, which is greater than the energy of the ambient sound signal. At this time, the energy ratio of the default prompt audio signal in different frequency bands is not adjusted. One way to increase the energy of the default cue audio signal from the first energy to the third energy is to increase the energy of the frequency bins of different frequencies in the default cue audio signal by the same value. In this method, the different-bin energy gain (here, the degree of gain increase) is determined by the absolute energy and the relative energy of the ambient sound signal included in the target ambient sound feature, and the larger the absolute energy and/or the relative energy is, the larger the different-bin energy gain is. In another mode, the default prompting audio signal may have different frequency point energy increase degrees in different frequency bands.

Fig. 10 is a schematic diagram illustrating adjustment of the default cue audio signal in case of noisy environment in the mode 2.

As shown in fig. 10, the energy of the default cue audio signal is a first energy, and the energy of the adjusted cue audio signal is a third energy, which is greater than the first energy. The adjusted energy ratios of different frequency bands in the cue audio signal are not adjusted, and may be the same as the default cue audio signal in some possible implementations. And the energy of the adjusted prompt audio signal is greater than the energy of the ambient sound signal.

In the case of a quiet environment, the headphones may decrease the energy of the default cue audio signal from the first energy to the third energy.

Under the moderate circumstances of environment, the earphone can adjust the default prompting audio signal, also can not adjust, and this application embodiment does not limit this.

Thus, in the case of noisy environment, the energy of the adjusted prompt audio signal may become larger and greater than the energy of the ambient sound signal. In the case of a quiet environment, the energy of the default cue audio signal may become small.

And S108, after the earphone is confirmed to be in the ear, playing the adjusted prompt audio signal, and acquiring the played prompt audio signal by the earphone through a microphone to obtain a feedback audio signal.

The microphone may be a feedback microphone of the earphone, since the feedback microphone is close to the ear canal, the sound signal transmitted in the ear canal may be better picked up.

In fig. 11, an icon 101 is a speaker of the earphone, an icon 102 is a feedback microphone of the earphone, and an icon 103 is a cue audio signal (adjusted) transmitted in the ear canal.

After the earphone is determined to be in the ear, the earphone may play the adjusted cue audio signal by using the speaker, and the played cue audio signal (adjusted) may be transmitted in the ear canal, as shown by an icon 103 in fig. 11, which is an exemplary case when the played cue audio signal (adjusted) may be transmitted in the ear canal. The (adapted) cue audio signal transmitted in the ear canal can then be picked up by the earphone via the feedback microphone to obtain a feedback audio signal. In some possible cases, the feedback audio signal may also include an ambient sound signal. However, the energy of the cue audio signal included in the feedback audio signal is greater than the energy of the ambient sound signal, the interference of the ambient sound signal with the target playback model can be reduced in the process of determining the target playback model in step S109 described below.

And S109, the earphone determines a target playing model based on the adjusted prompt audio signal and the adjusted feedback audio signal, wherein the target playing model can reflect the wearing condition of the earphone and the ear canal model of the user.

The target playing model refers to a comparison relation between the adjusted prompt audio signal and the feedback audio signal.

In a possible implementation manner, the comparison relationship may be a set of the adjusted prompt audio signal and the adjusted frequency point energy ratio in the feedback audio signal. The frequency point energy ratio is the ratio of the total energy of the frequency points with the same frequency in the adjusted prompt audio signal and the feedback audio signal after the adjusted prompt audio signal and the feedback audio signal are converted to the frequency domain.

The earphone can convert the adjusted prompt audio signal and the feedback audio signal to the frequency domain. And obtaining the adjusted prompt audio signal in the frequency domain and the feedback audio signal in the frequency domain. The adjusted cue audio signal in the frequency domain may be referred to as an adjusted cue audio signal hereinafter, and the feedback audio signal in the frequency domain may be referred to as a feedback audio signal hereinafter. Any frame of audio signals in the adjusted prompt audio signal (in the frequency domain) and the feedback audio signal (in the frequency domain) can be represented as N (N is an integer power of 2) frequency points, for example, N may be 1024, 2048, and the like, and the specific size may be determined by the computing power of the headset. The N frequency bins are used to represent audio signals within a certain frequency range, for example, between 0khz and 15khz, or other frequency ranges. It can also be understood that the frequency point refers to information of audio signals (including cue audio signals and ambient sound signals) at corresponding frequencies, the information includes time, frequency of the audio signals, and energy (decibel or amplitude) of the audio signals, wherein the energy can be used to represent the corresponding voltage of the audio signals; may also represent the magnitude of the audio signal; or decibel magnitude of the audio signal. The frequency distribution of the N frequency points in any two frames of audio signals is the same. For example, the frequency of the ith frequency point of the jth frame of audio signal in the feedback audio signal is the same as the frequency of the ith frequency point of the jth +1 frame of audio signal.

Any frame of audio signals in the adjusted prompt audio signal and the feedback audio signal can be represented as N (N is an integer power of 2) frequency points, and the target playing model includes N energy ratios. The method comprises a first total energy ratio which is the ratio of the total energy of all frequency points of the first frequency in the adjusted prompt audio signal to the total energy of all frequency points of the first frequency in the feedback audio signal. The first frequency is one of N frequencies corresponding to N frequency points in a frame of audio signal.

It should be understood that the target playback model may reflect the wearing conditions of the earphone and the ear canal model of the user. It can also be said that the target playback model may reflect the wearing conditions of the earphone and to which ear canal model the ear canal of the user belongs. Because of the same cue audio signal (adjusted), when the wearing condition of the earphone or the ear canal model is different, the feedback audio signal (denoted as the reference audio signal 2) obtained by the earphone playing the cue audio signal (adjusted, denoted as the cue audio signal 2) is different, and the target playing models determined based on the reference audio signal 2 and the cue audio signal 2 are different.

It should be understood that in other cases, the comparison may be of other content. For example, the ratio of the total energy of all frequency points of the feedback audio signal to the total energy of all frequency points of the adjusted prompt audio signal may be used. And the set of the adjusted prompt audio signal and the feedback audio signal frequency point energy ratio can also be used on part of frequency bands. The embodiments of the present application do not limit this.

S110, the earphone is matched with a preset playing model in a mode setting database based on the target playing model, the preset playing model matched with the target playing model in the mode setting database is determined, and an earphone mode corresponding to the matched preset playing model and parameters corresponding to the earphone mode are determined.

The mode setting database can comprise a plurality of preset playing models, wherein each preset playing model is also corresponding to an earphone mode, the earphone mode is also corresponding to preset auditory sensations and adjustment parameters, and the adjustment parameters are parameters which can be brought to a user by the earphone mode under one wearing condition of the earphone and one auditory canal model when the auditory sensations are preset. It can also be said that the mode setting database includes a plurality of preset playing models, wherein each preset playing model further corresponds to at least one parameter (adjustment parameter), and each parameter of the at least one parameter corresponds to one headphone mode and one preset listening sensation.

The detailed description of the mode setting data and the preset playback model therein may refer to the foregoing exemplary description of table 1 and related contents.

In the case that the foregoing step S106 is executed, after the earphone determines the earphone mode, the target auditory sensation corresponding to the earphone mode may be determined. The target hearing may be set by the user, and a default target hearing may be set in the case where the user does not set the target hearing. The description of the target hearing may refer to the foregoing exemplary description of term (3), which is not repeated herein. At this time, the earphone may determine, based on the preset playing model matched with the target playing model, a parameter corresponding to the matched preset playing model in combination with the earphone mode and the target listening sensation corresponding to the earphone mode. The parameters also correspond to the headphone mode and the target hearing sensation.

In the case that the foregoing step S106 is not executed, the earphone determines the earphone mode corresponding to the matched preset playing model and the parameters corresponding to the earphone mode, including but not limited to the following manners.

Mode 1: the earphone can select one earphone mode from a plurality of earphone modes, and the target hearing sense corresponding to the earphone mode is determined. Then, the earphone may determine, based on the preset playing model matched with the target playing model, a parameter corresponding to the matched preset playing model in combination with the earphone mode and the target listening sensation corresponding to the earphone mode. The parameters also correspond to the headphone mode and the target hearing sensation.

Mode 2: and the earphone determines all parameters corresponding to the matched preset playing model. Determining parameters meeting a first preset condition, wherein the first preset condition is as follows: the earphone mode corresponding to the parameter meets a second preset condition and the preset auditory sensation corresponding to the parameter meets a third preset condition. Wherein the second preset condition is as follows: the earphone mode corresponding to the parameter is the earphone mode selected by the user last time, and the earphone mode with the longest use time of the user in a period of time (for example, 10 days) can also be used. The third preset condition is that the preset auditory sensation corresponding to the parameter is the target auditory sensation set by the user or the preset auditory sensation corresponding to the parameter is the default target auditory sensation when the target auditory sensation is not set by the user.

It should be understood that the number of energy ratios included in any one of the preset playback models and the target playback model is the same. Here we assume that there are N energy ratios. The manner in which the headphone determines the preset playback model in the pattern setting database that matches the target playback model can refer to the following description.

Firstly, the earphone calculates the total difference value of N energy ratio values in the target playing model and different preset playing models. The different preset playing models comprise a first preset playing model, and the total difference value of the N energy ratio values in the target playing model and the first preset playing model comprises: and the sum of the absolute values of the difference values of the N corresponding energy ratios included in the target playing model and the first preset playing model. Any one of the N corresponding energy ratios is an ith energy ratio in the target play model and an ith energy ratio in the first preset play model. The first preset playing model is any one of all preset playing models included in the mode setting database.

Then, the earphone determines the total difference value meeting a fourth preset condition from the total difference value of the target playing model and the N energy ratios of all the preset playing models, and determines the preset playing model corresponding to the total difference value meeting the fourth preset condition as the preset playing model matched with the target playing model.

In some possible cases, the fourth preset condition is that the total difference between the N energy ratios in the matched preset playing model and the target playing model is the minimum total difference.

In other possible cases, the fourth preset condition is that a total difference between the N energy ratios in the matched preset playing model and the target playing model is less than or equal to the first difference threshold.

And S111, the earphone processes the audio signal based on the earphone mode corresponding to the matched preset playing model and the parameter corresponding to the earphone mode.

The earphone can process the audio signal based on the earphone mode corresponding to the matched preset playing model and the parameter corresponding to the earphone mode, so that the processing degree of the earphone on the audio signal can reach the preset processing degree, and a user can obtain the target listening feeling. The process of processing the audio signal by the earphone to obtain the target hearing sensation can refer to the foregoing description in term (2) and term (3), and is not described herein again.

It should be understood that the step in which the execution main body is the earphone in the aforementioned steps S101 to S111 may replace the execution main body with the terminal, and the terminal may transmit the execution result of the step to the earphone. For example, the headset may transmit a first ambient audio signal to the terminal, the terminal may determine a first ambient sound characteristic based on the first ambient audio signal, determine a target ambient sound characteristic based on the first ambient sound characteristic and a second ambient sound characteristic, and so on.

In the embodiment of the present application, the first energy threshold may also be referred to as a second threshold, and the second energy threshold may also be referred to as a first threshold.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to a determination of …" or "in response to a detection of …", depending on the context. Similarly, depending on the context, the phrase "at the time of determination …" or "if (a stated condition or event) is detected" may be interpreted to mean "if the determination …" or "in response to the determination …" or "upon detection (a stated condition or event)" or "in response to detection (a stated condition or event)".

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), among others.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media capable of storing program codes, such as ROM or RAM, magnetic or optical disks, etc.

Claims

1. A method for determining parameters corresponding to a headset mode is applied to a headset, and the method comprises the following steps:

the earphone acquires the sound characteristics of a target environment and determines the target hearing sense when the earphone mode is the first earphone mode; the target environmental sound characteristic is used for reflecting the energy of the environmental sound signal;

the earphone adjusts the default prompting audio signal of the first earphone mode based on the target environment sound characteristic to obtain an adjusted prompting audio signal; the larger the energy of the environment sound signal is, the larger the energy of the adjusted prompt audio signal is, and the smaller the energy of the environment sound signal is, the smaller the energy of the adjusted prompt audio signal is;

after the earphone plays the adjusted prompt audio signal, the played prompt audio signal is collected by a microphone to obtain a feedback audio signal;

the earphone determines a target playing model based on the adjusted prompt audio signal and the adjusted feedback audio signal; the target playing model is used for reflecting the condition that the user wears the earphone and the ear canal model of the user;

the earphone determines a preset playing model matched with the target playing model from all preset playing models in a mode setting database; the mode setting database comprises a plurality of preset playing models, wherein each preset playing model also corresponds to at least one parameter, and each parameter in the at least one parameter corresponds to one earphone mode and one preset auditory sensation;

the earphone determines a target parameter corresponding to the matched preset playing model; the earphone mode corresponding to the target parameter is the first earphone mode, and the preset hearing corresponding to the target parameter is the target hearing;

the earphone processes an audio signal based on the first earphone mode and a target parameter corresponding to the first earphone mode.

2. The method of claim 1, wherein:

the microphone is a feedback microphone of the earphone.

3. The method of claim 1, wherein:

the target ambient sound characteristic includes one or more of an absolute energy, a relative energy, and an energy fraction of different frequency bands of the ambient sound signal.

4. The method according to claim 3, wherein the target ambient sound characteristic includes absolute energy, relative energy, and energy ratios of different frequency bands of the ambient sound signal, and the obtaining of the target ambient sound characteristic by the earphone specifically includes:

the earphone collects an environmental sound signal to obtain a first environmental audio signal;

the earphone determines absolute energy, relative energy and energy ratio of different frequency bands of the environment sound signal in the first environment audio signal as the target environment sound characteristic based on the first environment audio signal.

5. The method according to claim 3, wherein the target ambient sound characteristic includes absolute energy, relative energy, and energy ratios of different frequency bands of the ambient sound signal, and the obtaining of the target ambient sound characteristic by the earphone specifically includes:

the headphones determine a first ambient sound characteristic based on the first ambient audio signal, the first ambient sound characteristic comprising absolute energy, relative energy, and energy fractions of different frequency bands of an ambient sound signal in the first ambient audio signal;

the earphone receives a second environment sound characteristic sent by a terminal connected with the earphone, wherein the second environment sound characteristic comprises absolute energy and relative energy of an environment sound signal in a second environment audio signal and energy ratios of different frequency bands; the second environment audio signal is an environment sound signal collected by the terminal;

in the case that the first ambient sound characteristic is the same as the second ambient sound characteristic, the earphone determines that the first ambient sound characteristic is the target ambient sound characteristic;

and under the condition that the first environment sound characteristic is different from the second environment sound characteristic, the earphone is fused after different weights are set on the basis of the first environment sound characteristic and the second environment sound characteristic, and a fused result is taken as the target environment sound characteristic.

6. The method of claim 3, wherein the adjusting, by the headset, the default cue audio signal for the first headset mode based on the target ambient sound characteristic comprises:

upon determining that the energy of the ambient sound signal is greater than or equal to a first threshold, the headphones increasing the energy of the default cue audio signal from a first energy to a second energy, the second energy being greater than the energy of the feedback ambient sound signal; the energy of the feedback environment sound signal is used for representing the energy of the environment sound signal in the ear canal; alternatively, the first and second electrodes may be,

upon determining that the energy of the ambient sound signal is less than or equal to a second threshold, the headphones reduce the energy of the default cue audio signal from a first energy to a third energy.

7. The method of claim 3, wherein the adjusting, by the headset, the default cue audio signal for the first headset mode based on the target ambient sound characteristic comprises:

upon determining that the energy of the ambient sound signal is greater than or equal to a first threshold, the earpiece increases the energy of the default cue audio signal from a first energy to a second energy, the second energy being greater than the energy of the feedback ambient sound signal and adjusts the energy fraction of the default cue audio signal in the different frequency bands to correlate with the energy fraction of the ambient sound signal in the different frequency bands included in the target ambient sound characteristic; the energy of the feedback environment sound signal is used for representing the energy of the environment sound signal in the ear canal; alternatively, the first and second electrodes may be,

8. The method according to claim 6 or 7, characterized in that:

the energy of the environment sound signal is one of the target energy obtained after the target environment sound characteristic comprises absolute energy, relative energy or combination of the absolute energy and the relative energy of the environment sound signal.

9. The method according to any one of claims 1-7, wherein:

the target hearing sense is a hearing sense set by the user through the earphone or a terminal connected with the earphone;

and under the condition that the target audibility is not set by the user, setting a default audibility as the target audibility by the earphone or the terminal connected with the earphone.

10. The method according to any one of claims 1 to 7, wherein the determining, by the headphone, a target playback model based on the adjusted cue audio signal and feedback audio signal specifically comprises:

after the adjusted prompt audio signal and the adjusted feedback audio signal are converted to a frequency domain by the earphone, any frame of audio signal in the adjusted prompt audio signal and the adjusted feedback audio signal comprises N frequency points, wherein N is an integer power of 2;

the earphone determines a target playing model based on the adjusted prompt audio signal and the feedback audio signal converted to the frequency domain; n energy ratios in the target playing model; the first total energy ratio is the ratio of the total energy of all frequency points of the first frequency in the adjusted prompt audio signal to the total energy of all frequency points of the first frequency in the feedback audio signal; the first frequency is one of N frequencies corresponding to N frequency points in a frame of audio signal.

11. A communication system, comprising a terminal and an earphone, wherein:

the earphone is used for acquiring an environment sound signal to obtain a first environment audio signal and determining a first environment sound characteristic based on the first environment audio signal;

the terminal is used for acquiring an environment sound signal to obtain a second environment audio signal and determining a second environment sound characteristic based on the second environment audio signal;

the terminal is further used for sending the second environment sound characteristics to the earphone;

the headset is further configured to determine a target ambient sound characteristic based on the first ambient sound characteristic and the second ambient sound characteristic;

the earphone is further used for adjusting the default prompt audio signal of the first earphone mode based on the target environment sound characteristic;

the earphone is also used for acquiring the played prompt audio signal through a microphone after the adjusted prompt audio signal is played to obtain a feedback audio signal;

the earphone is also used for determining a target playing model based on the adjusted prompt audio signal and the adjusted feedback audio signal;

the earphone is also used for determining a preset playing model matched with the target playing model from all preset playing models in a mode setting database;

the earphone is also used for determining a target parameter corresponding to the matched preset playing model;

the earphone is further used for processing an audio signal based on the first earphone mode and a target parameter corresponding to the first earphone mode.

12. An earphone, characterized in that the earphone comprises: one or more processors, memory, microphones, and speakers; the memory coupled with the one or more processors, the memory for storing computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the terminal to perform the method of any of claims 1-10.

13. A computer storage medium, in which a computer program is stored, the computer program comprising executable instructions that, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 10.