CN111818439B - Earphone control method, earphone control device and storage medium - Google Patents
Earphone control method, earphone control device and storage medium Download PDFInfo
- Publication number
- CN111818439B CN111818439B CN202010697054.3A CN202010697054A CN111818439B CN 111818439 B CN111818439 B CN 111818439B CN 202010697054 A CN202010697054 A CN 202010697054A CN 111818439 B CN111818439 B CN 111818439B
- Authority
- CN
- China
- Prior art keywords
- audio signal
- related parameter
- transmission difference
- frequency components
- difference related
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The disclosure discloses a control method, a control device and a storage medium of an earphone. The control method comprises the following steps: generating a first audio signal, the first audio signal being constituted based on a superposition of infrasonic signals of a plurality of frequencies; playing, by a speaker, a first audio signal; receiving a second audio signal transmitted by the played first audio signal through the ear canal by the in-ear microphone; determining a transmission difference related parameter based on the first audio signal and the second audio signal; and determining a leakage condition based on the transmission difference related parameter. The control method utilizes infrasonic waves which can not be heard by human ears as detection signals, avoids interference on users, reduces noise, simultaneously adopts a plurality of infrasonic waves with different frequency bands to be superposed to form a first audio signal, enhances the anti-interference capability of leakage detection, and improves the detection accuracy. The intensity of the detection signal can be properly reduced, and the leakage detection is guaranteed to have good robustness under complex environments and under the condition of low power consumption.
Description
Technical Field
The present disclosure relates to the field of earphones, and more particularly, to a control method, a control apparatus, and a storage medium for earphones.
Background
With the social progress and the improvement of the living standard of people, the earphone becomes an indispensable living article for people; the music listening device can bring comfortable listening enjoyment to users in various noisy environments such as airports, subways, airplanes, restaurants and the like, and is more and more widely accepted by markets and customers. However, for in-ear type earphones, especially for semi-in-ear type earphones, different wearing manners of the earphones (such as wearing tightness and wearing direction) and individual difference ear canal structures (such as ear canal length, ear canal width and reflection) can significantly affect sound fields of the earphones, and also bring an unsatisfactory use experience to users. Thus, a good active noise reduction or listening experience requires real-time detection of the leakage condition of the earphone.
The existing earphones do not have the leakage detection function usually, and some earphones with the leakage detection function are greatly influenced by the external environment, so that the condition of inaccurate detection often exists, or the complexity of the leakage detection function is too high, and the power consumption is too large.
Disclosure of Invention
The present disclosure is provided to solve the above-mentioned drawbacks in the background art. There is a need for a control method, a control device, and a storage medium for an earphone, which use infrasonic waves inaudible to the human ear as a detection signal, avoid interference to the user, reduce noise, and simultaneously form a first audio signal by superimposing a plurality of infrasonic waves of different frequency bands, thereby enhancing the anti-interference capability of leak detection and improving the accuracy of detection. The intensity of the detection signal can be properly reduced, and the leakage detection is guaranteed to have good robustness under complex environments and under the condition of low power consumption.
A first aspect of the present disclosure provides a control method of a headphone including a speaker and an in-ear microphone, the control method including: generating a first audio signal, the first audio signal being constituted based on a superposition of infrasonic signals of a plurality of frequencies; playing, by the speaker, the first audio signal; receiving, by the in-ear microphone, a second audio signal of the played first audio signal transmitted through an ear canal; determining a transmission difference related parameter based on the first audio signal and the second audio signal; and determining a leakage condition based on the transmission difference related parameter.
A second aspect of the present disclosure provides a control apparatus for a headset, the headset comprising a speaker and an in-ear microphone, the control apparatus comprising a processor configured to: generating a first audio signal, the first audio signal being constituted based on a superposition of infrasonic signals of a plurality of frequencies; causing the speaker to play the first audio signal; acquiring a second audio signal transmitted by the first audio signal collected by the in-ear microphone through the ear canal; determining a transmission difference related parameter based on the first audio signal and the second audio signal; and determining a leakage condition based on the transmission difference related parameter.
A third aspect of the disclosure provides a non-transitory computer readable storage medium having stored thereon instructions that, when executed by a processor, perform a control method as any one of the above.
The control method, the control device and the storage medium provided by the embodiment of the disclosure form a first audio signal based on superposition of multiple frequencies of infrasonic signals, the first audio signal is played by a loudspeaker, an in-ear microphone receives a second audio signal transmitted by the first audio signal through an ear canal, a transmission difference related parameter is determined according to the first audio signal and the second audio signal, and a leakage condition under a current scene can be determined based on the transmission difference related parameter. This embodiment utilizes the infrasound wave that people's ear can not hear as the detected signal, has avoided causing the interference to the user, has reduced the noise, adopts the infrasound wave stack of a plurality of different frequency channels to form first audio signal simultaneously, has strengthened leak detection's interference killing feature, has improved the accuracy of detection. Therefore, the strength of the detection signal can be properly reduced, and the leakage detection is guaranteed to have good robustness under the conditions of complex environment and low power consumption. In addition, the embodiment can realize the self-adaptive real-time detection of the leakage condition only according to the transmission difference related parameters between the transmitted first audio signal and the received second audio signal, and has simple realization mode and lower cost. The self-adaptive detection result of the leakage condition can be used in scenes such as self-adaptive active noise reduction, self-adaptive sound field equalization and the like, real-time control over audio signals is achieved, and a user can obtain better listening experience.
Drawings
In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals having letter suffixes or different letter suffixes may represent different instances of similar components. The drawings illustrate various embodiments generally by way of example and not by way of limitation, and together with the description and claims serve to explain the disclosed embodiments. Such embodiments are illustrative, and are not intended to be exhaustive or exclusive embodiments of the present apparatus or method.
Fig. 1 is a flowchart illustrating a control method of a headset according to an embodiment of the present disclosure.
Fig. 2 is a schematic diagram illustrating a transmission path of an infrasonic wave signal from a speaker to an in-ear microphone in a control method according to an embodiment of the disclosure.
Fig. 3 shows ear canal frequency response curves of earphones in an example of the present disclosure obtained under different usage scenarios in a design stage.
Fig. 4 is a schematic structural diagram of a control device of a headset according to an embodiment of the present disclosure.
Detailed Description
For a better understanding of the technical aspects of the present disclosure, reference is made to the following detailed description taken in conjunction with the accompanying drawings. Embodiments of the present disclosure are described in further detail below with reference to the figures and the detailed description, but the present disclosure is not limited thereto. The order in which the various steps described herein are described as examples should not be construed as a limitation if there is no requirement for a context relationship between each other, and one skilled in the art would know that sequential adjustments may be made without destroying the logical relationship between each other, rendering the overall process impractical.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
Fig. 1 is a flowchart illustrating a control method of a headset according to an embodiment of the present disclosure. The earphone comprises a loudspeaker and an in-ear microphone, and as shown in fig. 1, the control method comprises the following steps:
step 110: a first audio signal is generated, which is composed based on the superposition of infrasonic signals of a plurality of frequencies.
Here, the infrasonic signal refers to a sonic signal with a frequency below 20Hz, and the auditory range of human ears is generally 20Hz-20kHz, because the frequency of the infrasonic signal is outside the auditory range of human ears, the playing cannot be heard by human ears, thus avoiding interference to users, and the infrasonic signal can be played at any time according to the requirement of leakage detection. In addition, the first audio signal is formed by superposing infrasonic wave signals of multiple frequencies, so that the problems of low anti-interference capability (for example, pollution by environment low-frequency noise in an external environment) and poor robustness caused by the adoption of a signal of a single frequency are solved.
For the first audio signal, for example, a superposition of multiple infrasonic signals of frequencies in the range of 10Hz to 16Hz may be used, and specifically, several infrasonic signals of different frequencies such as 10Hz, 11Hz, 12Hz, 14Hz, 15Hz, etc. may be selected. Those skilled in the art can make various selections according to specific situations, and the disclosure is not limited thereto.
Step 120: the first audio signal is played by a speaker.
The speaker may play the first audio signal after the earpiece is placed in the ear canal of the human ear. The frequency of the first audio signal is out of the hearing range of human ears, so that the first audio signal cannot be heard by a user, and the listening experience of the user is improved; and can play at any time according to the demand of leak detection, and then facilitate the real-time detection of leaking.
Step 130: and receiving a second audio signal transmitted by the played first audio signal through the ear canal by the in-ear microphone.
Based on step 120, the first audio signal is played by the speaker, reflected by the ear canal of the human ear, and collected by the in-ear microphone as a second audio signal. The second audio signal and the first audio signal may be used for detection of the leak condition in steps 140 and 150.
Step 140: based on the first audio signal and the second audio signal, a transmission difference related parameter is determined.
The transmission difference related parameter may represent a characteristic parameter related to a difference of the second audio signal with respect to the first audio signal due to a transmission difference of the sound transmission path, such as an amplitude gain, a phase shift, and a correlation of the second audio signal with respect to the first audio signal, but is not limited thereto. Different leakage states may result in transmission differences in the acoustic transmission path, which are further reflected by transmission difference related parameters.
Step 150: a leakage condition is determined based on the transmission difference related parameter.
Namely, according to the obtained transmission difference related parameters between the second audio signal and the first audio signal, adaptive detection of the leakage condition can be performed under various use scenes (for example, different degrees of tightness of earphone wearing, different ear canal structures, and the like) for a client, and the result of the leakage detection can be used in scenes such as adaptive active noise reduction, adaptive sound field equalization, and the like, so that real-time control over the audio signal is realized, and the user can obtain better listening experience.
The control method provided by the embodiment of the disclosure includes the steps of firstly forming a first audio signal based on superposition of infrasonic signals of multiple frequencies, playing the first audio signal by a loudspeaker, receiving a second audio signal of the first audio signal transmitted by an ear canal by an in-ear microphone, determining transmission difference related parameters according to the first audio signal and the second audio signal, and determining the leakage condition under the current scene based on the transmission difference related parameters. This embodiment utilizes the infrasound wave that people's ear can not hear as the detected signal, has avoided causing the interference to the user, has reduced the noise, adopts the infrasound wave stack of a plurality of different frequency channels to form first audio signal simultaneously, has strengthened leak detection's interference killing feature, has improved the accuracy of detection. Therefore, the strength of the detection signal can be properly reduced, and the leakage detection is guaranteed to have good robustness under the conditions of complex environment and low power consumption. In addition, the method can realize the self-adaptive real-time detection of the leakage condition only according to the transmission difference related parameters between the transmitted first audio signal and the received second audio signal, and has simple realization mode and lower cost. The self-adaptive detection result of the leakage condition can be used in scenes such as self-adaptive active noise reduction, self-adaptive sound field equalization and the like, real-time control over audio signals is achieved, and a user can obtain better listening experience.
In some embodiments, step 150 may specifically include: the leakage condition is determined with reference to a correspondence between the transmission difference related parameter and the leakage condition based on the determined transmission difference related parameter.
The corresponding relationship may include a plurality of sets, and the plurality of sets of corresponding relationships may be obtained by pre-measuring the headset in a plurality of usage scenarios. The usage scenario is defined by the wearing conditions and the ear canal structure of the user/artificial ear. Different wearing conditions (such as wearing tightness, wearing direction and the like) and different ear canal structures (such as ear canal length, ear canal width and the like) all have certain influence on the leakage condition of the earphone, so different use scenes can be defined by the factors. The plurality of sets of corresponding relations can be obtained by pre-measuring in the design stage of the earphone, and then the current leakage condition can be determined by referring to the plurality of sets of corresponding relations between the pre-established transmission difference related parameters and the leakage condition based on the currently determined transmission difference related parameters.
In some embodiments, the transmission difference related parameter may specifically include at least one of: an amplitude gain and/or a phase shift of the second audio signal relative to the first audio signal, an amplitude gain and/or a phase shift of at least part of a frequency component of the second audio signal relative to a corresponding frequency component of the first audio signal, a correlation of the first audio signal and the second audio signal.
As an example, when the phase shift of the second audio signal relative to the first audio signal is used as the transmission difference related parameter, for example, values of the phase shift of the second audio signal relative to the first audio signal may be measured in advance in a laboratory by using different artificial ears, different wearing conditions of the same artificial ear, and the like, where the different values represent different preset values, which respectively correspond to different preset leakage conditions, and when the current phase shift between the first audio signal and the second audio signal is determined, the current phase shift may be compared with the preset phase shift value, and the closest preset phase shift is selected from the comparison result, and the corresponding preset leakage condition is used as the leakage condition in the current state. A similar method may also be used when the amplitude gain of the second audio signal relative to the first audio signal is used as the transmission difference related parameter, and details are not repeated here. In addition, the current leakage condition can also be determined by using the two parameters of the amplitude gain and the phase shift as transmission difference related parameters and combining the parameters with a reference.
Furthermore, an amplitude gain and/or a phase shift of frequency components of at least part of the second audio signal relative to corresponding frequency components of the first audio signal may be taken as transmission difference related parameter. In this case, the amplitude gain and/or phase shift of each frequency component with respect to the corresponding frequency component of the first audio signal may be first obtained from the second audio signal, and then an appropriate frequency component may be selected therefrom, and the amplitude gain and/or phase shift thereof may be determined as the transmission difference related parameter. Specifically, the method for determining the transmission difference related parameter may include:
carrying out orthogonal transformation on the second audio signal so as to decompose amplitude gain and/or phase shift of the infrasonic wave signal of each frequency in the second audio signal relative to the corresponding frequency component of the first audio signal;
selecting, from the second audio signal, infrasonic signals of a plurality of frequencies whose amplitude gains and/or phase shifts are deviated from each other by less than a threshold;
the amplitude gain and/or phase shift of the infrasonic signal of the selected plurality of frequencies is determined as the transmission difference related parameter.
Since the frequency of the detection signal is controlled in the frequency range of the infrasonic wave signal in the embodiment of the application, the frequency response characteristic values of the plurality of signals are generally in a range, especially the signals with smaller frequency difference, for example, the difference of the frequency response characteristic values between the signals with adjacent frequencies in the selected several infrasonic wave signals is generally in a range and does not deviate too much. If the degree of deviation exceeds a certain range, indicating that a signal of a certain frequency may have been contaminated (e.g., by factors such as weather or traffic), the signal may be disregarded and other signals may be selected as suitable infrasonic signals whose amplitude gain and/or phase shift are determined to be used as transmission difference related parameters for detecting a leak condition. By the method, interference caused by the pseudo signals can be effectively eliminated, and the accuracy of leakage detection is improved.
The threshold may be preset by a factory program of the earphone, or may be set by a tester according to an actual test requirement, which is not limited in this disclosure.
Fig. 2 shows a schematic diagram of a transmission path of an infrasonic signal from a speaker to an in-ear microphone in a control method according to an embodiment of the present disclosure.
As shown in fig. 2, the first audio signal x (t) is an audio signal to be transmitted to the speaker 202 for playing, and after being processed by digital-to-analog conversion of the digital-to-analog converter 201, the audio signal is played by the speaker 202, and the played sound signal is reflected by the ear canal to generate an echo signal. An echo signal generated by the ear canal reflection is collected by the in-ear microphone 203 and converted into a second audio signal y (t) by the analog-to-digital converter 204.
The following description will take an example of pre-measurement of a preset transmission difference related parameter by using an artificial ear in a laboratory.
Let it be assumed that the first audio signal x (t) is represented by formula (1):
x(t)＝sin(2πf1t)+sin(2πf2t)+...sin(2πfMt) formula (1)
Wherein M represents the frequency point number of the selected infrasonic wave signal, xf1(t)＝sin(2πf1t) represents the infrasonic signal at time t of the first frequency point, xf2(t)＝sin(2πf2t) represents the infrasonic signal at the time of the second frequency point t, xfM(t)＝sin(2πfMt) represents the infrasonic wave signal at the moment of the mth frequency point t.
The first audio signal x (t) is propagated and transformed to form a second audio signal y (t), which can be expressed as:
y(t)＝A1sin(2πf1(t-D1))+A2sin(2πf2(t-D2))+...AMsin(2πfM(t-DM))
wherein A is1，D1Amplitude gain and phase shift of infrasonic signal representing first frequency point, A2，D2Amplitude gain and phase shift of infrasonic signal representing second frequency point, … …, AM，DMThe amplitude gain and phase shift of the infrasonic wave signal of the Mth frequency point are shown, A1，D1，A2，D2，……,AM，DMMay be mapped to different leakage amounts.
In some embodiments, each frequency fiAmplitude gain a of the infrasonic signaliAnd a phase shift DiCan be calculated by the following formula (2) to formula (5):
wherein i is any integer between 1 and M, D is the starting time, n is a natural number, TiIs a frequency fiThe period of the infrasonic signal.
Obtaining M sets of amplitude gain and phase shift (A)1，D1)，(A2，D2)，……,(AM，DM) Thereafter, for example, when the amplitude gain is taken as the transmission difference-related parameter, the amplitude gain a from each frequency component can be derived1，A2，……,AMFor example, if the preset threshold value is 0.1dB, when the difference between the amplitude gain of the second frequency point and the amplitude gain of the first frequency point and the third frequency point is greater than 0.1dB, it is indicated that the infrasonic wave signal of the second frequency point may be polluted, and the frequency point may not be considered any more, but the infrasonic wave signals of other frequency points are used as reference signals to determine the preset leakage condition. Similar reasoning is also true when the phase shift is used as the transmission difference related parameter, and is not described herein again. In addition, the amplitude gain and the phase shift can be simultaneously referred to screen the frequency components so as to take the corresponding transmission difference related parameters as related parameters for determining the preset leakage condition, thus realizing double judgment of the pollution frequency points and further improving the accuracy of leakage detection.
In some embodiments, the frequencies of the infrasonic signals are in a non-multiple relationship, so that the correlation among different signals can be reduced, and the independence of the signals can be enhanced, thereby reducing the overall influence of the sound wave signals of the external environment on the infrasonic signals and further improving the anti-interference capability of leakage detection. Specifically, even if the acoustic signal of the external environment falls exactly at the frequency of a certain infrasonic signal, only the infrasonic signal can be influenced and polluted, and the influence and pollution can not be transferred to other infrasonic signals, and the influence and pollution which are relatively isolated are easier to detect and remove.
In an actual application scenario, when the earphone is worn on the ear of a person, the principle and formula for obtaining the transmission difference related parameters are the same as the preset transmission difference related parameters by still using the devices and connection relationship in fig. 2. At this time, the first audio signal x (t) becomes an audio signal actually transmitted to the speaker 202 for playing, and the second audio signal y (t) becomes an audio signal collected by the in-ear microphone 203 after the sound signal actually played by the speaker 202 is reflected by the ear canal; similarly, the above formula can be used to easily calculate the amplitude gain and phase shift of the infrasonic wave signal of each current frequency.
In some embodiments, in case of using the amplitude gain and/or the phase shift of the frequency components of at least part of the second audio signal relative to the respective frequency components of the first audio signal as transmission difference related parameters, sets of correspondences between transmission difference related parameters and leakage conditions may be obtained at the design stage by: fitting respective corresponding frequency response curves for low frequency portions below 20Hz under a plurality of usage scenarios for amplitude gains and/or phase shifts of at least part of the frequency components of the second audio signal relative to corresponding frequency components of the first audio signal, different frequency response curves representing different levels of leakage conditions.
For example, when a frequency response curve corresponding to a loose wearing condition is fitted for a certain earphone in a design stage, the amplitude gain and the phase shift of the infrasonic wave signal of each frequency can be calculated through the above formula (2) to formula (5), frequency points which are judged to be possibly polluted are removed, and then the frequency response curve in the scene is fitted by using the amplitude gain and/or the phase shift of part or all of the frequency components of other remaining second audio signals relative to the corresponding frequency components of the first audio signal. The frequency response curve may specifically be at least one of a frequency-amplitude gain curve and a frequency-phase shift curve, the frequency response curve representing a leakage condition of a grade severe, provided that the grade of the leakage condition of the usage scenario is defined severe.
Fig. 3 shows ear canal frequency response curves of earphones in an example of the present disclosure obtained under different usage scenarios in a design stage. As shown in fig. 3, the frequency response curve is specifically a frequency-amplitude gain curve, wherein the abscissa represents frequency in hertz (Hz) and the ordinate represents amplitude gain (i.e. the selected transmission difference related parameter) of a certain frequency component in the second audio signal relative to a corresponding frequency component in the first audio signal in full decibel scale (dBFS). The different curves in fig. 3 respectively represent the frequency response curves corresponding to the earphones under different use scenarios (such as loose, tight, and the like). In the design stage, the frequency response curves can be respectively defined as leakage conditions of different levels according to different use scenes, namely, a plurality of groups of corresponding relations between transmission difference related parameters and the leakage conditions are established.
In an actual application scenario, when the earphone is worn on the ear of a person, the amplitude gain of the infrasonic wave signal of each frequency can be calculated through the formula (2) to the formula (5), then the frequency point which is judged to be possibly polluted is removed, and the amplitude gain of other residual partial or all frequency components is compared with a frequency response curve (fitting frequency response curve) in a design stage, so that the corresponding leakage grade is determined. Specifically, for example, when the number of the selected suitable frequency components is small (e.g., 1 to 5), the corresponding coordinate position in fig. 3 may be corresponding according to the frequency component and the corresponding amplitude gain thereof, then a curve where the coordinate position is located or closest to the coordinate position is taken as a frequency response curve represented by the frequency component, and a leakage level represented by the curve is taken as a corresponding leakage condition in the current scenario; for another example, when the number of the selected suitable frequency components is large (e.g., more than 10), the frequency components and the corresponding amplitude gains may respectively correspond to respective coordinate positions in fig. 3, corresponding curves are obtained according to the coordinate positions, a fitted frequency response curve having the highest similarity to the curve in fig. 3 is taken as a frequency response curve represented by the frequency components, and a leakage level represented by the fitted frequency response curve is taken as a corresponding leakage condition in the current scenario.
It should be noted that the frequency-amplitude gain curve in fig. 3 is only an example, and a frequency-phase shift curve corresponding to different usage scenarios may also be fitted in the design stage, and used as a fitted frequency response curve for determining the leakage condition of the current scenario, and the comparison method is similar to the comparison method of the frequency-amplitude gain curve, and is not repeated here. Of course, the frequency-amplitude gain curve and the frequency-phase shift curve fitted in the design stage may also be simultaneously referred to determine the leakage condition of the current scene, so as to further improve the accuracy of leakage detection.
In some embodiments, the multiple sets of correspondences between transmission difference related parameters and leakage conditions may also be obtained at the design stage by: for the amplitude gain and/or the phase shift of at least part of the frequency components of the second audio signal relative to the corresponding frequency components of the first audio signal, establishing their corresponding threshold intervals for the amplitude gain and/or the phase shift of the at least part of the frequency components, respectively, under a plurality of usage scenarios, different threshold intervals representing different levels of leakage conditions. Therefore, in an actual application scene, when the earphone is worn on the ear of a person, the amplitude gain and/or the phase shift of the infrasonic wave signal of each frequency are calculated through the formula (2) to the formula (5), frequency points which are judged to be possibly polluted are removed, and the leakage condition of the current scene can be determined by judging that the amplitude gain and/or the phase shift of other remaining partial or all frequency components fall within a preset threshold value interval corresponding to a preset leakage level.
The preset threshold interval may be set by a tester according to an actual test requirement, which is not limited by the present disclosure.
In some embodiments, the transmission difference related parameter may be a normalized correlation of the first audio signal x (t) and the second audio signal y (t) with respect to the first audio signal x (t). The correlation can be calculated by the following equation (6):
wherein, t is1Is the starting time, n is a natural number, and T is any period of time.
In this case, a plurality of sets of corresponding relationships between the transmission difference related parameters and the leakage condition may also be established in the design stage, specifically, corresponding threshold intervals may be set for the normalized correlations of the first audio signal x (t) and the second audio signal y (t) with respect to the first audio signal x (t) in a plurality of different usage scenarios, where different threshold intervals represent different levels of leakage conditions. Thus, in an actual application scenario, after the second audio signal y (t) is obtained by the device shown in fig. 2, the correlation between the first audio signal x (t) and the second audio signal y (t) normalized with respect to the first audio signal x (t) is calculated, and the correlation is determined to fall within a threshold interval corresponding to the preset correlation, so that the preset leakage level corresponding to the threshold interval can be determined to be the leakage condition of the current scenario.
In this embodiment, after the normalization processing is performed on the second audio signal y (t) relative to the first audio signal x (t), the measured correlation gets rid of the influence of the amplitude of the first audio signal x (t), so that even if the amplitude of the first audio signal x (t) is small, the transmission difference related parameter can be accurately measured without adjusting the amplitude gain of the low-frequency signal to be large, and the leakage level corresponding to the current scene can be determined accordingly. In this way, the influence of the amplitude of the first audio signal x (t) on the correlation itself can be eliminated, and the amplitude of the first audio signal x (t) can be properly reduced while the detection accuracy is improved, so as to achieve the effect of further reducing the power consumption.
In some embodiments, the control method further comprises: the gain of the first audio signal is adjusted according to the leakage condition such that the strength of the second audio signal is within an acceptable range. That is, the magnitude of the transmitted first audio signal can be automatically controlled according to the intensity of the received second audio signal, so as not to make the intensity of the second audio signal too large to be within the acceptable range of human ears. Therefore, the leakage detection accuracy is guaranteed, meanwhile, the intensity of the transmitting signal is not too high, the system power consumption is saved, the ear pressure effect caused by too high transmitting signal is eliminated, and the user experience is improved. Specifically, the larger the current leakage amount is, that is, the larger the loss of signal strength in transmission is, the larger the gain of the first audio signal is made, so that it can be ensured that the strength of the second audio signal is still within the acceptable range under the larger current leakage amount, thereby ensuring the detection accuracy of the leakage condition; the smaller the leakage amount is, the lower the gain of the first audio signal is properly adjusted, so that the transmission intensity of the first audio signal is reduced as much as possible under the condition that the intensity of the second audio signal is ensured to be within an acceptable range, and the power consumption of the system is saved. That is, the current leakage condition and the strength of the second audio signal can be used as two feedback factors for the gain adjustment of the first audio signal, and under the action of the dynamic feedback adjustment mechanism, the strength of the second audio signal is ensured to be within an acceptable range, so that the leakage condition can be accurately detected, and the power consumption of the system is saved as much as possible.
In some embodiments, the control method may further include: and judging the wearing condition of the earphone according to the leakage condition, and configuring an active noise reduction filter according to the wearing condition so as to carry out active noise reduction processing.
That is to say, the wearing condition (such as the degree of tightness of wearing, the wearing direction, etc.) of the earphone of the current user can be calculated according to the detection result of the leakage condition, and for the active noise reduction (ANC) earphone, the ANC filter can be configured according to the judged wearing condition, so that the noise reduction curve can be better adapted to the current wearing condition of the earphone, and a better noise reduction effect can be obtained.
In some embodiments, the control method may further include: the equalization filter is configured according to the leakage condition.
For example, in an adaptive sound field equalization scenario (e.g., a music listening scenario), the equalization filter may be configured according to a leakage condition, so that the equalization filter can better adapt to the current audio transmission path, thereby enabling a user to obtain a high quality listening experience.
The embodiment of the disclosure also provides a control device of the earphone. The headset comprises a speaker and an in-ear microphone and as shown in fig. 4, the control means 400 comprises a processor 410 and a memory 420. The processor 410, when executing the instructions stored in the memory 420, may: generating a first audio signal, the first audio signal being constituted based on a superposition of infrasonic signals of a plurality of frequencies; causing a speaker to play a first audio signal; acquiring a second audio signal transmitted by a first audio signal collected by an in-ear microphone through an ear canal; determining a transmission difference related parameter based on the first audio signal and the second audio signal; and determining a leakage condition based on the transmission difference related parameter.
In some embodiments, the transmission difference related parameter comprises at least one of: an amplitude gain and/or a phase shift of the second audio signal relative to the first audio signal, an amplitude gain and/or a phase shift of at least part of a frequency component of the second audio signal relative to a corresponding frequency component of the first audio signal, a correlation of the first audio signal and the second audio signal.
In some embodiments, the processor 410 is further configured to: the leakage condition is determined on the basis of the transmission difference related parameter with reference to a correspondence between the transmission difference related parameter and the leakage condition, wherein the correspondence is measured in advance at a design stage of the headphone.
In some embodiments, where the amplitude gain and/or phase shift of the frequency components of at least part of the second audio signal relative to the respective frequency components of the first audio signal is a transmission difference related parameter, the processor 410 is further configured to: for amplitude gains and/or phase shifts of at least part of the frequency components of the second audio signal relative to corresponding frequency components of the first audio signal, fitting respective corresponding frequency response curves under a plurality of usage scenarios, different frequency response curves representing different levels of leakage conditions to establish a correspondence between transmission difference related parameters and leakage conditions.
In some embodiments, where the amplitude gain and/or phase shift of the frequency components of at least part of the second audio signal relative to the respective frequency components of the first audio signal is a transmission difference related parameter, the processor 410 is further configured to: determining amplitude gain and/or phase shift of the infrasonic wave signals of each frequency in the second audio signal relative to the corresponding frequency component of the first audio signal by performing orthogonal transformation on the second audio signal; selecting, from the second audio signal, infrasonic signals of a plurality of frequencies whose amplitude gains and/or phase shifts are deviated from each other by less than a threshold; the amplitude gain and/or phase shift of the infrasonic signal of the selected plurality of frequencies is determined as the transmission difference related parameter.
In some embodiments, the first audio signal x (t) is represented by formula (1):
x(t)＝sin(2πf1t)+sin(2πf2t)+...sin(2πfMt); formula (1)
Each frequency fiAmplitude gain a of the infrasonic signaliAnd a phase shift DiCan be calculated by the following formula (2) to formula (5), i is any integer between 1 and M:
Di＝arctan(Ii/Qi) Formula (5)
Wherein y (T) is the second audio signal, D is the start time, n is the natural number, TiIs a frequency fiThe period of the infrasonic signal.
In some embodiments, the processor 410 is further configured to: the gain of the first audio signal is adjusted according to the leakage condition such that the strength of the second audio signal is within an acceptable range.
In some embodiments, the headset further comprises a filter component, the processor 410 further configured to: and judging the wearing condition of the earphone according to the leakage condition, and configuring a filter component according to the wearing condition so as to carry out active noise reduction processing.
In some embodiments, the headset further comprises an equalization filter, the processor 410 is further configured to: the equalization filter is configured according to the leakage condition.
Processor 410 may be a processing device including more than one general purpose processing device such as a microprocessor, Central Processing Unit (CPU), Graphics Processing Unit (GPU), etc. More specifically, the processor 410 may be a Complex Instruction Set Computing (CISC) microprocessor, Reduced Instruction Set Computing (RISC) microprocessor, Very Long Instruction Word (VLIW) microprocessor, processor running other instruction sets, or processors running a combination of instruction sets. The processor 410 may also be one or more special-purpose processing devices such as an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), a system on a chip (SoC), or the like. The processor 410 may be communicatively coupled to the memory 420 and configured to execute computer-executable instructions stored thereon to perform the control method of the headset of the above-described embodiments.
The memory 420 may be a non-transitory computer-readable medium such as Read Only Memory (ROM), Random Access Memory (RAM), phase change random access memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), other types of Random Access Memory (RAM), flash disk or other forms of flash memory, cache, registers, static memory, compact disk read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes or other magnetic storage devices, or any other possible non-transitory medium that can be used to store information or instructions that can be accessed by a computer device, and so forth.
The disclosed embodiments also provide a non-transitory computer readable medium storing instructions that, when executed by a processor, perform a control method according to any of the above.
Moreover, although exemplary embodiments have been described herein, the scope thereof includes any and all embodiments based on the disclosure with equivalent elements, modifications, omissions, combinations (e.g., of various embodiments across), adaptations or alterations. The elements in the claims are to be interpreted broadly based on the language employed in the claims and not limited to examples described in the specification or during the prosecution of the disclosure, which examples are to be construed as non-exclusive. It is intended, therefore, that the specification and examples be considered as exemplary only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.
The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more versions thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the foregoing detailed description, various features may be grouped together to streamline the disclosure. This should not be interpreted as an intention that a disclosed feature not claimed is essential to any claim. Rather, inventive subject matter may lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with each other in various combinations or permutations. The scope of the invention should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
The above embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and the scope of the present invention is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present invention, and such modifications and equivalents should also be considered as falling within the scope of the present invention.
Claims (13)
1. A control method of an earphone, the earphone including a speaker and an in-ear microphone, the control method comprising:
generating a first audio signal, the first audio signal being constituted based on a superposition of infrasonic signals of a plurality of frequencies; wherein, the frequencies of the infrasonic wave signals are in a non-multiple relation;
playing, by the speaker, the first audio signal;
receiving, by the in-ear microphone, a second audio signal of the played first audio signal transmitted through an ear canal;
determining a transmission difference related parameter based on the first audio signal and the second audio signal; the transmission difference related parameter is an amplitude gain and/or a phase shift of frequency components of at least part of the second audio signal relative to corresponding frequency components of the first audio signal;
wherein, in case of a magnitude gain and/or a phase shift of frequency components of at least part of the second audio signal relative to corresponding frequency components of the first audio signal as the transmission difference related parameter, the determining of the transmission difference related parameter based on the first audio signal and the second audio signal comprises: determining amplitude gain and/or phase shift of infrasonic signals of various frequencies in the second audio signal relative to corresponding frequency components of the first audio signal by performing orthogonal transformation on the second audio signal; selecting, from the second audio signal, infrasonic signals of a plurality of frequencies whose amplitude gains and/or phase shifts are deviated from each other by less than a threshold; determining an amplitude gain and/or a phase shift of the selected plurality of frequencies of the infrasonic signal as the transmission difference-related parameter; and determining a leakage condition based on the transmission difference related parameter.
2. The control method of claim 1, wherein said determining a leakage condition based on said transmission difference related parameter comprises:
determining a leakage condition with reference to a correspondence between the transmission difference related parameter and the leakage condition, the correspondence being measured in advance at a design stage of the headphone, based on the transmission difference related parameter.
3. The control method according to claim 2, characterized in that in the case where an amplitude gain and/or a phase shift of a frequency component of at least a part of the second audio signal with respect to a corresponding frequency component of the first audio signal is used as the transmission difference-related parameter, the correspondence between the transmission difference-related parameter and a leakage condition is obtained by:
fitting respective corresponding low frequency response curves below 20Hz under a plurality of usage scenarios for amplitude gains and/or phase shifts of frequency components of at least a portion of the second audio signal relative to corresponding frequency components of the first audio signal, different frequency response curves representing different levels of leakage conditions.
4. The control method according to claim 2, wherein the correspondence is measured in advance in a plurality of usage scenarios, the usage scenarios being defined by wearing conditions and ear canal structures of the user or the artificial ear.
5. The control method according to claim 1, wherein the transmission difference correlation parameter is a correlation of the first audio signal and the second audio signal normalized with respect to the first audio signal.
6. The control method according to any one of claims 1 to 5, characterized by further comprising: adjusting a gain of the first audio signal such that an intensity of the second audio signal is within an acceptable range according to the leakage condition.
7. The control method according to any one of claims 1 to 5, characterized by further comprising:
judging the wearing condition of the earphone according to the leakage condition, and configuring an active noise reduction filter according to the wearing condition so as to carry out active noise reduction processing; and/or
An equalization filter is configured based on the leakage condition.
8. A control device for a headset comprising a speaker and an in-ear microphone, the control device comprising a processor configured to:
generating a first audio signal, the first audio signal being constituted based on a superposition of infrasonic signals of a plurality of frequencies; wherein, the frequencies of the infrasonic wave signals are in a non-multiple relation;
causing the speaker to play the first audio signal;
acquiring a second audio signal transmitted by the first audio signal collected by the in-ear microphone through the ear canal;
determining a transmission difference related parameter based on the first audio signal and the second audio signal;
the transmission difference related parameter includes at least one of: an amplitude gain and/or a phase shift of frequency components of at least part of the second audio signal relative to corresponding frequency components of the first audio signal;
wherein, in case of a magnitude gain and/or a phase shift of frequency components of at least part of the second audio signal relative to corresponding frequency components of the first audio signal as the transmission difference related parameter, the determining of the transmission difference related parameter based on the first audio signal and the second audio signal comprises: determining amplitude gain and/or phase shift of infrasonic signals of various frequencies in the second audio signal relative to corresponding frequency components of the first audio signal by performing orthogonal transformation on the second audio signal; selecting, from the second audio signal, infrasonic signals of a plurality of frequencies whose amplitude gains and/or phase shifts are deviated from each other by less than a threshold; determining an amplitude gain and/or a phase shift of the selected plurality of frequencies of the infrasonic signal as the transmission difference-related parameter;
and determining a leakage condition based on the transmission difference related parameter.
9. The control device of claim 8, wherein the processor is further configured to:
determining a leakage condition with reference to a correspondence between the transmission difference related parameter and a leakage condition based on the transmission difference related parameter, wherein the correspondence is measured in advance at a design stage of the earphone.
10. The control apparatus according to claim 8, wherein, in case of amplitude gain and/or phase shift of frequency components of at least part of the second audio signal relative to corresponding frequency components of the first audio signal as the transmission difference related parameter, the processor is further configured to:
fitting respective corresponding low-frequency response curves below 20Hz under a plurality of usage scenarios for amplitude gains and/or phase shifts of frequency components of at least a portion of the second audio signal relative to corresponding frequency components of the first audio signal, different frequency response curves representing different levels of leakage conditions to establish a correspondence between the transmission difference related parameter and the leakage conditions.
11. The control device of claim 8, wherein the processor is further configured to:
adjusting a gain of the first audio signal such that an intensity of the second audio signal is within an acceptable range according to the leakage condition.
12. The control device of any of claims 8 to 11, wherein the headset further comprises a filter component and/or an equalization filter, the processor further configured to:
judging the wearing condition of the earphone according to the leakage condition, and configuring the filter component according to the wearing condition so as to carry out active noise reduction processing; and/or
Configuring the equalization filter according to the leakage condition.
13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, perform the control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010697054.3A CN111818439B (en) | 2020-07-20 | 2020-07-20 | Earphone control method, earphone control device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010697054.3A CN111818439B (en) | 2020-07-20 | 2020-07-20 | Earphone control method, earphone control device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111818439A CN111818439A (en) | 2020-10-23 |
| CN111818439B true CN111818439B (en) | 2022-04-19 |
Family
ID=72866111
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010697054.3A Active CN111818439B (en) | 2020-07-20 | 2020-07-20 | Earphone control method, earphone control device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111818439B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112911485B (en) * | 2021-02-09 | 2022-06-17 | 恒玄科技(上海)股份有限公司 | Wireless earphone in and out ear detection method, wireless earphone and medium |
| CN112911487B (en) * | 2021-02-09 | 2022-12-27 | 恒玄科技(上海)股份有限公司 | In-ear detection method for wireless headset, wireless headset and storage medium |
| CN115412824A (en) * | 2021-05-27 | 2022-11-29 | Oppo广东移动通信有限公司 | Detection method, detection device, earphone and computer readable storage medium |
| CN113727233B (en) * | 2021-07-22 | 2023-12-15 | 上海闻泰电子科技有限公司 | Earphone prompting method and device, earphone and medium |
| CN115942170A (en) * | 2021-08-19 | 2023-04-07 | Oppo广东移动通信有限公司 | Audio signal processing method and device, earphone and storage medium |
| CN114040293B (en) * | 2021-11-26 | 2024-05-31 | 歌尔科技有限公司 | Earphone control method and device, earphone and computer readable storage medium |
| CN114071308B (en) * | 2021-11-29 | 2024-04-30 | 歌尔科技有限公司 | Headset self-adaptive tuning method and device, headset and readable storage medium |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE502006002035D1 (en) * | 2006-11-23 | 2008-12-18 | Siemens Audiologische Technik | Hearing device with automatic shutdown and corresponding method |
| US8199956B2 (en) * | 2009-01-23 | 2012-06-12 | Sony Ericsson Mobile Communications | Acoustic in-ear detection for earpiece |
| CN104661153B (en) * | 2014-12-31 | 2018-02-02 | 歌尔股份有限公司 | A kind of compensation method of earphone audio, device and earphone |
| CN105163222A (en) * | 2015-10-09 | 2015-12-16 | 歌尔声学股份有限公司 | Earphone hearing adjusting method and earphone |
| CN107920298B (en) * | 2018-01-03 | 2019-07-05 | 京东方科技集团股份有限公司 | A kind of earphone, headset control method and device |
| CN108540900B (en) * | 2018-03-30 | 2021-03-12 | Oppo广东移动通信有限公司 | Volume adjusting method and related product |
| CN108430003B (en) * | 2018-03-30 | 2020-01-14 | Oppo广东移动通信有限公司 | Sound effect compensation method and device, readable storage medium and terminal |
| CN108551631A (en) * | 2018-04-28 | 2018-09-18 | 维沃移动通信有限公司 | A kind of sound quality compensation method and mobile terminal |
| CN108763901B (en) * | 2018-05-28 | 2020-09-22 | Oppo广东移动通信有限公司 | Ear print information acquisition method and device, terminal, earphone and readable storage medium |
| CN110324751A (en) * | 2019-07-30 | 2019-10-11 | 潍坊歌尔电子有限公司 | Pleasant structural recognition method, sound quality adjusting method and the earphone of earphone |
| CN110996216B (en) * | 2020-02-26 | 2020-06-23 | 恒玄科技(北京)有限公司 | Method, device and system for configuring equalization filter in earphone and earphone |
| CN110996215B (en) * | 2020-02-26 | 2020-06-02 | 恒玄科技(北京)有限公司 | Method, device and computer readable medium for determining noise reduction parameters of earphone |
| CN110933554B (en) * | 2019-12-13 | 2022-02-15 | 恒玄科技(上海)股份有限公司 | Active noise reduction method and system and earphone |
| CN110996209B (en) * | 2019-12-13 | 2022-02-15 | 恒玄科技(上海)股份有限公司 | Active noise reduction method and system and earphone |
| CN110996210B (en) * | 2019-12-13 | 2021-11-23 | 恒玄科技(上海)股份有限公司 | Method for sound field equalization and earphone |
-
2020
- 2020-07-20 CN CN202010697054.3A patent/CN111818439B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111818439A (en) | 2020-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111818439B (en) | Earphone control method, earphone control device and storage medium | |
| CN111010646B (en) | Method and system for transparent transmission of earphone and earphone | |
| US11245976B2 (en) | Earphone signal processing method and system, and earphone | |
| US8606571B1 (en) | Spatial selectivity noise reduction tradeoff for multi-microphone systems | |
| JP5705980B2 (en) | System, method and apparatus for enhanced generation of acoustic images in space | |
| KR101547035B1 (en) | Three-dimensional sound capturing and reproducing with multi-microphones | |
| KR100930835B1 (en) | Sound playback device | |
| US20230352038A1 (en) | Voice activation detecting method of earphones, earphones and storage medium | |
| JP6102179B2 (en) | Audio processing apparatus and method, and program | |
| KR100930834B1 (en) | Sound playback device | |
| US9538288B2 (en) | Sound field correction apparatus, control method thereof, and computer-readable storage medium | |
| US9264812B2 (en) | Apparatus and method for localizing a sound image, and a non-transitory computer readable medium | |
| CN110754096B (en) | System and method for detecting voice activity of a user of a headset | |
| CN106878905A (en) | The method for determining the objective perception amount of noisy speech signal | |
| CN113891205B (en) | Active noise reduction method and device for compensating earphone leakage and earphone | |
| JP2018098798A (en) | Operation method of hearing aid | |
| US10349198B2 (en) | Active room compensation in loudspeaker system | |
| CN110636423B (en) | Method for enhancing signal directionality in a hearing device | |
| JP2024517721A (en) | Audio optimization for noisy environments | |
| JP2013543151A (en) | System and method for reducing unwanted sound in a signal received from a microphone device | |
| US11206502B1 (en) | System and method for evaluating an ear seal using normalization | |
| US9743179B2 (en) | Sound field spatial stabilizer with structured noise compensation | |
| US11516604B2 (en) | System and method for evaluating an ear seal using external stimulus | |
| CN112511963B (en) | Earphone edge tone detection method and device and airflow simulation device | |
| US20230045207A1 (en) | Processing device and processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |