CN113099335A

CN113099335A - Method and device for adjusting audio parameters of earphone, electronic equipment and earphone

Info

Publication number: CN113099335A
Application number: CN202010017446.0A
Authority: CN
Inventors: 孙长宇; 孙伟
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-01-08
Filing date: 2020-01-08
Publication date: 2021-07-09

Abstract

The disclosure relates to a method and a device for adjusting audio parameters of an earphone, electronic equipment and the earphone. The method comprises the following steps: acquiring an original audio signal; filtering sound signals in the original audio signals to obtain ultrasonic signals; the ultrasonic wave signal comprises a first audio signal which is not reflected and a second audio signal which is reflected; acquiring an amplitude difference and a phase difference of the first audio signal and the second audio signal; acquiring an audio grade corresponding to the ear where the earphone is located based on the amplitude difference and the phase difference; and when the audio level is a level other than the target level, adjusting the audio parameters of the earphone based on the audio level until the audio level acquired later becomes the target level. This embodiment can reach the same audio frequency and have the same effect of listening to different users through the audio frequency parameter of adjustment earphone, can promote user experience. Moreover, the audio parameters of the earphone can be synchronously adjusted when the user listens to the audio, so that the use of the user is not influenced, and the user experience can be further improved.

Description

Method and device for adjusting audio parameters of earphone, electronic equipment and earphone

Technical Field

The present disclosure relates to the field of audio technologies, and in particular, to a method and an apparatus for adjusting an audio parameter of an earphone, an electronic device, and an earphone.

Background

Currently, many users prefer to wear earphones in public places or during sports, and listen to music or talk using the earphones. Typically, the configuration of the headset is fixed, i.e. the configuration parameters of the same model of headset are the same for each user. However, each user's ear is different and has different hearing perceptions for the same audio, e.g., some users sound just, some users feel louder, and some users feel louder, thus reducing the user experience.

Disclosure of Invention

The present disclosure provides a method and an apparatus for adjusting an audio parameter of an earphone, an electronic device, and an earphone, so as to solve the deficiencies of the related art.

According to a first aspect of the embodiments of the present disclosure, there is provided a method for adjusting an audio parameter of a headphone, which is adapted to an electronic device, and includes:

acquiring an original audio signal; the original audio signal comprises an ultrasonic signal and a sound signal;

filtering out sound signals in the original audio signals to obtain the ultrasonic signals; the ultrasonic signal comprises a first audio signal which is not reflected and a second audio signal which is reflected;

acquiring an amplitude difference and a phase difference of the first audio signal and the second audio signal;

acquiring an audio grade corresponding to the ear where the earphone is located based on the amplitude difference and the phase difference;

and when the audio level is a level other than the target level, adjusting the audio parameters of the earphone based on the audio level until the audio level acquired later becomes the target level.

Optionally, obtaining an amplitude difference and a phase difference of both the first audio signal and the second audio signal comprises:

acquiring an original waveform of ultrasonic data played by the earphone;

extracting the first audio signal from the ultrasonic signal based on a pre-established relation between an original waveform and the first audio signal, acquiring a difference waveform of an actual waveform of the audio signal and the original waveform, and taking the difference waveform as the second audio signal;

acquiring an amplitude difference and a phase difference of the first audio signal and the second audio signal; the amplitude difference is used for representing the amplitude attenuation degree of the ear auditory canal to the first audio signal, and the phase difference is used for representing the time delay degree of the ear middle eardrum depth to the first audio signal.

Optionally, obtaining the audio level corresponding to the ear where the earphone is located based on the amplitude difference and the phase difference includes:

acquiring a preset amplitude difference threshold value and a preset phase difference threshold value;

comparing the amplitude difference with the amplitude difference threshold value and the phase difference with the phase difference threshold value to respectively obtain a first comparison result and a second comparison result;

and obtaining the audio level of the ear wearing the earphone according to the first comparison result and the second comparison result.

Optionally, obtaining an audio level of an ear wearing the headset according to the first comparison result and the second comparison result comprises:

determining the audio level as a first level when the first comparison result indicates that the amplitude difference is greater than the amplitude difference threshold and the second comparison result indicates that the phase difference is greater than the phase difference threshold; or,

determining the audio level as a second level when the first comparison result indicates that the magnitude difference is greater than the magnitude difference threshold and the second comparison result indicates that the phase difference is less than the phase difference threshold, or the first comparison result indicates that the magnitude difference is less than the magnitude difference threshold and the second comparison result indicates that the phase difference is greater than the phase difference threshold; or,

determining the audio level as a third level when the first comparison result indicates that the amplitude difference is less than the amplitude difference threshold and the second comparison result indicates that the phase difference is less than the phase difference threshold.

Optionally, adjusting the audio parameter of the headset based on the audio level until the audio level acquired later becomes a target level, including:

and when the audio level is a first level, sending a control signal to the earphone, and adjusting the cavity structure of the earphone by the earphone in response to the control signal so as to change the audio level acquired later from the first level to a second level.

Optionally, adjusting the cavity structure of the earphone comprises:

moving a movable element within the earpiece to a target position that increases or decreases the volume of the cavity.

and when the audio level is a second level, adjusting the frequency response characteristic to perform amplitude adjustment and frequency equalization on the sound wave emitted by the loudspeaker until the audio level acquired later is changed from the second level to a third level, wherein the third level is a target level.

acquiring a historical user list using the earphone; the historical user list comprises amplitude difference, phase difference, audio level and audio parameters corresponding to a target level corresponding to ears;

acquiring a target grade and a corresponding audio parameter according to the audio grade, the amplitude difference and the phase difference;

and adjusting the audio parameters of the earphone to the audio parameters corresponding to the target level, so that the audio level acquired later becomes the target level.

Optionally, before obtaining the amplitude difference and the phase difference of both the first audio signal and the second audio signal, the method further comprises:

if the amplitude of the second audio signal is smaller than a preset amplitude threshold value, determining that the audio parameter of the earphone does not need to be adjusted; and if the amplitude of the second audio signal is greater than the preset amplitude threshold, continuing to execute the step of obtaining the amplitude difference and the phase difference between the first audio signal and the second audio signal.

According to a second aspect of the embodiments of the present disclosure, there is provided an apparatus for adjusting an audio parameter of a headphone, adapted to an electronic device, including:

the original signal acquisition module is used for acquiring an original audio signal; the original audio signal comprises an ultrasonic signal and a sound signal;

the audio signal acquisition module is used for filtering sound signals in the original audio signals to obtain the ultrasonic signals; the ultrasonic signal comprises a first audio signal which is not reflected and a second audio signal which is reflected;

an amplitude and phase difference obtaining module, configured to obtain an amplitude difference and a phase difference between the first audio signal and the second audio signal;

the audio grade acquisition module is used for acquiring the audio grade corresponding to the ear where the earphone is located based on the amplitude difference and the phase difference;

and the audio parameter adjusting module is used for adjusting the audio parameters of the earphone based on the audio grade when the audio grade is a grade other than the target grade until the audio grade acquired later becomes the target grade.

Optionally, the amplitude-phase difference obtaining module includes:

the original waveform acquisition unit is used for acquiring an original waveform of ultrasonic data played by the earphone;

an audio signal acquisition unit, configured to extract a first audio signal from the ultrasonic signal based on a relationship between an original waveform and the first audio signal, which is established in advance, and acquire a difference waveform between an actual waveform of the audio signal and the original waveform, and use the difference waveform as the second audio signal;

an amplitude-phase difference acquisition unit configured to acquire an amplitude difference and a phase difference between the first audio signal and the second audio signal; the amplitude difference is used for representing the amplitude attenuation degree of the ear auditory canal to the first audio signal, and the phase difference is used for representing the time delay degree of the ear middle eardrum depth to the first audio signal.

Optionally, the audio level obtaining module includes:

the amplitude and phase threshold value acquisition unit is used for acquiring a preset amplitude difference threshold value and a preset phase difference threshold value;

a comparison result obtaining unit, configured to compare the amplitude difference with the amplitude difference threshold and the phase difference with the phase difference threshold, and obtain a first comparison result and a second comparison result respectively;

an audio level determining unit, configured to obtain an audio level of an ear wearing the headset according to the first comparison result and the second comparison result.

Optionally, the audio level determination unit includes:

a first determining unit configured to determine that the audio level is a first level when the first comparison result indicates that the amplitude difference is greater than the amplitude difference threshold and the second comparison result indicates that the phase difference is greater than the phase difference threshold; or,

a second determining unit configured to determine that the audio level is a second level when the first comparison result indicates that the amplitude difference is greater than the amplitude difference threshold and the second comparison result indicates that the phase difference is less than the phase difference threshold, or the first comparison result indicates that the amplitude difference is less than the amplitude difference threshold and the second comparison result indicates that the phase difference is greater than the phase difference threshold; or,

a third determining unit, configured to determine that the audio level is a third level when the first comparison result indicates that the amplitude difference is smaller than the amplitude difference threshold and the second comparison result indicates that the phase difference is smaller than the phase difference threshold.

Optionally, the audio parameter adjusting module includes:

and the control signal sending unit is used for sending a control signal to the earphone when the audio grade is a first grade, and the earphone responds to the control signal to adjust the cavity structure of the earphone so as to change the audio grade acquired later from the first grade to a second grade.

Optionally, the audio parameter adjusting module includes:

and the parameter adjusting unit is used for adjusting the frequency response characteristic when the audio level is the second level so as to perform amplitude adjustment and frequency equalization on the sound wave emitted by the loudspeaker until the acquired audio level is changed from the second level to a third level, wherein the third level is a target level.

a history list acquisition unit for acquiring a history user list using the headset; the historical user list comprises amplitude difference, phase difference, audio level and audio parameters corresponding to a target level corresponding to ears;

the audio parameter acquisition unit is used for acquiring a target grade and a corresponding audio parameter according to the audio grade, the amplitude difference and the phase difference;

and the audio parameter adjusting unit is used for adjusting the audio parameters of the earphone to the audio parameters corresponding to the target level so as to change the acquired audio level into the target level.

Optionally, the apparatus further includes an obtaining module, where the obtaining module is configured to determine that an audio parameter of the headset does not need to be adjusted when the amplitude of the second audio signal is smaller than a preset amplitude threshold, and send a trigger signal to the audio signal obtaining module; and when the amplitude of the second audio signal is greater than the preset amplitude threshold value, sending a trigger signal to the amplitude-phase difference acquisition module.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, including a processor, an audio module, a superimposing circuit, and an ultrasonic transmitter; the processor is respectively and electrically connected with the superposition circuit, the ultrasonic transmitter and the audio module; the audio module is electrically connected with the superposition circuit;

the processor is used for enabling the ultrasonic transmitter after the earphone is matched with the electronic equipment so as to enable an ultrasonic driving signal sent by the ultrasonic transmitter to be sent to the earphone through the superposition circuit;

the audio module is used for responding to an enabling signal of the processor and outputting audio data to the superposition circuit;

the superposition circuit is used for superposing the ultrasonic driving signal and the audio data and outputting a mixed signal.

According to a fourth aspect of embodiments of the present disclosure, there is provided a headset comprising:

a speaker for emitting ultrasonic waves and sound waves;

a movable device disposed within a cavity of the earpiece; the movable device is used for adjusting the size of the cavity;

ultrasonic receivers respectively provided in the respective channels; the ultrasonic receiver is used for acquiring original audio signals of the sound channel and outputting the original audio signals to the electronic equipment, wherein the original audio signals comprise ultrasonic signals and sound signals;

a processor electrically connected to the movable device; the processor is configured to adjust the cavity configuration of the headset in response to a control signal from an electronic device to change a subsequently acquired audio level from a first level to a second level.

According to a fifth aspect of embodiments of the present disclosure, there is provided a readable storage medium having stored thereon executable instructions that, when executed by a processor, implement the steps of the method of any one of the first aspects.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

as can be seen from the above embodiments, in the embodiments of the present disclosure, the ultrasonic signal can be obtained by filtering the sound signal in the original audio signal; the ultrasonic signal comprises a first audio signal which is not reflected and a second audio signal which is reflected; then, obtaining the amplitude difference and the phase difference of the first audio signal and the second audio signal; then, based on the amplitude difference and the phase difference, the audio grade corresponding to the ear where the earphone is located can be obtained; and finally, when the audio level is a level other than the target level, adjusting the audio parameters of the earphone based on the audio level until the audio level acquired later becomes the target level. In this embodiment, through the audio frequency parameter of adjustment earphone, can make amplitude and the phase place and the ear phase-match of the sound that this earphone sent, reach the audio frequency grade and the effect of target grade assorted of ear, the same audio frequency has the same effect of listening to different users promptly, can promote user experience. In addition, in the embodiment, the audio parameters of the earphone can be synchronously adjusted when the user listens to the audio, so that the use of the user is not influenced, and the user experience can be further improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a diagram illustrating an application scenario in accordance with an exemplary embodiment.

Fig. 2 is a structural diagram illustrating an electronic device and a headset according to an exemplary embodiment.

Fig. 3 is a flow chart illustrating a method of adjusting headphone audio parameters according to an exemplary embodiment.

FIG. 4 is a flow chart illustrating obtaining an amplitude difference and a phase difference according to an example embodiment.

FIG. 5 is a flow diagram illustrating obtaining audio levels according to an example embodiment.

FIG. 6 is a flow chart illustrating an audio adjustment according to an example embodiment.

FIG. 7 is a flow chart illustrating another audio adjustment according to an example embodiment.

FIG. 8 is a flow diagram illustrating adjusting audio parameters according to an example embodiment.

Fig. 9 to 14 are block diagrams illustrating an apparatus for adjusting an audio parameter of a headphone according to an exemplary embodiment.

FIG. 15 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure as recited in the claims below.

In order to solve the above technical problem, an embodiment of the present disclosure provides a method for adjusting an audio parameter of an earphone, referring to fig. 1, the inventive concept is that, by providing an ultrasonic receiver 12 on an earphone 10, after the earphone is worn on an ear, an ultrasonic wave 111 emitted from a speaker 11 in the earphone and an ultrasonic wave 112 reflected by an ear canal and/or an eardrum of the ear can be received by the echo receiving device 12, and a sound wave signal, so as to obtain an original audio signal. The audio module in the electronic equipment can obtain the original audio signal, and the ultrasonic signal can be obtained by filtering the sound signal in the original audio signal. Then separating a first audio signal and a second audio signal from the ultrasonic signal, and acquiring an amplitude difference and a phase difference of the first audio signal and the second audio signal; and determining the audio level corresponding to the ear where the earphone is located according to the amplitude difference and the phase difference. Finally, the audio module can adjust the audio parameters of the earphone based on the audio level, so that the audio level obtained later is adjusted to the target level. In this embodiment, through the audio frequency parameter of adjustment earphone, can make amplitude and the phase place and the ear phase-match of the sound that this earphone sent, reach the audio frequency grade and the effect of target grade assorted of ear, the same audio frequency has the same effect of listening to different users promptly, can promote user experience. In addition, in the embodiment, the audio parameters of the earphone can be synchronously adjusted when the user listens to the audio, so that the use of the user is not influenced, and the user experience can be further improved.

It should be noted that, in order to better receive the ultrasonic wave signal, with continued reference to fig. 1, in the present embodiment, the ultrasonic receiver 12 may be disposed on the side of the earphone 10 emitting the ultrasonic wave, so as to better receive the non-reflected ultrasonic wave and the reflected ultrasonic wave.

It should be noted that the earphone may include at least one of the following: wired headphones, wireless headphones, or digital headphones, analog headphones, headsets or ear plugs, or a combination thereof, which the technician can select according to the specific scenario, and is not limited herein. In the embodiments of the present disclosure, an ear bud earphone is taken as an example to describe the scheme.

In order to realize the inventive concept, the electronic device and the earphone are respectively improved correspondingly in one embodiment of the disclosure. See fig. 2, where:

aiming at the earphone, a loudspeaker, an ultrasonic receiver and a movable device are arranged in each sound channel of the earphone;

after the headset is paired with the electronic device, the pairing may be understood as a wireless connection or a wired connection, i.e. establishing an audio data transmission channel. This ultrasonic receiver can be connected with the audio frequency module in the electronic equipment electricity for the ultrasonic wave that the sensing came from the speaker and the ultrasonic wave after ear's duct and eardrum reflection to and come from the sound of speaker broadcast audio data, and convert ultrasonic wave and sound to the original audio signal of telecommunication form, export the audio frequency module in the electronic equipment.

The movable device can be electrically connected with an audio module passage in the electronic equipment and is used for responding to a control instruction of the audio module to adjust the cavity structure of the earphone, so that the effect of adjusting the audio grade is achieved. The speaker can be electrically connected with the audio module channel and the ultrasonic emitter channel, and can emit ultrasonic waves and play audio.

Aiming at the electronic equipment, an audio module, a superposition circuit and an ultrasonic transmitter are arranged in the electronic equipment. The processor is respectively electrically connected with the superposition circuit, the ultrasonic transmitter and the audio module; the audio module is electrically connected with the superposition circuit; the processor is used for enabling the ultrasonic transmitter after the earphone is matched with the electronic equipment so as to enable an ultrasonic driving signal sent by the ultrasonic transmitter to be sent to the superposition circuit; the audio module is used for responding to an enabling signal of the processor and outputting audio data to the superposition circuit; the superposition circuit is used for superposing the ultrasonic driving signal and the audio data and sending the superposed ultrasonic driving signal and audio data to the earphone. In addition, the audio module may obtain an original audio signal sent by the headphone and use the original audio signal as a processor for adjusting the audio parameters of the headphone, that is, the audio module may read executable instructions from a storage medium to perform the steps of the method for adjusting the audio parameters of the headphone.

The structure shown in fig. 2 is suitable for a headphone or an earplug type earphone, especially for an earplug type earphone, and can reduce the volume of the earphone and the production cost thereof. It should be noted that, in practical applications, when the earphone is a headphone, an audio module, a superimposing circuit, and an ultrasonic transmitter may also be disposed in the earphone, and the scheme of the embodiment of the present disclosure may also be implemented. The subsequent embodiments are described with the structure shown in fig. 2.

The method for adjusting the audio parameters of the earphone provided in this embodiment is further described below with reference to an embodiment.

Fig. 3 is a flowchart illustrating a method for adjusting headphone audio parameters according to an exemplary embodiment, and referring to fig. 3, a method for adjusting headphone audio parameters, which is adapted to an electronic device, includes steps 301 to 305, where:

in step 301, an original audio signal is obtained; the original audio signal includes an ultrasonic signal and a sound signal.

In this embodiment, with reference to fig. 2, the user may pair the earphone and the electronic device, so that the earphone and the electronic device establish a communication link, for example, bluetooth, WIFI, and the like, which is not limited herein. After the pairing, the processor in the electronic equipment enables the ultrasonic transmitter, so that the ultrasonic transmitter and the superposition circuit form an ultrasonic output channel, and an ultrasonic driving signal output by the ultrasonic transmitter is output to the earphone. The in-ear speaker can emit ultrasonic waves according to the ultrasonic drive signal and radiate the ultrasonic waves to the surroundings. Similarly, the processor enables the audio module, the audio module and the superposition circuit to form an audio data output channel so as to output the audio data driving signal to the earphone. The in-ear speaker can emit sound and radiate to the surroundings according to the audio data driving signal.

It should be noted that, in the above embodiments, the ultrasonic wave and the sound are separately described, in practical application, an adder may be provided in the superposition circuit, and the ultrasonic wave driving signal and the audio data driving signal are added by the adder, so as to obtain the mixed signal. The specific implementation form of the adder can refer to the related art, and is not described herein again. Of course, the skilled person may also choose a scheme with two audio signals mixed to implement the function of the superposition circuit, and the corresponding scheme falls within the scope of the present disclosure.

After the user wears the earphone to the ear, a part of the ultrasonic waves directly enter the ultrasonic receiver (i.e. are not reflected), and the other part of the ultrasonic waves are transmitted into the earphone and then enter the ultrasonic receiver after being reflected by the ear canal and the eardrum (i.e. are reflected). The ultrasonic receiver converts mechanical energy and electric energy of the received ultrasonic signals to obtain ultrasonic audio signals in the form of electric signals. It will be appreciated that the converted ultrasonic audio signal may comprise a first audio signal that is not reflected and a second audio signal that is reflected. It is understood that the propagation path of the ultrasonic wave may be referred to as the propagation path of the sound signal, and will not be described herein.

Finally, the ultrasonic receiver in the earphone can sense the ultrasonic waves and the sound, and the original audio signal can be obtained through mechanical energy and electric energy conversion.

In step 302, filtering out a sound signal in the original audio signal to obtain the ultrasonic signal; the ultrasonic signal includes a first audio signal that is not reflected and a second audio signal that is reflected.

In this embodiment, according to the frequencies of the sound signal and the ultrasonic signal, the audio module may filter the sound signal in the original audio signal by using a preset filter to obtain the ultrasonic signal. The filter may be a high-pass filter or a band-pass filter in the related art, and in the case where the ultrasonic signal can be selected, each scheme falls within the scope of the present disclosure.

In step 303, an amplitude difference and a phase difference of both the first audio signal and the second audio signal are obtained.

Referring to fig. 4, the audio module may obtain an original waveform of the ultrasonic data played by the earphone (corresponding to step 401). Considering that there may be some attenuation from the original waveform of the ultrasonic wave to the first audio signal, a relationship between the original waveform and the waveform of the first audio signal may be pre-established, so as to obtain the attenuation amplitude and the delay of the original waveform, and thus, the audio module may directly obtain the waveform of the first audio signal under the condition that the original waveform is known. Then, the audio module may obtain an actual waveform according to the ultrasonic audio signal, and may directly extract the first audio signal from the actual waveform, and then subtract the waveform of the first audio signal from the actual waveform to obtain a waveform of the second audio signal (corresponding to step 402).

It should be noted that, other related technologies may also be referred to in the processing procedure of the audio signal, and in the case that the first audio signal and the second audio signal can be separated, the corresponding scheme falls within the protection scope of the present disclosure.

With continued reference to fig. 4, the audio module may obtain the amplitude difference and the phase difference of both the first audio signal and the second audio signal (corresponding to step 403). The amplitude difference is used for representing the amplitude attenuation degree of the ear canal to the first audio signal, and the phase difference is used for representing the time delay degree of the eardrum depth to the first audio signal. For example, the first audio signal is Asin (wt + a) and the second audio signal is Bsin (wt + B), the amplitude difference may be-20 log (B/A) and the phase difference may be B-a.

It should be noted that, in an embodiment, the audio module may determine the amplitude of the second audio signal, compare the amplitude with a preset amplitude threshold (adjustable), and when the amplitude is smaller than the amplitude threshold, it is determined that the ultrasonic receiver does not receive the reflected ultrasonic wave, and at this time, it is determined that the audio parameter of the earphone is not required to be adjusted. When the amplitude is larger than the amplitude threshold value, step 303 may be continuously performed, so that whether the user wears the earphone may be obtained, and the audio parameter adjustment may be performed after the user wears the earphone, so as to reduce the calculation amount.

In step 304, an audio level corresponding to the ear where the earphone is located is obtained based on the amplitude difference and the phase difference.

In this embodiment, the audio module may obtain the audio level corresponding to the ear where the earphone is located according to the amplitude difference and the phase difference, see fig. 5, and the audio module may obtain a preset amplitude difference threshold and a preset phase difference threshold (corresponding to step 501). The amplitude difference threshold and the phase difference threshold can be obtained by statistics in a big data mode, for example, the amplitude difference threshold can be a proportion value of 20%, and the phase difference can be 5-10 degrees. Of course, it is also possible to use a large number of tests to determine how much the ear can sense the deterioration of the receiving effect when the amplitude difference and/or the amount of change in the phase difference are/is, and to use the amplitude difference and the phase difference corresponding to the variation in the receiving effect just sensed as the amplitude difference threshold and the phase difference threshold, respectively. Technicians can set an amplitude difference threshold and a phase difference threshold according to specific scenes, and the corresponding scheme falls into the protection scope of the disclosure.

With continued reference to fig. 5, the audio module may compare the amplitude difference with the amplitude difference threshold and the phase difference with the phase difference threshold to obtain a first comparison result and a second comparison result, respectively (corresponding to step 502). Wherein the first comparison result comprises that the amplitude difference is greater than an amplitude difference threshold value, or the amplitude difference is smaller than the amplitude difference threshold value; the second comparison result includes the phase difference being less than the phase difference threshold or the phase difference being greater than the phase difference threshold.

With continued reference to fig. 5, the audio module may obtain an audio level of an ear wearing the earphone according to the first comparison result and the second comparison result (corresponding to step 503), and may include:

and when the first comparison result indicates that the amplitude difference is larger than the amplitude difference threshold value and the second comparison result indicates that the phase difference is larger than the phase difference threshold value, determining the audio level as a first level.

And when the first comparison result indicates that the amplitude difference is larger than the amplitude difference threshold value and the second comparison result indicates that the phase difference is smaller than the phase difference threshold value, determining the audio level as a second level.

And determining the audio level as a second level when the first comparison result indicates that the amplitude difference is smaller than the amplitude difference threshold and the second comparison result indicates that the phase difference is larger than the phase difference threshold.

And determining the audio level as a third level when the first comparison result indicates that the amplitude difference is less than the amplitude difference threshold and the second comparison result indicates that the phase difference is less than the phase difference threshold.

It should be noted that, the above embodiment only illustrates a case where there are 3 audio levels, and a technician may increase corresponding levels according to a specific scene, at this time, the number of the amplitude difference threshold and the phase difference threshold may be increased, for example, when the amplitude difference threshold and the phase difference threshold are respectively 2, the audio levels may be increased to 9. The corresponding solutions fall within the scope of protection of the present disclosure.

In step 305, when the audio level is a level other than the target level, the audio parameters of the headphones are adjusted based on the audio level until the audio level acquired later becomes the target level.

In this embodiment, the third level may be used as the target level, the audio module determines whether the current audio level is the third level, and when the current audio level is the third level, the audio module may not adjust the audio parameter of the earphone, and returns to step 301; when the current audio level is a level other than the third level, such as the first level or the second level, the audio module determines to adjust the audio level of the earphone.

Referring to fig. 6, when the audio level is the first level, a control signal is transmitted to the earphone (corresponding to step 601). The earphone, upon receiving the control signal, may adjust a cavity structure of the earphone in response to the control signal to change a subsequently acquired audio level from a first level to a second level.

For example, when the audio level corresponding to the ear is the first level, the audio module continuously sends the control signal to the earphone, so that the earphone adjusts the cavity structure of the earphone after receiving the control signal once, and the audio module stops sending the control signal after determining that the audio level is the second level. The adjusting of the cavity structure of the earphone may include moving a movable device in the earphone to a target position according to a preset moving length controlled by a control signal, and increasing or decreasing a space of the cavity after the movable device reaches the target position. The target position may be a position reached after the movable device moves once or a position that should be reached finally, and may be set according to a specific scenario, which is not limited herein.

For another example, when the audio module determines that the audio level is the first level, the audio module sends a control signal to the earphone, the earphone can move the movable device according to the preset length to adjust the cavity structure of the earphone after receiving the control signal, and the audio module obtains the audio level again until the audio module determines that the audio level is the second level and then sends the control signal to the earphone again, and at this time, the earphone adjusts the cavity structure to stop.

It should be noted that when the movable device (after the earphone is worn) moves close to the eardrum, the cavity structure of the earphone becomes smaller, and in this case, the high-frequency effect of the output ultrasonic wave becomes better, and the earphone is suitable for an ear which is not sensitive to the high-frequency component in the ultrasonic wave, for example, a scene where the ear canal is short due to the shallow eardrum. When the movable device moves away from the eardrum, the cavity structure of the earphone is enlarged, the low-frequency effect of the output ultrasonic waves is improved, and the earphone is suitable for the ear insensitive to low-frequency components in the ultrasonic waves, such as a scene with a long auditory canal caused by the depth of the eardrum.

With continued reference to fig. 6, when the audio level is the second level, the audio module may adjust the frequency response characteristic of the speaker to perform amplitude adjustment and frequency equalization on the sound wave emitted by the speaker until the audio level acquired later changes from the second level to a third level, where the third level is the target level (corresponding to step 602). For example, when the audio level of the audio module is the second level, the audio module adjusts the audio parameters of the speaker driver (i.e., the audio module itself), and the adjustment modes may be eq (equal) and drc (dynamic Range control), so that the waveform of the sound wave output by the speaker can be adjusted, and then step 301 to step 304 are repeated to obtain the audio level obtained later. And if the acquired audio level is still the second level, continuing to adjust the audio parameters until the acquired audio level is changed into the third level, and stopping adjusting the audio parameters of the earphone.

It should be noted that, when the audio level is the first level, the audio module needs to perform step 601 and step 602. When the audio level is the second level, the audio module needs to perform step 602. When the audio level is the third level, the audio module may determine not to adjust the audio level.

In consideration of the case where a plurality of users share one headphone, a history user list may be stored in the electronic device or in the headphone, and the history user list may include audio parameters corresponding to an amplitude difference, a phase difference, an audio level, and a target level corresponding to an ear. In one embodiment, after the user wears the headset, referring to fig. 7, the audio module may obtain a list of historical users using the headset (corresponding to step 701). The audio module can be read from a local memory and also can be read from the earphone, and the audio module can be selected according to the storage position, which is not preferred here. Then, the audio module may obtain an audio parameter corresponding to the target level according to the audio level, the amplitude difference, the phase difference, and the audio level (step 702). Then, the audio module may adjust the audio parameter of the earphone to the audio parameter corresponding to the target level, so that the audio level obtained later becomes the target level (corresponding to step 703). Therefore, the user who uses the earphone can be identified in the embodiment, the target level can be achieved through one-time adjustment, the adjusting time can be shortened, and the user experience is improved.

Therefore, in the embodiment of the disclosure, the ultrasonic signal can be obtained by obtaining and filtering the sound signal in the original audio signal; the ultrasonic signal comprises a first audio signal which is not reflected and a second audio signal which is reflected; then, obtaining the amplitude difference and the phase difference of the first audio signal and the second audio signal; then, based on the amplitude difference and the phase difference, the audio grade corresponding to the ear where the earphone is located can be obtained; and finally, when the audio level is a level other than the target level, adjusting the audio parameters of the earphone based on the audio level until the audio level acquired later becomes the target level. In this embodiment, through the audio frequency parameter of adjustment earphone, can make amplitude and the phase place and the ear phase-match of the sound that this earphone sent, reach the audio frequency grade and the effect of target grade assorted of ear, the same audio frequency has the same effect of listening to different users promptly, can promote user experience. In addition, in the embodiment, the audio parameters of the earphone can be synchronously adjusted when the user listens to the audio, so that the use of the user is not influenced, and the user experience can be further improved.

The method for adjusting the audio parameters of the earphone is described below with reference to a scene, and referring to fig. 8, after the earphone acquires audio data, the earphone controls the left channel and the right channel to emit ultrasonic waves. The same operation is performed for the left and right channels, taking the left channel as an example:

1, when a user pairs the earphone, the processor in the electronic equipment enables the ultrasonic transmitter to form a channel of the ultrasonic transmitter, and outputs an ultrasonic driving signal to the superposition circuit. Meanwhile, the audio module outputs audio data to the superimposing circuit. The superimposing circuit outputs the mixed signal.

The speaker simultaneously emits ultrasonic waves and sound in response to the mixing information, and the ultrasonic waves are reflected by the surface after encountering the ear canal and the eardrum.

And 3, the loudspeaker receiver of the left sound channel receives the ultrasonic surface emission signal 1 reflected from the ear canal and returned and the ultrasonic signal 2 directly transmitted to the ultrasonic receiver from the loudspeaker, and converts the ultrasonic signal 1 and the ultrasonic signal 2 into an electric signal 1 (namely, a second audio signal) and an electric signal 2 (namely, a first audio signal). Meanwhile, the loudspeaker receiver of the left sound channel can also receive the sound signal reflected from the ear canal and returned and the sound signal directly transmitted to the ultrasonic receiver. Finally, the speaker receiver outputs the original audio signal.

And 4, filtering the sound signal in the original audio signal by an audio module in the electronic equipment to obtain the ultrasonic signal. Then the audio module acquires an electric signal 1 and an electric signal 2 in the ultrasonic signal, and the audio module acquires the amplitude difference and the phase difference of the electric signal 1 and the telecommunication signal 2, so that the length of the auditory canal, the position of the eardrum and the audio level (A, B and C) can be confirmed.

And 5, if the audio level is A, the first-level regulation is needed, and the audio module sends a control signal to the earphone. The movable device in the earphone moves to adjust the cavity structure, so that the cavity gradually changes from small to big or from big to small. The process of 1-4 is then repeated until the audio level is B.

6. If the audio level is B, the audio module performs a second level of regulation, namely, the EQ and DRC are adjusted. The process of 1-4 is repeated until the adjustment level is C.

In steps 5 and 6, the adjustment targets are: the emitted ultrasonic waves are reflected by the ear part and transmitted to the waveform received by the audio module to reach the expected ideal waveform, and the waveform shape is changed by adjusting the audio parameters such as EQ and DRC until the waveform reaches the expected shape.

7. If the audio level is C, the frequency response is matched with the user, and the regulation and control are completed.

The embodiment of the present disclosure also provides an apparatus for adjusting audio parameters of a headphone, and fig. 9 is a block diagram illustrating an apparatus for adjusting audio parameters of a headphone according to an exemplary embodiment. Referring to fig. 9, an apparatus for adjusting an audio parameter of a headphone includes:

an original signal obtaining module 901, configured to obtain an original audio signal; the original audio signal comprises an ultrasonic signal and a sound signal;

an audio signal obtaining module 902, configured to filter a sound signal in the original audio signal to obtain the ultrasonic signal; the ultrasonic signal comprises a first audio signal which is not reflected and a second audio signal which is reflected;

an amplitude-phase difference obtaining module 903, configured to obtain an amplitude difference and a phase difference between the first audio signal and the second audio signal;

an audio level obtaining module 904, configured to obtain, based on the amplitude difference and the phase difference, an audio level corresponding to an ear where the earphone is located;

an audio parameter adjusting module 905, configured to, when the audio level is a level other than the target level, adjust the audio parameter of the earphone based on the audio level until the audio level obtained later becomes the target level.

In one embodiment, referring to fig. 10, the magnitude-phase difference obtaining module 902 includes:

an original waveform obtaining unit 1001 configured to obtain an original waveform of the ultrasonic data played by the earphone;

an audio signal obtaining unit 1002, configured to extract a first audio signal from the ultrasonic signal based on a relationship between an original waveform and the first audio signal, which is established in advance, and obtain a difference waveform between an actual waveform of the audio signal and the original waveform, where the difference waveform is used as the second audio signal;

an amplitude-phase difference obtaining unit 1003 configured to obtain an amplitude difference and a phase difference between the first audio signal and the second audio signal; the amplitude difference is used for representing the amplitude attenuation degree of the ear auditory canal to the first audio signal, and the phase difference is used for representing the time delay degree of the ear middle eardrum depth to the first audio signal.

In one embodiment, referring to fig. 11, the audio level obtaining module 904 includes:

an amplitude-phase threshold value obtaining unit 1101 configured to obtain a preset amplitude difference threshold value and a preset phase difference threshold value;

a comparison result obtaining unit 1102, configured to compare the amplitude difference with the amplitude difference threshold and the phase difference with the phase difference threshold, and obtain a first comparison result and a second comparison result respectively;

an audio level determining unit 1103, configured to obtain an audio level of an ear wearing the headset according to the first comparison result and the second comparison result.

In an embodiment, referring to fig. 12, the audio level determining unit 1103 includes:

a first determining unit 1201, configured to determine that the audio level is a first level when the first comparison result indicates that the amplitude difference is greater than the amplitude difference threshold and the second comparison result indicates that the phase difference is greater than the phase difference threshold; or,

a second determining unit 1202, configured to determine that the audio level is a second level when the first comparison result indicates that the amplitude difference is greater than the amplitude difference threshold and the second comparison result indicates that the phase difference is less than the phase difference threshold, or the first comparison result indicates that the amplitude difference is less than the amplitude difference threshold and the second comparison result indicates that the phase difference is greater than the phase difference threshold; or,

a third determining unit 1203, configured to determine that the audio level is a third level when the first comparison result indicates that the amplitude difference is smaller than the amplitude difference threshold and the second comparison result indicates that the phase difference is smaller than the phase difference threshold;

in one embodiment, referring to fig. 13, the audio parameter adjustment module 905 includes:

a control signal sending unit 1301, configured to send a control signal to the earphone when the audio level is a first level, where the earphone adjusts a cavity structure of the earphone in response to the control signal, so that the audio level obtained later changes from the first level to a second level;

further comprising:

a parameter adjusting unit 1302, configured to, when the audio level is a second level, adjust a frequency response characteristic of a speaker in the headset, so as to perform amplitude adjustment and frequency equalization on a sound wave emitted by the speaker until an audio level obtained later changes from the second level to a third level, where the third level is a target level.

In one embodiment, referring to fig. 14, the audio parameter adjustment module 905 includes:

a history list acquisition unit 1401 for acquiring a history user list using the headphones; the historical user list comprises amplitude difference, phase difference, audio level and audio parameters corresponding to a target level corresponding to ears;

an audio parameter obtaining unit 1402, configured to obtain a target level and a corresponding audio parameter according to the audio level, the amplitude difference, and the phase difference;

an audio parameter adjusting unit 1403, configured to adjust the audio parameter of the headset to an audio parameter corresponding to the target level, so that the audio level obtained later becomes the target level.

In an embodiment, before obtaining an amplitude difference and a phase difference between the first audio signal and the second audio signal, the apparatus further includes a detection module, where the detection module is configured to determine that an audio parameter of the headset does not need to be adjusted when the amplitude of the second audio signal is smaller than a preset amplitude threshold, and send a trigger signal to the audio signal obtaining module; and when the amplitude of the second audio signal is greater than the preset amplitude threshold value, sending a trigger signal to the amplitude-phase difference acquisition module.

It can be understood that the apparatus provided in the embodiment of the present disclosure corresponds to the content of the above method embodiments, and specific content may refer to the content of each method embodiment, which is not described herein again.

Therefore, in the embodiment of the present disclosure, an ultrasonic signal can be obtained by filtering a sound signal in an original audio signal; the ultrasonic signal comprises a first audio signal which is not reflected and a second audio signal which is reflected; then, obtaining the amplitude difference and the phase difference of the first audio signal and the second audio signal; then, based on the amplitude difference and the phase difference, the audio grade corresponding to the ear where the earphone is located can be obtained; and finally, when the audio level is a level other than the target level, adjusting the audio parameters of the earphone based on the audio level until the audio level acquired later becomes the target level. In this embodiment, through the audio frequency parameter of adjustment earphone, can make amplitude and the phase place and the ear phase-match of the sound that this earphone sent, reach the audio frequency grade and the effect of target grade assorted of ear, the same audio frequency has the same effect of listening to different users promptly, can promote user experience. In addition, in the embodiment, the audio parameters of the earphone can be synchronously adjusted when the user listens to the audio, so that the use of the user is not influenced, and the user experience can be further improved.

FIG. 15 is a block diagram illustrating an electronic device in accordance with an example embodiment. For example, the electronic device 1500 may be a smart phone, a computer, a digital broadcast terminal, a tablet device, a medical device, a fitness device, a personal digital assistant, etc., that includes a transmitting coil, a first magnetic sensor, and a second magnetic sensor in a device that adjusts audio parameters of an earpiece.

Referring to fig. 15, electronic device 1500 may include one or more of the following components: processing component 1502, memory 1504, power component 1506, multimedia component 1508, audio component 1510, input/output (I/O) interface 1512, sensor component 1514, communication component 1516, and image capture component 1518.

The processing component 1502 generally provides for overall operation of the electronic device 1500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing components 1502 may include one or more processors 1520 to execute instructions. Further, processing component 1502 may include one or more modules that facilitate interaction between processing component 1502 and other components. For example, processing component 1502 may include a multimedia module to facilitate interaction between multimedia component 1508 and processing component 1502.

The memory 1504 is configured to store various types of data to support operations at the electronic device 1500. Examples of such data include instructions for any application or method operating on the electronic device 1500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 1506 provides power to the various components of the electronic device 1500. The power components 1506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1500.

The multimedia component 1508 includes a screen providing an output interface between the electronic device 1500 and the target object. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a target object. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

The audio component 1510 is configured to output and/or input audio signals. For example, the audio component 1510 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 1500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1504 or transmitted via the communication component 1516. In some embodiments, audio component 1510 also includes a speaker for outputting audio signals. In addition, the audio component 1510 may also be a headset as shown in fig. 1, and the processor MCU within the headset may implement the steps of the above-described method.

The I/O interface 1512 provides an interface between the processing component 1502 and peripheral interface modules, which can be keyboards, click wheels, buttons, etc.

The sensor assembly 1514 includes one or more sensors for providing status assessment of various aspects of the electronic device 1500. For example, the sensor component 1514 can detect an open/closed state of the electronic device 1500, the relative positioning of components, such as a display screen and keypad of the electronic device 1500, the sensor component 1514 can also detect a change in position of the electronic device 1500 or a component, the presence or absence of a target object in contact with the electronic device 1500, orientation or acceleration/deceleration of the electronic device 1500, and a change in temperature of the electronic device 1500.

The communication component 1516 is configured to facilitate wired or wireless communication between the electronic device 1500 and other devices. The electronic device 1500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1516 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 1500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components.

In an exemplary embodiment, there is also provided a headset, including:

a speaker for emitting ultrasonic waves and sound waves;

It should be noted that the movable device may include a movable device and a power device, wherein the movable device is fixed on the power device. The power means may be a spring or a stepper motor. Taking a stepping motor as an example, the stepping motor may be electrically connected to a processor of the earphone, and drive the movable device to move closer to or away from (when wearing the earphone) the eardrum direction according to a control signal of the processor.

In an exemplary embodiment, a non-transitory readable storage medium including executable instructions, such as memory 1504 including instructions, that are executable by a processor within an audio component is also provided. The readable storage medium may be, among others, ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosed solution following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for adjusting audio parameters of headphones, adapted for an electronic device, comprising:

2. The method of claim 1, wherein obtaining an amplitude difference and a phase difference for both the first audio signal and the second audio signal comprises:

acquiring an original waveform of ultrasonic data played by the earphone;

3. The method of claim 1, wherein obtaining the audio level corresponding to the ear where the earphone is located based on the amplitude difference and the phase difference comprises:

4. The method of claim 3, wherein obtaining an audio level of an ear wearing the headset from the first comparison result and the second comparison result comprises:

5. The method of claim 1, wherein adjusting audio parameters of the headset based on the audio level until a later obtained audio level becomes a target level comprises:

6. The method of claim 5, wherein adjusting the cavity structure of the earpiece comprises:

7. The method of claim 5, wherein adjusting audio parameters of the headset based on the audio level until a later obtained audio level becomes a target level comprises:

8. The method of claim 1, wherein adjusting audio parameters of the headset based on the audio level until a later obtained audio level becomes a target level comprises:

9. The method of claim 1, wherein before obtaining the amplitude difference and the phase difference of both the first audio signal and the second audio signal, the method further comprises:

10. An apparatus for adjusting audio parameters of a headphone, adapted to an electronic device, comprising:

11. The apparatus of claim 10, wherein the amplitude difference obtaining module comprises:

12. The apparatus of claim 10, wherein the audio level obtaining module comprises:

13. The apparatus of claim 12, wherein the audio level determination unit comprises:

14. The apparatus of claim 10, wherein the audio parameter adjustment module comprises:

15. The apparatus of claim 14, wherein the audio parameter adjustment module comprises:

16. The apparatus of claim 10, wherein adjusting audio parameters of the headset based on the audio level until a later obtained audio level becomes a target level comprises:

17. The apparatus of claim 10, further comprising an obtaining module, configured to determine that the audio parameter of the headphone does not need to be adjusted when the amplitude of the second audio signal is smaller than a preset amplitude threshold, and send a trigger signal to the audio signal obtaining module; and when the amplitude of the second audio signal is greater than the preset amplitude threshold value, sending a trigger signal to the amplitude-phase difference acquisition module.

18. An electronic device is characterized by comprising a processor, an audio module, a superposition circuit and an ultrasonic transmitter; the processor is respectively and electrically connected with the superposition circuit, the ultrasonic transmitter and the audio module; the audio module is electrically connected with the superposition circuit;

19. An earphone, comprising:

a speaker for emitting ultrasonic waves and sound waves;

20. A readable storage medium having stored thereon executable instructions, wherein the executable instructions when executed by a processor implement the steps of the method of any one of claims 1 to 9.