CN115842985A

CN115842985A - Ear canal frequency response compensation method and device, electroacoustic conversion device and electronic equipment

Info

Publication number: CN115842985A
Application number: CN202211528962.5A
Authority: CN
Inventors: 吕雪洋; 史润宇; 刘晗宇; 吕柱良
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2022-11-30
Filing date: 2022-11-30
Publication date: 2023-03-24

Abstract

The present disclosure provides a method and an apparatus for compensating a frequency response of an ear canal, an electroacoustic conversion apparatus, and an electronic device, which can be executed by the electroacoustic conversion apparatus, the method comprising: acquiring a target auditory canal frequency response; determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for carrying out frequency response compensation on the filter; and sending the compensated filtered frequency response to the electronic device. Through this disclosure, can effectively reduce the operation resource consumption of duct frequency response compensation, avoid influencing electroacoustic conversion device's duration effectively, promote duct frequency response compensation efficiency effectively.

Description

Ear canal frequency response compensation method and device, electroacoustic conversion device and electronic equipment

Technical Field

The present disclosure relates to the field of electronic devices, and in particular, to a method and an apparatus for compensating a frequency response of an ear canal, an electroacoustic conversion apparatus, and an electronic device.

Background

An electroacoustic conversion device, for example, an earphone, generally needs to perform auditory sense optimization and ear canal calibration (also referred to as ear canal frequency response compensation) on the electroacoustic conversion device, wherein the ear canal calibration is a customized sound effect function of the electroacoustic conversion device, and through the ear canal calibration, each user can hear a similar reference tune, and the reference tune is an Equalizer (EQ) added to correct the influence of the hardware structure of the electroacoustic conversion device on the auditory sense when the electroacoustic conversion device is shipped from a factory and according to the listening style designed by a tuner, so as to solve the problem that the auditory senses obtained by each user using the electroacoustic conversion device are inconsistent.

In the related art, when the auditory sense optimization and ear canal calibration are performed on the electroacoustic conversion device, more ear canal frequency response compensation operation resources are consumed, so that the cruising ability of the electroacoustic conversion device is influenced, and the ear canal frequency response compensation efficiency is influenced.

Disclosure of Invention

The present disclosure is directed to solving, at least to some extent, one of the technical problems in the related art.

Therefore, an object of the present disclosure is to provide a method and an apparatus for ear canal frequency response compensation, an electroacoustic conversion device, an electronic device, a storage medium, and a computer program product, which can effectively reduce the computation resource consumption of ear canal frequency response compensation, effectively avoid influencing the endurance of the electroacoustic conversion device, and effectively improve the ear canal frequency response compensation efficiency.

The ear canal frequency response compensation method provided by the embodiment of the first aspect of the present disclosure is executed by an electroacoustic conversion device, and includes: acquiring a target auditory canal frequency response; determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter; and sending the compensated filtering frequency response to the electronic device.

The ear canal frequency response compensation method provided by the embodiment of the second aspect of the present disclosure is executed by an electronic device, where the electronic device includes: a filter, comprising: receiving a compensation filtering frequency response sent by an electroacoustic conversion device, wherein the compensation filtering frequency response is obtained by acquiring a target ear canal frequency response by the electroacoustic conversion device and determining according to the target ear canal frequency response; and performing frequency response compensation on the filter according to the compensation filtering frequency response.

The ear canal frequency response compensation device provided by the embodiment of the third aspect of the present disclosure is applied to an electroacoustic conversion device, and includes: the acquisition module is used for acquiring the frequency response of the target auditory canal; the determining module is used for determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for carrying out frequency response compensation on the filter; and the sending module is used for sending the compensation filtering frequency response to the electronic equipment.

The ear canal frequency response compensation device provided by the embodiment of the fourth aspect of the present disclosure is applied to an electronic device, the electronic device includes: a filter, comprising: the receiving module is used for receiving a compensation filtering frequency response sent by the electroacoustic conversion device, wherein the compensation filtering frequency response is obtained by acquiring a target auditory canal frequency response by the electroacoustic conversion device and determining the frequency response according to the target auditory canal frequency response; and the compensation module is used for carrying out frequency response compensation on the filter according to the compensation filtering frequency response.

An embodiment of a fifth aspect of the present disclosure provides an electroacoustic conversion device, including: the device comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the ear canal frequency response compensation method as set forth in the embodiment of the first aspect of the disclosure.

An embodiment of a sixth aspect of the present disclosure provides an electronic device, including: the device comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the ear canal frequency response compensation method according to the embodiment of the second aspect of the disclosure.

A seventh aspect of the present disclosure proposes a non-transitory computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements an ear canal frequency response compensation method as proposed in the first aspect of the present disclosure, or implements an ear canal frequency response compensation method as proposed in the second aspect of the present disclosure.

An eighth aspect of the present disclosure provides a computer program product, wherein when instructions in the computer program product are executed by a processor, the method for compensating for ear canal frequency response as set forth in the first aspect of the present disclosure is executed, or the method for compensating for ear canal frequency response as set forth in the second aspect of the present disclosure is executed.

According to the ear canal frequency response compensation method and device, the electroacoustic conversion device, the electronic equipment, the storage medium and the computer program product, the target ear canal frequency response is obtained through the electroacoustic conversion device, the compensation filtering frequency response of the filter of the electronic equipment is determined according to the target ear canal frequency response, the compensation filtering frequency response is used for carrying out frequency response compensation on the filter, and the compensation filtering frequency response is sent to the electronic equipment, so that the computing resource consumption of ear canal frequency response compensation can be effectively reduced, the endurance capacity of the electroacoustic conversion device is effectively prevented from being influenced, and the ear canal frequency response compensation efficiency is effectively improved.

Additional aspects and advantages of the disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the disclosure.

Drawings

The foregoing and/or additional aspects and advantages of the present disclosure will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic flow chart of a method for compensating for ear canal frequency response according to an embodiment of the disclosure;

fig. 2 is a schematic flow chart of an ear canal frequency response compensation method according to another embodiment of the present disclosure;

FIG. 3 is a schematic diagram of an in-ear frequency response component of a head simulator in accordance with an embodiment of the present disclosure;

FIG. 4 is a schematic view of an in-ear frequency response component of a head simulator in accordance with another embodiment of the present disclosure;

FIG. 5 is a schematic diagram illustrating in-ear frequency response components in one embodiment of the present disclosure;

fig. 6 is a schematic flow chart of a method for compensating for ear canal frequency response according to another embodiment of the present disclosure;

FIG. 7 is a schematic view of an in-ear frequency response component of a head simulator in accordance with another embodiment of the present disclosure;

FIG. 8 is a schematic diagram of an in-ear frequency response assembly according to another embodiment of the present disclosure;

fig. 9 is a schematic flow chart of an ear canal frequency response compensation method according to another embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of an ear canal frequency response compensation device according to an embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of an ear canal frequency response compensation device according to another embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of an electroacoustic conversion device according to an embodiment of the present disclosure;

FIG. 13 illustrates a block diagram of an exemplary terminal device suitable for use in implementing embodiments of the present disclosure.

Detailed Description

Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of illustrating the present disclosure and should not be construed as limiting the same. On the contrary, the embodiments of the disclosure include all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.

Fig. 1 is a schematic flow chart of an ear canal frequency response compensation method according to an embodiment of the present disclosure.

The ear canal frequency response compensation method is configured as an ear canal frequency response compensation device in this embodiment for example, the ear canal frequency response compensation method in this embodiment may be configured in the ear canal frequency response compensation device, the ear canal frequency response compensation device may be disposed in the server, or may also be disposed in the electroacoustic conversion device, which is not limited in this disclosure.

The present embodiment takes the ear canal frequency response compensation method as an example configured in the electroacoustic conversion device. The electroacoustic conversion device is a hardware device such as an earphone or a speaker device having an electroacoustic conversion capability, and the electroacoustic conversion capability is a capability of converting an electric signal into a sound signal and converting a collected sound signal into an electric signal.

It should be noted that the execution main body of the embodiment of the present disclosure may be, for example, a Central Processing Unit (CPU) in a server or an electroacoustic conversion device in terms of hardware, and may be, for example, a server or an associated background service in the electroacoustic conversion device in terms of software, which is not limited thereto.

In the embodiment of the present disclosure, the electroacoustic conversion device may be exemplified as an earphone, which is not limited to this.

As shown in fig. 1, the ear canal frequency response compensation method includes:

s101: and acquiring the target auditory canal frequency response.

In the process of listening to audio by using the earphone, the frequency response at the eardrum of the user may be referred to as a target ear canal frequency response, and the target ear canal frequency response may also be understood as a frequency response generated by reflection of the received audio at the eardrum of the user.

It is understood that, generally, the device for collecting the ear canal frequency response (such as a sound pick-up) is disposed on the electroacoustic conversion device, and when the user wears the electroacoustic conversion device to listen to the audio, the device for collecting the ear canal frequency response cannot be accurately located at the eardrum of the user, so that, in the embodiment of the present disclosure, some methods may be combined to detect the target ear canal frequency response, and the ear canal frequency response compensation may be implemented based on the target ear canal frequency response.

For example, the test audio can be played by the earphone in the process that the user wears the earphone, the sound is recorded through a sound pickup arranged in the earphone, the recorded sound is subjected to spectrum analysis to obtain the spectrum characteristics of the auditory canal, and then the spectrum characteristics of the auditory canal are subjected to analysis operation processing to obtain the frequency response of the user at the eardrum of the user as the frequency response of the target auditory canal in the process that the user listens to the audio by using the earphone.

S102: and determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for carrying out frequency response compensation on the filter.

After the target ear canal frequency response is obtained, the compensation filtering frequency response of the filter of the electronic device can be determined according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter.

In the embodiment of the present disclosure, when determining the compensation filtering frequency response of the filter of the electronic device according to the target ear canal frequency response, some frequency response compensation algorithms may be combined to process the target ear canal frequency response, and determine the compensation filtering frequency response of the filter of the electronic device according to a result obtained by the processing, or the target ear canal frequency response may also be input into a pre-trained compensation frequency response determination model to determine the compensation filtering frequency response of the filter of the electronic device, which is not limited to this.

S103: and sending the compensation filtering frequency response to the electronic equipment.

That is to say, in the embodiment of the present disclosure, the compensation filtering frequency response of the filter is determined by the electroacoustic conversion device (earphone), and then the filter and the compensation processing logic of the filter are placed in the electronic device, which may be a device that interacts with the earphone to play audio, so that the consumption of computing resources for ear canal frequency response compensation can be effectively reduced, and the influence on the cruising ability of the electroacoustic conversion device is effectively avoided.

In the embodiment, the target ear canal frequency response is obtained by the electroacoustic conversion device, the compensation filtering frequency response of the filter of the electronic equipment is determined according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter, and the compensation filtering frequency response is sent to the electronic equipment, so that the consumption of computing resources for ear canal frequency response compensation can be effectively reduced, the endurance capacity of the electroacoustic conversion device is effectively prevented from being influenced, and the ear canal frequency response compensation efficiency is effectively improved.

Fig. 2 is a schematic flow chart of an ear canal frequency response compensation method according to another embodiment of the present disclosure.

The present embodiment takes the ear canal frequency response compensation method as an example configured in the electroacoustic conversion device.

As shown in fig. 2, the ear canal frequency response compensation method includes:

s201: the ear canal reflection frequency response is detected.

In the process of listening to audio by using the earphone, the frequency response reflected by the ear canal of the user may be referred to as ear canal reflection frequency response, and the ear canal reflection frequency response may also be understood as a frequency response generated by the reflection of the received audio in the ear canal of the user.

It is understood that a device (such as a sound pick-up) for collecting the ear canal frequency response is disposed in the electroacoustic transducer device, and when a user wears the electroacoustic transducer device to listen to audio, the ear canal reflection frequency response of the user, namely the ear canal reflection frequency response, is collected based on the ear canal frequency response collecting device.

In the embodiment of the present disclosure, the target ear canal frequency response at the eardrum of the user may be estimated based on the detected ear canal reflection frequency response, which is specifically described in the following description.

S202: acquiring a reference ear canal frequency response and a reference reflection frequency response.

The frequency response at the eardrum position obtained by the head simulation device is tested in advance based on the head simulation device and can be called as a reference auditory canal frequency response, the frequency response reflected in the auditory canal is tested in advance based on the head simulation device and can be called as a reference reflection frequency response, and the reference auditory canal frequency response and the reference reflection frequency response are used for assisting in determining the frequency response at the eardrum position of the user in the process that the user really uses the electroacoustic conversion device.

In an embodiment of the present disclosure, the electroacoustic conversion device may include: a first conversion device having a corresponding device frequency response and a second conversion device located at an eardrum location of the head simulator; the method includes the steps of obtaining a reference auditory canal frequency response, converting a first electric signal into a first sound signal based on a first conversion device, outputting the first sound signal to an auditory canal of a head simulation device, collecting a second sound signal obtained by reflecting the first sound signal by an eardrum of the head simulation device based on a second conversion device, converting the second sound signal into a second electric signal, determining a to-be-processed frequency response according to the first electric signal and the second electric signal, determining a reference auditory canal frequency response according to the to-be-processed frequency response and a device frequency response, testing the head simulation device in advance, determining the reference auditory canal frequency response, and in the actual auditory canal frequency response compensation process, directly obtaining the test obtained reference auditory canal frequency response to assist in auditory canal frequency response compensation, so that accuracy and efficiency of auditory canal frequency response compensation can be effectively improved.

As shown in fig. 3, fig. 3 is a schematic diagram of an in-ear frequency response composition of a head simulator in an embodiment of the present disclosure, which is exemplified by taking the head simulator as an artificial head, the artificial head may be tested in advance to obtain a frequency response at an eardrum in an ear of the artificial head as a reference ear canal frequency response (e.g., an artificial head ear canal frequency response H2 in fig. 3), and the first transducer device in the electroacoustic transducer device is tested to obtain a corresponding device frequency response (e.g., an earphone speaker frequency response H1 shown in fig. 3), the first transducer device in the electroacoustic transducer device is capable of converting a first electrical signal into a first sound signal and outputting the first sound signal into an ear canal of the head simulator (corresponding to an Input signal Input in fig. 3), then, a second sound signal obtained by reflecting the first sound signal at the eardrum of the artificial head may be recorded by a second conversion device (Microphone, mic) in the electroacoustic conversion device, and the second sound signal is converted into a second electric signal, and then a to-be-processed frequency response may be determined according to the first electric signal and the second electric signal, where the to-be-processed frequency response is obtained by performing spectrum analysis on the Input signal Input and the signal obtained by recording by the Microphone Mic, and the to-be-processed frequency response is composed of two parts, such as an earphone speaker frequency response H1 and an artificial head ear canal frequency response H2 in fig. 3, and then the artificial head ear canal frequency response H2 may be deduced back according to the to-be-processed frequency response and the device frequency response (earphone speaker frequency response H1), and the artificial head ear canal frequency response H2 may be used as a reference ear canal frequency response.

In the embodiment of the present disclosure, the target ear canal frequency response at the eardrum of the user is to be detected, but because the user cannot place the microphone of the electroacoustic conversion device (earphone) at the eardrum position in the process of actually wearing the electroacoustic conversion device (earphone), so that in an actual usage scenario, the target ear canal frequency response at the eardrum of the user cannot be obtained, then in the embodiment of the present disclosure, the frequency response (reference reflection frequency response) reflected inside the ear canal can be obtained by pre-testing based on the head simulation device, and the target ear canal frequency response at the eardrum can be estimated by combining the reference ear canal frequency response obtained by pre-testing based on the head simulation device and the ear canal reflection frequency response in the actual usage scenario.

In the embodiment of the disclosure, the reference ear canal frequency response is determined according to the frequency response to be processed and the device frequency response, the frequency response to be processed and the device frequency response may be subjected to difference processing, and the frequency response obtained through the difference processing is used as the reference ear canal frequency response, so that the determination efficiency and accuracy of the reference ear canal frequency response can be effectively improved.

For example, the frequency response to be processed determined based on the second electrical signal recorded by the second conversion device (microphone Mic) may be subtracted from the device frequency response (earphone speaker frequency response H1), and the result of the subtraction may be used as the artificial head-ear canal frequency response H2.

In an embodiment of the present disclosure, the electroacoustic conversion device may further include: a first transducer element having a corresponding element frequency response and a third transducer element located within the ear canal of the head simulator; the method includes the steps of obtaining a reference reflection frequency response, converting a first electric signal into a first sound signal based on a first conversion device, outputting the first sound signal to an ear canal of a head simulation device, collecting a third sound signal obtained by reflecting the first sound signal by the ear canal of the head simulation device based on a third conversion device, converting the third sound signal into a third electric signal, determining a frequency response to be processed according to the first electric signal and the third electric signal, determining a reference reflection frequency response according to the frequency response to be processed and a device frequency response, testing the head simulation device in advance, determining the reference reflection frequency response, and in the actual ear canal frequency response compensation process, directly obtaining the reference reflection frequency response obtained through testing to assist in ear canal frequency response compensation, so that accuracy and efficiency of the ear canal frequency response compensation can be effectively improved.

For example, in the embodiment of the present disclosure, an artificial head mapping method may be adopted, that is, when the artificial head measures the frequency response of the ear canal, the microphone of the electroacoustic conversion device (earphone) is used to measure the reflection frequency response of the artificial head, as shown in fig. 4 below:

as shown in fig. 4, fig. 4 is a schematic diagram illustrating in-ear frequency response composition of a head simulator according to another embodiment of the present disclosure, taking the head simulator as an artificial head for example, the artificial head may be tested in advance to obtain a frequency response at an eardrum in an ear of the artificial head as a reference ear canal frequency response (e.g., the artificial head ear canal frequency response H2 in fig. 4), and the first transducer element in the electroacoustic transducer device is tested to have a corresponding device frequency response (e.g., the earphone speaker frequency response H1 shown in fig. 4), the first transducer element in the electroacoustic transducer device is capable of converting a first electrical signal into a first sound signal and outputting the first sound signal into an ear canal of the head simulator (corresponding to the Input signal Input in fig. 4), then, a third sound signal obtained by reflecting the first sound signal in the ear canal of the artificial head may be recorded by a third conversion device (microphone Mic) in the electroacoustic conversion device, the third sound signal may be converted into a third electrical signal, a frequency response to be processed may be determined according to the first electrical signal and the third electrical signal, the frequency response to be processed may be obtained by performing spectrum analysis on the Input signal Input and the signal obtained by recording by the third conversion device (microphone Mic), the frequency response to be processed may be composed of two parts, for example, the earphone speaker frequency response H1 and the artificial head ear canal reflection frequency response H5 in fig. 4, the artificial head ear canal reflection frequency response H5 may be reversely deduced according to the frequency response to be processed and the device frequency response (earphone speaker frequency response H1), and the artificial head ear canal reflection frequency response H5 may be used as a reference reflection frequency response.

For example, the frequency response to be processed determined based on the third electrical signal recorded by the third conversion device (microphone Mic) and the device frequency response (earphone speaker frequency response H1) may be subtracted, and the result of the subtraction may be used as the artificial head-ear canal reflection frequency response H5.

S203: and determining the target ear canal frequency response according to the ear canal reflection frequency response, the reference ear canal frequency response and the reference reflection frequency response.

It can be understood that, in the embodiment of the present disclosure, the input signal input based on the head simulator frequency response is usually covered with the full frequency band, and the signal-to-noise ratio of each frequency band meets the test requirement, and there are usually frequency sweeping and white noise modes, and because the second conversion device (microphone Mic) of the head simulator is placed at the eardrum position, the frequency response of the ear canal of the head simulator mainly consists of the earphone speaker frequency response H1 and the artificial head ear canal frequency response H2. However, in the real usage scenario of the user, the second conversion device (microphone Mic) is actually located on the earphone, so the actual test results in the frequency response of the acoustic propagation path of the input signal emitted from the speaker, reflected to the second conversion device (microphone Mic) through the ear canal, and not to the eardrum of the user.

As shown in fig. 5 below, fig. 5 is a schematic diagram of an in-ear frequency response composition according to an embodiment of the present disclosure. In this embodiment of the present disclosure, referring to fig. 3 and fig. 4 together, because the frequency response of H1+ H5 is also tested in the above process of testing H1+ H2 based on the head simulation apparatus (artificial head), and because the ear canal frequency response and the ear canal reflection frequency response are mainly determined by the positions of the two microphones Mic (i.e., the second conversion device and the third conversion device) and the ear canal itself, it can be considered that the difference between the artificial head ear canal frequency response H2 and the artificial head ear canal reflection frequency response H5 is approximate, and the difference between the artificial head ear canal frequency response H2 and the artificial head ear canal reflection frequency response H4 has a certain mapping relationship with the difference between the target ear canal frequency response H3 and the ear canal reflection frequency response H4, that is, there is a function for deriving the target ear canal frequency response H3:

H3＝f(H2,H4,H5)；

then, a mapping function relationship between the difference between the artificial head ear canal frequency response H2 and the artificial head ear canal reflection frequency response H5 and the difference between the target ear canal frequency response H3 and the ear canal reflection frequency response H4 may be determined, and then, a function of the target ear canal frequency response H3 may be derived based on the mapping function relationship, which may be set based on experience, without limitation.

In some embodiments of the present disclosure, the target ear canal frequency response is determined according to the ear canal reflection frequency response, the reference ear canal frequency response, and the reference reflection frequency response, which may be a difference between the reference ear canal frequency response and the reference reflection frequency response to obtain a reference difference frequency response, and a sum between the reference difference frequency response and the ear canal reflection frequency response is processed, and the obtained sum is used as the target ear canal frequency response, so that the target ear canal frequency response can be conveniently determined in an application scenario in which differences between the ear canal frequency response and the ear canal reflection frequency response are fixed for ear canals of any shapes.

For example, H3= H2-H5+ H4, wherein the value of H2-H5 may be referred to as the reference difference frequency response.

S204: and determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for carrying out frequency response compensation on the filter.

S205: and sending the compensated filtering frequency response to the electronic equipment.

For the description of S204-S205, reference may be made to the above embodiments, which are not described herein again.

In this embodiment, the target ear canal frequency response is obtained by the electroacoustic conversion device, and the compensation filtering frequency response of the filter of the electronic device is determined according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter, and the compensation filtering frequency response is sent to the electronic device, so that the consumption of computing resources for ear canal frequency response compensation can be effectively reduced, the cruising ability of the electroacoustic conversion device is effectively prevented from being influenced, and the ear canal frequency response compensation efficiency is effectively improved. The realization tests head analogue means in advance to confirm and refer to duct frequency response and reference reflection frequency response, at the in-process that actually carries out duct frequency response compensation, can directly obtain the supplementary duct frequency response compensation that carries out of test gained reference duct frequency response and reference reflection frequency response, can effectively promote the rate of accuracy and the efficiency of duct frequency response compensation.

Fig. 6 is a schematic flow chart of a method for compensating for ear canal frequency response according to another embodiment of the disclosure.

As shown in fig. 6, the ear canal frequency response compensation method includes:

s601: and acquiring the target auditory canal frequency response.

S602: a reference ear canal frequency response is obtained.

For the description of S601-S602, reference may be made to the above embodiments, and details are not repeated herein.

S603: and determining the compensation filtering frequency response of a filter of the electronic equipment according to the target auditory canal frequency response and the reference auditory canal frequency response.

In some embodiments of the present disclosure, when determining the compensation filtering frequency response of the filter of the electronic device according to the target ear canal frequency response and the reference ear canal frequency response, the reference ear canal frequency response and the target ear canal frequency response may be subjected to a difference operation, and a frequency response obtained by the difference operation is used as the compensation filtering frequency response of the filter of the electronic device, so that the determination efficiency and accuracy of the compensation filtering frequency response can be effectively improved.

Examples are as follows: it can be understood that the ear canal calibration is to expect that all users can directly hear the earphone tone color frequency response designed by the disc-jockey, and the earphone tone color response can be regarded as an overall frequency response, as shown in fig. 7, fig. 7 is a schematic diagram of the in-ear frequency response composition of the head simulation apparatus in another embodiment of the present disclosure, and is exemplified by the head simulation apparatus as a dummy head, wherein the disc-jockey H6 is an equalizer EQ adjusted by the disc-jockey, and directly acts on the digital signal, and the target frequency response H _ tar can be calculated by recording the signal Record through the second conversion device (microphone Mic) and inputting the signal Input:

H_tar＝H1+H2+H6。

generally, the overall frequency response expected to be heard by the user is the same as H _ tar, while the frequency response path in the ear canal of the user is shown in fig. 8, fig. 8 is a schematic diagram of the in-ear frequency response composition in another embodiment of the present disclosure, and it is generally expected that the frequency response heard in the ear of the user is the same as the frequency response (H _ tar) recorded by the artificial head, then it follows:

compensating for the filtering frequency response H _ comp + H6+ H1+ H3= H _ tar = H1+ H2+ H6;

the available compensation filtering frequency response is: the compensation filtered frequency response H _ comp = H2-H3, i.e. compensation filtered frequency response = reference ear canal frequency response-target ear canal frequency response.

And if H3= H2-H5+ H4 (see above), the compensation filtering frequency response H _ comp = H5-H4 can be derived, without limitation.

S604: and sending the compensation filtering frequency response to the electronic equipment.

After the compensation filtering frequency response is calculated by the electroacoustic conversion device, the compensation filtering frequency response may be sent to the electronic device, and the electronic device performs frequency response compensation on the filter, for example, the compensation filtering frequency response may be sent based on a bluetooth communication method, which is not limited to this.

In this embodiment, the target ear canal frequency response is obtained by the electroacoustic conversion device, and the compensation filtering frequency response of the filter of the electronic device is determined according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter, and the compensation filtering frequency response is sent to the electronic device, so that the consumption of computing resources for ear canal frequency response compensation can be effectively reduced, the cruising ability of the electroacoustic conversion device is effectively prevented from being influenced, and the ear canal frequency response compensation efficiency is effectively improved. Therefore, the determining efficiency and accuracy of the compensation filtering frequency response can be effectively improved.

It should be noted that, in the following embodiments, descriptions of methods the same as or corresponding to those in the above embodiments may be referred to the above embodiments, and are not repeated herein.

Fig. 9 is a flowchart illustrating an ear canal frequency response compensation method according to another embodiment of the disclosure.

In this embodiment, for example, the ear canal frequency response compensation method is configured in an electronic device, and the electronic device includes: a filter that may be used to pre-process audio that a user listens to.

As shown in fig. 9, the ear canal frequency response compensation method includes:

s901: and receiving a compensation filtering frequency response sent by the electroacoustic conversion device, wherein the compensation filtering frequency response is obtained by acquiring a target auditory canal frequency response by the electroacoustic conversion device and determining according to the target auditory canal frequency response.

S902: and performing frequency response compensation on the filter according to the compensation filtering frequency response.

When the electronic device performs frequency response compensation on the filter according to the compensation filtering frequency response, the existing frequency response of the filter can be obtained, and then the compensation filtering frequency response and the existing frequency response are subjected to time domain or frequency domain convolution processing without limitation.

The ear canal frequency response compensation method provided in the embodiment of the present disclosure may be a distributed ear canal calibration process, including a detection part and an application part, where the detection part is executed by an electroacoustic conversion device, and the application part is executed by an electronic device, and the electroacoustic conversion device performs one-time processing on a recorded sound signal, that is, in the ear canal frequency response compensation process, when calculating a compensation filtering frequency response, a user wears the electroacoustic conversion device to test once, and then, when using this function each time, the calculated compensation filtering frequency response may be directly used, so that the endurance of the electroacoustic conversion device is not affected, and at the same time, the compensation filtering frequency response is transmitted to the electronic device, so that a 2-channel 1024-point 16-bit frequency response curve is used as a spectrum characteristic of the electroacoustic conversion device, and then the actually transmitted data amount is:

data size Sum =2 × 1024 × 16=32768bit;

it follows that an effective saving of data volume of nearly 100 times is obtained with respect to the direct transmission of recorded sound signals.

In the embodiment of the disclosure, the practical application of the filter can be configured on the electronic device, the power consumption of the electroacoustic conversion device can be more effectively saved, the endurance of the electroacoustic conversion device can be enhanced, and the filter with higher order and more accurate frequency response can be used because the calculation power of the processor of the electronic device is stronger, so that the practical use experience degree of the ear canal frequency response compensation is improved.

In this embodiment, the filter is disposed in the electronic device, and the electronic device receives a compensation filtering frequency response sent by the electroacoustic conversion device, where the compensation filtering frequency response is obtained by the electroacoustic conversion device and determined according to the target ear canal frequency response, and frequency response compensation is performed on the filter according to the compensation filtering frequency response.

Fig. 10 is a schematic structural diagram of an ear canal frequency response compensation device according to an embodiment of the present disclosure.

As shown in fig. 10, the ear canal frequency response compensation device 100 is applied to an electroacoustic conversion device, and includes:

an obtaining module 1001 is configured to obtain a target ear canal frequency response.

The determining module 1002 is configured to determine a compensation filtering frequency response of a filter of an electronic device according to the target ear canal frequency response, where the compensation filtering frequency response is used to perform frequency response compensation on the filter.

A sending module 1003, configured to send the compensation filtered frequency response to the electronic device.

In some embodiments of the present disclosure, the obtaining module 1001 is specifically configured to:

detecting the auditory canal reflection frequency response;

acquiring a reference auditory canal frequency response and a reference reflection frequency response;

and determining the target ear canal frequency response according to the ear canal reflection frequency response, the reference ear canal frequency response and the reference reflection frequency response.

In some embodiments of the present disclosure, the obtaining module 1001 is further configured to:

performing difference processing on the reference auditory canal frequency response and the reference reflection frequency response to obtain a reference difference value frequency response;

and summing the reference difference frequency response and the ear canal reflection frequency response, and taking the frequency response obtained by the summing as the target ear canal frequency response.

In some embodiments of the present disclosure, the determining module 1002 is specifically configured to:

acquiring a reference auditory canal frequency response;

and determining the compensation filtering frequency response of a filter of the electronic equipment according to the target auditory canal frequency response and the reference auditory canal frequency response.

In some embodiments of the present disclosure, the determining module 1002 is further configured to:

and (3) performing difference on the frequency response of the reference auditory canal and the frequency response of the target auditory canal, and using the frequency response obtained by difference as a compensation filtering frequency response of a filter of the electronic equipment.

In some embodiments of the present disclosure, an electroacoustic conversion apparatus includes: a first conversion device having a corresponding device frequency response and a second conversion device located at an eardrum location of the head simulator; the obtaining module 1001 or the determining module 1002 is further configured to:

converting the first electrical signal into a first sound signal based on the first conversion means, and outputting the first sound signal into an ear canal of the head simulator;

acquiring a second sound signal obtained by reflecting the first sound signal by an eardrum of the head simulation device based on a second conversion device, and converting the second sound signal into a second electric signal;

determining a frequency response to be processed according to the first electric signal and the second electric signal;

and determining the frequency response of the reference auditory canal according to the frequency response to be processed and the device frequency response.

In some embodiments of the present disclosure, the obtaining module 1001 or the determining module 1002 is further configured to:

and performing difference processing on the frequency response to be processed and the device frequency response, and taking the frequency response obtained by the difference processing as the reference auditory canal frequency response.

In some embodiments of the present disclosure, an electroacoustic conversion device includes: a first transducer element having a corresponding element frequency response and a third transducer element located within the ear canal of the head simulator; wherein, the obtaining module 1001 is further configured to:

acquiring a third sound signal obtained by reflecting the first sound signal by the auditory canal of the head simulation device based on a third conversion device, and converting the third sound signal into a third electric signal;

determining a frequency response to be processed according to the first electric signal and the third electric signal;

and determining a reference reflection frequency response according to the frequency response to be processed and the device frequency response.

It should be noted that the above explanation of the ear canal frequency response compensation method is also applicable to the ear canal frequency response compensation device of the present embodiment, and is not repeated herein.

In this embodiment, the target ear canal frequency response is obtained by the electroacoustic conversion device, and the compensation filtering frequency response of the filter of the electronic device is determined according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter, and the compensation filtering frequency response is sent to the electronic device, so that the consumption of computing resources for ear canal frequency response compensation can be effectively reduced, the cruising ability of the electroacoustic conversion device is effectively prevented from being influenced, and the ear canal frequency response compensation efficiency is effectively improved.

Fig. 11 is a schematic structural diagram of an ear canal frequency response compensation device according to another embodiment of the present disclosure.

As shown in fig. 11, the ear canal frequency response compensation apparatus 110 is applied to an electronic device, and the electronic device includes: a filter, comprising:

the receiving module 1101 is configured to receive a compensation filtering frequency response sent by the electroacoustic conversion device, where the compensation filtering frequency response is obtained by acquiring a target ear canal frequency response by the electroacoustic conversion device and is determined according to the target ear canal frequency response.

And the compensation module 1102 is configured to perform frequency response compensation on the filter according to the compensation filtering frequency response.

Fig. 12 is a schematic structural diagram of an electroacoustic conversion device according to an embodiment of the present disclosure.

As shown in fig. 12, the electroacoustic conversion device 120 includes:

at least one processor 1201; and

a memory 1202 communicatively coupled to the at least one processor 1201; wherein the content of the first and second substances,

the memory 1202 stores instructions executable by the at least one processor 1201, the instructions being executable by the at least one processor 1201 to enable the at least one processor 1201 to perform the ear canal frequency response compensation method described above in the embodiments of fig. 1-8.

It should be noted that the above explanation of the method for compensating the ear canal frequency response is also applicable to the electroacoustic conversion device 120 of the present embodiment, and is not repeated herein.

FIG. 13 illustrates a block diagram of an exemplary electronic device suitable for use in implementing embodiments of the present disclosure. The electronic device 12 shown in fig. 13 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 13, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. These architectures include, but are not limited to, industry Standard Architecture (ISA) bus, micro Channel Architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus, to name a few.

Electronic device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

Memory 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/or cache Memory 32. Electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 13, commonly referred to as a "hard drive").

Although not shown in FIG. 13, a disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk Read Only Memory (CD-ROM), a Digital versatile disk Read Only Memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the disclosure.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination of which may comprise an implementation of a network environment. Program modules 42 generally perform the functions and/or methodologies of the embodiments described in this disclosure.

Electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a person to interact with electronic device 12, and/or with any devices (e.g., network card, modem, etc.) that enable electronic device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network such as the Internet) via the Network adapter 20. As shown, the network adapter 20 communicates with the other modules of the electronic device 12 over the bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processing unit 16 executes various functional applications and data processing, such as implementing the ear canal frequency response compensation method mentioned in the foregoing embodiments, by executing programs stored in the system memory 28.

In order to achieve the above embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium on which a computer program is stored, which when executed by a processor implements the ear canal frequency response compensation method as proposed by the aforementioned embodiments of the present disclosure.

In order to implement the above embodiments, the present disclosure also proposes a computer program product, wherein when the instructions in the computer program product are executed by a processor, the ear canal frequency response compensation method proposed by the foregoing embodiments of the present disclosure is executed.

It should be noted that, in the description of the present disclosure, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present disclosure, "a plurality" means two or more unless otherwise specified.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present disclosure includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present disclosure.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present disclosure may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.

In the description of the present specification, reference to the description of "one embodiment," "some embodiments," "an example," "a specific example," or "some examples" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure, and that changes, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present disclosure.

Claims

1. An ear canal frequency response compensation method, performed by an electroacoustic conversion device, the method comprising:

acquiring a target auditory canal frequency response;

determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for performing frequency response compensation on the filter; and

and sending the compensation filtering frequency response to the electronic equipment.

2. The method of claim 1, wherein said obtaining a target ear canal frequency response comprises:

detecting the ear canal reflection frequency response;

3. The method of claim 2, wherein said determining said target ear canal frequency response from said ear canal reflection frequency response, said reference ear canal frequency response, and said reference reflection frequency response comprises:

performing difference processing on the reference ear canal frequency response and the reference reflection frequency response to obtain a reference difference value frequency response;

and performing sum processing on the reference difference frequency response and the ear canal reflection frequency response, and taking the frequency response obtained through the sum processing as the target ear canal frequency response.

4. The method of claim 1, wherein determining a compensated filter frequency response of a filter of an electronic device based on the target ear canal frequency response comprises:

acquiring a reference auditory canal frequency response;

5. The method of claim 4, wherein determining a compensated filter frequency response of a filter of an electronic device based on the target ear canal frequency response and the reference ear canal frequency response comprises:

and performing difference on the frequency response of the reference auditory canal and the frequency response of the target auditory canal, and using the frequency response obtained by difference as the compensation filtering frequency response of a filter of the electronic equipment.

6. The method of any one of claims 2-5, wherein said electro-acoustic conversion device comprises: a first conversion device having a corresponding device frequency response and a second conversion device located at an eardrum location of the head simulator; the acquiring of the reference ear canal frequency response comprises:

converting the first electrical signal into a first sound signal based on the first conversion means and outputting the first sound signal into an ear canal of the head simulator;

acquiring a second sound signal obtained by reflecting the first sound signal by an eardrum of the head simulation device based on the second conversion device, and converting the second sound signal into the second electric signal;

7. The method of claim 6, wherein said determining said reference ear canal frequency response from said to-be-processed frequency response and said device frequency response comprises:

8. The method of any one of claims 2-3, wherein said electro-acoustic conversion device comprises: a first conversion means having a corresponding device frequency response and a third conversion means located within the ear canal of the head simulator; wherein, obtain reference reflection frequency response, include:

acquiring a third sound signal obtained by reflecting the first sound signal by the ear canal of the head simulation device based on the third conversion device, and converting the third sound signal into a third electric signal;

and determining the reference reflection frequency response according to the frequency response to be processed and the device frequency response.

9. An ear canal frequency response compensation method, performed by an electronic device, the electronic device comprising: a filter, the method comprising:

receiving a compensation filtering frequency response sent by an electroacoustic conversion device, wherein the compensation filtering frequency response is obtained by acquiring a target ear canal frequency response by the electroacoustic conversion device and determining according to the target ear canal frequency response;

and performing frequency response compensation on the filter according to the compensation filtering frequency response.

10. An ear canal frequency response compensation device, for use in an electroacoustic conversion device, the device comprising:

the acquisition module is used for acquiring the frequency response of the target auditory canal;

the determining module is used for determining a compensation filtering frequency response of a filter of the electronic equipment according to the target ear canal frequency response, wherein the compensation filtering frequency response is used for carrying out frequency response compensation on the filter; and

and the sending module is used for sending the compensation filtering frequency response to the electronic equipment.

11. The apparatus of claim 10, wherein the acquisition module is specifically configured to:

detecting the ear canal reflection frequency response;

12. The apparatus of claim 11, wherein the obtaining module is further configured to:

13. The apparatus of claim 10, wherein the determination module is specifically configured to:

acquiring a reference auditory canal frequency response;

14. The apparatus of claim 13, wherein the determination module is further configured to:

15. The apparatus of any one of claims 11-14, wherein said electro-acoustic conversion means comprises: a first conversion device having a corresponding device frequency response and a second conversion device located at an eardrum location of the head simulator; the obtaining module or the determining module is further configured to:

16. The apparatus of claim 15, wherein the obtaining module or the determining module is further configured to:

17. The apparatus of any one of claims 11-12, wherein said electro-acoustic conversion means comprises: a first conversion means having a corresponding device frequency response and a third conversion means located within the ear canal of the head simulator; wherein the obtaining module is further configured to:

18. An ear canal frequency response compensation device, applied to an electronic device, the electronic device comprising: a filter, the apparatus comprising:

the receiving module is used for receiving a compensation filtering frequency response sent by the electroacoustic conversion device, wherein the compensation filtering frequency response is obtained by acquiring a target ear canal frequency response by the electroacoustic conversion device and determining the compensation filtering frequency response according to the target ear canal frequency response;

and the compensation module is used for carrying out frequency response compensation on the filter according to the compensation filtering frequency response.

19. An electro-acoustic conversion device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.

20. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of claim 9.

21. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-9.

22. A computer program product, characterized in that it comprises a computer program which, when being executed by a processor, carries out the steps of the method according to any one of claims 1-9.