WO2023016208A1

WO2023016208A1 - Audio signal compensation method and apparatus, earbud, and storage medium

Info

Publication number: WO2023016208A1
Application number: PCT/CN2022/106733
Authority: WO
Inventors: 练添富
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-08-13
Filing date: 2022-07-20
Publication date: 2023-02-16
Also published as: CN115706885A

Abstract

An audio signal compensation method and apparatus, an earbud, and a storage medium. The method is applied to the earbud. The earbud comprises a loudspeaker. The method comprises: respectively outputting, by means of the loudspeaker, test audio signals corresponding to M detection frequency points, and respectively obtaining hearing detection results fed back for the test audio signals corresponding to the M detection frequency points; and determining compensation parameters respectively corresponding to N detection frequency points according to the hearing detection results respectively corresponding to the M detection frequency points, the compensation parameters being used for respectively compensating, on frequency bands respectively corresponding to the N detection frequency points, a target audio signal to be output, wherein N and M are both positive integers, M is less than or equal to N, and the N detection frequency points may comprise the M detection frequency points. By implementing embodiments of the present application, compensation parameters required for compensating the audio signal can be conveniently and quickly determined, thereby improving the efficiency of audio signal compensation.

Description

Audio signal compensation method and device, earphone, storage medium

This application claims the priority of the Chinese patent application filed on August 13, 2021, with the application number 202110928003.1, and the title of the invention is "Audio signal compensation method and device, earphone, storage medium", the entire content of which is incorporated by reference in this application middle.

technical field

The present application relates to the technical field of audio processing, in particular to an audio signal compensation method and device, earphones, and storage media.

Background technique

At present, in scenarios where users use earphones to listen to music, watch videos (that is, the audio signal corresponding to the earphone output video), and make a call, the earphone can compensate the output audio signal according to the differences in the hearing characteristics of different users. . However, it is found in practice that traditional audio signal compensation schemes often require complex hearing detection and parameter calculation processes, making the process of audio signal compensation extremely slow and reducing the efficiency of audio signal compensation.

Contents of the invention

The embodiment of the present application discloses an audio signal compensation method and device, an earphone, and a storage medium, which can conveniently and quickly determine compensation parameters required for audio signal compensation, thereby improving the efficiency of audio signal compensation.

The first aspect of the embodiment of the present application discloses an audio signal compensation method, which is applied to earphones, the earphones include speakers, and the method includes:

Outputting test audio signals corresponding to M detection frequency points respectively through the speakers, and respectively obtaining hearing detection results fed back to the test audio signals corresponding to the M detection frequency points;

According to the hearing test results respectively corresponding to the M detection frequency points, the compensation parameters corresponding to the N detection frequency points are determined, and the compensation parameters are used to correspond to the N detection frequency points respectively for the target audio signal to be output. Compensation is performed on the frequency bands respectively, wherein the N and M are both positive integers, and the M is less than or equal to the N, and the N detection frequency points include the M detection frequency points.

The second aspect of the embodiment of the present application discloses an audio signal compensation device, which is applied to an earphone, the earphone includes a speaker, and the audio signal compensation device includes:

An output unit, configured to respectively output test audio signals corresponding to M detection frequency points through the speaker, and obtain hearing test results respectively corresponding to the M detection frequency points fed back to the test audio signal;

The determination unit is configured to determine compensation parameters corresponding to each of the N detection frequency points according to the hearing detection results corresponding to the M detection frequency points, and the compensation parameters are used for the target audio signal to be output when it is in relation to the N detection frequency points. Compensation is performed on the respective frequency bands corresponding to the detection frequency points, wherein the N and M are both positive integers, and the M is less than or equal to the N, and the N detection frequency points include the M detection frequency points .

The third aspect of the embodiment of the present application discloses an earphone, including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor realizes the implementation of the present application. For example, all or part of the steps in any audio signal compensation method disclosed in the first aspect.

The fourth aspect of the embodiment of the present application discloses a computer-readable storage medium, which stores a computer program, wherein, when the computer program is executed by a processor, any audio signal compensation as disclosed in the first aspect of the embodiment of the present application is realized. All or part of the steps in the method.

The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features and beneficial effects of the present application will emerge from the description, drawings and claims.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the accompanying drawings that need to be used in the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.

FIG. 1A is a schematic diagram of an application scenario of the audio signal compensation method disclosed in the embodiment of the present application;

FIG. 1B is a schematic diagram of another application scenario of the audio signal compensation method disclosed in the embodiment of the present application;

Fig. 2 is a schematic structural diagram of an earphone disclosed in an embodiment of the present application;

FIG. 3 is a schematic flowchart of an audio signal compensation method disclosed in an embodiment of the present application;

Fig. 4 is a schematic flowchart of another audio signal compensation method disclosed in the embodiment of the present application;

FIG. 5 is a schematic diagram of a frequency response of a target compensation filter disclosed in an embodiment of the present application;

Fig. 6 is a schematic diagram of the effect of audio signal compensation by the target compensation filter shown in Fig. 5;

FIG. 7 is a schematic diagram of the frequency response of another target compensation filter disclosed in the embodiment of the present application;

Fig. 8 is a schematic diagram of the effect of audio signal compensation by the target compensation filter shown in Fig. 7;

FIG. 9 is a schematic flowchart of another audio signal compensation method disclosed in the embodiment of the present application;

FIG. 10 is a schematic diagram of an interface of a terminal device outputting adjustment interaction information disclosed in an embodiment of the present application;

Fig. 11 is a modular schematic diagram of an audio signal compensation device disclosed in an embodiment of the present application;

Fig. 12 is a schematic modular diagram of an earphone disclosed in an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

It should be noted that the terms "comprising" and "having" and any variations thereof in the embodiments of the present application are intended to cover non-exclusive inclusion, for example, a process, method, system, product, or process that includes a series of steps or units. The apparatus is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to the process, method, product or apparatus.

A detailed description will be given below in conjunction with the accompanying drawings.

Please refer to Figure 1A and Figure 1B together, Figure 1A is a schematic diagram of an application scenario of the audio signal compensation method disclosed in the embodiment of the application, and Figure 1B is another application scenario of the audio signal compensation method disclosed in the embodiment of the application schematic diagram. As shown in FIG. 1A, the application scenario may include a user 10 and an earphone 20, and the user 10 may independently perform a hearing test through the earphone 20, so that the earphone 20 may obtain the corresponding hearing test result of the user 10, and then the earphone 20 may obtain the corresponding hearing test result according to the hearing test result. A corresponding compensation parameter is determined, and corresponding audio signal compensation is implemented based on the compensation parameter. By realizing the above-mentioned audio signal compensation, the earphone 20 can detect the target audio signal to be output at different detection frequencies according to the hearing characteristics of the user 10 (for example, there are different degrees of hearing impairment, different sensitivities to audio signals of different frequencies, etc.). Different degrees of compensation are performed on the frequency bands corresponding to the points, so that the compensated target audio signal can be more suitable for the hearing characteristics of the user 10, which helps to improve the listening effect of the user 10 when receiving the target audio signal (for example, can hear clearer and more comfortable).

Exemplarily, when it is necessary to perform hearing detection on the user 10 to perform corresponding audio signal compensation, the user 10 may interact with the earphone 20 and send a hearing detection instruction to the earphone 20 to trigger the earphone 20 to start hearing detection. Specifically, the hearing test can be performed using test audio signals corresponding to M (M is a positive integer) detection frequency points, the M detection frequency points can be preset, and can respectively correspond to a certain frequency range, that is, each frequency range representative frequency points in the For example, the above detection frequency points may include low and medium frequency points such as 500 Hz, 1000 Hz, and 2000 Hz, and may also include high frequency points such as 4000 Hz, 6000 Hz, and 8000 Hz. On this basis, the earphone 20 can respectively output the test audio signals corresponding to the above-mentioned M detection frequency points, and respectively collect the feedback situation of the user 10 for each test audio signal, based on which the hearing characteristics of the user in different frequency bands (that is, the hearing characteristics of the user) can be analyzed. Sensitivity of audio signals in different frequency bands) to conduct a more comprehensive evaluation to obtain the corresponding hearing test results; at the same time, setting a fixed number of detection frequency points is also conducive to reducing the number of detection times and saving detection time.

In the embodiment of the present application, the earphone 20 can respectively output the test audio signals corresponding to the above-mentioned M detection frequency points through its built-in speakers, and then can respectively obtain the hearing detection signals fed back by the test audio signals corresponding to the M detection frequency points. result. On this basis, the earphone 20 can determine the compensation parameters corresponding to each of the N (N is a positive integer) detection frequency points according to the hearing test results corresponding to the above M detection frequency points, and the compensation parameters can be used for output Compensation is performed on the target audio signal of the target audio signal in frequency bands corresponding to the N detected frequency points respectively. It should be noted that, besides being positive integers, the aforementioned N and M also need to meet the condition that M is less than or equal to N, that is, the N detection frequency points targeted by the earphone 20 when determining the compensation parameters may include other The M detection frequency points for hearing detection.

By implementing the embodiment of the present application, according to the hearing detection results of the earphone 20 for several detection frequency points (that is, the above-mentioned M detection frequency points), it is possible to determine the same or even more frequency points (that is, the above-mentioned N detection frequency points) corresponding Compensation parameters, and then the determined compensation parameters can be used to compensate the signal components of each frequency band of the target audio signal in the frequency bands corresponding to the corresponding frequency points. Based on this relatively simple process, the compensation parameters required for compensating the target audio signal can be determined quickly and conveniently, which avoids the complicated process required for hearing detection and parameter calculation by professional doctors or users themselves in related technologies , and can efficiently determine compensation parameters corresponding to multiple detection frequency points, thereby greatly improving the efficiency of audio signal compensation.

Optionally, as shown in FIG. 1B, the earphone 20 can also be connected to the terminal device 30, so that when the above-mentioned hearing test needs to be performed on the user 10, the user 10 can also interact with the terminal device 30, so as to pass the terminal device 30 to the The earphone 20 issues a hearing test instruction, and triggers the earphone 20 to start hearing test. Exemplarily, the above-mentioned terminal device 30 may include various devices or systems with wireless communication functions, such as mobile phones, smart wearable devices, vehicle-mounted terminals, tablet computers, PCs (Personal Computers, personal computers), PDAs (Personal Digital Assistants, personal digital assistant), etc., are not specifically limited in this embodiment of the application. It should be noted that when the earphone 20 obtains the hearing test result fed back by the user 10 for the test audio signal, it may obtain the hearing test result fed back directly by the user 10 through the earphone 20; or the terminal device 30 may obtain the feedback from the user 10. After the hearing test result, the earphone 20 communicates with the terminal device 30 again to obtain the hearing test result sent by the terminal device 30 .

It should be noted that, in the embodiment of the present application, the earphone 20 may also be provided with a feedback microphone and a feedforward microphone in addition to a speaker. For example, please refer to FIG. 2 , which is a schematic structural diagram of an earphone 20 disclosed in an embodiment of the present application. As shown in FIG. 2 , the earphone 20 may include a speaker 21 , a feedback microphone 22 and a feedforward microphone 23 . Wherein, when the user 10 wears the earphone 20, its feedback microphone 22 can be between the speaker 21 and the user 10, and its feedforward microphone 23 can be arranged behind the speaker 21 (that is, when the user wears the earphone, the feedforward microphone is in the between the speaker and the external environment). It can be understood that the feedback microphone 22 can be used to receive the audio signal output by the speaker 21 and the echo, noise, etc. inside the earphone 20, while the feedforward microphone 23 can be used to collect ambient sound, so as to cooperate to realize ANC (Active Noise Cancellation) , Active Noise Reduction) and other functions to assist the above hearing detection and audio signal compensation steps, so as to improve the accuracy and reliability of audio signal compensation.

Please refer to FIG. 3 . FIG. 3 is a schematic flowchart of an audio signal compensation method disclosed in an embodiment of the present application. The method may be applied to the above-mentioned earphone, and the earphone may include a loudspeaker. As shown in Figure 3, the audio signal compensation method may include the following steps:

302. Output test audio signals corresponding to the M detection frequency points respectively through the loudspeaker, and respectively obtain hearing test results fed back to the test audio signals corresponding to the M detection frequency points.

In the embodiment of the present application, in order to perform corresponding audio signal compensation according to the user's hearing characteristics (such as different degrees of hearing impairment, different sensitivities to audio signals of different frequencies, etc.), it is necessary to first obtain the user's corresponding hearing Test results. Specifically, after the user puts on the earphone, the earphone can output test audio signals corresponding to a plurality of detection frequency points through its built-in speaker, and the user can respectively give feedback on each test audio signal, so that the earphone can obtain the user's target audio frequency respectively. Hearing test results respectively corresponding to the multiple detection frequency points fed back by the multiple detection frequency points.

Exemplarily, the earphone may be set with M detection frequency points, where M is a positive integer. When it is necessary to perform a hearing test on the user (such as when the user wears the earphone for the first time and calibrates the earphone at certain intervals), the earphone can determine the corresponding M test audio signals based on the above M detection frequency points . The test audio signal may include pure tone signals at various detection frequency points (such as 500 Hz, 1000 Hz, etc.), that is, audio signals that only consist of audio signal components corresponding to the detection frequency points and do not contain audio signal components of other frequencies. Using the pure tone signal as the test audio signal can accurately determine the hearing sensitivity of the user at each detection frequency point through the subsequent hearing detection process. Further, after the earphone has determined the test audio signals corresponding to the above-mentioned M detection frequency points, the test audio signal in the form of an electrical signal can be converted into a corresponding sound wave vibration through its speaker, so as to output each test audio signal to the user respectively, so that In the subsequent steps, the feedback of whether the user listens to each test audio signal is obtained, and then the hearing test result fed back by the user for each test audio signal is obtained.

On this basis, when the earphone obtains the hearing detection result for the feedback of the above-mentioned test audio signal, it can be realized through interaction with the user, that is, based on whether the user listens to the feedback of the test audio signal corresponding to a certain detection frequency point, determine whether the hearing test result is related to the test audio signal. The hearing test result corresponding to the detection frequency point. Wherein, the above-mentioned hearing test result may include the subjective judgment information of whether the user listens to the test audio signal, and may also include the critical sound intensity further determined according to the above-mentioned subjective judgment information (that is, when the user just can hear the test audio signal, the test audio sound level of the signal), the audible sound level range, etc.

In an embodiment, when the user obtains the above-mentioned feedback hearing test result only through the earphone, it may be realized by detecting the user's operation on the earphone. Exemplarily, user operations on the headset may include touch operations, voice operations, mobile operations, and the like.

For example, when the user listens to the test audio signal, he can touch the specified touch point on the earphone, so that when the earphone detects the touch operation on the above-mentioned specified touch point, it can determine the hearing ability of the user to hear the test audio signal. state, and then obtain the corresponding hearing test results.

For another example, when the user listens to the test audio signal, the voice command of "heard" can be issued directly; and when the user does not listen to the test audio signal, the voice command of "not heard" can be directly issued, so that the earphone The detected voice commands can be analyzed to determine whether the user has heard the test audio signal.

For another example, the user can also move, rotate or shake the head in different directions according to whether the test audio signal is heard or not, so that the earphone can detect its own motion state through the sensor to determine whether the corresponding user listens to the test audio signal or not. to test the hearing status of the audio signal. Specifically, for example, when the user listens to the test audio signal, the head can be tilted to the left so that the earphone can detect the trend of moving to the left; when the user does not listen to the test audio signal, the head can be tilted to the right to make The earphone detects a tendency to move to the right, and then the earphone can determine the audiometry result fed back by the user for the test audio signal according to the detected movement tendency. For another example, when the user listens to the test audio signal, the head can be turned horizontally to the left (or horizontally to the right); when the user does not listen to the test audio signal, the head can be turned horizontally to the right ( or turn horizontally to the left), so that the earphone can determine the hearing test result fed back by the user to the test audio signal according to the motion trajectory detected by the earphone. For another example, when the user listens to the test audio signal, the head can be shaken back and forth (i.e. nodding); The audiometry result fed back by the user to the test audio signal can be determined according to the detected motion direction or frequency.

In another embodiment, when the user obtains the above-mentioned feedback hearing test result through a terminal device communicatively connected with the earphone, it may also be realized by obtaining user operations on the terminal device. Exemplarily, user operations on the terminal device may include touch operations, button click operations, and the like. When the terminal device detects the above user operation, it may determine whether the user has heard the hearing state of the test audio signal according to the user operation, and send the hearing state to the earphone. On this basis, the earphone can further obtain the hearing detection result fed back to the above-mentioned test audio signal according to the hearing state it receives.

304. According to the hearing test results corresponding to the above M detection frequency points, determine the compensation parameters corresponding to the N detection frequency points respectively, and the compensation parameters are used for the target audio signal to be output at the respective corresponding to the N detection frequency points Compensation is performed on frequency bands respectively, where N and M are both positive integers, and M is less than or equal to N, and the N detection frequency points may include the aforementioned M detection frequency points.

In the embodiment of the present application, after the earphone obtains the hearing test results corresponding to the above M detection frequency points, it can analyze the hearing test results through its built-in processor, and then determine N detection frequency points based on the analysis Corresponding compensation parameters. Wherein, N is also a positive integer, and the value of M above is smaller than the value of N.

In some embodiments, if M=N, then the N detection frequency points targeted by the earphone when determining the compensation parameters correspond to the M detection frequency points targeted by the hearing test, and the earphone can obtain The M hearing test results for each of the M hearing test results are used to determine the compensation parameters corresponding to the M test frequency points.

In some other embodiments, if M<N, the N detection frequency points targeted by the earphone when determining the compensation parameters may include the M detection frequency points targeted for the hearing test, and other frequency points not tested for hearing. One or more frequency points detected. Therefore, after the earphone determines the compensation parameters corresponding to the M detection frequency points respectively according to the obtained M hearing test results, it can further determine that the above N detection frequency points are not included in the M detection frequency points. Compensation parameters corresponding to other frequency points in , so that compensation parameters corresponding to more detection frequency points can be quickly determined, so as to improve the efficiency of subsequent audio signal compensation.

It should be noted that the hearing test results corresponding to the above M detection frequency points can represent the user's hearing sensitivity to different frequency components of the audio signal (ie, the frequency components corresponding to the above M detection frequency points). For example, if it is determined according to the hearing test result that the user's hearing sensitivity at a certain detection frequency point is low, that is, the user is not easy to hear the audio signal of the frequency component, then the frequency component of the audio signal can be enhanced subsequently; If it is determined according to the hearing test results that the user's hearing sensitivity at a certain detected frequency point is too high, that is, the user is easily stimulated by the audio signal of this frequency component, then the frequency component of the audio signal can be retained or weakened. It can be understood that the above-mentioned measures to enhance, retain or weaken the audio signal are only some examples of the compensation measures for the audio signal, and various degrees and methods of compensation can also be performed in practical applications. The compensation measures taken are determined by the above-mentioned N The compensation parameters corresponding to each of the detection frequency points are determined, which may or may not be related to the user's hearing sensitivity to different frequency components of the audio signal.

Exemplarily, the above-mentioned compensation parameters may include filter parameters (such as tap coefficients for configuring filters, or specific gain coefficients, center frequencies, etc.), so that the earphones can be based on the compensation parameters corresponding to each of the N detection frequency points, Corresponding filters are respectively configured to perform compensation filtering on frequency bands corresponding to each detection frequency point. For example, when it is necessary to compensate the audio signal of a specific frequency band, it can be compensated and filtered by configuring a band-pass filter or a band-stop filter of the corresponding frequency band; when it is necessary to perform more complex compensation for audio signals of multiple frequency bands When, you can also perform corresponding compensation filtering by configuring cascaded FIR (Finite Impulse Response, finite-length unit impulse response) filters or IIR (Infinite Impulse Response, infinite-length unit impulse response) filters.

It can be seen that, implementing the audio signal compensation method described in the above embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing test results of the earphones for several detection frequency points, and then the determined compensation parameters can be It is used to compensate the signal components of each frequency band of the target audio signal in the frequency bands corresponding to the corresponding frequency points. Based on the above-mentioned concise process, the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, which not only avoids the complicated process of hearing detection and parameter calculation by professional doctors or users themselves in related technologies, but also can efficiently Compensation parameters corresponding to multiple detection frequency points are accurately determined, thereby improving the efficiency of compensating audio signals.

Please refer to FIG. 4 . FIG. 4 is a schematic flowchart of another audio signal compensation method disclosed in an embodiment of the present application. The method may be applied to the above-mentioned earphone, and the earphone may include a speaker and a feedback microphone. As shown in Figure 4, the audio signal compensation method may include the following steps:

402. Output test audio signals corresponding to M detection frequency points respectively through the loudspeaker, and respectively obtain hearing detection results fed back to the test audio signals corresponding to the M detection frequency points.

404. According to the hearing test results corresponding to the above-mentioned M detection frequency points, determine the compensation parameters corresponding to the N detection frequency points respectively, and the compensation parameters are used for the target audio signal to be output at the respective corresponding to the N detection frequency points Compensation is performed on frequency bands respectively, where N and M are both positive integers, and M is less than or equal to N, and the N detection frequency points may include the aforementioned M detection frequency points.

Wherein, step 402 and step 404 are similar to the above-mentioned step 302 and step 304 . It should be noted that, if the aforementioned M is equal to N, the N detection frequency points targeted by the earphone when determining the compensation parameters correspond to the M detection frequency points targeted by the hearing test, then the earphone can be based on The obtained M hearing test results are used to determine the compensation parameters corresponding to the above M detected frequency points respectively.

In the embodiment of the present application, the hearing test result corresponding to a certain detection frequency point may include a sound intensity threshold, and the sound intensity threshold may be the critical sound intensity at which the user can hear the test audio signal corresponding to the detection frequency point (that is, the user just the sound level at which the test audio signal can be heard). In some embodiments, the earphone can query the compensation parameters corresponding to each detection frequency point based on the sound intensity thresholds corresponding to the above M detection frequency points through table lookup; in other embodiments, the earphone can also Using the mapping relationship between the sound intensity threshold and the compensation parameter, the sound intensity thresholds corresponding to the above M detection frequency points are respectively substituted into the corresponding mapping relationship to calculate the compensation parameters corresponding to each detection frequency point.

Specifically, taking table lookup as an example, the earphone may have a built-in compensation mapping table, and the compensation mapping table may include mapping relationships between sound intensity thresholds and compensation parameters corresponding to each detected frequency point. On this basis, after the earphone obtains the hearing test results corresponding to the above-mentioned M detection frequency points, it can use the sound intensity threshold included in the hearing test results, that is, according to the sound intensity corresponding to the M detection frequency points. Threshold, the compensation parameters corresponding to the M detection frequency points are respectively queried on the compensation mapping table. By implementing the above table look-up method, the compensation parameters corresponding to the M detection frequency points can be quickly obtained, thereby speeding up the efficiency of subsequent configuration of the compensation filter based on the compensation parameters, and further improving the response to the target audio signal through the compensation filter. Compensation efficiency.

In some embodiments, before the earphone queries the compensation parameters through the above-mentioned compensation mapping table, it can also divide the obtained hearing test results into different compensation levels, and then determine the corresponding compensation level according to the sound intensity thresholds of different compensation levels. parameter. Exemplarily, the earphone can respectively determine the compensation levels that match the sound intensity thresholds according to the sound intensity thresholds corresponding to the above M detection frequency points, and then based on the compensation levels corresponding to the M detection frequency points, in the compensation The compensation parameters corresponding to the M detection frequency points are respectively queried on the mapping table. It can be understood that, for different compensation levels, the compensation degree of the audio signal compensation performed by the earphone may be different. Exemplarily, in some embodiments, when the hearing test result indicates that the user's hearing impairment is relatively large, it may be determined that the compensation level matching the hearing test result is a relatively high compensation level, so that the subsequent output When the target audio signal is compensated, a larger gain factor, a smaller quality factor, etc. can be provided. In some other embodiments, when the hearing test result indicates that the user's hearing impairment is relatively small, a lower compensation level can be determined accordingly, so that a smaller gain can be provided when compensating the target audio signal to be output subsequently coefficients, larger quality factors, etc.

Wherein, the above-mentioned compensation mapping table may be obtained by using a sample data set for training, and the sample data set includes sample sound intensity thresholds and sample compensation parameters respectively corresponding to a plurality of sample frequency points. Therefore, using the above-mentioned compensation mapping table, based on the experimental experience of a large number of sample data, the accuracy of the determined compensation parameters (especially the gain coefficient) corresponding to each detection frequency point can be improved, so that the target audio signal can be detected at each detection frequency. Perform more accurate compensation (especially gain compensation) on the frequency band corresponding to the point to improve the user's listening experience.

As an optional implementation, according to the hearing test result fed back by the user, the earphone can also make differential adjustments to the compensation parameters corresponding to each detected frequency point based on the user's sensitivity to different frequency audio signals. Taking the gain coefficient as an example, the headset can set the gain coefficient corresponding to the frequency points with better hearing characteristics of the user (that is, the user's higher sensitivity) as an attenuating gain coefficient, such as taking a negative value and subtracting the specified gain adjustment coefficient etc.; at the same time, the gain coefficient corresponding to the frequency points with poor hearing characteristics of the user (that is, the user's low sensitivity) can also be set as an enhanced gain coefficient, such as taking a positive value, adding a specified gain adjustment coefficient, and the like. Therefore, the earphone can not only flexibly adjust the target audio signal to be output, but also realize overall audio signal processing, so that the compensated system frequency response curve is smoother and the sound quality is more comfortable.

In some embodiments, even if the hearing test results fed back by the user indicate that the user has similar or the same sensitivity to audio signals of different frequencies, the earphone can still set default compensation parameters. Exemplarily, if the hearing test results corresponding to the above M detection frequency points all belong to the first range (for example, the sound intensity thresholds corresponding to the M detection frequency points belong to the same threshold range), then the earphone can use the N detection frequency points The compensation parameters corresponding to the respective frequency points are determined as default parameters. Still taking the gain coefficient as an example, configuring the target compensation filter based on the default gain coefficient can compensate the target audio signal to be output to a certain extent, so that the user can clearly feel the effect of optimized compensation and further improve the user experience.

In some embodiments, the earphone can also perform corresponding weighting processing on the above-mentioned hearing test results in advance for different detection frequency points, so that when the compensation parameters corresponding to each detection frequency point are subsequently determined according to the hearing test results, it can be realized. Adjusting the compensation parameters above has a similar effect. For example, the earphone can assign certain weights to the corresponding hearing test results for detection frequency points such as 4000 Hz and 6000 Hz, so that corresponding compensation filters can be conveniently configured to adjust the frequency bands where the difference in hearing characteristics among the crowd is generally not obvious. Achieve targeted compensation. By implementing the above method, it is not only beneficial to reflect the difference before and after audio signal compensation, but also beneficial to realize personalized and customized audio signal compensation, and further improve user experience.

406. The above-mentioned compensation parameters include compensation filter parameters, and N target compensation filters are respectively configured according to the compensation filter parameters corresponding to the above-mentioned N detection frequency points, wherein the center frequencies of the N target compensation filters are respectively related to the N There is a one-to-one correspondence between the detection frequency points.

In the embodiment of the present application, the target compensation filter may include an infinite-length unit impulse response IIR filter. Exemplarily, when a second-order IIR filter is used as the target compensation filter, the second-order IIR filter can be expressed by the difference equation shown in Formula 1 as follows:

Formula 1:

Among them, a _i and b _i can be calculated using different calculation methods according to the type of the second-order IIR filter adopted, and both a _i and b _i can be calculated with the center frequency f ₀ of the compensation filter (with the above N Corresponding to the detection frequency point), the sampling rate f _s of the target audio signal to be output, the gain coefficient Gain value of the compensation filter, and the quality factor Q value of the compensation filter. Optionally, the above-mentioned filter type of the second-order IIR filtering may include a Lowshelf Filter, a Highshelf Filter, a Peaking Filter, etc., which are not specifically limited in this embodiment of the present application.

Optionally, if the above-mentioned compensation parameters are determined before the headset leaves the factory (for example, according to manual experience or big data analysis results, corresponding compensation parameters are specified in advance for several typical and common hearing test results), the headset can directly obtain each The compensation parameter corresponding to the frequency point is detected, and a corresponding compensation filter is configured according to the compensation parameter, so as to compensate the target audio signal to be output by the speaker.

408 . Through the N target compensation filters, respectively perform nonlinear compensation on the frequency bands centered on the N detection frequency points on the target audio signal to be output.

In the embodiment of the present application, the earphone may cascade the above-mentioned N target compensation filters, and perform nonlinear compensation on the target audio signal to be output through the cascaded N target compensation filters. Exemplarily, please refer to FIG. 5 and FIG. 6 together. FIG. 5 is a schematic diagram of the frequency response of a target compensation filter disclosed in the embodiment of the present application, and FIG. A schematic diagram of the effect of signal compensation, wherein the dotted line in FIG. 6 represents the system frequency response before filter compensation, and the solid line represents the system frequency response after filter compensation. It can be understood that the aforementioned target compensation filter may be an overall filter obtained by cascading the aforementioned N target compensation filters. As shown in FIG. 5 , since the magnitude response of the target compensation filter in the frequency band corresponding to each detection frequency point is nonlinear, its corresponding compensation effect may also present a nonlinear difference. For example, if the compensation corresponding to frequency point A in Figure 5 is relatively small, then the filter compensation effect near frequency point A in Figure 6 is not obvious; if the compensation corresponding to frequency point B in Figure 5 is large, then correspondingly In Fig. 6, the filter compensation near the frequency point B is more obvious. Therefore, the earphone can perform non-linear compensation for the target audio signal to be output in the above-mentioned frequency bands, which not only improves the flexibility of compensating the target audio signal, but also helps to achieve targeted and refined hearing characteristics for different users. Compensation, which improves the accuracy and effectiveness of audio signal compensation.

Further, when cascading the above N target compensation filters, the earphone may firstly perform smooth adjustment on the N target compensation filters according to the hearing test results respectively corresponding to the above M detection frequency points. For example, if the hearing test result corresponding to a certain detection frequency point indicates that the hearing characteristics of the user at the detection frequency point are poor (that is, the user's sensitivity is low), the compensation parameter corresponding to the detection frequency point can be set to enhance The compensation parameter can be used to adjust the signal enhancement of the target audio signal in the frequency band corresponding to the detection frequency point; higher sensitivity), then the compensation parameter corresponding to the detection frequency point can be set as an attenuation compensation parameter, so as to adjust the signal attenuation of the target audio signal in the frequency band corresponding to the detection frequency point. After the above smooth adjustment (including signal enhancement adjustment or signal attenuation adjustment), the earphone can cascade the adjusted N target compensation filters, so that the frequency response curve of the overall filter obtained after cascading is more accurate. smooth, so as to help improve the overall sound quality of the target audio signal, and further enhance the audio signal compensation effect. Please refer to Figure 7 and Figure 8 together, Figure 7 is a schematic diagram of the frequency response of a target compensation filter disclosed in the embodiment of the present application, and Figure 8 is the effect of audio signal compensation by the target compensation filter shown in Figure 7 A schematic diagram, wherein the dotted line in FIG. 8 represents the system frequency response before filter compensation, and the solid line represents the system frequency response after filter compensation. It can be understood that the above-mentioned target compensation filter may also be an overall filter obtained by cascading the above-mentioned N target compensation filters. It can be seen that, compared with FIG. 5 , the frequency response curve of the target compensation filter in FIG. 7 is smoother, and the frequency response curve of the compensated system in FIG. 8 is also smoother than that in FIG. 6 , indicating that a smoother compensation effect has been achieved.

It can be seen that, implementing the audio signal compensation method described in the above embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing test results of the earphones for several detection frequency points, and then the determined compensation parameters can be It is used to compensate the signal components of each frequency band of the target audio signal in the corresponding frequency bands of the corresponding frequency points, so that the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, and the audio signal is improved. Compensation efficiency; In addition, by looking up the table to determine the compensation parameters corresponding to each detection frequency point, the compensation parameters corresponding to multiple detection frequency points can be quickly obtained, and then the efficiency of subsequent compensation filter configuration based on the compensation parameters can be accelerated. It is beneficial to further improve the efficiency of correspondingly compensating the target audio signal through the compensation filter.

Please refer to FIG. 9 . FIG. 9 is a schematic flowchart of another audio signal compensation method disclosed in an embodiment of the present application. The method can be applied to the above-mentioned earphone, and the earphone can include a speaker, a feedback microphone, and a feed-forward microphone. As shown in Figure 9, the audio signal compensation method may include the following steps:

902. Output test audio signals corresponding to the M detection frequency points respectively through the loudspeaker, and respectively acquire hearing detection results fed back to the test audio signals corresponding to the M detection frequency points.

Wherein, step 902 is similar to the above-mentioned step 302 and will not be repeated here.

904. Determine a compensation parameter corresponding to the first frequency point according to the hearing test result corresponding to the first frequency point, where the first frequency point is one or more frequency points among the M detection frequency points;

Wherein, step 904 is similar to step 304 above. It should be noted that since the compensation parameters corresponding to the first frequency points can be used to further determine the compensation parameters corresponding to the second frequency points other than the above-mentioned M detection frequency points in subsequent steps, when selecting the above-mentioned M detection frequency points , that is, selection and setting can be performed based on the corresponding relationship between the second frequency point and the first frequency point.

For example, if according to the compensation parameters corresponding to the first frequency point, the gain coefficients corresponding to several adjacent frequency points can be further determined, then in all the N (M<N) detection frequency points that need to be tested for hearing , M detection frequency points may be selected at intervals as the first frequency point for preferentially determining compensation parameters. For example, if the above N detection frequency points are 500 Hz, 1000 Hz, 2000 Hz, 4000 Hz, 6000 Hz and 8000 Hz respectively, then N=6. On this basis, M=2 can be taken. For example, two frequency points of 1000Hz and 6000Hz are respectively used as the first frequency point. The compensation parameters corresponding to the first frequency points are further determined to be the compensation parameters corresponding to the remaining second frequency points (ie, 500 Hz, 2000 Hz, 4000 Hz, 8000 Hz). For example, according to the compensation parameters corresponding to the 1000Hz frequency point, the compensation parameters corresponding to the adjacent 500Hz and 2000Hz frequency points can be determined; according to the compensation parameters corresponding to the 6000Hz frequency point, the adjacent 4000Hz and 8000Hz frequency points can be determined Corresponding compensation parameters.

906. According to the compensation parameter corresponding to the first frequency point, determine the compensation parameter corresponding to the second frequency point, where the second frequency point is a frequency point other than the above M frequency points among the N detection frequency points, where M less than N.

In the embodiment of the present application, when M<N, after the earphone determines the compensation parameters corresponding to the above-mentioned M detection frequency points according to the obtained M hearing test results, the earphone can further determine which of the above-mentioned N detection frequency points The compensation parameters corresponding to other frequency points not included in the M detection frequency points can quickly determine the compensation parameters corresponding to more detection frequency points, which is beneficial to reduce the number of detection times and save detection time.

It should be noted that, in order to determine the compensation parameter corresponding to the second frequency point based on the compensation parameter corresponding to the first frequency point, it is necessary to determine the above-mentioned first frequency point and the second frequency point as related frequency points (for example, adjacent detection frequency points points, detection frequency points with multiplier relationship, etc.), and calculate based on the corresponding relationship of compensation parameters between the two. Among them, the corresponding relationship of the compensation parameters of the relevant frequency points can be obtained through a specified functional relationship operation, and can also be obtained on the basis of a large amount of data training. By implementing the above method, only a small number of frequency points need to be tested for hearing, and compensation parameters corresponding to a large number of frequency points can be determined for audio signal compensation, which effectively improves the efficiency and convenience of audio signal compensation.

As an optional implementation manner, the earphone can also perform compensation adjustment for the third frequency point, so as to improve the fineness of compensation for the audio signal. Wherein, the third frequency point may be one or more frequency points in the above M detected frequency points.

In some embodiments, if the compensation parameter corresponding to the third frequency point is greater than the first parameter threshold, the earphone can determine a first attenuation parameter that matches the compensation parameter corresponding to the third frequency point, and the first attenuation parameter can be used for Configure the first attenuation filter corresponding to the third frequency point. After the earphone compensates the target audio signal to be output in the frequency band corresponding to the third frequency point according to the above compensation parameters, the compensated target audio signal at the frequency band corresponding to the third frequency point can be compensated by the first attenuation filter. The attenuation correction is performed on the frequency band to reduce the excessive gain of the target audio signal caused by the above-mentioned target compensation filter.

In some other embodiments, if the compensation parameters corresponding to multiple consecutive third frequency points are greater than the first parameter threshold, the earphone may further determine the second attenuation parameter according to the compensation parameters corresponding to the multiple third frequency points. The second attenuation parameter may be used to configure a second attenuation filter corresponding to the continuous compensation frequency band formed by the above-mentioned plurality of third frequency points. After the earphone performs attenuation correction on the target audio signal through the first attenuation filters corresponding to each of the above-mentioned multiple third frequency points, the attenuation-corrected target audio signal can be adjusted in the above-mentioned continuous compensation frequency band through the second attenuation filter An overall smoothing process is performed to further reduce the excessive gain of the target audio signal caused by the above-mentioned multiple target compensation filters.

By finely adjusting the compensation parameters for the third frequency point above, the accuracy of audio signal compensation can be further improved, especially the overall gain of the target compensation filter can be effectively avoided from overflowing unexpectedly, thereby ensuring the compensation of the target audio signal. reliability.

908. Acquire user information corresponding to the wearer of the headset.

Exemplarily, the above user information may include one or more of age information, occupation information, style preference information, and use period information. Wherein, the above style preference information refers to the audio style preferred by the user, such as pure music, metal, rock and so on. The above usage period information may include the status, duration, frequency, etc. of the user using the earphone at different periods. After the headset obtains the user information corresponding to the wearer, it can perform corresponding audio signal compensation for different user information in subsequent steps, or perform personalized adjustments for the determined compensation parameters, so that personalized audio signals can be realized. compensate.

Specifically, for example, an earphone may acquire user information of a user of the terminal device from a terminal device connected thereto as user information corresponding to the wearer of the earphone. Taking the above-mentioned user information including age information as an example, the headset can obtain the user's age information from the above-mentioned terminal device, and then determine the compensation level matching the age information in subsequent steps (for example, different age groups correspond to different compensation levels) , and further obtain the compensation parameter corresponding to the compensation level, so as to perform personalized compensation on the target audio signal to be output, so that the target audio signal conforming to the age characteristics of the user can be output, and the user experience can be further improved.

910. According to the user information, determine a compensation adjustment parameter corresponding to the hearing test result, and adjust the compensation parameters corresponding to each of the N detection frequency points according to the compensation adjustment parameter.

In the embodiment of the present application, the compensation adjustment parameters determined based on the above user information may be used to adjust the compensation parameters corresponding to each of the N detection frequency points. Exemplarily, different compensation adjustment parameters may correspond to different types of filters, which are cascaded before or after the compensation filter configured by the above compensation parameters, so as to realize the adjustment effect of the compensation parameters. Exemplarily, the filter corresponding to the above-mentioned compensation adjustment parameters may include one or more of a Lowshelf Filter, a Highshelf Filter, and a Peaking Filter.

Optionally, after adjusting the compensation parameters corresponding to the above-mentioned N detection frequency points, the earphone can also be cascaded with a limiter Limiter to perform limiting processing, thereby preventing the gain overflow of the target audio signal and effectively ensuring the safety of the speaker.

By implementing the above method, personalized sound effect compensation can be performed based on user information, further improving the flexibility of audio signal compensation.

912. Determine a personalized adjustment type according to the above compensation adjustment parameters and compensation parameters.

914. Acquire adjustment interaction information corresponding to the personalized adjustment type.

Wherein, different compensation adjustment parameters and compensation parameters can be matched with different personalized adjustment types, and the above-mentioned personalized adjustment types can also be matched with specified adjustment interaction information. Exemplarily, the adjustment interaction information may include one or more of image information, sound information, and vibration information. For example, the adjustment interaction information may include a static or dynamic picture (which may include text) describing the sound perception, which is used to display the real-time sound perception state (such as soft, exciting, etc.) of the target audio signal to be output after the headphone compensates the target audio signal. etc.) or audio compensation status (such as whether the compensation function is turned on, what type of compensation function is turned on, etc.); it can also include a prompt voice output before outputting the target audio signal, which is used to prompt whether the headset has turned on the audio signal compensation function; it may also include outputting a vibration prompt while outputting the target audio signal, so as to form a multi-dimensional audio compensation effect display and further enhance the user experience.

916. Send the adjustment interaction information to the terminal device connected to the headset, and trigger the terminal device to output the adjustment interaction information.

For example, please refer to FIG. 10 . FIG. 10 is a schematic diagram of an interface of a terminal device outputting adjustment interaction information disclosed in an embodiment of the present application. As shown in FIG. 10 , the terminal device 30 may output adjustment interaction information in the form of an image on its screen 310 . The adjustment interaction information may be displayed on the upper half of the screen 310 of the terminal device 30 as shown in icon 311 (available for resident display); it may also be displayed on the lower half of the screen 310 as shown in icon 312 (available in on screen off). The above-mentioned

icons

311 and 312 may include text information ("XX" may represent descriptive text of different pitches), image information, and graphic information. It can be understood that the adjustment interaction information shown in FIG. 10 is only some examples, and the adjustment interaction information shown by icon 311 and the adjustment interaction information shown by icon 312 can be displayed separately or simultaneously, and the terminal device 30 can also output other types of Adjust the interactive information, so that the personalized audio compensation status can be displayed to the user, bringing a more diverse user experience.

It can be seen that, implementing the audio signal compensation method described in the above embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing test results of the earphones for several detection frequency points, and then the determined compensation parameters can be It is used to compensate the signal components of each frequency band of the target audio signal in the corresponding frequency bands of the corresponding frequency points, so that the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, and the audio signal is improved. Compensation efficiency; In addition, by finely adjusting the compensation parameters for the above-mentioned third frequency point, the accuracy of audio signal compensation can be further improved, especially to effectively avoid the overall gain of the target compensation filter from overflowing unexpectedly, thereby ensuring the The reliability of compensation for the target audio signal; in addition, personalized sound compensation can be performed based on user information, which further improves the flexibility of audio signal compensation.

Please refer to FIG. 11 . FIG. 11 is a modular schematic diagram of an audio signal compensation device disclosed in an embodiment of the present application. The audio signal compensation device may be applied to the above-mentioned earphone, and the earphone may include a speaker. As shown in Figure 11, the audio signal compensation device may include an output unit 1101 and a determination unit 1102, wherein:

The output unit 1101 is configured to respectively output the test audio signals corresponding to the M detection frequency points through the speaker, and respectively obtain the hearing test results fed back by the test audio signals corresponding to the M detection frequency points;

The determining unit 1102 is configured to determine compensation parameters corresponding to each of the N detection frequency points according to the hearing test results corresponding to the above M detection frequency points, and the compensation parameters are used for the target audio signal to be output when it is in relation to the N detection frequency points. Compensation is performed on frequency bands corresponding to the respective points, wherein N and M are both positive integers, and M is less than or equal to N, and the N detection frequency points may include the aforementioned M detection frequency points.

It can be seen that by using the audio signal compensation device described in the above embodiments, the compensation parameters corresponding to the same or more frequency points can be determined according to the hearing test results of the earphones for several detection frequency points, and then the determined compensation parameters can be It is used to compensate the signal components of each frequency band of the target audio signal in the frequency bands corresponding to the corresponding frequency points. Based on the above-mentioned concise process, the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, which not only avoids the complicated process of hearing detection and parameter calculation by professional doctors or users themselves in related technologies, but also can efficiently Compensation parameters corresponding to multiple detection frequency points are accurately determined, thereby improving the efficiency of compensating audio signals.

In an embodiment, the above-mentioned compensation parameters may include compensation filter parameters, and the audio signal compensation device may also include a filter configuration unit and a compensation unit not shown, wherein:

The filter configuration unit is used to configure N target compensation filters respectively according to the compensation filter parameters corresponding to the N detection frequency points, wherein the center frequencies of the N target compensation filters correspond to the N detection frequencies respectively. ;

The compensation unit is used to perform non-linear compensation on the target audio signal to be output in the frequency band centered on N detection frequency points through N target compensation filters, so as to improve the flexibility of compensating the target audio signal, It helps to achieve targeted and refined compensation according to the hearing characteristics of different users, and also improves the accuracy and effectiveness of audio signal compensation.

Wherein, the above-mentioned compensation unit can also be specifically configured to cascade N target compensation filters, and perform nonlinear compensation on the target audio signal to be output through the cascaded N target compensation filters.

Exemplarily, the compensation unit may include the following steps when cascading N target compensation filters:

Smoothly adjust the N target compensation filters according to the hearing test results corresponding to the M detection frequency points, and the smooth adjustment includes signal enhancement adjustment or signal attenuation adjustment;

The adjusted N target compensation filters are cascaded.

It should be noted that the above-mentioned target compensation filter may include an infinite-length unit impulse response IIR filter. In some embodiments, the above-mentioned IIR filter may include a second-order IIR filter, and include one or more of a Lowshelf Filter, a Highshelf Filter, and a Peaking Filter.

It can be seen that, using the audio signal compensation device described in the above embodiment, cascading the adjusted N target compensation filters can make the frequency response curve of the overall filter obtained after cascading smoother, which is conducive to improving the overall sound quality of the target audio signal,

In one embodiment, if the value of the above M is less than N, the above determining unit 1102 may include a first determining subunit and a second determining subunit not shown, wherein:

The first determination subunit is configured to determine the compensation parameter corresponding to the first frequency point according to the hearing test result corresponding to the first frequency point, where the first frequency point is one or more frequency points among the M detection frequency points;

The second determination subunit is used to determine the compensation parameter corresponding to the second frequency point according to the compensation parameter corresponding to the first frequency point, and the second frequency point is other frequency points except M frequency points among the N detection frequency points .

It can be seen that by using the audio signal compensation device described in the above embodiments, only a small number of frequency points need to be tested for hearing, and compensation parameters corresponding to a large number of frequency points can be determined for audio signal compensation, which effectively improves the audio signal performance. Efficiency and convenience of compensation.

In one embodiment, if the value of the above-mentioned M is equal to N, and the above-mentioned hearing test result includes a sound intensity threshold, the sound intensity threshold is the critical sound intensity at which the user can respectively hear the test audio signals corresponding to the M detection frequency points, Then the above determination unit 1102 may include an unillustrated query subunit, which may be used to query the compensation corresponding to the M detection frequency points on the compensation mapping table according to the respective sound intensity thresholds corresponding to the M detection frequency points. Parameters, wherein the compensation mapping table includes the mapping relationship between sound intensity thresholds corresponding to each detection frequency point and compensation parameters.

It should be noted that the above compensation mapping table may be obtained by training using a sample data set, and the sample data set includes sample sound intensity thresholds and sample compensation parameters corresponding to a plurality of sample frequency points respectively.

Exemplarily, when the above-mentioned query subunit respectively queries the compensation parameters corresponding to the M detection frequency points on the compensation mapping table, the following steps can be specifically performed:

According to the respective sound intensity thresholds corresponding to the M detection frequency points, respectively determine the compensation level matching the sound intensity threshold;

Based on the respective compensation levels corresponding to the M detection frequency points, the compensation parameters corresponding to the M detection frequency points are respectively queried on the compensation mapping table.

It can be seen that by looking up the table to determine the compensation parameters corresponding to each detection frequency point, the compensation parameters corresponding to multiple detection frequency points can be quickly obtained, which in turn can speed up the efficiency of subsequent compensation filter configuration based on the compensation parameters, which is conducive to further improvement. The efficiency with which the target audio signal is compensated accordingly by the compensation filter.

In one embodiment, if the value of M above is equal to N, then the determining unit 1102 may further include a third determining subunit not shown in the figure, and the third determining subunit may be used for if the M detection frequency points are respectively If the corresponding hearing test results all belong to the first range, the compensation parameters corresponding to each of the N detected frequency points are determined as default parameters. Configuring the target compensation filter based on the default gain coefficient can compensate the target audio signal to be output to a certain extent, so that the user can clearly feel the effect of optimized compensation, further improving the user experience.

In an embodiment, the audio signal compensation device may further include a first attenuation unit not shown in the figure, and the first attenuation unit may determine that when the compensation parameter corresponding to the third frequency point is greater than the first parameter threshold, The compensation parameters corresponding to the three frequency points match the first attenuation parameter, the first attenuation parameter is used to configure the first attenuation filter corresponding to the third frequency point, and the first attenuation filter is used for the target audio signal to be output according to the compensation parameter After compensation is performed on the frequency band corresponding to the third frequency point, the attenuation correction is performed on the compensated target audio signal through the first attenuation filter on the frequency band corresponding to the third frequency point, wherein the third frequency point is M detection One or more of the frequency bins.

In an embodiment, the audio signal compensation device may further include a second attenuation unit not shown, and the first attenuation unit may be used to determine a second attenuation parameter according to compensation parameters corresponding to multiple third frequency points, The second attenuation parameter is used to configure the second attenuation filter corresponding to the continuous compensation frequency band formed by a plurality of third frequency points, and the second attenuation filter is used to pass the first attenuation filter corresponding to each of the plurality of third frequency points, After attenuation correction is performed on the compensated target audio signal in frequency bands corresponding to multiple third frequency points, the overall smoothing process is performed on the attenuation-corrected target audio signal in continuous compensation frequency bands through the second attenuation filter.

It can be seen that by adopting the audio signal compensation device described in the above embodiment, the accuracy of audio signal compensation can be further improved by finely adjusting the compensation parameters for the third frequency point, especially to effectively avoid the overall Unexpected overflow of gain ensures reliable compensation of the target audio signal.

In an embodiment, the audio signal compensation device may also include an information acquisition unit not shown, wherein:

An information acquisition unit, configured to acquire user information corresponding to the wearer of the earphone after the determination unit determines the compensation parameters corresponding to each of the N detection frequency points;

The determination unit is further configured to determine the compensation adjustment parameters corresponding to the hearing test results according to the user information, and adjust the compensation parameters corresponding to the N detection frequency points according to the compensation adjustment parameters.

Wherein, the above user information may include one or more of age information, occupation information, style preference information, and use period information.

In an embodiment, the audio signal compensation device may also include a sending unit not shown, wherein:

The above determining unit is also used to determine the personalized adjustment level according to the compensation adjustment parameter and the compensation parameter after determining the compensation adjustment parameter corresponding to the hearing test result;

The above-mentioned information obtaining unit is also used to obtain the adjustment interaction information corresponding to the personalized adjustment level;

The sending unit is configured to send the adjustment interaction information to the terminal device connected to the headset, and trigger the terminal device to output the adjustment interaction information.

It can be seen that by using the audio signal compensation device described in the above embodiments, the compensation parameters corresponding to the same or more frequency points can be determined according to the hearing test results of the earphones for several detection frequency points, and then the determined compensation parameters can be It is used to compensate the signal components of each frequency band of the target audio signal in the corresponding frequency bands of the corresponding frequency points, so that the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, and the audio signal is improved. Compensation efficiency; In addition, by finely adjusting the compensation parameters for the above-mentioned third frequency point, the accuracy of audio signal compensation can be further improved, especially to effectively avoid the overall gain of the target compensation filter from overflowing unexpectedly, thereby ensuring the The reliability of compensation for the target audio signal; in addition, personalized sound compensation can be performed based on user information, which further improves the flexibility of audio signal compensation.

Please refer to FIG. 12 . FIG. 12 is a schematic modular diagram of an earphone disclosed in an embodiment of the present application. As shown in Figure 12, the headset may include:

A memory 1201 storing executable program codes;

a processor 1202 coupled to the memory 1201;

Wherein, the processor 1202 invokes the executable program code stored in the memory 1201 to execute all or part of the steps in any audio signal compensation method described in the above-mentioned embodiments.

In addition, the embodiment of the present application further discloses a computer-readable storage medium, which stores a computer program for electronic data exchange, wherein the computer program enables the computer to execute any audio signal compensation method described in the above-mentioned embodiments All or some of the steps in .

In addition, the embodiments of the present application further disclose a computer program product. When the computer program product is run on a computer, the computer can execute all or part of the steps in any audio signal compensation method described in the above embodiments.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes read-only Memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), programmable read-only memory (Programmable Read-only Memory, PROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, tape storage, or any other computer-readable medium that can be used to carry or store data.

An audio signal compensation method and device, earphone, and storage medium disclosed in the embodiments of the present application have been described above in detail. In this paper, specific examples are used to illustrate the principles and implementation methods of the present application. The descriptions of the above embodiments are only used To help understand the method and its core idea of this application; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation and application scope. In summary, this specification The content should not be construed as a limitation of the application.

Claims

An audio signal compensation method, characterized in that it is applied to earphones, the earphones include loudspeakers, and the method includes:

Outputting test audio signals corresponding to M detection frequency points respectively through the speakers, and respectively obtaining hearing detection results fed back to the test audio signals corresponding to the M detection frequency points;

According to the hearing test results respectively corresponding to the M detection frequency points, the compensation parameters corresponding to the N detection frequency points are determined, and the compensation parameters are used to correspond to the N detection frequency points respectively for the target audio signal to be output. Compensation is performed on the frequency bands respectively, wherein the N and M are both positive integers, and the M is less than or equal to the N, and the N detection frequency points include the M detection frequency points.
The method according to claim 1, wherein the compensation parameters include compensation filter parameters, and according to the hearing test results corresponding to the M detection frequency points, determine the corresponding After compensating the parameters, the method also includes:

According to the respective compensation filter parameters corresponding to the N detection frequency points, configure N target compensation filters respectively, wherein the center frequencies of the N target compensation filters correspond to the N detection frequency points one-to-one, respectively. ;

Through the N target compensation filters, the target audio signal to be output is respectively subjected to non-linear compensation in frequency bands centered on the N detection frequency points.
The method according to claim 2, characterized in that, through the N target compensation filters, the target audio signal to be output is respectively nonlinearly compensated in the frequency band centered on the N detection frequency points ,include:

The N target compensation filters are cascaded, and nonlinear compensation is performed on the target audio signal to be output through the N target compensation filters after cascading.
The method according to claim 3, wherein said cascading said N target compensation filters comprises:

Smoothly adjust the N target compensation filters according to the hearing test results respectively corresponding to the M detection frequency points, where the smooth adjustment includes signal enhancement adjustment or signal attenuation adjustment;

The adjusted N target compensation filters are cascaded.
The method according to claim 2, wherein the target compensation filter comprises an infinite-length unit impulse response (IIR) filter.
The method according to claim 5, wherein the IIR filter comprises a second-order IIR filter, and comprises a low-frequency shelf filter Lowshelf Filter, a high-frequency shelf filter Highshelf Filter, and a peak filter Peaking Filter one or more of .
The method according to any one of claims 1 to 6, wherein the M is smaller than the N, and the N detection frequency points are determined according to the hearing test results respectively corresponding to the M detection frequency points. The corresponding compensation parameters include:

Determine the compensation parameter corresponding to the first frequency point according to the hearing test result corresponding to the first frequency point, where the first frequency point is one or more frequency points in the M detection frequency points;

According to the compensation parameter corresponding to the first frequency point, determine the compensation parameter corresponding to the second frequency point, where the second frequency point is a frequency point other than the M frequency points among the N detection frequency points .
The method according to any one of claims 1 to 6, wherein the M is equal to the N, and the hearing test result includes a sound intensity threshold, and the sound intensity threshold is that the user can hear the M respectively. The critical sound intensity of the test audio signal corresponding to the detection frequency points, according to the hearing test results corresponding to the M detection frequency points, determine the respective compensation parameters corresponding to the N detection frequency points, including:

According to the sound intensity thresholds corresponding to each of the M detection frequency points, the compensation parameters corresponding to the M detection frequency points are respectively queried on the compensation mapping table, wherein the compensation mapping table includes the sound corresponding to each detection frequency point The mapping relationship between intensity threshold and compensation parameters.
The method according to claim 8, wherein the compensation mapping table is obtained by using a sample data set for training, and the sample data set includes sample sound intensity thresholds and sample compensation parameters respectively corresponding to a plurality of sample frequency points .
The method according to claim 8, wherein the compensation parameters corresponding to the M detection frequency points are respectively queried on the compensation mapping table according to the sound intensity thresholds corresponding to the M detection frequency points, including :

According to the sound intensity thresholds corresponding to each of the M detection frequency points, respectively determine the compensation level matching the sound intensity threshold;

Based on the respective compensation levels corresponding to the M detection frequency points, the compensation parameters corresponding to the M detection frequency points are respectively queried in the compensation mapping table.
The method according to any one of claims 1 to 6, wherein the M is equal to the N, and the N detection frequency points are determined according to the hearing test results respectively corresponding to the M detection frequency points. The corresponding compensation parameters include:

If the hearing test results respectively corresponding to the M detection frequency points all belong to the first range, then the compensation parameters corresponding to the N detection frequency points are determined as default parameters.
The method according to any one of claims 1 to 6, characterized in that, after determining the compensation parameters corresponding to each of the N detection frequency points according to the hearing test results respectively corresponding to the M detection frequency points, the The method also includes:

If the compensation parameter corresponding to the third frequency point is greater than the first parameter threshold, determine a first attenuation parameter that matches the compensation parameter corresponding to the third frequency point, and the first attenuation parameter is used to configure the third frequency point a corresponding first attenuation filter, the first attenuation filter is used to pass the first attenuation The filter performs attenuation correction on the compensated target audio signal in a frequency band corresponding to the third frequency point, where the third frequency point is one or more frequency points in the M detected frequency points.
The method according to claim 12, wherein the third frequency point includes multiple points, and if the compensation parameter corresponding to the third frequency point is greater than the first parameter threshold, it is determined that the compensation parameter corresponding to the third frequency point is After the corresponding compensation parameter matches the first attenuation parameter, the method further includes:

Determine a second attenuation parameter according to compensation parameters corresponding to a plurality of third frequency points, and the second attenuation parameter is used to configure a second attenuation filter corresponding to a continuous compensation frequency band formed by a plurality of third frequency points , the second attenuation filter is used to pass through the first attenuation filters corresponding to each of the plurality of third frequency points, respectively to the compensated target audio signal at the corresponding to the plurality of third frequency points After the attenuation correction is performed on the frequency band, an overall smoothing process is performed on the continuous compensation frequency band on the attenuation-corrected target audio signal through the second attenuation filter.
The method according to any one of claims 1 to 6, characterized in that, after determining the compensation parameters corresponding to each of the N detection frequency points according to the hearing test results respectively corresponding to the M detection frequency points, the The method also includes:

Obtaining user information corresponding to the wearer of the headset;

According to the user information, a compensation adjustment parameter corresponding to the hearing test result is determined, and the compensation parameters corresponding to each of the N detection frequency points are adjusted according to the compensation adjustment parameter.
The method according to claim 14, wherein the user information includes one or more of age information, occupation information, style preference information, and use period information.
The method according to claim 14, wherein, after determining the compensation adjustment parameter corresponding to the hearing test result according to the user information, the method further comprises:

determining a personalized adjustment type according to the compensation adjustment parameter and the compensation parameter;

Obtain adjustment interaction information corresponding to the personalized adjustment type;

sending the adjustment interaction information to a terminal device connected to the headset, and triggering the terminal device to output the adjustment interaction information.
An audio signal compensation device is characterized in that it is applied to an earphone, the earphone includes a loudspeaker, and the audio signal compensation device includes:

An output unit, configured to respectively output test audio signals corresponding to M detection frequency points through the speaker, and respectively obtain hearing test results fed back from the test audio signals corresponding to the M detection frequency points;

The determination unit is configured to determine compensation parameters corresponding to each of the N detection frequency points according to the hearing detection results corresponding to the M detection frequency points, and the compensation parameters are used for the target audio signal to be output when it is in relation to the N detection frequency points. Compensation is performed on the respective frequency bands corresponding to the detection frequency points, wherein the N and M are both positive integers, and the M is less than or equal to the N, and the N detection frequency points include the M detection frequency points .
The audio signal compensation device according to claim 17, wherein the compensation parameters include compensation filter parameters, and the audio signal compensation device further comprises:

A filter configuration unit, configured to determine the compensation parameters corresponding to each of the N detection frequency points according to the hearing test results respectively corresponding to the M detection frequency points by the determination unit, and then according to the respective corresponding compensation parameters of the N detection frequency points The parameters of the compensation filter are respectively configured with N target compensation filters, wherein the center frequencies of the N target compensation filters are in one-to-one correspondence with the N detection frequency points respectively;

The compensation unit is configured to use the N target compensation filters to respectively perform nonlinear compensation on the frequency band centered on the N detection frequency points for the target audio signal to be output.
The audio signal compensation device according to claim 18, wherein the compensation unit is used for passing through the N target compensation filters, and the target audio signal to be output is centered on the N detection frequency points When nonlinear compensation is performed on the frequency bands respectively, including:

The N target compensation filters are cascaded, and nonlinear compensation is performed on the target audio signal to be output through the N target compensation filters after cascading.
The audio signal compensation device according to claim 19, wherein when the compensation unit is used to cascade the N target compensation filters, it includes:

Smoothly adjust the N target compensation filters according to the hearing test results respectively corresponding to the M detection frequency points, where the smooth adjustment includes signal enhancement adjustment or signal attenuation adjustment;

The adjusted N target compensation filters are cascaded.
The audio signal compensation device according to claim 18, wherein the target compensation filter comprises an infinite-length unit impulse response (IIR) filter.
The audio signal compensation device according to claim 21, wherein the IIR filter includes a second-order IIR filter, and includes a low-frequency shelf filter Lowshelf Filter, a high-frequency shelf filter Highshelf Filter, and a peak filter One or more of Peaking Filter.
The audio signal compensation device according to any one of claims 17 to 22, wherein the M is smaller than the N, and the determination unit is used for hearing test results corresponding to the M detection frequency points , when determining the compensation parameters corresponding to each of the N detection frequency points, including:

Determine the compensation parameter corresponding to the first frequency point according to the hearing test result corresponding to the first frequency point, where the first frequency point is one or more frequency points in the M detection frequency points;

According to the compensation parameter corresponding to the first frequency point, determine the compensation parameter corresponding to the second frequency point, where the second frequency point is a frequency point other than the M frequency points among the N detection frequency points .
The audio signal compensation device according to any one of claims 17 to 22, wherein the M is equal to the N, and the hearing test result includes a sound intensity threshold, and the sound intensity threshold is a value that the user can hear respectively. The critical sound intensity of the test audio signal corresponding to the M detection frequency points, the determination unit is used to determine the compensation parameters corresponding to each of the N detection frequency points according to the hearing test results corresponding to the M detection frequency points , including:

According to the sound intensity thresholds corresponding to each of the M detection frequency points, the compensation parameters corresponding to the M detection frequency points are respectively queried on the compensation mapping table, wherein the compensation mapping table includes the sound corresponding to each detection frequency point The mapping relationship between intensity threshold and compensation parameters.
The audio signal compensation device according to claim 24, wherein the compensation mapping table is obtained by using a sample data set for training, and the sample data set includes sample sound intensity thresholds corresponding to a plurality of sample frequency points and Sample compensation parameters.
The audio signal compensation device according to claim 24, wherein the determining unit is used to respectively query the M detection frequency points on the compensation mapping table according to the corresponding sound intensity thresholds of the M detection frequency points. The compensation parameters corresponding to the frequency points include:

According to the sound intensity thresholds corresponding to each of the M detection frequency points, respectively determine the compensation level matching the sound intensity threshold;

Based on the respective compensation levels corresponding to the M detection frequency points, the compensation parameters corresponding to the M detection frequency points are respectively queried in the compensation mapping table.
The audio signal compensation device according to any one of claims 17 to 22, wherein the M is equal to the N, and the determination unit is used for hearing test results respectively corresponding to the M detection frequency points , when determining the compensation parameters corresponding to each of the N detection frequency points, including:

If the hearing test results respectively corresponding to the M detection frequency points all belong to the first range, then the compensation parameters corresponding to the N detection frequency points are determined as default parameters.
The audio signal compensation device according to any one of claims 17 to 22, wherein the audio signal compensation device further comprises:

The first attenuation unit is configured to, after the determination unit determines the compensation parameters corresponding to the N detection frequency points respectively according to the hearing test results corresponding to the M detection frequency points, if the compensation parameter corresponding to the third frequency point is greater than The first parameter threshold is to determine the first attenuation parameter matching the compensation parameter corresponding to the third frequency point, the first attenuation parameter is used to configure the first attenuation filter corresponding to the third frequency point, the The first attenuation filter is used to perform compensation on the frequency band corresponding to the third frequency point on the target audio signal to be output according to the compensation parameter, and to use the first attenuation filter to compensate the target audio signal after compensation. Attenuation correction is performed on a frequency band corresponding to the third frequency point, where the third frequency point is one or more frequency points in the M detected frequency points.
The audio signal compensation device according to claim 28, wherein the third frequency point includes multiple points, and the audio signal compensation device further includes:

The second attenuation unit is configured to determine the first attenuation parameter according to a plurality of compensation parameters corresponding to the third frequency point after the first attenuation unit determines the first attenuation parameter matching the compensation parameter corresponding to the third frequency point. Two attenuation parameters, the second attenuation parameter is used to configure a second attenuation filter corresponding to the continuous compensation frequency band formed by a plurality of the third frequency points, and the second attenuation filter is used to pass through a plurality of the third frequency points The first attenuation filters corresponding to the three frequency points respectively perform attenuation correction on the compensated target audio signal in the frequency bands corresponding to a plurality of the third frequency points, and pass through the second attenuation filter to The attenuation-corrected target audio signal is subjected to an overall smoothing process on the continuous compensation frequency band.
The audio signal compensation device according to any one of claims 17 to 22, wherein the audio signal compensation device further comprises:

An information acquisition unit, configured to acquire user information corresponding to the wearer of the earphone after the determination unit determines the compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points respectively ;

The determination unit is further configured to determine a compensation adjustment parameter corresponding to the hearing test result according to the user information, and adjust the compensation parameters corresponding to each of the N detection frequency points according to the compensation adjustment parameter.
The audio signal compensation device according to claim 30, wherein the user information includes one or more of age information, occupation information, style preference information, and use period information.
The audio signal compensation device according to claim 30, wherein the determining unit is further configured to, after determining the compensation adjustment parameter corresponding to the hearing test result according to the user information, adjust the compensation parameter according to the compensation adjustment parameter. parameters and the compensation parameters to determine the type of personalized adjustment;

The information acquiring unit is further configured to acquire adjustment interaction information corresponding to the personalized adjustment type;

The audio signal compensation device also includes:

A sending unit, configured to send the adjustment interaction information to a terminal device connected to the headset, and trigger the terminal device to output the adjustment interaction information.
An earphone, characterized in that it includes a memory and a processor, and a computer program is stored in the memory, and when the computer program is executed by the processor, the processor realizes any one of claims 1 to 16. The audio signal compensation method.
A computer-readable storage medium on which a computer program is stored, wherein the computer program implements the audio signal compensation method according to any one of claims 1 to 16 when executed by a processor.