CN115706885A - Audio signal compensation method and device, earphone and storage medium - Google Patents

Audio signal compensation method and device, earphone and storage medium Download PDF

Info

Publication number
CN115706885A
CN115706885A CN202110928003.1A CN202110928003A CN115706885A CN 115706885 A CN115706885 A CN 115706885A CN 202110928003 A CN202110928003 A CN 202110928003A CN 115706885 A CN115706885 A CN 115706885A
Authority
CN
China
Prior art keywords
compensation
frequency points
audio signal
detection
detection frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110928003.1A
Other languages
Chinese (zh)
Inventor
练添富
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202110928003.1A priority Critical patent/CN115706885A/en
Priority to PCT/CN2022/106733 priority patent/WO2023016208A1/en
Publication of CN115706885A publication Critical patent/CN115706885A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00Monitoring arrangements; Testing arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/04Circuits for transducers, loudspeakers or microphones for correcting frequency response

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

An audio signal compensation method and device, a headset and a storage medium, wherein the method is applied to the headset, the headset comprises a loudspeaker, and the method comprises the following steps: respectively outputting test audio signals corresponding to the M detection frequency points through a loudspeaker, and respectively acquiring hearing detection results fed back by aiming at the test audio signals corresponding to the M detection frequency points; and determining compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points, where the compensation parameters are used to compensate the target audio signal to be output on frequency bands corresponding to the N detection frequency points, where N and M are positive integers, and M is less than or equal to N, where the N detection frequency points may include the M detection frequency points. By implementing the embodiment of the application, the compensation parameters required by compensating the audio signal can be conveniently and rapidly determined, so that the efficiency of compensating the audio signal is improved.

Description

Audio signal compensation method and device, earphone and storage medium
Technical Field
The present application relates to the field of audio processing technologies, and in particular, to an audio signal compensation method and apparatus, an earphone, and a storage medium.
Background
At present, under the scenes that a user uses an earphone to listen to music, watch videos (namely, the earphone outputs audio signals corresponding to the videos), carry out conversation and the like, the earphone can carry out certain compensation on the output audio signals according to the difference of the hearing characteristics of different users. However, in practice, it is found that the conventional audio signal compensation scheme often requires a complex hearing test and parameter calculation process, so that the process of determining relevant parameters required for compensation is extremely slow, and the efficiency of compensating the audio signal is reduced.
Disclosure of Invention
The embodiment of the application discloses an audio signal compensation method and device, an earphone and a storage medium, which can conveniently and quickly determine compensation parameters required by the compensation of an audio signal, thereby improving the efficiency of the compensation of the audio signal.
In a first aspect of the embodiments of the present application, a method for compensating an audio signal is disclosed, where the method is applied to an earphone, where the earphone includes a speaker, and the method includes:
respectively outputting test audio signals corresponding to the M detection frequency points through the loudspeaker, and respectively acquiring hearing detection results fed back by aiming at the test audio signals corresponding to the M detection frequency points;
and determining compensation parameters corresponding to the N detection frequency points according to hearing detection results corresponding to the M detection frequency points respectively, wherein the compensation parameters are used for compensating target audio signals to be output on frequency bands corresponding to the N detection frequency points respectively, N and M are positive integers, M is smaller than or equal to N, and the N detection frequency points comprise the M detection frequency points.
A second aspect of the embodiments of the present application discloses an audio signal compensation apparatus, which is applied to a headset, where the headset includes a speaker, the audio signal compensation apparatus includes:
the output unit is used for outputting test audio signals corresponding to the M detection frequency points through the loudspeaker respectively and acquiring hearing detection results corresponding to the M detection frequency points fed back by aiming at the test audio signals respectively;
and the determining unit is used for determining compensation parameters corresponding to the N detection frequency points according to hearing detection results corresponding to the M detection frequency points respectively, wherein the compensation parameters are used for compensating target audio signals to be output on frequency bands corresponding to the N detection frequency points respectively, N and M are positive integers, M is smaller than or equal to N, and the N detection frequency points comprise the M detection frequency points.
In a third aspect of the embodiments of the present application, a headset is disclosed, which includes a memory and a processor, where the memory stores a computer program, and when the computer program is executed by the processor, the processor implements all or part of the steps of any one of the audio signal compensation methods disclosed in the first aspect of the embodiments of the present application.
A fourth aspect of the embodiments of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements all or part of the steps of any one of the audio signal compensation methods disclosed in the first aspect of the embodiments of the present application.
Compared with the related art, the embodiment of the application has the following beneficial effects:
in this application embodiment, the earphone applying the audio signal compensation method may include a speaker, and the test audio signals corresponding to the M detection frequency points are output through the speaker respectively, so that the hearing detection results fed back by the test audio signals corresponding to the M detection frequency points can be obtained respectively. On this basis, the earphone can determine respective compensation parameters corresponding to the N detection frequency points according to the hearing detection results corresponding to the M detection frequency points, and the compensation parameters can be used for respectively compensating the target audio signal to be output on the frequency bands corresponding to the N detection frequency points. Wherein N and M are positive integers, and M is less than or equal to N, and the N detection frequency points may include the M detection frequency points. Therefore, by implementing the embodiment of the application, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing detection results of the earphone aiming at the plurality of detection frequency points, and then the determined compensation parameters can be used for compensating the signal components of each frequency band of the target audio signal on the frequency band corresponding to the corresponding frequency point. Based on the simple process, the compensation parameters required by compensating the target audio signal can be conveniently and quickly determined, the complex process that professional doctors or users need to perform hearing detection and parameter calculation in the related technology is avoided, the compensation parameters corresponding to the multiple detection frequency points can be efficiently determined, and therefore the efficiency of compensating the audio signal is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1A is a schematic diagram of an application scenario of an audio signal compensation method disclosed in an embodiment of the present application;
fig. 1B is a schematic diagram of another application scenario of the audio signal compensation method disclosed in the embodiment of the present application;
fig. 2 is a schematic structural diagram of an earphone disclosed in an embodiment of the present application;
FIG. 3 is a flowchart illustrating an audio signal compensation method according to an embodiment of the disclosure;
FIG. 4 is a schematic flow chart illustrating another audio signal compensation method disclosed in the embodiments of the present application;
FIG. 5 is a schematic diagram of a frequency response of a target compensation filter disclosed in an embodiment of the present application;
FIG. 6 is a schematic diagram illustrating the effect of audio signal compensation by the target compensation filter shown in FIG. 5;
FIG. 7 is a frequency response diagram of another target compensation filter disclosed in an embodiment of the present application;
FIG. 8 is a schematic diagram illustrating the effect of audio signal compensation by the target compensation filter shown in FIG. 7;
FIG. 9 is a schematic flow chart illustrating a further audio signal compensation method disclosed in the embodiments of the present application;
fig. 10 is a schematic interface diagram of a terminal device outputting adjustment interaction information according to an embodiment of the present disclosure;
fig. 11 is a schematic block diagram of an audio signal compensation apparatus according to an embodiment of the present application;
fig. 12 is a schematic block diagram of a headset according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the embodiments of the present application, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the application discloses an audio signal compensation method and device, an earphone and a storage medium, which can conveniently and quickly determine compensation parameters required by the compensation of an audio signal, thereby improving the efficiency of the compensation of the audio signal.
The following detailed description is made with reference to the accompanying drawings.
Referring to fig. 1A and fig. 1B together, fig. 1A is a schematic view of an application scenario of the audio signal compensation method disclosed in the embodiment of the present application, and fig. 1B is a schematic view of another application scenario of the audio signal compensation method disclosed in the embodiment of the present application. As shown in fig. 1A, the application scenario may include a user 10 and an earphone 20, where the user 10 may perform a hearing test autonomously through the earphone 20, so that the earphone 20 obtains a hearing test result corresponding to the user 10, and further determines a corresponding compensation parameter according to the hearing test result, and implements corresponding audio signal compensation based on the compensation parameter. By implementing the above audio signal compensation, the earphone 20 may respectively perform different degrees of compensation on the frequency bands corresponding to different detection frequency points for the target audio signal to be output according to the hearing characteristics of the user 10 (for example, hearing impairment in different degrees exists, different sensitivities to audio signals of different frequencies, and the like), so that the compensated target audio signal can better fit the hearing characteristics of the user 10, and the listening effect when the user 10 receives the target audio signal is improved (for example, the user can listen to the target audio signal more clearly and comfortably) is facilitated.
Illustratively, when a hearing test needs to be performed on the user 10 for performing a corresponding audio signal compensation, the user 10 may interact with the headset 20 to issue a hearing test instruction to the headset 20 to trigger the headset 20 to start performing the hearing test. Specifically, the hearing test may be performed by using test audio signals corresponding to M (M is a positive integer) test frequency points, where the M test frequency points may be preset and may respectively correspond to a certain frequency range, that is, representative frequency points in each frequency range. For example, the detection frequency points may include middle and low frequency points such as 500Hz, 1000Hz, 2000Hz, and the like, and may also include high frequency points such as 4000Hz, 6000Hz, 8000Hz, and the like. On this basis, the earphones 20 may output the test audio signals corresponding to the M detection frequency points, and collect feedback conditions of the user 10 for each test audio signal, so as to perform a relatively comprehensive evaluation on the hearing characteristics of the user in different frequency bands (i.e., sensitivity to audio signals in different frequency bands), and obtain corresponding hearing detection results; meanwhile, the detection frequency points with fixed number are set, so that the detection frequency is reduced, and the detection time is saved.
In this embodiment of the application, the earphone 20 may output the test audio signals corresponding to the M detection frequency points through its built-in speaker respectively, and then may obtain the hearing detection results fed back by the test audio signals corresponding to the M detection frequency points respectively. On this basis, the earphone 20 may determine, according to the hearing test results corresponding to the M test frequency points, compensation parameters corresponding to N (N is a positive integer) test frequency points, where the compensation parameters may be used to compensate the target audio signal to be output on frequency bands corresponding to the N test frequency points, respectively. It should be noted that, in addition to that N and M are positive integers, the condition that M is less than or equal to N is also required to be satisfied, that is, N detection frequency points for which the earphone 20 determines the compensation parameters may include M detection frequency points for which the earphone performs hearing detection.
By implementing the embodiment of the present application, the compensation parameters corresponding to the same or even more frequency points (i.e., the N detection frequency points) can be determined according to the hearing detection results of the headphones 20 for a plurality of detection frequency points (i.e., the M detection frequency points), and then the determined compensation parameters can be used for compensating the signal components of each frequency band of the target audio signal in the frequency band corresponding to the corresponding frequency points. Based on the relatively simple process, the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, so that the complex process required by a professional doctor or a user for hearing detection and parameter calculation in the related technology is avoided, the compensation parameters corresponding to a plurality of detection frequency points can be determined efficiently, and the efficiency of compensating the audio signal is greatly improved.
Optionally, as shown in fig. 1B, the earphone 20 may further be connected to the terminal device 30, so that when the hearing test on the user 10 is required, the user 10 may further interact with the terminal device 30 to send a hearing test instruction to the earphone 20 through the terminal device 30, and trigger the earphone 20 to start performing the hearing test. The terminal device 30 may include various devices or systems with wireless communication functions, such as a mobile phone, a smart wearable device, an in-vehicle terminal, a tablet Computer, a PC (Personal Computer), a PDA (Personal Digital Assistant), and the like, which are not limited in this embodiment. It should be noted that, when the earphone 20 obtains the hearing test result fed back by the user 10 for the test audio signal, the hearing test result fed back by the user 10 directly through the earphone 20 may be obtained; after the terminal device 30 acquires the hearing test result fed back by the user 10, the earphone 20 may communicate with the terminal device 30 to acquire the hearing test result transmitted by the terminal device 30.
It should be noted that, in the embodiment of the present application, the earphone 20 may be provided with a feedback microphone and a feedforward microphone in addition to the speaker. Referring to fig. 2, fig. 2 is a schematic structural diagram of an earphone 20 disclosed in an embodiment of the present application. As shown in fig. 2, the headset 20 may include a speaker 21, a feedback microphone 22, and a feedforward microphone 23. Wherein, when the user 10 wears the earphone 20, the feedback microphone 22 may be located between the speaker 21 and the user 10, and the feedforward microphone 23 may be located behind the speaker 21 (i.e., when the user wears the earphone, the feedforward microphone is located between the speaker and the external environment). It can be understood that the feedback microphone 22 may be configured to receive the audio signal output by the speaker 21 and the echo, noise, and the like inside the earphone 20, and the feedforward microphone 23 may be configured to collect the ambient sound, so as to implement various functions such as ANC (Active Noise Cancellation, active Noise reduction) and the like, and assist in performing the above-mentioned hearing detection and audio signal compensation steps, so as to improve the accuracy and reliability of compensating the audio signal.
Referring to fig. 3, fig. 3 is a flowchart illustrating an audio signal compensation method according to an embodiment of the present disclosure, where the method can be applied to the above-mentioned earphone, and the earphone can include a speaker. As shown in fig. 3, the audio signal compensation method may include the steps of:
302. and outputting the test audio signals corresponding to the M detection frequency points through a loudspeaker, and acquiring hearing detection results fed back by the test audio signals corresponding to the M detection frequency points.
In the embodiment of the present application, in order to perform corresponding audio signal compensation for the hearing characteristics of a user (for example, hearing impairment of different degrees exists, different sensitivities to audio signals of different frequencies, and the like), a hearing detection result corresponding to the user needs to be obtained first. Specifically, after the user wears the earphone, the earphone may output test audio signals corresponding to a plurality of test frequency points through a built-in speaker of the earphone, and the user may perform feedback for each test audio signal, so that the earphone may obtain hearing test results corresponding to the plurality of test frequency points fed back by the user for the plurality of test frequency points, respectively.
Illustratively, the headset may be provided with M detection frequency points, where M is a positive integer. When hearing detection needs to be performed on a user (for example, in a scenario where the user wears the headset for the first time, calibrates the headset at regular intervals, and the like), the headset may determine corresponding M test audio signals respectively based on the M detection frequency points. The test audio signal may include pure tone signals at each detection frequency point (e.g., 500Hz, 1000Hz, etc.), i.e., an audio signal consisting only of audio signal components corresponding to the detection frequency point and not including audio signal components of other frequencies. The pure tone signal is adopted as the test audio signal, and the hearing sensitivity of the user at each detection frequency point can be accurately judged through the subsequent hearing detection process. Further, after the test audio signals corresponding to the M detection frequency points are determined, the earphone converts the test audio signals in the form of electric signals into corresponding sound wave vibration through the loudspeaker, so that each test audio signal is output to the user, whether the user listens to the feedback of each test audio signal is obtained in subsequent steps, and then the hearing detection result of the user for each test audio signal feedback is obtained.
On this basis, when the headset acquires the hearing test result fed back by aiming at the test audio signal, the interaction with the user can be realized, that is, the hearing test result corresponding to a certain detection frequency point is determined based on whether the user receives the feedback of the test audio signal corresponding to the detection frequency point. The hearing test result may include subjective judgment information on whether the user has received the test audio signal, or may further include a threshold sound intensity (i.e., the sound intensity of the test audio signal when the user can just receive the test audio signal), a range of the receivable sound intensity, and the like, which are further determined according to the subjective judgment information.
In one embodiment, when the user obtains the hearing test result fed back only through the earphone, the hearing test result can be obtained by detecting the user operation of the earphone. Illustratively, the user operation for the headset may include a touch operation, a voice operation, a movement operation, and the like.
For example, when the user listens to the test audio signal, the touch point designated on the earphone may be touched, so that when the earphone detects a touch operation for the designated touch point, the hearing state of the user listening to the test audio signal may be determined, and a corresponding hearing detection result may be obtained.
For another example, when the user hears the test audio signal, the user can directly send out an "hearing" voice instruction; when the user does not hear the test audio signal, the user can directly send out a voice command of 'not hearing', so that the earphone can analyze the voice command detected by the earphone to determine whether the user hears the test audio signal.
For another example, the user may also perform head movements, rotations, or shakes in different directions according to different situations of whether the test audio signal is heard, so that the headset may detect its own motion state through the sensor to determine whether the corresponding user hears the hearing state of the test audio signal. For example, when the user hears the test audio signal, the head may be tilted left, so that the headset detects a tendency to move left; when the test audio signal is not heard by the user, the head can be tilted right, so that the earphone detects the trend of moving right, and then the earphone can determine the hearing detection result fed back by the user for the test audio signal according to the detected movement trend. As another example, when the user hears the test audio signal, the head may be rotated horizontally to the left (or rotated horizontally to the right); when the user does not hear the test audio signal, the head can be rotated horizontally to the right (or rotated horizontally to the left), so that the earphone can determine the hearing detection result fed back by the user for the test audio signal according to the motion track detected by the earphone. As another example, when the user hears the test audio signal, the head may be shaken back and forth (i.e., nodding); when the user does not hear the test audio signal, the head can be shaken left and right (i.e., shaking the head), so that the earphone can determine the hearing detection result fed back by the user for the test audio signal according to the detected movement direction or frequency.
In another embodiment, when the user further obtains the hearing test result fed back by the terminal device connected to the earphone in communication, the hearing test result can also be obtained by obtaining the user operation for the terminal device. Illustratively, the user operation for the terminal device may include a touch operation, a button click operation, and the like. When the terminal device detects the user operation, it may be determined whether the user has received the hearing status of the test audio signal according to the user operation, and the hearing status may be sent to the earphone. On this basis, the earphone can further acquire a hearing detection result fed back by aiming at the test audio signal according to the received hearing state.
304. And determining compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points, where the compensation parameters are used to compensate the target audio signal to be output on frequency bands corresponding to the N detection frequency points, where N and M are positive integers, and M is less than or equal to N, where the N detection frequency points may include the M detection frequency points.
In this embodiment of the application, after the hearing test results corresponding to the M detection frequency points are obtained by the earphone, the hearing test results may be analyzed by a built-in processor of the earphone, and then the compensation parameters corresponding to the N detection frequency points are determined based on the analysis condition. Wherein N is also a positive integer, and the value of M is smaller than the value of N.
In some embodiments, if M = N, the N detection frequency points for which the earphone is configured to determine the compensation parameters are in one-to-one correspondence with the M detection frequency points for which the earphone is configured to perform hearing detection, and the earphone may respectively determine the compensation parameters corresponding to the M detection frequency points according to the M hearing detection results obtained by the earphone.
In other embodiments, if M < N, the N detection frequency points for which the headphone determines the compensation parameters may include M detection frequency points for which the headphone performs hearing tests and other one or more frequency points for which no hearing test is performed. Therefore, after the compensation parameters corresponding to the M detection frequency points are respectively determined by the earphone according to the M hearing detection results obtained by the earphone, the compensation parameters corresponding to other frequency points which are not contained in the M detection frequency points in the N detection frequency points can be further determined, so that the compensation parameters corresponding to more detection frequency points can be rapidly determined, and the subsequent efficiency of compensating the audio signal is improved.
It should be noted that the hearing test results corresponding to the M test frequency points may represent the hearing sensitivities of the user for different frequency components of the audio signal (i.e., the frequency components corresponding to the M test frequency points). For example, if it is determined from the hearing test result that the hearing sensitivity of the user at a certain test frequency point is low, that is, the user is not easy to hear the audio signal of the frequency component, the frequency component of the audio signal may be subsequently enhanced; if it is determined according to the hearing test result that the hearing sensitivity of the user at a certain test frequency point is too high, that is, the user is easily stimulated by the audio signal of the frequency component, the frequency component of the audio signal may be retained or weakened subsequently. It is understood that the above measures for enhancing, preserving or attenuating the audio signal are only some examples of the compensation measures for the audio signal, and in practical applications, the compensation measures may be implemented in different degrees and manners, and the compensation measures are determined by the compensation parameters corresponding to the above N detection frequency points, and may be related (including positive correlation or negative correlation) or unrelated to the hearing sensitivities of the user to different frequency components of the audio signal.
For example, the compensation parameters may include filter parameters (such as tap coefficients for configuring the filter, or specific gain coefficients, center frequencies, and the like), so that the headphone may configure corresponding filters to perform compensation filtering on frequency bands corresponding to the detection frequency points according to the compensation parameters corresponding to the N detection frequency points, respectively. For example, when the audio signal of a specific frequency band needs to be compensated, compensation filtering may be performed by configuring a band-pass filter or a band-stop filter of a corresponding frequency band; when more complex compensation needs to be performed on audio signals of multiple frequency bands, corresponding compensation filtering can also be performed by configuring a cascaded FIR (Finite Impulse Response) filter or IIR (Infinite Impulse Response) filter.
It can be seen that, by implementing the audio signal compensation method described in the foregoing embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing test results of the earphone for a plurality of test frequency points, and then the determined compensation parameters can be used for compensating the signal components of each frequency band of the target audio signal in the frequency bands corresponding to the corresponding frequency points. Based on the simple process, the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, so that the complex process that a professional doctor or a user needs to perform hearing detection and parameter calculation in the related technology is avoided, the compensation parameters corresponding to a plurality of detection frequency points can be determined efficiently, and the efficiency of compensating the audio signal is improved.
Referring to fig. 4, fig. 4 is a schematic flowchart illustrating another audio signal compensation method disclosed in the embodiment of the present application, where the method can be applied to the above-mentioned earphone, and the earphone can include a speaker and a feedback microphone. As shown in fig. 4, the audio signal compensation method may include the steps of:
402. and outputting the test audio signals corresponding to the M detection frequency points through a loudspeaker respectively, and acquiring hearing detection results fed back by the test audio signals corresponding to the M detection frequency points respectively.
404. And determining compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points, where the compensation parameters are used to compensate the target audio signal to be output on frequency bands corresponding to the N detection frequency points, where N and M are positive integers, and M is less than or equal to N, where the N detection frequency points may include the M detection frequency points.
Steps 402 and 404 are similar to steps 302 and 304. It should be noted that, when M is equal to N, N detection frequency points targeted by the earphone when determining the compensation parameters correspond to M detection frequency points targeted by the earphone when performing hearing test one to one, and the earphone may respectively determine the compensation parameters corresponding to the M detection frequency points according to the M hearing test results obtained by the earphone.
In this embodiment, the hearing test result corresponding to a certain detection frequency point may include a sound intensity threshold, where the sound intensity threshold may be a critical sound intensity at which the user can hear the test audio signal corresponding to the detection frequency point (that is, the user can just hear the sound intensity of the test audio signal). In some embodiments, the headset may query, in a table look-up manner, the compensation parameters corresponding to the detection frequency points based on the sound intensity thresholds corresponding to the M detection frequency points, respectively; in other embodiments, the earphone may also use a mapping relation between the sound intensity threshold and the compensation parameter to respectively substitute the sound intensity thresholds corresponding to the M detection frequency points into the corresponding mapping relation, so as to calculate the compensation parameter corresponding to each detection frequency point.
Specifically, taking a look-up table as an example, the headset may have a compensation mapping table built therein, where the compensation mapping table may include mapping relationships between the sound intensity thresholds and the compensation parameters corresponding to the detection frequency points, respectively. On this basis, after the hearing test results corresponding to the M detection frequency points are obtained, the compensation parameters corresponding to the M detection frequency points may be respectively queried on the compensation mapping table according to the sound intensity threshold included in the hearing test results, that is, according to the sound intensity threshold corresponding to each of the M detection frequency points. By implementing the table lookup method, the compensation parameters corresponding to the M detection frequency points can be rapidly acquired, so that the subsequent efficiency of configuring the compensation filter based on the compensation parameters can be accelerated, and the efficiency of correspondingly compensating the target audio signal through the compensation filter can be further improved.
In some embodiments, before the earphone queries the compensation parameters through the compensation mapping table, different compensation levels may be further classified into the hearing test results obtained by the earphone, and then the corresponding compensation parameters may be determined according to the sound intensity thresholds of the different compensation levels. For example, the headset may respectively determine compensation levels matched with the sound intensity thresholds according to the sound intensity thresholds corresponding to the M detection frequency points, and then may respectively query the compensation parameters corresponding to the M detection frequency points on the compensation mapping table based on the compensation levels corresponding to the M detection frequency points. It will be appreciated that the degree of compensation that the headphones compensate for the audio signal may differ for different levels of compensation. For example, in some embodiments, when the hearing test result indicates that the hearing impairment of the user is large, the compensation level matching with the hearing test result may be correspondingly determined to be a higher compensation level, so that when the target audio signal to be output is subsequently compensated, a larger gain factor, a smaller quality factor, and the like may be provided. In other embodiments, when the hearing test result indicates that the hearing impairment of the user is small, a lower compensation level may be determined accordingly, so that a smaller gain factor, a larger quality factor, and the like may be provided when the target audio signal to be output is subsequently compensated.
The compensation mapping table may be obtained by training a sample data set, where the sample data set includes sample sound intensity thresholds and sample compensation parameters corresponding to a plurality of sample frequency points, respectively. Therefore, by using the compensation mapping table, the accuracy of the determined compensation parameters (especially gain coefficients) corresponding to each detection frequency point can be improved based on the experimental experience of a large amount of sample data, so that more accurate compensation (especially gain compensation) can be performed on the target audio signal in the frequency band corresponding to each detection frequency point, and the auditory experience of a user can be improved.
As an optional implementation manner, according to the hearing test result fed back by the user, the earphone may further perform differential adjustment on the compensation parameters corresponding to the detection frequency points based on the difference in the sensitivity of the user to the audio signals of different frequencies. Taking the gain coefficient as an example, the earphone may set the gain coefficient corresponding to the frequency point with better user hearing characteristics (i.e. higher user sensitivity) as the attenuating gain coefficient, for example, taking a negative value, subtracting the specified gain adjustment coefficient, etc.; meanwhile, the gain coefficient corresponding to the frequency point with poor user hearing characteristics (i.e. low user sensitivity) may also be set as the enhanced gain coefficient, for example, taking a positive value, adding a specified gain adjustment coefficient, etc. Therefore, the earphone not only can flexibly adjust the target audio signal to be output, but also can realize integral audio signal processing, so that the compensated system frequency response curve is smoother, and the tone quality is more comfortable.
In some embodiments, the headset may set default compensation parameters even if the user's feedback of hearing test results indicates that the user's sensitivity to different frequency audio signals is similar or the same. For example, if the hearing test results corresponding to the M test frequency points all belong to a first range (e.g., the sound intensity thresholds corresponding to the M test frequency points belong to the same threshold range), the headset may determine the compensation parameters corresponding to the N test frequency points as default parameters. Still taking the gain coefficient as an example, the target compensation filter is configured based on the default gain coefficient, and certain compensation can be performed on the target audio signal to be output, so that the user can obviously feel the effect of optimizing the compensation, and the user experience is further improved.
In some embodiments, the earphone may also perform corresponding weighting processing on the hearing test result in advance for different test frequency points, so that an effect similar to the adjustment of the compensation parameter may be achieved when the compensation parameter corresponding to each test frequency point is determined according to the hearing test result in the following. For example, the earphone may give a certain weight to the corresponding hearing test result for the test frequency points of 4000Hz, 6000Hz, etc., so that a corresponding compensation filter may be conveniently configured to implement targeted compensation for the frequency bands where the difference in hearing characteristics is generally insignificant in the human population. By implementing the method, the difference before and after the audio signal compensation is favorably embodied, and meanwhile, the personalized and customized audio signal compensation is favorably realized, so that the user experience is further improved.
406. The compensation parameters comprise compensation filter parameters, and N target compensation filters are respectively configured according to the compensation filter parameters corresponding to the N detection frequency points, wherein the center frequencies of the N target compensation filters respectively correspond to the N detection frequency points one by one.
In an embodiment of the present application, the target compensation filter may include an infinite-length unit impulse response IIR filter. Illustratively, when a second-order IIR filter is employed as the target compensation filter, the second-order IIR filter may be expressed by a difference equation shown in formula 1 as follows:
equation 1:
Figure BDA0003209707230000111
wherein, a i And b i Can be obtained by adopting different calculation modes according to the type of the adopted second-order IIR filter, and a i And b i All can be matched with the center frequency f of the compensating filter 0 (corresponding to the above-mentioned N detection frequency points), the sampling rate f of the target audio signal to be output s The Gain coefficient Gain value of the compensation filter and the quality factor Q value of the compensation filter. Optionally, the Filter type of the second-order IIR filtering may include a low-frequency shelf Filter Lowshelf Filter, a high-frequency shelf Filter Highshelf Filter, a peak Filter, and the like, and is not particularly limited in this embodiment of the present application.
Optionally, if the compensation parameters are determined before the headset leaves a factory (for example, corresponding compensation parameters are specified in advance for several typical and common hearing test results according to manual experience or a big data analysis result), the headset may directly acquire the compensation parameters corresponding to each detection frequency point, and configure a corresponding compensation filter according to the compensation parameters, so as to compensate the target audio signal to be output by the speaker.
408. And respectively carrying out nonlinear compensation on the target audio signal to be output on the frequency band taking the N detection frequency points as centers through the N target compensation filters.
In this embodiment of the application, the earphone may cascade the N target compensation filters, and perform nonlinear compensation on the target audio signal to be output through the cascaded N target compensation filters. For example, please refer to fig. 5 and fig. 6 together, in which fig. 5 is a schematic frequency response diagram of a target compensation filter disclosed in an embodiment of the present application, and fig. 6 is a schematic frequency response diagram of an audio signal compensation performed by the target compensation filter shown in fig. 5, wherein a dotted line in fig. 6 represents a system frequency response before performing the filtering compensation, and a solid line represents a system frequency response after performing the filtering compensation. It is to be understood that the target compensation filter may be an overall filter obtained by cascading the N target compensation filters. As shown in fig. 5, since the amplitude response of the target compensation filter in the frequency band corresponding to each detected frequency point is nonlinear, the corresponding compensation effect may also exhibit nonlinear differences. For example, if the corresponding compensation is small at frequency point a in fig. 5, then the filter compensation effect is correspondingly insignificant near frequency point a in fig. 6; the corresponding compensation is larger at frequency point B in fig. 5, and correspondingly the filter compensation is more pronounced near frequency point B in fig. 6. Therefore, the earphone can perform nonlinear compensation on the target audio signal to be output in each frequency band, so that the flexibility of compensating the target audio signal is improved, the targeted and refined compensation can be realized for the hearing characteristics of different users, and the accuracy and the effectiveness of audio signal compensation are improved.
Further, when the N target compensation filters are cascaded, the N target compensation filters may be smoothly adjusted according to the hearing test results corresponding to the M test frequency points, respectively. For example, if a hearing test result corresponding to a certain detection frequency point indicates that the hearing characteristics of the user at the detection frequency point are poor (i.e., the user sensitivity is low), the compensation parameter corresponding to the detection frequency point may be set as an enhanced compensation parameter, so as to perform signal enhancement adjustment on the frequency band of the target audio signal corresponding to the detection frequency point; if the hearing test result corresponding to a certain detection frequency point indicates that the hearing characteristics of the user at the detection frequency point are good (i.e. the user sensitivity is high), the compensation parameter corresponding to the detection frequency point can be set as an attenuating compensation parameter, so as to perform signal attenuation adjustment on the frequency band of the target audio signal corresponding to the detection frequency point. After the smoothing adjustment (including signal enhancement adjustment or signal attenuation adjustment) is performed, the earphone can cascade the N adjusted target compensation filters, so that the frequency response curve of the overall filter obtained after the cascade connection is smoother, thereby being beneficial to improving the overall tone quality of the target audio signal and further improving the audio signal compensation effect. Referring to fig. 7 and 8 together, fig. 7 is a schematic frequency response diagram of a target compensation filter disclosed in an embodiment of the present application, and fig. 8 is a schematic frequency response diagram of an audio signal compensation performed by the target compensation filter shown in fig. 7, in which a dotted line in fig. 8 represents a system frequency response before performing filter compensation, and a solid line represents a system frequency response after performing filter compensation. It is to be understood that the target compensation filter may be an overall filter obtained by cascading the N target compensation filters. It can be seen that the frequency response curve of the target compensation filter of fig. 7 is smoother relative to fig. 5, and the frequency response curve of the compensated system of fig. 8 is also smoother relative to fig. 6, indicating that a smoother compensation effect is achieved.
It can be seen that, by implementing the audio signal compensation method described in the above embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing detection results of the earphone for a plurality of detection frequency points, and then the determined compensation parameters can be used for compensating the signal components of each frequency band of the target audio signal in the respective frequency bands corresponding to the corresponding frequency points, so that the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, and the efficiency of compensating the audio signal is improved; in addition, the compensation parameters corresponding to the detection frequency points are determined in a table look-up mode, the compensation parameters corresponding to the detection frequency points can be rapidly acquired, the subsequent efficiency of configuring the compensation filter based on the compensation parameters can be accelerated, and the efficiency of correspondingly compensating the target audio signal through the compensation filter can be further improved.
Referring to fig. 9, fig. 9 is a flowchart illustrating another audio signal compensation method disclosed in the embodiment of the present application, where the method can be applied to the above-mentioned earphone, and the earphone can include a speaker, a feedback microphone, and a feedforward microphone. As shown in fig. 9, the audio signal compensation method may include the steps of:
902. and outputting the test audio signals corresponding to the M detection frequency points through a loudspeaker respectively, and acquiring hearing detection results fed back by the test audio signals corresponding to the M detection frequency points respectively.
Step 902 is similar to step 302 described above, and is not described here again.
904. Determining compensation parameters corresponding to a first frequency point according to a hearing test result corresponding to the first frequency point, wherein the first frequency point is one or more frequency points in the M test frequency points;
wherein step 904 is similar to step 304 described above. It should be noted that, since the compensation parameter corresponding to the first frequency point can be used to further determine the compensation parameter corresponding to the second frequency point other than the M detection frequency points in the subsequent steps, when the M detection frequency points are selected, the selection and the setting can be performed based on the corresponding relationship between the second frequency point and the first frequency point.
For example, if the gain coefficients corresponding to several adjacent frequency points can be further determined according to the compensation parameter corresponding to the first frequency point, then, of all N (M < N) detection frequency points to be subjected to hearing test, M detection frequency points can be selected at intervals as the first frequency points for preferentially determining the compensation parameter. Specifically, for example, if the N detection frequency points are 500Hz, 1000Hz, 2000Hz, 4000Hz, 6000Hz, 8000Hz, respectively, N =6. On this basis, M =2 may be taken, for example, two frequency points of 1000Hz and 6000Hz are respectively used as the first frequency point, and after the compensation parameter corresponding to the first frequency point is determined by the earphone, the compensation parameter corresponding to the remaining second frequency point (i.e., 500Hz, 2000Hz, 4000Hz, 8000 Hz) may be further determined according to the compensation parameter corresponding to the first frequency point in the subsequent step. For example, according to the compensation parameters corresponding to the 1000Hz frequency point, the compensation parameters corresponding to two adjacent frequency points, 500Hz and 2000Hz, can be determined; according to the compensation parameters corresponding to the 6000Hz frequency point, the compensation parameters corresponding to two adjacent frequency points of 4000Hz and 8000Hz can be determined.
906. And determining the compensation parameters corresponding to a second frequency point according to the compensation parameters corresponding to the first frequency point, wherein the second frequency point is other frequency points except the M frequency points in the N detection frequency points, and M is smaller than N.
In this embodiment of the application, when M is less than N, after the headphones respectively determine the compensation parameters corresponding to the M detection frequency points according to the M hearing test results obtained by the headphones, the compensation parameters corresponding to other frequency points that are not included in the M detection frequency points in the N detection frequency points can be further determined, so that the compensation parameters corresponding to more detection frequency points can be quickly determined, the reduction of the detection times is facilitated, and the detection time is saved.
In order to determine the compensation parameter corresponding to the second frequency point based on the compensation parameter corresponding to the first frequency point, the first frequency point and the second frequency point need to be determined as related frequency points (for example, adjacent detection frequency points, detection frequency points having a frequency multiplication relationship, and the like), and calculation needs to be performed based on the compensation parameter correspondence relationship between the first frequency point and the second frequency point. The compensation parameter corresponding relation of the relevant frequency points can be obtained through the operation of a specified functional relation, and can also be obtained on the basis of mass data training. By implementing the method, the hearing detection is only carried out on a small number of frequency points, so that the compensation parameters corresponding to a large number of frequency points can be determined for audio signal compensation, and the efficiency and convenience for compensating the audio signals are effectively improved.
As an alternative embodiment, the headphone may also perform compensation adjustment for the third frequency point, so as to improve the fineness of the compensation of the audio signal. The third frequency point may be one or more of the M detection frequency points.
In some embodiments, if the compensation parameter corresponding to the third frequency point is greater than the first parameter threshold, the earphone may determine a first attenuation parameter matching the compensation parameter corresponding to the third frequency point, and the first attenuation parameter may be used to configure a first attenuation filter corresponding to the third frequency point. After the target audio signal to be output is compensated on the frequency band corresponding to the third frequency point by the earphone according to the compensation parameter, the compensated target audio signal is attenuation-corrected on the frequency band corresponding to the third frequency point by the first attenuation filter, so that the excessive gain of the target audio signal brought by the target compensation filter is reduced.
In other embodiments, if the compensation parameters corresponding to the consecutive third frequency points are greater than the first parameter threshold, the earphone may further determine a second attenuation parameter according to the compensation parameters corresponding to the consecutive third frequency points, where the second attenuation parameter may be used to configure a second attenuation filter corresponding to the consecutive compensation frequency band formed by the consecutive third frequency points. After the earphone performs attenuation correction on the target audio signal through the first attenuation filter corresponding to each of the plurality of third frequency points, the second attenuation filter performs overall smoothing on the target audio signal after the attenuation correction on the continuous compensation frequency band, so as to further reduce excessive gain brought by the plurality of target compensation filters on the target audio signal.
By carrying out refined compensation parameter adjustment on the third frequency point, the accuracy of audio signal compensation can be further improved, and especially the accidental overflow of the integral gain of the target compensation filter can be effectively avoided, so that the reliability of compensation on the target audio signal is ensured.
908. And acquiring user information corresponding to the wearer of the earphone.
Illustratively, the user information may include one or more of age information, professional information, style preference information, and usage period information. The style preference information refers to a preferred audio style of the user, such as pure music, metal, rock, and the like. The usage time period information may include the state, duration, frequency, etc. of the user using the headset in different time periods. After the user information corresponding to the wearer of the earphone is acquired, the earphone can perform corresponding audio signal compensation for different user information in subsequent steps, or perform personalized adjustment for the determined compensation parameters, so that personalized audio signal compensation can be realized.
Specifically, for example, the headset may obtain the user information of the user of the terminal device from the terminal device connected to the headset, as the user information corresponding to the wearer of the headset. Taking the example that the user information includes age information, the earphone may obtain the age information of the user from the terminal device, and then may determine a compensation level matched with the age information in a subsequent step (for example, different age groups correspond to different compensation levels), and further obtain a compensation parameter corresponding to the compensation level, so as to perform personalized compensation on the target audio signal to be output, thereby outputting a target audio signal according with the characteristics of the age of the user, and further improving the use experience of the user.
910. And determining a compensation adjustment parameter corresponding to the hearing test result according to the user information, and adjusting the compensation parameter corresponding to each of the N test frequency points according to the compensation adjustment parameter.
In this embodiment, the compensation adjustment parameter determined based on the user information may be used to adjust the compensation parameter corresponding to each of the N detection frequency points. For example, different compensation adjustment parameters may correspond to different types of filters for cascading before or after the compensation filter configured by the compensation parameters to achieve the adjustment effect on the compensation parameters. Illustratively, the Filter corresponding to the compensation adjustment parameter may include one or more of a low frequency shelf Filter Lowshelf Filter, a high frequency shelf Filter Highshelf Filter, and a peak Filter.
Optionally, after the compensation parameters corresponding to the N detection frequency points are adjusted, the earphone may further cascade a Limiter to perform limiting processing, so that the target audio signal gain may be prevented from overflowing, and the safety of the speaker is effectively guaranteed.
By implementing the method, personalized sound effect compensation can be performed based on the user information, and the flexibility of audio signal compensation is further improved.
912. And determining the personalized adjustment type according to the compensation adjustment parameters and the compensation parameters.
914. And acquiring adjustment interactive information corresponding to the personalized adjustment type.
Different compensation adjustment parameters and compensation parameters can be matched with different personalized adjustment types, and the personalized adjustment types can be matched with appointed adjustment interaction information. Illustratively, the adjustment interaction information may include one or more of image information, sound information, and vibration information. For example, the adjustment interactive information may include static or dynamic pictures (which may include text) with a shape, a sound and a sense, which are used to display real-time sound sense states (such as soft, exciting, etc.) or audio compensation states (such as whether the compensation function is turned on or not, what type of compensation function is turned on, etc.) of the target audio signal after the target audio signal to be output is compensated by the earphone; the earphone can also comprise a prompting voice which is output before the target audio signal is output and is used for prompting whether the earphone starts the function of audio signal compensation or not; the method can also comprise a vibration prompt and the like which are output together when the target audio signal is output, so that a multi-dimensional audio compensation effect display is formed, and the use experience of a user is further improved.
916. And sending the adjustment interactive information to terminal equipment connected with the earphone, and triggering the terminal equipment to output the adjustment interactive information.
For example, please refer to fig. 10, fig. 10 is a schematic interface diagram of a terminal device outputting adjustment interaction information according to an embodiment of the present application. As shown in fig. 10, the terminal device 30 may output the adjustment mutual information in the form of an image on its screen 310. The adjustment interactive information may be displayed on the upper half screen (available for resident display) of the screen 310 of the terminal device 30 as shown by an icon 311; or may be displayed in the lower half of the screen 310 (which may be used to turn off the display) as shown by icon 312. The icons 311 and 312 may include text information ("XX" may represent descriptive texts with different senses of sound), image information, and the like. It is understood that the adjustment interactive information shown in fig. 10 is only some examples, the adjustment interactive information shown in the icon 311 and the adjustment interactive information shown in the icon 312 may be displayed separately or simultaneously, and the terminal device 30 may further output other types of adjustment interactive information, so that a personalized audio compensation state may be displayed to the user, resulting in more diversified use experiences.
It can be seen that, by implementing the audio signal compensation method described in the foregoing embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing detection results of the earphone for a plurality of detection frequency points, and then the determined compensation parameters can be used for compensating signal components of each frequency band of the target audio signal in the respective corresponding frequency bands of the corresponding frequency points, so that the compensation parameters required for compensating the target audio signal can be determined quickly and conveniently, and the efficiency of compensating the audio signal is improved; in addition, the accuracy of audio signal compensation can be further improved by performing refined compensation parameter adjustment on the third frequency point, and especially, accidental overflow of the overall gain of the target compensation filter can be effectively avoided, so that the reliability of compensation on the target audio signal is ensured; in addition, personalized sound effect compensation can be performed based on user information, and flexibility of audio signal compensation is further improved.
Referring to fig. 11, fig. 11 is a schematic block diagram of an audio signal compensation apparatus according to an embodiment of the disclosure, where the audio signal compensation apparatus can be applied to the above-mentioned earphone, and the earphone can include a speaker. As shown in fig. 11, the audio signal compensation apparatus may include an output unit 1101 and a determination unit 1102, wherein:
the output unit 1101 is configured to output, through a speaker, test audio signals corresponding to the M detection frequency points, and obtain hearing detection results fed back by the test audio signals corresponding to the M detection frequency points, respectively;
the determining unit 1102 is configured to determine, according to the hearing test results corresponding to the M test frequency points, compensation parameters corresponding to the N test frequency points, where the compensation parameters are used to compensate the target audio signal to be output on frequency bands corresponding to the N test frequency points, where N and M are positive integers, and M is less than or equal to N, where the N test frequency points may include the M test frequency points.
It can be seen that, by using the audio signal compensation device described in the above embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing test results of the earphone for a plurality of test frequency points, and then the determined compensation parameters can be used for compensating the signal components of each frequency band of the target audio signal in the frequency band corresponding to the corresponding frequency point. Based on the simple process, the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, so that the complex process that a professional doctor or a user needs to perform hearing detection and parameter calculation in the related technology is avoided, the compensation parameters corresponding to a plurality of detection frequency points can be determined efficiently, and the efficiency of compensating the audio signal is improved.
In one embodiment, the compensation parameter may include a compensation filter parameter, and the audio signal compensation apparatus may further include a filter configuration unit and a compensation unit, which are not shown in the drawing, wherein:
the filter configuration unit is used for respectively configuring N target compensation filters according to compensation filter parameters corresponding to the N detection frequency points, wherein the center frequencies of the N target compensation filters are respectively in one-to-one correspondence with the N detection frequencies;
and the compensation unit is used for respectively carrying out nonlinear compensation on the target audio signal to be output on the frequency band taking the N detection frequency points as the center through the N target compensation filters, so that the flexibility of compensation on the target audio signal can be improved, the targeted and refined compensation for the hearing characteristics of different users can be realized, and the accuracy and the effectiveness of audio signal compensation are also improved.
The compensation unit may be further configured to cascade the N target compensation filters, and perform nonlinear compensation on the target audio signal to be output through the cascaded N target compensation filters.
Illustratively, when the compensation unit cascades the N target compensation filters, the compensation unit may include the following steps:
according to the hearing detection results corresponding to the M detection frequency points, smooth adjustment is carried out on the N target compensation filters, wherein the smooth adjustment comprises signal enhancement adjustment or signal attenuation adjustment;
and cascading the adjusted N target compensation filters.
It should be noted that the target compensation filter may include an infinite-length unit impulse response IIR filter. In some embodiments, the IIR Filter may include a second-order IIR Filter and may include one or more of a low-frequency shelf Filter Lowshelf Filter, a high-frequency shelf Filter Highshelf Filter, and a peak Filter.
It can be seen that, by using the audio signal compensation device described in the above embodiment to cascade N target compensation filters after adjustment, the frequency response curve of the overall filter obtained after the cascade connection can be smoother, thereby being beneficial to improving the overall tone quality of the target audio signal,
in an embodiment, if the value of M is smaller than N, the determining unit 1102 may include a first determining subunit and a second determining subunit, not shown, wherein:
the first determining subunit is configured to determine, according to a hearing test result corresponding to the first frequency point, a compensation parameter corresponding to the first frequency point, where the first frequency point is one or more frequency points of the M test frequency points;
and the second determining subunit is used for determining the compensation parameters corresponding to the second frequency points according to the compensation parameters corresponding to the first frequency points, wherein the second frequency points are other frequency points except the M frequency points in the N detection frequency points.
It can be seen that, the audio signal compensation device described by the above embodiment is adopted, and only a small number of frequency points are needed to be subjected to hearing detection, so that compensation parameters corresponding to a large number of frequency points can be determined to compensate the audio signal, and the efficiency and convenience of compensating the audio signal are effectively improved.
In an embodiment, if the value of M is equal to N and the hearing test result includes a sound intensity threshold, where the sound intensity threshold is a critical sound intensity at which a user can hear test audio signals corresponding to M detection frequency points, the determining unit 1102 may include a query subunit, not shown in the drawings, where the query subunit may be configured to query compensation parameters corresponding to M detection frequency points on a compensation mapping table according to the sound intensity thresholds corresponding to the M detection frequency points, respectively, and the compensation mapping table includes mapping relationships between the sound intensity thresholds corresponding to the detection frequency points and the compensation parameters.
It should be noted that the compensation mapping table may be obtained by training using a sample data set, where the sample data set includes sample sound intensity thresholds and sample compensation parameters corresponding to a plurality of sample frequency points, respectively.
For example, when the querying subunit queries the compensation parameters corresponding to the M detection frequency points on the compensation mapping table, the following steps may be specifically executed:
respectively determining compensation levels matched with the sound intensity threshold values according to the sound intensity threshold values corresponding to the M detection frequency points;
and respectively inquiring compensation parameters corresponding to the M detection frequency points on the compensation mapping table based on the compensation levels corresponding to the M detection frequency points.
Therefore, the compensation parameters corresponding to the detection frequency points are determined in a table look-up mode, the compensation parameters corresponding to the detection frequency points can be rapidly obtained, the subsequent efficiency of configuring the compensation filter based on the compensation parameters can be accelerated, and the efficiency of correspondingly compensating the target audio signal through the compensation filter can be further improved.
In an embodiment, if the value of M is equal to N, the determining unit 1102 may further include a third determining subunit, not shown in the drawing, and the third determining subunit may be configured to determine, as the default parameter, the compensation parameter corresponding to each of the N detection frequency points if the hearing test results corresponding to the M detection frequency points respectively belong to the first range. The target compensation filter is configured based on the default gain coefficient, and certain compensation can be performed on the target audio signal to be output, so that a user can obviously feel the effect of optimizing the compensation, and the user experience is further improved.
In an embodiment, the audio signal compensation apparatus may further include a first attenuation unit, not shown in the drawing, where the first attenuation unit may determine, when a compensation parameter corresponding to a third frequency point is greater than a first parameter threshold, a first attenuation parameter matched with the compensation parameter corresponding to the third frequency point, where the first attenuation parameter is used to configure a first attenuation filter corresponding to the third frequency point, and the first attenuation filter is used to perform attenuation correction on a frequency band corresponding to the third frequency point on the compensated target audio signal through the first attenuation filter after compensating the target audio signal to be output on the frequency band corresponding to the third frequency point according to the compensation parameter, where the third frequency point is one or more of the M detection frequency points.
In an embodiment, the audio signal compensation apparatus may further include a second attenuation unit, not shown in the drawing, where the first attenuation unit may be configured to determine a second attenuation parameter according to a compensation parameter corresponding to the plurality of third frequency points, the second attenuation parameter is configured to configure a second attenuation filter corresponding to a continuous compensation band formed by the plurality of third frequency points, and the second attenuation filter is configured to perform overall smoothing processing on the target audio signal after attenuation correction on the continuous compensation band through the second attenuation filter after performing attenuation correction on the target audio signal after compensation on the frequency bands corresponding to the plurality of third frequency points through the first attenuation filters corresponding to the plurality of third frequency points, respectively.
It can be seen that, by using the audio signal compensation device described in the above embodiment, the accuracy of audio signal compensation can be further improved by performing refined compensation parameter adjustment on the third frequency point, and especially, accidental overflow of the overall gain of the target compensation filter can be effectively avoided, thereby ensuring the reliability of compensation on the target audio signal.
In one embodiment, the audio signal compensation apparatus may further include an information acquisition unit, not shown, wherein:
the information acquisition unit is used for acquiring user information corresponding to a wearer of the earphone after the determining unit determines the compensation parameters corresponding to the N detection frequency points;
the determining unit is further configured to determine a compensation adjustment parameter corresponding to the hearing test result according to the user information, and adjust the compensation parameter corresponding to each of the N test frequency points according to the compensation adjustment parameter.
The user information may include one or more of age information, professional information, style preference information, and usage period information.
In one embodiment, the audio signal compensation apparatus may further include a transmitting unit not shown in the drawing, wherein:
the determining unit is further configured to determine an individualized adjustment level according to the compensation adjustment parameter and the compensation parameter after determining the compensation adjustment parameter corresponding to the hearing test result;
the information acquisition unit is further configured to acquire adjustment interaction information corresponding to the personalized adjustment level;
and the sending unit is used for sending the adjustment interactive information to the terminal equipment connected with the earphone and triggering the terminal equipment to output the adjustment interactive information.
It can be seen that, by using the audio signal compensation device described in the above embodiment, the compensation parameters corresponding to the same or even more frequency points can be determined according to the hearing detection results of the earphone for a plurality of detection frequency points, and then the determined compensation parameters can be used for compensating the signal components of each frequency band of the target audio signal in the respective frequency bands corresponding to the corresponding frequency points, so that the compensation parameters required for compensating the target audio signal can be determined conveniently and quickly, and the efficiency of compensating the audio signal is improved; in addition, the accuracy of audio signal compensation can be further improved by performing refined compensation parameter adjustment on the third frequency point, and especially, accidental overflow of the overall gain of the target compensation filter can be effectively avoided, so that the reliability of compensation on the target audio signal is ensured; in addition, personalized sound effect compensation can be performed based on user information, and flexibility of audio signal compensation is further improved.
Referring to fig. 12, fig. 12 is a schematic view of a headset according to an embodiment of the present disclosure. As shown in fig. 12, the headset may include:
a memory 1201 in which executable program code is stored;
a processor 1202 coupled with a memory 1201;
the processor 1202 calls the executable program code stored in the memory 1201, and may perform all or part of the steps of any of the audio signal compensation methods described in the above embodiments.
Furthermore, the present application further discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute all or part of the steps of any one of the audio signal compensation methods described in the above embodiments.
In addition, the embodiments of the present application further disclose a computer program product, which when run on a computer, enables the computer to perform all or part of the steps of any one of the audio signal compensation methods described in the above embodiments.
It will be understood by those skilled in the art that all or part of the steps of the methods of the embodiments described above may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, including Read-Only Memory (ROM), random Access Memory (RAM), programmable Read-Only Memory (PROM), erasable Programmable Read-Only Memory (EPROM), one-time Programmable Read-Only Memory (OTPROM), electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc-Read-Only Memory (CD-ROM) or other Memory capable of storing data, a magnetic tape, or any other computer-readable medium capable of storing data.
The audio signal compensation method and apparatus, the earphone, and the storage medium disclosed in the embodiments of the present application are introduced in detail above, and specific examples are applied herein to explain the principles and embodiments of the present application, and the descriptions of the above embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (19)

1. An audio signal compensation method applied to a headphone including a speaker, the method comprising:
respectively outputting test audio signals corresponding to the M detection frequency points through the loudspeaker, and respectively acquiring hearing detection results fed back by aiming at the test audio signals corresponding to the M detection frequency points;
and determining compensation parameters corresponding to the N detection frequency points according to hearing detection results corresponding to the M detection frequency points respectively, wherein the compensation parameters are used for compensating target audio signals to be output on frequency bands corresponding to the N detection frequency points respectively, N and M are positive integers, M is smaller than or equal to N, and the N detection frequency points comprise the M detection frequency points.
2. The method according to claim 1, wherein the compensation parameters comprise compensation filter parameters, and after determining the compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points, the method further comprises:
respectively configuring N target compensation filters according to compensation filter parameters corresponding to the N detection frequency points, wherein the center frequencies of the N target compensation filters respectively correspond to the N detection frequency points one to one;
and respectively carrying out nonlinear compensation on the target audio signal to be output on the frequency band taking the N detection frequency points as the center through the N target compensation filters.
3. The method according to claim 2, wherein the performing, by the N target compensation filters, nonlinear compensation on the target audio signal to be output in the frequency bands centered on the N detection frequency points respectively comprises:
and cascading the N target compensation filters, and carrying out nonlinear compensation on the target audio signal to be output through the N cascaded target compensation filters.
4. The method of claim 3, wherein cascading the N target compensation filters comprises:
according to the hearing detection results corresponding to the M detection frequency points respectively, performing smooth adjustment on the N target compensation filters, wherein the smooth adjustment comprises signal enhancement adjustment or signal attenuation adjustment;
and cascading the adjusted N target compensation filters.
5. The method of claim 2, wherein the target compensation filter comprises an infinite unit impulse response (IIR) filter.
6. The method of claim 5, wherein the IIR Filter comprises a second order IIR Filter and comprises one or more of a low frequency shelf Filter Lowshelf Filter, a high frequency shelf Filter highhelf Filter, and a peak Filter Peaking Filter.
7. The method according to any one of claims 1 to 6, wherein M is smaller than N, and the determining the compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points comprises:
determining compensation parameters corresponding to a first frequency point according to a hearing test result corresponding to the first frequency point, wherein the first frequency point is one or more frequency points in the M test frequency points;
and determining compensation parameters corresponding to a second frequency point according to the compensation parameters corresponding to the first frequency point, wherein the second frequency point is other frequency points except the M frequency points in the N detection frequency points.
8. The method according to any one of claims 1 to 6, wherein M is equal to N, the hearing test results include a sound intensity threshold, the sound intensity threshold is a threshold sound intensity at which a user can hear the test audio signals corresponding to the M test frequency points, and the determining compensation parameters corresponding to the N test frequency points according to the hearing test results corresponding to the M test frequency points comprises:
and respectively inquiring compensation parameters corresponding to the M detection frequency points on a compensation mapping table according to the sound intensity threshold values corresponding to the M detection frequency points, wherein the compensation mapping table comprises the sound intensity threshold values corresponding to the detection frequency points and the mapping relation between the compensation parameters.
9. The method of claim 8, wherein the compensation mapping table is obtained by training a sample data set, wherein the sample data set comprises sample sound intensity thresholds and sample compensation parameters corresponding to a plurality of sample frequency points, respectively.
10. The method according to claim 8, wherein the querying, according to the sound intensity threshold corresponding to each of the M detection frequency points, for the compensation parameters corresponding to the M detection frequency points on a compensation mapping table respectively comprises:
respectively determining compensation levels matched with the sound intensity threshold values according to the sound intensity threshold values respectively corresponding to the M detection frequency points;
and respectively inquiring compensation parameters corresponding to the M detection frequency points on a compensation mapping table based on the compensation levels corresponding to the M detection frequency points.
11. The method according to any one of claims 1 to 6, wherein M is equal to N, and the determining compensation parameters corresponding to the N detection frequency points according to the hearing test results corresponding to the M detection frequency points comprises:
and if the hearing test results corresponding to the M test frequency points respectively belong to a first range, determining the compensation parameters corresponding to the N test frequency points as default parameters.
12. The method according to any one of claims 1 to 6, wherein after determining the compensation parameters corresponding to the respective N detection frequency points according to the hearing test results corresponding to the respective M detection frequency points, the method further comprises:
if the compensation parameter corresponding to the third frequency point is larger than a first parameter threshold, determining a first attenuation parameter matched with the compensation parameter corresponding to the third frequency point, wherein the first attenuation parameter is used for configuring a first attenuation filter corresponding to the third frequency point, and the first attenuation filter is used for compensating the target audio signal to be output on the frequency band corresponding to the third frequency point according to the compensation parameter, and then carrying out attenuation correction on the compensated target audio signal on the frequency band corresponding to the third frequency point through the first attenuation filter, wherein the third frequency point is one or more of the M detection frequency points.
13. The method according to claim 12, wherein the third frequency point includes a plurality of points, and after determining the first attenuation parameter matching the compensation parameter corresponding to the third frequency point if the compensation parameter corresponding to the third frequency point is greater than the first parameter threshold, the method further comprises:
and determining a second attenuation parameter according to the compensation parameters corresponding to the plurality of third frequency points, wherein the second attenuation parameter is used for configuring a second attenuation filter corresponding to a continuous compensation frequency band formed by the plurality of third frequency points, and the second attenuation filter is used for performing attenuation correction on the compensated target audio signal on the frequency bands corresponding to the plurality of third frequency points through the first attenuation filters corresponding to the plurality of third frequency points respectively and performing integral smoothing processing on the target audio signal subjected to attenuation correction on the continuous compensation frequency band through the second attenuation filter.
14. The method according to any one of claims 1 to 6, wherein after determining the compensation parameters corresponding to the respective N detection frequency points according to the hearing test results corresponding to the respective M detection frequency points, the method further comprises:
acquiring user information corresponding to a wearer of the earphone;
and determining compensation adjustment parameters corresponding to the hearing test results according to the user information, and adjusting the compensation parameters corresponding to the N test frequency points according to the compensation adjustment parameters.
15. The method of claim 14, wherein the user information comprises one or more of age information, professional information, style preference information, and usage period information.
16. The method of claim 14, wherein after determining the compensation adjustment parameter corresponding to the hearing test result according to the user information, the method further comprises:
determining an individualized adjustment type according to the compensation adjustment parameter and the compensation parameter;
acquiring adjustment interactive information corresponding to the personalized adjustment type;
and sending the adjustment interactive information to a terminal device connected with the earphone, and triggering the terminal device to output the adjustment interactive information.
17. An audio signal compensation apparatus applied to a headphone including a speaker, the audio signal compensation apparatus comprising:
the output unit is used for respectively outputting the test audio signals corresponding to the M detection frequency points through the loudspeaker and respectively acquiring hearing detection results fed back by aiming at the test audio signals corresponding to the M detection frequency points;
and the determining unit is used for determining compensation parameters corresponding to the N detection frequency points according to hearing detection results corresponding to the M detection frequency points respectively, wherein the compensation parameters are used for compensating target audio signals to be output on frequency bands corresponding to the N detection frequency points respectively, N and M are positive integers, M is smaller than or equal to N, and the N detection frequency points comprise the M detection frequency points.
18. A headset comprising a memory and a processor, the memory having stored thereon a computer program which, when executed by the processor, causes the processor to carry out the method of any one of claims 1 to 16.
19. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 16.
CN202110928003.1A 2021-08-13 2021-08-13 Audio signal compensation method and device, earphone and storage medium Pending CN115706885A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110928003.1A CN115706885A (en) 2021-08-13 2021-08-13 Audio signal compensation method and device, earphone and storage medium
PCT/CN2022/106733 WO2023016208A1 (en) 2021-08-13 2022-07-20 Audio signal compensation method and apparatus, earbud, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110928003.1A CN115706885A (en) 2021-08-13 2021-08-13 Audio signal compensation method and device, earphone and storage medium

Publications (1)

Publication Number Publication Date
CN115706885A true CN115706885A (en) 2023-02-17

Family

ID=85181065

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110928003.1A Pending CN115706885A (en) 2021-08-13 2021-08-13 Audio signal compensation method and device, earphone and storage medium

Country Status (2)

Country Link
CN (1) CN115706885A (en)
WO (1) WO2023016208A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116249062B (en) * 2023-05-08 2023-07-25 深圳市英唐数码科技有限公司 Hearing-aid equipment state intelligent quality inspection method, system and medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105050014A (en) * 2015-06-01 2015-11-11 邹采荣 Hearing-aid device and method based on smart phone
AU2016100861A4 (en) * 2015-06-29 2016-07-07 Audeara Pty. Ltd. A customisable personal sound delivery system
US11607155B2 (en) * 2018-03-10 2023-03-21 Staton Techiya, Llc Method to estimate hearing impairment compensation function
CN110012406A (en) * 2019-04-10 2019-07-12 深圳湃声声学科技有限公司 Acoustic signal processing method, device, processor and ossiphone
CN112887877B (en) * 2021-01-28 2023-09-08 歌尔科技有限公司 Audio parameter setting method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2023016208A1 (en) 2023-02-16

Similar Documents

Publication Publication Date Title
CN113676803B (en) Active noise reduction method and device
JP6096993B1 (en) Earphone sound effect compensation method, apparatus, and earphone
US6639987B2 (en) Communication device with active equalization and method therefor
US8761421B2 (en) Portable electronic device and computer-readable medium for remote hearing aid profile storage
CN106775553A (en) Sound-volume control system and method for controlling volume
US20240040325A1 (en) Audio signal compensation method and apparatus, earphone and storage medium
CN114071308B (en) Headset self-adaptive tuning method and device, headset and readable storage medium
CN109524016B (en) Audio processing method and device, electronic equipment and storage medium
EP3038255B1 (en) An intelligent volume control interface
EP2705672B1 (en) Method for determining an impedance of an electroacoustic transducer and for operating an audio playback device
WO2021103260A1 (en) Control method for headphones and headphones
CN114125639B (en) Audio signal processing method and device and electronic equipment
CN111314560A (en) Method for adjusting sound loudness and communication terminal
CN115412803A (en) Audio signal compensation method and device, earphone and storage medium
CN107547732A (en) A kind of media play volume adjusting method, device, terminal and storage medium
CN111629313B (en) Hearing device comprising loop gain limiter
WO2023016208A1 (en) Audio signal compensation method and apparatus, earbud, and storage medium
CN114501224A (en) Sound playing method and device, wearable device and storage medium
CN111800699B (en) Volume adjustment prompting method and device, earphone equipment and storage medium
WO2004004414A1 (en) Method of calibrating an intelligent earphone
WO2022199354A1 (en) Call volume adjustment method and apparatus, and terminal and storage medium
EP3941090A1 (en) Method for adjusting a hear-through mode of a hearing device
CN115623372A (en) Earphone and method for adjusting sound effect of earphone
CN114157957B (en) Earphone active noise reduction method and device, electronic equipment and readable storage medium
CN114125625B (en) Noise reduction adjustment method, earphone and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination