CN116782094A - Audio processing method, device, computer readable storage medium and electronic equipment - Google Patents
Audio processing method, device, computer readable storage medium and electronic equipment Download PDFInfo
- Publication number
- CN116782094A CN116782094A CN202310886072.XA CN202310886072A CN116782094A CN 116782094 A CN116782094 A CN 116782094A CN 202310886072 A CN202310886072 A CN 202310886072A CN 116782094 A CN116782094 A CN 116782094A
- Authority
- CN
- China
- Prior art keywords
- signal
- target
- real
- time
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 230000007613 environmental effect Effects 0.000 claims abstract description 44
- 210000000988 bone and bone Anatomy 0.000 claims abstract description 39
- 230000005236 sound signal Effects 0.000 claims abstract description 34
- 238000000034 method Methods 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 claims description 35
- 238000012546 transfer Methods 0.000 claims description 32
- 230000035772 mutation Effects 0.000 claims description 23
- 230000009467 reduction Effects 0.000 claims description 20
- 230000001629 suppression Effects 0.000 claims description 19
- 238000001914 filtration Methods 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000000452 restraining effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The application discloses an audio processing method, a device, a computer readable storage medium and electronic equipment, wherein the method comprises the steps of dividing a target audio signal acquired in real time to obtain a high-frequency signal and a medium-low frequency signal; obtaining a target reference signal based on a current environmental noise signal transmitted by a feedforward microphone acquired in real time; acquiring a real-time control signal based on a real-time acquired target reference signal and a real-time acquired feedforward control filter coefficient of a feedforward microphone; the high-frequency signal and the real-time control signal are fused to form a first target audio signal and output to the air conduction sounding device so as to play corresponding first target audio, the simultaneously-timed medium-low frequency signal is output to the bone conduction sounding device so as to play corresponding second target audio, and the first target audio and the second target audio are synchronously played; the audio processing method provided by the application avoids the influence of the environmental noise on the audio receiving of the bone conduction earphone user, and can eliminate the interference of the external environmental noise for the user in a noisy environment.
Description
Technical Field
The present application relates to the field of audio technologies, and in particular, to an audio processing method, an apparatus, a computer readable storage medium, and an electronic device.
Background
In the earphone industry, the current noise reduction target mainly focuses on active noise reduction of a call. Active noise reduction for conversation in the industry refers to restraining the influence of environmental noise on the conversation partner in the conversation process. It can be seen that the technical improvement of the influence direction of the noise on the voice receiving of the earphone user by the technicians in the industry is not much.
In distinction to the air conduction earphone, the bone conduction earphone is used for transmitting sound in a bone conduction manner, so that the environmental noise greatly influences the user experience of a user when the bone conduction earphone is used, for example, in noisy subways, high-speed rails and other environments, the audio signal transmitted by the bone conduction earphone can be completely submerged by the environmental noise synchronously transmitted into human ears.
Therefore, there is a need to find a way for bone conduction headset users to effectively suppress the effects of ambient noise when listening to the headset audio signals.
Disclosure of Invention
The application aims to provide an audio processing method, an audio processing device, a computer readable storage medium and electronic equipment, which can effectively reduce the influence of environmental noise and improve the voice quality of voice of a conversation counterpart answered by a headset user.
In order to achieve the purpose of the application, the application provides the following technical scheme:
in the first aspect, a high-frequency signal and a medium-low frequency signal are obtained by frequency division of a target audio signal obtained in real time;
obtaining a target reference signal based on a current environmental noise signal transmitted by a feedforward microphone acquired in real time;
acquiring a real-time control signal based on the target reference signal acquired in real time and a feedforward control filter coefficient of the feedforward microphone acquired in real time;
and the high-frequency signal and the real-time control signal are fused to form a first target audio signal and output to the air conduction sounding device so as to play corresponding first target audio, the middle-low frequency signal at the same time is output to the bone conduction sounding device so as to play corresponding second target audio, and the first target audio and the second target audio are synchronously played.
In a preferred embodiment, the obtaining the target reference signal based on the current environmental noise signal transmitted by the feedforward microphone acquired in real time includes:
acquiring an initial reference signal transmitted by a feedforward microphone in real time;
performing band-pass filtering processing on the initial reference signal to obtain a preprocessed reference signal;
and carrying out reduction treatment on the preprocessed reference signal to obtain a target reference signal.
In a preferred embodiment, the reducing the reference signal after the preprocessing to obtain the target reference signal includes:
the target reference signal is obtained based on a pre-processed reference signal and a pre-calibrated output-reference transfer path coefficient.
In a preferred embodiment, the method further comprises updating the feedforward control filter coefficients in real time, including:
judging whether an environmental noise mutation exists in real time, and determining a target mutation suppression coefficient at the current moment according to a preset corresponding relation between a judging result and the mutation suppression coefficient;
updating the output-error transfer path coefficient of the feedback microphone in real time;
obtaining a target feedback signal based on a current environmental noise signal transmitted by a feedback microphone obtained in real time;
the feedforward control filter coefficient at the current time is obtained based on the output-error transfer path coefficient at the current time, the target abrupt change suppression coefficient, and the target feedback signal.
In a preferred embodiment, the obtaining the target feedback signal based on the current environmental noise signal transmitted by the feedback microphone acquired in real time includes:
acquiring an initial feedback signal transmitted by a feedback microphone in real time;
performing band-pass filtering processing on the initial feedback signal to obtain a preprocessed feedback signal;
and carrying out reduction processing on the preprocessed feedback signal to obtain a target feedback signal.
In a preferred embodiment, the updating the output-error transfer path coefficient of the feedback microphone in real time includes:
obtaining a pre-calibrated initial output-error transfer path coefficient;
and carrying out real-time compensation updating on the initial output-error transfer path coefficient to obtain the output-error transfer path coefficient.
In a second aspect, there is provided an audio processing apparatus, the apparatus comprising:
the first acquisition module is used for obtaining a high-frequency signal and a medium-low frequency signal by frequency division of a target audio signal acquired in real time;
the second acquisition module is used for acquiring a target reference signal based on the current environmental noise signal transmitted by the feedforward microphone acquired in real time;
and the processing module is used for fusing the high-frequency signal with the real-time control signal and outputting the high-frequency signal to the air conduction sounding device so as to play and form a first target audio, and outputting the medium-low frequency signal at the same time to the bone conduction sounding device so as to play and form a second target audio.
In a preferred embodiment, the second acquisition module includes:
the first acquisition unit is used for acquiring an initial reference signal transmitted by the feedforward microphone in real time;
the second acquisition unit is used for carrying out band-pass filtering processing on the initial reference signal to obtain a preprocessed reference signal;
and the reduction unit is used for carrying out reduction processing on the preprocessed reference signal to obtain a target reference signal.
In a third aspect, a computer-readable storage medium is provided, on which a computer program is stored which, when executed by one or more processors, implements the steps of the audio processing method according to any of the first aspects.
In a fourth aspect, an electronic device is provided, comprising:
the audio receiving device is in communication connection with a target communication terminal to receive the target audio signal sent by the target communication terminal in real time;
a feedforward microphone for picking up a current ambient noise signal;
one or more processors coupled to the audio acquisition device, the feedforward microphone, respectively, to perform operations according to any of the first aspects; and
the gas conduction sounding device is connected with the one or more processors to receive the first target audio signal and play corresponding first target audio;
and the bone conduction sounding device is connected with the one or more processors to receive the second target audio signal and play corresponding second target audio.
Compared with the prior art, the application has the following beneficial effects:
the application provides an audio processing method, an audio processing device, a computer readable storage medium and electronic equipment, wherein the method comprises the steps of dividing a target audio signal acquired in real time to obtain a high-frequency signal and a medium-low frequency signal; obtaining a target reference signal based on a current environmental noise signal transmitted by a feedforward microphone acquired in real time; acquiring a real-time control signal based on a real-time acquired target reference signal and a real-time acquired feedforward control filter coefficient of a feedforward microphone; the method comprises the steps of fusing a high-frequency signal and a real-time control signal to form a first target audio signal, outputting the first target audio signal to an air conduction sounding device so as to play corresponding first target audio, outputting a simultaneously-timed medium-low frequency signal to a bone conduction sounding device so as to play corresponding second target audio, and synchronously playing the first target audio and the second target audio; according to the audio processing method provided by the application, the environment noise is counteracted by synchronously playing the reverse sound signal of the environment noise through the air conduction sounding device arranged on the bone conduction earphone, so that the influence of the environment noise on the user when receiving the earphone audio is avoided, the interference of the external environment noise can be eliminated for the user even in a noisy environment, a better audio receiving experience is provided, and the quality of the user communication or music experience is improved; and the high-frequency part in the target audio signal is output by using the gas conduction sounding device in a frequency division mode, so that the defect that the bone conduction earphone experiences poor high-frequency part of the audio can be effectively overcome, and the use experience of the bone conduction earphone is improved;
the method further comprises the steps of updating the feedforward control filter coefficient in real time, including judging whether the environmental noise mutation exists in real time, and determining a target mutation suppression coefficient at the current moment according to the corresponding relation between a preset judging result and the mutation suppression coefficient; updating the output-error transfer path coefficient of the feedback microphone in real time; obtaining a target feedback signal based on a current environmental noise signal transmitted by a feedback microphone obtained in real time; obtaining a feedforward control filter coefficient at the current moment based on the error transfer path coefficient at the current moment, the mutation suppression coefficient and a target feedback signal; the adaptive updating based on the feedforward control filter can effectively avoid abnormal sounds such as howling and the like caused by sudden changes of the real-time control signal due to sudden changes of the environmental noise, thereby further improving the use experience of the bone conduction earphone.
Drawings
Fig. 1 is a flowchart of an audio processing method in the present embodiment;
fig. 2 is a hardware configuration layout of one view direction of the bone conduction headset in the present embodiment;
fig. 3 is a layout diagram of the hardware structure of the bone conduction headset in another view direction in the present embodiment;
FIG. 4 is a schematic diagram of the audio processing method in the present embodiment;
fig. 5 is a schematic diagram of the structure of a computer-readable storage medium according to the present embodiment.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
In the description of the present application, it should be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.
Aiming at the current situation that when the current earphone, particularly the bone conduction earphone, is in use, a user is susceptible to environmental noise when receiving an audio signal, the embodiment provides an audio processing method, an audio processing device, a computer readable storage medium and electronic equipment, and can effectively improve the use experience when the user uses the earphone, particularly the bone conduction earphone.
Audio processing methods, apparatuses, computer-readable storage media, and electronic devices are described in further detail below in connection with specific embodiments.
Examples
As shown in fig. 1 and 4, the present embodiment provides an audio processing method, which is suitable for a bone conduction earphone, and is used for suppressing the influence of environmental noise on the bone conduction earphone when a user listens to audio to perform real-time active noise reduction, so that a quiet earphone use environment can be provided for the bone conduction earphone even in a noisy environment.
As shown in fig. 2 and 3, the earphone in the present embodiment includes a controller, a microphone, an air conduction sounding device (speaker) 1, a bone conduction sounding device (motor vibrator), a feedforward microphone 3, a feedback microphone 2, and the like, wherein the controller is configured to perform the audio processing method, the feedforward microphone 3 and the feedback microphone 2 are both configured to pick up environmental noise of the earphone, and the air conduction sounding device is configured to output a first target audio corresponding to a first target audio signal output by the controller. Preferably, the processor is integrated in the bluetooth controller of the bone conduction headset or algorithmically processed in a separate MCU/DSP. Preferably, the air conduction sounding device is arranged at the main control hardware, preferably near or towards the ear, the feedback microphone 2 is arranged at the near ear end of the bone conduction earphone closest to the human ear, and the feedforward microphone 3 is arranged at the position of the bone conduction vibrator far from the loudspeaker. Of course, the setting manner is not limited to this, and all setting manners capable of realizing the audio processing method in the present embodiment are within the scope of the present embodiment.
Specifically, the audio processing method includes:
s1, dividing frequency of a target audio signal acquired in real time to obtain a high-frequency signalMedium and low frequency signals.
Specifically, the target audio signal is divided by band-pass filtering to obtain a high-frequency signal and a medium-low frequency signal respectively. In this embodiment, the frequency of the high-frequency signal is greater than 1000Hz, and the frequency of the medium-low frequency signal is less than 1000 Hz.
S2, obtaining a target reference signal x (n) based on the current environmental noise signal transmitted by the feedforward microphone obtained in real time.
Specifically, step S2 includes:
s21, acquiring an initial reference signal transmitted by the feedforward microphone in real time.
S22, carrying out band-pass filtering processing on the initial reference signal to obtain a preprocessed reference signal.
Specifically, the initial reference signal is preprocessed according to the frequency band range of the active noise reduction control to obtain a preprocessed reference signal, and the preprocessing method is implemented by adopting band-pass filtering to perform filtering processing according to the frequency band range of the active noise reduction control.
S23, carrying out reduction processing on the preprocessed reference signal to obtain a target reference signal x (n).
Since the output audio corresponding to the control signal output by the gas conduction sounding device and the output audio corresponding to the high-frequency part of the target audio may have a certain influence on the initial reference signal acquired by the feedforward microphone, the initial reference signal needs to be subjected to reduction processing to obtain an actual target reference signal.
Before step S23, the method further includes step S0a of pre-calibrating the output-reference transmission path coefficient of the feedforward microphone to obtain a calibrated output-reference transmission path coefficient. The step S0a specifically comprises the following steps: the test loudspeaker emits a white noise signal a (n), the feedforward microphone picks up the white noise signal and converts the white noise signal into an audio electric signal (reference signal x0 (n)), the reference signal x0 (n) and the white noise signal are calculated according to a least mean square algorithm (LMS) to obtain a calibrated output-reference transmission path coefficient Pn, and n represents the current n moment.
Similarly, the method further comprises the step of S0b, emitting a white noise signal a (n) by the test loudspeaker, picking up the white noise signal by the feedback microphone, converting the white noise signal into an audio electric signal (error signal e0 (n)), calculating a calibrated output-feedback transfer path coefficient Sn according to a least mean square algorithm (LMS) by the error signal e0 (n) and the white noise signal, wherein n represents the current n time.
It should be noted that, the calibration output-reference transmission path coefficient Pn and the calibration output-feedback transmission path coefficient Sn are actual physical parameters of the bone conduction earphone, and only one calibration is needed after the bone conduction earphone leaves the factory.
The step S23 specifically includes: and obtaining a target reference signal based on the preprocessed reference signal and a calibrated output-reference transmission path coefficient calibrated in advance. Specifically, the target reference signal is obtained by calculation of the following formula (1)x(n)：
（1）
Where n represents the current nth time, i represents the sequence number, and M represents the filter order.
S3, acquiring a real-time control signal based on the real-time acquired target reference signal and the feedforward control filter coefficient of the feedforward microphone acquired in real time.
Before step S3, the method further includes Sa, updating feedforward control filter coefficients in real time, including:
sa1, real-time update based on the calibration output-error transfer path coefficient of the feedback microphone obtained in advance to obtain the real-time output-error transfer path coefficient。
Specifically, step Sa1 includes:
sa1-1, obtaining a calibration output-error transfer path coefficient, see step S0b;
sa1-2, and error transmission path coefficient for calibration outputPerforming real-time compensation update to obtain real-time output-error transfer path coefficient。
Specifically, the real-time output-error transfer path coefficient is obtained by calculation using the following formula (2)：
（2）
M denotes the filter order, n denotes the current n time instant, i denotes the sequence number,Sni(n)representation ofnTime, the firstiCalibration output of sequence number-error transfer path coefficient.
Sa2, obtaining a target feedback signal based on the current environmental noise signal transmitted by the feedback microphone obtained in real time. Specifically, step Sa1 includes:
sa2-1, acquiring an initial feedback signal transmitted by a feedback microphone in real time;
sa2-2, performing band-pass filtering processing on the initial feedback signal to obtain a preprocessed feedback signal;
sa2-3 for feedback signal after pretreatmentPerforming reduction treatment to obtain target feedback signal->。
Because the output audio corresponding to the control signal output by the gas conduction sounding device and the output audio corresponding to the high-frequency part of the target audio may have a certain influence on the initial feedback signal collected by the feedback microphone, the initial feedback signal needs to be restored to obtain the actual target feedback signal。
Specifically, the target feedback signal e (n) is obtained by calculation using the following formula (3):
（3）
wherein M represents the filter order, n represents the current n time, i represents the sequence number,representation ofnTime, the firstiCalibration output of sequence number-error transfer path coefficient.
And Sa3, judging whether the environmental noise mutation exists or not in real time based on the target feedback signal, and determining a target mutation suppression coefficient at the current moment according to the corresponding relation between a preset judging result and the mutation suppression coefficient.
In one embodiment, it is determined whether the target feedback signal belongs to a preset feedback signal threshold. If not, judging the mutation of the environmental noise. If yes, judging that the environmental noise has no mutation.
In another embodiment, it is determined whether the target feedback signal power belongs to a preset feedback signal power threshold, and if not, it is determined that the environmental noise is abrupt. If yes, judging that the environmental noise has no mutation.
When it is judged that the environmental noise has no mutation, the mutation suppression coefficient p3 value is set to 0. When the environmental noise is judged to be suddenly changed: the value of the abrupt change suppression coefficient p3 is updated to be non-zero, so that the updated quantity part of the feedforward control filter coefficient is attenuated rapidly, and the feedforward control filter coefficient is stopped from updating.
Sa4, obtaining the feedforward control filter coefficient at the current moment based on the real-time output-error transfer path coefficient at the current moment, the target abrupt change suppression coefficient and the target feedback signal.
Specifically, the feedforward control filter coefficients are calculated using the following equations (4) (5):
（4）
（5）
wherein,,representing step size->Representing an anti-divergence small value, +.>Representing normalized coefficient,/->Represents mutation suppression coefficient, N1 represents error buffer order,>indicating the degree of adaptation of the feedforward control filter at the present time (which can be used to update the coefficients of the feedforward control filter to achieve adaptive feedforward control),>representing the feedforward control filter coefficients at the current time.
Therefore, when the feedforward control filter coefficient is updated, an abnormal sound suppression module is added on the basis of the fxlms algorithm, and abnormal sound generation caused by abrupt change of the output of the control signal due to abrupt change of environmental noise can be effectively avoided.
S4, fusing the high-frequency signal and the real-time control signal to form a first target audio signal, outputting the first target audio signal to the air conduction sounding device so as to play the corresponding first target audio, outputting the simultaneously-timed medium-low frequency signal to the bone conduction sounding device so as to play the corresponding second target audio, and synchronously playing the first target audio and the second target audio.
In summary, the present embodiment provides an audio processing method, which counteracts environmental noise by means of synchronous playing of an environmental noise reverse sound signal by an air conduction sounding device set by a bone conduction earphone, so as to avoid influence of the environmental noise on the user when receiving the earphone audio, and even in a noisy environment, the method can eliminate interference of external environmental noise for the user, provide a better audio receiving experience, and improve quality of user communication or music experience; and the high-frequency part in the target audio signal is output by using the gas conduction sounding device in a frequency division mode, so that the defect that the bone conduction earphone experiences poor high-frequency part of the audio can be effectively overcome, and the use experience of the bone conduction earphone is improved;
and the adaptive updating based on the feedforward control filter can effectively avoid abnormal sounds such as howling and the like caused by abrupt change of the real-time control signal due to abrupt change of the environmental noise, thereby further improving the use experience of the bone conduction earphone.
Corresponding to the above-mentioned audio processing method, the present embodiment further provides an audio processing apparatus corresponding to the method, and the method is implemented by each functional module. The audio processing apparatus includes:
the first acquisition module is used for obtaining a high-frequency signal and a medium-low frequency signal by frequency division of a target audio signal acquired in real time;
the second acquisition module is used for acquiring a target reference signal based on the current environmental noise signal transmitted by the feedforward microphone acquired in real time;
the processing module is used for fusing the high-frequency signal and the real-time control signal and outputting the fused high-frequency signal and the real-time control signal to the air conduction sounding device so as to play and form a first target audio, and outputting the medium-low frequency signal at the same time to the bone conduction sounding device so as to play and form a second target audio;
and the updating module is used for updating the feedforward control filter coefficient in real time.
The second obtaining module includes:
the first acquisition unit is used for acquiring an initial reference signal transmitted by the feedforward microphone in real time;
the second acquisition unit is used for carrying out band-pass filtering processing on the initial reference signal to obtain a preprocessed reference signal;
and the reduction unit is used for carrying out reduction processing on the preprocessed reference signal to obtain a target reference signal.
The second obtaining unit is specifically configured to obtain the target reference signal based on the preprocessed reference signal and a calibrated output-reference transmission path coefficient calibrated in advance.
The update module includes:
the first updating unit is used for carrying out real-time updating based on the calibration output-error transfer path coefficient of the feedback microphone obtained in advance to obtain a real-time output-error transfer path coefficient;
a third acquisition unit for acquiring a target feedback signal based on the current environmental noise signal transmitted by the feedback microphone acquired in real time;
the first processing unit is used for judging whether the environmental noise mutation exists or not in real time based on the target feedback signal, and determining a target mutation suppression coefficient at the current moment according to the corresponding relation between a preset judging result and the mutation suppression coefficient;
and the second processing unit is used for obtaining the feedforward control filter coefficient at the current moment based on the real-time output-error transfer path coefficient at the current moment, the target mutation suppression coefficient and the target feedback signal.
The first updating unit is specifically configured to:
obtaining a calibration output-error transfer path coefficient of the feedback microphone;
and carrying out real-time compensation and update on the calibrated output-error transfer path coefficient to obtain the real-time output-error transfer path coefficient.
The third obtaining unit is specifically configured to:
acquiring an initial feedback signal transmitted by a feedback microphone in real time;
performing band-pass filtering processing on the initial feedback signal to obtain a preprocessed feedback signal;
and carrying out reduction processing on the preprocessed feedback signal to obtain a target feedback signal.
It should be noted that: in the audio processing device provided in the above embodiment, when performing audio processing service, only the division of the above functional modules is used for illustration, in practical application, the above functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the embodiments of the audio processing apparatus and the audio processing method provided in the foregoing embodiments belong to the same concept, that is, the apparatus is based on the method, and the specific implementation process of the apparatus is detailed in the method embodiment, which is not described herein again.
And as shown in fig. 5, this embodiment also provides a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements the steps of the audio processing method provided in this embodiment, so that environmental noise of a user can be effectively counteracted, and the influence of the environmental noise on the user receiving the earphone audio signal is avoided.
In particular, any combination of one or more computer readable media may be employed. The computer readable storage medium may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Further, the present embodiment also provides an electronic device, preferably a bone conduction headset, including:
the audio receiving device is in communication connection with a target communication terminal to receive the target audio signal sent by the target communication terminal in real time;
a feedforward microphone for picking up a current ambient noise signal;
one or more processors, respectively connected to the audio acquisition device and the feedforward microphone, for performing operations according to any one of the foregoing audio reception methods; and
the gas conduction sounding device is connected with the one or more processors to receive the first target audio signal and play corresponding first target audio;
and the bone conduction sounding device is connected with the one or more processors to receive the second target audio signal and play corresponding second target audio.
All the above optional technical solutions can be combined to form an optional embodiment of the present application, and any multiple embodiments can be combined, so as to obtain the requirements of coping with different application scenarios, which are all within the protection scope of the present application, and are not described in detail herein.
It should be noted that the above-mentioned embodiments are only preferred embodiments of the present application, and are not intended to limit the present application, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (10)
1. A method of audio processing, the method comprising:
dividing the frequency of a target audio signal acquired in real time to acquire a high-frequency signal and a medium-low frequency signal;
obtaining a target reference signal based on a current environmental noise signal transmitted by a feedforward microphone acquired in real time;
acquiring a real-time control signal based on the target reference signal acquired in real time and a feedforward control filter coefficient of the feedforward microphone acquired in real time;
and the high-frequency signal and the real-time control signal are fused to form a first target audio signal and output to the air conduction sounding device so as to play corresponding first target audio, the middle-low frequency signal at the same time is output to the bone conduction sounding device so as to play corresponding second target audio, and the first target audio and the second target audio are synchronously played.
2. The method of claim 1, wherein the obtaining the target reference signal based on the current ambient noise signal transmitted by the feed-forward microphone acquired in real-time comprises:
acquiring an initial reference signal transmitted by a feedforward microphone in real time;
performing band-pass filtering processing on the initial reference signal to obtain a preprocessed reference signal;
and carrying out reduction treatment on the preprocessed reference signal to obtain a target reference signal.
3. The method of claim 2, wherein the reducing the preprocessed reference signal to obtain the target reference signal comprises:
and obtaining the target reference signal based on the preprocessed reference signal and a calibrated output-reference transmission path coefficient calibrated in advance.
4. The method of claim 1, further comprising updating the feedforward control filter coefficients in real time, comprising:
updating in real time based on a calibration output-error transfer path coefficient of a feedback microphone obtained in advance to obtain a real-time output-error transfer path coefficient;
obtaining a target feedback signal based on a current environmental noise signal transmitted by a feedback microphone obtained in real time;
judging whether an environmental noise mutation exists or not in real time based on a target feedback signal, and determining a target mutation suppression coefficient at the current moment according to a preset corresponding relation between a judging result and the mutation suppression coefficient;
the feedforward control filter coefficient at the current time is obtained based on the real-time output-error transfer path coefficient at the current time, the target abrupt change suppression coefficient, and the target feedback signal.
5. The method of claim 4, wherein the obtaining the target feedback signal based on the current ambient noise signal transmitted by the feedback microphone acquired in real-time comprises:
acquiring an initial feedback signal transmitted by a feedback microphone in real time;
performing band-pass filtering processing on the initial feedback signal to obtain a preprocessed feedback signal;
and carrying out reduction processing on the preprocessed feedback signal to obtain a target feedback signal.
6. The method of claim 4, wherein the real-time updating based on the pre-obtained calibrated output-error transfer path coefficients of the feedback microphone to obtain real-time output-error transfer path coefficients comprises:
obtaining a calibration output-error transfer path coefficient of the feedback microphone;
and carrying out real-time compensation and update on the calibrated output-error transfer path coefficient to obtain the real-time output-error transfer path coefficient.
7. An audio processing apparatus, the apparatus comprising:
the first acquisition module is used for obtaining a high-frequency signal and a medium-low frequency signal by frequency division of a target audio signal acquired in real time;
the second acquisition module is used for acquiring a target reference signal based on the current environmental noise signal transmitted by the feedforward microphone acquired in real time;
and the processing module is used for fusing the high-frequency signal with the real-time control signal and outputting the high-frequency signal to the air conduction sounding device so as to play and form a first target audio, and outputting the medium-low frequency signal at the same time to the bone conduction sounding device so as to play and form a second target audio.
8. The apparatus of claim 7, wherein the second acquisition module comprises:
the first acquisition unit is used for acquiring an initial reference signal transmitted by the feedforward microphone in real time;
the second acquisition unit is used for carrying out band-pass filtering processing on the initial reference signal to obtain a preprocessed reference signal;
and the reduction unit is used for carrying out reduction processing on the preprocessed reference signal to obtain a target reference signal.
9. Computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by one or more processors, implements the steps of the audio processing method according to any of claims 1 to 6.
10. An electronic device, comprising:
the audio receiving device is in communication connection with a target communication terminal to receive the target audio signal sent by the target communication terminal in real time;
a feedforward microphone for picking up a current ambient noise signal;
one or more processors, respectively connected to the audio acquisition device and the feedforward microphone, to perform the operations of any one of claims 1 to 6; and
the gas conduction sounding device is connected with the one or more processors to receive the first target audio signal and play corresponding first target audio;
and the bone conduction sounding device is connected with the one or more processors to receive the second target audio signal and play corresponding second target audio.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310886072.XA CN116782094A (en) | 2023-07-21 | 2023-07-21 | Audio processing method, device, computer readable storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310886072.XA CN116782094A (en) | 2023-07-21 | 2023-07-21 | Audio processing method, device, computer readable storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116782094A true CN116782094A (en) | 2023-09-19 |
Family
ID=88011576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310886072.XA Pending CN116782094A (en) | 2023-07-21 | 2023-07-21 | Audio processing method, device, computer readable storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116782094A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117198264A (en) * | 2023-11-06 | 2023-12-08 | 江西红声技术有限公司 | Active noise reduction processing method, system, readable storage medium and computer equipment |
-
2023
- 2023-07-21 CN CN202310886072.XA patent/CN116782094A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117198264A (en) * | 2023-11-06 | 2023-12-08 | 江西红声技术有限公司 | Active noise reduction processing method, system, readable storage medium and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2017272228B2 (en) | Signal Enhancement Using Wireless Streaming | |
| TWI559292B (en) | Anc system with spl-controlled output | |
| US9066176B2 (en) | Systems and methods for adaptive noise cancellation including dynamic bias of coefficients of an adaptive noise cancellation system | |
| JP4888852B2 (en) | Bidirectional communication apparatus having one transducer and method thereof | |
| JP6823657B2 (en) | Hybrid adaptive noise elimination system with filtered error microphone signal | |
| KR102245356B1 (en) | Frequency-shaped noise-based adaptation of secondary path adaptive response in noise-canceling personal audio devices | |
| US8422691B2 (en) | Audio outputting device, audio outputting method, noise reducing device, noise reducing method, program for noise reduction processing, noise reducing audio outputting device, and noise reducing audio outputting method | |
| KR102025527B1 (en) | Coordinated control of adaptive noise cancellation(anc) among earspeaker channels | |
| JP6069829B2 (en) | Ear hole mounting type sound collecting device, signal processing device, and sound collecting method | |
| CN104751839B (en) | Noise canceling system with lower rate emulation | |
| US10290296B2 (en) | Feedback howl management in adaptive noise cancellation system | |
| CN113409755B (en) | Active noise reduction method and device and active noise reduction earphone | |
| CN110475178A (en) | A kind of wireless headset noise-reduction method, device and wireless headset and storage medium | |
| CN116782094A (en) | Audio processing method, device, computer readable storage medium and electronic equipment | |
| CN107889007B (en) | Active noise reduction method and system for eliminating influence of noise reduction channel on playing sound | |
| JP6197930B2 (en) | Ear hole mounting type sound collecting device, signal processing device, and sound collecting method | |
| WO2022020122A1 (en) | Ear-wearable device with active noise cancellation system that uses internal and external microphones | |
| CN111629313A (en) | Hearing device comprising a loop gain limiter | |
| US11074903B1 (en) | Audio device with adaptive equalization | |
| US20230328462A1 (en) | Method, device, headphones and computer program for actively suppressing the occlusion effect during the playback of audio signals | |
| JP5470729B2 (en) | Signal processing apparatus and signal processing method | |
| JPH06153289A (en) | Voice input output device | |
| CN113299263B (en) | Acoustic path determining method and device, readable storage medium and active noise reduction earphone | |
| US20240013765A1 (en) | Feed-forward adaptive noise-canceling with dynamic filter selection based on classifying acoustic environment | |
| TW202309879A (en) | Adaptive active noise cancellation apparatus and audio playback system using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20241015 Address after: Room 101, 201, 301, 401, Block B, Building 2, No. 69 Jiepu Road, Industrial Park, Suzhou City, Jiangsu Province, 215000 Applicant after: Suzhou Suoye Electronic Technology Co.,Ltd. Country or region after: China Address before: Room F1-A-1028, Building A2, No. 8, Qicun Road, Suzhou Industrial Park, Suzhou City, Jiangsu Province, 215000 Applicant before: Suzhou Mojue Intelligent Electronics Co.,Ltd. Country or region before: China |