US11961501B2 - Noise reduction method and device - Google Patents
Noise reduction method and device Download PDFInfo
- Publication number
- US11961501B2 US11961501B2 US17/548,609 US202117548609A US11961501B2 US 11961501 B2 US11961501 B2 US 11961501B2 US 202117548609 A US202117548609 A US 202117548609A US 11961501 B2 US11961501 B2 US 11961501B2
- Authority
- US
- United States
- Prior art keywords
- audio
- signals
- audio signals
- effective
- collection devices
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 81
- 230000009467 reduction Effects 0.000 title claims abstract description 63
- 230000005236 sound signal Effects 0.000 claims abstract description 285
- 238000011946 reduction process Methods 0.000 claims abstract description 16
- 230000008569 process Effects 0.000 claims description 40
- 230000002159 abnormal effect Effects 0.000 claims description 18
- 238000001914 filtration Methods 0.000 claims description 11
- 238000007493 shaping process Methods 0.000 claims description 9
- 238000003860 storage Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 description 18
- 230000000694 effects Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000012805 post-processing Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000010191 image analysis Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 102100026436 Regulator of MON1-CCZ1 complex Human genes 0.000 description 1
- 101710180672 Regulator of MON1-CCZ1 complex Proteins 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02165—Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
- H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
- H04R2201/107—Monophonic and stereophonic headphones with microphone for two-way hands free communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
Definitions
- the present disclosure generally relates to the field of audio processing and, more particularly, relates to a noise reduction method and device.
- One aspect of the present disclosure provides a noise reduction method.
- the method includes: obtaining different audio signals respectively collected by two audio collection devices, where one of the two audio collection devices has a specific positional relationship with an effective audio source; at least according to the different audio signals respectively collected by the two audio collection devices, determining effective signals corresponding to the effective audio source and noise signals corresponding to a noise source and obtaining determination results; and performing a noise reduction process on the audio signals collected by at least one of the two audio collection devices to retain the effective signals and reduce the noise signals, according to the determination results.
- an electronic device including an acquisition module, a determination module, and a noise reduction module.
- the acquisition module is configured to obtain different audio signals collected by two audio collection devices respectively.
- One of the two audio collection devices has a specific positional relationship with an effective audio source.
- the determination module is configured to determine effective signals corresponding to the effective audio source and noise signals corresponding to a noise source and obtain determination results, at least according to the different audio signals respectively collected by the two audio collection devices.
- the noise reduction module is configured to perform noise reduction on the different audio signals collected by two audio collection devices respectively to retain the effective signals and reduce the noise signals, according to the determination results.
- Another aspect of the present disclosure provides a non-transitory computer-readable storage medium, containing program instructions for, when executed by a processor, performing a noise reduction method.
- the method includes: obtaining different audio signals respectively collected by two audio collection devices, where one of the two audio collection devices has a specific positional relationship with an effective audio source; at least according to the different audio signals respectively collected by the two audio collection devices, determining effective signals corresponding to the effective audio source and noise signals corresponding to a noise source and obtaining determination results; and performing a noise reduction process on the audio signals collected by at least one of the two audio collection devices to retain the effective signals and reduce the noise signals, according to the determination results.
- FIG. 1 illustrates an exemplary noise reduction method consistent with various disclosed embodiments of the present disclosure
- FIG. 2 illustrates an exemplary application scenario consistent with various disclosed embodiments in the present disclosure
- FIG. 3 A and FIG. 3 B illustrate waveform diagrams of audio signals respectively collected by two audio collection devices consistent with the embodiments of the present disclosure
- FIG. 4 illustrates another exemplary noise reduction method consistent with various disclosed embodiments in the present disclosure
- FIG. 5 illustrates a waveform diagram of the audio signal in FIG. 3 after the phase is reversed consistent with the embodiments of the present disclosure
- FIG. 6 illustrates a waveform diagram of a target audio signal after noise reduction consistent with various disclosed embodiments in the present disclosure
- FIG. 7 illustrates another exemplary noise reduction method consistent with various disclosed embodiments in the present disclosure
- FIG. 8 illustrates another exemplary noise reduction method consistent with various disclosed embodiments in the present disclosure
- FIG. 9 illustrates another exemplary noise reduction method consistent with various disclosed embodiments in the present disclosure.
- FIG. 10 illustrates an exemplary noise reduction device consistent with various disclosed embodiments in the present disclosure.
- FIG. 11 illustrates another exemplary noise reduction device consistent with various disclosed embodiments in the present disclosure.
- the present disclosure provides a noise reduction method and device, which may be used for noise reduction and/or noise cancellation of collected audio signals to improve the quality of the audio signals.
- the method or device may be applied to electronic devices, and the electronic devices may include, but are not limited to, various smart terminals or computers such as smartphones, tablets, notebooks, all-in-ones, or conference equipment with data process functions.
- the noise reduction method may include S 101 to S 103 .
- S 101 different audio signals collected by two audio collection devices respectively may be obtained.
- One of the two audio collection devices may have a specific positional relationship with an effective audio source.
- One of the two audio collection devices may be, but is not limited to, a built-in mic of an electronic device, a mic of an external earphone, or a recording device such as a voice recorder set in a corresponding position.
- That one of the two audio collection devices may have a specific positional relationship with the effective audio source, optionally, may include any one of:
- the one of the two audio collection devices may be a mic on a headset worn by a speaker who uses a mobile phone or notebook for voice communication, a mic on a bracelet or smartwatch worn by a speaker, or a mic worn by the speaker in a conference scene.
- a distance between the one of the two audio collection devices and the effective audio source is less than a set threshold
- the audio collection device may be a recording pen fixed within a predetermined distance around a speaker in a conference scene.
- the different audio signals collected by the two audio collection devices may be obtained. Specifically, different audio signals collected by two audio collection devices at the same time may be obtained. In the presence of a noise source, the audio signals collected by the two audio collection devices may be mixed audio signals that include both the effective signals of the effective audio source and the noise signals of the noise source.
- the effective signals corresponding to the effective audio source and the noise signals corresponding to the noise source may be determined to obtain determination results, at least according to the different audio signals respectively collected by the two audio collection devices.
- a prerequisite for realizing the noise reduction may be performing audio signal collection based on the two audio collection devices, and that the one of the two audio collection devices and the effective audio source have any one of the above-mentioned specific positional relationships.
- the one of the two audio collection devices may have the characteristic of being relatively close to the effective audio source, while another of the two audio collection devices may be relatively far away from the effective audio source.
- the one of the two audio collection devices relatively close to the effective audio source will be referred to as the first audio collection device, and another of the two audio collection devices relatively far away from the effective audio source will be referred to as the second audio collection device.
- a distance D 2 between the effective audio source and the second audio collection device may be much larger than a distance D 1 between the effective audio source and the first audio collection device, that is,
- the first audio collection device of the two audio collection devices may be a mic on a headset worn by the user, and the second audio collection device may be a built-in mic of the mobile phone/laptop or other electronic devices, as shown in FIG. 2 .
- the distance between the effective audio source (user1's mouth) and the built-in mic of the device may be much larger than the distance between the effective audio source the mic on the external headset.
- the first audio collection device of the two audio collection devices may be a mic worn by the speaker or a recording device fixedly set within a predetermined distance near the speaker, and the second audio collection device may be a recording device set relatively far away from the speaker.
- a distance between the speaker and the recording device set relatively far away may be far larger than a distance from the mic (or the recording device set up close).
- the two audio collection devices may also be external mics of electronic devices such as notebooks, where one mic is the mic worn by the speaker, and the other mic is relatively far away from the speaker.
- the distance between the noise source and the two audio collection devices may be relatively close, that is, a ratio between a distance D 4 between the noise source and the second audio collection device and a distance D 3 between the noise source and the first audio collection device may approach 1:
- this positional relationship (D 4 /D 3 ⁇ 1) may be highly consistent with the actual positional relationship between the noise source and the two audio collection devices in the actual application scenario.
- the noise source the mouse of user2
- the mic of the earphone worn by user1 or the built-in mic of user1's notebook please refer to the positional relationship between the noise source (the mouse of user2) and the mic of the earphone worn by user1 or the built-in mic of user1's notebook.
- an effective signal part (effective signals) of the audio source may have a large variation in the amplitude (representing the volume/loudness) of the signal waveforms corresponding to the two audio collection devices.
- a signal part of the noise source may have a small difference in the amplitude of the signal waveforms corresponding to the two audio collection devices, as shown by the amplitude difference between the voice signals (effective signals) in the audio signals of the two mics and the amplitude difference between the waveforms of the noise signals in FIG. 3 A and FIG. 3 B .
- S 102 may be used to determine the effective signals corresponding to the effective audio source and the noise signals corresponding to the noise source.
- noise reduction may be performed on the audio signals collected by at least one of the two audio collection devices, to retain the effective signals and reduce the noise signals.
- the noise reduction may be performed on the audio signals collected by at least one of the two audio collection devices.
- the audio signals collected by the second audio collection device may be used as reference signals, to perform the noise reduction on the audio signals collected by the first audio collection device to retain the effective signals and reduce the noise signals.
- the different audio signals collected by the two audio collection devices may be obtained.
- the effective signals corresponding to the effective audio source and the noise signals corresponding to the noise source may be determined to obtain determination results, at least according to the different audio signals respectively collected by the two audio collection devices.
- the noise reduction may be performed on the audio signals collected by at least one of the two audio collection devices, to retain the effective signals and reduce the noise signals.
- the effect of noise reduction on the collected audio signals may be achieved, which may effectively improve the quality of the collected audio signals. Therefore, the quality of the voice communication in the voice communication scene may be improved.
- the noise reduction method may include S 401 to S 406 .
- different audio signals respectively collected by two audio collection devices may be obtained.
- One of the two audio collection devices may have a specific positional relationship with an effective audio source.
- S 401 may be same as S 101 and may refer to the description of S 101 .
- one group of audio signals corresponding to each audio source may be determined from the different audio signals respectively collected by the two audio collection devices.
- one group of audio signals corresponding to the effective audio source may be determined, and at least one group of audio signals corresponding to at least one noise source may be determined.
- Each group of audio signals may include different audio signals generated by a corresponding audio source in the two audio collection devices.
- One same audio source may generate audio signals with higher similarity of waveform characteristics in different audio collection devices.
- waveforms of voice signals in the audio signals collected by the two mics may be basically same, and waveforms of the noise signals in the audio signals collected by the two mics may be basically same.
- two audio signals in the audio signals collected by the two audio collection devices with waveform characteristics meeting similar conditions may be determined to belong to one group of audio signals corresponding to one same audio source.
- the above similar conditions may include that the matching degree of the signal waveforms of the two audio signals reaches a preset threshold.
- a target group of audio signals with a largest amplitude variation between the audio signals collected by the two audio collection devices in each group of audio signals may be determined.
- the target group of audio signals may be effective signals corresponding to the effective audio source.
- Other groups of audio signals except for the target group of audio signals may be the noise signals corresponding to the noise source.
- the signal waveforms corresponding to the signal part of the effective audio source (the effective signals) in the two audio collection devices respectively may have the largest variation in the amplitude (ie, the volume/loudness of the sound), while the signal waveforms corresponding to the signal part of the noise source in the two audio collection devices respectively may have a small difference.
- the target group of audio signals with a larget amplitude variation between the audio signals collected by the two audio collection devices in each group of audio signals may be determined as the effective signals corresponding to the effective audio source and signals other than the effective signals may be determined as the noise signals corresponding to the noise source.
- a time alignment process may be performed on the different audio signals respectively collected by the two audio collection devices.
- the timestamps of the different audio signals collected by the two audio collection devices may be aligned.
- an inversion process may be performed on the waveforms of the second audio signals after the time alignment process, to obtain the second audio signals in the inverted waveform form.
- a waveform superposition process may be performed on the second audio signals in the inverted waveform form and the first audio signals, to obtain target audio signals.
- the first audio signals and the second audio signals may be different audio signals collected by the two audio collection devices.
- the amplitude of the effective signal in the first audio signals may be higher than the amplitude of the effective signal in the second audio signals.
- the first audio signals may essentially be the audio signals collected by mic1 on the external earphone
- the second audio signals may be audio signals collected by mic2 built in the notebook.
- performing the inversion process on the waveforms of the second audio signals after the time alignment process may at least include: performing the inversion process on the noise signal in the second audio signals.
- the inversion process may be performed on the signal waveform of the overall audio signals (including the effective signal and the noise signal) in FIG. 3 B , or the inversion process may be performed on the signal waveform of the noise signal in FIG. 3 B .
- the audio signals shown in FIG. 5 may be obtained, and the audio signals may be the second audio signals in the inverted waveform.
- the second audio signals in the inverted waveform form and the first audio signals may be further superimposed on the waveforms to obtain the target audio signal.
- the target audio signal shown in FIG. 6 may be obtained.
- the target audio signal may retain the effective signal corresponding to the effective audio source, and at least reduce the noise signal corresponding to the noise source, to achieve noise reduction and noise cancellation in the collected audio signals.
- the quality of the collected audio signals may be effectively improved, improving the quality of voice communication in scenarios such as voice communication.
- the noise reduction method may include S 701 to S 709 .
- different audio signals respectively collected by two audio collection devices may be obtained.
- One of the two audio collection devices may have a specific positional relationship with an effective audio source.
- S 701 may be same as S 101 and may refer to the description of S 101 .
- the relative position information between the effective audio source and the two audio collection devices may at least include a distance between the effective audio source and each of the two audio collection devices.
- the relative position information between the effective audio source and the two audio collection devices may be detected based on, but not limited to, any one of image analysis, ultrasonic ranging, infrared ranging, or any combination thereof.
- a camera on the notebook may be used to collect the user's image information including a worn mic, and then based on image analysis, distances from the user's mouth (the effective audio source) to the worn mic and the notebook's built-in mic may be determined.
- a bracelet/watch worn by the user may emit ultrasound or infrared light to the environment, and then the distance between the bracelet/watch and the user's mouth and the distance between the bracelet/watch and the notebook may be determined based on the time difference between the received reflection signals (such as the reflection of the notebook, the reflection of the mouth when speaking) and the transmitted signal to obtain the distance between the user's mouth (the effective audio source) and the mic in the bracelet/watch.
- the received reflection signals such as the reflection of the notebook, the reflection of the mouth when speaking
- the transmitted signal to obtain the distance between the user's mouth (the effective audio source) and the mic in the bracelet/watch.
- the distance between the user's mouth (the effective audio source) and the mic in the bracelet/watch and the distance between the bracelet/watch and the notebook may be obtained by estimation in advance.
- the wristband/watch may transmit the detected or estimated distance information to the notebook and other electronic devices for use in the noise reduction of the electronic devices.
- images of a speaker in the conference venue may be collected, and then distances between the speaker and the two audio collection devices (such as a mic worn by the speaker and another mic fixed at a certain location in the venue) may be determined based on image analysis.
- a distance ratio between distances of the effective audio source with respect to each of the two audio collection devices may be determined according to the relative position information.
- a first ratio between the distance from the effective audio source to the second audio collection device (such as the built-in mic of the notebook) and the distance from the effective audio source to the first audio collection device (such as the mic worn by the notebook user) may be calculated, or a second ratio between the distance from the effective audio source to the first audio collection device and the distance from the effective audio source to the second audio collection device may be calculated.
- the above-mentioned distance ratio may be a fixed value that does not change with time.
- the first ratio or the second ratio may be a fixed value that does not change with time.
- the first ratio or the second ratio may be correspondingly a fixed value (or, even if there is a change, the change is relatively small and can be ignored).
- the detection of the relative position information and the calculation of the distance ratio based on the relative position information may be performed only once when the noise reduction is started.
- the distance ratio may also be a dynamic value that changes with time. For example, in a conference scene, as the speaker keeps moving, the ratio of the distance between his mouth and the mic fixed at a certain position in the conference venue and the distance between his mouth and the mic worn by the speaker may dynamically change.
- the ratio of the distance between his mouth and the mic fixed at a certain position in the conference venue and the distance between his mouth and the mic worn by the speaker may dynamically change.
- it may be necessary to detect in real time or periodically and continuously the above-mentioned relative position information at a small time interval and calculate the above-mentioned distance ratio based on the relative position information.
- the specific situation depends on the scene.
- the amplitude variation characteristics that should exist between the effective signals of the effective audio sources collected by the two audio collection devices respectively may be determined.
- the amplitude difference between the effective signal waveforms of the effective audio sources collected by the two audio collection devices may be larger.
- the amplitude difference between the effective signal waveforms of the effective audio sources collected by the two audio collection devices may be smaller.
- the amplitude variation characteristics of the effective signal waveforms of the effective audio sources collected by the two audio collection devices may be estimated.
- the amplitude variation characteristics may include a pre-estimated amplitude difference or a pre-estimated amplitude difference range, and the present disclosure has no limits on this.
- one group of audio signals corresponding to each audio source may be determined from the different audio signals respectively collected by the two audio collection devices.
- Each group of audio signals may include different audio signals generated by a corresponding audio source in the two audio collection devices.
- S 705 may be same as S 402 and, for details, please refer to the description about S 402 .
- a target group of audio signals with a largest amplitude variation between the audio signals collected by the two audio collection devices in each group of audio signals may be determined.
- the target group of audio signals may be effective signals corresponding to the effective audio source.
- Other sets of audio signals except for the target group of audio signals may be the noise signals corresponding to the noise source.
- the amplitude variation characteristics may be further used as a reference to determine a group of audio signals with actual amplitude variation matching the amplitude variation characteristics (ie, the aforementioned target group of audio signals) from each group of audio signals, and may be used as the effective signal corresponding to the effective audio source.
- a group of audio signals with a difference between its amplitude difference and the pre-estimated amplitude difference less than a preset threshold may be determined as the effective signals corresponding to the effective audio source.
- a group of audio signals whose amplitude difference is within the pre-estimated amplitude difference range may be determined as the effective signals corresponding to the effective audio source.
- a time alignment process may be performed on the different audio signals respectively collected by the two audio collection devices.
- an inversion process may be performed on the waveforms of the second audio signals after the time alignment process, to obtain the second audio signals in the inverted waveform form.
- a waveform superposition process may be performed on the second audio signals in the inverted waveform form and the first audio signals, to obtain target audio signals.
- S 707 to S 709 may be same as S 404 to S 406 and, for details, please refer to the description about S 404 to 406 .
- recognition of the effective signal and the noise signal and noise reduction may be performed, to achieve a good noise reduction effect under low-cost requirements and effectively improve the quality of the collected audio signal.
- the quality of voice communication in scenarios such as voice communication may be improved.
- the noise reduction method may further include:
- the amplitude of the effective signal part of the obtained target audio signal may have a reduced amplitude, for example, as shown by the comparison of the amplitude of the audio signals in FIG. 3 A and FIG. 6 .
- the target audio signal (where the noise signal has been reduced or the noise signal has been eliminated) may be relatively weak, which will affect the audio listening effect.
- the target audio signal obtained after the noise reduction process may be amplified.
- an audio signal amplifier may be used to amplify the relatively weak target audio signal to a signal with a power or large enough amplitude and a variation characteristic consistent with the original signal. That is, amplifying without distortion may be performed, to ensure the audio effect of the effective audio source.
- the noise reduction method may further include:
- S 901 performing a noise filtering process on the target audio signal, and/or performing a shaping process on the target audio signal.
- the target audio signal obtained may include not only the retained effective source signal, but also the weak noise signal.
- the target audio signal obtained after the noise reduction process may still contain a weak noise signal.
- the target audio signal may be further subjected to the noise filtering process.
- the signal part whose amplitude is lower than a preset threshold value in the target audio signal it may be determined whether there is a signal part whose amplitude is lower than a preset threshold value in the target audio signal.
- the signal part whose amplitude is lower than the preset threshold value it may be filtered out, to realize the noise filtering process on the target audio signal.
- the target audio signal when the target audio signal is obtained based on the above-mentioned signal superposition process, a certain portion of the effective signal part corresponding to the effective sound source may be abnormal caused by the superposition of the two parts of the signals corresponding to the two audio collection devices.
- the target audio signal after the target signal is obtained through noise reduction, optionally, the target audio signal may also be shaped.
- the signal part whose waveform satisfies an abnormal condition in the target audio signal may be shaped.
- the above abnormal condition may include, but is not limited to: that the waveform of the audio signal includes a portion with abnormal conditions such as glitches and/or sudden changes (reflected in the audio effect, usually produces a slight rubbing sound or a sharp harsh sound).
- the signal part in the target audio signal whose waveform satisfies the abnormal condition may be reshaped.
- the part of the waveform with abnormal conditions such as glitches and/or sudden changes may be smoothed.
- various noise signals in the target audio signal may be further eliminated, to further improve the audio quality after noise reduction.
- the noise reduction device may include an acquisition module 1001 , a determination module 1002 , and a noise reduction module 1003 .
- the acquisition module 1001 may be configured to obtain different audio signals collected by two audio collection devices respectively.
- One of the two audio collection devices may have a specific positional relationship with an effective audio source.
- the determination module 1002 may be configured to: determine effective signals corresponding to an effective audio source and noise signals corresponding to a noise source and obtain determination results, at least according to the different audio signals respectively collected by the two audio collection devices.
- the noise reduction module 1003 may be configured to: perform noise reduction on the different audio signals collected by two audio collection devices respectively to retain the effective signals and reduce the noise signals, according to the determination results.
- one of the two audio collection devices may be a built-in audio collection device of the electronic device, and another may be an audio collection device worn by the subject where the effective sound source is located.
- the determination module 1002 may be configured to:
- each group of audio signals may include different audio signals generated by a corresponding audio source in the two audio collection devices respectively;
- the target group of audio signals may be effective signals corresponding to the effective audio source.
- Other sets of audio signals except for the target group of audio signals may be the noise signals corresponding to the noise source.
- the determination module 1002 may be configured to:
- each group of audio signals may include different audio signals generated by a corresponding audio source in the two audio collection devices
- the target group of audio signals may be effective signals corresponding to the effective audio source.
- Other sets of audio signals except for the target group of audio signals may be the noise signals corresponding to the noise source.
- the noise reduction module 1003 may be configured to:
- the first audio signals and the second audio signals may be different audio signals respectively collected by the two audio collecting devices, and the effective signals in the first audio signals may have a higher amplitude than the effective signals in the second audio signals.
- the device may further include a postprocessing module 1004 .
- the postprocessing module 1004 may be configured to amplify the target audio signal obtained by the noise reduction.
- the postprocessing module 1004 may be further configured to: perform the noise filtering process on the target audio signal, and/or perform the shaping process on the target audio signal, before amplifying the target audio signal obtained by the noise reduction.
- the postprocessing module 1004 when being configured to perform the noise filtering process on the target audio signal, the postprocessing module 1004 may be specifically configured to:
- the postprocessing module 1004 when being configured to perform the shaping process on the target audio signal, the postprocessing module 1004 may be specifically configured to:
- the different audio signals collected by the two audio collection devices may be obtained.
- the effective signals corresponding to the effective audio source and the noise signals corresponding to the noise source may be determined to obtain determination results, at least according to the different audio signals respectively collected by the two audio collection devices.
- the noise reduction may be performed on the audio signals collected by at least one of the two audio collection devices, to retain the effective signals and reduce the noise signals.
- the effect of noise reduction on the collected audio signals may be achieved, which may effectively improve the quality of the collected audio signals. Therefore, the quality of the voice communication in the voice communication scene may be improved.
- the various embodiments of the present disclosure may be implemented by means of software plus a necessary general hardware platform.
- the technical solution of the present disclosure essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product can be stored in a storage medium, such as ROM/RAM, magnetic disk, CD-ROM, etc., including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the method described in each embodiment of the present disclosure or some parts of the embodiments.
Abstract
Description
Claims (20)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110301973.9 | 2021-03-22 | ||
CN202110301973.9A CN113038338A (en) | 2021-03-22 | 2021-03-22 | Noise reduction processing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20220301533A1 US20220301533A1 (en) | 2022-09-22 |
US11961501B2 true US11961501B2 (en) | 2024-04-16 |
Family
ID=76472409
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/548,609 Active 2042-01-04 US11961501B2 (en) | 2021-03-22 | 2021-12-13 | Noise reduction method and device |
Country Status (2)
Country | Link |
---|---|
US (1) | US11961501B2 (en) |
CN (1) | CN113038338A (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020172350A1 (en) * | 2001-05-15 | 2002-11-21 | Edwards Brent W. | Method for generating a final signal from a near-end signal and a far-end signal |
US20140056435A1 (en) * | 2012-08-24 | 2014-02-27 | Retune DSP ApS | Noise estimation for use with noise reduction and echo cancellation in personal communication |
US20150050967A1 (en) * | 2013-08-15 | 2015-02-19 | Cisco Technology, Inc | Acoustic Echo Cancellation for Audio System with Bring Your Own Devices (BYOD) |
US20160125869A1 (en) * | 2014-11-05 | 2016-05-05 | Voyetra Turtle Beach, Inc. | HEADSET WITH USER CONFIGURABLE NOISE CANCELLATION vs AMBIENT NOISE PICKUP |
US20170354796A1 (en) * | 2016-06-08 | 2017-12-14 | Ford Global Technologies, Llc | Selective amplification of an acoustic signal |
CN111182416A (en) | 2019-12-31 | 2020-05-19 | 联想(北京)有限公司 | Processing method and device and electronic equipment |
CN111402915A (en) | 2020-03-23 | 2020-07-10 | 联想(北京)有限公司 | Signal processing method, device and system |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1809105B (en) * | 2006-01-13 | 2010-05-12 | 北京中星微电子有限公司 | Dual-microphone speech enhancement method and system applicable to mini-type mobile communication devices |
JP6107151B2 (en) * | 2013-01-15 | 2017-04-05 | 富士通株式会社 | Noise suppression apparatus, method, and program |
CN104376848B (en) * | 2013-08-12 | 2018-03-23 | 展讯通信(上海)有限公司 | Audio signal processing method and device |
EP3252766B1 (en) * | 2016-05-30 | 2021-07-07 | Oticon A/s | An audio processing device and a method for estimating a signal-to-noise-ratio of a sound signal |
CN106952654A (en) * | 2017-04-24 | 2017-07-14 | 北京奇虎科技有限公司 | Robot noise-reduction method, device and robot |
CN110837077B (en) * | 2018-08-16 | 2021-11-19 | 杭州海康威视系统技术有限公司 | Sound source position verification method and device |
CN110149573B (en) * | 2019-04-01 | 2021-02-19 | 联想(北京)有限公司 | Electronic equipment |
EP3793210A1 (en) * | 2019-09-11 | 2021-03-17 | Oticon A/s | A hearing device comprising a noise reduction system |
CN111508531B (en) * | 2020-04-23 | 2023-07-07 | 维沃移动通信有限公司 | Audio processing method and device |
-
2021
- 2021-03-22 CN CN202110301973.9A patent/CN113038338A/en active Pending
- 2021-12-13 US US17/548,609 patent/US11961501B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020172350A1 (en) * | 2001-05-15 | 2002-11-21 | Edwards Brent W. | Method for generating a final signal from a near-end signal and a far-end signal |
US20140056435A1 (en) * | 2012-08-24 | 2014-02-27 | Retune DSP ApS | Noise estimation for use with noise reduction and echo cancellation in personal communication |
US20150050967A1 (en) * | 2013-08-15 | 2015-02-19 | Cisco Technology, Inc | Acoustic Echo Cancellation for Audio System with Bring Your Own Devices (BYOD) |
US20160125869A1 (en) * | 2014-11-05 | 2016-05-05 | Voyetra Turtle Beach, Inc. | HEADSET WITH USER CONFIGURABLE NOISE CANCELLATION vs AMBIENT NOISE PICKUP |
US20170354796A1 (en) * | 2016-06-08 | 2017-12-14 | Ford Global Technologies, Llc | Selective amplification of an acoustic signal |
CN111182416A (en) | 2019-12-31 | 2020-05-19 | 联想(北京)有限公司 | Processing method and device and electronic equipment |
CN111402915A (en) | 2020-03-23 | 2020-07-10 | 联想(北京)有限公司 | Signal processing method, device and system |
Also Published As
Publication number | Publication date |
---|---|
CN113038338A (en) | 2021-06-25 |
US20220301533A1 (en) | 2022-09-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110970057B (en) | Sound processing method, device and equipment | |
KR102305066B1 (en) | Sound processing method and device | |
US9922663B2 (en) | Voice signal processing method and apparatus | |
JP6703525B2 (en) | Method and device for enhancing sound source | |
CN109036448B (en) | Sound processing method and device | |
WO2014161309A1 (en) | Method and apparatus for mobile terminal to implement voice source tracking | |
EP2426950A2 (en) | Noise suppression for sending voice with binaural microphones | |
CN109360549B (en) | Data processing method, wearable device and device for data processing | |
WO2020043037A1 (en) | Voice transcription device, system and method, and electronic device | |
US11776555B2 (en) | Audio modification using interconnected electronic devices | |
US9369186B1 (en) | Utilizing mobile devices in physical proximity to create an ad-hoc microphone array | |
TW201801069A (en) | Method and system for receiving voice message and electronic device using the method | |
CN106302974B (en) | information processing method and electronic equipment | |
CN115482830A (en) | Speech enhancement method and related equipment | |
CN114830681A (en) | Method for reducing errors in an ambient noise compensation system | |
WO2017045512A1 (en) | Voice recognition method and apparatus, terminal, and voice recognition device | |
CN113038337B (en) | Audio playing method, wireless earphone and computer readable storage medium | |
US11961501B2 (en) | Noise reduction method and device | |
CN113409800A (en) | Processing method and device for monitoring audio, storage medium and electronic equipment | |
CN111182416B (en) | Processing method and device and electronic equipment | |
WO2018229464A1 (en) | Noise cancellation in voice communication systems | |
US20220337945A1 (en) | Selective sound modification for video communication | |
Pasha et al. | Distributed microphone arrays, emerging speech and audio signal processing platforms: A review | |
CN207638831U (en) | A kind of lasing area line identification denoising device and earphone | |
US20220101870A1 (en) | Noise filtering and voice isolation device and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
AS | Assignment |
Owner name: LENOVO (BEIJING) LIMITED, CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BAN, XUELI;XIAO, QIHUA;NI, YANBO;AND OTHERS;SIGNING DATES FROM 20211203 TO 20211208;REEL/FRAME:060279/0232 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |