CN111028851B - Sound playing device and noise reducing method thereof - Google Patents
Sound playing device and noise reducing method thereof Download PDFInfo
- Publication number
- CN111028851B CN111028851B CN201811178676.4A CN201811178676A CN111028851B CN 111028851 B CN111028851 B CN 111028851B CN 201811178676 A CN201811178676 A CN 201811178676A CN 111028851 B CN111028851 B CN 111028851B
- Authority
- CN
- China
- Prior art keywords
- sound signal
- noise
- intensity
- processed
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000005236 sound signal Effects 0.000 claims abstract description 95
- 238000004458 analytical method Methods 0.000 claims abstract description 46
- 238000012545 processing Methods 0.000 claims description 40
- 238000013473 artificial intelligence Methods 0.000 claims description 12
- 238000001914 filtration Methods 0.000 claims description 5
- 230000000873 masking effect Effects 0.000 claims description 5
- 230000003595 spectral effect Effects 0.000 description 5
- 238000012935 Averaging Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000011946 reduction process Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Circuit For Audible Band Transducer (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
A sound playing device and a method for reducing noise thereof are provided. The method comprises the following steps: receiving an input sound signal, wherein the input sound signal comprises noise; performing a first denoising process on the input sound signal to become a first processed sound signal; performing a noise analysis program on the input sound signal to obtain an analysis result; performing a second denoising process on the first processed sound signal according to the analysis result, thereby reducing noise to become a second processed sound signal; and outputting the second processed sound signal.
Description
Technical Field
The present invention relates to a sound playing device and a method for reducing noise thereof, and more particularly, to a sound playing device capable of executing two denoising processes simultaneously and a method for reducing noise thereof.
Background
Current sound playback devices, such as headphones, typically remove ambient noise in several ways in order to allow the user to hear a clearer sound. In the prior art, a conventional algorithmic noise reduction or artificial intelligence noise reduction approach has been disclosed. There are many methods of noise reduction techniques for conventional algorithms, such as spectral subtraction, wiener filters, etc. The artificial intelligence noise reduction mode is a technology for enabling a machine to learn and generalize classification by providing a large amount of data so as to minimize the difference between each pen output and a target as much as possible. However, artificial intelligence noise reduction requires a lot of data for machine learning, and may cause significant errors when the previous data cannot replace the scene features in practical applications. The artificial intelligence noise reduction method may have a disadvantage in identifying the noise of a specific category.
Therefore, it is necessary to invent a new audio playing device and a method for reducing noise thereof to solve the drawbacks of the prior art.
Disclosure of Invention
The main objective of the present invention is to provide a sound playing device, which can execute two denoising processes simultaneously to achieve a better denoising effect.
Another main object of the present invention is to provide a method for reducing noise of the above-mentioned sound playing device.
In order to achieve the above objective, the sound playing device of the present invention includes a sound receiving module, a first processing module, a second processing module and a sound output module. The sound receiving module is used for receiving an input sound signal, wherein the input sound signal comprises noise. The first processing module is electrically connected with the sound receiving module and is used for performing a first denoising processing procedure on the input sound signal to form a first processed sound signal. The second processing module is electrically connected with the sound receiving module and the first processing module and is used for carrying out a noise analysis program on the input sound signal so as to obtain an analysis result; the second processing module further performs a second denoising processing procedure on the first processed sound signal according to the analysis result, thereby reducing noise to become a second processed sound signal. The sound output module is electrically connected with the second processing module and is used for outputting a second processed sound signal.
The method for reducing noise comprises the following steps: receiving an input sound signal, wherein the input sound signal comprises noise; performing a first denoising process on the input sound signal to become a first processed sound signal; performing a noise analysis program on the input sound signal to obtain an analysis result; performing a second denoising process on the first processed sound signal according to the analysis result, thereby reducing noise to become a second processed sound signal; and outputting the second processed sound signal.
Drawings
Fig. 1 is a schematic diagram of an architecture of a sound playing device according to the present invention.
FIG. 2 is a flow chart of the steps of the method for reducing noise of the present invention.
FIG. 3 is a flow chart of the steps of the method of the noise analysis program of the present invention.
Wherein the reference numerals are as follows:
sound playing device 10
Sound receiving Module 20
First processing module 30
Second processing module 40
Comparison module 41
Prediction module 42
Analysis module 43
Filtering module 44
Sound output module 50
Detailed Description
In order to enable the technical content of the present invention to be more understood by the review board, preferred embodiments are described below.
Fig. 1 is a schematic diagram illustrating an architecture of a sound playing device according to the present invention.
The sound playing device 10 of the present invention may be an earphone, a hearing aid, or the like, but the present invention is not limited thereto. The sound playing device 10 includes a sound receiving module 20, a first processing module 30, a second processing module 40, and a sound outputting module 50. The sound receiving module 20 is used for receiving an input sound signal. The input sound signal received by the sound receiving module 20 may include an audio signal transmitted from another electronic device, and an ambient sound captured by a microphone (not shown) outside the sound playing device 10, so that the input sound signal includes a noise. The first processing module 30 is electrically connected to the sound receiving module 20, and is configured to perform a first denoising process on the input sound signal to form a first processed sound signal, wherein the first processing module 30 performs an artificial intelligent denoising process. The first processing module 30 learns, generalizes and classifies the input sound signal by a large amount of data, and can adjust internal parameters by itself. Since the artificial intelligence denoising process is already familiar to those skilled in the art, the principle thereof will not be described here.
The second processing module 40 is electrically connected to the sound receiving module 20 and the first processing module 30, and is configured to perform a noise analysis procedure on the input sound signal to obtain an analysis result, where the noise analysis procedure is a non-artificial intelligent analysis procedure, for example, using an estimation of a spectral gain function to obtain a predicted noise. The spectral gain function is a result calculated from a prior signal-to-noise ratio (a priority SNR) or a post-noise ratio (a postiori SNR). The second processing module 40 further performs a second denoising process on the first processed sound signal according to the analysis result, so as to reduce the noise into a second processed sound signal, for example, using a method such as spectral subtraction (Spectral Subtraction, SS) or Wiener Filter (Wiener Filter), but the invention is not limited thereto. Finally, the sound output module 50 is electrically connected to the second processing module 40, and the sound output module 50 may be a speaker for outputting the second processed sound signal.
In an embodiment of the invention, the second processing module 40 performs a Noise reduction process by using an algorithm, for example, a Noise Estimation (Noise Estimation) analysis process, which may be a voice presence probability (Speech Presence Probability, SPP), IMCRA (Improved Minima Controlled Recursive Averaging), minimum-Tracking (minimum-Tracking) analysis method, but the invention is not limited thereto. The second processing module 40 includes a comparing module 41, an estimating module 42, an analyzing module 43 and a filtering module 44. The comparison module 41 compares the intensity of the input sound signal with a previous frame estimated noise intensity to obtain a signal-to-noise ratio (SNR). The estimation module 42 estimates an estimated noise level according to the snr. The analysis module 43 analyzes the intensity of the input sound signal and the estimated noise intensity to obtain an analysis result, wherein the analysis result is a masking value. In this way, the analysis module 43 can know how much noise is in the input audio signal, and the masked portion is the non-noise portion. Finally, the filtering module 44 reduces the intensity of the portion of the first processed sound signal by the masking value obtained by the analyzing module 43, thereby eliminating the noise. In this way, the sound output module 50 can output the processed second processed sound signal. Since the above-mentioned noise estimation analysis procedures are widely used by those skilled in the art, the principles thereof will not be described herein.
It should be noted that the above modules may be configured as hardware devices, software programs, firmware, or a combination thereof, or may be configured by circuit loops or other suitable types; further, the modules may be arranged in a combination of the modules, in addition to a single module. In addition, this embodiment is only illustrative of the preferred embodiments of the present invention, and all possible variations and combinations are not described in detail for avoiding redundant description. However, it will be appreciated by those of ordinary skill in the art that the various modules or elements described above are not necessarily all necessary. And may include other more detailed existing modules or elements for implementing the invention. Each module or element may be omitted or modified as desired, and no other module or element may be present between any two modules.
Next, please refer to fig. 2, which is a flowchart illustrating steps of the method for reducing noise according to the present invention. It should be noted that although the method for reducing noise of the present invention is described below by taking the above-described audio playback apparatus 10 as an example, the method for reducing noise of the present invention is not limited to the use of the audio playback apparatus 10 having the same configuration as described above.
First, the sound receiving module 20 is configured to receive an input sound signal.
Next, step 202: the input sound signal is subjected to a first denoising process to become a first processed sound signal.
The first processing module 30 is used for performing a first denoising process on the input sound signal, so as to convert the input sound signal into a first processed sound signal by using the artificial intelligence denoising process.
Step 203 is performed: and performing a noise analysis procedure on the input sound signal to obtain an analysis result.
Then, the second processing module 40 is configured to perform a Noise Estimation (Noise Estimation) analysis on the most original input audio signal to obtain an analysis result, so as to determine how much Noise is contained in the original input audio signal.
Step 204 is then performed: and performing a second denoising process on the first processed sound signal according to the analysis result so as to reduce the noise to become a second processed sound signal.
The second processing module 40 further performs a second denoising process on the first processed sound signal processed by the first processing module 30 according to the analysis result of the original input sound signal, so as to reduce the noise in the first processed sound signal to become a second processed sound signal.
Finally, step 205 is performed: outputting the second processed sound signal.
Finally, the sound output module 50 can output the second processed sound signal processed by the second processing module 40.
Next, please refer to fig. 3, which is a flowchart illustrating a method of the noise analysis procedure of the present invention.
In one embodiment of the present invention, the second processing module 40 performs the noise reduction process using the algorithm in steps 203 to 204. Step 301 is therefore performed first: a signal to noise ratio is obtained based on the intensity of the input sound signal compared with an estimated noise intensity of a previous frame.
The comparison module 41 first compares the intensity of the input sound signal with the intensity of a previous frame estimated noise to obtain a signal-to-noise ratio.
Step 302 is then performed: and estimating an estimated noise intensity according to the signal-to-noise ratio.
The estimation module 42 can then calculate an estimated noise level according to the snr by using a formula. The formula can be obtained by analysis methods such as voice presence probability (Speech Presence Probability, SPP), IMCRA (Improved Minima Controlled Recursive Averaging), minimum-Tracking (minimum-Tracking), etc., and the invention is not limited to this calculation formula.
Step 303 is performed: and analyzing the intensity of the input sound signal and the estimated noise intensity to obtain the analysis result.
The analysis module 43 then analyzes the intensity of the input sound signal and the estimated noise intensity to obtain an analysis result, i.e. the input sound signal
Finally, step 304 is performed: the noise is eliminated by reducing the partial intensity of the first processed sound signal by the shielding value.
Finally, the filtering module 44 reduces the intensity of a portion of the first processed sound signal by the masking value obtained by the analyzing module 43 to eliminate the noise, so as to obtain a second processed sound signal.
It should be noted that the method for adjusting the output voice of the hearing aid according to the present invention is not limited to the above-mentioned sequence of steps, and the above-mentioned sequence of steps may be changed as long as the objective of the present invention is achieved.
As can be seen from the above description, the audio playing device 10 of the present invention performs an artificial intelligence denoising process on the input audio signal by using the first processing module 30 to obtain a first processed audio signal. The second processing module 40 analyzes the input sound signal by using a conventional algorithm, and finally processes the first processed sound signal by using the analysis result to obtain a second processed sound signal. Therefore, the sound playing device 10 of the present invention can perform the denoising process of artificial intelligence and conventional algorithm at the same time, so as to achieve better denoising performance.
It should be noted that the above is only an example and is not limited to the example. Such as those described above, should be construed in view of the appended claims without deviating from the basic framework of the invention.
Claims (8)
1. A method of reducing noise, the method comprising:
receiving an input sound signal, wherein the input sound signal comprises noise;
performing a first denoising process on the input sound signal to form a first processed sound signal; performing a noise analysis procedure on the input sound signal to obtain an analysis result, wherein the analysis result is a shielding value;
performing a second denoising process on the first processed sound signal according to the analysis result, wherein the second denoising process reduces the partial intensity of the first processed sound signal by the analysis result to eliminate the noise, so as to form a second processed sound signal; and
the second processed sound signal is output and,
wherein the noise analysis program includes the steps of:
comparing the intensity of the input sound signal with the intensity of the estimated noise of a previous sound frame to obtain a signal-to-noise ratio;
calculating an estimated noise intensity according to the signal-to-noise ratio; and
and analyzing the intensity of the input sound signal and the estimated noise intensity to obtain the analysis result.
2. The method of claim 1, wherein the performing the first denoising process is performing an artificial intelligence denoising process.
3. The method of reducing noise of claim 2, wherein the noise analysis procedure is performed as a non-artificial intelligence analysis procedure.
4. The method of claim 1 wherein the second denoising process reduces the partial intensity of the first processed sound signal by the masking value to cancel the noise.
5. A sound playing device, comprising:
a sound receiving module for receiving an input sound signal, wherein the input sound signal comprises a noise;
the first processing module is electrically connected with the sound receiving module and is used for carrying out a first denoising processing procedure on the input sound signal to form a first processed sound signal;
the second processing module is electrically connected with the sound receiving module and the first processing module and is used for carrying out a noise analysis program on the input sound signal to obtain an analysis result, wherein the analysis result is a shielding value; the second processing module further performs a second denoising process on the first processed sound signal according to the analysis result, the second denoising process reduces the partial intensity of the first processed sound signal to eliminate the noise by the analysis result, thereby becoming a second processed sound signal, and the second processing module further comprises:
a comparison module for comparing the intensity of the input sound signal with the estimated noise intensity of a previous sound frame to obtain a signal-to-noise ratio;
the estimating module estimates the estimated noise intensity according to the signal-to-noise ratio; and
the analysis module is used for analyzing the intensity of the input sound signal and the estimated noise intensity to obtain an analysis result; and
the sound output module is electrically connected with the second processing module and used for outputting the second processed sound signal.
6. The audio playback apparatus of claim 5, wherein the first processing module performs an artificial intelligence denoising process.
7. The audio playback apparatus of claim 6, wherein the second processing module performs a non-artificial intelligence analysis procedure.
8. The audio playback apparatus of claim 5, wherein the second processing module further comprises a filtering module for reducing a partial intensity of the first processed audio signal by the masking value to eliminate the noise.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811178676.4A CN111028851B (en) | 2018-10-10 | 2018-10-10 | Sound playing device and noise reducing method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811178676.4A CN111028851B (en) | 2018-10-10 | 2018-10-10 | Sound playing device and noise reducing method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111028851A CN111028851A (en) | 2020-04-17 |
| CN111028851B true CN111028851B (en) | 2023-05-12 |
Family
ID=70191634
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811178676.4A Active CN111028851B (en) | 2018-10-10 | 2018-10-10 | Sound playing device and noise reducing method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111028851B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060031067A1 (en) * | 2004-08-05 | 2006-02-09 | Nissan Motor Co., Ltd. | Sound input device |
| US20110158418A1 (en) * | 2009-12-25 | 2011-06-30 | National Chiao Tung University | Dereverberation and noise reduction method for microphone array and apparatus using the same |
| CN102157156A (en) * | 2011-03-21 | 2011-08-17 | 清华大学 | Single-channel voice enhancement method and system |
| CN103871421A (en) * | 2014-03-21 | 2014-06-18 | 厦门莱亚特医疗器械有限公司 | Self-adaptive denoising method and system based on sub-band noise analysis |
-
2018
- 2018-10-10 CN CN201811178676.4A patent/CN111028851B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060031067A1 (en) * | 2004-08-05 | 2006-02-09 | Nissan Motor Co., Ltd. | Sound input device |
| US20110158418A1 (en) * | 2009-12-25 | 2011-06-30 | National Chiao Tung University | Dereverberation and noise reduction method for microphone array and apparatus using the same |
| CN102157156A (en) * | 2011-03-21 | 2011-08-17 | 清华大学 | Single-channel voice enhancement method and system |
| CN103871421A (en) * | 2014-03-21 | 2014-06-18 | 厦门莱亚特医疗器械有限公司 | Self-adaptive denoising method and system based on sub-band noise analysis |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111028851A (en) | 2020-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10403299B2 (en) | Multi-channel speech signal enhancement for robust voice trigger detection and automatic speech recognition | |
| JP4842583B2 (en) | Method and apparatus for multisensory speech enhancement | |
| CN103871421B (en) | A kind of self-adaptation noise reduction method and system based on subband noise analysis | |
| US10789968B2 (en) | Sound playback device and noise reducing method thereof | |
| US20200184987A1 (en) | Noise reduction using specific disturbance models | |
| US10553236B1 (en) | Multichannel noise cancellation using frequency domain spectrum masking | |
| CN106558315B (en) | Heterogeneous microphone automatic gain calibration method and system | |
| US10755728B1 (en) | Multichannel noise cancellation using frequency domain spectrum masking | |
| JP7486266B2 (en) | Method and apparatus for determining a depth filter - Patents.com | |
| US8477956B2 (en) | Howling suppression device, howling suppression method, program, and integrated circuit | |
| CN110992967A (en) | Voice signal processing method and device, hearing aid and storage medium | |
| US9875748B2 (en) | Audio signal noise attenuation | |
| CN110708651A (en) | Hearing aid squeal detection and suppression method and device based on segmented trapped wave | |
| Lemercier et al. | Diffusion posterior sampling for informed single-channel dereverberation | |
| WO2024017110A1 (en) | Voice noise reduction method, model training method, apparatus, device, medium, and product | |
| CN112562712A (en) | Recording data processing method and system, electronic equipment and storage medium | |
| CN111028851B (en) | Sound playing device and noise reducing method thereof | |
| KR20110024969A (en) | Apparatus for filtering noise by using statistical model in voice signal and method thereof | |
| US20230360662A1 (en) | Method and device for processing a binaural recording | |
| CN106997768A (en) | A kind of computational methods, device and the electronic equipment of voice probability of occurrence | |
| JP2005308771A (en) | Noise-filtering method, noise eliminator, system, and program for noise filtering | |
| KR101096091B1 (en) | Apparatus for Separating Voice and Method for Separating Voice of Single Channel Using the Same | |
| RU2788939C1 (en) | Method and apparatus for defining a deep filter | |
| US11967304B2 (en) | Sound pick-up device, sound pick-up method and non-transitory computer-readable recording medium recording sound pick-up program | |
| WO2023172609A1 (en) | Method and audio processing system for wind noise suppression |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201028 Address after: Taiwan, Hsinchu, China Science and Technology Industrial Park, Hsinchu County Road, building 5, No. 5 Applicant after: PixArt Imaging Inc. Address before: Room 1, business centre, Eden, Seychelles Applicant before: SEYCHELLES SHANGYUANDING AUDIO Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220824 Address after: 5th floor, 6-5 TuXing Road, Hsinchu Science Park, Taiwan, China Applicant after: Dafa Technology Co.,Ltd. Address before: Taiwan, Hsinchu, China Science and Industry Park, Hsinchu County, 5 innovation road, No. 5 Building Applicant before: PixArt Imaging Inc. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |