CN104936088A - Mixed virtual bass enhancing method - Google Patents

Mixed virtual bass enhancing method Download PDF

Info

Publication number
CN104936088A
CN104936088A CN201510192051.3A CN201510192051A CN104936088A CN 104936088 A CN104936088 A CN 104936088A CN 201510192051 A CN201510192051 A CN 201510192051A CN 104936088 A CN104936088 A CN 104936088A
Authority
CN
China
Prior art keywords
mrow
signal
msubsup
msup
frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510192051.3A
Other languages
Chinese (zh)
Inventor
张斌
方勇
刘华平
王红梅
邹禾灿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Shanghai for Science and Technology
Original Assignee
University of Shanghai for Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Shanghai for Science and Technology filed Critical University of Shanghai for Science and Technology
Priority to CN201510192051.3A priority Critical patent/CN104936088A/en
Publication of CN104936088A publication Critical patent/CN104936088A/en
Pending legal-status Critical Current

Links

Landscapes

  • Circuit For Audible Band Transducer (AREA)
  • Stereophonic System (AREA)

Abstract

The invention discloses a mixed virtual bass enhancing method. The method includes a signal processing process, and aims at enhancing the bass effect of audio signals. The method comprises the following steps that the same pathway signal of original audio is divided into two paths, high-pass filtering at the initial frequency of Fc is carried out on one path of the signals to obtain part of signals which is higher than the loudspeaker cutoff frequency Fc, time delay processing is carried out on the path of signals to obtain high-frequency signals, and low-pass filtering at the cutoff frequency Fc is carried out on the other path of signals to obtain low-frequency signals; the low-frequency signals are separated to obtain transient and stable components, and virtual bass processing are carried out on the transient and stable components respectively to obtain virtual low-frequency signals, and the virtual low-frequency signals are overlapped with high-frequency signals to obtain virtual bass enhanced audio signals. The audio signals after virtual bass processing reserve original quality with enhanced bass effect, and the audio loudness, fullness, deepness and spaciousness are enhanced.

Description

Hybrid virtual bass enhancement processing method
Technical Field
The invention relates to the technical field of audio processing, in particular to a hybrid virtual bass enhancement processing method.
Background
With the miniaturization and lightness of multimedia devices, speakers embedded in these devices have severe limitations in size, and the low-frequency reproduction capability of the small speakers is poor due to the size limitation of the speakers, but low-frequency components in audio play an important role in listening perception, directly affecting the sound's fullness, richness, and spatial perception. How to improve the low-frequency performance of a small loudspeaker is a problem to be solved urgently in the field of audio design.
The traditional low-frequency enhancement method is to directly enhance low-frequency energy by using an audio equalizer, which can cause the reduction of the loudspeaker efficiency, the distortion of the reproduced signal and even the damage to the loudspeaker system in severe cases. In contrast, virtual bass enhancement is a more efficient solution. The virtual bass technique is formed by psychoacoustic theory, when people perceive heavy bass, people do not mainly depend on the fundamental frequency of bass, but more depend on each harmonic of the fundamental frequency, even if the fundamental frequency of bass signals is suppressed, as long as each harmonic and the relationship of the harmonics still exist, the bass effect can still be perceived by human ears. The virtual bass enhancement technology utilizes the phenomenon to filter components lower than the cutoff frequency of the loudspeaker, properly increases harmonic energy at a frequency doubling point, and utilizes the advantage of strong reproduction capability of the loudspeaker in a harmonic frequency band to virtually simulate bass effect in subjective hearing.
The existing virtual bass enhancement algorithm is mainly based on a nonlinear device, a phase vocoder and a mixed virtual bass enhancement algorithm based on the combination of the nonlinear device and the phase vocoder, the processing speed of the method based on the nonlinear device is high, the bass effect generated by transient signals is good, such as drumbeats and the like, but nonlinear distortion is generated for steady-state signals. Based on the phase vocoder algorithm, the time-frequency information of the audio signal is obtained through short-time Fourier transform, and then harmonic waves are generated in a mode of increasing the phase change rate of low-frequency components of the signal. The method is flexible, effectively controls signal distortion, but has slow processing speed, and the phase vocoder must have a large analysis window in the time domain in order to obtain higher low-frequency resolution, thus generating certain distortion to transient signals, so that the bass enhancement algorithm based on the phase vocoder has better performance in processing steady-state signals. The mixed virtual bass enhancing system combines the advantages of a nonlinear device and a phase vocoder, audio signals respectively pass through two harmonic generators, and the obtained signals pass through a harmonic energy control module to distribute the proportion of the two. However, since the audio signals input to the two harmonic generators are original signals containing transient components and stationary components, the harmonics generated based on the nonlinear device will have distortion of the stationary signals, and the harmonics generated based on the phase vocoder will have distortion of the transient signals, so that the resulting virtual bass signal contains a large amount of distortion and cannot well restore the real sound quality.
Disclosure of Invention
The invention aims to solve the defects and shortcomings of the prior art and provide a novel hybrid virtual bass enhancement processing method. The method utilizes a sound source separation algorithm to separate transient and steady signals in the original audio signals and then respectively perform corresponding virtual bass processing, overcomes the defect of high distortion degree of the traditional method, and obviously improves the effect of enhancing the virtual bass.
In order to achieve the purpose, the invention adopts the following technical scheme:
a mixed virtual bass enhancement processing method, the signal processing method divides the same channel signal of the original audio into two paths at first, wherein one path gets the part higher than the cutoff frequency Fc of the loudspeaker after the high-pass filtering processing with the initial frequency Fc, get the high-frequency signal after delaying processing; the other path of signal is subjected to low-pass filtering with the cut-off frequency of Fc to obtain a low-frequency signal; carrying out signal separation processing on the low-frequency signal to obtain a transient component and a steady component; and respectively carrying out corresponding virtual bass processing on the transient component and the steady component to obtain a virtual low-frequency signal, and superposing the virtual low-frequency signal and the high-frequency signal to obtain an audio signal enhanced by virtual bass. The method comprises the following specific steps:
(1) dividing the same path signal of the original audio into two paths, wherein one path is subjected to high-pass filtering to obtain a part higher than the cutoff frequency Fc of the loudspeaker, and then is subjected to time delay processing to obtain a high-frequency signal; and the other path of the signal is subjected to low-pass filtering with the cut-off frequency of Fc to obtain a low-frequency signal.
(2) And passing the low-frequency signal through a transient/steady-state separation module to obtain a transient component and a steady-state component of the low-frequency signal.
(3) The stable state component of the low-frequency signal passes through a virtual bass generating module based on a phase vocoder to obtain virtual bass of the stable state component; and passing the transient component of the low-frequency signal through a virtual bass generation module based on a nonlinear device to obtain the virtual bass of the transient component.
(4) And (4) carrying out harmonic amplitude control on the virtual bass of the steady-state component and the transient-state component generated in the step (3) according to the equal loudness curve, so that the loudness of each harmonic meets the equal loudness curve, combining the equal loudness curve into a path, and obtaining the amplitude-controlled virtual bass signal.
(5) And (4) synthesizing the high-frequency signal obtained in the step (1) and the virtual bass signal with the controlled amplitude obtained in the step (4) into one path to obtain an audio signal after virtual bass processing.
Compared with the prior art, the hybrid virtual bass enhancement processing method has the following advantages:
the invention considers that the audio signal generally has transient components and steady components, firstly utilizes a transient/steady signal separation algorithm to separate the transient components and the steady components in the original audio, and then utilizes the traditional virtual bass generating module based on a nonlinear device and the virtual bass generating module based on a phase vocoder to perform virtual bass processing, thereby greatly reducing the steady distortion and the transient distortion of the virtual bass processing, ensuring that the audio signal after the virtual bass processing enhances the bass effect while keeping the original quality, and enhancing the flood brightness, the fullness, the richness and the spatial sense of the audio.
Drawings
Fig. 1 is a general flow diagram of a hybrid virtual bass enhancement processing method according to the present invention.
Fig. 2 is a detailed flowchart of the virtual bass processing module in fig. 1.
Detailed Description
The present invention will be described in further detail with reference to examples and drawings, but the present invention is not limited thereto.
The invention relates to a mixed virtual bass enhancement processing method, wherein an audio signal comprises transient components and steady components, the transient components and the steady components in an original audio signal are separated by utilizing a transient/steady signal separation algorithm, then virtual bass processing is respectively carried out through a virtual bass generating module based on a nonlinear device and a virtual bass generating module based on a phase vocoder, then two paths of obtained virtual bass signals are subjected to harmonic amplitude control to meet an equal loudness curve and are combined into one path, and finally the obtained virtual bass signals and high-frequency signals obtained after the original audio signal is subjected to high-pass filtering and time delay processing are superposed to obtain the audio signal subjected to mixed virtual bass enhancement processing. As shown in fig. 1 and fig. 2, the specific implementation steps are as follows:
(1) the original audio signal xori(t) is divided into two paths, wherein one path of signals passes through a high-pass filter with the initial frequency of Fc to obtain signals higher than the cut-off frequency Fc of the loudspeaker, and then high-frequency signals x of the original signals are obtained through a delay processing moduleH(t), the other path passes through a low-pass filter with the cut-off frequency Fc to obtain a low-frequency signal x lower than the cut-off frequency Fc of the loudspeakerL(t);
(2) Will low frequency signal xL(t) inputting the signal into a virtual bass processing module to obtain a virtual bass signal x'L(t), the specific implementation steps are as follows:
(2-1) converting the low frequency signal xL(t) after HPSS sound source separation algorithm processing, transient signal and steady state signal can be separated from original signal to obtain steady state signalNumber xL_H(t), and a transient signal xL_P(t) of (d). The specific separation algorithm is as follows:
a. will low frequency signal xL(t) performing short-time Fourier transform (STFT) to obtain a time-frequency spectrum matrix of the low-frequency signal, and recording the time-frequency spectrum matrix as The method is an N multiplied by K complex matrix, wherein N represents the total number of time samples of the time spectrum, and K represents the number of frequency samples owned by each time sample.
b. For original signal time frequency spectrumPerforming modulus operation to obtain amplitude spectrum Y, wherein Y is a real number matrix of NxKn,kA certain time frequency point in the time spectrum magnitude spectrum is represented, n and k are integers and represent the time index and the frequency index of the time frequency point;
c. setting the initial values of the steady-state signal amplitude spectrum H and the transient-state signal amplitude spectrum P to beWhere γ is the attenuation factor, in this example γ is 0.5;
d. the iterative process is performed using the following equation:
<math> <mrow> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>&LeftArrow;</mo> <mfrac> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <msqrt> <msup> <mrow> <mo>(</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> </msqrt> </mfrac> <msubsup> <mi>Y</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>&LeftArrow;</mo> <mfrac> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <msqrt> <msup> <mrow> <mo>(</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> </msqrt> </mfrac> <msubsup> <mi>Y</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>2</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein,
<math> <mrow> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>=</mo> <mfrac> <mn>1</mn> <mrow> <mn>2</mn> <msup> <mi>N</mi> <mo>&prime;</mo> </msup> </mrow> </mfrac> <munderover> <mi>&Sigma;</mi> <mrow> <msup> <mi>n</mi> <mo>&prime;</mo> </msup> <mo>=</mo> <mn>1</mn> </mrow> <msup> <mi>N</mi> <mo>&prime;</mo> </msup> </munderover> <mrow> <mo>(</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>+</mo> <msup> <mi>n</mi> <mo>&prime;</mo> </msup> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>+</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>-</mo> <msup> <mi>n</mi> <mo>&prime;</mo> </msup> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>)</mo> </mrow> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>3</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>=</mo> <mfrac> <mn>1</mn> <mrow> <mn>2</mn> <msup> <mi>K</mi> <mo>&prime;</mo> </msup> </mrow> </mfrac> <munderover> <mi>&Sigma;</mi> <mrow> <msup> <mi>k</mi> <mo>&prime;</mo> </msup> <mo>=</mo> <mn>1</mn> </mrow> <msup> <mi>K</mi> <mo>&prime;</mo> </msup> </munderover> <mrow> <mo>(</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> <mo>+</mo> <msup> <mi>k</mi> <mo>&prime;</mo> </msup> </mrow> <mi>&gamma;</mi> </msubsup> <mo>+</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> <mo>-</mo> <msup> <mi>k</mi> <mo>&prime;</mo> </msup> </mrow> <mi>&gamma;</mi> </msubsup> <mo>)</mo> </mrow> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>4</mn> <mo>)</mo> </mrow> </mrow> </math>
e. obtaining a wiener filter by using the obtained steady-state signal amplitude spectrum H and the obtained transient-state signal amplitude spectrum P according to the following formula;
W H = H H 2 + P 2 - - - ( 5 )
W P = P H 2 + P 2 - - - ( 6 )
f. time frequency spectrum of original signalMultiplying by a wiener filter to obtain a steady-state signal time-frequency spectrumAnd transient signal time frequency spectrumThe calculation formula is as follows;
<math> <mrow> <mover> <mi>H</mi> <mo>^</mo> </mover> <mo>=</mo> <mover> <mi>Y</mi> <mo>^</mo> </mover> <mo>&times;</mo> <msub> <mi>W</mi> <mi>H</mi> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>7</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <mover> <mi>P</mi> <mo>^</mo> </mover> <mo>=</mo> <mover> <mi>Y</mi> <mo>^</mo> </mover> <mo>&times;</mo> <msub> <mi>W</mi> <mi>P</mi> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>8</mn> <mo>)</mo> </mrow> </mrow> </math>
g. for the obtained steady-state signal time frequency spectrumAnd transient signal time frequency spectrumInverse short-time Fourier transform (iSTFT) is carried out to obtain a steady-state signal x of a time domainL_H(t) and transient signal x in time domainL_P(t)。
(2-2) converting the transient signal xL_P(t) inputting the signal to a virtual bass generating module based on a nonlinear device to obtain harmonic signals of transient signalsNumber x'L_P(t) of (d). The virtual bass generating module based on non-linear device uses multiplier element to generate higher harmonic of low frequency component, if the input signals at two ends of the multiplier are both with frequency f0Pure tone signal of (2):
<math> <mrow> <mi>X</mi> <mo>=</mo> <msup> <mi>Ae</mi> <mrow> <mo>-</mo> <mi>j</mi> <mn>2</mn> <mi>&pi;</mi> <msub> <mi>f</mi> <mn>0</mn> </msub> <mi>t</mi> </mrow> </msup> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>9</mn> <mo>)</mo> </mrow> </mrow> </math>
the output signal of the multiplier is at a frequency of 2f0Pure tone signal of (2):
<math> <mrow> <mfenced open='' close=''> <mtable> <mtr> <mtd> <msub> <mi>X</mi> <mi>out</mi> </msub> <mo>=</mo> <mi>X</mi> <mo>&times;</mo> <mi>X</mi> </mtd> </mtr> <mtr> <mtd> <mo>=</mo> <msup> <mi>Ae</mi> <mrow> <mo>-</mo> <mi>j</mi> <mn>2</mn> <mi>&pi;</mi> <msub> <mi>f</mi> <mn>0</mn> </msub> <mi>t</mi> </mrow> </msup> <mo>&times;</mo> <msup> <mi>Ae</mi> <mrow> <mo>-</mo> <mi>j</mi> <mn>2</mn> <mi>&pi;</mi> <msub> <mi>f</mi> <mn>0</mn> </msub> <mi>t</mi> </mrow> </msup> </mtd> </mtr> <mtr> <mtd> <mo>=</mo> <msup> <mi>A</mi> <mn>2</mn> </msup> <msup> <mi>e</mi> <mrow> <mo>-</mo> <mn>2</mn> <mi>&pi;</mi> <mrow> <mo>(</mo> <mn>2</mn> <msub> <mi>f</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> <mi>t</mi> </mrow> </msup> </mtd> </mtr> </mtable> </mfenced> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>10</mn> <mo>)</mo> </mrow> </mrow> </math>
similarly, if the input signal has the frequency f0And 2f0The frequency of the output signal is 3f0
(2-3) applying the steady-state signal xL_H(t) inputting the signal to a virtual bass generation module based on a phase vocoder to obtain a harmonic signal x 'of a steady-state signal'L_H(t) of (d). The phase vocoder based virtual bass generation module utilizes a phase vocoder to control harmonics, and the phase vocoder algorithm is a method of implementing pitch transformation of signals by using phase information based on short-time fourier transform, and can be applied to time stretching and compression of audio. The phase vocoder based virtual bass generation module first inputs a steady-state signal xL_H(t) performing short-time Fourier transform, segmenting the signal by windowing, performing FFT on each segment of signal to obtain a signal which can be formed by combining a group of sinusoidal signals, changing the phase change rate of the sinusoidal signals to change the frequency of the sinusoidal signals so as to generate higher harmonics, performing inverse FFT on each segment of signal to restore the signal to a time domain signal, and adding each segment of signal to obtain a harmonic signal x 'of a steady-state signal'L_H(t);
(2-4) converting the transient harmonic signal x 'described above'L_P(t) and a steady-state harmonic signal x'L_H(t) carrying out harmonic amplitude control and combining into one path, wherein because pure sound signals with different frequencies and complex sound signals with different frequency components have the same sound pressure level and different loudness, the harmonic amplitude control needs to be carried out on the generated harmonic components according to the equal loudness curve to enable the harmonic components to achieve the ideal bass effect, and then combining into one path to obtain a virtual bass signal x'L(t)。
(3) Enabling the virtual bass signal x 'obtained in the step (2)'L(t) and the high-frequency signal x obtained in step (1)H(t) mixing into a signal to obtain a signal x processed by mixing virtual bassBass(t)。
In summary, the present invention provides a hybrid virtual bass enhancement processing method, which first separates an original audio signal into two parts, namely a transient part and a steady part, by using a sound source separation algorithm, and then performs corresponding virtual bass generation processing on each part of the original audio signal according to the characteristics of each part of the original audio signal, so that the original audio tone quality is ensured, the distortion after the virtual bass enhancement processing is effectively reduced, and the bass effect of the audio signal is enhanced.

Claims (4)

1. A hybrid virtual bass enhancement processing method, comprising the processing of:
1) the original audio signal xori(t) dividing one path of signal into two paths, wherein one path of signal passes through a high-pass filter with the initial frequency of Fc to obtain a part higher than the cutoff frequency Fc of the loudspeaker, and a high-frequency signal x is obtained through time delay processingH(t), the other path of signal is processed by a low-pass filter with the cut-off frequency of Fc to obtain a low-frequency signal xL(t);
2) For the low frequency signal xL(t) performing signal divisionSeparating to obtain steady-state signal x of low-frequency audio signalL_H(t) and transient signal xL_P(t);
3) For the steady state signal x of the low frequency signalL_H(t) and transient signal xL_P(t) performing virtual bass harmonic generation processing to obtain a steady-state harmonic signal x'L_H(t) and transient harmonic signal x'L_P(t);
4) The steady state harmonic signal x'L_H(t) and transient harmonic signal x'L_P(t) carrying out harmonic amplitude control processing, and synthesizing into a path to obtain a virtual bass signal x'L(t);
5) Applying the high frequency signal xH(t) and virtual Bass Signal x'L(t) synthesizing to obtain the audio signal x with enhanced virtual bassBass(t)。
2. A hybrid virtual bass enhancement processing method according to claim 1, wherein said step 2) is performed on said low-frequency signal xL(t) the signal separation process includes the steps of:
a) for the low frequency signal xL(t) performing short-time Fourier transform to obtain a time-frequency spectrum of the low-frequency signal
b) For the time spectrum of the low frequency signalPerforming modulus operation to obtain a magnitude spectrum Y of a low-frequency signal time spectrum;
c) setting the initial values of the steady-state signal amplitude spectrum H and the transient-state signal amplitude spectrum P to beWherein γ is an attenuation factor;
d) the iterative process is performed using the following equation:
<math> <mrow> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>&LeftArrow;</mo> <mfrac> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <msqrt> <msup> <mrow> <mo>(</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> </msqrt> </mfrac> <msubsup> <mi>Y</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>&LeftArrow;</mo> <mfrac> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <msqrt> <msup> <mrow> <mo>(</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>)</mo> </mrow> <mn>2</mn> </msup> </msqrt> </mfrac> <msubsup> <mi>Y</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>2</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein,
<math> <mrow> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>=</mo> <mfrac> <mn>1</mn> <mrow> <mn>2</mn> <msup> <mi>N</mi> <mo>&prime;</mo> </msup> </mrow> </mfrac> <munderover> <mi>&Sigma;</mi> <mrow> <msup> <mi>n</mi> <mo>&prime;</mo> </msup> <mo>=</mo> <mn>1</mn> </mrow> <msup> <mi>N</mi> <mo>&prime;</mo> </msup> </munderover> <mrow> <mo>(</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>+</mo> <msup> <mi>n</mi> <mo>&prime;</mo> </msup> </mrow> <mi>&gamma;</mi> </msubsup> <mo>+</mo> <msubsup> <mi>H</mi> <mrow> <mi>n</mi> <mo>-</mo> <msup> <mi>n</mi> <mo>&prime;</mo> </msup> <mo>,</mo> <mi>k</mi> </mrow> <mi>&gamma;</mi> </msubsup> <mo>)</mo> </mrow> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>3</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> </mrow> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mi>mean</mi> <mo>)</mo> </mrow> </msubsup> <mo>=</mo> <mfrac> <mn>1</mn> <mrow> <mn>2</mn> <msup> <mi>K</mi> <mo>&prime;</mo> </msup> </mrow> </mfrac> <munderover> <mi>&Sigma;</mi> <mrow> <msup> <mi>k</mi> <mo>&prime;</mo> </msup> <mo>=</mo> <mn>1</mn> </mrow> <msup> <mi>K</mi> <mo>&prime;</mo> </msup> </munderover> <mrow> <mo>(</mo> <msubsup> <mi>P</mi> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> <mo>+</mo> <msup> <mi>k</mi> <mo>&prime;</mo> </msup> </mrow> <mi>&gamma;</mi> </msubsup> <mo>+</mo> <msubsup> <mi>P</mi> <msup> <mrow> <mi>n</mi> <mo>,</mo> <mi>k</mi> <mo>-</mo> <mi>k</mi> </mrow> <mo>&prime;</mo> </msup> <mi>&gamma;</mi> </msubsup> <mo>)</mo> </mrow> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>4</mn> <mo>)</mo> </mrow> </mrow> </math>
e) obtaining a wiener filter by using the obtained steady-state signal amplitude spectrum H and the obtained transient-state signal amplitude spectrum P according to the following formula;
W H = H H 2 + P 2 - - - ( 5 )
W P = P H 2 + P 2 - - - ( 6 )
f) time spectrum of the original signalMultiplying by a wiener filter to obtain a steady-state signal time-frequency spectrumAnd transient signal time frequency spectrumThe calculation formula is as follows;
<math> <mrow> <mover> <mi>H</mi> <mo>^</mo> </mover> <mo>=</mo> <mover> <mi>Y</mi> <mo>^</mo> </mover> <mo>&times;</mo> <msub> <mi>W</mi> <mi>H</mi> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>7</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <mover> <mi>P</mi> <mo>^</mo> </mover> <mo>=</mo> <mover> <mi>Y</mi> <mo>^</mo> </mover> <mo>&times;</mo> <msub> <mi>W</mi> <mi>P</mi> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>8</mn> <mo>)</mo> </mrow> </mrow> </math>
g) for the obtained steady-state signal time frequency spectrumAnd transient signal time frequency spectrumInverse short-time Fourier transform is carried out to obtain a steady-state signal x of a time domainL_H(t) and transient signal x in time domainL_P(t)。
3. A hybrid virtual bass boost processing method according to claim 1, wherein the virtual bass harmonic generation processing procedure in step 3) is to apply the transient signal xL_P(t) is input to a harmonic generator comprising a multiplier element and a feedback loop to obtain a harmonic signal x 'of the transient signal'L_P(t); the steady state signal x is measuredL_H(t) is inputted to a harmonic generator constituted by a phase vocoder to obtain a harmonic signal x 'of a steady-state signal'L_H(t)。
4. The hybrid virtual bass enhancement processing method according to claim 1, wherein the harmonic amplitude control processing in step 4) refers to the processing of the transient harmonic signal x 'according to an equal loudness curve'L_P(t) and a steady-state harmonic signal x'L_H(t) carrying out harmonic amplitude adjustment to enable the harmonic amplitude to achieve an ideal bass effect, and synthesizing into a path to obtain a virtual bass signal x'L(t)。
CN201510192051.3A 2015-04-21 2015-04-21 Mixed virtual bass enhancing method Pending CN104936088A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510192051.3A CN104936088A (en) 2015-04-21 2015-04-21 Mixed virtual bass enhancing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510192051.3A CN104936088A (en) 2015-04-21 2015-04-21 Mixed virtual bass enhancing method

Publications (1)

Publication Number Publication Date
CN104936088A true CN104936088A (en) 2015-09-23

Family

ID=54122998

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510192051.3A Pending CN104936088A (en) 2015-04-21 2015-04-21 Mixed virtual bass enhancing method

Country Status (1)

Country Link
CN (1) CN104936088A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516860A (en) * 2016-01-19 2016-04-20 青岛海信电器股份有限公司 Virtual basetone generating method, virtual basetone generating device and terminal
CN106572419A (en) * 2015-10-08 2017-04-19 中国科学院声学研究所 Stereo sound effect enhancement system
CN106653049A (en) * 2015-10-30 2017-05-10 国光电器股份有限公司 Addition of virtual bass in time domain
CN107222808A (en) * 2017-05-03 2017-09-29 上海大学 A kind of high-fidelity loudspeaker playback system design method
CN107959906A (en) * 2017-11-20 2018-04-24 英业达科技有限公司 Audio Enhancement Method and audio strengthening system
CN108492179A (en) * 2018-02-12 2018-09-04 上海翌固数据技术有限公司 Time-frequency spectrum generation method and equipment
CN108668193A (en) * 2017-03-30 2018-10-16 展讯通信(上海)有限公司 A kind of bass enhancing method, device and playback equipment for playback equipment
CN109996151A (en) * 2019-04-10 2019-07-09 上海大学 One kind mixing virtual bass boosting method based on the separation of wink steady-state signal
CN110506425A (en) * 2017-02-17 2019-11-26 思睿逻辑国际半导体有限公司 Bass boost
CN111796791A (en) * 2020-06-12 2020-10-20 瑞声科技(新加坡)有限公司 Bass enhancement method, system, electronic device and storage medium
CN112637741A (en) * 2020-12-30 2021-04-09 广州酷狗计算机科技有限公司 Audio signal processing method, device, chip, electronic equipment and storage medium
CN114067817A (en) * 2021-11-08 2022-02-18 易兆微电子(杭州)股份有限公司 Bass enhancement method, bass enhancement device, electronic equipment and storage medium
WO2022237252A1 (en) * 2021-05-14 2022-11-17 广州视源电子科技股份有限公司 Audio signal processing method and apparatus, and storage medium
WO2023274180A1 (en) * 2021-06-30 2023-01-05 华为技术有限公司 Method and apparatus for improving sound quality of speaker

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6813528B1 (en) * 1998-03-09 2004-11-02 Samsung Electronics Co., Ltd. Apparatus and method for outputting audio signal of laptop computer coupled with docking station
CN102354500A (en) * 2011-08-03 2012-02-15 华南理工大学 Virtual bass boosting method based on harmonic control
CN102724605A (en) * 2012-06-29 2012-10-10 惠州天缘电子有限公司 Virtual bass enhancement processing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6813528B1 (en) * 1998-03-09 2004-11-02 Samsung Electronics Co., Ltd. Apparatus and method for outputting audio signal of laptop computer coupled with docking station
CN102354500A (en) * 2011-08-03 2012-02-15 华南理工大学 Virtual bass boosting method based on harmonic control
CN102724605A (en) * 2012-06-29 2012-10-10 惠州天缘电子有限公司 Virtual bass enhancement processing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HIDEYUKI TACHIBANA ET AL: "Harmonic/Percussive Sound Separation Based on Anisotropic Smoothness of Spectrograms", 《IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106572419B (en) * 2015-10-08 2018-08-03 中国科学院声学研究所 A kind of stereo audio enhancing system
CN106572419A (en) * 2015-10-08 2017-04-19 中国科学院声学研究所 Stereo sound effect enhancement system
CN106653049A (en) * 2015-10-30 2017-05-10 国光电器股份有限公司 Addition of virtual bass in time domain
CN105516860A (en) * 2016-01-19 2016-04-20 青岛海信电器股份有限公司 Virtual basetone generating method, virtual basetone generating device and terminal
CN105516860B (en) * 2016-01-19 2019-02-19 青岛海信电器股份有限公司 Virtual bass generation method, device and terminal
US11109155B2 (en) 2017-02-17 2021-08-31 Cirrus Logic, Inc. Bass enhancement
CN110506425A (en) * 2017-02-17 2019-11-26 思睿逻辑国际半导体有限公司 Bass boost
CN108668193A (en) * 2017-03-30 2018-10-16 展讯通信(上海)有限公司 A kind of bass enhancing method, device and playback equipment for playback equipment
CN107222808A (en) * 2017-05-03 2017-09-29 上海大学 A kind of high-fidelity loudspeaker playback system design method
CN107222808B (en) * 2017-05-03 2019-11-19 上海大学 A kind of high-fidelity loudspeaker playback system design method
CN107959906A (en) * 2017-11-20 2018-04-24 英业达科技有限公司 Audio Enhancement Method and audio strengthening system
CN108492179B (en) * 2018-02-12 2020-09-01 上海翌固数据技术有限公司 Time-frequency spectrum generation method and device
CN108492179A (en) * 2018-02-12 2018-09-04 上海翌固数据技术有限公司 Time-frequency spectrum generation method and equipment
CN109996151A (en) * 2019-04-10 2019-07-09 上海大学 One kind mixing virtual bass boosting method based on the separation of wink steady-state signal
CN111796791A (en) * 2020-06-12 2020-10-20 瑞声科技(新加坡)有限公司 Bass enhancement method, system, electronic device and storage medium
CN112637741A (en) * 2020-12-30 2021-04-09 广州酷狗计算机科技有限公司 Audio signal processing method, device, chip, electronic equipment and storage medium
CN112637741B (en) * 2020-12-30 2023-03-10 广州酷狗计算机科技有限公司 Audio signal processing method, device, chip, electronic equipment and storage medium
WO2022237252A1 (en) * 2021-05-14 2022-11-17 广州视源电子科技股份有限公司 Audio signal processing method and apparatus, and storage medium
WO2023274180A1 (en) * 2021-06-30 2023-01-05 华为技术有限公司 Method and apparatus for improving sound quality of speaker
CN114067817A (en) * 2021-11-08 2022-02-18 易兆微电子(杭州)股份有限公司 Bass enhancement method, bass enhancement device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN104936088A (en) Mixed virtual bass enhancing method
US8971551B2 (en) Virtual bass synthesis using harmonic transposition
JP4286510B2 (en) Acoustic signal processing apparatus and method
US10750278B2 (en) Adaptive bass processing system
CN109996151A (en) One kind mixing virtual bass boosting method based on the separation of wink steady-state signal
CN111970627B (en) Audio signal enhancement method, device, storage medium and processor
CN102354500A (en) Virtual bass boosting method based on harmonic control
US20160322949A1 (en) Frequency-Domain DRC
CN106797526A (en) Apparatus for processing audio, methods and procedures
CN103369429B (en) Low voice enhancing method and device and voice control device
CN102547517B (en) Bass signal harmonic generating method and device and sound playing equipment
EP2720477B1 (en) Virtual bass synthesis using harmonic transposition
JP5046786B2 (en) Pseudo deep bass generator
CN108604454B (en) Audio signal processing apparatus and input audio signal processing method
US12101613B2 (en) Bass enhancement for loudspeakers
Mu Perceptual quality improvement and assessment for virtual bass system
CN202178861U (en) Virtual bass boosting treatment device based on harmonic control
CN115346544A (en) Audio signal processing method, apparatus, storage medium, and program product
JP4427672B2 (en) Technology for improving the clarity and discrimination performance of acoustic signals
CN116320903B (en) Virtual bass method, device and loudspeaker system based on auditory perception
US20240098401A1 (en) Suspended audio device with bass boost performance
CN111988726A (en) Method and system for synthesizing single sound channel by stereo
CN103297898B (en) Low frequency extending method and device
KR102698128B1 (en) Adaptive filterbank using scale-dependent nonlinearity for psychoacoustic frequency range extension
JP7576632B2 (en) Bass Enhancement for Speakers

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150923

WD01 Invention patent application deemed withdrawn after publication