US8351614B2 - Digital reverberations for audio signals - Google Patents

Digital reverberations for audio signals Download PDF

Info

Publication number
US8351614B2
US8351614B2 US11/701,971 US70197107A US8351614B2 US 8351614 B2 US8351614 B2 US 8351614B2 US 70197107 A US70197107 A US 70197107A US 8351614 B2 US8351614 B2 US 8351614B2
Authority
US
United States
Prior art keywords
feed forward
reverberation
digital audio
input
loop
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/701,971
Other versions
US20070195967A1 (en
Inventor
Yuan Wu
Sapna George
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
STMicroelectronics Asia Pacific Pte Ltd
Original Assignee
STMicroelectronics Asia Pacific Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by STMicroelectronics Asia Pacific Pte Ltd filed Critical STMicroelectronics Asia Pacific Pte Ltd
Assigned to STMICROELECTRONICS ASIA PACIFIC PTE. LTD. reassignment STMICROELECTRONICS ASIA PACIFIC PTE. LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GEORGE, SAPNA, WU, YUAN
Publication of US20070195967A1 publication Critical patent/US20070195967A1/en
Application granted granted Critical
Publication of US8351614B2 publication Critical patent/US8351614B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S1/00Two-channel systems
    • H04S1/007Two-channel systems in which the audio signals are in digital form
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/033Headphones for stereophonic communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic

Definitions

  • the present disclosure generally relates to digital audio signal processing technologies, and more particularly to devices for generating and controlling artificial reverberations for audio signals.
  • Artificial reverberations are often used for dry audio contents to simulate effects of real environments. In many applications such as headphone and speaker playbacks, artificial reverberations are added to give the listeners a sense of being in the real environments.
  • reverberations are echoes from various reflections in real environments, such as a room.
  • the ideal way of generating reverberations will be convolving the audio signal with the impulse response of the desired environment.
  • Such a method in practice is computationally costly. In a digital signal processing application, it takes huge computational and storage resources to implement this method.
  • conventional methods provide an electronic sound processor for creating reverberation effect by convolving random white noise with dry audio signals to simulate the late part of the reverberation.
  • an electric reverberation apparatus includes a plurality of loops having different delay times and adapted to form sound repetitions of diminishing intensity.
  • the loops are typically provided with tappings, each of which has a particular delay time associated with it.
  • a conventional reverberation effect imparting system includes a number of comb filters, each of which has a signal delay line and a feedback loop for filtering a delayed output signal from the delay line and feeding the filtered signal back to the input side with a variable loop gain.
  • the drawback of such feedback systems is that they will create resonates thus colorizes the sound.
  • the present disclosure provides a reverberation device with a uniformed structure for use in digital audio signal processing.
  • the generated artificial reverberations preferably have the characteristics extracted from real environments.
  • the present disclosure provides a reverberation generator for use in a digital audio signal processor.
  • the reverberation generator includes an input to receive a digital audio signal input and a summing circuit to generate a digital audio signal output containing the digital audio signal input and reverberations.
  • the reverberation generator also includes a digital audio signal direct path connected to the input and the summing circuit.
  • the reverberation generator further includes feed forward loops configured in a cascade manner, wherein the outputs of the feed forward loops are connected to the summing circuit, a first one of the feed forward loops is connected to the input, and an output of the first feed forward loops is fed to the summing circuit and an input of a second one of the feed forward loops.
  • the present disclosure provides a digital audio signal processing system.
  • the digital audio signal processing system includes a digital I/O interface to input and output digital audio signals.
  • the digital audio signal processing system also includes a controlling unit connected to the digital I/O interface to receive the input, wherein the controlling unit extracts reverberation characteristics of the input.
  • the system further includes a reverberation generator connected to the controlling unit, wherein the extracted reverberation characteristics control the configuration of the reverberation generator to generate the reverberations for the input to simulate a real environment.
  • the present disclosure provides a method of generating reverberations for a digital audio signal to simulate real environments.
  • the method includes extracting the reverberation characteristics of the digital audio signal for a real environment.
  • the method also includes translating the extracted reverberation characteristics into controlling parameters for a reverberation generator with a plurality of feed forward loops configured in a cascade manner.
  • the method further includes generating the reverberations using the controlling parameters to control the reverberation generator.
  • FIG. 1 is a schematic block diagram illustrating components of a typical digital audio signal processor
  • FIG. 2 shows a typical amplitude response of an audio signal in a real environment
  • FIG. 3 is a schematic function block diagram of the controlling mechanism of the reverberation-generating process of a digital audio signal processing system in accordance with one embodiment of the present disclosure
  • FIG. 4 is a schematic block circuit diagram illustrating the allpass filter used in the digital audio signal processor for the generation of reverberation in accordance with one embodiment of the present disclosure
  • FIG. 5 is a schematic block circuit diagram of a reverberation generator used in the digital audio signal processing system in accordance with one embodiment of the present disclosure
  • FIG. 6 is a schematic functional diagram of an electronic audio device illustrating the applications of the digital audio signal processor in accordance with one embodiment of the present disclosure.
  • FIG. 7 is a somewhat simplified flowchart illustrating a method of generating reverberations for a digital audio signal in accordance with one embodiment of the present disclosure.
  • FIG. 1 is a schematic block diagram illustrating components of a typical digital audio signal processor.
  • the digital audio signal processor 100 comprises a digital I/O interface 102 for inputting and outputting the audio data, a data bus 103 for transporting audio data within the processor and interconnecting with peripherals, a memory unit 104 for storing the input audio data and intermediate data from the executions of the processor, a computational unit 105 for loading the audio data and program data to host registers 106 and performing the processing then storing the processed audio data back to the I/O interface 102 for output.
  • the memory unit 104 comprises RAM, ROM, DMA, and I2C where the computational unit executes its programs and stores all the data.
  • the computation unit 105 comprises ALU, MAC and Shift for performing additions, subtractions, multiplications, and other operations. It is well known that multiplications usually need more resources, and short filter lengths and fewer multiplications will save the load of the processor.
  • the digital audio signal processor 100 further comprises a controller 107 that is usually present to control the processor through host registers which are interfaced with the computational unit through data bus. In addition, the controller 107 is connected to a User Interface 107 a so that the user of the processor could input its instructions to the processor.
  • the digital signal processor comprises a peripheral interface 108 through which the processor can interact with other components of an audio processing system.
  • the peripheral can be any suitable device including, for example, keyboards and mice.
  • FIG. 2 illustrates amplitudes of a direct signal and its reverberations 200 in a time domain in a real environment such as, for example, in a room. It is apparent that the direct signal reaches a listener's ears first and is followed by the echoes caused by reflections of floor, walls, ceiling and other surfaces. The characteristics of the echoes will be discussed in detail hereinafter. It is to be noted that the echoes do not change their pitches.
  • the reverberation shows certain general characteristics including the following: that the early echoes are quite sparse after the direct sound; that the density of the echoes increases in the time domain; and that in the late part of the reverberation in the time domain, the echoes become increasingly diffused and dense.
  • a reverberation model has to be established by extracting certain peculiar characteristics of the reverberations in each type of real environments.
  • the peculiar characteristics considered in the present disclosure include, for example, final echo density, rate of echo density to be built up, decay rate of the overall energy of echoes, and differential decay rates of high frequency signals and low frequency signals.
  • the final echo density and the rate of echo density to be built up depend on the size of the room. The smaller the room is, the faster the density of the echoes will be built up.
  • the rate of decay of the overall energy level of the echoes depends on the absorption of the surfaces.
  • the reflection surfaces generally absorb more high-frequency signals than low-frequency signals. As a result, the high-frequency signals decay faster than do the low-frequency signals. How fast the high-frequency signals decay with respect to the low-frequency signals depends on the surfaces of reflections.
  • the digital audio signal processing system 310 comprises a digital I/O interface 311 , a core processor 312 , and a controlling unit 313 .
  • the digital I/O interface 311 and the core processor 312 are very similar or identical to the ones shown in FIG. 1 , thus no detail description herein.
  • the controlling unit 313 may be electronically connected to the controller 107 of FIG. 1 to control the reverberation generating process.
  • the peculiar reverberation characteristics include final echo density 314 a , rate of the echo density to be built up 314 b , decay rate of overall energy level of the echoes 314 c , and differential decay rates of high-frequency signals and low-frequency signals 314 d.
  • the final echo density 314 a will be translated into the number of feed forward loops 315 a .
  • the final echo density is the number of echoes of a given time duration at the tail of the response.
  • the number of feed forward loops to be used is determined in the following manner: the denser the echoes to be built up, the more loops should the structure have. Generally, three or more loops are required to have the desired effects. Because of the diffusive nature of the late reverberation and the way human auditory system works, a reasonable close approximation for the final echo density will give sufficient sensation of the real environment when other controlling parameters are correctly set. Generally, an open space such as a square will have lower echo density and experiment shows three to four loops are sufficient for the simulation. An enclosed massy environment such as a wet market will have a high echo density and a minimum of four loops is necessary.
  • the rate of echo density to be built up 314 b will be translated into the delay lengths of delay lines 315 b .
  • the delay lines used in the digital signal processing device include the delay lines used in the loops and the delay lines used in the allpass filters.
  • the rate of the echo density to be built up is defined as the distance between the echoes. It is vital for the simulation of the reverberation to have the first few echoes well generated because the human auditory system judges the environment depending very much on the first few echoes. As the echoes become more and more diffused in the later part of the reverberation, the distances between the consecutive echoes are of less importance to the human auditory system.
  • the delay lengths of the delay lines used in the loops and the delay lines used in the allpass filters can be determined in the following manner: the longer the delay lengths, the slower the echo density will be built up.
  • the delay length of the delay line in the first loop (delay line 1) will be equal to the delay between the direct sound and the first echo.
  • the delay length of the delay line in the first allpass filter (AP1) will be equal to the delay between the first echo and second echo. To simulate a large room like a church, the delay lengths in each delay line and each allpass filter will be relatively large.
  • the delay lengths in the delay lines and allpass filters can be approximately calculated using the relationship exemplified by Equations 1 and 2, respectively.
  • Equations 1 and 2 respectively.
  • DL n is the length of delay line in the nth loop
  • AP n the length of the delay line in the nth allpass filter
  • x and y are the environment coefficients.
  • the values of x and y vary from 1.1 to 1.5.
  • the lengths of the delay lines DL n and AP n are preferable to be prime numbers, which will ensure a smooth decay of the reflection sound without significant burst signals.
  • the decay rate of the overall energy of echoes 314 c will be translated into the gains in each loop 315 c .
  • the decay rate of the overall energy level of the echo is defined by the reduction of the energy of the echoes given a time period, which can be expressed by
  • Equation 3 Equation 3
  • G n + 1 G n ⁇ d E d t ⁇ DL n + 1 ( Eqn . ⁇ 8 )
  • Equations 3 and 4 G n is the gain for the nth loop and DL n is the length of the delay line in the nth loop. To simulate a room with higher absorption of sound, the gains in each loop will be small. Typically, the gain value in the first loop varies between 0.2 to 0.5. The gain values in subsequent loops vary between 1 to 2.
  • the differential decay rates of high-frequency signals and low-frequency signals 314 d will be translated into the cutoff frequencies and roll off rate of lowpass filters 315 d ; the cutoff frequencies and roll off rates of the filters will determine how fast high-frequency signals decay with respect to low-frequency signals.
  • the decay rates of different frequencies vary. Generally, high frequency signals will be more absorbed by the reflection surfaces.
  • the characteristics can be quantified as the relative difference in the change of energy of different frequencies. The mathematical expression for this characteristic is
  • low-pass filters may be used to have a reasonably close approximation due to the fact that high frequencies decay faster than low frequencies most of the time.
  • the lowpass filters in each loop are used to simulate this characteristic.
  • the lowpass filters can be realized by finite response filters (FIR) or infinite response filters (IIR).
  • FIR finite response filters
  • IIR infinite response filters
  • the cutoff frequencies and roll off rates of the filters will determine how fast high-frequency signals decay with respect to low-frequency signals.
  • the filter may be a first order lowpass filter generally represented by Equation 5 below.
  • y n b*x n ⁇ a*y n ⁇ 1 (Eqn. 5)
  • the cutoff frequencies of the lowpass filter will be very specific environment dependent.
  • the cutoff frequency for a typical room environment is recommended to be between 5,000 and 15,000 with the first order lowpass filter implementation provided.
  • these parameters will be passed to a control unit controlling the core processor, which loads the input digital audio data from the I/O interface, performs the reverberation generation.
  • the output signal including the reverberation generated is sent out through the I/O interface.
  • the method of the present disclosure for generating reverberations is unique because it gradually builds up the density of the reverberations and at the same time decays different frequency components discriminately. At the same time, other characteristics including the final echo density and the decay rate of the overall energy level will also be controlled depending on the real environment characteristics. Therefore, the reverberations generated will closely match the characteristics of the real environments. Coloration of the sound is also minimized through the use of allpass filters and delay lines.
  • FIG. 4 there is provided a schematic block circuit diagram illustrating the allpass filter used in the digital audio signal processor for the generation of reverberation in accordance with one embodiment of the present disclosure.
  • the allpass filter 420 comprises an input adder 421 , a delay line 422 , an output adder 423 , a feedback loop 424 with an amplifier ( ⁇ a), and a feed forward loop 425 with an amplifier (a).
  • the allpass filter 420 has a flat frequency response, thus introducing little coloration to the sounds.
  • the value of (a) can be between 0.6 and 0.7.
  • the reverberation generator 530 comprises a plurality of feed forward loops 531 , 532 , 533 , 534 configured in a cascade manner, and a summer 535 .
  • Each of the feed forward loops comprises a gain, a delay line, an allpass filter shown in FIG. 4 and a lowpass filter.
  • the reverberation generator 530 uses the controlling parameters passed by the control unit to perform the generation process of reverberations for an input signal.
  • the input signal is sent without manipulation to the summer 535 to simulate the direct signal in the output.
  • the input signal is also to be sent to a first feed forward loop.
  • the output of the first feed forward loop is sent to the summer 535 to simulate early reverberations in the output, and at the same time is used as the input of a second feed forward loop.
  • the output of the second feed forward loop is sent to the summer 535 to simulate later-than-early reverberations in the output, and is used as the input of a third feed forward loop and so on.
  • the output of the reverberation generator is the sum of the direct signal and all the outputs of the feed forward loops.
  • the diagram only shows 4 feed forward loops, but the number of loops is not limited to 4 and can be changed when necessary.
  • the delay line in the first loop is recommended to be equal to the delay time between the direct signal and the first echo.
  • the delay lines used in the feed forward loops and allpass filters can be realized by circular buffers in digital signal processing.
  • the lowpass filters can be realized by FIR and IIR filters, generally, first order IIR filters will be sufficient for most of the environments.
  • this circuit generates the direct and reverberation signals.
  • the gain in each loop controls the rate of decay of the overall energy level of the reverberation signals.
  • the cascaded allpass filters will create dense echoes. With the delay lines used in each loop, the structure will create reverberations with increasing density of the echoes.
  • the lowpass filters used in each loop will create the effect of faster decay of high-frequency signals.
  • the computational cost of generating reverberations using the digital signal processing device of the present disclosure is reasonably low for the following reasons: the design involves very few multiplications; all the delay lines can be realized by circular buffers; and the lowpass filters can be as simple as first order IIR filters.
  • the MP3 player 640 comprises a memory domain 641 for storing all databases and enabling all computational executions, an audio media file database 642 , a decoder 643 for decoding all audio media files before each file is output, a controlling unit 644 for performing the controlling process of the reverberation generation, and a reverberation generator 645 for generating the reverberations according to the characteristics controlled by the controlling unit.
  • the memory domain 641 , file database 642 , and decoder 643 may be any suitable respective device.
  • the electronics that can employ the digital audio signal processing system of the present disclosure further include handphones, portable players, TV, DVD player, and the like.
  • FIG. 7 there is provided a flowchart of generating reverberations for a digital audio signal in accordance with one embodiment of the present disclosure.
  • the generation of reverberation 750 of an input digital audio signal 751 starts by choosing one real environment to be simulated and extracting the reverberation characteristics for the chosen environment 752 ; then the reverberation generator is configured with the control of the reverberation characteristics (i.e., setting up the parameters of the reverberation generator including the number of feed forward loops, and the gains, delay lines, allpass filters, and low pass filters for each loop) 753 ; then the simulated reverberation is generated 754 and output 755 .
  • the control of the reverberation characteristics i.e., setting up the parameters of the reverberation generator including the number of feed forward loops, and the gains, delay lines, allpass filters, and low pass filters for each loop
  • the extracted reverberation characteristics include the final echo density 314 a , the rate of the echo density to be built up 314 b , the decay rate of overall energy level of the echoes 314 c , and the differential decay rates of high-frequency signals and low-frequency signals 314 d , as shown in FIG. 3 .
  • the translation of the characteristics into controlling parameters of the reverberation generator has been discussed above.
  • Couple and its derivatives refer to any direct or indirect communication between two or more elements, whether or not those elements are in physical contact with one another.
  • the term “or” is inclusive, meaning and/or.
  • the phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like.

Abstract

The present disclosure provides a digital audio signal processing system that comprises a set of delay lines, allpass and lowpass filters to achieve the reverberation effect. The present disclosure further provides a method for generating and controlling digital reverberations for audio signals. The reverberation generated will have an increasing echo density in the time domain and a faster decay of high frequency signals than low frequency signals. The controlling mechanism of reverberation generation is realized through the extraction of the real environment characteristics.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
The present application is related to Singapore Patent Application No. 200600974-0, filed Feb. 14, 2006, entitled “DIGITAL AUDIO SIGNAL PROCESSING METHOD AND SYSTEM FOR GENERATING AND CONTROLLING DIGITAL REVERBERATIONS FOR AUDIO SIGNALS”. Singapore Patent Application No. 200600974-0 is assigned to the assignee of the present application and is hereby incorporated by reference into the present disclosure as if fully set forth herein. The present application hereby claims priority under 35 U.S.C. §119(a) to Singapore Patent Application No. 200600974-0.
TECHNICAL FIELD
The present disclosure generally relates to digital audio signal processing technologies, and more particularly to devices for generating and controlling artificial reverberations for audio signals.
BACKGROUND
Artificial reverberations are often used for dry audio contents to simulate effects of real environments. In many applications such as headphone and speaker playbacks, artificial reverberations are added to give the listeners a sense of being in the real environments.
In nature, reverberations are echoes from various reflections in real environments, such as a room. The ideal way of generating reverberations will be convolving the audio signal with the impulse response of the desired environment. Such a method in practice is computationally costly. In a digital signal processing application, it takes huge computational and storage resources to implement this method. To reduce the cost, for example, conventional methods provide an electronic sound processor for creating reverberation effect by convolving random white noise with dry audio signals to simulate the late part of the reverberation.
A number of conventional methods approximate the exact reverberation or to create only the salient signals. Most of the algorithms use feedback loops with delay lines, sometimes combined with allpass filters. For example, in one conventional system, an electric reverberation apparatus includes a plurality of loops having different delay times and adapted to form sound repetitions of diminishing intensity. The loops are typically provided with tappings, each of which has a particular delay time associated with it.
A conventional reverberation effect imparting system includes a number of comb filters, each of which has a signal delay line and a feedback loop for filtering a delayed output signal from the delay line and feeding the filtered signal back to the input side with a variable loop gain. The drawback of such feedback systems is that they will create resonates thus colorizes the sound. These problems may be overcome by phase-shifting or time-variant delay lines in some algorithms, which introduce certain undesired pitch shifting effects.
Other conventional systems use only delay lines and feed forward loops, tapping at different locations of the delay lines. Still other conventional systems use algorithms that separate the reverberations to early and later parts and generate them separately. This typically leads to a sudden increase of echo density at the boundary, which is not true in a natural environment.
There is therefore a need for improved reverberation devices.
SUMMARY
In one embodiment, the present disclosure provides a reverberation device with a uniformed structure for use in digital audio signal processing. The generated artificial reverberations preferably have the characteristics extracted from real environments.
In one embodiment, the present disclosure provides a reverberation generator for use in a digital audio signal processor. The reverberation generator includes an input to receive a digital audio signal input and a summing circuit to generate a digital audio signal output containing the digital audio signal input and reverberations. The reverberation generator also includes a digital audio signal direct path connected to the input and the summing circuit. The reverberation generator further includes feed forward loops configured in a cascade manner, wherein the outputs of the feed forward loops are connected to the summing circuit, a first one of the feed forward loops is connected to the input, and an output of the first feed forward loops is fed to the summing circuit and an input of a second one of the feed forward loops.
In another embodiment, the present disclosure provides a digital audio signal processing system. The digital audio signal processing system includes a digital I/O interface to input and output digital audio signals. The digital audio signal processing system also includes a controlling unit connected to the digital I/O interface to receive the input, wherein the controlling unit extracts reverberation characteristics of the input. The system further includes a reverberation generator connected to the controlling unit, wherein the extracted reverberation characteristics control the configuration of the reverberation generator to generate the reverberations for the input to simulate a real environment.
In still another embodiment, the present disclosure provides a method of generating reverberations for a digital audio signal to simulate real environments. The method includes extracting the reverberation characteristics of the digital audio signal for a real environment. The method also includes translating the extracted reverberation characteristics into controlling parameters for a reverberation generator with a plurality of feed forward loops configured in a cascade manner. The method further includes generating the reverberations using the controlling parameters to control the reverberation generator.
Other technical features may be readily apparent to one skilled in the art from the following figures, descriptions and claims.
BRIEF DESCRIPTION OF THE DRAWINGS
For a more complete understanding of this disclosure and its features, reference is now made to the following description, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a schematic block diagram illustrating components of a typical digital audio signal processor;
FIG. 2 shows a typical amplitude response of an audio signal in a real environment;
FIG. 3 is a schematic function block diagram of the controlling mechanism of the reverberation-generating process of a digital audio signal processing system in accordance with one embodiment of the present disclosure;
FIG. 4 is a schematic block circuit diagram illustrating the allpass filter used in the digital audio signal processor for the generation of reverberation in accordance with one embodiment of the present disclosure;
FIG. 5 is a schematic block circuit diagram of a reverberation generator used in the digital audio signal processing system in accordance with one embodiment of the present disclosure;
FIG. 6 is a schematic functional diagram of an electronic audio device illustrating the applications of the digital audio signal processor in accordance with one embodiment of the present disclosure; and
FIG. 7 is a somewhat simplified flowchart illustrating a method of generating reverberations for a digital audio signal in accordance with one embodiment of the present disclosure.
DETAILED DESCRIPTION
Most conventional reverberation generation methods use digital signal processors (DSP), which have limited computational and memory resources. FIG. 1 is a schematic block diagram illustrating components of a typical digital audio signal processor. The digital audio signal processor 100 comprises a digital I/O interface 102 for inputting and outputting the audio data, a data bus 103 for transporting audio data within the processor and interconnecting with peripherals, a memory unit 104 for storing the input audio data and intermediate data from the executions of the processor, a computational unit 105 for loading the audio data and program data to host registers 106 and performing the processing then storing the processed audio data back to the I/O interface 102 for output.
The memory unit 104 comprises RAM, ROM, DMA, and I2C where the computational unit executes its programs and stores all the data. The computation unit 105 comprises ALU, MAC and Shift for performing additions, subtractions, multiplications, and other operations. It is well known that multiplications usually need more resources, and short filter lengths and fewer multiplications will save the load of the processor. The digital audio signal processor 100 further comprises a controller 107 that is usually present to control the processor through host registers which are interfaced with the computational unit through data bus. In addition, the controller 107 is connected to a User Interface 107 a so that the user of the processor could input its instructions to the processor. Furthermore, the digital signal processor comprises a peripheral interface 108 through which the processor can interact with other components of an audio processing system. The peripheral can be any suitable device including, for example, keyboards and mice.
Now referring to FIG. 2, illustrates amplitudes of a direct signal and its reverberations 200 in a time domain in a real environment such as, for example, in a room. It is apparent that the direct signal reaches a listener's ears first and is followed by the echoes caused by reflections of floor, walls, ceiling and other surfaces. The characteristics of the echoes will be discussed in detail hereinafter. It is to be noted that the echoes do not change their pitches.
As illustrated in FIG. 2, the reverberation shows certain general characteristics including the following: that the early echoes are quite sparse after the direct sound; that the density of the echoes increases in the time domain; and that in the late part of the reverberation in the time domain, the echoes become increasingly diffused and dense. However, to simulate the reverberations, a reverberation model has to be established by extracting certain peculiar characteristics of the reverberations in each type of real environments.
The peculiar characteristics considered in the present disclosure include, for example, final echo density, rate of echo density to be built up, decay rate of the overall energy of echoes, and differential decay rates of high frequency signals and low frequency signals. For example, in a room, the final echo density and the rate of echo density to be built up depend on the size of the room. The smaller the room is, the faster the density of the echoes will be built up. Furthermore, the rate of decay of the overall energy level of the echoes depends on the absorption of the surfaces. In addition, the reflection surfaces generally absorb more high-frequency signals than low-frequency signals. As a result, the high-frequency signals decay faster than do the low-frequency signals. How fast the high-frequency signals decay with respect to the low-frequency signals depends on the surfaces of reflections.
Now referring to FIG. 3, there is provided a schematic function block diagram of the controlling mechanism of the reverberation-generating process of a digital audio signal processing system in accordance with one embodiment of the present disclosure. As shown in FIG. 3, the digital audio signal processing system 310 comprises a digital I/O interface 311, a core processor 312, and a controlling unit 313. The digital I/O interface 311 and the core processor 312 are very similar or identical to the ones shown in FIG. 1, thus no detail description herein. The controlling unit 313 may be electronically connected to the controller 107 of FIG. 1 to control the reverberation generating process.
Still referring to FIG. 3, there is provided a more detailed description of the operation of the controlling unit 313. First, extract the peculiar reverberation characteristics of an audio signal from the audio signal reverberations of one real environment to be simulated. The peculiar reverberation characteristics include final echo density 314 a, rate of the echo density to be built up 314 b, decay rate of overall energy level of the echoes 314 c, and differential decay rates of high-frequency signals and low-frequency signals 314 d.
Then, these reverberation characteristics are translated into controlling parameters. More specifically, the final echo density 314 a will be translated into the number of feed forward loops 315 a. The final echo density is the number of echoes of a given time duration at the tail of the response. The number of feed forward loops to be used is determined in the following manner: the denser the echoes to be built up, the more loops should the structure have. Generally, three or more loops are required to have the desired effects. Because of the diffusive nature of the late reverberation and the way human auditory system works, a reasonable close approximation for the final echo density will give sufficient sensation of the real environment when other controlling parameters are correctly set. Generally, an open space such as a square will have lower echo density and experiment shows three to four loops are sufficient for the simulation. An enclosed massy environment such as a wet market will have a high echo density and a minimum of four loops is necessary.
The rate of echo density to be built up 314 b will be translated into the delay lengths of delay lines 315 b. As discussed hereinafter, the delay lines used in the digital signal processing device include the delay lines used in the loops and the delay lines used in the allpass filters. The rate of the echo density to be built up is defined as the distance between the echoes. It is vital for the simulation of the reverberation to have the first few echoes well generated because the human auditory system judges the environment depending very much on the first few echoes. As the echoes become more and more diffused in the later part of the reverberation, the distances between the consecutive echoes are of less importance to the human auditory system.
The delay lengths of the delay lines used in the loops and the delay lines used in the allpass filters can be determined in the following manner: the longer the delay lengths, the slower the echo density will be built up. The delay length of the delay line in the first loop (delay line 1) will be equal to the delay between the direct sound and the first echo. The delay length of the delay line in the first allpass filter (AP1) will be equal to the delay between the first echo and second echo. To simulate a large room like a church, the delay lengths in each delay line and each allpass filter will be relatively large. After the first loop, the delay lengths in the delay lines and allpass filters can be approximately calculated using the relationship exemplified by Equations 1 and 2, respectively.
DL n+1 ≈DL n ×x  (Eqn. 2)
AP n+1 ≈AP n ×y  (Eqn. 4)
In Equations 1 and 2, DLn is the length of delay line in the nth loop; APn the length of the delay line in the nth allpass filter; x and y are the environment coefficients. The values of x and y vary from 1.1 to 1.5. The lengths of the delay lines DLn and APn are preferable to be prime numbers, which will ensure a smooth decay of the reflection sound without significant burst signals.
The decay rate of the overall energy of echoes 314 c will be translated into the gains in each loop 315 c. The decay rate of the overall energy level of the echo is defined by the reduction of the energy of the echoes given a time period, which can be expressed by
E t ,
where E represents the energy of the echo and t represents the time. For example, a room with carpet floor absorbs sound much better than wooden floor. This characteristic can be translated into the gains in each loop: the smaller the gains are, the faster the over energy level of the echoes decays. The gain can be approximately calculated using the relationship exemplified by Equations 3 and 4 below.
G 1 = E t * DL 1 ( Eqn . 6 )
G n + 1 = G n E t × DL n + 1 ( Eqn . 8 )
In Equations 3 and 4, Gn is the gain for the nth loop and DLn is the length of the delay line in the nth loop. To simulate a room with higher absorption of sound, the gains in each loop will be small. Typically, the gain value in the first loop varies between 0.2 to 0.5. The gain values in subsequent loops vary between 1 to 2.
The differential decay rates of high-frequency signals and low-frequency signals 314 d will be translated into the cutoff frequencies and roll off rate of lowpass filters 315 d; the cutoff frequencies and roll off rates of the filters will determine how fast high-frequency signals decay with respect to low-frequency signals. For each environment, the decay rates of different frequencies vary. Generally, high frequency signals will be more absorbed by the reflection surfaces. The characteristics can be quantified as the relative difference in the change of energy of different frequencies. The mathematical expression for this characteristic is
E f f * t ,
where Ef represents the energy for a certain frequency f. This characteristic will be a very complex scenario to model.
But in most cases, low-pass filters may be used to have a reasonably close approximation due to the fact that high frequencies decay faster than low frequencies most of the time. The lowpass filters in each loop are used to simulate this characteristic. The lowpass filters can be realized by finite response filters (FIR) or infinite response filters (IIR). The cutoff frequencies and roll off rates of the filters will determine how fast high-frequency signals decay with respect to low-frequency signals. The filter may be a first order lowpass filter generally represented by Equation 5 below.
y n =b*x n −a*y n−1  (Eqn. 5)
In Equation 5, a=1-b. It should be understood by those who are skilled in the art that the lowpass filters can be implemented with different structures and methods, without being limited to the one this patent provides. The cutoff frequencies of the lowpass filter will be very specific environment dependent. The cutoff frequency for a typical room environment is recommended to be between 5,000 and 15,000 with the first order lowpass filter implementation provided.
Then, these parameters will be passed to a control unit controlling the core processor, which loads the input digital audio data from the I/O interface, performs the reverberation generation. The output signal including the reverberation generated is sent out through the I/O interface.
The method of the present disclosure for generating reverberations is unique because it gradually builds up the density of the reverberations and at the same time decays different frequency components discriminately. At the same time, other characteristics including the final echo density and the decay rate of the overall energy level will also be controlled depending on the real environment characteristics. Therefore, the reverberations generated will closely match the characteristics of the real environments. Coloration of the sound is also minimized through the use of allpass filters and delay lines.
Now referring to FIG. 4, there is provided a schematic block circuit diagram illustrating the allpass filter used in the digital audio signal processor for the generation of reverberation in accordance with one embodiment of the present disclosure. The allpass filter 420 comprises an input adder 421, a delay line 422, an output adder 423, a feedback loop 424 with an amplifier (−a), and a feed forward loop 425 with an amplifier (a). The allpass filter 420 has a flat frequency response, thus introducing little coloration to the sounds. The value of (a) can be between 0.6 and 0.7.
Now referring to FIG. 5, there is provided a schematic block circuit diagram of a reverberation generator used in the digital audio signal processing system in accordance with one embodiment of the present disclosure. The reverberation generator 530 comprises a plurality of feed forward loops 531, 532, 533, 534 configured in a cascade manner, and a summer 535. Each of the feed forward loops comprises a gain, a delay line, an allpass filter shown in FIG. 4 and a lowpass filter. The reverberation generator 530 uses the controlling parameters passed by the control unit to perform the generation process of reverberations for an input signal.
The input signal is sent without manipulation to the summer 535 to simulate the direct signal in the output. The input signal is also to be sent to a first feed forward loop. The output of the first feed forward loop is sent to the summer 535 to simulate early reverberations in the output, and at the same time is used as the input of a second feed forward loop. The output of the second feed forward loop is sent to the summer 535 to simulate later-than-early reverberations in the output, and is used as the input of a third feed forward loop and so on. The output of the reverberation generator is the sum of the direct signal and all the outputs of the feed forward loops. The diagram only shows 4 feed forward loops, but the number of loops is not limited to 4 and can be changed when necessary.
The delay line in the first loop is recommended to be equal to the delay time between the direct signal and the first echo. The delay lines used in the feed forward loops and allpass filters can be realized by circular buffers in digital signal processing. The lowpass filters can be realized by FIR and IIR filters, generally, first order IIR filters will be sufficient for most of the environments.
In one embodiment, this circuit generates the direct and reverberation signals. The gain in each loop controls the rate of decay of the overall energy level of the reverberation signals. The cascaded allpass filters will create dense echoes. With the delay lines used in each loop, the structure will create reverberations with increasing density of the echoes. The lowpass filters used in each loop will create the effect of faster decay of high-frequency signals.
Moreover, the computational cost of generating reverberations using the digital signal processing device of the present disclosure is reasonably low for the following reasons: the design involves very few multiplications; all the delay lines can be realized by circular buffers; and the lowpass filters can be as simple as first order IIR filters.
Now referring to FIG. 6, there is provided a schematic functional diagram of an electronic audio device illustrating the applications of the digital audio signal processor in accordance with one embodiment of the present disclosure. The MP3 player 640 comprises a memory domain 641 for storing all databases and enabling all computational executions, an audio media file database 642, a decoder 643 for decoding all audio media files before each file is output, a controlling unit 644 for performing the controlling process of the reverberation generation, and a reverberation generator 645 for generating the reverberations according to the characteristics controlled by the controlling unit. The memory domain 641, file database 642, and decoder 643 may be any suitable respective device. The electronics that can employ the digital audio signal processing system of the present disclosure further include handphones, portable players, TV, DVD player, and the like.
Now referring to FIG. 7, there is provided a flowchart of generating reverberations for a digital audio signal in accordance with one embodiment of the present disclosure. The generation of reverberation 750 of an input digital audio signal 751 starts by choosing one real environment to be simulated and extracting the reverberation characteristics for the chosen environment 752; then the reverberation generator is configured with the control of the reverberation characteristics (i.e., setting up the parameters of the reverberation generator including the number of feed forward loops, and the gains, delay lines, allpass filters, and low pass filters for each loop) 753; then the simulated reverberation is generated 754 and output 755.
In the step of extracting reverberation characteristics, the extracted reverberation characteristics include the final echo density 314 a, the rate of the echo density to be built up 314 b, the decay rate of overall energy level of the echoes 314 c, and the differential decay rates of high-frequency signals and low-frequency signals 314 d, as shown in FIG. 3. The translation of the characteristics into controlling parameters of the reverberation generator has been discussed above.
It may be advantageous to set forth definitions of certain words and phrases used in this patent document. The term “couple” and its derivatives refer to any direct or indirect communication between two or more elements, whether or not those elements are in physical contact with one another. The terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation. The term “or” is inclusive, meaning and/or. The phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like.
While this disclosure has described certain embodiments and generally associated methods, alterations and permutations of these embodiments and methods will be apparent to those skilled in the art. Accordingly, the above description of example embodiments does not define or constrain this disclosure. Other changes, substitutions, and alterations are also possible without departing from the spirit and scope of this disclosure, as defined by the following claims.

Claims (25)

1. For use in a digital audio signal processor, a reverberation generator comprising:
an input configured to receive a digital audio signal input;
a summing circuit configured to generate a digital audio signal output containing the digital audio signal input and reverberations;
a digital audio signal direct path connected to the input and the summing circuit, the digital audio signal direct path configured to provide the digital audio signal input to the summing circuit without manipulation; and
a plurality of feed forward loops configured in a cascade manner, wherein the outputs of the feed forward loops are connected to the summing circuit, a first one of the feed forward loops is connected to the input, and an output of the first feed forward loops is configured to be fed to the summing circuit and an input of a second one of the feed forward loops.
2. The reverberation generator of claim 1, wherein an output of the second feed forward loop is configured to be fed to the summing circuit and an input of a third one of the feed forward loops.
3. The reverberation generator of claim 1, wherein the feed forward loops comprise a gain, a delay line, an allpass filter, and a lowpass filter.
4. The reverberation generator of claim 3, wherein the allpass filter comprises:
an input adder configured to sum up the input to the allpass filter and a feedback from a delay line, wherein the delay line is electronically downstream of the input adder;
a feedback loop configured to use an output of the delay line as the feedback to the input adder, wherein the feedback loop comprises a feedback amplifier having a feedback gain (−a);
a feed forward loop connected to the input adder, wherein the feed forward loop comprises an amplifier having a feed forward gain (a); and
an output adder configured to sum up the outputs from the delay line and the feed forward loop.
5. The reverberation generator of claim 4, wherein an absolute value of the feedback gain (−a) and the feed forward gain (a) is between 0.6 and 0.7.
6. The reverberation generator of claim 4, wherein the length of the delay line in the first allpass filter is equal to the delay time between the first echo and the second echo.
7. The reverberation generator of claim 4, wherein the lengths of all the delay lines and allpass filters are prime numbers.
8. The reverberation generator of claim 4, wherein the length of the delay lines in the allpass filters except for the first allpass filter (APn+1) is given by APn+1≈APn×y, wherein APn is the length of the delay line in the nth allpass filter, and y is an environment coefficient having a value between 1.1 to 1.5.
9. The reverberation generator of claim 3, wherein the delay line in the first loop is set to be equal to the delay time between a direct signal and its first echo.
10. The reverberation generator of claim 9, wherein the length of the delay line in any loop except for the first loop (DLn+1) is given by DLn+1≈DLn×x, wherein DLn is the length of delay line in the nth loop, and x is an environment coefficient having a value between 1.1 to 1.5.
11. The reverberation generator of claim 4, wherein the delay lines used in the feed forward loops and allpass filters are realized by circular buffers in digital signal processing.
12. The reverberation generator of claim 3, wherein the gain at a particular feed forward loop is given by
G 1 = E t * DL 1 and G n + 1 = G n E t × DL n + 1 ,
wherein Gn is the gain for the nth feed forward loop and DLn is the length of the delay line in the nth loop.
13. The reverberation generator of claim 11, wherein the gain in the first feed forward loop varies between 0.2 to 0.5 and the gain in subsequent feed forward loops varies between 1 to 2.
14. The reverberation generator of claim 3, wherein the lowpass filters comprise at least one of: FIR filters, IIR filters, and first order IIR filters.
15. The reverberation generator of claim 1, wherein the reverberation generator is configured to combine the reverberation with the digital audio signal input to produce a digital audio signal output simulating a real environment.
16. A digital audio signal processing system comprising:
a digital I/O interface configured to input and output digital audio signals;
a controlling unit connected to the digital I/O interface configured to receive the inputted digital audio signals, wherein the controlling unit is configured to extract reverberation characteristics of the inputted digital audio signals, the reverberation characteristics comprising at least one of: a final echo density, a rate of the echo density to be built up, and a differential decay rate of a high-frequency signal and a low-frequency signal; and
a reverberation generator coupled to the controlling unit, the reverberation generator configured to generate, according to the extracted reverberation characteristics, reverberations for the inputted digital audio signals to simulate a real environment, the reverberation generator comprising:
a plurality of feed forward loops configured in a cascade manner; and
a summing circuit configured to receive outputs of the plurality of feed forward loops and output the digital audio signals,
wherein a first one of the feed forward loops is connected to the inputted digital audio signals, and an output of the first feed forward loops is configured to be fed to the summing circuit and an input of a second one of the feed forward loops.
17. The system of claim 16, wherein the reverberation characteristics comprises a decay rate of overall energy level of the echoes.
18. The system of claim 16, wherein an output of the second feed forward loop is configured to be fed to the summing circuit and an input of a third one of the feed forward loops.
19. A method of generating reverberations for a digital audio signal to simulate real environments, the method comprising:
extracting the reverberation characteristics of the digital audio signal for a real environment, the reverberation characteristics comprising at least one of: a final echo density, a rate of the echo density to be built up, and a differential decay rate of a high-frequency signal and a low-frequency signal;
translating the extracted reverberation characteristics into controlling parameters for a reverberation generator with a plurality of feed forward loops configured in a cascade manner, and a summing circuit configured to receive the outputs of the feed forward loops, wherein a first one of the feed forward loops is connected to the inputted digital audio signals, and an output of the first feed forward loops is configured to be fed to the summing circuit and an input of a second one of the feed forward loops; and
generating the reverberations using the controlling parameters to control the reverberation generator.
20. The method of claim 19, wherein the reverberation characteristics comprise a decay rate of overall energy level of the echoes.
21. The method of claim 19, wherein each of the feed forward loops comprises a gain, a delay line, an allpass filter, and a lowpass filter.
22. The method of claim 21, wherein the allpass filter comprises:
an input adder configured to sum up the input to the allpass filter and a feedback from a delay line, wherein the delay line is electronically downstream of the input adder;
a feedback loop configured to use an output of the delay line as the feedback to the input adder, wherein the feedback loop comprises a feedback amplifier having a feedback gain (−a);
a feed forward loop connected to the input adder, wherein the feed forward loop comprises an amplifier having a feed forward gain (a); and
an output adder configured to sum up the outputs from the delay line and the feed forward loop.
23. The method of claim 20, wherein the delay line in the first loop is equal to the delay time between a direct signal and its first echo.
24. The method of claim 20, wherein the controlling parameters of the reverberation generator include at least one of: a number of feed forward loops, a length of the delay line, a gain used in the feed forward loops, and a cutoff frequency and roll off rate of the lowpass filters.
25. The method of claim 24, wherein the reverberation generator generates reverberations by:
controlling the final echo density by the number of feed forward loops;
controlling the rate of the echo density to be built up by the lengths of the delay lines used in the feed forward loops and allpass filters;
controlling the decay rate of the overall energy level of the echoes by the gain used in the feed forward loops; and
controlling the decay of high frequency signals with respect to low frequency signals with the cutoff frequencies and roll off rates of the lowpass filters.
US11/701,971 2006-02-14 2007-02-02 Digital reverberations for audio signals Active 2030-07-01 US8351614B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SG200600974-0 2006-02-14
SG200600974-0A SG135058A1 (en) 2006-02-14 2006-02-14 Digital audio signal processing method and system for generating and controlling digital reverberations for audio signals

Publications (2)

Publication Number Publication Date
US20070195967A1 US20070195967A1 (en) 2007-08-23
US8351614B2 true US8351614B2 (en) 2013-01-08

Family

ID=38042951

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/701,971 Active 2030-07-01 US8351614B2 (en) 2006-02-14 2007-02-02 Digital reverberations for audio signals

Country Status (4)

Country Link
US (1) US8351614B2 (en)
EP (1) EP1819197A2 (en)
CN (2) CN101034548B (en)
SG (1) SG135058A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100172508A1 (en) * 2009-01-05 2010-07-08 Samsung Electronics Co., Ltd. Method and apparatus of generating sound field effect in frequency domain
US20120035936A1 (en) * 2010-08-05 2012-02-09 Stmicroelectronics Asia Pacific Pte Ltd Information reuse in low power scalable hybrid audio encoders
US20120057715A1 (en) * 2010-09-08 2012-03-08 Johnston James D Spatial audio encoding and reproduction
US20130301839A1 (en) * 2012-04-19 2013-11-14 Peter Vogel Instruments Pty Ltd Sound synthesiser
US9245520B2 (en) 2009-10-21 2016-01-26 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reverberator and method for reverberating an audio signal

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100040243A1 (en) * 2008-08-14 2010-02-18 Johnston James D Sound Field Widening and Phase Decorrelation System and Method
US8254588B2 (en) * 2007-11-13 2012-08-28 Stmicroelectronics Asia Pacific Pte., Ltd. System and method for providing step size control for subband affine projection filters for echo cancellation applications
CN101727892B (en) * 2009-12-03 2013-01-30 无锡中星微电子有限公司 Method and device for generating reverberation model
EP3018918A1 (en) * 2014-11-07 2016-05-11 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating output signals based on an audio source signal, sound reproduction system and loudspeaker signal
JP6926662B2 (en) * 2017-05-17 2021-08-25 ティアック株式会社 Audio equipment and programs
CN107358962B (en) * 2017-06-08 2018-09-04 腾讯科技(深圳)有限公司 Audio-frequency processing method and apparatus for processing audio
CN107622773B (en) * 2017-09-08 2021-04-06 科大讯飞股份有限公司 Audio feature extraction method and device and electronic equipment
WO2019078034A1 (en) 2017-10-20 2019-04-25 ソニー株式会社 Signal processing device and method, and program
WO2019078035A1 (en) 2017-10-20 2019-04-25 ソニー株式会社 Signal processing device, method, and program
WO2019241754A1 (en) * 2018-06-14 2019-12-19 Magic Leap, Inc. Reverberation gain normalization
CN112153535B (en) * 2020-09-03 2022-04-08 Oppo广东移动通信有限公司 Sound field expansion method, circuit, electronic equipment and storage medium
CN112581932A (en) * 2020-11-26 2021-03-30 交通运输部南海航海保障中心广州通信中心 Wired and wireless sound mixing system based on DSP
CN112820256B (en) * 2021-01-14 2022-06-14 四川湖山电器股份有限公司 Reverberation method and system based on improved feedback delay network
CN113470669B (en) * 2021-05-26 2023-06-30 广州市迪士普音响科技有限公司 Digital audio processing method and system
CN113518286B (en) * 2021-06-29 2023-07-14 广州酷狗计算机科技有限公司 Reverberation processing method and device for audio signal, electronic equipment and storage medium
CN114842820A (en) * 2022-05-18 2022-08-02 北京地平线信息技术有限公司 K song audio processing method and device and computer readable storage medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4181820A (en) 1977-04-29 1980-01-01 Franz Vertriebsgesellschaft Mbh Electric reverberation apparatus
US4955057A (en) 1987-03-04 1990-09-04 Dynavector, Inc. Reverb generator
US5040219A (en) 1988-11-05 1991-08-13 Mitsubishi Denki Kabushiki Kaisha Sound reproducing apparatus
US5131051A (en) * 1989-11-28 1992-07-14 Yamaha Corporation Method and apparatus for controlling the sound field in auditoriums
US5146507A (en) 1989-02-23 1992-09-08 Yamaha Corporation Audio reproduction characteristics control device
US5317104A (en) 1991-11-16 1994-05-31 E-Musystems, Inc. Multi-timbral percussion instrument having spatial convolution
US5555306A (en) 1991-04-04 1996-09-10 Trifield Productions Limited Audio signal processor providing simulated source distance control
US5621801A (en) 1993-06-11 1997-04-15 Yamaha Corporation Reverberation effect imparting system
US5740716A (en) 1996-05-09 1998-04-21 The Board Of Trustees Of The Leland Stanford Juior University System and method for sound synthesis using a length-modulated digital delay line
US6978027B1 (en) * 2000-04-11 2005-12-20 Creative Technology Ltd. Reverberation processor for interactive audio applications
US20060086237A1 (en) * 2004-10-26 2006-04-27 Burwen Technology, Inc. Unnatural reverberation
US7062337B1 (en) * 2000-08-22 2006-06-13 Blesser Barry A Artificial ambiance processing system
US7149314B2 (en) * 2000-12-04 2006-12-12 Creative Technology Ltd Reverberation processor based on absorbent all-pass filters

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1080759A (en) * 1992-07-02 1994-01-12 联华电子股份有限公司 Speech reverberation and tone color changing method
CN1589066A (en) * 2004-09-03 2005-03-02 威盛电子股份有限公司 Method and relative device for producing echo effect
CN1719512B (en) * 2005-07-15 2010-09-29 北京中星微电子有限公司 Digital audio frequency reverberation simulation system and method
CN100375149C (en) * 2005-08-19 2008-03-12 北京中星微电子有限公司 A reverberation generating circuit

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4181820A (en) 1977-04-29 1980-01-01 Franz Vertriebsgesellschaft Mbh Electric reverberation apparatus
US4955057A (en) 1987-03-04 1990-09-04 Dynavector, Inc. Reverb generator
US5040219A (en) 1988-11-05 1991-08-13 Mitsubishi Denki Kabushiki Kaisha Sound reproducing apparatus
US5146507A (en) 1989-02-23 1992-09-08 Yamaha Corporation Audio reproduction characteristics control device
US5131051A (en) * 1989-11-28 1992-07-14 Yamaha Corporation Method and apparatus for controlling the sound field in auditoriums
US5555306A (en) 1991-04-04 1996-09-10 Trifield Productions Limited Audio signal processor providing simulated source distance control
US5317104A (en) 1991-11-16 1994-05-31 E-Musystems, Inc. Multi-timbral percussion instrument having spatial convolution
US5621801A (en) 1993-06-11 1997-04-15 Yamaha Corporation Reverberation effect imparting system
US5740716A (en) 1996-05-09 1998-04-21 The Board Of Trustees Of The Leland Stanford Juior University System and method for sound synthesis using a length-modulated digital delay line
US6978027B1 (en) * 2000-04-11 2005-12-20 Creative Technology Ltd. Reverberation processor for interactive audio applications
US7062337B1 (en) * 2000-08-22 2006-06-13 Blesser Barry A Artificial ambiance processing system
US7149314B2 (en) * 2000-12-04 2006-12-12 Creative Technology Ltd Reverberation processor based on absorbent all-pass filters
US20060086237A1 (en) * 2004-10-26 2006-04-27 Burwen Technology, Inc. Unnatural reverberation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Author: M.R. Schroeder Title: Natural Sounding Artificial Reverberation Date: Oct. 9, 1961 Thirteenth Annual Fall Convnetion of the Audio Engineering Society. *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100172508A1 (en) * 2009-01-05 2010-07-08 Samsung Electronics Co., Ltd. Method and apparatus of generating sound field effect in frequency domain
US8615090B2 (en) * 2009-01-05 2013-12-24 Samsung Electronics Co., Ltd. Method and apparatus of generating sound field effect in frequency domain
US9245520B2 (en) 2009-10-21 2016-01-26 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reverberator and method for reverberating an audio signal
US10043509B2 (en) 2009-10-21 2018-08-07 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandtem Forschung E.V. Reverberator and method for reverberating an audio signal
US9747888B2 (en) 2009-10-21 2017-08-29 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reverberator and method for reverberating an audio signal
US20120035936A1 (en) * 2010-08-05 2012-02-09 Stmicroelectronics Asia Pacific Pte Ltd Information reuse in low power scalable hybrid audio encoders
US8489391B2 (en) * 2010-08-05 2013-07-16 Stmicroelectronics Asia Pacific Pte., Ltd. Scalable hybrid auto coder for transient detection in advanced audio coding with spectral band replication
US20120082319A1 (en) * 2010-09-08 2012-04-05 Jean-Marc Jot Spatial audio encoding and reproduction of diffuse sound
US9042565B2 (en) * 2010-09-08 2015-05-26 Dts, Inc. Spatial audio encoding and reproduction of diffuse sound
US20150332663A1 (en) * 2010-09-08 2015-11-19 Dts, Inc. Spatial audio encoding and reproduction of diffuse sound
US8908874B2 (en) * 2010-09-08 2014-12-09 Dts, Inc. Spatial audio encoding and reproduction
US9728181B2 (en) * 2010-09-08 2017-08-08 Dts, Inc. Spatial audio encoding and reproduction of diffuse sound
US20120057715A1 (en) * 2010-09-08 2012-03-08 Johnston James D Spatial audio encoding and reproduction
US20130301839A1 (en) * 2012-04-19 2013-11-14 Peter Vogel Instruments Pty Ltd Sound synthesiser

Also Published As

Publication number Publication date
CN102638757B (en) 2016-09-07
SG135058A1 (en) 2007-09-28
CN101034548A (en) 2007-09-12
CN101034548B (en) 2012-06-06
US20070195967A1 (en) 2007-08-23
EP1819197A2 (en) 2007-08-15
CN102638757A (en) 2012-08-15

Similar Documents

Publication Publication Date Title
US8351614B2 (en) Digital reverberations for audio signals
US8670570B2 (en) Environmental effects generator for digital audio signals
CN106875953B (en) Method and system for processing analog mixed sound audio
CN101689840B (en) Apparatus and method for artificial reverberation
Dahl et al. A reverberator based on absorbent all-pass filters
US7149314B2 (en) Reverberation processor based on absorbent all-pass filters
CN101714861B (en) Harmonics generation apparatus and method thereof
EP3026666B1 (en) Reverberant sound adding apparatus, reverberant sound adding method, and reverberant sound adding program
WO2006040727A2 (en) A system and a method of processing audio data to generate reverberation
US20060045283A1 (en) Method And Related Apparatus For Generating Audio Reverberation Effect
CN117693791A (en) Speech enhancement
JP2000163086A (en) Echo generating device
CN109195062B (en) Method and system for expanding sound field of audio equipment and audio equipment
WO2022048376A1 (en) Sound field expansion method and circuit, electronic device, and storage medium
Beltrán et al. Matlab implementation of reverberation algorithms
CN1589066A (en) Method and relative device for producing echo effect
CN109686348A (en) A kind of audio processing system restoring professional audio
KR20100137912A (en) Apparatus for generating reverberation
JP2542616Y2 (en) Reverberation device
EP4091339A1 (en) Method for bi-phasic separation and re-integration on mobile media devices
Khasmuri DESC 9115 Final Report
JPH0729600U (en) Reverberation device
Hong et al. The natural sound field effect for multimedia contents
JPH0619489A (en) Reverberation adding device
Thouta Mono to stereo synthesizer implementation on FPGA

Legal Events

Date Code Title Description
AS Assignment

Owner name: STMICROELECTRONICS ASIA PACIFIC PTE. LTD., SINGAPO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WU, YUAN;GEORGE, SAPNA;REEL/FRAME:019248/0001

Effective date: 20070417

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8