EP3201911B1 - Akustischer prozessor mit niedriger latenzzeit - Google Patents
Akustischer prozessor mit niedriger latenzzeit Download PDFInfo
- Publication number
- EP3201911B1 EP3201911B1 EP15782144.8A EP15782144A EP3201911B1 EP 3201911 B1 EP3201911 B1 EP 3201911B1 EP 15782144 A EP15782144 A EP 15782144A EP 3201911 B1 EP3201911 B1 EP 3201911B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sample rate
- rap
- sensor
- digital
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005236 sound signal Effects 0.000 claims description 26
- 238000000034 method Methods 0.000 claims description 12
- 238000005070 sampling Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 11
- 230000009467 reduction Effects 0.000 description 10
- 238000001914 filtration Methods 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000004888 barrier function Effects 0.000 description 2
- 101100458289 Drosophila melanogaster msps gene Proteins 0.000 description 1
- 230000005534 acoustic noise Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000001627 detrimental effect Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1785—Methods, e.g. algorithms; Devices
- G10K11/17855—Methods, e.g. algorithms; Devices for improving speed or power requirements
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
- G10K11/17821—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
- G10K11/17827—Desired external signals, e.g. pass-through audio such as music or speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1785—Methods, e.g. algorithms; Devices
- G10K11/17853—Methods, e.g. algorithms; Devices of the filter
- G10K11/17854—Methods, e.g. algorithms; Devices of the filter the filter being an adaptive filter
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17879—General system configurations using both a reference signal and an error signal
- G10K11/17881—General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
- G10K2210/30—Means
- G10K2210/301—Computational
- G10K2210/3051—Sampling, e.g. variable rate, synchronous, decimated or interpolated
Definitions
- This disclosure is directed to acoustic processing, and, more specifically, to a reconfigurable acoustic processor that is capable of running in real-time or near real-time.
- noise that is present in a listening environment nearly always compromises the experience of listening to audio through headphones.
- noise from the airplane produces unwanted acoustic waves, i.e., noise, that travel to the listener's ears, in addition to the audio program.
- Other examples include computer and air-conditioning noise of an office or house, vehicle and passenger noise in public or private transportation, or other noisy environments.
- Passive noise reduction refers to a reduction in noise caused by placing a physical barrier, which are commonly headphones or earplugs, between the ear cavity and the noisy outside environment. The amount of noise reduced depends on the quality of the barrier. In general, noise-reduction headphones having more mass provide higher passive noise reduction. Large, heavy headphones may be uncomfortable to wear for extended periods, however. For a given headphone, passive noise reduction works better to reduce the higher frequency noise, while low frequencies may still pass through a passive noise reduction system.
- Active noise reduction systems also called active noise cancellation (ANC) refers to the reduction of noise achieved by playing an anti-noise signal through headphone speakers.
- the anti-noise signal is generated as an approximation of the negative of the noise signal that would be in the ear cavity in absence of ANC.
- the noise signal is then neutralized when combined with the anti-noise signal.
- one or more sensors monitor ambient noise or noise in the earcups of headphones in real-time, then the system generates the anti-noise signal from the ambient or residual noise.
- the anti-noise signal may be generated differently depending on factors such as physical shape and size of the ANC system, (e.g., headphones, etc.), frequency response of the sensor and a transducer, e.g. speaker, latency of the transducer at various frequencies, sensitivity of the sensor, and placement of the transducers and sensors, for example.
- the variations in the above factors between different sensors and transducers (e.g., headphones) and even between the two ear cups of the same headphone system mean that optimal filter design for generating anti-noise also vary.
- Latency in processing an anti-noise signal prevents Active Noise Cancellation systems from operating efficiently. For instance, digitizing the sensor signals and processing the signal at rates common in audio processing, such as 44.1 KHz or 48 KHz introduces large latency. Because performance of an acoustic processor, such as an ANC, depends on the ability to detect noise and produce the anti-noise signal soon enough in time to cancel the noise, a large latency is detrimental to acoustic noise cancellation processing.
- Document WO2012166273 discloses a personal audio device, such as a wireless telephone, that includes an adaptive noise canceling (ANC) circuit that adaptively generates an anti-noise signal from a reference microphone signal that measures the ambient audio and an error microphone signal that measures the output of an output transducer plus any ambient audio at that location and injects the anti-noise signal at the transducer output to cause cancellation of ambient audio sounds.
- ANC adaptive noise canceling
- Document US2011007907 discloses an adaptive active noise cancellation apparatus that performs a filtering operation in a first digital domain and performs adaptation of the filtering operation in a second digital domain.
- Document GB2455828 discloses a system and method comprising: an adaptive filter for receiving a digital noise signal at a first sample rate and for generating a noise cancellation signal; and control circuitry, for generating a control signal at a second sample rate for application to the adaptive filter so as to adjust a filter characteristic.
- Document US2014112491 discloses a method and apparatus for active noise canceling.
- Document US2011001646 discloses a system and method of emulating characteristics of an output signal of a first analog-to-digital converter by a second analog-to-digital converter employing signal processing.
- Embodiments of the invention are directed to a digital acoustic processor, such as a Reconfigurable Acoustic Processor (RAP) for use in audio systems that use digitized sensor inputs.
- a digital acoustic processor such as a Reconfigurable Acoustic Processor (RAP) for use in audio systems that use digitized sensor inputs.
- RAP Reconfigurable Acoustic Processor
- ANC Active Noise Cancellation
- the sensor senses ambient noise but does not appreciably sense signal produced by a transducer, such as a speaker.
- a feed-forward ANC system 10 includes a sensor 12 that senses ambient noise, but does not monitor the signal directly from a transducer 14.
- the output from the sensor 12 is filtered in a feed-forward filter 16 and the filter output coupled to a feed-forward mixer 18, where the filtered signal is mixed with an input audio signal.
- the filtered signal from the filter 16 is an anti-noise signal produced from the output of the sensor 12.
- the output of the transducer 14 which is a combination of an input signal mixed with the filtered, anti-noise signal, has less noise than if there were no anti-noise signal generated.
- the sensor In feedback ANC, the sensor is placed in a position to sense the total audio signal present in the ear cavity. In other words, the sensor senses the sum of both the ambient noise as well as the audio played back by the transducer.
- a sensor 32 directly monitors output from the transducer 24.
- the output from the sensor 32 is mixed with the audio input signal in a feedback mixer 30, and then the combined signal sent to a feedback filter 34 where the combined signal is filtered to produce an anti-noise signal.
- This anti-noise signal from the filter 34 is mixed with the original audio signal in a mixer 28, the combined output of which is then fed to the transducer 24.
- the feedback ANC system 20 also reduces the noise heard by the listener of the speaker 24.
- a combined feed-forward and feedback ANC system uses two or more sensors, the first position for sensors being in the feed-forward path as illustrated in Fig. 1 , and the second position of sensors being in the feedback path as illustrated in Fig. 2 .
- a combined feed-forward and feedback ANC system 40 is illustrated in Fig. 3 , and includes sensor positions 42, 52, and one or multiple transducers at the position illustrated in Fig. 44.
- a signal sensed from the feedback sensor(s) at position 52 is mixed in a feedback mixer 50 and the combined signal filtered by a feedback filter 54.
- a signal sensed from the feed-forward sensors(s) at position 42 is filtered in a feed-forward filter 46 and the filtered signal combined with the incoming audio signal in a feed-forward mixer 48.
- the output of the transducer(s) at position 44 has reduced noise by the filtering and mixing operations.
- embodiments of the invention use a selectable system to cover many different applications, as described in detail below.
- Typical audio processing rates are 44.1 kHz or 48 kHz, which is based on the frequency range of typical human hearing. At these sample rates, the sampling time period is around 20 ⁇ s.
- the digitizing and the filtering in ANC systems invariably take multiple samples. At these rates, the resulting delay is in order of hundreds of microseconds. Because any delay in processing degrades generation of the anti-noise signal, this significantly lower ANC performance. This usually manifests itself as limiting the maximum noise frequency that may be cancelled.
- Fig. 4 is a block diagram of an audio system 100 including a low-latency or ultra-low latency acoustic processor.
- the acoustic processor may be reconfigurable, and is referred to as a Reconfigurable Audio Processor (RAP) 150.
- RAP Reconfigurable Audio Processor
- the audio system in Fig. 4 is divided into three general portions - an analog portion 102, a digital portion 104 running at a rate of an Analog to Digital Converter (ADC), and a digital portion 106 running at a standard audio sample rate of 48 KHz. These portions may also be referred to as domains.
- ADC Analog to Digital Converter
- the analog portion 102 does not require a clock, and typically signals in this portion are generally continuous, analog, signals.
- a transducer or speaker 110 may produce an analog audio signal such as from headphones or other speakers.
- a sensor such as a digital microphone 112 automatically generates a digital output from an analog input signal, while a standard analog sensor, such as microphone 114, may be combined with an ADC 124 to generate a digital signal from the analog sensor 114.
- a sensor 116 such as a microphone, may be placed in the feedback position, and coupled to an ADC 126.
- the ADCs 124, 126 may use sigma-delta processing, for example.
- the ADCs 124, 126 may be of Pulse Code Modulation (PCM) or Successive Approximation Register (SAR) type.
- PCM Pulse Code Modulation
- SAR Successive Approximation Register
- a single sensor 112, 114, 116 may be used for multiple purposes, such as sampling ambient noise while also serving as an input microphone for a telephone, for example.
- One or more filters 128 may be present to filter outputs from the ADCs 124, 126, but are not required in all embodiments.
- a Digital Signal Processor (DSP) 130 or other audio source operates in the digital portion 106 and at a frequency of a standard audio sample rate.
- the operating frequency of the digital portion 106 of the audio system 100 is 48 KHz.
- the operating frequency of the digital portion 104 may operate from a low of approximately 50 KHz to a rate of approximately 100 MHz, and preferably within a range such as 2-100 MHz.
- the digital portion 104 may operate at 50 KHz, 96 KHz, within a range of hundreds of KHz, at frequencies in the low MHz range, such as 1-6, in the 10s of MHz range, such as 10-20 MHz, up to approximately 100MHz.
- each of the components of the particular domain operates at the frequency of the domain.
- the ADCs 124, 126 operate at the same frequency as the audio processor or RAP 150. This is quite different than previous systems that typically use decimation filters to downsample sensor signals before processing in an audio processor.
- An interpolator 140 converts audio signals from the DSP 130, operating at 48 KHz, to audio signals operating at 3 MHz or 6 MHz as an input signal to the RAP 150.
- a decimator 144 which need not be present in all audio systems 100, converts signals from the RAP 150 at, for instance 3 or 6 MHz, to the operating frequency of the digital portion 106.
- the resulting latency of the RAP 150 is extremely low, for example less than 2.5 ⁇ s, and preferably less than 0.5 ⁇ s, because the RAP 150 processes signals at the same rate as they are generated by the sensors, or microphones 112, 114, 116, whether or not the sensors are digital microphones or whether the sensor signals are converted by the ADCs 124, 126 to digital signals.
- the RAP 150 controls acoustic signals, for example emitted from the transducer 110, in real time.
- the RAP 150 is structured to operate on raw sensor samples from the microphones 112, 114, and/or 116 without any intermediate processing, like a decimation filter or other sample rate converters. This allows responding to microphone signals with zero or near zero computational delay in the RAP 150, which enables implementation of real-time audio processing algorithms.
- the effect of using real-time sensor sampling is that delay from the decimation filter of previous systems is eliminated, which in turn dramatically increases the responsiveness of the control loop.
- the sample rate of the digital portion 104 may be varied according to a sample rate of the digital sensor 112, or the ADC 124 coupled to the analog sensor 114. There is a linear tradeoff between the sample rate and the amount of processing that may be processed per sample.
- Fig. 5 is a functional block diagram of an example reconfigurable acoustic processor (RAP) 250, which may be an embodiment of the RAP 150 of Fig. 4 .
- the RAP 250 of Fig. 5 includes six chains of bi-quadratic, or bi-quad filters, BQ0-BQ6, the functions of which are described below.
- Bi-quad filters are well known in electrical processing, especially audio processing.
- Bi-quad filters typically include 2 zeros and 2 poles.
- the bi-quad chains BQ0-BQ6 each include a cascade of bi-quad filters. In some embodiments the chains BQ0-BQ6 may include 4, 6, 8, 12, or 16 cascaded bi-quad filters, with 8 being preferred.
- the bi-quad filter chains BQ0-BQ6 are programmable, so that their filtering values may be changed according to a desired implementation. They may also be set to a pass-through, or unity, setting, which means they do not appreciably affect the signal passing through them.
- each bi-quad filter chain BQ0-BQ6 Connected to each bi-quad filter chain BQ0-BQ6 are gain units, M0-M6, respectively, with an additional gain unit M7, the purpose of which is described below.
- the gain units M0-M7 are programmable, in that the amount of gain produced between their inputs and outputs is controllable.
- Output of particular bi-quad filter chains BQ0-BQ6 may be controlled by its coupled gain unit M0-M6. Setting the gain of any of the gain units M0-M6 to zero effectively turns off that particular circuit branch. It is not strictly necessary to maintain a one-to-one relationship between bi-quad filter chains and gain units, but maintaining that relationship provides flexibility for setting up the RAP.
- the RAP 250 of Fig. 5 shows a single audio channel. For two or more channels, such as for stereo processing, additional hardware would be used.
- Also coupled to the RAP 250 may include inputs from digital sensors, 212, 214, which may be microphones, a decimator 218, and an interpolator 220. Either or both of the sensor inputs 212, 214 may be created by having an analog microphone coupled to an ADC.
- the decimator 218 and interpolator 220 operate as described with reference to Fig. 4 .
- the RAP 250 accepts input from the sensor 212 at bi-quad filter chains BQ0 and BQ3, and accepts input from the sensor 214 at bi-quad filter chains BQ1 and BQ5.
- An audio signal is accepted at the bi-quad filter chains BQ2 and BQ6.
- an audio signal is not strictly necessary. For example, in noise cancellation headphones for hunters or industry, no audio signal may be present.
- the gain unit M7 may be used as a controllable gain for the processed audio signal before its final combination in a combiner A2 with the unprocessed audio signal from the interpolator 220.
- the gain unit M7 may be controlled to increase its gain gradually, so that noise cancelation or other processing may be added to the unprocessed audio signal gradually, to eliminate pops or other fast changes in the output audio signal, which may be uncomfortable for a listener.
- Adders or combiners A0, A1, and A2 combine intermediate signal outputs from the bi-quad filter chains, as illustrated in Fig. 5 .
- the RAP 350 operates at 49.152 MHz, which is a standard rate for audio processing.
- the input sample rate is typically 3.072 Msps, and the filter portion may also operate at the same rate.
- the gain unit M7 is set to 0, i.e., turned off, while the audio signal from the interpolator is filtered by the bi-quad filter chain BQ6. Controlling the gain unit M6 controls an output signal level of the filtered audio signal, which is sent to the transducer 210, which may be a speaker, or other transducer output.
- the RAP 250 may be configured as a feed-forward/feedback ANC, having the same functionality as the feed-forward and feed-back ANC circuit illustrated in Fig. 3 .
- Fig. 6 illustrates how the RAP 250 is set for such a configuration.
- the gain units M0 and M5 are set to 0, which is illustrated in Fig. 6 as having an "x", which indicates they do not contribute anything to the processing.
- the gain units M2, M4, M6 and M7 are set to 1.
- Gain units M1 and M3 are set to -1, which means their outputs are subtracted.
- Bi-quad filter chains BQ1, BQ2, and BQ6 are set to pass-through settings. With reference to Figs. 3 and 6 , the Bi-quad filter chain BQ3 has the role of the feed-forward filter 46, while Bi-quad filter chain BQ4 has the role of the feedback filter 54.
- the RAP 250 may be configured to perform most any type of audio processing.
- the RAP 250 may be configured as an ANC processor for active noise cancellation headphones, in either feedback, feed-forward, or combined feed-forward feedback configurations.
- the RAP 250 may be used for active noise cancellation in phone handsets by using input from the handset microphone and producing audio output for one or more speakers in the handset.
- the RAP 250 may further enhance an input audio signal while simultaneously performing noise cancellation.
- the RAP 250 may also be used for ambient sound enhancement by accepting an ambient sound at one of the microphone inputs, modifying it through one or more bi-quad filter chains, setting an appropriate gain level, then outputting the modified ambient signal.
- the RAP 250 of Fig. 6 or RAP 150 of Fig. 5 includes functions, processes, or operations for modifying an audio signal input.
- these functions may be implemented by specially formed hardware circuits, as programmed functions operating on a general-purpose or special-purpose processor, such as a Digital Signal Processor (DSP), or may be implemented in Field Programmable Gate Arrays (FPGAs) or Programmable Logic Devices (PLDs). Other variations are also possible.
- DSP Digital Signal Processor
- FPGAs Field Programmable Gate Arrays
- PLDs Programmable Logic Devices
- Fig. 7 is a functional block diagram of components of an example reconfigurable acoustic processor of Fig. 4 , according to embodiments of the invention.
- a RAP 350 includes a bi-quad engine 310 and a multiplier accumulator 320.
- the multiplier accumulator 320 implements all of the multipliers and adders in the functional block diagram of Figs. 5 and 6 . In one embodiment there are seven multiply-add operations per sample.
- the bi-quad engine 310 includes inputs from one or more sensors, such as microphones, as well as an input of the audio signal to be processed.
- the biquad engine may also accept input from the multiplier-accumulator output. The inputs from the sensors are clocked at the same rate as the biquad engine.
- the bi-quad engine 310 may be sized to operate on 16 bi-quad filters.
- a bi-quad descriptor section 330 contains filter values for implementing the bi-quad filter chains, while bi-quad state memory 332 is memory for storing intermediate values during bi-quad processing.
- a gain table 322 stores values for the gain units, while feathering control, such as provided by gain unit M7 of Fig. 5 , is provided separately by a feathering control 334.
- the RAP 350 is programmed and configured by writing particular values into the bi-quad descriptors 330 and gain tables 322, as illustrated in Fig. 7 .
- filters may be chosen to enhance, rather than reduce certain sounds or noises.
- parameters instead of bi-quad chain filter parameters chosen for their ability to reduce sounds sensed by a particular microphone, as described above, parameters may be chosen that enhance particular sounds.
- a person may be using noise cancellation headphones in a noisy work environment with a variety of rumbling machinery, but still wants to be able to speak to a co-worker without removing the noise reducing headphones.
- the adaptive filter coefficients when microphones detected noise in the vocal band, different parameters may be automatically loaded to the RAP system that enhanced the voice of the co-worker.
- the listener would have noise-canceling headphones that adaptively enhanced particular sounds. Sounds such as voices, audio television signals, and traffic, for example, may be enhanced.
- the standard filtering coefficients could again be dynamically loaded into the filters of the RAP system.
- Embodiments of the invention may be incorporated into integrated circuits such as sound processing circuits, or other audio circuitry.
- the integrated circuits may be used in audio devices such as headphones, mobile phones, portable computing devices, sound bars, audio docks, amplifiers, speakers, etc.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Circuit For Audible Band Transducer (AREA)
Claims (10)
- Rekonfigurierbares Geräuschunterdrückungssystem (100), umfassend:einen Interpolator (140) zum Umwandeln eines digitalen Audiosignals, das von einem digitalen Signalprozessor (130) erzeugt wird, von einer ersten Abtastrate von 48 kHz in eine zweite Abtastrate von 3 oder 6 MHz;mindestens einen Sensor (112; 114; 116; 212; 214), der ein Sensor-Rohsignal mit der zweiten Abtastrate erzeugt; undeinen rekonfigurierbaren Akustikprozessor (reconfigurable acoustic processor, RAP) (150; 250), der mit dem Interpolator (140) und dem mindestens einen Sensor (112; 114; 116; 212; 214) gekoppelt ist, mit der zweiten Abtastrate arbeitet und mehrere programmierbare Filter (BQ0-BQ6), mehrere steuerbare Verstärkungsstufen (M0-M6), die mit den jeweiligen der mehreren programmierbaren Filter gekoppelt sind, Addierer (A0-A2), die aufgebaut sind, um Ausgänge der mehreren steuerbaren Verstärkungsstufen (M0-M6) zu kombinieren, und einen Audioausgang (110; 210) aufweist, der mit mindestens einem der Addierer (A0-A2) gekoppelt ist, um ein Ausgangsaudiosignal auszugeben, das durch das Sensor-Rohsignal modifiziert ist, das von dem RAP (150; 250) von dem mindestens einen Sensor (112; 114; 116; 212; 214) ohne jegliche Zwischenverarbeitung in Echtzeit mit einer maximalen Rechenverzögerung von 2,5 us empfangen wird.
- Rekonfigurierbares Geräuschunterdrückungssystem (100) nach Anspruch 1, wobei der mindestens eine Sensor ein digitales Abtastmikrofon (112; 212) umfasst, das mit der zweiten Abtastrate arbeitet.
- Rekonfigurierbares Geräuschunterdrückungssystem (100) nach Anspruch 1 oder 2, wobei der mindestens eine Sensor ein analoges Mikrofon (114, 116; 214) umfasst, das mit einem Analog-Digital-Wandler (analog to digital converter, ADC) (124, 126), gekoppelt ist, der mit der zweiten Abtastrate arbeitet.
- Rekonfigurierbares Geräuschunterdrückungssystem (100) nach Anspruch 3, wobei der ADC (124, 126) eingerichtet ist, eine Sigma-Delta-Verarbeitung durchzuführen.
- Rekonfigurierbares Geräuschunterdrückungssystem (100) nach Anspruch 1, wobei die programmierbaren Filter eingerichtet sind, um während des Betriebs des Geräuschunterdrückungssystems programmiert zu werden; und/oder zumindest einige der mehreren steuerbaren Verstärkungsstufen eingerichtet sind, um während des Betriebs des Geräuschunterdrückungssystems aktualisiert zu werden.
- Verfahren zum Betreiben eines rekonfigurierbaren Akustikprozessors (reconfigurable acoustic processor, RAP) (150; 250), umfassend:Umwandeln eines digitalen Audiosignals, das von einem digitalen Signalprozessor (130) erzeugt wird, von einer ersten Abtastrate von 48 kHz in eine zweite Abtastrate von 3 oder 6 MHz, die höher ist als die erste Abtastrate;Empfangen eines oder mehrerer Sensor-Rohsignale einer überwachten Umgebung mit der zweiten Abtastrate durch einen oder mehrere Sensoren (112; 114; 116; 212; 214);Konfigurieren eines Filterparameterabschnitts von mehreren programmierbaren Filtern in dem RAP (150; 250), der mit der zweiten Abtastrate arbeitet und das eine oder die mehreren Sensor-Rohsignale von dem mindestens einen Sensor (112; 114; 116; 212; 214) ohne jegliche Zwischenverarbeitung in Echtzeit und mit einer maximalen Rechenverzögerung von 2,5 us empfängt;Konfigurieren mehrerer steuerbarer Verstärkungsstufen in dem RAP (150; 250), so dass mindestens einige der mehreren steuerbaren Verstärkungsstufen jeweils mit mindestens einigen der mehreren programmierbaren Filter gekoppelt sind; undMischen, bei der zweiten Abtastrate, ausgewählter Ausgänge der mehreren steuerbaren Verstärkungsstufen mit dem digitalen Audiosignal, um einen Audiosignalausgang zu erzeugen, der durch das eine oder die mehreren Sensor-Rohsignale modifiziert ist, die von dem RAP (150; 250) empfangen werden.
- Verfahren nach Anspruch 6, ferner umfassend:
Ausgeben des Audiosignalausgangs an einen Wandler (110; 210) . - Verfahren nach Anspruch 6, ferner umfassend:
Senden des digitalen Audiosignals an den digitalen Signalprozessor (130) mit der ersten Abtastrate. - Verfahren nach Anspruch 6, ferner umfassend:
Modifizieren der Konfiguration des Filterparameterabschnitts der mehreren programmierbaren Filter während des Betriebs des RAP (150; 250). - Verfahren nach Anspruch 6, wobei der eine oder die mehreren Sensoren mindestens ein digitales Abtastmikrofon (112; 212) umfassen, das mit der zweiten Abtastrate arbeitet.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462057481P | 2014-09-30 | 2014-09-30 | |
US201414553644A | 2014-11-25 | 2014-11-25 | |
PCT/US2015/053187 WO2016054186A1 (en) | 2014-09-30 | 2015-09-30 | Acoustic processor having low latency |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3201911A1 EP3201911A1 (de) | 2017-08-09 |
EP3201911B1 true EP3201911B1 (de) | 2024-06-05 |
Family
ID=54337376
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15782144.8A Active EP3201911B1 (de) | 2014-09-30 | 2015-09-30 | Akustischer prozessor mit niedriger latenzzeit |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP3201911B1 (de) |
JP (1) | JP2017530413A (de) |
KR (1) | KR20170084054A (de) |
CN (1) | CN107112003B (de) |
TW (2) | TWI672689B (de) |
WO (1) | WO2016054186A1 (de) |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2647002B1 (de) | 2010-12-03 | 2024-01-31 | Cirrus Logic, Inc. | Aufsichtssteuerung eines adaptiven rauschunterdrückers bei einer persönlichen audiovorrichtung |
US9318094B2 (en) | 2011-06-03 | 2016-04-19 | Cirrus Logic, Inc. | Adaptive noise canceling architecture for a personal audio device |
US8958571B2 (en) | 2011-06-03 | 2015-02-17 | Cirrus Logic, Inc. | MIC covering detection in personal audio devices |
US9824677B2 (en) | 2011-06-03 | 2017-11-21 | Cirrus Logic, Inc. | Bandlimiting anti-noise in personal audio devices having adaptive noise cancellation (ANC) |
US9318090B2 (en) | 2012-05-10 | 2016-04-19 | Cirrus Logic, Inc. | Downlink tone detection and adaptation of a secondary path response model in an adaptive noise canceling system |
US9123321B2 (en) | 2012-05-10 | 2015-09-01 | Cirrus Logic, Inc. | Sequenced adaptation of anti-noise generator response and secondary path response in an adaptive noise canceling system |
US9532139B1 (en) | 2012-09-14 | 2016-12-27 | Cirrus Logic, Inc. | Dual-microphone frequency amplitude response self-calibration |
US9414150B2 (en) | 2013-03-14 | 2016-08-09 | Cirrus Logic, Inc. | Low-latency multi-driver adaptive noise canceling (ANC) system for a personal audio device |
US9666176B2 (en) | 2013-09-13 | 2017-05-30 | Cirrus Logic, Inc. | Systems and methods for adaptive noise cancellation by adaptively shaping internal white noise to train a secondary path |
US9620101B1 (en) | 2013-10-08 | 2017-04-11 | Cirrus Logic, Inc. | Systems and methods for maintaining playback fidelity in an audio system with adaptive noise cancellation |
US10219071B2 (en) | 2013-12-10 | 2019-02-26 | Cirrus Logic, Inc. | Systems and methods for bandlimiting anti-noise in personal audio devices having adaptive noise cancellation |
US9478212B1 (en) | 2014-09-03 | 2016-10-25 | Cirrus Logic, Inc. | Systems and methods for use of adaptive secondary path estimate to control equalization in an audio device |
GB2541976A (en) * | 2015-07-21 | 2017-03-08 | Cirrus Logic Int Semiconductor Ltd | Hybrid finite impulse response filter |
JP6964581B2 (ja) | 2015-08-20 | 2021-11-10 | シーラス ロジック インターナショナル セミコンダクター リミテッド | 固定応答フィルタによって部分的に提供されるフィードバック応答を有するフィードバック適応雑音消去(anc)コントローラおよび方法 |
US10013966B2 (en) | 2016-03-15 | 2018-07-03 | Cirrus Logic, Inc. | Systems and methods for adaptive active noise cancellation for multiple-driver personal audio device |
US10609468B2 (en) | 2016-09-16 | 2020-03-31 | Avatronics Sarl | Active noise cancellation system for headphone |
TWI759652B (zh) * | 2017-03-09 | 2022-04-01 | 美商艾孚諾亞公司 | 用於處理聲學信號的電子網路、用於即時聲學處理的方法及主動雜訊消除音訊裝置 |
EP3627493B1 (de) * | 2017-03-30 | 2024-05-15 | Bose Corporation | Kompensation und automatische verstärkungsregelung bei aktiven rauschminderungsvorrichtungen |
US10553195B2 (en) | 2017-03-30 | 2020-02-04 | Bose Corporation | Dynamic compensation in active noise reduction devices |
US10614790B2 (en) | 2017-03-30 | 2020-04-07 | Bose Corporation | Automatic gain control in an active noise reduction (ANR) signal flow path |
US10580398B2 (en) | 2017-03-30 | 2020-03-03 | Bose Corporation | Parallel compensation in active noise reduction devices |
JP7282761B2 (ja) * | 2017-10-31 | 2023-05-29 | グーグル エルエルシー | 低遅延デシメータ及びインターポレータフィルタ |
CN108419162A (zh) * | 2018-02-09 | 2018-08-17 | 万魔声学科技有限公司 | 主动降噪方法、主动降噪装置和降噪耳机 |
US11223891B2 (en) * | 2020-02-19 | 2022-01-11 | xMEMS Labs, Inc. | System and method thereof |
BR112022018189A2 (pt) * | 2020-03-13 | 2022-10-25 | Fraunhofer Ges Forschung | Aparelho e método para renderizar uma cena de som usando estágios de encadeamento |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5685308A (en) * | 1994-08-05 | 1997-11-11 | Acuson Corporation | Method and apparatus for receive beamformer system |
US7933295B2 (en) * | 1999-04-13 | 2011-04-26 | Broadcom Corporation | Cable modem with voice processing capability |
TWI315159B (en) * | 2004-05-12 | 2009-09-21 | Chou Yuan Fan | The frequency response shaping analog hearing aid |
JP4882773B2 (ja) * | 2007-02-05 | 2012-02-22 | ソニー株式会社 | 信号処理装置、信号処理方法 |
GB0725108D0 (en) * | 2007-12-21 | 2008-01-30 | Wolfson Microelectronics Plc | Slow rate adaption |
SG163453A1 (en) * | 2009-01-28 | 2010-08-30 | Creative Tech Ltd | An earphone set |
US7928886B2 (en) * | 2009-07-01 | 2011-04-19 | Infineon Technologies Ag | Emulation of analog-to-digital converter characteristics |
US8737636B2 (en) * | 2009-07-10 | 2014-05-27 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation |
US8940994B2 (en) * | 2010-09-15 | 2015-01-27 | Avedis Zildjian Co. | Illuminated non-contact cymbal pickup |
EP2647002B1 (de) * | 2010-12-03 | 2024-01-31 | Cirrus Logic, Inc. | Aufsichtssteuerung eines adaptiven rauschunterdrückers bei einer persönlichen audiovorrichtung |
US20120155666A1 (en) * | 2010-12-16 | 2012-06-21 | Nair Vijayakumaran V | Adaptive noise cancellation |
US20120300960A1 (en) * | 2011-05-27 | 2012-11-29 | Graeme Gordon Mackay | Digital signal routing circuit |
US9318094B2 (en) * | 2011-06-03 | 2016-04-19 | Cirrus Logic, Inc. | Adaptive noise canceling architecture for a personal audio device |
US9082392B2 (en) * | 2012-10-18 | 2015-07-14 | Texas Instruments Incorporated | Method and apparatus for a configurable active noise canceller |
CN103402156B (zh) * | 2013-07-25 | 2016-05-25 | 瑞声科技(南京)有限公司 | 声学系统 |
-
2015
- 2015-09-30 KR KR1020177011938A patent/KR20170084054A/ko unknown
- 2015-09-30 TW TW104132165A patent/TWI672689B/zh active
- 2015-09-30 TW TW108129871A patent/TWI734176B/zh active
- 2015-09-30 WO PCT/US2015/053187 patent/WO2016054186A1/en active Application Filing
- 2015-09-30 JP JP2017518156A patent/JP2017530413A/ja active Pending
- 2015-09-30 EP EP15782144.8A patent/EP3201911B1/de active Active
- 2015-09-30 CN CN201580064466.0A patent/CN107112003B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
CN107112003A (zh) | 2017-08-29 |
EP3201911A1 (de) | 2017-08-09 |
KR20170084054A (ko) | 2017-07-19 |
TW201944390A (zh) | 2019-11-16 |
TWI734176B (zh) | 2021-07-21 |
WO2016054186A1 (en) | 2016-04-07 |
TWI672689B (zh) | 2019-09-21 |
JP2017530413A (ja) | 2017-10-12 |
TW201626361A (zh) | 2016-07-16 |
CN107112003B (zh) | 2021-11-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3201911B1 (de) | Akustischer prozessor mit niedriger latenzzeit | |
US10096312B2 (en) | Noise cancellation system | |
TWI759652B (zh) | 用於處理聲學信號的電子網路、用於即時聲學處理的方法及主動雜訊消除音訊裝置 | |
US9807503B1 (en) | Systems and methods for use of adaptive secondary path estimate to control equalization in an audio device | |
US10219071B2 (en) | Systems and methods for bandlimiting anti-noise in personal audio devices having adaptive noise cancellation | |
JP6389232B2 (ja) | パーソナルオーディオデバイスのための短待ち時間マルチドライバ適応雑音消去(anc)システム | |
US10997960B2 (en) | Acoustic processor having low latency | |
GB2455828A (en) | Noise cancellation system with adaptive filter and two different sample rates | |
WO2009081193A1 (en) | Noise cancelling system with adaptive high-pass filter | |
WO2016198481A2 (en) | Hybrid finite impulse response filter | |
US20180047410A1 (en) | Signal Processor with side-tone noise reduction for a headset | |
GB2541976A (en) | Hybrid finite impulse response filter | |
KR20210149857A (ko) | 액티브 노이즈 소거 시스템들 및 방법들을 위한 윈드 노이즈 억제 | |
CN114787911A (zh) | 耳戴式播放设备的噪声消除系统和信号处理方法 | |
CN111696512A (zh) | 双二阶前馈式主动抗噪系统及处理器 | |
GB2455823A (en) | Active noise cancellation filter cut-off frequency adjusted in accordance with magnitude of filter output signal | |
US10013966B2 (en) | Systems and methods for adaptive active noise cancellation for multiple-driver personal audio device | |
CN114155827A (zh) | 双二阶错误量控制的反馈式主动抗噪系统 | |
Wang et al. | Design of Effective Noise Cancellation Circuits in Acoustic |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170428 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: AVNERA CORPORATION |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: AVNERA CORPORATION |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20210428 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20240125 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20240223 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015088908 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |