EP2375408B1 - Verfahren zur Anpassung der Rauschreduktion und System zur Audiobereitstellung mit Rauschreduktion - Google Patents

Verfahren zur Anpassung der Rauschreduktion und System zur Audiobereitstellung mit Rauschreduktion Download PDF

Info

Publication number
EP2375408B1
EP2375408B1 EP10166978.6A EP10166978A EP2375408B1 EP 2375408 B1 EP2375408 B1 EP 2375408B1 EP 10166978 A EP10166978 A EP 10166978A EP 2375408 B1 EP2375408 B1 EP 2375408B1
Authority
EP
European Patent Office
Prior art keywords
signal
noise
audio signal
noise reducing
altered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10166978.6A
Other languages
English (en)
French (fr)
Other versions
EP2375408A2 (de
EP2375408A3 (de
Inventor
Jan Abildgaard Pedersen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harman Becker Gepkocsirendszer Gyarto Kft
Original Assignee
Harman Becker Gepkocsirendszer Gyarto Kft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harman Becker Gepkocsirendszer Gyarto Kft filed Critical Harman Becker Gepkocsirendszer Gyarto Kft
Publication of EP2375408A2 publication Critical patent/EP2375408A2/de
Publication of EP2375408A3 publication Critical patent/EP2375408A3/de
Application granted granted Critical
Publication of EP2375408B1 publication Critical patent/EP2375408B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17827—Desired external signals, e.g. pass-through audio such as music or speech
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785—Methods, e.g. algorithms; Devices
    • G10K11/17857—Geometric disposition, e.g. placement of microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17879—General system configurations using both a reference signal and an error signal
    • G10K11/17883—General system configurations using both a reference signal and an error signal the reference signal being derived from a machine operating condition, e.g. engine RPM or vehicle speed
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10—Applications
    • G10K2210/128—Vehicles
    • G10K2210/1282—Automobiles
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30—Means
    • G10K2210/301—Computational
    • G10K2210/3045—Multiple acoustic inputs, single acoustic output
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30—Means
    • G10K2210/301—Computational
    • G10K2210/3046—Multiple acoustic inputs, multiple acoustic outputs
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30—Means
    • G10K2210/301—Computational
    • G10K2210/3056—Variable gain

Definitions

  • the present invention relates to a method of adapting noise reduction when providing an audio signal and in particular in an environment, such as a vehicle, where the noise contents and noise level changes over time.
  • Usual noise reduction relies on a determination/estimation of the noise and subsequently "subtracting" the noise signal from the desired audio signal or adding the inverted noise signal thereto.
  • the noise may be directly determined using sensors, such as microphones, or may be estimated, such as by determining the rpm of an engine and there from estimating the actual noise generated. In the latter example, a mathematical equation or a look-up table may be used for estimating the noise from the rpm determined.
  • the invention relates to a system for outputting an altered audio signal, the system comprising:
  • an altered audio signal is an audio signal having one component being the audio signal to be provided to e.g. a listener and another component which is adapted to or desired to counteract or cancel out at least part of an audible noise present at the listener.
  • an audio signal may be any type of signal, usually representing music, speech, rhythms, discussions, narrations, shows, or the like.
  • the audio signal may be received from an external source, such as a wireless signal received by an antenna, a cell phone or the like, an optically transmitted signal detected by an optical detector, or may be delivered by a local or internal source, such as from a CD, DVD, tape recorder, MP3/4 player, hard drive memory or a memory of any other type, such as a memory unit of a cell phone, a USB memory unit, flash memory, a RAM/ROM/PROM/EPROM/EEPROM or the like.
  • the means for providing or receiving an audio signal may be adapted to derive the signal from any type of memory or storage unit and/or from an external source using an antenna or other means adapted to receive a wireless or optically transmitted signal.
  • a noise reducing signal is a signal which, when output, acts to counteract, extinguish and/or reduce audible noise.
  • the outputting of the signal is the feeding of the signal to a loudspeaker or woofer.
  • a noise reducing signal may be provided or generated in a number of manners.
  • the noise may be predicted or otherwise known, whereby the signal may be generated without any determination/detection or measurement of the actual noise.
  • the noise reducing signal is generated on the basis of a determination, sensing or estimation of the actual noise.
  • Determining, sensing or estimating noise may be performed in a number of manners depending on whether the noise source is known and/or available. If the noise source is available, direct measurement of the noise may be performed at, in or on the noise source.
  • the noise output or generated may be determined/estimated/approximated using other types or features of the noise source.
  • One example is the noise generated by an engine, which may be determined/estimated/approximated based on a determination of the RPM of the engine.
  • a mathematical model, or a look-up-table may be used for generating the actual noise-reducing signal.
  • the noise may be determined indirectly, such as using force/vibration detection.
  • Wind or tyre noise of a vehicle may be estimated on the basis of a velocity of the vehicle.
  • Any type of sensors may be used, based on any suitable measuring technique, such as optical measurements, accelerometers, position sensors, rotation sensors, strain gauges, or the like.
  • a more general approach is to determine or sense the noise directly, such as using a microphone, accelerometer or the like. In this manner, knowledge of the noise source is not required, and noise from several sources may more easily be determined/detected. This also has the advantage that noise may be sensed/detected at different positions. In this situation, the sensed sound may be a combination of the audio signal and the noise, whereby it may be desired to subtract the audio signal to derive the noise. This is standard technology for a skilled person. This is described in further detail further below.
  • noise from the engine may be modeled based on e.g. a rpm-determination and wind noise and/or tire noise may be determined directly, such as using a microphone and subtracting the audio signal detected as well as engine noise.
  • the noise reducing signal is provided which describes the noise and which, when added to an audio signal and provided to e.g. a loudspeaker, will act to counter-act the noise and thus reduce or remove the apparent noise.
  • the noise reducing signal may be an inverted noise signal. If a sufficiently small delay is seen between determination/sensing of the noise signal and the outputting of the inverted signal, the outputting of this inverted signal will act to reduce the noise.
  • the inverted noise signal may, at least at some frequencies, act to amplify the noise, whereby another strategy may be to analyze different frequency components and their phases in the noise signal and derive a signal with the same frequency components but an opposite phase, and output this signal.
  • one or both of the noise reducing signal and the audio signal is/are limited with a level/strength of the audio signal.
  • the noise reducing signal may be limited simply by being provided with the desired level/strength.
  • the limitation may be a reduction/increase of the level/strength thereof.
  • the level/strength of a signal is a value describing how loud the signal is, such as an amplitude or a mean sound pressure thereof.
  • This limitation acts to adapt the level/strength of the noise reducing signal in relation to the level/strength of the audio signal. Whether one signal is limited to have a reduced level/strength or the other is limited to have an increased level/strength is not important, as any combined signal may subsequently be limited (amplified to have a larger level/strength or be reduced in level/strength).
  • a "limitation” may both be an increase and a decrease in level/strength.
  • an increase/decrease in level/strength may be a linear scaling of the signal, such that all parts of the signal are linearly decreased/increased in level/strength.
  • the limitation may be a non-linear increase/decrease in level/strength, such as the "local” limitation only of parts of a signal exceeding a given threshold, which is also denoted "clipping" or falling under a given threshold.
  • the signals are combined, such as by a simple summing or adding of the signals.
  • the limited audio signal is combined with the limited noise reducing signal.
  • the noise reducing signal is limited so that the level/strength of the combined signal fulfills predetermined criteria. These criteria may be a maximum level/strength or a level/strength falling within a predetermined interval, and the analysis may be performed on the basis of a mean level of the signal or a peak level of the signal.
  • the outputting means are adapted to:
  • the second predetermined level/strength will be a maximum output level/strength.
  • This level/strength may be dictated by other elements of the system, such as an amplifier used for subsequently amplifying the combined signal, in order to e.g. maintain optimum audio quality.
  • the first predetermined level/strength is lower than the second one and may be determined so as to leave sufficient "headroom" for the noise reducing signal but still ensure sufficient audio signal level/strength and thereby quality.
  • the limiting means are adapted to limit, clip or scale the audio signal, i.e. before being combined. In this manner, it may be ensured that the level/strength of the audio signal is sufficiently low to allow "space" for the noise reducing signal - limited or not - while maintaining a maximum allowed or desired level/strength of the altered audio signal.
  • the audio signal may be limited, clipped or scaled to have a strength/level below a predetermined value, percentage or the like of a maximum desired level/strength of the altered audio signal. Then, the noise reducing signal may also be limited, if it does not already fall within the allowed "space” and thus has a maximum level within defined limits.
  • the advantage of this adaptation is that when noise reduction is needed, e.g. when an engine generates noise and no significant music levels are being played back then the noise reducing signal can be allowed to use almost all the dynamic headroom of the playback system. Thus, a good noise reduction is obtained when the audio signal level is low and the noise therefore audible. And when large levels of music are being played back, whereby the level/strength of the audio system is high, the noise reducing signal can be attenuated to avoid significant distortion of the sound output. Then, the noise will still be less audible due to the high level of the audio signal. Thus, both the noise reducing and the entertainment system can take full advantage of the audio system with only minimal interference.
  • the noise may be generated by any type of source and usually may be heard both close to and farther away from the source.
  • Noise may be experienced outside, such as close to a factory, road, race track, railway track, airport, harbour, or the like.
  • the present system may be desired when wishing to experience an audio signal in the vicinity of such installations. Then, music systems on porches, balconies, open air concerts or the like may advantageously use the present system. Also when using portable MP3/4 players or cell phones, the present system is advantageous. In one embodiment, however:
  • the structure may be any type of structure, such as a building, a room/space in a building, a vehicle such as a car, bus, lorry or the like, or a vessel, such as a ferry, ship, boat or the like.
  • the noise may be generated within the structure, such as an engine of a car, or may be generated outside the structure, such as a railway track located close to a house.
  • the system comprises a loudspeaker and means for providing the altered audio signal to the loudspeaker.
  • multiple loudspeakers may be used both to obtain stereo/surround sound or to obtain a desired sound level.
  • different loudspeakers may have different frequency characteristics, so that a combination of speakers is desired to obtain a desired sound.
  • one or more amplifiers may be used for amplifying the altered signal before being fed to the loudspeaker(s).
  • the noise cancellation or noise reduction may not be sufficient at all positions. This is equally relevant outside as within a structure. This disadvantage may be taken into account if the system further comprises a plurality of loudspeakers positioned in different first positions, such as within the structure, and wherein:
  • noise is determined/estimated at a plurality of second positions, even though each noise signal could be used for generating a particular, single altered signal which is then output to a loudspeaker, such as a loudspeaker positioned close to the pertaining second position, it is preferred that all noise signals are used for the generation of each altered signal.
  • the structure is a car, and speakers are positioned at each of the four main seats in the car as well as centrally (such as a subwoofer). Then, microphones may be positioned near or above the four main seats and generate noise signals from those positions.
  • the limiting may act to ensure that the altered audio signal has a maximum or predetermined level/strength.
  • the processing system due to there usually being a delay in the processing system, sudden bursts in the audio signal may occur and cause the altered audio signal to exceed this maximum limit.
  • a too high signal is output to e.g. an amplifier, which may cause distortion of the sound.
  • the system further comprises additional means for limiting the altered signal, such as to stay below a predetermined maximum limit.
  • additional means for limiting the altered signal such as to stay below a predetermined maximum limit.
  • this limitation may be a scaling, clipping or any other desired type of limitation.
  • this further limitation may be a standard limitation or attenuation of the signal.
  • a second aspect of the invention relates to a method of generating an altered audio signal, the method comprising:
  • the noise reducing signal may be estimated or predetermined or may be derived from a determination or estimation of the noise, which again may be performed as described above: directly, indirectly or modeled.
  • a large number of manners are used. Each manner has its advantages and disadvantages and may be selected based on the actual situation.
  • the audio signal may be received from e.g. a remote source, such as a radio transmitter, a remote network, a cell phone transceiver or the like. Also, the audio signal may be provided from a source or storage locally or readily available, such as from a CD or DVD in a player, a MP3/4-player, a cell phone, or a local storage of any other type.
  • a remote source such as a radio transmitter, a remote network, a cell phone transceiver or the like.
  • the audio signal may be provided from a source or storage locally or readily available, such as from a CD or DVD in a player, a MP3/4-player, a cell phone, or a local storage of any other type.
  • the altered audio signal is based on the audio signal and the noise reducing signal, where at least one of these signals is limited on the basis of a level/strength of the audio signal.
  • the limiting may be an increasing of the level/strength of one of the representations or a reduction of the level/strength of the other - or both.
  • the limiting is used to obtain a predetermined or desired relation between the level/strengths of the audio signal and the noise reducing signal.
  • the noise is determined or estimated in the structure. It is noted that the noise may be determined or sensed outside the structure, but then, preferably, an estimation step is used in order to estimate the noise inside the structure, as the structure will normally alter or affect the noise, such as the strength/level/amplitude thereof as well as a frequency content thereof.
  • the method further comprises providing the altered audio signal to a loudspeaker.
  • the altered audio signal will be output as a combination of the audio signal and the noise reducing signal to the effect that the overall noise is reduced or cancelled out.
  • multiple speakers may be used, and usually, one or more amplifiers are used for amplifying the altered audio signal before feeding this to the speaker(s).
  • the method further comprises the steps of:
  • an altered signal may be derived for one first position and on the basis of a noise reducing signal derived from a noise signal from one second position, which positions may correspond, so individual or local noise cancellation or reduction may be obtained at different positions, such as within a structure.
  • a noise reducing signal derived from a noise signal from one second position
  • positions may correspond, so individual or local noise cancellation or reduction may be obtained at different positions, such as within a structure.
  • all or more than one noise signal is used for generating each altered signal.
  • the method further comprises the further step of limiting the altered signal, such as before amplifying it. This has the advantage that sudden burst in the altered signal do not cause the amplified signal to be distorted due to the amplifier being operated close to its upper limit.
  • the method comprises the step of limiting the audio signal before the combination. This is one manner of allowing the limiting step to not having to limit the audio signal but only the noise reducing signal in order to obtain a desired relation between the levels/strengths thereof while allowing a minimum "space" or headroom for the noise cancellation.
  • the limiting of the determined/estimated noise reducing signal may be a generation of this signal with the desired level/strength.
  • the limiting step comprises:
  • FIG 1 major components of a preferred embodiment 10 of the invention for use in a car are described.
  • an audio signal may be provided as a flow or signal, such as generated by a radio wave receiver, a CD player, a DVD player, a network connection, an MP3/MP4 player, a cell phone, a computer, a laptop, a router, an e-reader, a memory holding audio information, or any other type of audio source.
  • This signal is fed to a unit 12 which introduces cross-over filters, equalizers etc, and divides the audio signal into individual signals for each of a number of, here six, speakers in the car 30.
  • circuits are provided for adapting the individual audio signals to meet specifications of the user/driver of the car 30, such as an adaptation of the volume 14 or other types of manipulations, which will be described further below. Naturally, no manipulations or adaptations are required, as the audio signal may be output as received.
  • the resulting, adapted signals usually are amplified and output into the interior of the car 30 using one or more speakers. Only a single amplifier 28 and a single speaker 34 are illustrated.
  • any number of speakers 34 and amplifiers 28 may be used.
  • desired types of manipulations are performed by a volume control, a so-called compressor which handles the variations of dynamics found in the music signal, and a limiter 18, the function of which is to ensure that the audio signal is kept below a predefined level before adding the noise reducing signal, as will be described below.
  • the limiter 18 may ensure that the audio signal is kept e.g. 2 dB below Full Scale Digital (FSD) of a digital signal path or a predetermined limit below full analogue signal on an analogue signal path.
  • FSD Full Scale Digital
  • the signal path may be a single audio signal path instead of the separate paths depicted in the figure. Then, if multiple speakers are used, the signal may be divided into signals for each speaker at any position in the figure.
  • the present system 10 further comprises an analyzer 20 which receives the audio signal output of the limiter 18.
  • the analyzer 20 receives one of the audio signals output of the limiter 18 and determines a level thereof. This level is a value describing how loud the audio signal is in the car. This level is transmitted to a noise reducing circuit 22 which generates a noise reducing signal adapted to cancel noise in the car 30.
  • the level may relate to the signal level of the audio signal or a maximum level or a noise reducing signal to be generated.
  • This cancelation/reduction may be performed in any desired manner, such as based on an actual determination or detection of the noise in the car using one or more microphones 32 and/or based on the Revolutions Per Minute (RPM) of the engine of the car 30, such as could be determined from the engine control system 36 of the car 30.
  • Detected noise may itself be used for generating the noise reducing signal, such as by simple inversion, or may be used for the generation thereof.
  • a determined RPM is used by a Digital Signal Processor (DSP) for generating a noise reducing signal based on any of a multitude of methods.
  • DSP Digital Signal Processor
  • the noise may be so well known that it need not be determined/sensed but may be predicted/modelled sufficiently without such determination/sensing.
  • the determined noise reducing signal is limited on the basis of the value provided by the analyzer 20 and is subsequently added, in the adder 24, to the audio signal output of the limiter 18 and from which the value was derived.
  • the limiting/scaling of the noise reducing signal is an adaptation of the level or volume thereof and may be performed by simple multiplication or division of the noise reducing signal by the value received from the analyzer 20, so as to ensure that the sum of the audio signal and the noise reducing signal does not exceed a predetermined limit. In this manner, it is ensured that the amplifier 28 is not overloaded by the summed signal output of the adder 24, which could otherwise result in a deterioration of the audio signal quality.
  • the limiting of a signal may be a linear limiting of all parts of the signal or e.g. a clipping, whereby only parts of the signal exceeding, for example, a maximum level, are reduced.
  • the limiter 18 may be set to ensure that the audio signal does not take up the full signal level so that there is "room” for the noise reducing signal.
  • a further limiter 26 is provided in order to ensure that the summed signal does not overload the amplifier 28. Then, the setting of the limiter 18 may be lower compared to the setting of the limiter 26.
  • the analyzer 20 and noise reducing circuit 22 will provide a signal delay, so that a sudden increase in the audio signal, which would then cause a reduction in a level of the noise reducing signal, will cause a short burst of high level summed signal, which may then be reduced by the limiter 26.
  • the louder the audio the higher the level of the audio signal
  • the louder the audio the less discernible will the noise be, so the present technology will both ensure noise cancellation/reduction and first of all a high quality audio representation in the vehicle.
  • the settings of the limiters 18 and 26 may be chosen in many manners.
  • 2dB may be "reserved" by the limiter 18 for the noise reducing signal, to ensure a minimum "head room” for the noise reducing signal independently of the level of the audio signal.
  • This may effectively reduce the power output available from the amplifier for the audio signal from e.g. 125W to 79W. Therefore, less "head room” may be desired for the noise reducing signal to be able to have a louder audio signal. This will also depend on the actual vehicle and the amount of noise which requires cancellation/reduction.
  • a single analyzer 20 and noise reducing circuit 22 may be provided for generating the noise cancellation in the vehicle 30. This may be on the basis of the audio signal in a single channel as illustrated in figure 1 or on the basis of the audio signals of all channels. However, an analyzer 20 and noise reducing circuit may be provided for each speaker 34 or more than one speaker 34, so as to better provide the noise cancelling sound in the vehicle 30. Also, in this situation, the signal strength required from each speaker 34 to cancel the noise (when the noise reducing signal is output by multiple speakers 34) will be lower, whereby a better audio quality (and louder audio) may be obtained.
  • multiple microphones 32 may be present in the vehicle 30.
  • one microphone 32 may be provided per speaker 34, per main seat in the vehicle 30, or per set of analyzer 20 and noise reducing circuit, so that the different noise in different positions in the car 30 may be determined and cancelled out.
  • the noise reducing signal for a given speaker 34 may be generated from the microphone 32 which is the closest to the speaker 34 or from signals from multiple microphones 32 in order to estimate, from the microphone signals, the noise signal at the position of the speaker 34 or of a listener.
  • the sound output of all speakers 34 will be sensed by all microphones 32, so the output of each speaker 34 should be taken into account when generating the noise reducing signal.
  • a system having four microphones 32 and four speakers 34 will result in the solving of a number of equations with a number of unknown parameters. This, however, is a known technique.
  • individual units of figure 1 may be, as is also described above, left out or be positioned at other positions in the flow direction of the audio signals. It is preferred, however, that the compressor 16 is positioned before the adder 24 in the signal path (downwards in the figure) so as to not affect the noise reducing signal provided by the circuit 22.
  • the output is simply calculated as the absolute value of the input yielding a strict positive number.
  • the input is the music signal for any one of the 5 woofers (WF - left front, WF - right front, WF - left back, WF - right back, Subwoofer), which is generated by the complete audio flow.
  • the output is the maximum value of the input during a period of 1.0sec.
  • the output is only calculated every integer multiple of 1.0sec, i.e. at the termination of each block of 1.0sec. (end of peak detection period). The length of the peak detection period can be adjusted.
  • the calculated Peak Value is subtracted from the Max Digital Value to work out how much digital head room can be reserved for the noise reducing signal.
  • the output is calculated as the input restricted (bound to) the range from (0.0057 x FSD) to (0.8 x FSD). This ensures that some digital head room is always reserved for the music signal, i.e. -14 dB rel. FSD and that a small digital head room (-44.8 dB rel. FSD) is reserved for a noise reducing signal even when the music is at maximum level.
  • the minimum allowed noise reducing signal level "Min. ANC” and the maximum allowed noise reducing signal level "Max. ANC” can be adjusted, depending on the actual needs and e.g. the noise level of the vehicle.
  • the current output is the former output incremented or decremented by a specific number or step size to move the current output closer to the input value (tracing).
  • This process or step acts to limit the increase/decrease of the noise reducing signal (also called attack rate) to avoid the situation where the audio signal decreases abruptly but just as abruptly increases again. In this situation, the changes of the noise reducing signal strength are limited by the slew rate limiter.
  • the specific number which is the step size, here corresponds to a slope of +/-FSD/(2x0.05sec). Only if the former output is within +/- (specific number/2), the output remains unchanged.
  • the output of this block is the "Max ANC signal", which imposes a limit on how large the noise reducing signal is allowed to be.
  • the maximum slew rate for increasing “Max. ANC” and decreasing “Max. ANC” can be adjusted individually, i.e. attack rate and release rate.
  • the analyzer 20 and noise reducing circuit 22 may be provided in a number of manners, such as as special purpose electronics, ASICs or the like, or on the same or different processors or DSPs. If multiple analyzers 20 and noise reducing circuits 22 are provided, any number of processors/DSPs or the like may be used, depending on the capabilities thereof and the programming efficiency etc. of the software defining these processes or circuits.
  • noise cancellation in a car or vehicle Even though the present invention and embodiments primarily have been directed toward noise cancellation in a car or vehicle, the same technology may with advantages be used in any type environment.
  • a number of structures or crafts generate noise themselves, such as trains, busses, ferries, ships or the like having engines or other elements creasing noise.
  • external noise sources may generate noise which is desired cancelled.
  • noise from the surroundings may be desired cancelled out within a building or room, or outside, such as on a soccer field, on a porch or the like.
  • the noise detection or estimation means may vary from situation to situation. If the noise is generated by an element to which access is possible, the rpm-detector mentioned above may be a possibility. This may, naturally, be replaced by another type of sensor adapted to detect or sense noise from that particular type of element.
  • the noise may be detected or sensed using microphones, vibration sensors or the like.
  • the noise may be estimated or modelled without requiring sensing of any kind.
  • the same noise detection or noise cancellation signal(s) may be used in different environments for noise cancelling different audio signals, such as an audio signal generated by a TV in one room of a house or ship and a radio signal provided in another room of the house/ship.

Claims (8)

  1. System zum Ausgeben eines veränderten Audiosignals, wobei das System Folgendes umfasst:
    - Mittel (32) zum Bereitstellen eines Rauschreduktionssignals,
    - Mittel (12) zum Bereitstellen oder Empfangen eines Audiosignals,
    - Mittel (18, 20, 22, 24) zum Ausgeben eines veränderten Audiosignals basierend auf dem Audiosignal und dem Rauschreduktionssignal, und Mittel zum Begrenzen des veränderten Audiosignals;
    wobei das Ausgabemittel (18, 20, 22, 24) für Folgendes angepasst ist:
    o Begrenzen des Rauschreduktionssignals und des Audiosignals,
    o Bereitstellen des veränderten Audiosignals durch Kombinieren:
    • des begrenzten Audiosignals mit dem begrenzten Rauschreduktionssignal, wobei die Ausgabemittel (18, 20, 22, 24) für Folgendes angepasst sind:
    - Begrenzen des Audiosignals, um ein Niveau/eine Stärke aufzuweisen, das/die nicht höher als ein(e) erste(s) vorbestimmte(s) Niveau/Stärke ist und wobei das System dadurch gekennzeichnet ist, dass das Ausgabemittel für Folgendes angepasst ist:
    - Begrenzen des Rauschreduktionssignals, sodass das kombinierte, begrenzte Audiosignal und das Rauschreduktionssignal ein Niveau/eine Stärke aufweisen, das/die nicht höher als ein(e) zweite(s), vorbestimmte(s) Niveau/Stärke ist,
    wobei das/die erste vorbestimmte Niveau/Stärke niedriger als das/die zweite vorbestimmte Niveau/Stärke ist.
  2. System nach Anspruch 1, wobei:
    - die Mittel (32) zum Bereitstellen des Rauschreduktionssignals Mittel (22) zum Bestimmen/Schätzen von Rauschen in einer Struktur und Bereitstellen des Rauschreduktionssignals von bestimmtem/geschätztem Rauschen umfassen, und
    - die Ausgabemittel (18, 20, 22, 24) angepasst sind, um das veränderte Audiosignal in die Struktur auszugeben.
  3. System nach Anspruch 1, ferner umfassend einen Lautsprecher (34) und Mittel (28) zum Bereitstellen des veränderten Audiosignals an den Lautsprecher (34).
  4. System nach einem der Ansprüche 1-3, ferner umfassend eine Vielzahl von Lautsprechern, die in unterschiedlichen ersten Positionen positioniert sind, und wobei:
    - die Mittel (32) zum Bereitstellen des Rauschreduktionssignals angepasst sind, um Rauschsignale für jede aus einer Vielzahl von unterschiedlichen zweiten Positionen in der Struktur zu empfangen/bereitzustellen und ein oder mehrere Rauschreduktionssignale auf der Grundlage von empfangenen/bereitgestellten Rauschsignalen bereitzustellen,
    - das Ausgabemittel (18, 20, 22, 24) angepasst ist, um eine Vielzahl von veränderten Signalen zu erzeugen, wobei jedes veränderte Signal auf der Grundlage des Audiosignals und eines Rauschreduktionssignals erzeugt wird, wobei das System Mittel zum Führen von jedem veränderten Signal zu einem der Lautsprecher (34) umfasst.
  5. Verfahren zum Erzeugen eines veränderten Audiosignals, wobei das Verfahren Folgendes umfasst:
    - Bereitstellen eines Rauschreduktionssignals,
    - Bereitstellen oder Empfangen eines Audiosignals,
    - Erzeugen des veränderten Audiosignals basierend auf dem Audiosignal und dem Rauschreduktionssignal durch:
    o Begrenzen des Rauschreduktionssignals und des Audiosignals,
    o Bereitstellen des veränderten Audiosignals durch Kombinieren:
    • des begrenzten Audiosignals mit dem begrenzten Rauschreduktionssignal, und dann weiter Begrenzen des veränderten Audiosignals,
    wobei der Begrenzungsschritt Folgendes umfasst:
    - Begrenzen des Audiosignals, um ein Niveau/eine Stärke aufzuweisen, das/die nicht höher als ein(e) erste(s) vorbestimmte(s) Niveau/Stärke ist, wobei das Verfahren dadurch gekennzeichnet ist, dass der Begrenzungsschritt ferner Folgendes umfasst:
    - Begrenzen des Rauschreduktionssignals, sodass das kombinierte, begrenzte Audiosignal und das Rauschreduktionssignal ein Niveau/eine Stärke aufweisen, das/die nicht höher als ein(e) zweite(s), vorbestimmte(s) Niveau/Stärke ist,
    wobei das/die erste vorbestimmte Niveau/Stärke niedriger als das/die zweite vorbestimmte Niveau/Stärke ist.
  6. Verfahren nach Anspruch 5, wobei:
    - der Schritt des Bereitstellens des Rauschreduktionssignals das Bestimmen/Schätzen von Rauschen in einer Struktur umfasst, und
    - das veränderte Audiosignal in die Struktur ausgegeben wird.
  7. Verfahren nach Anspruch 5 oder 6, ferner umfassend das Bereitstellen des veränderten Audiosignals an einen Lautsprecher (34) .
  8. Verfahren nach einem der Ansprüche 5-7, ferner die folgenden Schritte umfassend:
    - Bereitstelen einer Vielzahl von Lautsprechern, die in unterschiedlichen ersten Positionen positioniert sind,
    - Empfangen von Rauschsignalen für jede aus einer Vielzahl von unterschiedlichen zweiten Positionen in der Struktur, wobei der Schritt des Bereitstellens der Rauschreduktionssignale das Bereitstellen einer Vielzahl von Rauschreduktionssignalen auf der Grundlage der Rauschsignale umfasst,
    - Erzeugen einer Vielzahl von veränderten Signalen, wobei jedes veränderte Signal auf der Grundlage des Audiosignals und eines Rauschreduktionssignals erzeugt wird, und
    - Führen von jedem veränderten Signal zu einem der Lautsprecher.
EP10166978.6A 2010-04-12 2010-06-23 Verfahren zur Anpassung der Rauschreduktion und System zur Audiobereitstellung mit Rauschreduktion Active EP2375408B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DKPA201000301 2010-04-12

Publications (3)

Publication Number Publication Date
EP2375408A2 EP2375408A2 (de) 2011-10-12
EP2375408A3 EP2375408A3 (de) 2015-04-08
EP2375408B1 true EP2375408B1 (de) 2021-03-10

Family

ID=44341596

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10166978.6A Active EP2375408B1 (de) 2010-04-12 2010-06-23 Verfahren zur Anpassung der Rauschreduktion und System zur Audiobereitstellung mit Rauschreduktion

Country Status (1)

Country Link
EP (1) EP2375408B1 (de)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5822862B2 (ja) * 2013-03-21 2015-11-25 本田技研工業株式会社 車両用能動型振動騒音制御装置
US9672803B2 (en) 2014-09-19 2017-06-06 GM Global Technology Operations LLC Adaptive active noise cancellation
US10706834B2 (en) 2018-08-31 2020-07-07 Bose Corporation Systems and methods for disabling adaptation in an adaptive feedforward control system
US10741165B2 (en) 2018-08-31 2020-08-11 Bose Corporation Systems and methods for noise-cancellation with shaping and weighting filters
US10410620B1 (en) 2018-08-31 2019-09-10 Bose Corporation Systems and methods for reducing acoustic artifacts in an adaptive feedforward control system
US10629183B2 (en) 2018-08-31 2020-04-21 Bose Corporation Systems and methods for noise-cancellation using microphone projection
JP2023526483A (ja) * 2020-05-21 2023-06-21 ボーズ・コーポレーション 娯楽音声に応答する走行雑音消去システム

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3508152B2 (ja) * 1993-03-26 2004-03-22 マツダ株式会社 車両用振動制御装置
US5469510A (en) * 1993-06-28 1995-11-21 Ford Motor Company Arbitration adjustment for acoustic reproduction systems
GB2479675B (en) * 2006-04-01 2011-11-30 Wolfson Microelectronics Plc Ambient noise-reduction control system
JP2008137636A (ja) * 2006-11-07 2008-06-19 Honda Motor Co Ltd 能動型騒音制御装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP2375408A2 (de) 2011-10-12
EP2375408A3 (de) 2015-04-08

Similar Documents

Publication Publication Date Title
EP2375408B1 (de) Verfahren zur Anpassung der Rauschreduktion und System zur Audiobereitstellung mit Rauschreduktion
EP4068275B1 (de) Verfahren zur kalibrierung eines in ein audiogerät eingebetteten systems zur geräuschminderung
US10607592B2 (en) Noise reducing device, noise reducing method, noise reducing program, and noise reducing audio outputting device
US8831238B2 (en) Noise cancellation system
US7333618B2 (en) Ambient noise sound level compensation
EP1940198B1 (de) Audioausgabevorrichtung, Audioausgabeverfahren, Audioausgabesystem und Programm zur Audioausgabeverarbeitung
US10582288B2 (en) Sports headphone with situational awareness
EP2291002B1 (de) Vorrichtung zur akustischen verarbeitung
JP6870078B2 (ja) 動的サウンド調整のための雑音推定
KR20110103355A (ko) 오디오 신호에서 음량 레벨의 자동 보정
US8249265B2 (en) Method and apparatus for achieving active noise reduction
JP2016051038A (ja) ノイズゲート装置
US20160295325A1 (en) Method and device
JP2006129434A (ja) 自動利得制御方法、自動利得制御装置、自動利得制御プログラム及びこれを記録した記録媒体
JP2022544453A (ja) 周波数分解能が向上したノイズキャンセレーション
US20100278353A1 (en) System and Method For Intelligibility Enhancement of Audio Information
JP2018182480A (ja) 騒音スペクトル分布検出方法と対騒音音量音質制御方法
Felber An automatic volume control for preserving intelligibility
JP5092864B2 (ja) 音処理装置およびプログラム
JP2012257079A (ja) フィルタ係数決定装置
JP5998357B2 (ja) 車載用音響再生装置
JP2012187995A (ja) 車載用音響再生装置
JP2008301376A (ja) ノイズキャンセルヘッドホン
KR20170053252A (ko) 주행 중 음질을 개선하기 위한 장치 및 방법
KR100803346B1 (ko) 하우링 소거 기능을 갖는 차량용 노래 반주 시스템

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

RIC1 Information provided on ipc code assigned before grant

Ipc: G10K 11/178 20060101AFI20150303BHEP

17P Request for examination filed

Effective date: 20151006

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: HARMAN BECKER GEPKOCSIRENDSZER GYARTO KORLATOLT FE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180220

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20201014

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1370711

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210315

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010066562

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210611

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210610

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210610

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1370711

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210310

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20210310

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210710

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210712

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010066562

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20211213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210623

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210630

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210623

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210710

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100623

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230527

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230523

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230523

Year of fee payment: 14

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310