EP1005783A1 - A method for electronically beam forming acoustical signals and acoustical sensor apparatus - Google Patents

A method for electronically beam forming acoustical signals and acoustical sensor apparatus

Info

Publication number
EP1005783A1
EP1005783A1 EP98922985A EP98922985A EP1005783A1 EP 1005783 A1 EP1005783 A1 EP 1005783A1 EP 98922985 A EP98922985 A EP 98922985A EP 98922985 A EP98922985 A EP 98922985A EP 1005783 A1 EP1005783 A1 EP 1005783A1
Authority
EP
European Patent Office
Prior art keywords
signal
unit
output
transducers
signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP98922985A
Other languages
German (de)
French (fr)
Other versions
EP1005783B1 (en
Inventor
Joseph Maisano
Werner Hottinger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sonova Holding AG
Original Assignee
Phonak AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Phonak AG filed Critical Phonak AG
Priority to EP98922985A priority Critical patent/EP1005783B1/en
Publication of EP1005783A1 publication Critical patent/EP1005783A1/en
Application granted granted Critical
Publication of EP1005783B1 publication Critical patent/EP1005783B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/407Circuits for combining signals of a plurality of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing

Definitions

  • the present invention is generically directed on a technique for so-called "beam forming" on acoustical signals.
  • the amplitude of the resulting signal A_. is proportional to the sine of the signal frequency ⁇ and to the distance p.
  • f r becomes approx. 7 kHz.
  • Such techniques for beam forming are well-known and have been realised using analogue signal processing, as e.g. shown in the US-A-2 237 298, US-A-4 544 927, US-A-4 703 506, US-A-5 506 908 or using digital signal processing, both in time or in frequency domain, as shown in the EP-A-0 381 498 (time domain) or in the US-A-5 581 620 (frequency domain) .
  • the resulting signal is dampened at low frequencies, which results in a bad signal to noise ratio.
  • the directivity index is very sensitive to matching of the individual microphone cells, especially at low frequencies.
  • the distance p between the microphone cells should be large (> 12 mm) for audio range.
  • the directivity largely depends upon the number of microphone cells and thus on the complexity of the overall arrangement .
  • the US-A-4 653 102 proposes the use of two directional microphones aimed in target direction and of a third microphone aimed in opposite direction.
  • the signal of the third microphone supposedly only containing noise is used to shape the response of the two primary microphones.
  • This technique obviously has the drawback within reverberating rooms, where the desired signal is reflected on walls, floor, ceiling and furniture and is therefore considered as noise by the system.
  • This technique is further unhandy as making use of at least three microphones .
  • the US-5 539 859 proposes a technique wherein reception characteristic is logged in on that direction wherefrom the highest energy impinges on a pair of microphones and considered in the sound environment. Principally, all sound impinging from directions other than from highest energy direction is considered as noise and its reception is cancelled.
  • an analogue to digital conversion and subsequent time to frequency domain conversion is performed on the output signals of two microphones. Exploiting the knowledge of the fixed mutual distance between the two microphones, wherefrom phase difference of the impinging signal spectra is dependent, there is determined the mutual phasing and thus impinging direction of highest energy sound signals, i.e. direction of highest en- ergy sound source within the acoustical surrounding. Signals impinging from that direction are amplified by means of in- phase shifting and adding similarly to an auto correlation technique, whereby signals from other impinging angles are cancelled as noise.
  • the preferred apparatus according to the present invention is a hearing aid apparatus, and especially a one ear hearing aid apparatus . It is a further object to provide such method and apparatus with good frequency response in the audio band, i.e. between approx. 0,1 and 10 kHz.
  • Still a further object of the present invention is to provide such method and apparatus which allow high signal to noise ratio realisation without unwanted side-lobes and with easily variable beam form, e.g. for acoustical zooming.
  • the inventive method comprises the steps of repetitively determining from sig- nals dependent from the acoustical signals a respective mutual delay signal according to reception delay at the at least two transducers; subjecting a signal dependent from the output signal of at least one of the at least two transducers to filtering with a filtering transfer characteristic; and of control- ling the filtering transfer characteristic in dependency of the mutual delay signal; further exploiting a signal dependent from the output signal of the filtering as electrical reception signal .
  • the inventive acoustical sensor apparatus comprises at least two acoustical/electrical transducers, arranged at a predetermined mutual distance in target direction, a time delay detection unit, which has at least two inputs and an output, the inputs thereof being respectively operationally connected to the outputs of the two transducers, whereby the time delay detection unit generates an output signal in dependency of the time delay of acoustical signals, impinging on the at least two spaced apart transducers, preferably a time domain to frequency domain converter unit generating the output signal of said time delay detection unit in frequency domain; a weighing unit with a predetermined weighing characteristic and with an input and with an output, whereby the input thereof is operationally connected to the output of the time delay detection unit and preferably receiv- ing the signal at said output of said time delay detection unit in frequency domain mode; with a filter unit with a controllable transfer characteristic, which has at least one input, a control input and an output and whereat the input is operationally connected to
  • Fig. 1 A functional block diagram of a two-cell directional microphone arrangement according to the prior art principle of "delay and sum";
  • Fig. 2 the first order cardoid amplification characteristic of prior art arrangement according to fig. 1;
  • Fig. 3 departing from the prior art arrangement of fig. 1 a further arrangement following up the technique of "delay and sum" for realising second order characteristic;
  • Fig. 4 the second order amplification characteristic as realised by the prior art arrangement according to fig. 3;
  • Fig. 5 in dependency of frequency the amplification characteristic of the arrangement according to fig. 1 or 3 at maximum amplification impinging angle of acoustical signals;
  • Fig. 6 a simplified functional block diagram of an inventive apparatus operating according to the inventive method and further showing the sequence of process signals;
  • Fig. 7 in a representation according to fig. 6 a first preferred realisation form of an inventive apparatus operating according to the inventive method;
  • Fig. 8 in an inventive apparatus operating according to the inventive method according to fig. 6 a further preferred form of realisation of a time delay detection unit;
  • Fig. 9 a polar diagram of signals as realised by the embodi- ment of fig. 8 for explaining operation of a comparator unit as provided in the fig. 8 embodiment;
  • Fig. 10 the course of comparison results in dependency of impinging angle of an acoustical signal and as realised by the embodiment according to fig. 8;
  • Fig. 11 a preferred form of realising superimposing result signal dependency from impinging angle of an acoustical signal at an embodiment according to fig. 8 ;
  • Fig. 12 in a representation according to fig. 10 the course of comparison results as realised with a preferred embodiment resulting in the fig. 11 dependency;
  • Fig. 13 in polar diagrammatic representation the dependency of superimposing result signals from impinging angle of acoustical signals and from frequency as realised by the embodiment according to fig. 8;
  • Fig. 14 a preferred realisation form of the fig. 8 embodiment, additionally counteracting frequency dependency as shown in fig. 13;
  • Fig. 15 in a representation according to fig. 13 the. depend- ency of the superimposing result signal with normalisation as realised by the embodiment of fig. 14 with a first preferred normalisation frequency function;
  • Fig. 16 a representation according to fig. 15, realised with a second preferred normalisation frequency function at the embodiment of fig. 14;
  • Fig. 17 a first (rigid line) and second (dashed line) preferred realisation form of amplitude filter characteristic at the embodiment of fig. 6 or 7;
  • Fig. 18a the effect of the amplitude filter amplitude versus amplitude transfer characteristic according to fig. 17
  • Fig. 18b the representation of the output signal of a time delay detection unit passed through the amplitude filter with a transfer characteristic according to fig. 17
  • Fig. 19 the spectrum of an acoustical signal converted into electrical and input to a controllable frequency fil- ter as provided by the present invention according to fig. 6;
  • Fig. 20 the electrical reception result signal realised by amplitude filter characteristic according to fig. 17 (rigid line) and reception signal as exemplified in fig. 19 at the inventive embodiment according to fig.
  • Fig. 21 the resulting dependency of amplification from impinging angle of an acoustical signal as realised by the fig. 17 amplitude filter characteristic (rigid and dashed lines) ;
  • Fig. 22 the amplification versus impinging angle characteristic as realised by the fig. 6 or fig. 8, 14 embodiments of the invention, making use of an amplitude filter characteristic with a maximum to minimum spec- tral amplitude transfer behaviour;
  • Fig. 23 in a simplified signal/functional block diagram a further preferred embodiment of the invention
  • Fig. 24 in a signal flow, functional block representation, a further mode of realisation of the time delay detection unit as shown in fig. 6 and
  • Fig. 25 in a signal flow, functional block representation, a further mode of realisation of the time delay detection unit following the technique as shown in fig. 8 or fig. 14.
  • At least two acoustical/electrical transducers 1 and 2 are provided with a predetermined mutual distance p along axis a. Acoustical signals IN are received by the transducers 1 and 2 as they impinge from different spatial directions ⁇ . The acoustical signals IN have frequency spectra which vary in time. Output signals of transducer 1, S x (t, ⁇ ) and of transducer 2, S 2 (t, ⁇ ), are formed as electrical signals at the output of the transducers 1 and 2.
  • the acoustical signals IN impinge on the transducers 1 and 2 with a time delay dt, which may be expressed by the phase difference ⁇ ⁇ at each spectral frequency ⁇ according to
  • the time delay dt ⁇ becomes equal for all spectral components at the different ⁇ .
  • the output signals S. and S 2 of the transduc- ers 1 and 2 are operationally connected to the respective inputs of a time delay detection unit 10, which generates an output signal A 10 according to the spectral distribution of time delays dt ⁇ , which are, as was explained, a function of the impinging angle ⁇ at which the respective frequency components impinge on the transducers 1 and 2 and thus in fact of ⁇ ⁇ .
  • a possible spectrum of output signal A 10 is also shown in fig. 6.
  • This spectrum varies in time according to the time variation of impinging acoustical signal IN.
  • the output signal A 10 of time delay detection unit 10 is input to a weighing unit 12.
  • a 12 results from respectively weighing the spectral amplitudes of A 10 according to the characteristic W.
  • the weighing unit 12 determines with its characteristic W the beam shape .
  • the output signal A 12 is applied to a filter unit 14 with a controllable transfer filter characteristic.
  • each spec- tral line of the time varying spectrum of the output signal S- tjCo) is amplified or attenuated according to the controlling spectrum W ⁇ • A 10 ⁇ .
  • unit 14 is a filter unit for input signal S 1 at which the transfer characteristic is varied, as controlled by A 12 .
  • the weighing unit 12 In dependency of the kind of filter unit 14 the weighing unit 12, generally spoken, calculates adjustment of filter characteristic determining coefficients as a function of A 10 .
  • the beam form can be adjusted and thus acoustical zooming is realised.
  • both transducer output signals may be advantageous to subject both transducer output signals to a controlled filtering at unit 14.
  • fig. 7 there is shown a first preferred form of realisation of the inventive principle according to fig. 6.
  • the output signals S x and S 2 are first converted from analogue to digital form in respective analogue/digital converters 16 and 17.
  • the digital output signals of the respective converters 16 and 17 are input to respective complex time domain/frequency domain converters 18 and 19.
  • the output spectra S 1 (t, ⁇ ) and S 2 (t, ⁇ ) of converters 18, 19 are input to the spectral time delay detection unit 10'.
  • Unit 10' computes according to formula (1) the phase difference spectrum ⁇ ⁇ divided by the respective frequency ⁇ to result in an output signal spectrum A 10 ' according to the time delay dt ⁇ as was explained in connection with fig. 6.
  • the output signal of the time delay detection unit 10', A 10 ' is further treated, as was explained in connection with fig. 6, by the weighing filter unit 12 and the controllable filter unit 14.
  • the unit 10' operates. Out of the spectral phase distribution ⁇ ln of signal S- and ⁇ 2n of signal S 2 the time delay dt ⁇ is calculated for each spectral line within an interesting spectral band.
  • the time domain to frequency domain conversion units 18 and 19 perform complex (real and imaginary) operation.
  • a second preferred realisation form of the present invention and especially as concerns realisation of the time delay detection unit 10, shall be explained with the help of fig. 8 and 9.
  • the output signal of one of the transducers is fed to a time delay unit 20, wherein, in a first form of this realisation, signal S ⁇ is time delayed by a predetermined frequency independent time delay ⁇ .
  • signal S x accords thus with signal A x .
  • the output signal of time delay unit 20 thus accords with signal A. 1 of fig. 1.
  • the time delay signal according to A x ' is superimposed to the output signal S 2 (t, ⁇ ) from transducer 2 at a superimposing unit 23 according to unit 3 of fig. 1, thus resulting in an output signal according to A_.(t, ⁇ ) of fig. 1.
  • the output signal A_.(t, ⁇ ) depends from the impinging acoustical signal direction ⁇ ac- cording to the first order cardoid beam of fig. 2, which cardoid function nevertheless varies with frequency ⁇ .
  • the output signal A., of superimposing unit 23 and e.g. the output signal S 2 (t, ⁇ ) from transducer 2 are input to a ratio unit 25, as a comparator unit .
  • a 20 according to fig. 9 is indicative of the impinging angle ⁇ 0 .
  • the division unit 25 of fig. 8 there is formed for each spectral component amplitude the ratio of A. to A., wherefrom there results a signal spectrum at the output of division unit 25 with a ratio spectrum.
  • the spectrum of A 10 according to fig. 6 thus becomes the spectrum of an amplitude ratio which nevertheless is indicative of the impinging angle ⁇ , at which each frequency component of the spectrum of the acoustical signal impinges with respect to the axis a of the two transducers (see fig. 6) .
  • the dotted line block indicates the delay detection unit 10 according to fig. 6. Further signal processing is performed as was explained by means of fig. 6, i.e. via weighing unit 12 and controllable filter unit 14.
  • the output ratio signal of unit 25 is a measure for the time delay dt ⁇ and is input to the weighing unit 12.
  • This amplitude ratio is shown for ⁇ at unit 20 of fig. 8 being selected to be
  • the cardoid function as shown in the figures 2, 9 and 11 is only valid for one specific frequency considered.
  • the outputs of the transducers 1 and 2 are converted into digital form by respective analogue to digital converters 16, 17 and the resulting digital signal of transducer 1 is time delayed by a time delay ⁇ ', which is larger than p/c.
  • the output signal S 2 of transducer 2 is further converted into frequency domain by a linear (not complex) time to frequency domain conversion unit 18 ' , whereas the output signal A., of superimposing unit 23 is converted to frequency domain at a linear time to frequency domain conversion unit 19 ' .
  • the frequency dependent polar diagram according to fig. 13 is taken into ac- count by a normaliser unit 30 which is in fact a filter.
  • the transfer characteristic of the filter is selected proportional to 1/ ⁇ . This results in a frequency dependency of the pole diagram as is shown in fig. 15 for the same distance and frequency values as shown in fig. 13.
  • a further, even improved normalisation function or filter characteristic at unit 30 of fig. 14 is achieved when the filter characteristic is selected as a function l/sin( ⁇ ). The result is shown in fig. 16. The characteristics match well from 0.5 to 4 kHz.
  • a further advantage of this normalisation technique is improved sensitivity in backwards direction. This improved sensitivity may be exploited for adaptive beam forming, that is for selectively eliminating noise sources from the rear side.
  • Fig. 24 shows in block diagram form, that the signal A 10 (dt ( ) may also be generated as the output signal of a comparator unit 60 to which on one hand the output signal of an omnidirectional transducer 61, having equal amplification of its acousti- cal/electrical reception characteristic substantially irrespective of the impinging angle ⁇ and the output signal of a directional transducer 62 with selected, beam shaped reception characteristic are led to.
  • time delaying ⁇ may also be performed by one of the transducers itself.
  • the output signals of the transducers 1 and 2 are first converted by respective analogue to digital converters 16 and 17 and then by respective time domain to fre- quency domain converters 18, 19 finally into frequency domain.
  • One signal, as an example S 2 of the converted output signals of the transducers, which, after time to frequency domain conversion may be represented as a spectrum of S 2 ⁇ pointers, is converted to its conjugate complex pointers at a conversion unit 50. At the output of this unit 50, the conjugate, complex pointers S * 2 ⁇ are generated.
  • This spectrum S 2 * and the pointer spectrum S x are multiplied to form the scalar product spectrum S 3 in a multiplication unit 52.
  • the pointers S 3( of spectrum S 3 have a phase angle with respect to the real axis, which is ⁇ ⁇ .
  • ⁇ ⁇ ⁇ • (p/c) • cos( ⁇ ⁇ )
  • a conversion unit 53 forms the imaginary part of the pointers S 3 ⁇ and a further unit 54 forms the amplitudes I S 3 ⁇ I of these pointers .
  • All the units 50, 52, 53, 54, 55 and 56 are preferably realised in one calculator unit .
  • each dt M spectral line amplitude of signal A 10 (see fig. 6) is attenu- ated to zero, if such amplitude is below or above predetermined values dt min ⁇ , dt mas ⁇ and is set to be "one" if such spectral component amplitude is between these two values.
  • Such selection of weighing function W results in an output signal spectrum A 12 , as shown in the figures 18a and 18b.
  • Fig. 19 shows a spectrum example of signal S- L .
  • All spectral lines of S 1 (Fig. b) are amplified by the value 1 according to A 12 or are nullified ac- cording to zero values of A 12 .
  • the weighing function I of fig. 17 is applied to the technique according to fig. 7 there results a beam form as shown in fig. 21 in strong lines.
  • If an amplitude filter characteristic is applied as shown by II in fig. 17, there results the characteristic as shown in fig. 21 in dashed line .
  • Fig. 22 shows the resulting beam if in analogy to fig. 17 and with an eye on figures 8 and 9 all ratio values which exceed (A-VA- it-ax are discarded. This is realised by the amplitude filter characteristic as also indicated in Fig. 22.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
  • Investigating Or Analyzing Materials By The Use Of Ultrasonic Waves (AREA)

Abstract

A predetermined characteristic of amplification in dependency of the direction (θ) from which acoustical signals are received at two spaced apart acoustical/electrical transducers (1, 2) is formed in that repetitively a mutual delay signal (A10) is determined from the output signals of the transducers and according to the reception delay at the transducers, one (S1) of the output signals is filtered, thereby the filtering transfer characteristic is controlled in dependency of the mutual delay signal (A12). The output signal of the filtering (14) is exploited as electrical reception signal (Sr). <IMAGE>

Description

A method for electronically beam forming acoustical signals and acoustical sensor apparatus
The present invention is generically directed on a technique for so-called "beam forming" on acoustical signals.
The use of directional acoustical/electrical transducers and especially of such microphones is one of the most efficient ways for improving signal to noise ratio in audio systems. It is known to realise directional microphones by using an array of microphone cells and time delaying and superimposing the output signals of such cells following up the known "delay and sum" technique.
With two omnidirectional microphone cells this known principle is shown in fig. 1. Two omnidirectional microphones, 1 and 2, are provided with a mutual distance p. The output signal of one of the microphones according to signal Al is time delayed by the time amount τ, the time delayed signal according to A1 ' is superimposed at a superimposing unit 3 to the undelayed output signal Aj of microphone 2. At the output of the superimposing unit 3 there results the output signal A-. with an amplification versus impinging angle θ characteristic, as shown in fig. 2 for one frequency ω considered. Thereby, it is customary to select as delay time τ as the quotient of distance p and velocity of sound c. With this arrangement there results, as shown in fig. 2, a first order cardoid characteristic. It may be shown that the amplitude of the resulting signal A_. is proportional to the sine of the signal frequency ω and to the distance p. The maximum gain in target direction (180°) occurs at the frequency fr = c/ (4p) . For a distance p of 12 mm, fr becomes approx. 7 kHz. By staggering more than one of the fig. 1 double-cell arrangements and superimposing the resulting signals A_. of the more than one double-cell arrangements, higher order cardoid characteristics may be realised.
In fig. 3 a known arrangement to realise second order cardoid characteristics according to fig. 4 is shown. Thereby, a narrower beam can be achieved. The higher the order of the directional microphone arrangement, the higher becomes the directivity index and the gain at fr, but the higher will also be the roll-off for low and high frequencies and the number of unwanted side-lobes. With respect to the definition of the directivity index please refer to speech communication 20 (1996) , 229 - 240, "Microphone array systems for hands-free telecommunications", Garry W. Elko.
In fig. 5 there is shown the gain versus frequency characteristic of the first and second cardoid characteristics for an impinging angle θ = 180°. Therefrom, high and low frequency roll- offs are clearly evident .
Such techniques for beam forming are well-known and have been realised using analogue signal processing, as e.g. shown in the US-A-2 237 298, US-A-4 544 927, US-A-4 703 506, US-A-5 506 908 or using digital signal processing, both in time or in frequency domain, as shown in the EP-A-0 381 498 (time domain) or in the US-A-5 581 620 (frequency domain) .
Beam formings realised with any of these principles has the following drawbacks:
a) The resulting signal is dampened at low frequencies, which results in a bad signal to noise ratio. b) The directivity index is very sensitive to matching of the individual microphone cells, especially at low frequencies.
c) The distance p between the microphone cells should be large (> 12 mm) for audio range.
d) The frequency band with a high gain in target direction is rather small, as may clearly be seen from fig. 5.
e) The directivity largely depends upon the number of microphone cells and thus on the complexity of the overall arrangement .
f) As one aims for a high directivity by increasing the number of cells, more unwanted side-lobes are introduced.
Several techniques have been proposes to overcome some of these drawbacks :
In the WO 95/20305 (E. Lindemann) an adaptive noise reduction system for use in binaural hearing aid is proposed. It detects the power of the received signals to separate the desired from unwanted signals.
There is proposed a "broad side" microphone-cell array, i.e. target direction is perpendicular to the axis from one micro- phone to the other, in contrary to the arrangement according e.g. to Fig. 1 and the principles of the present invention, which is "in line".
The disclosed apparatus is bulky (» 5 cm) , so that it may not be implemented for one ear hearing aid.
Two equal beam lobes are generated in target and in opposing directions . In such a hearing aid a connection between the left and right ear system must be present, making the apparatus for hearing aid unhandy. Furthermore, as described by the same author in "Two microphone non-linear frequency domain beam former for hearing aid noise reduction" 1995, IEEE ASSP Workshop on Applications of Signal Processing to Audio and Acoustics, October 15 - 18, Mohonk, New Paltz, New York, such beam forming is efficient only up to about 2 kHz and leads to distortions of the desired signals.
The US-A-4 653 102 proposes the use of two directional microphones aimed in target direction and of a third microphone aimed in opposite direction. The signal of the third microphone supposedly only containing noise is used to shape the response of the two primary microphones. This technique obviously has the drawback within reverberating rooms, where the desired signal is reflected on walls, floor, ceiling and furniture and is therefore considered as noise by the system. This technique is further unhandy as making use of at least three microphones .
Attention is further drawn to US-A 5 400 409 and 5 539 859.
As an example of known beam-forming techniques, the US-5 539 859 proposes a technique wherein reception characteristic is logged in on that direction wherefrom the highest energy impinges on a pair of microphones and considered in the sound environment. Principally, all sound impinging from directions other than from highest energy direction is considered as noise and its reception is cancelled.
Thereby, an analogue to digital conversion and subsequent time to frequency domain conversion is performed on the output signals of two microphones. Exploiting the knowledge of the fixed mutual distance between the two microphones, wherefrom phase difference of the impinging signal spectra is dependent, there is determined the mutual phasing and thus impinging direction of highest energy sound signals, i.e. direction of highest en- ergy sound source within the acoustical surrounding. Signals impinging from that direction are amplified by means of in- phase shifting and adding similarly to an auto correlation technique, whereby signals from other impinging angles are cancelled as noise.
By such a technique the energy distribution in the sound environment traps the selectivity of reception, and it is not possible to freely select or preselect a maximum reception characteristic, e.g. in direction wherefrom sound is desired to be selectively received, irrespective of its relative energy. One field whereat such selectivity irrespective of energy distribution within the sound surrounding would clearly be advantageous is hearing aid technique .
It is an object of the present invention to provide a method for electronically forming a predetermined characteristic of amplification in dependency of direction from which acoustical signals are received at at least two spaced apart acoustical/electrical transducers and a respective acoustical sensor apparatus, with which only a small number of microphones or microphone cells has to be used and which is thus enabling small and compact directional transducer or microphone realisation. Thereby, the preferred apparatus according to the present invention is a hearing aid apparatus, and especially a one ear hearing aid apparatus . It is a further object to provide such method and apparatus with good frequency response in the audio band, i.e. between approx. 0,1 and 10 kHz.
Still a further object of the present invention is to provide such method and apparatus which allow high signal to noise ratio realisation without unwanted side-lobes and with easily variable beam form, e.g. for acoustical zooming.
These and other objects are realised by the inventive method, which comprises the steps of repetitively determining from sig- nals dependent from the acoustical signals a respective mutual delay signal according to reception delay at the at least two transducers; subjecting a signal dependent from the output signal of at least one of the at least two transducers to filtering with a filtering transfer characteristic; and of control- ling the filtering transfer characteristic in dependency of the mutual delay signal; further exploiting a signal dependent from the output signal of the filtering as electrical reception signal .
To fulfil the above mentioned objects the inventive acoustical sensor apparatus comprises at least two acoustical/electrical transducers, arranged at a predetermined mutual distance in target direction, a time delay detection unit, which has at least two inputs and an output, the inputs thereof being respectively operationally connected to the outputs of the two transducers, whereby the time delay detection unit generates an output signal in dependency of the time delay of acoustical signals, impinging on the at least two spaced apart transducers, preferably a time domain to frequency domain converter unit generating the output signal of said time delay detection unit in frequency domain; a weighing unit with a predetermined weighing characteristic and with an input and with an output, whereby the input thereof is operationally connected to the output of the time delay detection unit and preferably receiv- ing the signal at said output of said time delay detection unit in frequency domain mode; with a filter unit with a controllable transfer characteristic, which has at least one input, a control input and an output and whereat the input is operationally connected to at least one of the outputs of the at least two transducers, preferably via at least one time domain to frequency domain converter, the control input is operationally connected to the output of the weighing unit, the filter unit generating an output signal in dependency of its input signal and of its transfer characteristic which is controlled by the signal - preferably a spectral signal - which is applied to the control input of the filter unit, this weighing - preferably spectral weighing - result signal being dependent from the output signal of the time delay detection unit and the weighing characteristic of the weighing unit .
Other objects, advantages and specific embodiments of the present invention shall be exemplified with the help of further figures. The figures show:
Fig. 1: A functional block diagram of a two-cell directional microphone arrangement according to the prior art principle of "delay and sum";
Fig. 2: the first order cardoid amplification characteristic of prior art arrangement according to fig. 1;
Fig. 3: departing from the prior art arrangement of fig. 1 a further arrangement following up the technique of "delay and sum" for realising second order characteristic;
Fig. 4: the second order amplification characteristic as realised by the prior art arrangement according to fig. 3;
Fig. 5: in dependency of frequency the amplification characteristic of the arrangement according to fig. 1 or 3 at maximum amplification impinging angle of acoustical signals;
Fig. 6: a simplified functional block diagram of an inventive apparatus operating according to the inventive method and further showing the sequence of process signals;
Fig. 7: in a representation according to fig. 6 a first preferred realisation form of an inventive apparatus operating according to the inventive method;
Fig. 8: in an inventive apparatus operating according to the inventive method according to fig. 6 a further preferred form of realisation of a time delay detection unit;
Fig. 9: a polar diagram of signals as realised by the embodi- ment of fig. 8 for explaining operation of a comparator unit as provided in the fig. 8 embodiment;
Fig. 10: the course of comparison results in dependency of impinging angle of an acoustical signal and as realised by the embodiment according to fig. 8; Fig. 11: a preferred form of realising superimposing result signal dependency from impinging angle of an acoustical signal at an embodiment according to fig. 8 ;
Fig. 12: in a representation according to fig. 10 the course of comparison results as realised with a preferred embodiment resulting in the fig. 11 dependency;
Fig. 13: in polar diagrammatic representation the dependency of superimposing result signals from impinging angle of acoustical signals and from frequency as realised by the embodiment according to fig. 8;
Fig. 14: a preferred realisation form of the fig. 8 embodiment, additionally counteracting frequency dependency as shown in fig. 13;
Fig. 15: in a representation according to fig. 13 the. depend- ency of the superimposing result signal with normalisation as realised by the embodiment of fig. 14 with a first preferred normalisation frequency function;
Fig. 16: a representation according to fig. 15, realised with a second preferred normalisation frequency function at the embodiment of fig. 14;
Fig. 17: a first (rigid line) and second (dashed line) preferred realisation form of amplitude filter characteristic at the embodiment of fig. 6 or 7;
Fig. 18a: the effect of the amplitude filter amplitude versus amplitude transfer characteristic according to fig. 17
(rigid line) on the output signal of the delay detec- tion unit as provided in the embodiment of fig. 6 or 7;
Fig. 18b: the representation of the output signal of a time delay detection unit passed through the amplitude filter with a transfer characteristic according to fig. 17
(rigid line) and as realisable by the embodiment of fig. 6 or 7;
Fig. 19: the spectrum of an acoustical signal converted into electrical and input to a controllable frequency fil- ter as provided by the present invention according to fig. 6;
Fig. 20: the electrical reception result signal realised by amplitude filter characteristic according to fig. 17 (rigid line) and reception signal as exemplified in fig. 19 at the inventive embodiment according to fig.
6;
Fig. 21: the resulting dependency of amplification from impinging angle of an acoustical signal as realised by the fig. 17 amplitude filter characteristic (rigid and dashed lines) ;
Fig. 22: the amplification versus impinging angle characteristic as realised by the fig. 6 or fig. 8, 14 embodiments of the invention, making use of an amplitude filter characteristic with a maximum to minimum spec- tral amplitude transfer behaviour;
Fig. 23: in a simplified signal/functional block diagram a further preferred embodiment of the invention; Fig. 24: in a signal flow, functional block representation, a further mode of realisation of the time delay detection unit as shown in fig. 6 and
Fig. 25: in a signal flow, functional block representation, a further mode of realisation of the time delay detection unit following the technique as shown in fig. 8 or fig. 14.
In fig. 6 there is shown in form of a functional block diagram, together with principle signal processing diagrams, the princi- pie of the inventive method and apparatus.
At least two acoustical/electrical transducers 1 and 2, as especially of microphones or microphone cells, are provided with a predetermined mutual distance p along axis a. Acoustical signals IN are received by the transducers 1 and 2 as they impinge from different spatial directions θ. The acoustical signals IN have frequency spectra which vary in time. Output signals of transducer 1, Sx(t,ω) and of transducer 2, S2(t,ω), are formed as electrical signals at the output of the transducers 1 and 2. Due to the mutual distance p of the two transducers 1 and 2 - which is preferably smaller than 5 cm, preferably between 0,5 and 1,5 cm, especially for the inventive sensor being a one ear hearing aid apparatus - and as shown with the two respective pointer diagrams below the functional block diagram of fig. 6, the acoustical signals IN impinge on the transducers 1 and 2 with a time delay dt, which may be expressed by the phase difference Δφω at each spectral frequency ω according to
(1) Δφω = ω.dtω, where ( 2 ) dt„ cos θ„
If the source of acoustical signal IN is a point source, then the time delay dtω becomes equal for all spectral components at the different ω. The output signals S. and S2 of the transduc- ers 1 and 2 are operationally connected to the respective inputs of a time delay detection unit 10, which generates an output signal A10 according to the spectral distribution of time delays dtω, which are, as was explained, a function of the impinging angle θ at which the respective frequency components impinge on the transducers 1 and 2 and thus in fact of θω .
Purely as example a possible spectrum of output signal A10 is also shown in fig. 6. This spectrum varies in time according to the time variation of impinging acoustical signal IN. The output signal A10 of time delay detection unit 10 is input to a weighing unit 12. As the spectrum of dtω with respective spectral amplitudes of A10 is input to the weighing unit 12 with the preselected weighing transfer characteristic W, there results at a certain moment in time, as an output signal A12, a spectral signal W(ω), as also shown as an example in fig. 6. A12 results from respectively weighing the spectral amplitudes of A10 according to the characteristic W. As A10 indicates according to dtω from which direction θω each frequency component of the acoustical signal IN impinges, its specific weighing by means of function W is nothing else than predetermining which impinging directions θω shall be amplified or attenuated. Thus, the weighing unit 12 determines with its characteristic W the beam shape .
The output signal A12 is applied to a filter unit 14 with a controllable transfer filter characteristic. There, each spec- tral line of the time varying spectrum of the output signal S- tjCo) is amplified or attenuated according to the controlling spectrum Wω A10ω . Thus, unit 14 is a filter unit for input signal S1 at which the transfer characteristic is varied, as controlled by A12. In dependency of the kind of filter unit 14 the weighing unit 12, generally spoken, calculates adjustment of filter characteristic determining coefficients as a function of A10.
Thus, along the channels 10 and 12 there is predetermined by the weighing transfer function W which spatial directions θ shall be "aimed" at. At the filter unit 14 this beam shaping information is applied to the electrical analogon Sx of the acoustical signal IN, thus resulting in an output signal Sr(t,ω) representing the shaped reception signal.
By adjusting the weighing transfer function W by applying a control signal Cw to a control input C12, the beam form can be adjusted and thus acoustical zooming is realised.
As shown in dashed line, it may be advantageous to subject both transducer output signals to a controlled filtering at unit 14.
In fig. 7 there is shown a first preferred form of realisation of the inventive principle according to fig. 6. Thereby, the output signals Sx and S2 are first converted from analogue to digital form in respective analogue/digital converters 16 and 17. The digital output signals of the respective converters 16 and 17 are input to respective complex time domain/frequency domain converters 18 and 19.
The output spectra S1(t,ω) and S2(t,ω) of converters 18, 19 are input to the spectral time delay detection unit 10'. Unit 10' computes according to formula (1) the phase difference spectrum Δφω divided by the respective frequency ω to result in an output signal spectrum A10 ' according to the time delay dtω as was explained in connection with fig. 6. The output signal of the time delay detection unit 10', A10 ' , is further treated, as was explained in connection with fig. 6, by the weighing filter unit 12 and the controllable filter unit 14. In the following table there is exemplified how the unit 10' operates. Out of the spectral phase distribution φln of signal S- and φ2n of signal S2 the time delay dtω is calculated for each spectral line within an interesting spectral band.
So as to extract the phase information φ out of the two signals S- and S2 the time domain to frequency domain conversion units 18 and 19 perform complex (real and imaginary) operation.
A second preferred realisation form of the present invention, and especially as concerns realisation of the time delay detection unit 10, shall be explained with the help of fig. 8 and 9.
The output signal of one of the transducers, as shown e.g. of transducer 1, S1(t,ω) is fed to a time delay unit 20, wherein, in a first form of this realisation, signal Sλ is time delayed by a predetermined frequency independent time delay τ. Looking back on fig. 1, signal Sx accords thus with signal Ax .
The output signal of time delay unit 20 thus accords with signal A.1 of fig. 1.
The time delay signal according to Ax ' is superimposed to the output signal S2(t,ω) from transducer 2 at a superimposing unit 23 according to unit 3 of fig. 1, thus resulting in an output signal according to A_.(t,ω) of fig. 1. As is known, and as was explained in connection with fig. 1, the output signal A_.(t,ω) depends from the impinging acoustical signal direction θ ac- cording to the first order cardoid beam of fig. 2, which cardoid function nevertheless varies with frequency ω . The output signal A., of superimposing unit 23 and e.g. the output signal S2(t,ω) from transducer 2 are input to a ratio unit 25, as a comparator unit .
For understanding the functioning of ratio unit 25, attention is drawn to fig. 9. In fig. 9 the cardoid attenuation characteristic of output signal A. at a specific spectral frequency ωx is shown. At a specifically considered impinging angle θ0 the output signal A-. of superimposing unit 23 is Aro1) with an amplitude value as indicated in fig. 9. Simultaneously, at that frequency ωx considered and at that impinging angle ΘQ considered, the amplitude of signal S2 is A2o1) as also shown in fig. 9. It must be emphasised that as the amplitude A2o varies, the amplitude of A_.0 varies proportionally. Thus, the ratio of A_.0 to A20 according to fig. 9 is indicative of the impinging angle θ0. In the division unit 25 of fig. 8 there is formed for each spectral component amplitude the ratio of A. to A., wherefrom there results a signal spectrum at the output of division unit 25 with a ratio spectrum. The spectrum of A10 according to fig. 6 thus becomes the spectrum of an amplitude ratio which nevertheless is indicative of the impinging angle θ, at which each frequency component of the spectrum of the acoustical signal impinges with respect to the axis a of the two transducers (see fig. 6) . In fig. 8 the dotted line block indicates the delay detection unit 10 according to fig. 6. Further signal processing is performed as was explained by means of fig. 6, i.e. via weighing unit 12 and controllable filter unit 14.
In this embodiment it is possible to perform a time domain to frequency domain conversion at the output side of comparator unit 12.
Thus, the output ratio signal of unit 25 is a measure for the time delay dtω and is input to the weighing unit 12.
In fig. 10 there is shown the course of the ratio A_. to A0 as a function of θ at a specific frequency ωx.
This amplitude ratio is shown for τ at unit 20 of fig. 8 being selected to be
τ = p/c,
wherein p is the distance of the transducers 1 and 2 and c is the velocity of sound.
When selecting τ to be p/c and as may be seen from the cardoid beam function of fig. 2 signal attenuation or dampening for θ near 0° becomes very high.
Thus, in this area of impinging angle θ any kind of noise in A2 according to S2 of fig. 8 would falsify comparison result formed at unit 25. This problem can be eliminated by choosing a delay τ which is different, thereby preferably larger than p/c.
In fig. 11 the resulting cardoid diagram is shown for τ = 1.2 p/c, whereas fig. 12 shows in analogy to fig. 10 the course of the amplitude of A_. divided by the amplitude A- .
Further, it must be noted that the cardoid function as shown in the figures 2, 9 and 11 is only valid for one specific frequency considered. In fact, considering different frequencies, the cardoid function varies as shown in fig. 13, wherein the amplitude A_. of the output signal of superimposing unit 23 according to fig. 8 is shown for p = 12 mm, a delay τ of 42 microseconds and for frequencies of 0.5, 1, 2, 4 and 7.2 kHz. From this polar diagram the frequency dependency of the cardoid amplification function is clearly evident. Although such de- pendency may be neglected in a first approximation, in a preferred form of realising the inventive method principally as shown in fig. 8, such dependency is taken into account. Thus, a preferred realisation form of the fig. 8 technique is shown in fig. 14. Here, the same reference numbers are used as in the figures 7 or 8. The outputs of the transducers 1 and 2 are converted into digital form by respective analogue to digital converters 16, 17 and the resulting digital signal of transducer 1 is time delayed by a time delay τ', which is larger than p/c. The output signal S2 of transducer 2 is further converted into frequency domain by a linear (not complex) time to frequency domain conversion unit 18 ' , whereas the output signal A., of superimposing unit 23 is converted to frequency domain at a linear time to frequency domain conversion unit 19 ' . The frequency dependent polar diagram according to fig. 13 is taken into ac- count by a normaliser unit 30 which is in fact a filter. In a first embodiment the transfer characteristic of the filter is selected proportional to 1/ω. This results in a frequency dependency of the pole diagram as is shown in fig. 15 for the same distance and frequency values as shown in fig. 13.
As may be seen, a good matching is achieved for small angles θ and frequencies up to about 4 kHz . At 4 kHz the deviation is about 10 %, at θ = 180°.
A further, even improved normalisation function or filter characteristic at unit 30 of fig. 14 is achieved when the filter characteristic is selected as a function l/sin(ω). The result is shown in fig. 16. The characteristics match well from 0.5 to 4 kHz. A further advantage of this normalisation technique is improved sensitivity in backwards direction. This improved sensitivity may be exploited for adaptive beam forming, that is for selectively eliminating noise sources from the rear side.
It is evident for the skilled artisan, that such normalisation may be performed also in signal path 1 to 23 and/or 2 to 23.
In this embodiment of fig. 14 it is highly advantageous that only one-dimensional TFC ' s 18', 19' have to be used and not complex TFC's as in the embodiment of fig. 7.
Fig. 24 shows in block diagram form, that the signal A10 (dt() may also be generated as the output signal of a comparator unit 60 to which on one hand the output signal of an omnidirectional transducer 61, having equal amplification of its acousti- cal/electrical reception characteristic substantially irrespective of the impinging angle θ and the output signal of a directional transducer 62 with selected, beam shaped reception characteristic are led to. According to fig. 25 time delaying τ may also be performed by one of the transducers itself.
Thereby, in the embodiment of fig. 25 as well as of fig. 8 τ may be selected to be zero.
With the help of fig. 23 a further preferred embodiment, especially of realising the time delay detection unit 10 of fig. 6 shall be explained. The output signals of the transducers 1 and 2 are first converted by respective analogue to digital converters 16 and 17 and then by respective time domain to fre- quency domain converters 18, 19 finally into frequency domain. One signal, as an example S2, of the converted output signals of the transducers, which, after time to frequency domain conversion may be represented as a spectrum of S pointers, is converted to its conjugate complex pointers at a conversion unit 50. At the output of this unit 50, the conjugate, complex pointers S* are generated. This spectrum S2 * and the pointer spectrum Sx are multiplied to form the scalar product spectrum S3 in a multiplication unit 52. As may be shown, the pointers S3( of spectrum S3 have a phase angle with respect to the real axis, which is Δφω.
Thus , the imaginary part of the pointers S of S3 become
(3) Im (S) = |s I sin (Δφω)
with
(4) Δφω = ω (p/c) cos(θω) According to fig. 23, a conversion unit 53 forms the imaginary part of the pointers S and a further unit 54 forms the amplitudes I S I of these pointers .
For small values of Δφω the sinus in (3) may be approximated by Δφω itself, so that there results from (3)
(3)' Im (S3 = |s S* 2J ω(p/c) cos (Θ
Thus, and as performed by unit 55, dividing the imaginary parts Im (S) of the pointers S of spectrum S3 by the respective values of the scalar product according to | S | , there results an output signal which accords with Δφω. As was already explained with the help of fig. 7, Δφω is further divided in unit 56 by the respective pointer frequency co . The resulting signal is A10 according to fig. 6 or A10 ' according to fig. 7.
All the units 50, 52, 53, 54, 55 and 56 are preferably realised in one calculator unit .
Let's turn back to the generic block diagram of fig. 6 having described different possibilities of realising the delay detector unit 10.
By means of the figs 17 to 22 we will further explain with a specific example the effect of amplitude filter unit 12 and of controllable filter unit 14.
In fig. 17 there are shown examples of two weighing signal characteristics of unit 12. According characteristic I each dtM spectral line amplitude of signal A10 (see fig. 6) is attenu- ated to zero, if such amplitude is below or above predetermined values dtminω, dtmas ω and is set to be "one" if such spectral component amplitude is between these two values.
Such selection of weighing function W results in an output signal spectrum A12, as shown in the figures 18a and 18b.
The figures 18a and 18b are self-explanatory for the skilled artisan.
Fig. 19 shows a spectrum example of signal S-L . At the controllable filter unit 14 all spectral lines of S1 (Fig. b) are amplified by the value 1 according to A12 or are nullified ac- cording to zero values of A12. This results, according to fig. 20, in a spectrum Sr as an output signal spectrum of controllable filter unit 14 of fig. 6. If the weighing function I of fig. 17 is applied to the technique according to fig. 7 there results a beam form as shown in fig. 21 in strong lines. If an amplitude filter characteristic is applied as shown by II in fig. 17, there results the characteristic as shown in fig. 21 in dashed line .
Fig. 22 shows the resulting beam if in analogy to fig. 17 and with an eye on figures 8 and 9 all ratio values which exceed (A-VA- it-ax are discarded. This is realised by the amplitude filter characteristic as also indicated in Fig. 22.
In fig. 22 the ratio A../A., is denoted with r(ω) .
It is clear for the skilled artisan that only examples of the invention were described with the help of the figures. For in- stance more than two transducers or microphones arranged in linear, planar or spatial array form can be used. Additionally, directional microphones may be used instead of the omnidirec- tional. Beam forming following the inventive principle can also be made by the combination of the functions of two or more microphones . As is perfectly clear to the skilled artisan also the delay detector can be realised in many other ways. Further, normalisation, which was explained with the help of normaliser unit 30 in fig. 14, may clearly be done by providing time domain to frequency domain conversion just after the analogue to digital converters 16 and 17 and providing frequency-specific arrays or tables of time delays τω .

Claims

Claims :
1. A method for electronically forming a predetermined characteristic of amplification in dependency of direction (╬╕) from which acoustical signals (IN) are received at at least two spaced apart acoustical/electrical transducers (1, 2), comprising, at least within a predetermined frequency band, the steps of:
- repetitively determining from signals (S╬╣; S2) dependent from said acoustical signals a respective mutual delay signal
(dtω) according to reception delay at said at least two transducers ;
- subjecting a signal dependent from the output signal (S of at least one (1) of said at least two transducers (1, 2) to filtering with a filtering transfer characteristic (14) ;
- controlling said filtering transfer characteristic (14) in dependency of said mutual delay signal (A12) ;
- exploiting a signal dependent from the output signal of said filtering (14) as electrical reception signal (Sr) .
2. The method of claim 1, further comprising the step of determining said mutual delay signal (dtω) as a spectral signal.
3. The method of claim 1 or 2 , further comprising the step of performing said repetitive determining from said signals (S_, S2) converted into frequency domain.
4. The method of one of claims 1 to 3 , comprising the step of subjecting said signal dependent from the output signal (Sx) to said filtering converted into frequency domain.
5. The method of claim 4, further comprising the step of re- converting said signal exploited into time domain.
6. The method of one of claims 1 to 5 , further comprising the step of performing said determining by monitoring phase difference of spectral components of said signals and dividing said phase difference monitored by the frequency of said respective spectral components.
7. The method of one of claims 1 to 5 , thereby performing said determining by
- providing one of said at least two transducers with an at least approximately omnidirectional acoustical to electrical reception characteristic;
- providing one of said at least two transducers with a directional, beam-shaped acoustical to electrical reception characteristic;
- comparing signals dependent from the output signals of said at least two transducers and exploiting the result signal of said comparing as said mutual delay signal.
8. The method of one claims 1 to 5 , further comprising the step of performing said determining by
- superimposing signals dependent from the output signals of said at least two transducers and - comparing the result signal of said superimposing and at least one of said dependent signals.
9. The method of claim 8, further comprising the step of delaying one of said dependent signals before said superimposing by a predetermined or frequency dependent time amount .
10. The method of one of claims 1 to 5 , further comprising the step of performing said determining by
- converting signals dependent from the output signals of said at least two transducers into frequency domain;
- forming the conjugate complex pointers of one of said signals converted;
- multiplying the pointers of the other of said signals converted with said conjugate complex pointers to get multiplication result pointers;
- forming the amplitudes of said multiplication result pointers;
- forming the imaginary pointers components of said multiplication result pointers;
- forming the ratio of said imaginary pointer components and said amplitudes multiplied by the respective frequency,
the result signal of said ratio forming being said respective control delay signal in spectral representation.
11. The method of claim 9, further comprising the step of performing said delaying with a time delay which is different from, preferably larger than the quotient of the mutual dis- tance (p) of said at least two transducers (1, 2) and velocity (c) of sound.
12. The method of one of claims 7 to 9 or 11, further comprising the step of normalising at least one of the comparing re- suit signal, of the superimposing result signal and of at least one of said dependent signals with a frequency dependent normalising function (30) .
13. The method of one of claims 7 to 9, 11 or 12, further comprising the step of performing said comparing by spectrally forming the ratio of amplitudes of the superimposing result signal and of at least one of said dependent signals.
14. The method of one of claim 1 to 13, further comprising the step of controlling said transfer characteristic by subjecting said delay spectral signal to weighing and controlling said transfer characteristic by the result of said weighing.
15. The method of claim 14, further comprising the step of adjusting said predetermined characteristic of amplification by adjusting a weighing characteristic for said weighing.
16. An acoustical sensor apparatus comprising
- at least two acoustical/electrical transducers (1, 2) at a predetermined mutual distance (p) ;
- a time delay detection unit (10) with at least two inputs and an output, the inputs thereof being respectively operationally connected to the outputs of said at least two transduc- ers (1, 2) , said time delay detection unit (10) generating an output signal (A10) in dependency of the time delay of acous- tical signals (IN) impinging on said at least two transducers (1, 2) ;
- a weighing unit (12) with a predetermined weighing characteristic and with an input and with an output, the input thereof being operationally connected to the output of said time delay detection unit (10) ;
- a filter unit (14) with a controllable transfer characteristic and with at least one input, a characteristic control input and an output, the input thereof being operationally con- nected to the output of at least one of said at least two transducers, the control input thereof being operationally connected to the output of said weighing unit (12) , the filter unit (14) generating an output signal (Sr) in dependency of its input signal and said characteristic controlled by the signal (A12) applied at said control input, being dependent from said output signal of said delay detection unit converted by said weighing characteristic of said weighing unit .
17. The apparatus of claim 16, said control input of said filter unit (14) receiving said output signal of said delay detec- tion unit in frequency domain mode.
18. The apparatus of one of claims 16 or 17, further comprising time domain to frequency converters interconnected between said at least two transducers and said time delay detection unit (10) , said detection unit being a spectral time delay de- tection unit.
19. The apparatus of one of claims 16 to 18, wherein one of said at least two transducers is a transducer with at least approximately an omnidirectional acoustical/electrical reception characteristic on said time delay detection unit comprises a comparator unit, the inputs thereof being operationally connected to the outputs of said at least two transducers, the output of said comparator unit being operationally connected to the output of said time delay detection unit.
20. The apparatus of one of claims 16 to 18, said time delay detection unit comprising a superimposing unit, the inputs thereof being operationally connected to the outputs of said at least two transducers, the output thereof being operationally connected to the output of said time delay detection unit.
21. The apparatus of claim 20, wherein said time delay detection unit comprises a time delay unit (20) with an input operationally connected to the output of one of said transducers (1) and with an output operationally connected to one input of said superimposing unit (23), the second input of said superimposing unit being operationally connected to the output of the second of said at least two transducers (2) .
22. The apparatus of claim 21, wherein the output of said superimposing unit being operationally connected to one input of a comparator unit (25) , the second input thereof being operationally connected to said output of said second transducer (2) ;
the output of said comparator unit being the output of said spectral delay detector unit .
23. The apparatus of one of claims 21 or 22, wherein said time delay unit (20) performs signal delaying by an amount which is different than given by the mutual distance (p) of said trans- ducers (1, 2) divided by velocity of sound (c) , which is preferably larger.
24. The apparatus of one of the claims 16 to 23, wherein said time delay detection unit comprises a normalising filter unit (30) with predetermined transfer characteristic, which is provided at its input and/or output .
25. The apparatus of one of claims 20 to 24, wherein said comparator unit is a ratio forming unit of amplitudes of respective frequency components applied to its inputs.
26. The apparatus of claim 16, wherein said time delay detection unit (10) is a spectral time delay detection unit and performs spectral phase difference measurement (Δφω) and division of spectral phase difference by the respective frequency (ω) .
27. The apparatus of claim 26, wherein said time delay detection unit comprises a calculator unit with two inputs operationally connected to the outputs of said at least two transducers which
- forms the conjugate complex pointers of a signal at one of its inputs;
- multiplies said conjugate complex pointers with the respective pointers of the signal applied to its second input;
- divides the imaginary part of multiplying result pointers by the amplitude of said multiplying result pointers; - further divides the dividing result pointers by their respective frequency and emits as an output signal at its output the result pointers of said further dividing.
28. The apparatus of claim 16, further comprising a time to frequency domain conversion unit (18') interconnected between the output of said second transducer and said filter unit (14) .
29. The apparatus of claim 16, further comprising a time to frequency domain conversion unit (19') interconnected between the output of said superimposing unit (23) and control input of said frequency filter unit (14) .
30. The apparatus of one of claims 16 to 29, being a hearing aid apparatus, the mutual distance of said at least two transducers being 4 cm at most, preferably 0,5 cm to 1,5 cm.
31. The apparatus of one of claims 16 to 30, said weighing unit comprising a control input to adjust weighing characteristic of said weighing unit .
EP98922985A 1997-08-20 1998-06-08 A method for electronically beam forming acoustical signals and acoustical sensor apparatus Expired - Lifetime EP1005783B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP98922985A EP1005783B1 (en) 1997-08-20 1998-06-08 A method for electronically beam forming acoustical signals and acoustical sensor apparatus

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP97114413 1997-08-20
EP97114413A EP0820210A3 (en) 1997-08-20 1997-08-20 A method for elctronically beam forming acoustical signals and acoustical sensorapparatus
EP98922985A EP1005783B1 (en) 1997-08-20 1998-06-08 A method for electronically beam forming acoustical signals and acoustical sensor apparatus
PCT/IB1998/000889 WO1999009786A1 (en) 1997-08-20 1998-06-08 A method for electronically beam forming acoustical signals and acoustical sensor apparatus

Publications (2)

Publication Number Publication Date
EP1005783A1 true EP1005783A1 (en) 2000-06-07
EP1005783B1 EP1005783B1 (en) 2002-02-20

Family

ID=8227250

Family Applications (2)

Application Number Title Priority Date Filing Date
EP97114413A Withdrawn EP0820210A3 (en) 1997-08-20 1997-08-20 A method for elctronically beam forming acoustical signals and acoustical sensorapparatus
EP98922985A Expired - Lifetime EP1005783B1 (en) 1997-08-20 1998-06-08 A method for electronically beam forming acoustical signals and acoustical sensor apparatus

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP97114413A Withdrawn EP0820210A3 (en) 1997-08-20 1997-08-20 A method for elctronically beam forming acoustical signals and acoustical sensorapparatus

Country Status (14)

Country Link
EP (2) EP0820210A3 (en)
JP (1) JP2001516196A (en)
KR (1) KR20010023076A (en)
CN (1) CN1267445A (en)
AT (1) ATE213581T1 (en)
AU (1) AU746584B2 (en)
CA (1) CA2301216C (en)
DE (1) DE69803933T2 (en)
DK (1) DK1005783T3 (en)
IL (1) IL134435A (en)
NZ (1) NZ502883A (en)
RU (1) RU2185710C2 (en)
TR (1) TR200000457T2 (en)
WO (1) WO1999009786A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7209568B2 (en) 2003-07-16 2007-04-24 Siemens Audiologische Technik Gmbh Hearing aid having an adjustable directional characteristic, and method for adjustment thereof
EP2088802A1 (en) 2008-02-07 2009-08-12 Oticon A/S Method of estimating weighting function of audio signals in a hearing aid
EP2192794A1 (en) 2008-11-26 2010-06-02 Oticon A/S Improvements in hearing aid algorithms
EP2306457A1 (en) 2009-08-24 2011-04-06 Oticon A/S Automatic sound recognition based on binary time frequency units

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CH693759A5 (en) * 1999-01-06 2004-01-15 Martin Kompis Apparatus and method for suppression of St oergeraeuschen.
CA2341255C (en) * 1999-02-05 2003-09-09 Topholm & Westermann Aps Hearing aid with beam forming properties
EP1035752A1 (en) 1999-03-05 2000-09-13 Phonak Ag Method for shaping the spatial reception amplification characteristic of a converter arrangement and converter arrangement
US7324649B1 (en) 1999-06-02 2008-01-29 Siemens Audiologische Technik Gmbh Hearing aid device, comprising a directional microphone system and a method for operating a hearing aid device
JP2003532881A (en) * 2000-05-08 2003-11-05 マイクロブリッジ テクノロジーズ インコーポレイテッド Gas flow sensor, speaker system, and microphone utilizing measurement of absolute pressure over time
AU2000267447A1 (en) * 2000-07-03 2002-01-14 Nanyang Technological University Microphone array system
US7274794B1 (en) 2001-08-10 2007-09-25 Sonic Innovations, Inc. Sound processing system including forward filter that exhibits arbitrary directivity and gradient response in single wave sound environment
US7369669B2 (en) 2002-05-15 2008-05-06 Micro Ear Technology, Inc. Diotic presentation of second-order gradient directional hearing aid signals
US8027495B2 (en) 2003-03-07 2011-09-27 Phonak Ag Binaural hearing device and method for controlling a hearing device system
EP1326478B1 (en) 2003-03-07 2014-11-05 Phonak Ag Method for producing control signals and binaural hearing device system
US20040175008A1 (en) 2003-03-07 2004-09-09 Hans-Ueli Roeck Method for producing control signals, method of controlling signal and a hearing device
EP1320281B1 (en) 2003-03-07 2013-08-07 Phonak Ag Binaural hearing device and method for controlling such a hearing device
DE10312065B4 (en) * 2003-03-18 2005-10-13 Technische Universität Berlin Method and device for separating acoustic signals
DE10313330B4 (en) * 2003-03-25 2005-04-14 Siemens Audiologische Technik Gmbh Method for suppressing at least one acoustic interference signal and apparatus for carrying out the method
DE10334396B3 (en) * 2003-07-28 2004-10-21 Siemens Audiologische Technik Gmbh Electrical hearing aid has individual microphones combined to provide 2 microphone units in turn combined to provide further microphone unit with same order directional characteristic
US7212643B2 (en) 2004-02-10 2007-05-01 Phonak Ag Real-ear zoom hearing device
EP1443798B1 (en) * 2004-02-10 2006-06-07 Phonak Ag Real-ear zoom hearing device
DE102004010867B3 (en) * 2004-03-05 2005-08-18 Siemens Audiologische Technik Gmbh Matching phases of microphones of hearing aid directional microphone involves matching second signal level to first by varying transition time of output signal from microphone without taking into account sound source position information
WO2005109951A1 (en) * 2004-05-05 2005-11-17 Deka Products Limited Partnership Angular discrimination of acoustical or radio signals
DE102006046638A1 (en) 2005-12-15 2007-06-21 Strothmann, Rolf, Dr.rer.nat. Rotor`s rotating condition determining device for e.g. three-phase electrical machine, has comparison and classification device determining rotation angle interval, which is defined for rotating condition, from voltage difference values
US8249284B2 (en) 2006-05-16 2012-08-21 Phonak Ag Hearing system and method for deriving information on an acoustic scene
US8565459B2 (en) 2006-11-24 2013-10-22 Rasmussen Digital Aps Signal processing using spatial filter
JP4962572B2 (en) * 2007-08-03 2012-06-27 富士通株式会社 Sound receiver
US8396234B2 (en) 2008-02-05 2013-03-12 Phonak Ag Method for reducing noise in an input signal of a hearing device as well as a hearing device
DE102008046040B4 (en) 2008-09-05 2012-03-15 Siemens Medical Instruments Pte. Ltd. Method for operating a hearing device with directivity and associated hearing device
EP2262285B1 (en) 2009-06-02 2016-11-30 Oticon A/S A listening device providing enhanced localization cues, its use and a method
WO2011010292A1 (en) * 2009-07-24 2011-01-27 Koninklijke Philips Electronics N.V. Audio beamforming
DK2352312T3 (en) 2009-12-03 2013-10-21 Oticon As Method for dynamic suppression of ambient acoustic noise when listening to electrical inputs
DK2629551T3 (en) * 2009-12-29 2015-03-02 Gn Resound As Binaural hearing aid system
EP2372700A1 (en) 2010-03-11 2011-10-05 Oticon A/S A speech intelligibility predictor and applications thereof
EP2381700B1 (en) 2010-04-20 2015-03-11 Oticon A/S Signal dereverberation using environment information
WO2012010195A1 (en) 2010-07-19 2012-01-26 Advanced Bionics Ag Hearing instrument and method of operating the same
DK2439958T3 (en) 2010-10-06 2013-08-12 Oticon As Method for Determining Parameters of an Adaptive Sound Processing Algorithm and a Sound Processing System
EP2463856B1 (en) 2010-12-09 2014-06-11 Oticon A/s Method to reduce artifacts in algorithms with fast-varying gain
CN103329566A (en) 2010-12-20 2013-09-25 峰力公司 Method and system for speech enhancement in a room
EP3122072B1 (en) 2011-03-24 2020-09-23 Oticon A/s Audio processing device, system, use and method
EP2519032A1 (en) 2011-04-26 2012-10-31 Oticon A/s A system comprising a portable electronic device with a time function
EP2528358A1 (en) 2011-05-23 2012-11-28 Oticon A/S A method of identifying a wireless communication channel in a sound system
EP2541973B1 (en) 2011-06-27 2014-04-23 Oticon A/s Feedback control in a listening device
EP2560410B1 (en) 2011-08-15 2019-06-19 Oticon A/s Control of output modulation in a hearing instrument
DK2563044T3 (en) 2011-08-23 2014-11-03 Oticon As A method, a listening device and a listening system to maximize a better ear effect
DK2563045T3 (en) 2011-08-23 2014-10-27 Oticon As Method and a binaural listening system to maximize better ear effect
EP2574082A1 (en) 2011-09-20 2013-03-27 Oticon A/S Control of an adaptive feedback cancellation system based on probe signal injection
EP2584794A1 (en) 2011-10-17 2013-04-24 Oticon A/S A listening system adapted for real-time communication providing spatial information in an audio stream
DK2613567T3 (en) 2012-01-03 2014-10-27 Oticon As Method for improving a long-term feedback path estimate in a listening device
DK2613566T3 (en) 2012-01-03 2016-10-17 Oticon As A listening device and method for monitoring the placement of an earplug for a listening device
CN104853671B (en) * 2012-12-17 2019-04-30 皇家飞利浦有限公司 The sleep apnea diagnostic system of information is generated using non-interfering audio analysis
CN104464739B (en) * 2013-09-18 2017-08-11 华为技术有限公司 Acoustic signal processing method and device, Difference Beam forming method and device
CN112240909A (en) * 2020-09-30 2021-01-19 山东大学 Bridge inhaul cable broken wire sound signal acquisition system and method
CN112492475B (en) * 2020-11-30 2022-01-11 瑞声新能源发展(常州)有限公司科教城分公司 MEMS microphone and working control method thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4884265A (en) * 1987-04-30 1989-11-28 Loral Corporation Digital demodulator for frequency-division-multiplexed signals
GB8724932D0 (en) * 1987-10-23 1987-11-25 Szeto L W M Analysing signals
US5473701A (en) * 1993-11-05 1995-12-05 At&T Corp. Adaptive microphone array

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO9909786A1 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7209568B2 (en) 2003-07-16 2007-04-24 Siemens Audiologische Technik Gmbh Hearing aid having an adjustable directional characteristic, and method for adjustment thereof
EP2088802A1 (en) 2008-02-07 2009-08-12 Oticon A/S Method of estimating weighting function of audio signals in a hearing aid
EP2192794A1 (en) 2008-11-26 2010-06-02 Oticon A/S Improvements in hearing aid algorithms
EP2306457A1 (en) 2009-08-24 2011-04-06 Oticon A/S Automatic sound recognition based on binary time frequency units

Also Published As

Publication number Publication date
WO1999009786A1 (en) 1999-02-25
ATE213581T1 (en) 2002-03-15
IL134435A (en) 2004-03-28
CA2301216A1 (en) 1999-02-25
DE69803933T2 (en) 2002-10-10
EP1005783B1 (en) 2002-02-20
NZ502883A (en) 2002-10-25
DK1005783T3 (en) 2002-05-21
EP0820210A2 (en) 1998-01-21
AU746584B2 (en) 2002-05-02
IL134435A0 (en) 2001-04-30
EP0820210A3 (en) 1998-04-01
CA2301216C (en) 2004-07-13
AU7544198A (en) 1999-03-08
CN1267445A (en) 2000-09-20
KR20010023076A (en) 2001-03-26
RU2185710C2 (en) 2002-07-20
JP2001516196A (en) 2001-09-25
TR200000457T2 (en) 2000-05-22
DE69803933D1 (en) 2002-03-28

Similar Documents

Publication Publication Date Title
EP1005783B1 (en) A method for electronically beam forming acoustical signals and acoustical sensor apparatus
AU749652B2 (en) Method for electronically selecting the dependency of an output signal from the spatial angle of acoustic signal impingement and hearing aid apparatus
US7409068B2 (en) Low-noise directional microphone system
CA2407855C (en) Interference suppression techniques
JP4732483B2 (en) Directional audio signal processing using oversampled filter banks
US7492916B2 (en) Method for manufacturing acoustical devices and for reducing especially wind disturbances
US20040252852A1 (en) Hearing system beamformer
US6603861B1 (en) Method for electronically beam forming acoustical signals and acoustical sensor apparatus
AU2004202688B2 (en) Method For Operation Of A Hearing Aid, As Well As A Hearing Aid Having A Microphone System In Which Different Directional Characteristics Can Be Set
EP1391138B1 (en) Method of generating an electrical output signal and acoustical/electrical conversion system
WO2000054553A1 (en) Method for shaping the spatial reception amplification characteristic of a converter arrangement and converter arrangement
WO2007096247A1 (en) Hearing device providing smooth transition between operational modes of a hearing aid
US20040037437A1 (en) Directional microphone
US6947570B2 (en) Method for analyzing an acoustical environment and a system to do so
US7502479B2 (en) Method for analyzing an acoustical environment and a system to do so
CA2390844A1 (en) A method for analyzing an acoustical environment and a system to do so

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20000203

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

17Q First examination report despatched

Effective date: 20010327

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020220

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 20020220

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020220

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020220

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020220

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020220

REF Corresponds to:

Ref document number: 213581

Country of ref document: AT

Date of ref document: 20020315

Kind code of ref document: T

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 69803933

Country of ref document: DE

Date of ref document: 20020328

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: TROESCH SCHEIDEGGER WERNER AG

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020520

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020520

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20020608

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20020608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20020610

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020630

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
ET Fr: translation filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20020829

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20021121

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20040602

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050608

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20050608

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20060608

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20080229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070702

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20150629

Year of fee payment: 18

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20170626

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20170628

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 69803933

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EUP

Effective date: 20180608