EP3048813A1 - Method and device for suppressing noise based on inter-subband correlation - Google Patents
Method and device for suppressing noise based on inter-subband correlation Download PDFInfo
- Publication number
- EP3048813A1 EP3048813A1 EP15198238.6A EP15198238A EP3048813A1 EP 3048813 A1 EP3048813 A1 EP 3048813A1 EP 15198238 A EP15198238 A EP 15198238A EP 3048813 A1 EP3048813 A1 EP 3048813A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- frequency band
- band
- correlation
- signal
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000001629 suppression Effects 0.000 claims abstract description 28
- 230000006870 function Effects 0.000 claims abstract description 16
- 230000005236 sound signal Effects 0.000 claims abstract description 15
- 238000001514 detection method Methods 0.000 claims description 2
- 230000003071 parasitic effect Effects 0.000 claims 1
- 230000003044 adaptive effect Effects 0.000 description 9
- 230000003595 spectral effect Effects 0.000 description 5
- 210000000988 bone and bone Anatomy 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 210000000613 ear canal Anatomy 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 208000032041 Hearing impaired Diseases 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 210000000883 ear external Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000011295 pitch Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
- H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
- H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
Definitions
- the invention relates to a method for suppressing noise in hearing aids and a corresponding hearing aid.
- Incoming audio signals are divided into frequency bands.
- Hearing aids are portable hearing aids that are used to care for the hearing impaired.
- different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
- BTE behind-the-ear hearing aids
- RIC hearing aid with external receiver
- ITE in-the-ear hearing aids
- ITE in-the-ear hearing aids
- ITE in-the-ear hearing aids
- ITE concha hearing aids or canal hearing aids
- the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
- bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
- Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
- the input transducer is usually an acousto-electrical converter, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
- the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
- the amplifier is usually integrated in a signal processing device.
- the power is usually supplied by a battery or a rechargeable battery.
- the hearing aid it is therefore necessary for the hearing aid to perform some of these functions. It is already known to suppress noise, for example, by a directional characteristic or to reduce using their spectral properties of an input signal from the microphones.
- the object of the present invention is therefore to provide a hearing aid device and a method for operating a hearing aid, which improve speech understanding in the case of noise suppression.
- this object is achieved by a method for operating a hearing aid according to claim 1 and a hearing aid according to claim 11.
- the inventive method for noise suppression in hearing aids has the step of dividing an audio signal into a plurality of substantially disjoint frequency bands.
- the audio signal can come from one or more microphones, a signal input or a wireless transmission device.
- the signal can be analog or digital.
- the splitting into frequency bands can be done with one or more filter means, for example a filter bank, several discrete filters or by a transformation into a frequency space. This is to be understood essentially disjoint that the individual frequency bands overlap only to a limited extent or not at all, for example at most a quarter, a tenth or twentieth of their bandwidth.
- a reference band of the plurality of frequency bands is selected, which has a detectable first portion of a speech signal.
- the hearing aid has means for recognizing a voice component. Possible means can detect this on the basis of a spectral distribution, temporal dynamics, but also on the basis of an origin direction of the audio signals recorded by a plurality of microphones of a hearing aid.
- a controller of the hearing aid can select with the help of this means a frequency band with a voice portion as the reference band.
- the hearing aid device determines a correlation between a first frequency band and the reference band. This can be done, for example, with a device for determining a correlation.
- a value is determined as a function of the ascertained correlation, which indicates a second portion of a speech signal in the first frequency band. This can be done for example by the controller. It is conceivable that, based on a strong correlation between the first frequency band and the reference band, it can be concluded that the first frequency band also has a signal component with speech. However, it is also conceivable that the first frequency band is also evaluated by a means for recognizing a speech component. It is also possible for the means for recognizing a speech component to be applied only to the first frequency band if a sufficiently high correlation with the first frequency band has been determined.
- noise suppression in the first frequency band is set as a function of the determined values.
- the method according to the invention makes it possible in an advantageous manner to make the noise suppression in the individual frequency bands dependent on whether they have a voice signal component.
- the selection of a reference band also makes it possible to recognize the language preferably in frequency ranges, where this is easier due to the speech spectrum, for example, and to transfer the result to other channels with a lower content, where this is more difficult, by correlating with the presence of a voice component is confirmed to the first frequency range.
- the method according to the invention is carried out in parallel or sequentially with the steps of determining a correlation, determining a value and setting a noise suppression for a plurality of first frequency bands.
- the method according to the invention is repeated and carried out with a second reference band. It is conceivable that the second reference band is equal to the first reference band or differs from the first reference band.
- the selection of a reference band is made by selecting the frequency band with the highest energy in comparison to the other frequency bands of the plurality of frequency bands.
- the energy over the square of the amplitude is equivalent to the amplitude of the signal in the frequency band.
- a single voice has e.g. in the case of vowels, a high energy density in a narrow frequency range, so that a voice component in a frequency band with high energy is likely.
- the selection of a reference band is effected by the selection of the frequency band having a greatest degree of modulation in a predetermined frequency range.
- a high degree of modulation in a frequency band indicates a voice activity in this frequency band and can be determined with low processor load.
- the degree of modulation in a frequency range e.g. is characteristic of the modulation frequency of the speech
- the recognition certainty can be increased.
- the correlation between the first frequency band and the reference band is determined on the basis of a signal amplitude or a signal energy of a signal of the first frequency band and reference band.
- the correlation can be determined particularly easily.
- the correlation between the first frequency band and the reference band is determined on the basis of a degree of modulation of a signal of the first frequency band and reference band in a predetermined frequency range.
- a degree of modulation with in a predetermined frequency range of a speech modulation between one hertz and five or ten hertz for determining the correlation.
- the correlation of the momentary or via a moving window determines modulation degree reliable detection, whether in the first frequency band, a voice component is present.
- the correlation over a window length is determined as a function of the first audio signal.
- the correlation must always be determined over a certain number of values that indicate a certain period of time during the course of the signals. This period or the number of values is also referred to as window length. It may be advantageous to change this window length depending on the environment and thus the first audio signal. For example, in the case of rapid changes in the input signal, it is necessary to reduce the window length in order to be able to react faster to environmental changes with the noise suppression.
- a value for a speech component of a signal is determined by comparing the correlation with a predetermined threshold value.
- the reference band is selected in the method according to the invention such that it preferably has a speech component. If the first frequency band has a correlation with a sufficiently high value, that is, the reference band and the first frequency band have properties sufficiently in common, then it can advantageously be assumed that the first frequency band also has speech components.
- a noise suppression parameter is set, which is a parameter for influencing a noise signal estimation, a parameter for setting the strength of the interference signal suppression or a parameter for limiting interference suppression.
- the noise suppression in a frequency band can thus be adjusted as a function of a detected speech component in such a way that noise is generated preferably be suppressed and speech components remain as uninfluenced
- Fig. 1 shows the basic structure of a hearing aid according to the invention 110.
- a hearing aid housing 1 for carrying behind the ear, one or more electro-acoustic transducers 2 for receiving the sound or acoustic signals from the environment are arranged.
- the acousto-electrical converters 2 are, for example, microphones for converting the sound into an electrical input signal.
- the hearing aid device 110 can also have a recording device 6 for receiving an electrical or electromagnetic signal and conversion into an electrical input signal.
- a signal processing device 3, which also integrates into the hearing aid housing 1 is, processes the first electrical signals and is for this purpose in signal communication with the microphone and / or the recording device 6.
- the output signal of the signal processing device 3 is transmitted to a loudspeaker or listener 4, which outputs an acoustic signal.
- the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
- a sound tube which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
- electro-acoustic and other electro-mechanical transducers such as bone conduction.
- the power supply of the hearing device, and in particular that of the signal processing device 3, is effected by a battery 5 likewise integrated into the hearing device housing 1.
- the hearing aid device 110 also has a noise suppression device 20 which, as in FIG Fig. 1 is shown part of the signal processing device 3, or is also designed as a separate noise canceling device 20 in the hearing aid 110.
- the further signal processing functions of the signal processing 3 are shown as block 12.
- the noise suppression device 20 is in signal communication with the microphone 2 and the pickup device 6.
- the noise canceling device 20 is configured to reduce a noise in the first electrical signal.
- a noise suppression device 20 is Fig. 2 shown in more detail in function blocks.
- the electrical input signal of a microphone or the recording device 6 is already divided by the signal processing device 3 in a plurality of signals with substantially disjoint Frequenz selected before it the noise suppression device 20 is supplied.
- This essentially means that the frequency bands do not overlap or overlap only slightly.
- noise suppression device 20 is provided in the hearing aid 110 several times for different frequency bands, in Fig.2 but only represented for a single frequency band.
- the multiple noise suppression can be done for example by multiple parallel functional units or by a sequential processing for the individual frequency bands with a functional unit
- an input filter 21 is used to provide an envelope of a first, individual frequency band and limited by a bandpass filter 22 in frequency to a characteristic range for speech in order to facilitate the subsequent steps.
- These are typical modulation frequencies between one hertz and 5 or even 10 Hz.
- no separate preparation takes place or this takes place in another way.
- other characteristic features of speech may subsequently be used, for example a spectral energy distribution or dynamic variations.
- a reference band selector 23 selects a reference band from the plurality of frequency bands. This is the in Fig. 2 Reference band selector means 23 is in signal connection (not shown) with other reference band selection means for other frequency bands or is part of frequency band crossing reference band selection means 23.
- a same frequency band may always be selected as reference band, for example in a frequency range typical of speech.
- a reference band is selected dynamically for a variable period of time, which has characteristic features, for example for speech. These may include dynamic fluctuations with a typical dynamic range or with a typical fluctuation frequency, for example less than 10, 5 or 2 Hertz.
- the correlation determination described below preferably takes place for the selected reference band and at least one further, different frequency band.
- a subband correlation determination device 24 is supplied with the signal of the reference band as well as with at least one different frequency band, wherein the signal connection in Fig. 2 not shown.
- the different frequency band is the first frequency band supplied to the noise suppression device 20, unless it is the reference band itself.
- the subband correlation determiner 24 determines a value for a correlation between the reference band and the first frequency band.
- the subband correlation determining means 24 preferably provides, by means of the speech identification means 26, a value for a probability that the signal of the first frequency band has a speech content.
- the subband correlation determination device 24 can also provide a binary signal by means of a decision device 25 as to whether the first frequency band has a voice signal.
- a parameter setting means 27 determines suitable parameters for an adaptive noise filter 28 based on the binary signal and / or the probability value.
- the gain of the adaptive noise filter 28 can be set to zero if there is no speech component in the first frequency band. It is also conceivable that the gain is proportional or otherwise dependent on the probability value. It is also possible, other parameters of the adaptive noise filter 28 in other ways depending on the binary signal and / or the probability signal.
- the step size could be adapted for an adaptive adaptation of the filter, for example a Wiener filter.
- the adaptive noise filter 28 preferably reduces a level of noise over speech portions in the first frequency band due to the parameter setting.
- Fig. 3 shows a schematic flowchart of a method according to the invention.
- an audio signal is divided into a plurality of substantially disjoint frequency bands.
- the audio signal preferably originates from one or more microphones, but the source can also be, for example, an electrical signal input or a wireless transmission device.
- the division into subbands can be done with one or more filter means, for example a filter bank, several discrete filters or by a transformation into a frequency space. This is to be understood essentially disjoint that the individual frequency bands overlap only to a limited extent or not at all, for example at most a quarter, a tenth or twentieth of their bandwidth.
- a first frequency band of the plurality of frequency bands is selected as the reference band, which has a detectable first portion of a speech signal.
- the hearing aid has means for recognizing a voice component.
- This agent can be used in Fig. 2 be shown Referenzbandausschmikll Surprise.
- Possible means can recognize a voice component based on a spectral distribution, temporal dynamics, but also on the basis of an origin direction of the audio signals recorded by a plurality of microphones of a hearing aid.
- a controller or the Referenzbandausschmikll planted 23 of the hearing aid can thus select a frequency band with a voice component as the reference band. It is also conceivable, however, for the means for selecting to select by default a specific frequency band typical for speech.
- the hearing aid device determines a correlation between the first frequency band and the reference band. This can be done, for example, by means of the subband correlation determination device 24. Methods for determining a correlation are in the description too Fig. 2 specified.
- the first frequency band is a different frequency band than the reference band.
- the correlation value is then maximum because of the identity.
- the decision device 25 and / or the speech identification device 26 determines a value which indicates a second portion of a speech signal in the second frequency band as a function of the ascertained correlation. It can be a binary value, a binary mask, or a fuzzy value in the sense of a fuzzy logic that indicates a probability. It is conceivable that, based on a strong correlation between the first frequency band and the reference band, it can be concluded that the first frequency band also has a signal component with speech. However, it is also conceivable that the first frequency band is also evaluated by a means for recognizing a speech component. It is also possible that the voice identification device 26 is applied only to the first frequency band when a sufficiently high correlation with the first frequency band has been determined and the decision means 25 assumes a corresponding value as "binary mask".
- a noise suppression in the first frequency band is set as a function of the determined value.
- the gain of the noise filter 28 can be set to zero if there is no speech component in the first frequency band. It is also conceivable that the gain is proportional or otherwise dependent on the probability value. It is also possible to set other parameters of an adaptive noise filter in other ways depending on the binary signal and / or the probability signal. Thus, the step size for an adaptive adaptation of the filter, e.g. a Wiener filter, or the maximum possible reduction be adjusted.
- the adaptive noise filter preferably reduces a level of noise over speech portions in the first frequency band due to the parameter setting.
- the steps S30 to S50 are executed for all the frequency bands of the plurality of frequency bands either in parallel or sequentially one after the other.
- the steps S10 to S50 are repeated cyclically at predetermined or variable intervals, wherein the step S20 can be executed only once or also repeated with a variable reference band.
- steps S30 to S50 for several or all of the frequency bands are preferably executed in parallel or sequentially.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Die Erfindung betrifft ein Verfahren zur Störgeräuschunterdrückung in Hörhilfegeräten sowie eine Hörvorrichtung zur Ausführung des Verfahrens. In einem Schritt des Verfahrens wird ein erstes Audiosignal in eine Mehrzahl von im Wesentlichen disjunkten Frequenzbändern aufgeteilt. In einem weiteren Schritt des Verfahrens wird ein Referenzband aus der Mehrzahl an Frequenzbändern ausgewählt, das einen feststellbaren ersten Anteil eines Sprachsignals aufweist. In einem anderen Schritt wird eine Korrelation zwischen dem Referenzband und einem ersten Frequenzband ermittelt. In einem weiteren Schritt wird ein Wert, der einen zweiten Anteil eines Sprachsignals in dem ersten Frequenzband angibt, in Abhängigkeit von der Korrelation ermittelt. In einem anderen Schritt des Verfahrens wird eine Störgeräuschunterdrückung in dem ersten Frequenzband in Abhängigkeit des ermittelten Wertes eingestellt.The invention relates to a method for noise suppression in hearing aids and a hearing device for carrying out the method. In a step of the method, a first audio signal is split into a plurality of substantially disjoint frequency bands. In a further step of the method, a reference band is selected from the plurality of frequency bands having a detectable first portion of a speech signal. In another step, a correlation between the reference band and a first frequency band is determined. In a further step, a value indicating a second portion of a speech signal in the first frequency band is determined as a function of the correlation. In another step of the method, noise suppression in the first frequency band is set as a function of the determined value.
Description
Die Erfindung betrifft ein Verfahren zum Unterdrücken von Störgeräuschen in Hörhilfegeräten sowie ein entsprechendes Hörhilfegerät. Dabei werden eingehende Audiosignale in Frequenzbänder aufgeteilt.The invention relates to a method for suppressing noise in hearing aids and a corresponding hearing aid. Incoming audio signals are divided into frequency bands.
Hörhilfegeräte sind tragbare Hörvorrichtungen, die zur Versorgung von Schwerhörenden dienen. Um den zahlreichen individuellen Bedürfnissen entgegenzukommen, werden unterschiedliche Bauformen von Hörhilfegeräten wie Hinter-dem-Ohr-Hörgeräte (HdO), Hörgerät mit externem Hörer (RIC: receiver in the canal) und In-dem-Ohr-Hörgeräte (IdO), z.B. auch Concha-Hörgeräte oder Kanal-Hörgeräte (ITE, CIC), bereitgestellt. Die beispielhaft aufgeführten Hörgeräte werden am Außenohr oder im Gehörgang getragen. Darüber hinaus stehen auf dem Markt aber auch Knochenleitungshörhilfen, implantierbare oder vibrotaktile Hörhilfen zur Verfügung. Dabei erfolgt die Stimulation des geschädigten Gehörs entweder mechanisch oder elektrisch.Hearing aids are portable hearing aids that are used to care for the hearing impaired. In order to meet the numerous individual needs, different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC). The hearing aids listed by way of example are worn on the outer ear or in the ear canal. In addition, bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
Hörhilfegeräte besitzen prinzipiell als wesentliche Komponenten einen Eingangswandler, einen Verstärker und einen Ausgangswandler. Der Eingangswandler ist in der Regel ein akusto-elektrischer Wandler, z. B. ein Mikrofon, und/oder ein elektromagnetischer Empfänger, z. B. eine Induktionsspule. Der Ausgangswandler ist meist als elektroakustischer Wandler, z. B. Miniaturlautsprecher, oder als elektromechanischer Wandler, z. B. Knochenleitungshörer, realisiert. Der Verstärker ist üblicherweise in eine Signalverarbeitungseinrichtung integriert. Die Energieversorgung erfolgt üblicherweise durch eine Batterie oder einen aufladbaren Akkumulator.Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer. The input transducer is usually an acousto-electrical converter, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil. The output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized. The amplifier is usually integrated in a signal processing device. The power is usually supplied by a battery or a rechargeable battery.
Bei Personen mit einem verminderten Hörvermögen ist insbesondere das Sprachverständnis bei hohem Umgebungslärm erschwert, da die natürlichen Mechanismen zur Selektion bestimmter Schallquellen in der Signalverarbeitung im Gehirn aufgrund eines im Frequenz- und Dynamikumfangs verringerten Eingangssignal vom Ohr nicht oder nur in verringertem Maß wirksam sind.In persons with a reduced hearing ability, speech understanding is particularly difficult in the case of high ambient noise, because the natural mechanisms for the selection of certain sound sources in the signal processing in the brain are not or only to a lesser extent effective due to a reduced input and frequency signal from the ear in the frequency and dynamic range.
Es ist daher erforderlich, dass das Hörhilfegerät einen Teil dieser Funktionen übernimmt. Es ist dabei bereits bekannt, Störgeräusche beispielsweise durch eine Richtcharakterisik auszublenden oder mithilfe ihrer spektralen Eigenschaften aus einem Eingangssignal von den Mikrofonen zu reduzieren.It is therefore necessary for the hearing aid to perform some of these functions. It is already known to suppress noise, for example, by a directional characteristic or to reduce using their spectral properties of an input signal from the microphones.
Dabei werden auch adaptive Filter genutzt, die Eigenschaften eines Störgeräuschs schätzen bzw. vorhersagen und ein entsprechend geschätztes Signal aus dem Eingangssignal herausfiltern. Derartige Verfahren sind beispielsweise aus den Veröffentlichungen von
Eine derartige Geräuschunterdrückung kann aber bei Sprache, die einen hohen Dynamikbereich mit schnellen Änderungen umfasst, zu unerwünschten Artefakten führen, die die Sprachverständlichkeit stören.However, such noise suppression can result in unwanted artifacts that disrupt speech intelligibility in speech that includes high dynamic range with rapid changes.
Die Aufgabe der vorliegenden Erfindung ist es daher, ein Hörhilfegerät und ein Verfahren zum Betrieb eines Hörhilfegeräts bereitzustellen, die das Sprachverständnis bei einer Störgeräuschunterdrückung verbessern.The object of the present invention is therefore to provide a hearing aid device and a method for operating a hearing aid, which improve speech understanding in the case of noise suppression.
Erfindungsgemäß wird diese Aufgabe gelöst durch ein Verfahren zum Betrieb eines Hörhilfegeräts nach Anspruch 1 sowie ein Hörhilfegerät nach Anspruch 11.According to the invention, this object is achieved by a method for operating a hearing aid according to claim 1 and a hearing aid according to claim 11.
Das erfindungsgemäße Verfahren zur Störgeräuschunterdrückung in Hörhilfegeräten weist den Schritt auf, eine Audiosignal in eine Mehrzahl von im Wesentlichen disjunkten Frequenzbändern aufzuteilen.The inventive method for noise suppression in hearing aids has the step of dividing an audio signal into a plurality of substantially disjoint frequency bands.
Das Audiosignal kann dabei von einem oder mehreren Mikrofonen, einem Signaleingang oder einer drahtlosen Übertragungseinrichtung stammen. Das Signal kann dabei analog oder digital sein. Das Aufteilen in Frequenzbänder kann mit einem oder mehreren Filtermitteln erfolgen, beispielsweise einer Filterbank, mehreren diskreten Filtern oder durch eine Transformation in einen Frequenzraum. Dabei ist unter im Wesentlichen disjunkt zu verstehen, dass sich die einzelnen Frequenzbänder nur in geringem Umfang oder gar nicht überlappen, beispielsweise um höchstens ein Viertel, ein Zehntel oder Zwanzigstel ihrer Bandbreite.The audio signal can come from one or more microphones, a signal input or a wireless transmission device. The signal can be analog or digital. The splitting into frequency bands can be done with one or more filter means, for example a filter bank, several discrete filters or by a transformation into a frequency space. This is to be understood essentially disjoint that the individual frequency bands overlap only to a limited extent or not at all, for example at most a quarter, a tenth or twentieth of their bandwidth.
In einem Schritt des erfindungsgemäßen Verfahrens wird ein Referenzband der Mehrzahl an Frequenzbändern ausgewählt, welches einen feststellbaren ersten Anteil eines Sprachsignals aufweist.In a step of the method according to the invention, a reference band of the plurality of frequency bands is selected, which has a detectable first portion of a speech signal.
Dabei ist es denkbar, dass das Hörhilfegerät Mittel zum Erkennen eines Sprachanteils aufweist. Mögliche Mittel können dies anhand einer spektralen Verteilung, zeitlicher Dynamik, aber auch anhand einer Ursprungsrichtung der von mehreren Mikrofonen eines Hörhilfegeräts aufgenommenen Audiosignale erkennen. Eine Steuerung des Hörhilfegeräts kann mit Hilfe dieses Mittels ein Frequenzband mit einem Sprachanteil als Referenzband auswählen.It is conceivable that the hearing aid has means for recognizing a voice component. Possible means can detect this on the basis of a spectral distribution, temporal dynamics, but also on the basis of an origin direction of the audio signals recorded by a plurality of microphones of a hearing aid. A controller of the hearing aid can select with the help of this means a frequency band with a voice portion as the reference band.
In einem Schritt des erfindungsgemäßen Verfahrens ermittelt das Hörhilfegerät eine Korrelation zwischen einem ersten Frequenzband und dem Referenzband. Dies kann beispielsweise mit einer Einrichtung zum Ermitteln einer Korrelation erfolgen.In one step of the method according to the invention, the hearing aid device determines a correlation between a first frequency band and the reference band. This can be done, for example, with a device for determining a correlation.
In einem Schritt des erfindungsgemäßen Verfahrens wird ein Wert in Abhängigkeit von der ermittelten Korrelation ermittelt, der einen zweiten Anteil eines Sprachsignals in dem ersten Frequenzband angibt. Dies kann beispielsweise durch die Steuerung erfolgen. Dabei ist es denkbar, dass anhand einer starken Korrelation zwischen dem ersten Frequenzband und dem Referenzband geschlossen werden kann, dass auch das erste Frequenzband einen Signalanteil mit Sprache aufweist. Es ist aber ebenso denkbar, dass das erste Frequenzband ebenfalls mit einem Mittel zum Erkennen eines Sprachanteils bewertet wird. Ebenso ist es möglich, dass das Mittel zum Erkennen eines Sprachanteils nur auf das erste Frequenzband angewandt wird, wenn eine ausreichend hohe Korrelation mit dem ersten Frequenzband ermittelt wurde.In one step of the method according to the invention, a value is determined as a function of the ascertained correlation, which indicates a second portion of a speech signal in the first frequency band. This can be done for example by the controller. It is conceivable that, based on a strong correlation between the first frequency band and the reference band, it can be concluded that the first frequency band also has a signal component with speech. However, it is also conceivable that the first frequency band is also evaluated by a means for recognizing a speech component. It is also possible for the means for recognizing a speech component to be applied only to the first frequency band if a sufficiently high correlation with the first frequency band has been determined.
In einem weiteren Schritt des erfindungsgemäßen Verfahrens wird eine Störgeräuschunterdrückung in dem ersten Frequenzband in Abhängigkeit von dem ermittelten Werte eingestellt.In a further step of the method according to the invention, noise suppression in the first frequency band is set as a function of the determined values.
Das erfindungsgemäße Verfahren ermöglicht es auf vorteilhafte Weise, die Störgeräuschunterdrückung in den einzelnen Frequenzbändern davon abhängig zu machen, ob diese einen Sprachsignalanteil aufweisen. So ist es denkbar, keine oder nur eine reduzierte Störgeräuschunterdrückung anzuwenden, wenn Sprache vorhanden ist, um dies nicht durch Artefakte in ihrer Verständlichkeit zu verschlechtern.The method according to the invention makes it possible in an advantageous manner to make the noise suppression in the individual frequency bands dependent on whether they have a voice signal component. Thus, it is conceivable to apply no or only a reduced noise suppression, if there is language, in order not to impair this by artifacts in their comprehensibility.
Die Auswahl eines Referenzbandes ermöglicht es darüber hinaus, die Sprache bevorzugt in Frequenzbereichen zu erkennen, wo dies z.B. aufgrund des Sprachspektrums einfacher ist, und das Ergebnis auch auf andere Kanäle mit geringerem Anteil zu übertragen, in denen dies schwieriger ist, indem über die Korrelation mit dem ersten Frequenzbereich das Vorhandensein eines Sprachanteils bestätigt wird.The selection of a reference band also makes it possible to recognize the language preferably in frequency ranges, where this is easier due to the speech spectrum, for example, and to transfer the result to other channels with a lower content, where this is more difficult, by correlating with the presence of a voice component is confirmed to the first frequency range.
In einer denkbaren Ausführungsform wird das erfindungsgemäße Verfahren mit den Schritten Ermitteln einer Korrelation, Ermitteln eines Wertes und Einstellen einer Störgeräuschunterdrückung für eine Mehrzahl an ersten Frequenzbändern parallel oder sequentiell ausgeführt.In one conceivable embodiment, the method according to the invention is carried out in parallel or sequentially with the steps of determining a correlation, determining a value and setting a noise suppression for a plurality of first frequency bands.
So kann auf vorteilhafte Weise ein Störgeräusch über einen größeren Frequenzbereich unterdrückt werden.Thus, advantageously, a noise over a wider frequency range can be suppressed.
In einer möglichen Ausführungsform wird das erfindungsgemäße Verfahren wiederholt und dabei mit einem zweiten Referenzband ausgeführt. Dabei ist es denkbar, dass das zweite Referenzband gleich dem ersten Referenzband ist oder sich von dem ersten Referenzband unterscheidet.In one possible embodiment, the method according to the invention is repeated and carried out with a second reference band. It is conceivable that the second reference band is equal to the first reference band or differs from the first reference band.
Durch die Verwendung unterschiedlicher Referenzbänder zu unterschiedlichen Zeiten wird es möglich, das Hörhilfegerät an unterschiedliche Situationen mit unterschiedlichen Sprechern mit unterschiedlichen Tonhöhen anzupassen und unter unterschiedlichen Bedingungen die Sprache zuverlässig zu erkennen.By using different reference bands at different times, it is possible to adapt the hearing aid to different situations with different speakers with different pitches and reliably recognize the language under different conditions.
In einer möglichen Ausführungsform des erfindungsgemäßen Verfahrens erfolgt die Auswahl eines Referenzbandes durch die Auswahl des Frequenzbandes mit der höchsten Energie im Vergleich zu den anderen Frequenzbändern der Mehrzahl der Frequenzbänder. Dabei ist die Energie über das Quadrat der Amplitude äquivalent zur Amplitude des Signals in dem Frequenzband.In one possible embodiment of the method according to the invention, the selection of a reference band is made by selecting the frequency band with the highest energy in comparison to the other frequency bands of the plurality of frequency bands. The energy over the square of the amplitude is equivalent to the amplitude of the signal in the frequency band.
Eine einzelne Stimme hat z.B. bei Vokalen eine hohe Energiedichte in einem schmalen Frequenzbereich, sodass ein Stimmanteil in einem Frequenzband mit hoher Energie wahrscheinlich ist.A single voice has e.g. in the case of vowels, a high energy density in a narrow frequency range, so that a voice component in a frequency band with high energy is likely.
In einer denkbaren Ausführungsform des erfindungsgemäßen Verfahrens erfolgt die Auswahl eines Referenzbandes durch die Auswahl des Frequenzbands mit einem größten Modulationsgrad in einem vorbestimmten Frequenzbereich.In a conceivable embodiment of the method according to the invention, the selection of a reference band is effected by the selection of the frequency band having a greatest degree of modulation in a predetermined frequency range.
Ein hoher Modulationsgrad in einem Frequenzband deutet auf eine Sprachaktivität in diesem Frequenzband hin und kann mit geringer Prozessorlast ermittelt werden. Durch die Betrachtung des Modulationsgrades in einem Frequenzbereich, der z.B. charakteristisch für die Modulationsfrequenz der Sprache ist, kann die Erkennungssicherheit erhöht werden. So ist es in dem erfindungsgemäßen Verfahren beispielsweise denkbar, einen Modulationsgrad in einem vorbestimmten Frequenzbereich mit einer Sprachmodulation zwischen einem Hertz und 5 oder 10 Hertz zur Spracherkennung auszuwerten.A high degree of modulation in a frequency band indicates a voice activity in this frequency band and can be determined with low processor load. By considering the degree of modulation in a frequency range, e.g. is characteristic of the modulation frequency of the speech, the recognition certainty can be increased. For example, in the method according to the invention, it is conceivable to evaluate a degree of modulation in a predetermined frequency range with a speech modulation between one hertz and five or ten hertz for speech recognition.
In einer denkbaren Ausführungsform des erfindungsgemäßen Verfahrens wird die Korrelation zwischen dem ersten Frequenzband und dem Referenzband anhand einer Signalamplitude oder einer Signalenergie eines Signals des ersten Frequenzbandes und Referenzbandes ermittelt wird.In a conceivable embodiment of the method according to the invention, the correlation between the first frequency band and the reference band is determined on the basis of a signal amplitude or a signal energy of a signal of the first frequency band and reference band.
Anhand der Signalamplitude oder der Signalenergie in dem ersten Frequenzband und dem Referenzband lässt sich die Korrelation besonders einfach ermitteln.On the basis of the signal amplitude or the signal energy in the first frequency band and the reference band, the correlation can be determined particularly easily.
In einer möglichen Ausführungsform des erfindungsgemäßen Verfahrens wird die Korrelation zwischen dem ersten Frequenzband und dem Referenzband anhand eines Modulationsgrades eines Signals des ersten Frequenzbandes und Referenzbandes in einem vorbestimmten Frequenzbereich ermittelt. So ist es in dem erfindungsgemäßen Verfahren beispielsweise denkbar, einen Modulationsgrad mit in einem vorbestimmten Frequenzbereich einer Sprachmodulation zwischen einem Hertz und 5 oder 10 Hertz zur Bestimmung der Korrelation zu verwenden.In one possible embodiment of the method according to the invention, the correlation between the first frequency band and the reference band is determined on the basis of a degree of modulation of a signal of the first frequency band and reference band in a predetermined frequency range. Thus, in the method according to the invention, for example, it is conceivable to use a degree of modulation with in a predetermined frequency range of a speech modulation between one hertz and five or ten hertz for determining the correlation.
Eine hohe Modulation ist charakteristisch für die Sprache. Daher bietet die Korrelation des momentanen bzw. über ein mitlaufendes Fenster bestimmten Modulationsgrad eine zuverlässige Erkennung, ob auch in dem ersten Frequenzband ein Sprachanteil vorhanden ist.High modulation is characteristic of the language. Therefore, the correlation of the momentary or via a moving window determines modulation degree reliable detection, whether in the first frequency band, a voice component is present.
In einer denkbaren Ausführungsform des erfindungsgemäßen Verfahrens wird die Korrelation über eine Fensterlänge in Abhängigkeit von dem ersten Audiosignal ermittelt.In a conceivable embodiment of the method according to the invention, the correlation over a window length is determined as a function of the first audio signal.
Die Korrelation muss immer über eine gewisse Anzahl von Werten, die einen gewissen Zeitraum im Verlauf der Signale angeben, ermittelt werden. Dieser Zeitraum bzw. die Anzahl der Werte wird auch als Fensterlänge bezeichnet. Dabei kann es von Vorteil sein, diese Fensterlänge in Abhängigkeit der Umgebung und damit des ersten Audiosignals zu verändern. So ist es beispielsweise bei schnellen Änderungen im Eingangssignal die Fensterlänge zu reduzieren, um mit der Störgeräuschunterdrückung schneller auf Umgebungsänderungen reagieren zu können.The correlation must always be determined over a certain number of values that indicate a certain period of time during the course of the signals. This period or the number of values is also referred to as window length. It may be advantageous to change this window length depending on the environment and thus the first audio signal. For example, in the case of rapid changes in the input signal, it is necessary to reduce the window length in order to be able to react faster to environmental changes with the noise suppression.
In einer möglichen Ausführungsform des erfindungsgemäßen Verfahrens wird ein Wert für einen Sprachanteil eines Signals ermittelt, indem die Korrelation mit einem vorbestimmten Schwellwert verglichen wird.In one possible embodiment of the method according to the invention, a value for a speech component of a signal is determined by comparing the correlation with a predetermined threshold value.
Das Referenzband wird in dem erfindungsgemäßen Verfahren so ausgewählt, dass es vorzugsweise einen Sprachanteil aufweist. Wenn das erste Frequenzband eine Korrelation mit ausreichend hohem Wert aufweist, das Referenzband und das erste Frequenzband also Merkmale in ausreichendem Maß gemeinsam aufweisen, so ist auf vorteilhafte Weise davon auszugehen, dass auch das erste Frequenzband Sprachanteile aufweist.The reference band is selected in the method according to the invention such that it preferably has a speech component. If the first frequency band has a correlation with a sufficiently high value, that is, the reference band and the first frequency band have properties sufficiently in common, then it can advantageously be assumed that the first frequency band also has speech components.
In einer denkbaren Ausführungsform des erfindungsgemäßen Verfahrens wird ein Parameter der Störgeräuschunterdrückung eingestellt, der ein Parameter zur Beeinflussung einer Störsignalschätzung, ein Parameter zur Einstellung der Stärke der Störsignalunterdrückung oder ein Parameter zur Begrenzung einer Störsignalunterdrückung ist.In one conceivable embodiment of the method according to the invention, a noise suppression parameter is set, which is a parameter for influencing a noise signal estimation, a parameter for setting the strength of the interference signal suppression or a parameter for limiting interference suppression.
Auf vorteilhafte Weise kann so die Störgeräuschunterdrückung in einem Frequenzband in Abhängigkeit von einem festgestellten Sprachanteil derart eingestellt werden, dass Störgeräusche bevorzugt unterdrückt werden und Sprachanteile möglichst unbeeinflusst bleibenAdvantageously, the noise suppression in a frequency band can thus be adjusted as a function of a detected speech component in such a way that noise is generated preferably be suppressed and speech components remain as uninfluenced
Die Ausführungsformen der erfindungsgemäßen Hörvorrichtung, auf der das erfindungsgemäße Verfahren ausführbar ist, teilen die Vorzüge dieses Verfahrens.The embodiments of the hearing device according to the invention, on which the method according to the invention can be carried out, share the advantages of this method.
Die oben beschriebenen Eigenschaften, Merkmale und Vorteile dieser Erfindung sowie die Art und Weise, wie diese erreicht werden, werden klarer und deutlicher verständlich im Zusammenhang mit der folgenden Beschreibung der Ausführungsbeispiele, die im Zusammenhang mit den Zeichnungen näher erläutert werden.The above-described characteristics, features, and advantages of this invention, as well as the manner in which they will be achieved, will become clearer and more clearly understood in connection with the following description of the embodiments, which will be described in detail in conjunction with the drawings.
Es zeigen:
- Fig. 1
- eine schematische Darstellung eines erfindungsgemäßen Hörhilfegeräts;
- Fig. 2
- eine Darstellung einer erfindungsgemäßen Störgeräuschunterdrückungseinrichtung in Funktionsblöcken und
- Fig. 3
- einen schematischen Ablaufplan eines erfindungsgemäßen Verfahrens.
- Fig. 1
- a schematic representation of a hearing aid according to the invention;
- Fig. 2
- a representation of a noise reduction device according to the invention in function blocks and
- Fig. 3
- a schematic flowchart of a method according to the invention.
Das erfindungsgemäße Hörhilfegerät 110 weist darüber hinaus eine Störgeräuschunterdrückungseinrichtung 20 auf, die wie in
Eine mögliche Ausführungsform einer Störgeräuschunterdrückungseinrichtung 20 ist
In der in
Eine Referenzbandauswahleinrichtung 23 wählt aus der Mehrzahl der Frequenzbänder ein Referenzband aus. Dazu steht die in
Einer Subband-Korrelationsbestimmungseinrichtung 24 wird das Signal des Referenzbandes sowie mindestens eines unterschiedliches Frequenzbandes zugeführt, wobei die Signalverbindung in
Als Ergebnis liefert die Subband-Korrelationsbestimmungseinrichtung 24 mittels der Sprachidentifikationseinrichtung 26 bevorzugter Weise einen Wert für eine Wahrscheinlichkeit, dass das Signal des ersten Frequenzbandes einen Sprachanteil aufweist. Alternativ oder ergänzend kann die Subband-Korrelationsbestimmungseinrichtung 24 auch mittels einer Entscheidungseinrichtung 25 ein binäres Signal liefern, ob das erste Frequenzband ein Sprachsignal aufweist. So kann die nachfolgende Bearbeitung vereinfacht werden, wenn das erste Frequenzband keine Sprachanteile aufweist.As a result, the subband correlation determining means 24 preferably provides, by means of the speech identification means 26, a value for a probability that the signal of the first frequency band has a speech content. Alternatively or additionally, the subband
Eine Parametereinstelleinrichtung 27 ermittelt aufgrund des binären Signals und oder des Wahrscheinlichkeitswertes geeignete Parameter für ein adaptives Störgeräuschfilter 28. Im einfachsten Fall kann die Verstärkung des adaptiven Störgeräuschfilters 28 auf null gesetzt werden, wenn kein Sprachanteil in dem ersten Frequenzband vorliegt. Denkbar ist es auch, dass die Verstärkung proportional oder in anderer Weise abhängig von dem Wahrscheinlichkeitswert ist. Möglich ist es auch, andere Parameter des adaptiven Störgeräuschfilters 28 auf andere Weise in Abhängigkeit von dem binären Signal und/oder dem Wahrscheinlichkeitssignal einzustellen. So könnte die Schrittweite für eine adaptive Anpassung des Filters, z.B. eines Wiener-Filters angepasst werden.A parameter setting means 27 determines suitable parameters for an
Das adaptive Störgeräuschfilter 28 reduziert aufgrund der Parametereinstellung bevorzugter Weise einen Anteil von Störgeräuschen gegenüber Sprachanteilen in dem ersten Frequenzband.The
In einem Schritt S10 wird eine Audiosignal in eine Mehrzahl von im Wesentlichen disjunkten Frequenzbändern aufgeteilt.In a step S10, an audio signal is divided into a plurality of substantially disjoint frequency bands.
Dabei stammt das Audiosignal bevorzugter Weise von einem oder mehreren Mikrofonen, die Quelle kann aber beispielsweise auch ein elektrischer Signaleingang oder eine drahtlose Übertragungseinrichtung sein. Das Aufteilen in Subbänder kann mit einem oder mehreren Filtermitteln erfolgen, beispielsweise einer Filterbank, mehreren diskreten Filtern oder durch eine Transformation in einen Frequenzraum. Dabei ist unter im Wesentlichen disjunkt zu verstehen, dass sich die einzelnen Frequenzbänder nur in geringem Umfang oder gar nicht überlappen, beispielsweise um höchstens ein Viertel, ein Zehntel oder Zwanzigstel ihrer Bandbreite.The audio signal preferably originates from one or more microphones, but the source can also be, for example, an electrical signal input or a wireless transmission device. The division into subbands can be done with one or more filter means, for example a filter bank, several discrete filters or by a transformation into a frequency space. This is to be understood essentially disjoint that the individual frequency bands overlap only to a limited extent or not at all, for example at most a quarter, a tenth or twentieth of their bandwidth.
In einem Schritt S20 des erfindungsgemäßen Verfahrens wird ein erstes Frequenzbandes der Mehrzahl an Frequenzbändern als Referenzband ausgewählt, welches einen feststellbaren ersten Anteil eines Sprachsignals aufweist.In a step S20 of the method according to the invention, a first frequency band of the plurality of frequency bands is selected as the reference band, which has a detectable first portion of a speech signal.
Dabei ist es denkbar, dass das Hörhilfegerät Mittel zum Erkennen eines Sprachanteils aufweist. Diese Mittel kann die in
In einem Schritt S30 des erfindungsgemäßen Verfahrens ermittelt das Hörhilfegerät eine Korrelation zwischen dem ersten Frequenzband und dem Referenzband. Dies kann beispielsweise mithilfe der Subband-Korrelationsbestimmungseinrichtung 24 erfolgen. Verfahren zur Bestimmung einer Korrelation sind in der Beschreibung zu
Üblicherweise handelt es sich bei dem ersten Frequenzband um ein anderes Frequenzband als das Referenzband. Bei einer parallelen oder sequentiellen Bearbeitung aller Frequenzbänder mittels der Schritte S30 bis S50 kann es jedoch auch vorkommen, dass das erste Frequenzband identisch mit dem Referenzband ist. Der Korrelationswert ist dann wegen der Identität maximal.Typically, the first frequency band is a different frequency band than the reference band. In a parallel or sequential processing of all frequency bands by means of steps S30 to S50, however, it may also happen that the first frequency band is identical to the reference band. The correlation value is then maximum because of the identity.
In einem Schritt S40 des erfindungsgemäßen Verfahrens bestimmt die Entscheidungseinrichtung 25 und/oder die Sprachidentifikationseinrichtung 26 in Abhängigkeit von der ermittelten Korrelation einen Wert, der einen zweiten Anteil eines Sprachsignals in dem zweiten Frequenzband angibt. Es kann sich dabei um einen binären Wert, eine "binary mask" handeln, oder auch um einen unscharfen Wert im Sinne einer Fuzzy-Logik, der eine Wahrscheinlichkeit angibt. Dabei ist es denkbar, dass anhand einer starken Korrelation zwischen dem ersten Frequenzband und dem Referenzband geschlossen werden kann, dass auch das erste Frequenzband einen Signalanteil mit Sprache aufweist. Es ist aber ebenso denkbar, dass das erste Frequenzband ebenfalls mit einem Mittel zum Erkennen eines Sprachanteils bewertet wird. Ebenso ist es möglich, dass die Sprachidentifikationseinrichtung 26 nur auf das erste Frequenzband angewandt wird, wenn eine ausreichend hohe Korrelation mit dem ersten Frequenzband ermittelt wurde und die Entscheidungseinrichtung 25 einen entsprechenden Wert als "binary mask" annimmt.In a step S40 of the method according to the invention, the
In einem Schritt S50 des erfindungsgemäßen Verfahrens wird eine Störgeräuschunterdrückung in dem ersten Frequenzband in Abhängigkeit des ermittelten Wertes eingestellt. Im einfachsten Fall kann die Verstärkung des Störgeräuschfilters 28 auf null gesetzt werden, wenn kein Sprachanteil in dem ersten Frequenzband vorliegt. Denkbar ist es auch, dass die Verstärkung proportional oder in anderer Weise abhängig von dem Wahrscheinlichkeitswert ist. Möglich ist es auch, andere Parameter eines adaptiven Störgeräuschfilters auf andere Weise in Abhängigkeit von dem binären Signal und/oder dem Wahrscheinlichkeitssignal einzustellen. So könnte die Schrittweite für eine adaptive Anpassung des Filters, z.B. eines Wiener-Filters, oder die maximal mögliche Absenkung angepasst werden.In a step S50 of the method according to the invention, a noise suppression in the first frequency band is set as a function of the determined value. In the simplest case, the gain of the
Das adaptive Störgeräuschfilter reduziert aufgrund der Parametereinstellung bevorzugter Weise einen Anteil von Störgeräuschen gegenüber Sprachanteilen in dem ersten Frequenzband.The adaptive noise filter preferably reduces a level of noise over speech portions in the first frequency band due to the parameter setting.
Bevorzugter Weise werden die Schritte S30 bis S50 für alle Frequenzbänder der Mehrzahl der Frequenzbänder entweder parallel oder sequentiell nacheinander ausgeführt.Preferably, the steps S30 to S50 are executed for all the frequency bands of the plurality of frequency bands either in parallel or sequentially one after the other.
In einer bevorzugten erfindungsgemäßen Ausführungsform des Verfahrens ist es vorgesehen, dass die Schritte S10 bis S50 zyklisch in vorbestimmten oder variablen Zeitabständen wiederholt werden, wobei der Schritt S20 nur einmal ausgeführt werden kann oder ebenfalls mit einem veränderlichen Referenzband wiederholt wird. Innerhalb dieser Wiederholungen werden dabei vorzugsweise die Schritte S30 bis S50 für mehrere oder alle der Frequenzbänder parallel oder sequentiell ausgeführt.In a preferred embodiment of the method according to the invention, it is provided that the steps S10 to S50 are repeated cyclically at predetermined or variable intervals, wherein the step S20 can be executed only once or also repeated with a variable reference band. Within these repetitions, steps S30 to S50 for several or all of the frequency bands are preferably executed in parallel or sequentially.
Obwohl die Erfindung im Detail durch das bevorzugte Ausführungsbeispiel näher illustriert und beschrieben wurde, so ist die Erfindung nicht durch die offenbarten Beispiele eingeschränkt und andere Variationen können vom Fachmann hieraus abgeleitet werden, ohne den Schutzumfang der Erfindung zu verlassen.Although the invention has been illustrated and described in detail by the preferred embodiment, the invention is not limited by the disclosed examples and other variations can be derived therefrom by those skilled in the art without departing from the scope of the invention.
Claims (13)
ein Audiosignal mit Hilfe des Filtermittels in eine Mehrzahl an im Wesentlichen disjunkte Frequenzbänder aufzuteilen,
mit dem Erkennungsmittel zu erkennen, ob in einem Frequenzband ein erster Anteil eines Sprachsignals vorhanden ist und ein Frequenzband mit dem ersten Anteil eines Sprachsignal als Referenzband auszuwählen,
mit dem Korrelationsmittel eine Korrelation zwischen einem ersten Frequenzband und dem Referenzband zu bestimmen,
einen Wert zu ermitteln, der einen zweiten Anteil eines Sprachsignals in dem ersten Frequenzband angibt,
einer Störgeräuschunterdrückung in dem ersten Frequenzband in Abhängigkeit des ermittelten Wertes mittels der Steuerung einzustellen.Hearing aid device having a device for noise suppression, wherein the hearing aid device filter means, detecting means for detecting a voice component in an audio signal, correlation means for determining a correlation of two audio signals, noise cancellation with an adjustable parameter and a control, wherein the hearing aid is designed,
splitting an audio signal into a plurality of substantially disjoint frequency bands using the filter means,
to recognize with the recognition means whether a first portion of a speech signal is present in a frequency band and to select a frequency band with the first portion of a speech signal as the reference band,
using the correlation means to determine a correlation between a first frequency band and the reference band,
determine a value indicating a second portion of a speech signal in the first frequency band,
to adjust a noise suppression in the first frequency band as a function of the determined value by means of the controller.
wobei das das Erkennungsmittel ausgelegt ist, einen Modulationsgrad eines Frequenzbandes zu ermitteln und in Abhängigkeit von dem Modulationsgrad in einem vorbestimmten Frequenzbereich einen Sprachanteil zu erkennen.Hearing aid according to claim 11,
wherein the detection means is adapted to determine a degree of modulation of a frequency band and to detect a voice component as a function of the degree of modulation in a predetermined frequency range.
wobei das Korrelationsmittel ausgelegt ist, einen Modulationsgrad eines Frequenzbandes in einem vorbestimmten Frequenzbereich zu ermitteln und in Abhängigkeit von dem Modulationsgrad in dem ersten Frequenzband und dem Referenzband eine Korrelation zwischen einem ersten Frequenzband und dem Referenzband zu ermitteln.Hearing aid according to claim 11 or 12,
wherein the correlating means is adapted to determine a degree of modulation of a frequency band in a predetermined frequency range and to determine a correlation between a first frequency band and the reference band depending on the degree of modulation in the first frequency band and the reference band.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102015201073.2A DE102015201073A1 (en) | 2015-01-22 | 2015-01-22 | Method and apparatus for noise suppression based on inter-subband correlation |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3048813A1 true EP3048813A1 (en) | 2016-07-27 |
EP3048813B1 EP3048813B1 (en) | 2018-03-14 |
Family
ID=54783516
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15198238.6A Active EP3048813B1 (en) | 2015-01-22 | 2015-12-07 | Method and device for suppressing noise based on inter-subband correlation |
Country Status (4)
Country | Link |
---|---|
US (1) | US10051382B2 (en) |
EP (1) | EP3048813B1 (en) |
DE (1) | DE102015201073A1 (en) |
DK (1) | DK3048813T3 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017025108A2 (en) * | 2016-10-04 | 2017-02-16 | Al-Shalash Taha Kais Taha | Sequencing the speech signal |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102006051071A1 (en) * | 2006-10-30 | 2008-05-08 | Siemens Audiologische Technik Gmbh | Level-dependent noise reduction |
DE102010026884A1 (en) * | 2010-07-12 | 2012-01-12 | Siemens Medical Instruments Pte. Ltd. | Method for operating a hearing device with two-stage transformation |
DE102012202469B3 (en) * | 2012-02-17 | 2013-01-17 | Siemens Medical Instruments Pte. Ltd. | Hearing apparatus with an adaptive filter and method for filtering an audio signal |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0219025B1 (en) | 1985-10-16 | 1990-06-13 | Siemens Aktiengesellschaft | Hearing aid |
DK406189A (en) | 1989-08-18 | 1991-02-19 | Otwidan Aps Forenede Danske Ho | METHOD AND APPARATUS FOR CLASSIFYING A MIXED SPEECH AND NOISE SIGNAL |
EP1101390B1 (en) | 1998-07-24 | 2004-04-14 | Siemens Audiologische Technik GmbH | Hearing aid having an improved speech intelligibility by means of frequency selective signal processing, and a method for operating such a hearing aid |
JP3750583B2 (en) * | 2001-10-22 | 2006-03-01 | ソニー株式会社 | Signal processing method and apparatus, and signal processing program |
US7340068B2 (en) | 2003-02-19 | 2008-03-04 | Oticon A/S | Device and method for detecting wind noise |
US20040252853A1 (en) * | 2003-05-27 | 2004-12-16 | Blamey Peter J. | Oscillation suppression |
US6912289B2 (en) * | 2003-10-09 | 2005-06-28 | Unitron Hearing Ltd. | Hearing aid and processes for adaptively processing signals therein |
US7489789B2 (en) * | 2004-03-02 | 2009-02-10 | Oticon A/S | Method for noise reduction in an audio device and hearing aid with means for reducing noise |
US8428275B2 (en) | 2007-06-22 | 2013-04-23 | Sanyo Electric Co., Ltd. | Wind noise reduction device |
ATE501604T1 (en) * | 2007-10-16 | 2011-03-15 | Phonak Ag | HEARING SYSTEM AND METHOD FOR OPERATING A HEARING SYSTEM |
CN102084667B (en) * | 2008-03-03 | 2014-01-29 | 日本电信电话株式会社 | Dereverberation apparatus, dereverberation method, dereverberation program, and recording medium |
US8473287B2 (en) | 2010-04-19 | 2013-06-25 | Audience, Inc. | Method for jointly optimizing noise reduction and voice quality in a mono or multi-microphone system |
AU2010365366B2 (en) | 2010-12-08 | 2014-10-02 | Widex A/S | Hearing aid and a method of enhancing speech reproduction |
DE102011004338B3 (en) * | 2011-02-17 | 2012-07-12 | Siemens Medical Instruments Pte. Ltd. | Method and device for estimating a noise |
US9031259B2 (en) * | 2011-09-15 | 2015-05-12 | JVC Kenwood Corporation | Noise reduction apparatus, audio input apparatus, wireless communication apparatus, and noise reduction method |
US9384759B2 (en) * | 2012-03-05 | 2016-07-05 | Malaspina Labs (Barbados) Inc. | Voice activity detection and pitch estimation |
EP2765787B1 (en) | 2013-02-07 | 2019-12-11 | Sennheiser Communications A/S | A method of reducing un-correlated noise in an audio processing device |
-
2015
- 2015-01-22 DE DE102015201073.2A patent/DE102015201073A1/en not_active Withdrawn
- 2015-12-07 EP EP15198238.6A patent/EP3048813B1/en active Active
- 2015-12-07 DK DK15198238.6T patent/DK3048813T3/en active
-
2016
- 2016-01-22 US US15/003,854 patent/US10051382B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102006051071A1 (en) * | 2006-10-30 | 2008-05-08 | Siemens Audiologische Technik Gmbh | Level-dependent noise reduction |
DE102010026884A1 (en) * | 2010-07-12 | 2012-01-12 | Siemens Medical Instruments Pte. Ltd. | Method for operating a hearing device with two-stage transformation |
DE102012202469B3 (en) * | 2012-02-17 | 2013-01-17 | Siemens Medical Instruments Pte. Ltd. | Hearing apparatus with an adaptive filter and method for filtering an audio signal |
Non-Patent Citations (2)
Title |
---|
RAINER MARTIN: "Noise Power Spectral Density Estimation Based on Optimal Smoothing and Minimum Statistics", IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, vol. 9, no. 5, July 2001 (2001-07-01), XP011054118 |
TIMO GERKMANN; R.C. HENDRIKS: "Unbiased MMSE-based Noise Power Estimation with Low Complexity and Low Tracking Delay", IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, vol. 20, no. 4, May 2012 (2012-05-01), pages 1383 - 1393, XP011420578, DOI: doi:10.1109/TASL.2011.2180896 |
Also Published As
Publication number | Publication date |
---|---|
US10051382B2 (en) | 2018-08-14 |
US20160219381A1 (en) | 2016-07-28 |
EP3048813B1 (en) | 2018-03-14 |
DE102015201073A1 (en) | 2016-07-28 |
DK3048813T3 (en) | 2018-05-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3222057B1 (en) | Method and apparatus for fast recognition of a user's own voice | |
EP2603018B1 (en) | Hearing aid with speaking activity recognition and method for operating a hearing aid | |
EP2991379B1 (en) | Method and device for improved perception of own voice | |
EP2840809B1 (en) | Control of the strength of the effect of a binaural directional microphone | |
EP2811762B1 (en) | Logic-based binaural beam forming system | |
DE102011006129B4 (en) | Hearing device with feedback suppression device and method for operating the hearing device | |
EP3926982A2 (en) | Method for direction-dependent noise suppression for a hearing system comprising a hearing device | |
EP2200345B1 (en) | Method for selecting a preferred direction of a directional microphone and corresponding hearing device | |
EP2797344A2 (en) | Method for controlling an adaption step size and hearing aid | |
EP2109329A2 (en) | Multi-layer estimation method for reducing interference noises and audio device | |
EP2822300B1 (en) | Detection of listening situations with different signal sources | |
EP2161949A2 (en) | Method for operating a hearing aid with directional effect and accompanying hearing aid | |
EP2584795B1 (en) | Method for determining a compression characteristic curve | |
DE102012203349B4 (en) | Method for adapting a hearing device based on the sensory memory and adaptation device | |
EP3048813B1 (en) | Method and device for suppressing noise based on inter-subband correlation | |
EP1962554A2 (en) | Hearing device with interference signal separation and corresponding method | |
EP2658289B1 (en) | Method for controlling an alignment characteristic and hearing aid | |
EP2434781A1 (en) | Method for reconstructing a speech signal and hearing aid | |
EP2219389B1 (en) | Device and method for evaluating interference noises in a binaural hearing device product | |
EP2222096A2 (en) | Method for processing the signal of a hearing device and corresponding hearing device | |
EP2635048B1 (en) | Amplification of a speech signal based on the input level | |
EP2648424B1 (en) | Method for limiting the output level in hearing aids | |
EP4311269A1 (en) | Method for operating a binaural hearing aid, binaural hearing aid, and computer program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20170127 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101AFI20170925BHEP Ipc: H03H 21/00 20060101ALN20170925BHEP |
|
INTG | Intention to grant announced |
Effective date: 20171018 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIVANTOS PTE. LTD. |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 979943 Country of ref document: AT Kind code of ref document: T Effective date: 20180315 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502015003382 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20180516 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180314 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180615 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R026 Ref document number: 502015003382 Country of ref document: DE |
|
PLBI | Opposition filed |
Free format text: ORIGINAL CODE: 0009260 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180716 |
|
PLAX | Notice of opposition and request to file observation + time limit sent |
Free format text: ORIGINAL CODE: EPIDOSNOBS2 |
|
26 | Opposition filed |
Opponent name: OTICON A/S / WIDEX A/S / GN HEARING A/S Effective date: 20181214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 |
|
PLAB | Opposition data, opponent's data or that of the opponent's representative modified |
Free format text: ORIGINAL CODE: 0009299OPPO |
|
R26 | Opposition filed (corrected) |
Opponent name: OCTICON A/S / GN RESOUND A/S Effective date: 20181214 |
|
PLBB | Reply of patent proprietor to notice(s) of opposition received |
Free format text: ORIGINAL CODE: EPIDOSNOBS3 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181207 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181207 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20151207 Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180314 |
|
PLCK | Communication despatched that opposition was rejected |
Free format text: ORIGINAL CODE: EPIDOSNREJ1 |
|
RDAF | Communication despatched that patent is revoked |
Free format text: ORIGINAL CODE: EPIDOSNREV1 |
|
PLCK | Communication despatched that opposition was rejected |
Free format text: ORIGINAL CODE: EPIDOSNREJ1 |
|
PLAB | Opposition data, opponent's data or that of the opponent's representative modified |
Free format text: ORIGINAL CODE: 0009299OPPO |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180714 |
|
R26 | Opposition filed (corrected) |
Opponent name: OTICON A/S / GN HEARING A/S Effective date: 20181214 |
|
APBM | Appeal reference recorded |
Free format text: ORIGINAL CODE: EPIDOSNREFNO |
|
APBP | Date of receipt of notice of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA2O |
|
APAH | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNO |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R100 Ref document number: 502015003382 Country of ref document: DE |
|
APBU | Appeal procedure closed |
Free format text: ORIGINAL CODE: EPIDOSNNOA9O |
|
PLBN | Opposition rejected |
Free format text: ORIGINAL CODE: 0009273 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: OPPOSITION REJECTED |
|
27O | Opposition rejected |
Effective date: 20201116 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 979943 Country of ref document: AT Kind code of ref document: T Effective date: 20201207 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201207 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20231220 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231219 Year of fee payment: 9 Ref country code: DK Payment date: 20231219 Year of fee payment: 9 Ref country code: DE Payment date: 20231214 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20240110 Year of fee payment: 9 |