EP3697107B1 - Verfahren zum betrieb eines hörsystems und hörsystem - Google Patents

Verfahren zum betrieb eines hörsystems und hörsystem Download PDF

Info

Publication number
EP3697107B1
EP3697107B1 EP19213772.7A EP19213772A EP3697107B1 EP 3697107 B1 EP3697107 B1 EP 3697107B1 EP 19213772 A EP19213772 A EP 19213772A EP 3697107 B1 EP3697107 B1 EP 3697107B1
Authority
EP
European Patent Office
Prior art keywords
signal
input signal
hearing
input
determined
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19213772.7A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3697107A1 (de
Inventor
Homayoun KAMKAR-PARSI
Marko Lugger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP3697107A1 publication Critical patent/EP3697107A1/de
Application granted granted Critical
Publication of EP3697107B1 publication Critical patent/EP3697107B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/21—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being power information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/405—Arrangements for obtaining a desired directivity characteristic by combining a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation

Definitions

  • the invention relates to a method for operating a hearing system, which has a first input converter, a second input converter and a device for signal processing. Furthermore, the invention relates to a corresponding hearing system.
  • a hearing system typically has one hearing aid and in many cases two hearing aids or is formed by two hearing aids.
  • Hearing aids are usually referred to as classic hearing aids that are used to provide hearing-impaired people with hearing aids. In a broader sense, however, this term also designates devices that are designed to support people with normal hearing.
  • Such hearing aids are also referred to as "Personal Sound Amplification Products” or “Personal Sound Amplification Devices”("PSAD” for short) and are not intended to compensate for hearing loss, but are used specifically to support and improve normal human hearing in specific hearing situations , e.g. to support hunters on the hunt or when observing animals, to be able to better perceive animal sounds and other noises produced by animals, to support sports reporters, to enable improved speaking and/or speech understanding in complex background noise, to support musicians , to reduce the strain on hearing, etc.
  • hearing aids typically have an input converter, a device for signal processing and an output converter as essential components.
  • the input converter is generally in the form of an acousto-electric converter, for example a microphone, and/or an electromagnetic receiver, for example an induction coil.
  • An electro-acoustic converter for example a miniature loudspeaker, or an electromechanical converter, for example a bone conduction receiver, is usually used as the output converter.
  • the device for signal processing is typically realized by an electronic circuit implemented on a printed circuit board and usually includes an amplifier. It is used to process input signals that are generated during operation of a hearing aid when ambient noise hits the input transducer and, based on the input signals, to generate output signals that are converted by the output transducer and thus made audible.
  • different algorithms are preferably used depending on the present hearing situation, which are adapted to different expected hearing situations.
  • the individual listening situations to be expected are characterized, for example, by frequently recurring patterns of superimposition of a useful signal sound by background noise or generally by noise. be typified on the basis of the type of noise occurring, the signal-to-noise ratio, the frequency response of the useful signal sound and/or temporal variations and mean values of the variables mentioned.
  • a prerequisite for an automatic switch between different algorithms is the recognition of the respectively present hearing situation or at least the recognition of a change in a present hearing situation.
  • DE 10 2016 225 205 A1 describes, for example, a change in a hearing situation in which the number of conversation partners changes. This change in the hearing situation is achieved by means of a DE 10 2016 225 205 A1 described acoustic system determined by a direction of a useful signal source is determined by the acoustic system.
  • the invention is based on the object of specifying an advantageous method for operating a hearing system and an advantageously designed hearing system.
  • the method serves to operate a hearing system, in particular a hearing system of the type mentioned at the outset, the hearing system having a first input converter, a second input converter and a device for signal processing.
  • the surroundings or surroundings of the hearing system are monitored for activity from a lateral useful signal source and accordingly activity of a lateral useful signal source in the vicinity of the hearing system is determined by the method.
  • a first input signal is generated by an acoustic signal from the environment impinging on the first input transducer and a second input signal is generated by the acoustic signal impinging on the second input transducer, by further based on the first input signal and on the second input signal by means of a direction-dependent Notch filter unit a filtered input signal is generated by also based on the filtered input signal and based on the first input signal and / or on the second input signal, a measure of an attenuation, which is caused by the direction-dependent notch filter unit, is determined and finally the measure of a reference is contrasted, where off the presence or absence of the activity of a lateral useful signal source in the vicinity of the hearing system can be concluded from the comparison.
  • the method according to the invention is based in particular on a basic idea according to which two damping effects are compared with one another.
  • One of the two damping effects describes a damping of a signal to be examined, ie in particular the first input signal and/or the second input signal, by a type of masking of a solid angle range in which an active lateral useful signal source is suspected.
  • This first damping effect is compared with a second damping effect that would occur if only a portion of diffuse background noise is masked out by masking out the corresponding solid angle range. If the first damping effect is then significantly greater than the second damping effect, it can be assumed that a lateral useful signal source is active, and otherwise it can be assumed that there is no activity from a lateral useful signal source.
  • a conversation partner is typically regarded as the useful signal source, that is to say a person who, looking in the direction of a wearer of the hearing system, speaks at least temporarily.
  • a useful signal source is a lateral useful signal source when the wearer of the hearing system does not look in the direction of the useful signal source when looking straight ahead, i.e. when the useful signal source is located to the side or laterally offset to the viewing direction of the wearer of the hearing system.
  • a useful signal source that is in the viewing direction of the wearer of the hearing system is referred to below as the central useful signal source.
  • Such a differentiation between a central useful signal source and a lateral useful signal source and recognizing when a lateral useful signal source is currently active, i.e. when a conversation partner offset to the side is currently speaking, is particularly advantageous if a wearer of the hearing system is having a conversation with several conversation partners and accordingly different useful signal sources are active in alternation.
  • By recognizing the activity With such a lateral useful signal source it is then possible, for example, to process the first and/or the second input signal for generating an output signal differently, depending on whether a lateral useful signal source is active or not.
  • the aforementioned measure is compared to the aforementioned reference. This means that a comparison is made between the determined dimension and the reference, for example by relating the dimension and the reference. In this case, it is then typically only determined whether the ratio or the absolute value of the ratio is greater than or less than one.
  • a difference is formed and it is determined whether the difference or the amount is greater than or less than zero or whether it is greater than or less than a predefined threshold value. If, for example, when the measure and reference are compared, it is found that the measure is significantly smaller than the reference, then the presence of activity from a lateral useful signal source is determined, whereas the absence of activity from a lateral useful signal source is determined if the measure is greater than the reference is.
  • a damping factor or a logarithmic damping measure is preferably determined as a measure, the damping factor or the logarithmic damping measure typically being time-dependent. More preferably, the reference also reflects a damping factor or a logarithmic damping measure, this damping factor or this logarithmic damping measure also typically being time-dependent. Two damping factors or two logarithmic damping measures are thus preferably compared with one another.
  • the aforementioned filtered input signal is first generated, with a direction-dependent notch filter unit being used for this purpose.
  • the filtered input signal preferably corresponds to at least in good approximation an input signal or several input signals of a hearing system with variable directional characteristics, the directional characteristic being such that a certain spatial area or spatial angle area is virtually masked out, in which a potential activity of a useful signal source is determined, so that quasi components of an acoustic signal from this solid angle range are not taken into account.
  • a predetermined solid angle range or, for short, an angular range, for example an angular range of 10° is used around the corresponding direction or the associated angular positions hidden.
  • the area around the central angular position, ie around the viewing direction of the wearer of the hearing system when looking straight ahead, is excluded or disregarded when determining a potential activity of a useful signal source.
  • the potential activity of a useful signal source is in turn determined, for example, when a predetermined threshold value for a signal level in a solid angle range is exceeded.
  • the reference angular position, ie the angular position 0° is advantageously but not necessarily fixed to the aforementioned central angular position, ie to the viewing direction of the wearer when looking straight ahead.
  • Direction-dependent notch filter units are to be regarded as known, at least with regard to the basic principle (adaptive spatial notch beamforming).
  • Two types are of particular importance, namely a first type in which the so-called “Binaural Minimum Variance Distorless Response Beamforming (MVDR)” method is used, and a second type in which the so-called “Binaural Linearly Constrained Minimum Variance Beamforming (LCMV)” method is used. " procedure is used.
  • the first type is described in more detail in E Hadad, S Doclo and S Gannot, "Binaural LCMV beamformer and its performance analysis", IEEE Tran. On Audio, Sp., and Lang. Poc. Aug 2015 .
  • the preferred second type is described in more detail, for example, in D.
  • the reference is not simply specified in the form of a reference value, for example, but is determined by determining a power spectral density for background noise based on the first input signal and/or on the second input signal or by determining a variable derived from this power spectral density for background noise.
  • background noises are preferably regarded as interference noises, which are generated by people who are not in conversation with the wearer of the hearing system, who are therefore, for example, in conversation with other people.
  • the background noise thus includes, in particular, so-called background chatter, which can be found in a cafeteria or in a public place, for example.
  • Such background noise or background noise typically occurs as diffuse background noise, ie as background noise that cannot be clearly assigned to a source with a specific position and that is not aimed directly at the wearer of the hearing system.
  • a preferred method for determining such a spectral power density for background noise is described in more detail, for example, in AH Kamkar-Parsi and M Bouchard, "Improved noise power spectrum density estimation for binaural hearing aids operating in a diffuse noise field environment", IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 4, pp. 521-533, May 2009 .
  • An alternative method is described, for example, in R. Martin, "Noise power spectral desity estimation based on optimal smoothing and minimum statistics", IEEE Trans. Speech Audio Process., vol. 9, no. 5, pp. 504-512, Jul. 2001 .
  • a variable derived from the spectral power density for background noise is more preferably a current power for background noise, a current power value for background noise or current mean power value for background noise for a power for background noise that can be derived from the first input signal and/or the second input signal typically over a given period of time and usually over a given frequency band.
  • a corresponding current power value for background noise is then determined, for example, for a predefined first time interval, for example a first time interval of approximately 10 ms, and a predefined frequency band.
  • the predetermined frequency band is expediently based on human speech, although the entire frequency spectrum of human speech from approximately 80 Hz to approximately 12 kHz is not necessarily covered. In some cases, a frequency band is specified instead, which includes frequencies from about 100 Hz to about 500 Hz. A frequency band from approximately 125 Hz to approximately 4 kHz is preferably taken into account.
  • corresponding current power values for background noise are also determined at intervals of a predetermined second time interval, for example a second time interval of approximately 100 ms, and it is then typically assumed that each determined current power value for background noise is constantly valid for the duration of the predetermined second time interval is, so that from this a time profile for the current power for background noise over the specified frequency spectrum can be derived and is preferably derived.
  • the frequency components taken into account are weighted and a weighted mean value is formed, for example, based in particular on the frequency components over a frequency band from approximately 125 Hz to approximately 4 kHz.
  • a parameter value is also determined for at least one correction parameter by means of the direction-dependent notch filter unit, or a corresponding parameter value for the at least one correction parameter is specified in particular by the design of the direction-dependent notch filter unit.
  • the at least one correction parameter or the correction parameters are in particular adaptive filter coefficients directional notch filter unit.
  • the number of correction parameters usually corresponds to the number of channels or input signals used.
  • a modified spectral power density for background noise or a modified derived variable is determined, e.g time profile for a modified current power for background noise across the specified frequency spectrum based on a time profile for the current power for background noise across the specified frequency spectrum.
  • a time profile for the current power for background noise across the predefined frequency spectrum is derived from the first input signal and/or from the second input signal.
  • the modified derived variable i.e. the modified current power for background noise
  • the line for background noise is always distributed equally in all spatial directions, as is to be expected with diffuse background noise.
  • the parameter value for the at least one correction parameter or the parameter values for the correction parameters indicate, for example, the width or size of the Spatial area that is masked out using the directional notch filter unit to determine the dimension.
  • the modified current noise power is finally derived from the current noise power, which corresponds to the proportion of the current noise power that is masked out by masking the spatial region by the directional notch filter unit.
  • a variant of the method is also advantageous in which, to determine the reference, the spectral power density for background noise or the modified spectral power density for background noise is compared with a spectral total power density, the spectral total power density being based on the first input signal and/or on the second input signal is determined.
  • a variable derived from the spectral power density for background noise a modified derived variable for background noise or a variable derived from the modified spectral power density for background noise is compared with a variable derived from the spectral total power density.
  • the total power from the first input signal and/or from the second input signal is preferably simply taken into account.
  • the reference reproduces, for example, the attenuation of a current total power in the event that the current total power is reduced by the previously described modified current power for background noise.
  • the current total power is determined in a manner analogous to the current power for background noise.
  • the same time intervals and the same frequency band are thus specified, but virtually the entire power from the first input signal and/or from the second input signal is taken into account, ie the total spectral power density is taken as a basis.
  • the reference, or rather the current reference then reflects a current damping factor or a current logarithmic damping measure.
  • a power spectral density is determined for the filtered input signal and compared to a total power spectral density, in particular the total power spectral density described above, the total power spectral density being based on the first input signal and/or or is determined based on the second input signal.
  • a current power for the filtered input signal is preferably compared with a current total power, which in particular corresponds to the current total power described above.
  • a current total power which in particular corresponds to the current total power described above.
  • the same time intervals and the same frequency band are again specified as, for example, in the case of the current power for background noise.
  • the measure, or rather the current measure then also reflects a current damping factor or a current logarithmic damping measure.
  • both the measure and the reference each reflect a current damping factor or a current logarithmic damping measure, these can be compared and contrasted with one another in a simple manner, for example by forming a difference.
  • the measure or the current measure and the reference or the current reference are supplied to a comparator unit.
  • that comparator unit then preferably outputs a binary decision signal with two possible values, one value representing the presence of activity from a lateral useful signal source and the other value representing the absence of activity from a lateral useful signal source.
  • an offset value is also specified for the comparator unit, with which the decision threshold is shifted. In this way, it is then preferably determined from which difference between the dimension and the reference the output signal of the comparator unit changes, ie for example how much larger or how much smaller the measure must be than the reference so that the presence of an activity of a lateral useful signal source is determined.
  • the compromise between sensitivity and error susceptibility is typically shifted toward sensitivity or toward error susceptibility.
  • the surroundings of the hearing system are monitored for activities of a lateral useful signal source using the method described above or the part of the method according to the invention described above.
  • the monitoring allows the detection of the presence of an activity of a lateral useful signal source and this is used in an advantageous development to control the hearing system and in particular to activate or start an auxiliary function, the auxiliary function being preferably activated and consequently executed if an activity of a lateral useful signal source in around the hearing system is determined.
  • the activity detection then preferably acts as a kind of trigger that triggers the start of the auxiliary function whenever activity of a lateral useful signal source in the vicinity of the hearing system is determined.
  • a suitable hearing program is selected using the auxiliary function depending on the current hearing situation or simply switched back and forth between two hearing programs, depending on whether the presence or absence of an activity of a lateral useful signal source is detected. i.e. for example that the hearing system operates with a first hearing program as long as the absence of activity from a lateral useful signal source is determined, and that the hearing system operates with a second hearing program as long as the presence of activity from a lateral useful signal source is determined.
  • Also of advantage is a method variant according to which an output signal is generated by means of the device for signal processing as a function of at least one parameter value for at least one parameter for signal processing and according to which an adjustment of the at least one Parameter value is made to a current hearing situation.
  • so-called beamforming is carried out based on the at least one parameter value and the directional characteristic of the hearing system is then typically adapted by adapting the at least one parameter value.
  • a variant of the method is also advantageous in which a relative location or a relative position of a lateral useful signal source relative to the hearing system is determined by means of the auxiliary function. That relative location or position then describes in particular the direction in which a lateral useful signal source can be found, in relation to the viewing direction of the wearer of the hearing system when looking straight ahead.
  • the relative location or relative position is then not only determined once, instead the relative position of the red relative position of the lateral useful signal source is subsequently tracked as far as possible.
  • the method according to the invention described above serves to operate a hearing system and is accordingly designed for a hearing system.
  • a hearing system according to the invention is then in turn set up for the execution of the method described above in at least one operating mode and has a first input converter, a second input converter and a device for signal processing.
  • a first input signal is generated with the first input converter
  • a second input signal is generated with the second input converter inventive method described here.
  • the two input signals that is to say the first input signal and the second input signal, are typically provided in such a way that, depending on requirements, one of the input signals or both input signals can or will also be fed to a plurality of signal processing processes in parallel.
  • the principles described above for this signal processing can be implemented independently of whether analog signals are present and one analog signal Signal processing is to be carried out or whether digital signals are present and digital signal processing is to be carried out.
  • the first input signal described above and the second input signal described above are that embodiment variant of the method according to the invention or, depending on the implementation of the method according to the invention, are either analog signals or digital signals.
  • the signals are preferably digital and the signal processing is preferably digital signal processing, which is carried out, for example, with the aid of a microprocessor, which is then in particular part of the signal processing device.
  • the partial steps of the method described above are then usually carried out and implemented using logical or virtual modules.
  • the hearing system is preferably designed in such a way that the time delay between a change in an activity of a lateral useful signal source, i.e. a start or end of an activity, and the determination of the change by the hearing system is less than about 100 ms.
  • the hearing system also expediently has a first hearing aid and a second hearing aid.
  • the first input converter is preferably part of the first hearing aid and the second input converter is part of the second hearing aid.
  • the first input transducer and the second input transducer are part of the first hearing aid.
  • the hearing system also has, in addition to the first input converter and the second input converter, one or more further input converters, with which further input signals are generated in addition to the first input signal and the second input signal.
  • the other input signals are then preferably additionally used to determine the reference and/or the measure.
  • a proximity detector of the hearing system is also used as an additional input converter and for generating an additional input signal.
  • the hearing system 2 shown in a block diagram is preferably embodied as a binaural hearing system 2 and expediently has a first hearing aid 4 and a second hearing aid 6, with the first hearing aid 4 being worn on or in the left ear during use by a wearer 8 in the exemplary embodiment and with while the second hearing aid 6 is worn on or in the right ear.
  • the first hearing device 4 has a first input transducer 10, by means of which a first input signal ES1 is generated during operation by an acoustic signal AS impinging on the first input transducer 10.
  • a first input signal ES1 is generated during operation by an acoustic signal AS impinging on the first input transducer 10.
  • an analog signal is first generated, which is then converted into a digital signal with the aid of a first A/D converter 12 and is made available in this form as a first input signal ES1 to a device for signal processing 14 .
  • the device for signal processing 14 has here typically a microprocessor or computer chip or is formed by a corresponding electronic assembly.
  • the second hearing device 6 in turn has a second input transducer 16 and, analogous to the first hearing device 4, a second input signal ES2 is generated during operation of the second hearing device 6 by the acoustic signal AS impinging on the second input transducer 16.
  • a second input signal ES2 is generated during operation of the second hearing device 6 by the acoustic signal AS impinging on the second input transducer 16.
  • an analog signal is first generated and this is then in turn converted into a digital signal by means of a second A/D converter 18 and is thus made available as the second input signal ES2.
  • the second hearing device 6 also has a second transmitting and receiving unit 20 by means of which the second input signal ES2 is transmitted to the first hearing device 4 and received there by a first transmitting and receiving unit 22 . This makes the second input signal ES2 available to the device for signal processing 14 in the first hearing aid 4, so that the device for signal processing 14 has both the first input signal ES1 and the second input signal ES2 available.
  • a method according to the invention is carried out in at least one operating mode by means of the device for signal processing 14 , by means of which an activity of a lateral useful signal source 24 in an area surrounding the hearing system 2 is determined.
  • the first hearing aid 4, which is worn on or in the left ear, is primarily used to monitor the left hemisphere from the perspective of the wearer 8, and the second hearing aid 6, which is worn on or in the right ear, primarily monitors the right hemisphere.
  • the second hearing device 6 also has a device for signal processing, even if this is not shown.
  • the first hearing device 4 transmits the first input signal ES1 to the second hearing device 6 in parallel, so that the device for signal processing of the second hearing device 6 also makes both input signals ES1, ES2 available.
  • the method according to the invention described below is then carried out in each of the two hearing aids 4.6. Both hearing aids 4.6 carry out the method according to the invention in parallel.
  • a listening situation is assumed, as described in 2 is shown.
  • the wearer 8 of the hearing system 2 is shown approximately in the center in the lower area of the illustration, the viewing direction of which defines a central direction 26 when looking straight ahead.
  • a first interlocutor is located in the central direction 26 in front of the carrier 8 as a central useful signal source 28. This is in 2 , which reproduces the listening situation in a top view, shown in the center above.
  • a second interlocutor who is arranged in a lateral direction 30 as seen from the carrier 8, with the lateral direction 30 and the central direction 26 enclosing an angle of approximately 70° in the exemplary embodiment.
  • the second interlocutor is thus seen from the carrier 8 in a lateral or lateral position, at least when looking in the central direction 26 when looking straight ahead.
  • the method described below is now used to recognize when the second conversation partner, who represents a lateral useful signal source 24, is currently speaking, ie when there is an activity of this lateral useful signal source 24.
  • the first input signal ES1 and the second input signal ES2 are processed in the device for signal processing 14, in particular in such a way that the first input signal ES1 and the second input signal ES2 are made available in parallel to a plurality of modules 32 for signal processing.
  • the various modules 32 for signal processing are typically not realized by different quadrupoles or other electronic assemblies, but by virtual units, ie, for example, by different programs or processes that can be executed in parallel.
  • a measurement module 34, a reference module 36, a comparator unit 38, a direction-dependent notch filter unit 40, a first auxiliary module 42 and a second auxiliary module 44 are implemented as modules 32 for signal processing.
  • a filtered input signal GS is generated in the direction-dependent notch filter unit 28 based on the first input signal ES1 and on the second input signal ES2.
  • a directional characteristic is simulated, through which a predetermined solid angle range, in 2 represented by two dashed lines flanking the source direction 46, around a source direction 46, for example a solid angle range of 10° around the source direction 46, is masked out, so that components of the incident acoustic signal AS that originate from this solid angle range are eliminated or masked out . Corresponding components are then no longer represented in the filtered input signal GS.
  • the source direction 46 is not fixed but varies over time and is determined in a manner of speaking in a separate process running in parallel, in particular in such a way that the source direction 46 points in the direction of a potential lateral useful signal source.
  • the transverse direction 46 is therefore a current source direction 46 or a source direction 46 that varies over time.
  • a directional characteristic is simulated in turn, through which a predefined solid angle range around the central direction 26, for example a solid angle range of 10° around the central direction 26, is masked out, so that parts of the incident acoustic signal AS that originate from this solid angle range are eliminated or be hidden. Corresponding components are then no longer represented in the auxiliary signal.
  • a search is then made for the direction from which the strongest portion of the incident acoustic signal AS reaches the hearing system 2 .
  • This direction is determined as source direction 46 .
  • the source direction 46 In a good approximation, the source direction 46 always coincides with the lateral direction 30 when the lateral useful signal source 24 is active.
  • current parameter values P that are dependent on the current source direction 46 can be calculated or derived for parameters with which the aforementioned directional characteristic can be simulated.
  • the first input signal ES1 is then subjected to a filtering process with the aid of the parameter values P, as a result of which the filtered input signal GS is obtained.
  • the second input signal ES2 is subjected to a filtering process using the parameter values P in an analogous manner in the second hearing device 6 .
  • both input signals ES1, ES2 are typically used to determine the source direction 46 and the parameter values P, but that the filtered input signal GS is preferably derived from one of the two input signals ES1, ES2, in the first hearing device 4 from the first Input signal ES1 from the second input signal ES2.
  • a time-dependent measure M is then determined in the measure module 34 based on the first input signal ES1 and based on the filtered input signal GS, with the time-dependent measure M representing a logarithmic damping measure.
  • a current total power P G (ES1, ⁇ t 1 , ⁇ t 2 , ⁇ f) is first determined based on the first input signal ES1, which reproduces the power of the acoustic signal AS that can be derived from the first input signal ES1 for a predetermined first time interval ⁇ t 1 and for a given frequency band ⁇ f.
  • the predetermined frequency band ⁇ f is expediently based on human speech, although the entire frequency spectrum of human speech from approximately 80 Hz to approximately 12 kHz is not necessarily covered. Instead, a frequency band is preferably specified which includes frequencies from approximately 125 Hz to approximately 4 kHz.
  • the individual frequency components are more preferably weighted. For example, a weighted average is formed. For example, a time interval of 10 ms is specified for the first time interval ⁇ t 1 .
  • a power value can thus be determined for each time interval of size ⁇ t1, and corresponding power values are determined at intervals of a predetermined second time interval ⁇ t 2 , for example a second time interval ⁇ t 2 of 100 ms, and it is then typically assumed that each determined power value for the duration of a time interval of the size ⁇ t 2 is constantly valid, so that from this a time profile for the total power P G (ES1, ⁇ t 1 , ⁇ t 2 , ⁇ f) can be derived over the predetermined frequency spectrum and is preferably derived.
  • the first damped power P D1 (GS, ⁇ t 1 , ⁇ t 2 , ⁇ f) is also determined based on the filtered input signal GS.
  • both input signals ES1, ES2 are first evaluated together in the first auxiliary module 30 to identify diffuse noise and a first noise signal S is determined, which only has the components of the first input signal ES1 that represent diffuse noise.
  • the first interference signal S determined in this way is then made available to the second auxiliary component 32 .
  • a second interference signal is determined in parallel in an analogous manner in the second hearing device 6, which only has the components of the second input signal ES2 that represent diffuse interference noise.
  • the first interference signal S is subjected to the same filtering process using the parameter values P as the first input signal ES1 to obtain the filtered input signal GS, whereby a first modified interference signal MS is obtained.
  • This first modified interference signal MS is made available to the reference module 36 .
  • the time-dependent reference R is then determined in the reference module 36, the time-dependent reference in turn reflecting a logarithmic damping measure.
  • a second attenuated power P D2 (MS, ⁇ t 1 , ⁇ t 2 , ⁇ f) is determined, with the same specified frequency band ⁇ f and the same specified time intervals ⁇ t 1 and ⁇ t 2 as before being used.
  • time-dependent measure M and the time-dependent reference R are fed to the comparator unit 38 and compared with one another here. If the time-dependent measure M is then significantly smaller than the time-dependent reference, then the presence of activity from a lateral useful signal source is determined, and otherwise the absence of activity from a lateral useful signal source is determined.
  • a binary decision signal E is then generated by means of the comparator unit 38, for example with the values zero and one, the value one standing for the presence of an activity of a useful signal source and the value zero for the absence.
  • a possible time profile of the measure M, the time-dependent reference R and the associated decision signal E is in 4 shown. In this case, however, shorter time intervals are used for the specified time intervals ⁇ t 1 and ⁇ t 2 than the 10 ms and 100 ms mentioned by way of example.
  • an offset value O is taken into account, which ensures that the value of the decision signal E only changes to the value one when the difference between the dimension M and the reference R is greater than or equal to a predetermined amount.
  • An auxiliary function is then preferably activated or deactivated with the decision signal E, or a switch is made between two programs, for example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
EP19213772.7A 2019-02-13 2019-12-05 Verfahren zum betrieb eines hörsystems und hörsystem Active EP3697107B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102019201879.3A DE102019201879B3 (de) 2019-02-13 2019-02-13 Verfahren zum Betrieb eines Hörsystems und Hörsystem

Publications (2)

Publication Number Publication Date
EP3697107A1 EP3697107A1 (de) 2020-08-19
EP3697107B1 true EP3697107B1 (de) 2022-11-16

Family

ID=68806632

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19213772.7A Active EP3697107B1 (de) 2019-02-13 2019-12-05 Verfahren zum betrieb eines hörsystems und hörsystem

Country Status (6)

Country Link
US (1) US11153692B2 (zh)
EP (1) EP3697107B1 (zh)
JP (1) JP6861303B2 (zh)
CN (1) CN111565347B (zh)
DE (1) DE102019201879B3 (zh)
DK (1) DK3697107T3 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020207586A1 (de) 2020-06-18 2021-12-23 Sivantos Pte. Ltd. Hörsystem mit mindestens einem am Kopf des Nutzers getragenen Hörinstrument sowie Verfahren zum Betrieb eines solchen Hörsystems

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8787606B2 (en) * 2009-04-15 2014-07-22 Garth William Gobeli Electronically compensated micro-speakers
EP3051844B1 (en) * 2015-01-30 2017-11-15 Oticon A/s A binaural hearing system
EP3269155B1 (en) 2015-03-13 2019-01-02 Sivantos Pte. Ltd. Binaural hearing aid system
DE102015210652B4 (de) * 2015-06-10 2019-08-08 Sivantos Pte. Ltd. Verfahren zur Verbesserung eines Aufnahmesignals in einem Hörsystem
US9831988B2 (en) * 2015-08-18 2017-11-28 Gn Hearing A/S Method of exchanging data packages between first and second portable communication devices
US9883294B2 (en) * 2015-10-01 2018-01-30 Bernafon A/G Configurable hearing system
DK3285500T3 (da) 2016-08-05 2021-04-26 Oticon As Binauralt høresystem, der er konfigureret til at lokalisere en lydkilde
CN110140362B (zh) 2016-08-24 2021-07-06 领先仿生公司 用于通过增强耳间水平差异来促进耳间水平差异感知的系统和方法
EP3979667A3 (en) * 2016-08-30 2022-07-06 Oticon A/s A hearing device comprising a feedback detection unit
JP6759898B2 (ja) 2016-09-08 2020-09-23 富士通株式会社 発話区間検出装置、発話区間検出方法及び発話区間検出用コンピュータプログラム
DK3300078T3 (da) 2016-09-26 2021-02-15 Oticon As Stemmeaktivitetsdetektionsenhed og en høreanordning, der omfatter en stemmeaktivitetsdetektionsenhed
DE102016225204B4 (de) 2016-12-15 2021-10-21 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgerätes
DE102016225205A1 (de) 2016-12-15 2018-06-21 Sivantos Pte. Ltd. Verfahren zum Bestimmen einer Richtung einer Nutzsignalquelle
DE102016225207A1 (de) 2016-12-15 2018-06-21 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgerätes
US10911877B2 (en) * 2016-12-23 2021-02-02 Gn Hearing A/S Hearing device with adaptive binaural auditory steering and related method
EP3373602A1 (en) * 2017-03-09 2018-09-12 Oticon A/s A method of localizing a sound source, a hearing device, and a hearing system
CN108694956B (zh) * 2017-03-29 2023-08-22 大北欧听力公司 具有自适应子频带波束成形的听力设备及相关方法
US10555094B2 (en) * 2017-03-29 2020-02-04 Gn Hearing A/S Hearing device with adaptive sub-band beamforming and related method
US10079026B1 (en) * 2017-08-23 2018-09-18 Cirrus Logic, Inc. Spatially-controlled noise reduction for headsets with variable microphone array orientation

Also Published As

Publication number Publication date
DE102019201879B3 (de) 2020-06-04
JP2020137123A (ja) 2020-08-31
DK3697107T3 (da) 2023-02-06
CN111565347B (zh) 2021-12-21
CN111565347A (zh) 2020-08-21
EP3697107A1 (de) 2020-08-19
US11153692B2 (en) 2021-10-19
US20200260196A1 (en) 2020-08-13
JP6861303B2 (ja) 2021-04-21

Similar Documents

Publication Publication Date Title
EP3451705B1 (de) Verfahren und vorrichtung zum schnellen erkennen der eigenen stimme
EP1239700B1 (de) Verfahren zum Betrieb eines Hörhilfegerätes oder Hörgerätesystem sowie Hörhilfegerät oder Hörgerätesystem
DE69634841T2 (de) Verfahren und Vorrichtung zur Echokompensation
EP1648197B2 (de) Verfahren und Vorrichtung zur Reduktion von Rückkopplungen bei einem Akustiksystem
EP2226795B1 (de) Hörvorrichtung und Verfahren zum Reduzieren eines Störgeräuschs für eine Hörvorrichtung
WO2000019770A1 (de) Hörgerät und verfahren zum verarbeiten von mikrofonsignalen in einem hörgerät
EP3337189A1 (de) Verfahren zum bestimmen einer richtung einer nutzsignalquelle
EP2595414B1 (de) Hörvorrichtung mit einer Einrichtung zum Verringern eines Mikrofonrauschens und Verfahren zum Verringern eines Mikrofonrauschens
EP2023669A2 (de) Verfahren zum Betrieb eines Hörgerätesystems und Hörgerätesystem
EP3926982A2 (de) Verfahren zur richtungsabhängigen rauschunterdrückung für ein hörsystem, welches eine hörvorrichtung umfasst
EP2114089A1 (de) Verfahren und Vorrichtung zur Bestimmung eines Verschlussgrads bei Hörgeräten
DE102008046040B4 (de) Verfahren zum Betrieb einer Hörvorrichtung mit Richtwirkung und zugehörige Hörvorrichtung
EP2200341B1 (de) Verfahren zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät mit einer Quellentrennungseinrichtung
EP3697107B1 (de) Verfahren zum betrieb eines hörsystems und hörsystem
EP1912470B1 (de) Verfahren zur Dynamikkompression eines Audiosignals und entsprechende Hörvorrichtung
EP2373063B1 (de) Hörvorrichtung und Verfahren zum Einstellen derselben für einen rückkopplungsfreien Betrieb
EP1303166B1 (de) Verfahren zum Betrieb eines Hörgerätes und Anordung mit einem Hörgerät
EP2658289B1 (de) Verfahren zum Steuern einer Richtcharakteristik und Hörsystem
EP3534624B1 (de) Verfahren zum betrieb eines hörgerätes
EP2590437B1 (de) Periodisches Adaptieren einer Rückkopplungsunterdrückungseinrichtung
DE102011087692A1 (de) Hörvorrichtung und Verfahren zur Verbesserung der Wahrnehmbarkeit eines Anteils eines Eingangssignals für einen Benutzer der Hörvorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210125

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220615

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502019006282

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1532503

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221215

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20230201

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20221116

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230316

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230216

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230316

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502019006282

Country of ref document: DE

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221205

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20230817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231220

Year of fee payment: 5

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231219

Year of fee payment: 5

Ref country code: DK

Payment date: 20231219

Year of fee payment: 5

Ref country code: DE

Payment date: 20231214

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20240110

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20191205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221116