EP3427498B1 - Procédé et appareil auditif pour detection de la voix propre sur la base d'un seuil individuel - Google Patents

Procédé et appareil auditif pour detection de la voix propre sur la base d'un seuil individuel Download PDF

Info

Publication number
EP3427498B1
EP3427498B1 EP17716463.9A EP17716463A EP3427498B1 EP 3427498 B1 EP3427498 B1 EP 3427498B1 EP 17716463 A EP17716463 A EP 17716463A EP 3427498 B1 EP3427498 B1 EP 3427498B1
Authority
EP
European Patent Office
Prior art keywords
voice
threshold value
value
noise
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP17716463.9A
Other languages
German (de)
English (en)
Other versions
EP3427498A1 (fr
Inventor
Marko Lugger
Tobias Daniel Rosenkranz
Homayoun KAMKAR-PARSI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Priority to EP19195912.1A priority Critical patent/EP3598778A1/fr
Publication of EP3427498A1 publication Critical patent/EP3427498A1/fr
Application granted granted Critical
Publication of EP3427498B1 publication Critical patent/EP3427498B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/70—Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • G10L2025/783—Detection of presence or absence of voice signals based on threshold decision
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/61—Aspects relating to mechanical or electronic switches or control elements, e.g. functioning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/60—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles
    • H04R25/603—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of mechanical or electronic switches or control elements

Definitions

  • the invention relates to a method for operating a hearing aid according to claim 1, wherein a noise is recorded by means of a microphone, wherein the noise is analyzed in terms of its match with the own voice of the hearing aid wearer and a feature value is generated, which indicates how much the noise with the own voice of the hearing aid wearer, wherein the own voice is a noise type, wherein the feature value is compared with a threshold, the noise depending on whether the feature value is above or below the threshold, is recognized as a separate voice, and wherein the hearing aid depending on whether the noise was recognized as a separate voice, switching between several operating modes. Furthermore, the invention relates to a hearing aid according to claim 11.
  • a method for eigenvoice recognition is, for example, in the applicant's international application with the file reference PCT / EP 2015/068796 described.
  • a predetermined threshold for the detection of one's own voice is selected in response to ambient noise.
  • different thresholds are initially set for different noise classes of ambient noise.
  • the threshold value is selected as a function of the currently existing noise class.
  • the analysis is carried out by means of special filters, each of which has its own filter profile, which is adapted to a particular noise, ie to a specific type of noise or noise class.
  • a given signal is then filtered by the filters. From the resulting filtered signal it is then determined for each of the filters how much the original noise corresponds to the type of noise to which a respective filter is adapted.
  • the filter profiles are designed, for example, such that the noise to be detected is maximally attenuated on account of the filter profile.
  • Hearing aid generally refers to a device for outputting sound, i. Sounds understood by means of a loudspeaker, wherein the sound is obtained from sounds that have been recorded by means of at least one microphone from the environment. The sounds are converted by the microphone into electrical signals and processed in the hearing aid by means of a control unit. The signals are then converted back into noise via the loudspeaker and output.
  • a hearing device is understood to be a device for the care of a hearing-impaired or hearing-impaired person who, in particular, wears the hearing aid continuously or most of the time in order to compensate for a hearing deficit.
  • the hearing aid thus has a total of at least one microphone, a loudspeaker, also referred to as a handset, and a control unit, the latter controlling the recording of noise and its output.
  • the control unit is at least designed to amplify the noise.
  • a noise is recorded by means of the microphone.
  • the noise or more precisely the electrical signal generated therefrom, is analyzed with regard to its agreement with the hearing aid wearer's own voice and a feature value is generated which indicates how strongly the sound matches the hearing aid wearer's own voice.
  • the own voice is a type of noise, in particular several different types of noise.
  • the feature value is preferably generated by means of a classifier.
  • a classifier analyzes recorded noise for a number of characteristic features of a particular type of noise and provides the feature value as a measure of compliance with the type of noise.
  • the characteristic value is then compared with a threshold value. Depending on whether the characteristic value is above or below the threshold value, the noise is recognized as a separate voice, ie clearly the type of noise "own In this respect, the comparison with the threshold value is a decision-making procedure for determining which values of the feature value are based on the existence of one's own voice and, finally, when one's own voice is recognized as being recognized.
  • the analysis of the noise, the generation of the feature value, the comparison with the threshold value and the decision as to whether or not one's own voice is present are carried out by means of an eigenstate recognition, which is a component of the hearing device and which is realized, for example, as an integrated circuit.
  • the intrinsic voice recognition can be part of the control unit of the hearing device or can be designed as a separate unit.
  • the hearing aid is switched between several operating modes, such as a self-tuning mode and a non-voice-on mode. The switching takes place automatically, i. by the hearing aid itself, in particular by the control unit or directly by the own voice recognition.
  • the threshold value is set user-dependent and as an individual threshold value.
  • User-dependent determination of an individual threshold value is understood to mean that the threshold value is set as a function of the person of the hearing device wearer. In particular, no characteristic values from other hearing aid users / users are used for the determination of the threshold value.
  • the adjustment takes place either in the context of a fitting session with the acoustician, by the hearing aid wearer himself or in normal operation, ie online, and automatically by the hearing aid.
  • a possibly strongly deviating feature value is optimally taken into account in the determination, in particular classification of one's own voice. It makes sense, the generation of the feature value in itself as already described above specifically adapted the hearing aid wearer in order to realize a particularly optimal recognition of one's own voice.
  • the threshold value is determined by means of a calibration method in which, in particular, the hearing aid wearer's own voice is recorded several times and a plurality of individual, i. user-specific characteristic values are generated. Finally, in the calibration method, the individual threshold value is set as a function of the individual feature values generated. In this way, a particularly suitable and user-optimal threshold value is set. Therefore, a plurality of individual feature values are generated, so that a distribution of the individual feature values is obtained, from which the threshold value is then determined.
  • the threshold value is thus set as a function of the individual feature values generated in the calibration method by setting the threshold value with respect to a characteristic of the distribution, for example as a 2 ⁇ deviation from the mean or generally such that the generated feature values are predominantly above or below the threshold value.
  • This embodiment is based on the knowledge that the threshold value can be strongly user-dependent. Especially in the described above and from the PCT / EP 2015/068796 For the method to be taken, the attenuation values generated by the filter used can vary greatly depending on the user. A fixed threshold value would therefore result in one user being recognized for his or her own voice and the other user being recognized as a foreign voice, even though his or her own voice exists in both cases.
  • this embodiment is based on the consideration that both the own voice and foreign voices / ambient noises are detected during the course of the calibration process. Therefore, both feature values are obtained in the presence of one's own voice as well as in the presence of a foreign voice / ambient noise.
  • the overall distribution of the feature values thus shows a range of possible feature values. Out This distribution is determined, for example by means of statistical methods, in particular averaging, the individual threshold.
  • a feature value which is used to identify a noise and to assign it to a type of noise is determined and used, can vary considerably from one environment to another.
  • a sometimes greatly altered feature value may be generated in the detection of a particular sound, as this may be e.g. changed, distorted or superimposed by other sounds.
  • the hearing aid wearer's own voice is logically different from user to user, so that different hearing aid wearers also present different environments for the hearing aid.
  • other sounds i. with respect to the hearing aid wearer external noise, e.g. foreign voices can lead to different characteristic values in different environments.
  • noise is generally understood any kind of sound signals in the audible frequency range. Different types of sounds include your own voice, a foreign voice, sounds, sounds, music, noise and noise.
  • the method according to the invention is further based on the consideration that a decision of the eigenstate recognition on the basis of a fixed predetermined threshold value is potentially heavily faulty.
  • a decision of the eigenstate recognition on the basis of a fixed predetermined threshold value is potentially heavily faulty.
  • a user-dependent setting of the threshold value is understood to mean in particular that no generally predetermined threshold value is used by the eigenstate recognition for decision-making.
  • the respective suitable threshold value is selected in particular by a preceding environmental analysis.
  • the actual environment is first of all determined by the eigenstate recognition itself or by the control unit, and then the associated threshold, which is optimal for the environment, is selected and set from a group of threshold values.
  • a prior determination of the concrete threshold value to be used for this particular situation is to be distinguished. This determination is made either when setting the hearing aid, for example as part of a fitting session at the acoustician, or alternatively or additionally by the hearing aid wearer itself. Also an automatic determination in a special calibration or normal operation of the hearing aid is generally conceivable. In general, the determination creates an association of thresholds to environments so that there is a set of thresholds to choose from, from which the most appropriate one is then set. This assignment is expediently stored in a memory of the hearing device, in particular the control unit, for example as a table, as a functional assignment or as a user profile.
  • predetermined threshold value not only is a predetermined threshold value stored, but several predetermined threshold values are stored for different environments. From a plurality of predetermined threshold values, a suitable one is selected and adjusted depending on the environment, so that during operation the selection of the operating mode of the hearing device is significantly less error-prone.
  • the user-dependent setting of the individual threshold value is further to be distinguished from setting the determination of a feature value, for example a setting of the aforementioned filter or a classifier, which is used to analyze noises and to generate a feature value. Consequently, the threshold value does not serve to determine the feature value but to evaluate the already determined feature value.
  • a configuration of those components which generate the characteristic values takes place, in particular, independently of the user-dependent or environment-dependent selection and setting of the threshold value for the evaluation of the feature value.
  • these components are also set user-dependent. This is, for example, in terms of eigenstate recognition, i. the detection of the hearing aid wearer's voice, i. the generation of the feature value e.g. through a filter is expediently adapted to the voice of the hearing aid wearer in order to ensure optimum feature value generation and thus optimum distinguishability from other types of noise.
  • the threshold value is calibrated by determining a maximum and a minimum feature value over a limited period of time and setting the threshold value between the minimum and the maximum feature value. This is based in particular on the assumption that at the maximum feature value the noise of the noise type is "own voice" and at the minimum feature value the noise of the noise type is "foreign voice". However, depending on the calculation of the feature value, this can also be reversed, ie it is then assumed that the own voice generates a minimum feature value and the foreign voice generates a maximum feature value.
  • the limited period is usually a few seconds to a few tens of seconds, for example, about 20 seconds. The maximum and minimum characteristic values are thus short-term extrema within the period.
  • the threshold value is calibrated in normal operation by the individual feature values are determined recurrently and the threshold value is set depending on it. As a result, the threshold value is continuously adjusted so that the threshold values stored in the context of the assignment approximate to optimum threshold values over time.
  • the calibration does not correspond to the environment-dependent setting of the threshold, which is set in a specific situation. Rather, during calibration, an adjustment of the stored for a respective range of values threshold, which is then set.
  • the recurrent re-calibration of the threshold of a range of values is a continuous online optimization of the eigenstate recognition. This optimization is either continuous or only at specific times, or just over a single specified period of time.
  • the noise is analyzed in addition to the agreement with the own voice also in terms of a match with at least one other type of noise.
  • a match value is generated which indicates how strongly the noise matches a specific type of noise, with the match values then being combined into the feature value.
  • One of the at least two types of noise is one's own voice.
  • the feature value is, for example, the difference or the quotient of the two match values.
  • One's own voice and another type of noise corresponds, in a preferred variant, to the distinction between local, i. spatially separated noises.
  • One's own voice is regularly that type of noise which is closest to the hearing device spatially, so that due to the spatial differentiation, i. a differentiation according to the location of the noise, in a simple way also between one's voice and another type of noise is distinguished.
  • the other type of noise is a foreign voice, which is arranged in particular frontally with respect to the hearing aid wearer.
  • the voice of a certain other person is not understood in a foreign voice, but quite generally a voice which is not the voice of the hearing aid user.
  • the generation of the feature value is carried out as in the aforementioned international application PCT / EP 2015/068796 by means of a filter pair, wherein one of the filters is configured for a maximum attenuation of the own voice and the other filter for a maximum attenuation of a foreign voice, in particular a foreign voice, which originates from a person frontally in front of the hearing aid wearer.
  • the two filters each provide a match score in the analysis of a noise, and then the feature score is formed from the two match scores, eg, by subtracting the match score for the foreign vote from that of their own vote.
  • the characteristic value is then lower for a foreign vote than for one's own vote. If the threshold value is exceeded, the noise is recognized as a foreign voice; if the threshold is exceeded, the noise is recognized as a separate voice.
  • the generation of the feature values is also often user-dependent for other types of noise. Therefore, in the calibration method, in another advantageous embodiment, another type of noise, in particular a foreign voice, is recorded before or after the recording of one's own voice.
  • another type of noise in particular a foreign voice
  • several characteristic values are generated, in particular analogously to what was said above, as a function of which the threshold value is set. The calibration is thus significantly improved, in particular with regard to the accuracy in distinguishing between one's own voice and the other type of noise.
  • the mean value of the two average values of the two generated statistical distributions for the two types of noise is then set as the threshold value.
  • the person of the hearing aid wearer is not the only environmental condition with regard to which it is sensible to adjust the threshold value.
  • Of particular importance in the analysis of most types of noise is their superposition with noise, often background noise or noise.
  • the generation of a feature value i. In particular, the classification of the noise becomes more difficult and erroneous as the volume of the noise increases.
  • the threshold value is adjusted as a function of the environment by determining a noise value and setting the threshold value as a function of the noise value. This further optimizes the eigenstate recognition.
  • the noise value characterizes the noise and quantifies it in particular.
  • the noise value is a level, a volume, an intensity or an amplitude of the noise.
  • the signal-to-noise ratio is suitable as a noise value.
  • a typification of the noise ie the assignment of the currently existing noise to a specific noise type and an adjustment of the threshold value as a function of the detected noise type, the noise type then being the noise value.
  • any other environmental dependency is also suitable for first determining and, in particular, quantifying, in order subsequently to set the threshold value as a function thereof.
  • a plurality of value ranges are defined for the noise value, to each of which a threshold value is assigned.
  • the value range in which the noise value is located is then determined, and then the threshold value selected and set which is assigned to the determined value range is selected and set.
  • each noise value is simply assigned a sufficiently suitable threshold value, so that an overall allocation of e.g. in the form of a table from which of the most appropriate in each situation threshold is selected and then set. This is based on the consideration that the noise value is within a certain range of values, which is now advantageously divided into several, in particular, coherent intervals, in order to realize a noise value-dependent setting of the threshold value.
  • the noise value is a level of noise in the environment of the hearing aid.
  • the level is usually given in dB.
  • the value range then ranges, for example, from -90 to -40 dB and is divided into approximately 10 to 20 value ranges, for example 5 dB each.
  • Each value range is then assigned a separate threshold value.
  • the level of the noise is then measured and then that threshold value is set which is assigned to the value range in which the measured level lies.
  • the level is determined, for example, by means of a noise estimator, i. a so-called "noise estimator", e.g. based on a "minimum statistics" approach.
  • the assignment of threshold values to the value ranges takes place, for example, in the context of a fitting session with the acoustician or by the hearing aid wearer himself, eg as part of a calibration procedure. It is essential in particular that defined noise values are available or at least reliably measured.
  • the assignment can be made via a pure calibration measurement be performed and then be present as a table and stored on the hearing aid or the assignment is made by a functional assignment, which is for example an approximation to the result of the calibration.
  • the upper and lower limits are assumed for the threshold value, in particular an upper limit for low levels, eg below -75 dB, and a lower limit for high levels, eg above -60 dB, and linear extrapolation is used in between. In this case, it is advantageous to determine only a suitable upper and lower limit, as well as those ranges of values over which extrapolation is then carried out.
  • the threshold value is recalibrated recursively in a normal operation of the hearing device, in particular as described above with regard to the user-dependent determination of the optimum threshold value.
  • the user-dependent threshold value is thereby calibrated in particular continuously and with time always better adapted to the current hearing aid wearer. This corresponds in particular to a training operation for the hearing aid, which expediently ends after a certain training period.
  • the user-dependent threshold is then set in particular then fixed.
  • the hearing aid according to the invention has an intrinsic voice recognition, which is designed to carry out the method in one of the abovementioned embodiments. Depending on the result of the eigenstate recognition, the hearing device is then switched over to a suitable operating mode for the respective present situation. Switching takes place in a variant also by the Eigenmonerkennung.
  • a hearing aid 2 is shown. This is designed here as a so-called BTE device and is worn by a user behind the ear. In one variant, the hearing aid 2 is an ITE device and is worn in the ear. Other types of hearing aids are also suitable.
  • the hearing device 2 has a microphone 4 for recording noises from the surroundings of the hearing device 2. A recorded sound is processed as a signal in a control unit 6 of the hearing device 2 and processed for output via a loudspeaker 8. Usually this takes place an amplification of the signal, ie the noise.
  • the hearing device also has an intrinsic voice recognition 10, which in the exemplary embodiment shown is part of the control unit 6.
  • the control unit 6, the own voice recognition 10, the microphones 4 and the loudspeaker 8 are suitably connected with each other.
  • the hearing device 2 is operable in different operating modes, between which by means of the control unit 6 or the own voice recognition 10 is switched.
  • the eigenstate recognition 10 analyzes the recorded noises and assigns them to certain types of noise G1, G2, for example the noise type G1 "own voice” or the noise type G2 "foreign voice". Depending on the detected type of noise G1, G2 is then switched to a suitable operating mode. For detection, the eigenstate recognition 10 generates a feature value M and compares it with a threshold value S to decide which type of noise G1, G2 the analyzed noise is. This is related to the Fig. 2 and 3 described in more detail below.
  • the Fig. 2 and 3 each show results of a measurement in which several times in succession a noise was recorded and analyzed.
  • Two different types of noise G1, G2 were used, on the one hand the own voice of the hearing aid wearer and on the other hand a strange voice.
  • the own voice recognition 10 of the hearing device 2 first analyzes the recorded sound Noise with the aim of assigning to this one feature value M, which gives an indication of whether the noise is of one type or the other of the types of noise G1, G2.
  • this was realized by a filter pair, with two filters, which have different filter profiles.
  • the filters are designed in such a way that one filter attenuates one's own voice as much as possible and the other filter the foreign voice. By comparing the two different attenuations for the same noise, a feature value M is generated.
  • the plurality of feature values M, which were included in the measurements are in the Fig. 2 and 3 represented and plotted against a noise value R, here the level of noise in the environment.
  • the noise figure is given here in decibels (dB).
  • the noise value R is measured, for example, by means of a noise estimator.
  • the feature values M are also each assigned to one of two groups, depending on which type of noise G1, G2 was actually presented to the hearing aid. In this case, the feature values M, which were generated in the analysis of the own voice as noise type G1, are shown in light gray, and the feature values M, which were generated in the analysis of the foreign voice as noise type G2, are shown in black.
  • the measurements of Fig. 2 and 3 differ now in that they show results for different hearing aid users, ie at least one's own voice is different.
  • a smaller feature value M is predominantly generated than in the case of a separate voice.
  • a noise is recognized by the self-voice recognition 10 as a separate voice when the feature value M is greater than the threshold value S, and as a foreign voice when the feature value M is smaller than the threshold value S.
  • a fixed threshold S is used to be compared to the feature value M in any situation and environments. Like from the Fig. 2 and 3 However, this may be insufficient. Rather, it can be seen that the use of different threshold values S makes sense in different environments.
  • a first environmental dependence is that the generation of the feature value M is strongly dependent on the noise value R. For low noise values R, relatively large feature values M are still generated for the own voice, but with a larger noise value R, the difference to the feature values M of the foreign voice is significantly lower. Therefore, a smaller threshold value S is advantageously selected for larger noise values R.
  • Fig. 2 the optimum threshold values S are entered for individual value ranges W of the noise value R, namely as gray horizontal bars.
  • a threshold value S is effectively assigned to a specific value range W, so that the overall result is an assignment Z1 in the manner of a table.
  • the hearing aid 2 determines, on the one hand, a feature value M for a noise just recorded and, in addition, the environment, in this case the noise value R, ie effectively the level or volume of the noise superimposed on the noise.
  • the threshold value S is then adjusted as a function of the environment, namely to that threshold value S which is assigned to the value range W in which the determined noise value R lies.
  • the feature value M is compared with a threshold value S adapted in the given situation, and an optimum result is achieved in the distinction between the own voice and the foreign voice.
  • a simplified assignment Z2 is alternatively used. Such is also in Fig. 2 shown, as a dark gray, staircase-like line. Here, for the sake of simplification, it is assumed that below a low noise value Rmin a maximum threshold value Smax is sufficient and above a high noise value Rmax a minimum threshold value Smin is sufficient. Between an extrapolation of the threshold values S, here according to a linear relationship with respect to the selected representation. Overall, the simplified assignment Z2 virtually results in a smoothing of the assignment Z1 with the optimum threshold values S.
  • the assignment Z2 is stored in a variant as a simple table, alternatively a function is stored for the calculation.
  • Fig. 3 are on the one hand as well as in Fig. 2 an assignment Z1 of optimum threshold values S to specific value ranges W is shown as gray horizontal bars.
  • the same simplified assignment Z2 is off Fig. 2 in the Fig. 3 registered, namely again as a dark gray, staircase-like line.
  • the threshold value S is also set user-dependent, ie depending on the person of the hearing aid wearer.
  • the threshold value S is preferably set in an environment-dependent manner in two ways, namely on the one hand depending on the user and, on the other hand, depending on the noise value R measured at a given instant. Which threshold value S is then set concretely, i. one or mappings Z1, Z2, i. which threshold values S are available for selection is expediently determined in a calibration method. This is done either as part of a fitting session at the acoustician, by the hearing aid wearer himself, automatically by the hearing aid as part of an online optimization or a combination thereof.
  • noises of a known type of noise G1, G2 are analyzed and the thereby determined characteristic values M are used as typical feature values M to set a suitable threshold value S.
  • two different types of noise G1, G2 are used, two different statistical distributions of feature values M are then determined, for example, and then a threshold value S between them is selected.
  • the calibration is done in a variant by using previously known types of noise G1, G2, so that the correct assignment is trained.
  • the calibration is carried out in the normal operation of the hearing device 2 by generating feature values M in limited periods of a few seconds to a few tens of seconds and assuming that the determined in a given period extremes of the feature values M with a certain certainty Assign noise type G1, G2. For example, it is assumed that the generation of a maximum feature value M was caused by the own voice and the generation of a minimum feature value M by a foreign voice. These extremes are then used to establish an optimal threshold value S, which can be further adjusted and expediently used in further operation of the hearing device 2 by continuous calibration.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Claims (11)

  1. Procédé opérationnel d'un appareil auditif (2),
    - au moyen d'un microphone (4), un bruit étant enregistré,
    - le bruit étant analysé au niveau de sa concordance avec la propre voix du porteur de l'appareil auditif et une valeur caractéristique (M) étant générée, laquelle indique à quel point le bruit concorde avec la propre voix du porteur de l'appareil auditif,
    - la propre voix étant un type de bruit (G1),
    - la valeur caractéristique (M) étant comparée avec une valeur seuil (S),
    - le bruit étant identifié comme étant la propre voix, en fonction du fait si valeur caractéristique (M) est supérieure ou inférieure à la valeur seuil (S), et
    - l'appareil auditif (2) étant commuté entre plusieurs modes de fonctionnement, en fonction du fait si le bruit a été identifié comme étant la propre voix,
    caractérisé en ce que la valeur seuil (S) est déterminée en fonction de l'utilisateur et réglée en tant que valeur seuil (S) individuelle, en ce que la valeur seuil (S) est déterminée au moyen d'un procédé de calibrage, lors duquel la propre voix du porteur de l'appareil auditif est enregistrée et plusieurs valeurs caractéristiques (M) individuelles sont générées, et lors duquel, pour finir, la valeur seuil (S) individuelle est réglée en fonction des valeurs caractéristiques (M) individuelles générées,
    la génération de la valeur caractéristique (M) s'effectuant à l'aide d'une paire de filtres, l'un des filtres étant configuré pour un maximum d'atténuation de la propre voix et l'autre filtre étant configuré pour un maximum d'atténuation d'une voix étrangère.
  2. Procédé selon la revendication précédente, caractérisé en ce que la valeur seuil (S) est calibrée, en ce que sur une période limitée, une valeur caractéristique (M) maximale et minimale sont recherchées et la valeur seuil (S) est réglée entre la valeur caractéristique (M) minimale et maximale.
  3. Procédé selon l'une quelconque des revendications précédentes, caractérisé en ce que la valeur seuil (S) est recalibrée de manière récurrente dans un mode normal, lors de l'utilisation de l'appareil auditif (2) par le porteur de l'appareil auditif.
  4. Procédé selon l'une quelconque des revendications précédentes, caractérisé en ce qu'en supplément du niveau de la concordance avec la propre voix, le bruit est également analysé au niveau d'une concordance avec au moins un autre type de bruit (G2).
  5. Procédé selon la revendication précédente, caractérisé en ce que l'autre type de bruit (G2) est une voix étrangère, laquelle est placée notamment au niveau frontal par rapport au porteur de l'appareil auditif.
  6. Procédé selon la revendication précédente, caractérisé en ce que lors du procédé de calibrage, avant ou après l'enregistrement de la propre voix, un autre type de bruit (G2) est enregistré, et en ce qu'à cet effet également, plusieurs valeurs caractéristiques (M) sont générées, en fonction desquelles la valeur seuil (S) est réglée,
    à partir des valeurs caractéristiques (M), lesquelles sont générées par enregistrement de la propre voix, et d'autres valeurs caractéristiques (M), lesquelles sont générées par enregistrement de l'autre type de bruit (G2), étant générée respectivement une distribution statistique des valeurs caractéristiques (M) respectives et pour fixer la valeur seuil (S), une valeur seuil (S) entre les deux distributions étant sélectionnée.
  7. Procédé selon la revendication 6, l'autre type de bruit (G2) étant une voix étrangère.
  8. Procédé selon l'une quelconque des revendications précédentes, caractérisé en ce que la valeur seuil (S) est réglée en fonction de l'environnement, en ce qu'une valeur de bruit (R) est déterminée et la valeur seuil (S) est réglée en fonction de la valeur de bruit (R).
  9. Procédé selon la revendication précédente, caractérisé en ce que pour la valeur de bruit (R) sont définis plusieurs ordres de valeurs (W) auxquels est respectivement affectée une valeur seuil (S), en ce que l'ordre de valeurs (W) est recherché dans lequel se situe la valeur de bruit (R), et en ce que la valeur seuil (S) est sélectionnée et réglée, laquelle est affectée à l'ordre de valeurs (W) recherché.
  10. Procédé selon l'une quelconque des deux revendications précédentes, caractérisé en ce que la valeur seuil (S) est calibrée en mode normal, en ce que la valeur de bruit (R) est déterminée de manière récurrente et la valeur seuil (S) est calibrée en fonction de celle-ci.
  11. Appareil auditif (2) pourvu d'un microphone (4), destiné à enregistrer un bruit, et pourvu d'une identification de la propre voix (10), qui est conçue de telle sorte que
    - le bruit soit analysé au niveau de sa concordance avec la propre voix du porteur de l'appareil auditif et qu'il soit généré une valeur caractéristique (M), laquelle indique à quel point le bruit concorde avec la propre voix du porteur de l'appareil auditif,
    - la propre voix étant un type de bruit (G1),
    - la valeur caractéristique (M) étant comparée avec une valeur seuil (S),
    - le bruit étant identifié comme étant la propre voix, en fonction du fait si valeur caractéristique (M) est supérieure ou inférieure à la valeur seuil (S), et
    - l'appareil auditif étant commuté entre plusieurs modes de fonctionnement, en fonction du fait si le bruit a été identifié comme étant la propre voix, caractérisé en ce que
    - la valeur seuil (S) est déterminée en fonction de l'utilisateur et réglée en tant que valeur seuil (S) individuelle, en ce que la valeur seuil (S) est déterminée au moyen d'un procédé de calibrage, lors duquel la propre voix du porteur de l'appareil auditif est enregistrée et plusieurs valeurs caractéristiques (M) individuelles sont générées, et lors duquel, pour finir, la valeur seuil (S) individuelle est réglée en fonction des valeurs caractéristiques (M) individuelles générées,
    - la génération de la valeur caractéristique s'effectuant à l'aide d'une paire de filtres, l'un des filtres étant configuré pour un maximum d'atténuation de la propre voix et l'autre filtre étant configuré pour un maximum d'atténuation d'une voix étrangère.
EP17716463.9A 2016-03-10 2017-03-09 Procédé et appareil auditif pour detection de la voix propre sur la base d'un seuil individuel Active EP3427498B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP19195912.1A EP3598778A1 (fr) 2016-03-10 2017-03-09 Procédé de fonctionnement d'un appareil auditif ainsi qu'appareil auditif pour la detection de la propre voix sur la base d'une valeur seuil individuelle

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102016203987.3A DE102016203987A1 (de) 2016-03-10 2016-03-10 Verfahren zum Betrieb eines Hörgeräts sowie Hörgerät
PCT/EP2017/055613 WO2017153550A1 (fr) 2016-03-10 2017-03-09 Procédé de fonctionnement d'une prothèse auditive ainsi que prothèse auditive servant à la détection de la voix propre à l'aide d'une valeur seuil individuelle

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP19195912.1A Division EP3598778A1 (fr) 2016-03-10 2017-03-09 Procédé de fonctionnement d'un appareil auditif ainsi qu'appareil auditif pour la detection de la propre voix sur la base d'une valeur seuil individuelle

Publications (2)

Publication Number Publication Date
EP3427498A1 EP3427498A1 (fr) 2019-01-16
EP3427498B1 true EP3427498B1 (fr) 2019-09-18

Family

ID=58530500

Family Applications (2)

Application Number Title Priority Date Filing Date
EP17716463.9A Active EP3427498B1 (fr) 2016-03-10 2017-03-09 Procédé et appareil auditif pour detection de la voix propre sur la base d'un seuil individuel
EP19195912.1A Pending EP3598778A1 (fr) 2016-03-10 2017-03-09 Procédé de fonctionnement d'un appareil auditif ainsi qu'appareil auditif pour la detection de la propre voix sur la base d'une valeur seuil individuelle

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP19195912.1A Pending EP3598778A1 (fr) 2016-03-10 2017-03-09 Procédé de fonctionnement d'un appareil auditif ainsi qu'appareil auditif pour la detection de la propre voix sur la base d'une valeur seuil individuelle

Country Status (7)

Country Link
US (1) US10616694B2 (fr)
EP (2) EP3427498B1 (fr)
JP (1) JP6803394B2 (fr)
CN (1) CN108781339B (fr)
DE (1) DE102016203987A1 (fr)
DK (1) DK3427498T3 (fr)
WO (1) WO2017153550A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102018202155A1 (de) 2018-02-13 2019-03-07 Sivantos Pte. Ltd. Sprechhilfe-Vorrichtung und Verfahren zum Betrieb einer Sprechhilfe-Vorrichtung
DE102018209719A1 (de) * 2018-06-15 2019-07-11 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörsystems sowie Hörsystem
EP3664470B1 (fr) * 2018-12-05 2021-02-17 Sonova AG Fourniture d'une rétroaction du volume de la propre voix d'un utilisateur d'un dispositif auditif
DE102019201456B3 (de) * 2019-02-05 2020-07-23 Sivantos Pte. Ltd. Verfahren für eine individualisierte Signalverarbeitung eines Audiosignals eines Hörgerätes
US11750984B2 (en) 2020-09-25 2023-09-05 Bose Corporation Machine learning based self-speech removal
DE102020213051A1 (de) 2020-10-15 2022-04-21 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörhilfegeräts sowie Hörhilfegerät
JP2024502930A (ja) 2020-11-30 2024-01-24 ソノヴァ アー・ゲー 聴取システムにおける自声検出のためのシステムおよび方法

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2905112B2 (ja) * 1995-04-27 1999-06-14 リオン株式会社 環境音分析装置
JP3284968B2 (ja) * 1998-04-27 2002-05-27 ヤマハ株式会社 話速変換機能を有する補聴器
JP2998759B1 (ja) * 1999-03-25 2000-01-11 ヤマハ株式会社 振動検出器、自己発話検出器および補聴器
DE60204902T2 (de) * 2001-10-05 2006-05-11 Oticon A/S Verfahren zum programmieren einer kommunikationseinrichtung und programmierbare kommunikationseinrichtung
EP1599742B1 (fr) * 2003-02-25 2009-04-29 Oticon A/S Procede de detection de l'activite de la propre voix d'un utilisateur dans un dispositif de communication
JP4185866B2 (ja) * 2004-01-14 2008-11-26 富士通株式会社 音響信号処理装置および音響信号処理方法
JP4254753B2 (ja) * 2005-06-30 2009-04-15 ヤマハ株式会社 話者認識方法
DE102005032274B4 (de) * 2005-07-11 2007-05-10 Siemens Audiologische Technik Gmbh Hörvorrichtung und entsprechendes Verfahren zur Eigenstimmendetektion
JP4714523B2 (ja) * 2005-07-27 2011-06-29 富士通東芝モバイルコミュニケーションズ株式会社 話者照合装置
JP5151103B2 (ja) * 2006-09-14 2013-02-27 ヤマハ株式会社 音声認証装置、音声認証方法およびプログラム
ATE453910T1 (de) * 2007-02-06 2010-01-15 Oticon As Abschätzung der eigenen stimmaktivität mit einem hörgerätsystem aufgrund des verhältnisses zwischen direktklang und widerhall
US8477973B2 (en) * 2009-04-01 2013-07-02 Starkey Laboratories, Inc. Hearing assistance system with own voice detection
CA2765766A1 (fr) * 2009-06-17 2010-12-23 Widex A/S Procede d'initialisation d'un systeme d'aide auditive binaurale et aide auditive
US8462969B2 (en) * 2010-04-22 2013-06-11 Siemens Audiologische Technik Gmbh Systems and methods for own voice recognition with adaptations for noise robustness
JP2012083746A (ja) * 2010-09-17 2012-04-26 Kinki Univ 音処理装置
EP2528358A1 (fr) * 2011-05-23 2012-11-28 Oticon A/S Procédé d'identification d'un canal de communication sans fil dans un système sonore
DE102011087984A1 (de) * 2011-12-08 2013-06-13 Siemens Medical Instruments Pte. Ltd. Hörvorrichtung mit Sprecheraktivitätserkennung und Verfahren zum Betreiben einer Hörvorrichtung
JP6003472B2 (ja) * 2012-09-25 2016-10-05 富士ゼロックス株式会社 音声解析装置、音声解析システムおよびプログラム
WO2014112375A1 (fr) * 2013-01-17 2014-07-24 日本電気株式会社 Dispositif d'identification de locuteur, procédé d'identification de locuteur, et programme d'identification de locuteur
KR102060949B1 (ko) * 2013-08-09 2020-01-02 삼성전자주식회사 청각 기기의 저전력 운용 방법 및 장치
EP2882203A1 (fr) * 2013-12-06 2015-06-10 Oticon A/s Dispositif d'aide auditive pour communication mains libres
EP2991379B1 (fr) * 2014-08-28 2017-05-17 Sivantos Pte. Ltd. Procede et dispositif de perception amelioree de sa propre voix
EP3451705B1 (fr) 2014-11-19 2020-10-14 Sivantos Pte. Ltd. Procédé et dispositif de reconnaissance rapide de voix propre

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
JP2019507992A (ja) 2019-03-22
DE102016203987A1 (de) 2017-09-14
CN108781339B (zh) 2020-08-11
EP3427498A1 (fr) 2019-01-16
EP3598778A1 (fr) 2020-01-22
CN108781339A (zh) 2018-11-09
US20190020957A1 (en) 2019-01-17
JP6803394B2 (ja) 2020-12-23
WO2017153550A1 (fr) 2017-09-14
DK3427498T3 (da) 2019-12-16
US10616694B2 (en) 2020-04-07

Similar Documents

Publication Publication Date Title
EP3427498B1 (fr) Procédé et appareil auditif pour detection de la voix propre sur la base d'un seuil individuel
DE102015203288B3 (de) Verfahren zur Ermittlung von trägerspezifischen Nutzungsdaten eines Hörgeräts, Verfahren zur Anpassung von Hörgeräteeinstellungen eines Hörgeräts, Hörgerätesystem und Einstelleinheit für ein Hörgerätesystem
DE102019219510B3 (de) Verfahren, bei welchem zwei Hörgeräte miteinander gekoppelt werden, sowie Hörgerät
EP3068146A1 (fr) Procede de fonctionnement d'un appareil auditif et appareil auditif
EP3454572B1 (fr) Procédé de reconnaissance d'un défaut dans un appareil auditif
DE102017205652B3 (de) Verfahren zum Betrieb einer Hörvorrichtung und Hörvorrichtung
EP2305117A2 (fr) Procédé d'adaptation d'un appareil d'aide auditive ainsi qu'appareil d'adaptation d'appareils d'aide auditive
DE102007038191B3 (de) Individuell einstellbares Hörgerät und Verfahren zu seinem Betrieb
WO2016139205A1 (fr) Dispositif et procédé pour l'excitation d'un compresseur de dynamique et procédé pour déterminer des valeurs d'amplification pour un compresseur de dynamique
EP3873108A1 (fr) Système auditif pourvu d'au moins un instrument auditif porté dans ou sur l'oreille de l'utilisateur, ainsi que procédé de fonctionnement d'un tel système auditif
DE10145994A1 (de) Steuerung eines Hörgeräts durch Klopfen
DE102008046040B4 (de) Verfahren zum Betrieb einer Hörvorrichtung mit Richtwirkung und zugehörige Hörvorrichtung
EP2239963B1 (fr) Procédé et dispositif auditif destinés au réglage d'un appareil auditif doté de dotées enregistrées dans une unité externe
EP1523220A2 (fr) Dispositif de prothèse auditive pour commutation automatique en foctionnement téléphonique et procédé correspondant
EP2884772A1 (fr) Prothèse auditive avec détermination de son positionnement dans l'oreille
EP1696701B1 (fr) Dispositif d'écoute et procédé pour la surveillance de la capacité auditive pour malentendants
DE102012203349B4 (de) Verfahren zum Anpassen einer Hörvorrichtung anhand des Sensory Memory und Anpassvorrichtung
DE102016207936A1 (de) Verfahren zum Betrieb eines Hörgeräts
EP1416764B1 (fr) Procédé d'établissement des paramètres d'une prothèse auditive et dispositif pour la mise en oeuvre du procédé
DE102016103297B4 (de) Vorrichtung und Verfahren zur Konfiguration eines nutzerspezifischen Hörsystems
DE102006029268B4 (de) Hörvorrichtung mit Körperschalldetektionseinrichtung und entsprechendes Verfahren
EP3926981A1 (fr) Système auditif doté d'au moins un instrument auditif porté sur la tête de l'utilisateur, ainsi que mode de fonctionnement d'un tel système auditif
DE102019201879B3 (de) Verfahren zum Betrieb eines Hörsystems und Hörsystem
EP1845751B1 (fr) Prothèse auditif avec modification automatique
WO2024104945A1 (fr) Procédé de fonctionnement d'une prothèse auditive, et prothèse auditive

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180816

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
INTG Intention to grant announced

Effective date: 20190322

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
RIN1 Information on inventor provided before grant (corrected)

Inventor name: KAMKAR-PARSI, HOMAYOUN

Inventor name: ROSENKRANZ, TOBIAS DANIEL

Inventor name: LUGGER, MARKO

INTG Intention to grant announced

Effective date: 20190701

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

RIN1 Information on inventor provided before grant (corrected)

Inventor name: ROSENKRANZ, TOBIAS DANIEL

Inventor name: KAMKAR-PARSI, HOMAYOUN

Inventor name: LUGGER, MARKO

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502017002351

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1182727

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20191211

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191219

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200120

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502017002351

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200119

26N No opposition filed

Effective date: 20200619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1182727

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220309

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20230402

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240321

Year of fee payment: 8

Ref country code: GB

Payment date: 20240322

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240320

Year of fee payment: 8

Ref country code: DK

Payment date: 20240321

Year of fee payment: 8