EP3427498B1 - Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts - Google Patents
Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts Download PDFInfo
- Publication number
- EP3427498B1 EP3427498B1 EP17716463.9A EP17716463A EP3427498B1 EP 3427498 B1 EP3427498 B1 EP 3427498B1 EP 17716463 A EP17716463 A EP 17716463A EP 3427498 B1 EP3427498 B1 EP 3427498B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- voice
- threshold value
- value
- noise
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 37
- 238000001514 detection method Methods 0.000 title claims description 9
- 238000009826 distribution Methods 0.000 claims description 9
- 230000001419 dependent effect Effects 0.000 description 23
- 230000006870 function Effects 0.000 description 11
- 238000004458 analytical method Methods 0.000 description 9
- 238000005259 measurement Methods 0.000 description 7
- 230000007613 environmental effect Effects 0.000 description 4
- 238000013213 extrapolation Methods 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 208000032041 Hearing impaired Diseases 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000004069 differentiation Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 230000030808 detection of mechanical stimulus involved in sensory perception of sound Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003891 environmental analysis Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/70—Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
- H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
- G10L2025/783—Detection of presence or absence of voice signals based on threshold decision
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/61—Aspects relating to mechanical or electronic switches or control elements, e.g. functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/60—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles
- H04R25/603—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of mechanical or electronic switches or control elements
Definitions
- the invention relates to a method for operating a hearing aid according to claim 1, wherein a noise is recorded by means of a microphone, wherein the noise is analyzed in terms of its match with the own voice of the hearing aid wearer and a feature value is generated, which indicates how much the noise with the own voice of the hearing aid wearer, wherein the own voice is a noise type, wherein the feature value is compared with a threshold, the noise depending on whether the feature value is above or below the threshold, is recognized as a separate voice, and wherein the hearing aid depending on whether the noise was recognized as a separate voice, switching between several operating modes. Furthermore, the invention relates to a hearing aid according to claim 11.
- a method for eigenvoice recognition is, for example, in the applicant's international application with the file reference PCT / EP 2015/068796 described.
- a predetermined threshold for the detection of one's own voice is selected in response to ambient noise.
- different thresholds are initially set for different noise classes of ambient noise.
- the threshold value is selected as a function of the currently existing noise class.
- the analysis is carried out by means of special filters, each of which has its own filter profile, which is adapted to a particular noise, ie to a specific type of noise or noise class.
- a given signal is then filtered by the filters. From the resulting filtered signal it is then determined for each of the filters how much the original noise corresponds to the type of noise to which a respective filter is adapted.
- the filter profiles are designed, for example, such that the noise to be detected is maximally attenuated on account of the filter profile.
- Hearing aid generally refers to a device for outputting sound, i. Sounds understood by means of a loudspeaker, wherein the sound is obtained from sounds that have been recorded by means of at least one microphone from the environment. The sounds are converted by the microphone into electrical signals and processed in the hearing aid by means of a control unit. The signals are then converted back into noise via the loudspeaker and output.
- a hearing device is understood to be a device for the care of a hearing-impaired or hearing-impaired person who, in particular, wears the hearing aid continuously or most of the time in order to compensate for a hearing deficit.
- the hearing aid thus has a total of at least one microphone, a loudspeaker, also referred to as a handset, and a control unit, the latter controlling the recording of noise and its output.
- the control unit is at least designed to amplify the noise.
- a noise is recorded by means of the microphone.
- the noise or more precisely the electrical signal generated therefrom, is analyzed with regard to its agreement with the hearing aid wearer's own voice and a feature value is generated which indicates how strongly the sound matches the hearing aid wearer's own voice.
- the own voice is a type of noise, in particular several different types of noise.
- the feature value is preferably generated by means of a classifier.
- a classifier analyzes recorded noise for a number of characteristic features of a particular type of noise and provides the feature value as a measure of compliance with the type of noise.
- the characteristic value is then compared with a threshold value. Depending on whether the characteristic value is above or below the threshold value, the noise is recognized as a separate voice, ie clearly the type of noise "own In this respect, the comparison with the threshold value is a decision-making procedure for determining which values of the feature value are based on the existence of one's own voice and, finally, when one's own voice is recognized as being recognized.
- the analysis of the noise, the generation of the feature value, the comparison with the threshold value and the decision as to whether or not one's own voice is present are carried out by means of an eigenstate recognition, which is a component of the hearing device and which is realized, for example, as an integrated circuit.
- the intrinsic voice recognition can be part of the control unit of the hearing device or can be designed as a separate unit.
- the hearing aid is switched between several operating modes, such as a self-tuning mode and a non-voice-on mode. The switching takes place automatically, i. by the hearing aid itself, in particular by the control unit or directly by the own voice recognition.
- the threshold value is set user-dependent and as an individual threshold value.
- User-dependent determination of an individual threshold value is understood to mean that the threshold value is set as a function of the person of the hearing device wearer. In particular, no characteristic values from other hearing aid users / users are used for the determination of the threshold value.
- the adjustment takes place either in the context of a fitting session with the acoustician, by the hearing aid wearer himself or in normal operation, ie online, and automatically by the hearing aid.
- a possibly strongly deviating feature value is optimally taken into account in the determination, in particular classification of one's own voice. It makes sense, the generation of the feature value in itself as already described above specifically adapted the hearing aid wearer in order to realize a particularly optimal recognition of one's own voice.
- the threshold value is determined by means of a calibration method in which, in particular, the hearing aid wearer's own voice is recorded several times and a plurality of individual, i. user-specific characteristic values are generated. Finally, in the calibration method, the individual threshold value is set as a function of the individual feature values generated. In this way, a particularly suitable and user-optimal threshold value is set. Therefore, a plurality of individual feature values are generated, so that a distribution of the individual feature values is obtained, from which the threshold value is then determined.
- the threshold value is thus set as a function of the individual feature values generated in the calibration method by setting the threshold value with respect to a characteristic of the distribution, for example as a 2 ⁇ deviation from the mean or generally such that the generated feature values are predominantly above or below the threshold value.
- This embodiment is based on the knowledge that the threshold value can be strongly user-dependent. Especially in the described above and from the PCT / EP 2015/068796 For the method to be taken, the attenuation values generated by the filter used can vary greatly depending on the user. A fixed threshold value would therefore result in one user being recognized for his or her own voice and the other user being recognized as a foreign voice, even though his or her own voice exists in both cases.
- this embodiment is based on the consideration that both the own voice and foreign voices / ambient noises are detected during the course of the calibration process. Therefore, both feature values are obtained in the presence of one's own voice as well as in the presence of a foreign voice / ambient noise.
- the overall distribution of the feature values thus shows a range of possible feature values. Out This distribution is determined, for example by means of statistical methods, in particular averaging, the individual threshold.
- a feature value which is used to identify a noise and to assign it to a type of noise is determined and used, can vary considerably from one environment to another.
- a sometimes greatly altered feature value may be generated in the detection of a particular sound, as this may be e.g. changed, distorted or superimposed by other sounds.
- the hearing aid wearer's own voice is logically different from user to user, so that different hearing aid wearers also present different environments for the hearing aid.
- other sounds i. with respect to the hearing aid wearer external noise, e.g. foreign voices can lead to different characteristic values in different environments.
- noise is generally understood any kind of sound signals in the audible frequency range. Different types of sounds include your own voice, a foreign voice, sounds, sounds, music, noise and noise.
- the method according to the invention is further based on the consideration that a decision of the eigenstate recognition on the basis of a fixed predetermined threshold value is potentially heavily faulty.
- a decision of the eigenstate recognition on the basis of a fixed predetermined threshold value is potentially heavily faulty.
- a user-dependent setting of the threshold value is understood to mean in particular that no generally predetermined threshold value is used by the eigenstate recognition for decision-making.
- the respective suitable threshold value is selected in particular by a preceding environmental analysis.
- the actual environment is first of all determined by the eigenstate recognition itself or by the control unit, and then the associated threshold, which is optimal for the environment, is selected and set from a group of threshold values.
- a prior determination of the concrete threshold value to be used for this particular situation is to be distinguished. This determination is made either when setting the hearing aid, for example as part of a fitting session at the acoustician, or alternatively or additionally by the hearing aid wearer itself. Also an automatic determination in a special calibration or normal operation of the hearing aid is generally conceivable. In general, the determination creates an association of thresholds to environments so that there is a set of thresholds to choose from, from which the most appropriate one is then set. This assignment is expediently stored in a memory of the hearing device, in particular the control unit, for example as a table, as a functional assignment or as a user profile.
- predetermined threshold value not only is a predetermined threshold value stored, but several predetermined threshold values are stored for different environments. From a plurality of predetermined threshold values, a suitable one is selected and adjusted depending on the environment, so that during operation the selection of the operating mode of the hearing device is significantly less error-prone.
- the user-dependent setting of the individual threshold value is further to be distinguished from setting the determination of a feature value, for example a setting of the aforementioned filter or a classifier, which is used to analyze noises and to generate a feature value. Consequently, the threshold value does not serve to determine the feature value but to evaluate the already determined feature value.
- a configuration of those components which generate the characteristic values takes place, in particular, independently of the user-dependent or environment-dependent selection and setting of the threshold value for the evaluation of the feature value.
- these components are also set user-dependent. This is, for example, in terms of eigenstate recognition, i. the detection of the hearing aid wearer's voice, i. the generation of the feature value e.g. through a filter is expediently adapted to the voice of the hearing aid wearer in order to ensure optimum feature value generation and thus optimum distinguishability from other types of noise.
- the threshold value is calibrated by determining a maximum and a minimum feature value over a limited period of time and setting the threshold value between the minimum and the maximum feature value. This is based in particular on the assumption that at the maximum feature value the noise of the noise type is "own voice" and at the minimum feature value the noise of the noise type is "foreign voice". However, depending on the calculation of the feature value, this can also be reversed, ie it is then assumed that the own voice generates a minimum feature value and the foreign voice generates a maximum feature value.
- the limited period is usually a few seconds to a few tens of seconds, for example, about 20 seconds. The maximum and minimum characteristic values are thus short-term extrema within the period.
- the threshold value is calibrated in normal operation by the individual feature values are determined recurrently and the threshold value is set depending on it. As a result, the threshold value is continuously adjusted so that the threshold values stored in the context of the assignment approximate to optimum threshold values over time.
- the calibration does not correspond to the environment-dependent setting of the threshold, which is set in a specific situation. Rather, during calibration, an adjustment of the stored for a respective range of values threshold, which is then set.
- the recurrent re-calibration of the threshold of a range of values is a continuous online optimization of the eigenstate recognition. This optimization is either continuous or only at specific times, or just over a single specified period of time.
- the noise is analyzed in addition to the agreement with the own voice also in terms of a match with at least one other type of noise.
- a match value is generated which indicates how strongly the noise matches a specific type of noise, with the match values then being combined into the feature value.
- One of the at least two types of noise is one's own voice.
- the feature value is, for example, the difference or the quotient of the two match values.
- One's own voice and another type of noise corresponds, in a preferred variant, to the distinction between local, i. spatially separated noises.
- One's own voice is regularly that type of noise which is closest to the hearing device spatially, so that due to the spatial differentiation, i. a differentiation according to the location of the noise, in a simple way also between one's voice and another type of noise is distinguished.
- the other type of noise is a foreign voice, which is arranged in particular frontally with respect to the hearing aid wearer.
- the voice of a certain other person is not understood in a foreign voice, but quite generally a voice which is not the voice of the hearing aid user.
- the generation of the feature value is carried out as in the aforementioned international application PCT / EP 2015/068796 by means of a filter pair, wherein one of the filters is configured for a maximum attenuation of the own voice and the other filter for a maximum attenuation of a foreign voice, in particular a foreign voice, which originates from a person frontally in front of the hearing aid wearer.
- the two filters each provide a match score in the analysis of a noise, and then the feature score is formed from the two match scores, eg, by subtracting the match score for the foreign vote from that of their own vote.
- the characteristic value is then lower for a foreign vote than for one's own vote. If the threshold value is exceeded, the noise is recognized as a foreign voice; if the threshold is exceeded, the noise is recognized as a separate voice.
- the generation of the feature values is also often user-dependent for other types of noise. Therefore, in the calibration method, in another advantageous embodiment, another type of noise, in particular a foreign voice, is recorded before or after the recording of one's own voice.
- another type of noise in particular a foreign voice
- several characteristic values are generated, in particular analogously to what was said above, as a function of which the threshold value is set. The calibration is thus significantly improved, in particular with regard to the accuracy in distinguishing between one's own voice and the other type of noise.
- the mean value of the two average values of the two generated statistical distributions for the two types of noise is then set as the threshold value.
- the person of the hearing aid wearer is not the only environmental condition with regard to which it is sensible to adjust the threshold value.
- Of particular importance in the analysis of most types of noise is their superposition with noise, often background noise or noise.
- the generation of a feature value i. In particular, the classification of the noise becomes more difficult and erroneous as the volume of the noise increases.
- the threshold value is adjusted as a function of the environment by determining a noise value and setting the threshold value as a function of the noise value. This further optimizes the eigenstate recognition.
- the noise value characterizes the noise and quantifies it in particular.
- the noise value is a level, a volume, an intensity or an amplitude of the noise.
- the signal-to-noise ratio is suitable as a noise value.
- a typification of the noise ie the assignment of the currently existing noise to a specific noise type and an adjustment of the threshold value as a function of the detected noise type, the noise type then being the noise value.
- any other environmental dependency is also suitable for first determining and, in particular, quantifying, in order subsequently to set the threshold value as a function thereof.
- a plurality of value ranges are defined for the noise value, to each of which a threshold value is assigned.
- the value range in which the noise value is located is then determined, and then the threshold value selected and set which is assigned to the determined value range is selected and set.
- each noise value is simply assigned a sufficiently suitable threshold value, so that an overall allocation of e.g. in the form of a table from which of the most appropriate in each situation threshold is selected and then set. This is based on the consideration that the noise value is within a certain range of values, which is now advantageously divided into several, in particular, coherent intervals, in order to realize a noise value-dependent setting of the threshold value.
- the noise value is a level of noise in the environment of the hearing aid.
- the level is usually given in dB.
- the value range then ranges, for example, from -90 to -40 dB and is divided into approximately 10 to 20 value ranges, for example 5 dB each.
- Each value range is then assigned a separate threshold value.
- the level of the noise is then measured and then that threshold value is set which is assigned to the value range in which the measured level lies.
- the level is determined, for example, by means of a noise estimator, i. a so-called "noise estimator", e.g. based on a "minimum statistics" approach.
- the assignment of threshold values to the value ranges takes place, for example, in the context of a fitting session with the acoustician or by the hearing aid wearer himself, eg as part of a calibration procedure. It is essential in particular that defined noise values are available or at least reliably measured.
- the assignment can be made via a pure calibration measurement be performed and then be present as a table and stored on the hearing aid or the assignment is made by a functional assignment, which is for example an approximation to the result of the calibration.
- the upper and lower limits are assumed for the threshold value, in particular an upper limit for low levels, eg below -75 dB, and a lower limit for high levels, eg above -60 dB, and linear extrapolation is used in between. In this case, it is advantageous to determine only a suitable upper and lower limit, as well as those ranges of values over which extrapolation is then carried out.
- the threshold value is recalibrated recursively in a normal operation of the hearing device, in particular as described above with regard to the user-dependent determination of the optimum threshold value.
- the user-dependent threshold value is thereby calibrated in particular continuously and with time always better adapted to the current hearing aid wearer. This corresponds in particular to a training operation for the hearing aid, which expediently ends after a certain training period.
- the user-dependent threshold is then set in particular then fixed.
- the hearing aid according to the invention has an intrinsic voice recognition, which is designed to carry out the method in one of the abovementioned embodiments. Depending on the result of the eigenstate recognition, the hearing device is then switched over to a suitable operating mode for the respective present situation. Switching takes place in a variant also by the Eigenmonerkennung.
- a hearing aid 2 is shown. This is designed here as a so-called BTE device and is worn by a user behind the ear. In one variant, the hearing aid 2 is an ITE device and is worn in the ear. Other types of hearing aids are also suitable.
- the hearing device 2 has a microphone 4 for recording noises from the surroundings of the hearing device 2. A recorded sound is processed as a signal in a control unit 6 of the hearing device 2 and processed for output via a loudspeaker 8. Usually this takes place an amplification of the signal, ie the noise.
- the hearing device also has an intrinsic voice recognition 10, which in the exemplary embodiment shown is part of the control unit 6.
- the control unit 6, the own voice recognition 10, the microphones 4 and the loudspeaker 8 are suitably connected with each other.
- the hearing device 2 is operable in different operating modes, between which by means of the control unit 6 or the own voice recognition 10 is switched.
- the eigenstate recognition 10 analyzes the recorded noises and assigns them to certain types of noise G1, G2, for example the noise type G1 "own voice” or the noise type G2 "foreign voice". Depending on the detected type of noise G1, G2 is then switched to a suitable operating mode. For detection, the eigenstate recognition 10 generates a feature value M and compares it with a threshold value S to decide which type of noise G1, G2 the analyzed noise is. This is related to the Fig. 2 and 3 described in more detail below.
- the Fig. 2 and 3 each show results of a measurement in which several times in succession a noise was recorded and analyzed.
- Two different types of noise G1, G2 were used, on the one hand the own voice of the hearing aid wearer and on the other hand a strange voice.
- the own voice recognition 10 of the hearing device 2 first analyzes the recorded sound Noise with the aim of assigning to this one feature value M, which gives an indication of whether the noise is of one type or the other of the types of noise G1, G2.
- this was realized by a filter pair, with two filters, which have different filter profiles.
- the filters are designed in such a way that one filter attenuates one's own voice as much as possible and the other filter the foreign voice. By comparing the two different attenuations for the same noise, a feature value M is generated.
- the plurality of feature values M, which were included in the measurements are in the Fig. 2 and 3 represented and plotted against a noise value R, here the level of noise in the environment.
- the noise figure is given here in decibels (dB).
- the noise value R is measured, for example, by means of a noise estimator.
- the feature values M are also each assigned to one of two groups, depending on which type of noise G1, G2 was actually presented to the hearing aid. In this case, the feature values M, which were generated in the analysis of the own voice as noise type G1, are shown in light gray, and the feature values M, which were generated in the analysis of the foreign voice as noise type G2, are shown in black.
- the measurements of Fig. 2 and 3 differ now in that they show results for different hearing aid users, ie at least one's own voice is different.
- a smaller feature value M is predominantly generated than in the case of a separate voice.
- a noise is recognized by the self-voice recognition 10 as a separate voice when the feature value M is greater than the threshold value S, and as a foreign voice when the feature value M is smaller than the threshold value S.
- a fixed threshold S is used to be compared to the feature value M in any situation and environments. Like from the Fig. 2 and 3 However, this may be insufficient. Rather, it can be seen that the use of different threshold values S makes sense in different environments.
- a first environmental dependence is that the generation of the feature value M is strongly dependent on the noise value R. For low noise values R, relatively large feature values M are still generated for the own voice, but with a larger noise value R, the difference to the feature values M of the foreign voice is significantly lower. Therefore, a smaller threshold value S is advantageously selected for larger noise values R.
- Fig. 2 the optimum threshold values S are entered for individual value ranges W of the noise value R, namely as gray horizontal bars.
- a threshold value S is effectively assigned to a specific value range W, so that the overall result is an assignment Z1 in the manner of a table.
- the hearing aid 2 determines, on the one hand, a feature value M for a noise just recorded and, in addition, the environment, in this case the noise value R, ie effectively the level or volume of the noise superimposed on the noise.
- the threshold value S is then adjusted as a function of the environment, namely to that threshold value S which is assigned to the value range W in which the determined noise value R lies.
- the feature value M is compared with a threshold value S adapted in the given situation, and an optimum result is achieved in the distinction between the own voice and the foreign voice.
- a simplified assignment Z2 is alternatively used. Such is also in Fig. 2 shown, as a dark gray, staircase-like line. Here, for the sake of simplification, it is assumed that below a low noise value Rmin a maximum threshold value Smax is sufficient and above a high noise value Rmax a minimum threshold value Smin is sufficient. Between an extrapolation of the threshold values S, here according to a linear relationship with respect to the selected representation. Overall, the simplified assignment Z2 virtually results in a smoothing of the assignment Z1 with the optimum threshold values S.
- the assignment Z2 is stored in a variant as a simple table, alternatively a function is stored for the calculation.
- Fig. 3 are on the one hand as well as in Fig. 2 an assignment Z1 of optimum threshold values S to specific value ranges W is shown as gray horizontal bars.
- the same simplified assignment Z2 is off Fig. 2 in the Fig. 3 registered, namely again as a dark gray, staircase-like line.
- the threshold value S is also set user-dependent, ie depending on the person of the hearing aid wearer.
- the threshold value S is preferably set in an environment-dependent manner in two ways, namely on the one hand depending on the user and, on the other hand, depending on the noise value R measured at a given instant. Which threshold value S is then set concretely, i. one or mappings Z1, Z2, i. which threshold values S are available for selection is expediently determined in a calibration method. This is done either as part of a fitting session at the acoustician, by the hearing aid wearer himself, automatically by the hearing aid as part of an online optimization or a combination thereof.
- noises of a known type of noise G1, G2 are analyzed and the thereby determined characteristic values M are used as typical feature values M to set a suitable threshold value S.
- two different types of noise G1, G2 are used, two different statistical distributions of feature values M are then determined, for example, and then a threshold value S between them is selected.
- the calibration is done in a variant by using previously known types of noise G1, G2, so that the correct assignment is trained.
- the calibration is carried out in the normal operation of the hearing device 2 by generating feature values M in limited periods of a few seconds to a few tens of seconds and assuming that the determined in a given period extremes of the feature values M with a certain certainty Assign noise type G1, G2. For example, it is assumed that the generation of a maximum feature value M was caused by the own voice and the generation of a minimum feature value M by a foreign voice. These extremes are then used to establish an optimal threshold value S, which can be further adjusted and expediently used in further operation of the hearing device 2 by continuous calibration.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP19195912.1A EP3598778A1 (de) | 2016-03-10 | 2017-03-09 | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102016203987.3A DE102016203987A1 (de) | 2016-03-10 | 2016-03-10 | Verfahren zum Betrieb eines Hörgeräts sowie Hörgerät |
PCT/EP2017/055613 WO2017153550A1 (de) | 2016-03-10 | 2017-03-09 | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19195912.1A Division EP3598778A1 (de) | 2016-03-10 | 2017-03-09 | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3427498A1 EP3427498A1 (de) | 2019-01-16 |
EP3427498B1 true EP3427498B1 (de) | 2019-09-18 |
Family
ID=58530500
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17716463.9A Active EP3427498B1 (de) | 2016-03-10 | 2017-03-09 | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts |
EP19195912.1A Pending EP3598778A1 (de) | 2016-03-10 | 2017-03-09 | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19195912.1A Pending EP3598778A1 (de) | 2016-03-10 | 2017-03-09 | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts |
Country Status (7)
Country | Link |
---|---|
US (1) | US10616694B2 (ja) |
EP (2) | EP3427498B1 (ja) |
JP (1) | JP6803394B2 (ja) |
CN (1) | CN108781339B (ja) |
DE (1) | DE102016203987A1 (ja) |
DK (1) | DK3427498T3 (ja) |
WO (1) | WO2017153550A1 (ja) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018202155A1 (de) | 2018-02-13 | 2019-03-07 | Sivantos Pte. Ltd. | Sprechhilfe-Vorrichtung und Verfahren zum Betrieb einer Sprechhilfe-Vorrichtung |
DE102018209719A1 (de) * | 2018-06-15 | 2019-07-11 | Sivantos Pte. Ltd. | Verfahren zum Betrieb eines Hörsystems sowie Hörsystem |
EP3664470B1 (en) * | 2018-12-05 | 2021-02-17 | Sonova AG | Providing feedback of an own voice loudness of a user of a hearing device |
DE102019201456B3 (de) * | 2019-02-05 | 2020-07-23 | Sivantos Pte. Ltd. | Verfahren für eine individualisierte Signalverarbeitung eines Audiosignals eines Hörgerätes |
US11750984B2 (en) | 2020-09-25 | 2023-09-05 | Bose Corporation | Machine learning based self-speech removal |
DE102020213051A1 (de) | 2020-10-15 | 2022-04-21 | Sivantos Pte. Ltd. | Verfahren zum Betrieb eines Hörhilfegeräts sowie Hörhilfegerät |
WO2022112834A1 (en) | 2020-11-30 | 2022-06-02 | Sonova Ag | Systems and methods for own voice detection in a hearing system |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2905112B2 (ja) * | 1995-04-27 | 1999-06-14 | リオン株式会社 | 環境音分析装置 |
JP3284968B2 (ja) * | 1998-04-27 | 2002-05-27 | ヤマハ株式会社 | 話速変換機能を有する補聴器 |
JP2998759B1 (ja) * | 1999-03-25 | 2000-01-11 | ヤマハ株式会社 | 振動検出器、自己発話検出器および補聴器 |
DK1437031T3 (da) * | 2001-10-05 | 2005-10-10 | Oticon As | Fremgangsmåde til programmering af en kommunikationsanordning og programmerbar kommunikationsanordning |
DK1599742T3 (da) * | 2003-02-25 | 2009-07-27 | Oticon As | Fremgangsmåde til detektering af en taleaktivitet i en kommunikationsanordning |
JP4185866B2 (ja) * | 2004-01-14 | 2008-11-26 | 富士通株式会社 | 音響信号処理装置および音響信号処理方法 |
JP4254753B2 (ja) * | 2005-06-30 | 2009-04-15 | ヤマハ株式会社 | 話者認識方法 |
DE102005032274B4 (de) * | 2005-07-11 | 2007-05-10 | Siemens Audiologische Technik Gmbh | Hörvorrichtung und entsprechendes Verfahren zur Eigenstimmendetektion |
JP4714523B2 (ja) * | 2005-07-27 | 2011-06-29 | 富士通東芝モバイルコミュニケーションズ株式会社 | 話者照合装置 |
JP5151103B2 (ja) * | 2006-09-14 | 2013-02-27 | ヤマハ株式会社 | 音声認証装置、音声認証方法およびプログラム |
EP1956589B1 (en) * | 2007-02-06 | 2009-12-30 | Oticon A/S | Estimating own-voice activity in a hearing-instrument system from direct-to-reverberant ratio |
US8477973B2 (en) * | 2009-04-01 | 2013-07-02 | Starkey Laboratories, Inc. | Hearing assistance system with own voice detection |
KR101334538B1 (ko) * | 2009-06-17 | 2013-11-28 | 비덱스 에이/에스 | 양이 보청 시스템을 초기화하는 방법 및 보청기 |
US8462969B2 (en) * | 2010-04-22 | 2013-06-11 | Siemens Audiologische Technik Gmbh | Systems and methods for own voice recognition with adaptations for noise robustness |
JP2012083746A (ja) * | 2010-09-17 | 2012-04-26 | Kinki Univ | 音処理装置 |
EP2528358A1 (en) * | 2011-05-23 | 2012-11-28 | Oticon A/S | A method of identifying a wireless communication channel in a sound system |
DE102011087984A1 (de) * | 2011-12-08 | 2013-06-13 | Siemens Medical Instruments Pte. Ltd. | Hörvorrichtung mit Sprecheraktivitätserkennung und Verfahren zum Betreiben einer Hörvorrichtung |
JP6003472B2 (ja) * | 2012-09-25 | 2016-10-05 | 富士ゼロックス株式会社 | 音声解析装置、音声解析システムおよびプログラム |
JP6424628B2 (ja) * | 2013-01-17 | 2018-11-21 | 日本電気株式会社 | 話者識別装置、話者識別方法、および話者識別用プログラム |
KR102060949B1 (ko) * | 2013-08-09 | 2020-01-02 | 삼성전자주식회사 | 청각 기기의 저전력 운용 방법 및 장치 |
EP2882203A1 (en) * | 2013-12-06 | 2015-06-10 | Oticon A/s | Hearing aid device for hands free communication |
EP2991379B1 (de) | 2014-08-28 | 2017-05-17 | Sivantos Pte. Ltd. | Verfahren und vorrichtung zur verbesserten wahrnehmung der eigenen stimme |
WO2016078786A1 (de) | 2014-11-19 | 2016-05-26 | Sivantos Pte. Ltd. | Verfahren und vorrichtung zum schnellen erkennen der eigenen stimme |
-
2016
- 2016-03-10 DE DE102016203987.3A patent/DE102016203987A1/de active Pending
-
2017
- 2017-03-09 CN CN201780015132.3A patent/CN108781339B/zh active Active
- 2017-03-09 WO PCT/EP2017/055613 patent/WO2017153550A1/de active Application Filing
- 2017-03-09 JP JP2018547274A patent/JP6803394B2/ja active Active
- 2017-03-09 EP EP17716463.9A patent/EP3427498B1/de active Active
- 2017-03-09 EP EP19195912.1A patent/EP3598778A1/de active Pending
- 2017-03-09 DK DK17716463.9T patent/DK3427498T3/da active
-
2018
- 2018-09-07 US US16/124,493 patent/US10616694B2/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
WO2017153550A1 (de) | 2017-09-14 |
JP2019507992A (ja) | 2019-03-22 |
US20190020957A1 (en) | 2019-01-17 |
EP3427498A1 (de) | 2019-01-16 |
EP3598778A1 (de) | 2020-01-22 |
DK3427498T3 (da) | 2019-12-16 |
DE102016203987A1 (de) | 2017-09-14 |
JP6803394B2 (ja) | 2020-12-23 |
CN108781339A (zh) | 2018-11-09 |
CN108781339B (zh) | 2020-08-11 |
US10616694B2 (en) | 2020-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3427498B1 (de) | Verfahren zum betrieb eines hörgeräts sowie hörgerät zur detektion der eigenstimme anhand eines individuellen schwellwerts | |
DE102015203288B3 (de) | Verfahren zur Ermittlung von trägerspezifischen Nutzungsdaten eines Hörgeräts, Verfahren zur Anpassung von Hörgeräteeinstellungen eines Hörgeräts, Hörgerätesystem und Einstelleinheit für ein Hörgerätesystem | |
DE102019219510B3 (de) | Verfahren, bei welchem zwei Hörgeräte miteinander gekoppelt werden, sowie Hörgerät | |
EP3454572B1 (de) | Verfahren zum erkennen eines defektes in einem hörinstrument | |
EP3445067A1 (de) | Verfahren zum betrieb eines hörgeräts und hörgerät | |
EP3068146A1 (de) | Verfahren zum betrieb eines hörgeräts sowie hörgerät | |
EP3873108A1 (de) | Hörsystem mit mindestens einem im oder am ohr des nutzers getragenen hörinstrument sowie verfahren zum betrieb eines solchen hörsystems | |
DE102017205652B3 (de) | Verfahren zum Betrieb einer Hörvorrichtung und Hörvorrichtung | |
EP2026607B1 (de) | Individuell einstellbares Hörgerät und Verfahren zu seinem Betrieb | |
WO2016139205A1 (de) | Vorrichtung und verfahren zum ansteuern des dynamikkompressors und verfahren zum ermitteln von verstärkungswerten für einen dynamikkompressor | |
DE10145994A1 (de) | Steuerung eines Hörgeräts durch Klopfen | |
DE102008046040B4 (de) | Verfahren zum Betrieb einer Hörvorrichtung mit Richtwirkung und zugehörige Hörvorrichtung | |
EP2239963B1 (de) | Verfahren und Hörvorrichtung zum Einstellen eines Hörgeräts mit in einer externen Einheit aufgezeichneten Daten | |
EP1523220A2 (de) | Hörhilfevorrichtung zum automatischen Schalten in einen Telefonbetrieb und entsprechendes Verfahren | |
EP2884772A1 (de) | Hörgerät mit ermittlung seines sitzes im ohr | |
EP3926981A1 (de) | Hörsystem mit mindestens einem am kopf des nutzers getragenen hörinstrument sowie verfahren zum betrieb eines solchen hörsystems | |
EP1696701B1 (de) | Hörvorrichtung und Verfahren zum Überwachen des Hörvermögens eines Minderhörenden | |
DE102012203349B4 (de) | Verfahren zum Anpassen einer Hörvorrichtung anhand des Sensory Memory und Anpassvorrichtung | |
DE102016207936A1 (de) | Verfahren zum Betrieb eines Hörgeräts | |
EP1416764B1 (de) | Verfahren zur Einstellung eines Hörgerätes sowie Vorrichtung zur Durchführung des Verfahrens | |
EP1303166A2 (de) | Verfahren zum Betrieb eines Hörgerätes und Anordung mit einem Hörgerät | |
DE102016103297B4 (de) | Vorrichtung und Verfahren zur Konfiguration eines nutzerspezifischen Hörsystems | |
DE102006029268B4 (de) | Hörvorrichtung mit Körperschalldetektionseinrichtung und entsprechendes Verfahren | |
EP1845751B1 (de) | Automatisch modifizierendes Hörgerät | |
WO2024104945A1 (de) | Verfahren zum betrieb eines hörgeräts sowie hörgerät |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20180816 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
INTG | Intention to grant announced |
Effective date: 20190322 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTC | Intention to grant announced (deleted) | ||
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: KAMKAR-PARSI, HOMAYOUN Inventor name: ROSENKRANZ, TOBIAS DANIEL Inventor name: LUGGER, MARKO |
|
INTG | Intention to grant announced |
Effective date: 20190701 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: ROSENKRANZ, TOBIAS DANIEL Inventor name: KAMKAR-PARSI, HOMAYOUN Inventor name: LUGGER, MARKO |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502017002351 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1182727 Country of ref document: AT Kind code of ref document: T Effective date: 20191015 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20191211 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20190918 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191218 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191218 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191219 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200120 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200224 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502017002351 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG2D | Information on lapse in contracting state deleted |
Ref country code: IS |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200119 |
|
26N | No opposition filed |
Effective date: 20200619 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 1182727 Country of ref document: AT Kind code of ref document: T Effective date: 20220309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190918 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240321 Year of fee payment: 8 Ref country code: GB Payment date: 20240322 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240320 Year of fee payment: 8 Ref country code: DK Payment date: 20240321 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20240401 Year of fee payment: 8 |