EP1443803B1 - Hearing aid and method for the detection and automatic selection of an input signal - Google Patents
Hearing aid and method for the detection and automatic selection of an input signal Download PDFInfo
- Publication number
- EP1443803B1 EP1443803B1 EP04405158.9A EP04405158A EP1443803B1 EP 1443803 B1 EP1443803 B1 EP 1443803B1 EP 04405158 A EP04405158 A EP 04405158A EP 1443803 B1 EP1443803 B1 EP 1443803B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- input signal
- analog
- hearing aid
- relevant
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000001514 detection method Methods 0.000 title claims description 42
- 238000000034 method Methods 0.000 title claims description 20
- 238000012545 processing Methods 0.000 claims description 32
- 230000005236 sound signal Effects 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 10
- 238000004422 calculation algorithm Methods 0.000 claims description 3
- 238000013459 approach Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000003750 conditioning effect Effects 0.000 description 3
- 238000007635 classification algorithm Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 235000014676 Phragmites communis Nutrition 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001225 therapeutic effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000003245 working effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/03—Aspects of the reduction of energy consumption in hearing devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
- H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
Definitions
- the invention relates to the field of hearing devices or hearing aids. It relates in particular to a hearing aid with detection and automatic selection of an input signal and a method for detecting and automatically selecting an input signal in a hearing aid as described in the preamble of the corresponding independent claims.
- hearing aid denotes on the one hand hearing aid devices that are therapeutic devices improving the hearing ability of individuals, primarily according to diagnostic results. Such hearing aid devices may be Outside-The-Ear hearing aid devices or In-The-Ear hearing aid devices.
- hearing aid devices stands for devices which may improve the hearing of individuals with normal hearing e.g. in specific acoustical situations as in a very noisy environment or in concert halls, or which may even be used in context with remote communication or with audio listening, for instance as provided by headphones.
- the hearing devices addressed by the present invention are so-called active hearing devices which comprise at the input side at least one acoustical to electrical converter, such as a microphone, at the output side at least one electrical to mechanical converter, such as a loudspeaker, and which further comprise a signal processing unit for processing signals according to the output signals of the acoustical to electrical converter and for generating output signals to the electrical input of the electrical to mechanical output converter.
- the signal processing circuit may be an analog, digital or hybrid analog-digital circuit, and may be implemented with discrete electronic components, integrated circuits, or a combination of both.
- Many hearing aids comprise more than one microphone in order to allow directional hearing. They may also have additional signal sources such as telecoils, audio input lines and wireless receivers for amplitude or frequency modulated (AM or FM) signals.
- AM or FM amplitude or frequency modulated
- Telecoils and the processing of telecoil signals are e.g. activated by a reed relay that is operated by a small magnet attached to a telephone receiver as described in DE 31 09 049 C2 .
- Audio input processing may be enabled by a contact which is mechanically activated when a corresponding input device such as an audio shoe is attached to the hearing aid.
- DE 101 46 886 proposes to constantly digitise audio signals from two potential signal sources.
- the digitised signals are analysed by a classification algorithm running on a digital signal processor (DSP), resulting in an indication which signal may carry relevant acoustic information.
- DSP digital signal processor
- the respective signal or a mixture of signals is then fed to the output speaker.
- US 2003/223592 A1 is directed to minimising the number of electrical terminals of a microphone assembly, where the microphone assembly on the one hand has an internal microphone and on the other hand can handle externally generated auxiliary audio signals.
- the auxiliary audio signal and a control signal for switching the assembly to process the auxiliary audio signal are transmitted over the same pair of terminals.
- a switching means is adapted to detect the control signal and then to select the auxiliary signal instead of the internal one.
- the auxiliary signal source must be adapted to generate the control signal required by the switching means. This principle is extended to more than one auxiliary input.
- the detection in the switching means is based on the characteristic of the combined auxiliary/control signal , such as its DC or AC amplitude level, but the manner in which this detection is accomplished is not disclosed. No further information is given on the internal workings of the switching means, that is, on the structure according to which the input signal characteristics are analysed.
- EP-A-1 367 857 describes a data logging method for a hearing prosthesis comprises two AD-converters. In an omnidirectional mode of operation, one of the AD-converters is shut down to conserve power. The mode of operation is selected by the user, not automatically.
- US-A-4 596 902 discloses a hearing aid with a microprocessor and further elements.
- the input signal is analysed periodically with a subset of the power-consuming circuitry, and only if a relevant signal (according to intensity and duration) is present, is the entire hearing aid fully activated.
- an A/D converter is configured to digitise said first analog input signal and transmit the digitised signal for further processing.
- Said A/D converter is either an A/D converter that was powered down and is activated to convert said first analog input signal, or an A/D converter that was used to convert another analog input signal and is switched over to analyse the first analog input signal instead.
- the digitised input signal corresponding to the newly detected analog signal may be analysed and classified in the DSP or in any other appropriate processing means such as a microcontroller or custom integrated circuit in order to verify whether it should be provided to the user. In this way, the flexibility and sophistication of classification algorithms that may be implemented on the DSP are obtained.
- a hearing aid further comprises a signal detection means configured to analyse a single signal, and a further input multiplexer for alternately selecting one of the analog input signals and feeding it to the signal detection means in turn.
- the signal detection means is configured to indicate the presence of a relevant signal in an input signal if the amplitude of the input signal exceeds a predetermined amplitude threshold during a predetermined minimum time within a predetermined time window.
- the amplitude threshold may optionally be dynamically adapted in accordance with user feedback and/or with the signal classification performed by the digital signal processing means. For example, if the signal detection means repeatedly reports the presence of a signal which is then rejected by the signal processing means, then the amplitude threshold can be increased.
- This approach allows a simple and low-power implementation of a detection circuit and method.
- a digital signal processor is not required, and yet all of the input signals can be analysed for the presence of a relevant signal.
- the approach works equally well for two or more signal sources.
- each of these selected input signals is associated with one A/D converter, either by powering on the converter or by routing or feeding the input signal to the converter.
- the DSP is then configured to combine the several digitised input signals.
- the invention is preferably practiced in order to switch from a microphone input to a telecoil and/or wireless receiver input or to a combined signal generated from the microphone and telecoil and/or wireless receiver inputs.
- the input signal detection means of the present invention can furthermore be used to automatically control the operational mode of the entire hearing aid in order to minimise electric power consumption. For example, if the detection means does not detect any relevant acoustic signals on any of the multiple sources (i.e. microphones, telecoil, audio input or wireless receiver, etc.) the hearing aid is automatically put into sleep mode. In such a sleep mode all circuitry associated with audio signal processing - especially the DSP, audio signal converters and transducers, which constitute the major fraction of power consumption - is switched off, i.e. deactivated, thus reducing the electric power consumption of the hearing aid to a minimum.
- the detection means does not detect any relevant acoustic signals on any of the multiple sources (i.e. microphones, telecoil, audio input or wireless receiver, etc.) the hearing aid is automatically put into sleep mode. In such a sleep mode all circuitry associated with audio signal processing - especially the DSP, audio signal converters and transducers, which constitute the major fraction of power consumption - is
- the audio signal processing path is reactivated ("woken up" from sleep mode), i.e. the device is restored to its normal operational mode.
- This wake-up functionality regarding the audio signal processing in its entirety may be implemented independently from the selection of individual signal sources.
- FIG. 1 schematically shows a block diagram with a signal flow structure of a hearing aid according to a preferred embodiment of the invention.
- the hearing aid comprises a plurality of analog input signal sources, each providing an analog input signal.
- Such sources are, for example one or more microphones 1, a telecoil 2 and an audio input 3.
- the telecoil 2 or T-coil receives signals inductively from a telephone speaker or from a coil installed in a building.
- the audio input 3 may receive signals e.g. from a wire connection or from a wireless receiver.
- Each of the input signal sources may comprise dedicated signal conditioning means.
- a multiplexer 4 is configured to select one of the input signals and to route or connect it, optionally via a pre-amplifier, to an A/D converter 5 which generates a corresponding digital signal and transmits it to a digital signal processor 6.
- the digital signal processor 6 processes one or more incoming audio signals in accordance with the needs of the user and generates a digital output signal that is converted by a D/A converter 7 and output via an output amplifier 8 and a speaker 9.
- the input signals are also transmitted to a "sniffer" circuit 10 which detects whether a specific input signal comprises a relevant signal, that is, whether a signal component carrying information for the user is present in the input signal.
- the sniffer circuit 10 comprises a single detection circuit 12 and a further multiplexer 11 for selecting the input signal to be analysed, and a synchronised demultiplexer 13 for controlling binary signal lines, each of which represents the detection of a relevant input signal on a corresponding input line.
- the binary signals A_M, A_TC, A_AI are processed by a selection logic 20 for selecting which of the analog input devices 1, 2, 3 is to be connected by the multiplexer 4 to the A/D converter 5.
- the selection logic 20 transmits a corresponding control signal s to the multiplexer 4.
- the hearing aid comprises a second A/D converter connected to the digital signal processor 6, and a second multiplexer configured to connect one of several input sources to the second A/D converter. This allows to select two input signals for further processing by the digital signal processor 6. Said further processing may include combining or "mixing" of the input signals.
- the second A/D converter is permanently associated with one signal input, e.g. a microphone, and the multiplexer 4 and sniffer circuit 10 are configured to choose among the remaining input signal sources.
- Figure 2 schematically shows a structure of a signal detection means according to the invention.
- the further multiplexer 11 has only two inputs, i.e. one from a telecoil 2 and one from an audio input 3.
- the further multiplexer 11 alternately selects one of said inputs for a suitable period of time that is sufficiently long to detect a signal activity on the input.
- the signal lines of Figure 2 are marked with reference numbers 21 to 27, and corresponding signal waveforms along a common time axis t are shown in Figure 3 .
- the input signal 21 is transmitted from the further multiplexer 11 to a variable gain amplifier 14 which normalises the amplitude levels of signals coming from different sources.
- the variable gain amplifier 14 generates a differential output signal 22.
- a first differential amplifier 16 is arranged to compare this differential output signal 22 to a reference signal generated by a reference signal source 15, generating a first comparator output 24 which has positive binary value if the amplitude of the differential output signal 22 exceeds the reference signal.
- a second differential amplifier 17 compares the inverted differential output signal 23 to the reference signal (or the differential output signal to the inverted reference signal) and generates second comparator output 25 which has a positive binary value if the amplitude of the inverted differential output signal exceeds the reference signal (or if the negative amplitude of the differential output signal exceeds the inverted reference signal).
- the output signals 24, 25 of the two differential amplifiers 16, 17 are combined by an OR-gate 18.
- the OR-combined signal 26 is fed to an integrator 19.
- the integrator 19 determines whether the duty cycle, i.e. the relative time duration in which the OR-combined signal 26 is positive, exceeds, over a given period of time, or integration time T, a predetermined threshold. If this threshold is exceeded, then the integrator output 27 is set to represent a logical value of ON or True.
- the time T may be constant or be dynamically adapted by a learning algorithm. In a preferred embodiment of the invention, this is done by having a programmable counter circuit that is enabled only when the OR-combined signal 26 is in an ON or positive state.
- the counter frequency is suitably higher than typical frequencies of the audio input signals and the combined signal, for example on the order of 64 kHz.
- the counter is periodically set back to zero, for example every 256 ms, whereby this integration time is predetermined, programmable and optionally adaptable parameter. Only if the counter reaches a predetermined threshold value is a relevant signal considered to be detected, and is a corresponding logical signal 27 transmitted to the demultiplexer 13.
- the circuit elements corresponding to the further A/D converter are not provided with power and are not operational. In other words, a power supply to said circuit elements is interrupted. Only when a relevant signal is detected does the sniffer circuit 10 send a signal that causes the further A/D converter to be powered up. This causes the further A/D converter to generate a digital representation corresponding to said analog input signal and communicate it to the digital signal processor 6 as a new signal.
- the digital signal processor 6 is simultaneously triggered by an interrupt generated by the sniffer circuit 10. This causes the digital signal processor 6 either to switch immediately to processing the new signal, or to first perform a classification of the new signal. During this classification, the new signal is preferably not transmitted to the output. Only if the classification determines that the new signal satisfies predetermined criteria that characterise e.g. speech or non-noise signals, is the new signal processed and included in the output. Accordingly, the multiplexer 4 may be also controlled by the digital signal processor 6.
- the signal routing for selecting the desired input signal is then performed within the digital signal processor 6. If the signals are not combined, that is, if the previously active signal is disregarded, then the A/D converter 5 of the previously active signal is no longer needed and may be powered down.
- Switching back to the original signal source takes place when either no relevant signal is received on the new signal, or when a relevant signal occurs on the original signal. If the original signal is not disregarded but combined with the new signal, then conversion and processing of the new signal is deactivated when it does not comprise a relevant signal for a predetermined period of time.
- the sniffer circuit 10 and detection circuit 12 according to the invention as described above are preferably implemented in a mixed-signal integrated circuit, based e.g. on CMOS technology. This is preferable if other analog front-end signal conditioning and preprocessing means are implemented on such a mixed-signal circuit anyway, and the inventive circuits are then located on the same, already existing chip. However, under other circumstances it may be advantageous to obtain the same functionality by other implementation technologies and other circuit arrangements.
- the OR-combined signal 27 as described could also be obtained by full-wave-rectification of the input signal and comparison with a given reference value by a Schmitt trigger.
- the integrated circuit could be replaced by essentially an RC-circuit. Such an implementation could be implemented by purely analog means, but would incur a larger silicon area, greater circuit design complexity and less precision.
- a typical power consumption of the circuit according to the invention is on the order of 25 microamperes for the sniffer circuit 10 alone, whereas an additional A/D converter and pre-amplifier would draw approximately 90 microamperes.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Analogue/Digital Conversion (AREA)
- Amplifiers (AREA)
- Input From Keyboards Or The Like (AREA)
Description
- The invention relates to the field of hearing devices or hearing aids. It relates in particular to a hearing aid with detection and automatic selection of an input signal and a method for detecting and automatically selecting an input signal in a hearing aid as described in the preamble of the corresponding independent claims.
- The term "hearing aid", "hearing instrument" or "hearing device", as understood here, denotes on the one hand hearing aid devices that are therapeutic devices improving the hearing ability of individuals, primarily according to diagnostic results. Such hearing aid devices may be Outside-The-Ear hearing aid devices or In-The-Ear hearing aid devices. On the other hand, the term stands for devices which may improve the hearing of individuals with normal hearing e.g. in specific acoustical situations as in a very noisy environment or in concert halls, or which may even be used in context with remote communication or with audio listening, for instance as provided by headphones.
- The hearing devices addressed by the present invention are so-called active hearing devices which comprise at the input side at least one acoustical to electrical converter, such as a microphone, at the output side at least one electrical to mechanical converter, such as a loudspeaker, and which further comprise a signal processing unit for processing signals according to the output signals of the acoustical to electrical converter and for generating output signals to the electrical input of the electrical to mechanical output converter. In general, the signal processing circuit may be an analog, digital or hybrid analog-digital circuit, and may be implemented with discrete electronic components, integrated circuits, or a combination of both.
- Many hearing aids comprise more than one microphone in order to allow directional hearing. They may also have additional signal sources such as telecoils, audio input lines and wireless receivers for amplitude or frequency modulated (AM or FM) signals. In order to automatically select a signal source that is appropriate for the user's current hearing situation, various approaches exist: Telecoils and the processing of telecoil signals are e.g. activated by a reed relay that is operated by a small magnet attached to a telephone receiver as described in
DE 31 09 049 C2 . Audio input processing may be enabled by a contact which is mechanically activated when a corresponding input device such as an audio shoe is attached to the hearing aid. - In order to eliminate the need for dedicated electromechanical devices,
DE 101 46 886 proposes to constantly digitise audio signals from two potential signal sources. The digitised signals are analysed by a classification algorithm running on a digital signal processor (DSP), resulting in an indication which signal may carry relevant acoustic information. The respective signal or a mixture of signals is then fed to the output speaker. - An important design criterion for components of hearing devices is the electric power consumption.
-
US 2003/223592 A1 is directed to minimising the number of electrical terminals of a microphone assembly, where the microphone assembly on the one hand has an internal microphone and on the other hand can handle externally generated auxiliary audio signals. For this purpose, the auxiliary audio signal and a control signal for switching the assembly to process the auxiliary audio signal are transmitted over the same pair of terminals. A switching means is adapted to detect the control signal and then to select the auxiliary signal instead of the internal one. The auxiliary signal source must be adapted to generate the control signal required by the switching means. This principle is extended to more than one auxiliary input. The detection in the switching means is based on the characteristic of the combined auxiliary/control signal , such as its DC or AC amplitude level, but the manner in which this detection is accomplished is not disclosed. No further information is given on the internal workings of the switching means, that is, on the structure according to which the input signal characteristics are analysed. -
EP-A-1 367 857 describes a data logging method for a hearing prosthesis comprises two AD-converters. In an omnidirectional mode of operation, one of the AD-converters is shut down to conserve power. The mode of operation is selected by the user, not automatically. -
US-A-4 596 902 discloses a hearing aid with a microprocessor and further elements. The input signal is analysed periodically with a subset of the power-consuming circuitry, and only if a relevant signal (according to intensity and duration) is present, is the entire hearing aid fully activated. - It is therefore an object of the invention to create a hearing aid with detection and automatic selection of an input signal and a method for detecting and automatically selecting an input signal in a hearing aid of the type mentioned initially, which provide for an automatic selection among a plurality of signal sources while minimising power consumption of the associated means.
- These objects are achieved by a hearing aid with detection and automatic selection of an input signal and a method for detecting and automatically selecting an input signal in a hearing aid according to corresponding independent claims.
- Since the analog input signals are analysed, it is not necessary to constantly perform an analog-to-digital (A/D) conversion and a digital signal analysis on the DSP for each input signal source. This results in a reduced consumption of electric power. Signal analysis is done without generating a digital multilevel or high resolution representation of the input signal.
- In a further preferred embodiment of the invention, if a relevant signal is detected in a first analog input signal, then an A/D converter is configured to digitise said first analog input signal and transmit the digitised signal for further processing. Said A/D converter is either an A/D converter that was powered down and is activated to convert said first analog input signal, or an A/D converter that was used to convert another analog input signal and is switched over to analyse the first analog input signal instead.
- In both the above cases (switching on a converter or switching over to an active converter), power consumption is reduced as long as no signal is detected. In the second case, the number of circuit components in the hearing aid is also reduced, i.e. the complexity of an integrated circuit based solution is decreased. The same holds for analog signal conditioning means such as pre-amplification prior to the A/D conversion, which may also be powered down or up or switched from one input source to another, respectively.
- In the first of the above cases, the digitised input signal corresponding to the newly detected analog signal may be analysed and classified in the DSP or in any other appropriate processing means such as a microcontroller or custom integrated circuit in order to verify whether it should be provided to the user. In this way, the flexibility and sophistication of classification algorithms that may be implemented on the DSP are obtained.
- In a preferred embodiment of the invention, a hearing aid further comprises a signal detection means configured to analyse a single signal, and a further input multiplexer for alternately selecting one of the analog input signals and feeding it to the signal detection means in turn. As a result, as only one detection means is required, the power consumption and the number of components (i.e. circuit complexity) is further reduced.
- In another preferred embodiment of the invention, the signal detection means is configured to indicate the presence of a relevant signal in an input signal if the amplitude of the input signal exceeds a predetermined amplitude threshold during a predetermined minimum time within a predetermined time window. The amplitude threshold may optionally be dynamically adapted in accordance with user feedback and/or with the signal classification performed by the digital signal processing means. For example, if the signal detection means repeatedly reports the presence of a signal which is then rejected by the signal processing means, then the amplitude threshold can be increased.
- This approach allows a simple and low-power implementation of a detection circuit and method. A digital signal processor is not required, and yet all of the input signals can be analysed for the presence of a relevant signal. The approach works equally well for two or more signal sources.
- For more than two signal sources it is, in principle, possible to have more than one input signal comprising a relevant signal, and to select more than one of them as selected input signals. Each of these selected input signals is associated with one A/D converter, either by powering on the converter or by routing or feeding the input signal to the converter. The DSP is then configured to combine the several digitised input signals.
- The invention is preferably practiced in order to switch from a microphone input to a telecoil and/or wireless receiver input or to a combined signal generated from the microphone and telecoil and/or wireless receiver inputs.
- The input signal detection means of the present invention can furthermore be used to automatically control the operational mode of the entire hearing aid in order to minimise electric power consumption. For example, if the detection means does not detect any relevant acoustic signals on any of the multiple sources (i.e. microphones, telecoil, audio input or wireless receiver, etc.) the hearing aid is automatically put into sleep mode. In such a sleep mode all circuitry associated with audio signal processing - especially the DSP, audio signal converters and transducers, which constitute the major fraction of power consumption - is switched off, i.e. deactivated, thus reducing the electric power consumption of the hearing aid to a minimum. As soon as the input signal detection means senses relevant acoustic signals on one of the multiple inputs, the audio signal processing path is reactivated ("woken up" from sleep mode), i.e. the device is restored to its normal operational mode. This wake-up functionality regarding the audio signal processing in its entirety (which does not comprise the detection means) may be implemented independently from the selection of individual signal sources.
- Further preferred embodiments are evident from the dependent patent claims. Features of the device claims may be incorporated into the method claims and vice versa.
- The subject matter of the invention will be explained in more detail in the following text with reference to preferred exemplary embodiments which are illustrated in the attached drawings, in which:
- Figure 1
- schematically shows a signal flow structure of a hearing aid according to the invention;
- Figure 2
- schematically shows a structure of a signal detection means according to the invention; and
- Figure 3
- shows signal waveforms within a circuit according to a preferred embodiment of the invention.
- The reference symbols used in the drawings, and their meanings, are listed in summary form in the list of reference symbols. In principle, identical parts are provided with the same reference symbols in the figures.
-
Figure 1 schematically shows a block diagram with a signal flow structure of a hearing aid according to a preferred embodiment of the invention. The hearing aid comprises a plurality of analog input signal sources, each providing an analog input signal. Such sources are, for example one ormore microphones 1, atelecoil 2 and anaudio input 3. Thetelecoil 2 or T-coil receives signals inductively from a telephone speaker or from a coil installed in a building. Theaudio input 3 may receive signals e.g. from a wire connection or from a wireless receiver. Each of the input signal sources may comprise dedicated signal conditioning means. A multiplexer 4 is configured to select one of the input signals and to route or connect it, optionally via a pre-amplifier, to an A/D converter 5 which generates a corresponding digital signal and transmits it to adigital signal processor 6. Thedigital signal processor 6 processes one or more incoming audio signals in accordance with the needs of the user and generates a digital output signal that is converted by a D/A converter 7 and output via an output amplifier 8 and a speaker 9. - The input signals are also transmitted to a "sniffer"
circuit 10 which detects whether a specific input signal comprises a relevant signal, that is, whether a signal component carrying information for the user is present in the input signal. - In a preferred embodiment of the invention, the
sniffer circuit 10 comprises asingle detection circuit 12 and afurther multiplexer 11 for selecting the input signal to be analysed, and asynchronised demultiplexer 13 for controlling binary signal lines, each of which represents the detection of a relevant input signal on a corresponding input line. The binary signals A_M, A_TC, A_AI are processed by aselection logic 20 for selecting which of theanalog input devices D converter 5. Theselection logic 20 transmits a corresponding control signal s to the multiplexer 4. - In another preferred embodiment of the invention, the hearing aid comprises a second A/D converter connected to the
digital signal processor 6, and a second multiplexer configured to connect one of several input sources to the second A/D converter. This allows to select two input signals for further processing by thedigital signal processor 6. Said further processing may include combining or "mixing" of the input signals. - In yet another preferred embodiment of the invention, the second A/D converter is permanently associated with one signal input, e.g. a microphone, and the multiplexer 4 and
sniffer circuit 10 are configured to choose among the remaining input signal sources. -
Figure 2 schematically shows a structure of a signal detection means according to the invention. In this example, thefurther multiplexer 11 has only two inputs, i.e. one from atelecoil 2 and one from anaudio input 3. Thefurther multiplexer 11 alternately selects one of said inputs for a suitable period of time that is sufficiently long to detect a signal activity on the input. - The signal lines of
Figure 2 are marked withreference numbers 21 to 27, and corresponding signal waveforms along a common time axis t are shown inFigure 3 . Theinput signal 21 is transmitted from thefurther multiplexer 11 to avariable gain amplifier 14 which normalises the amplitude levels of signals coming from different sources. Thevariable gain amplifier 14 generates adifferential output signal 22. A firstdifferential amplifier 16 is arranged to compare thisdifferential output signal 22 to a reference signal generated by areference signal source 15, generating afirst comparator output 24 which has positive binary value if the amplitude of thedifferential output signal 22 exceeds the reference signal. A seconddifferential amplifier 17 compares the inverteddifferential output signal 23 to the reference signal (or the differential output signal to the inverted reference signal) and generatessecond comparator output 25 which has a positive binary value if the amplitude of the inverted differential output signal exceeds the reference signal (or if the negative amplitude of the differential output signal exceeds the inverted reference signal). The output signals 24, 25 of the twodifferential amplifiers signal 26 is fed to anintegrator 19. - The
integrator 19 determines whether the duty cycle, i.e. the relative time duration in which the OR-combinedsignal 26 is positive, exceeds, over a given period of time, or integration time T, a predetermined threshold. If this threshold is exceeded, then theintegrator output 27 is set to represent a logical value of ON or True. The time T may be constant or be dynamically adapted by a learning algorithm. In a preferred embodiment of the invention, this is done by having a programmable counter circuit that is enabled only when the OR-combinedsignal 26 is in an ON or positive state. The counter frequency is suitably higher than typical frequencies of the audio input signals and the combined signal, for example on the order of 64 kHz. - The counter is periodically set back to zero, for example every 256 ms, whereby this integration time is predetermined, programmable and optionally adaptable parameter. Only if the counter reaches a predetermined threshold value is a relevant signal considered to be detected, and is a corresponding
logical signal 27 transmitted to thedemultiplexer 13. - In another preferred embodiment of the invention there is not necessarily a multiplexer 4 arranged between the
signal sources D converter 5. Instead, at least one signal source has an associated further A/D converter which directly receives the analog input signal of said source. As long as no relevant signal is detected in said analog input signal, the circuit elements corresponding to the further A/D converter are not provided with power and are not operational. In other words, a power supply to said circuit elements is interrupted. Only when a relevant signal is detected does thesniffer circuit 10 send a signal that causes the further A/D converter to be powered up. This causes the further A/D converter to generate a digital representation corresponding to said analog input signal and communicate it to thedigital signal processor 6 as a new signal. - The
digital signal processor 6 is simultaneously triggered by an interrupt generated by thesniffer circuit 10. This causes thedigital signal processor 6 either to switch immediately to processing the new signal, or to first perform a classification of the new signal. During this classification, the new signal is preferably not transmitted to the output. Only if the classification determines that the new signal satisfies predetermined criteria that characterise e.g. speech or non-noise signals, is the new signal processed and included in the output. Accordingly, the multiplexer 4 may be also controlled by thedigital signal processor 6. - The signal routing for selecting the desired input signal is then performed within the
digital signal processor 6. If the signals are not combined, that is, if the previously active signal is disregarded, then the A/D converter 5 of the previously active signal is no longer needed and may be powered down. - Switching back to the original signal source, e.g. a microphone, takes place when either no relevant signal is received on the new signal, or when a relevant signal occurs on the original signal. If the original signal is not disregarded but combined with the new signal, then conversion and processing of the new signal is deactivated when it does not comprise a relevant signal for a predetermined period of time.
- The
sniffer circuit 10 anddetection circuit 12 according to the invention as described above are preferably implemented in a mixed-signal integrated circuit, based e.g. on CMOS technology. This is preferable if other analog front-end signal conditioning and preprocessing means are implemented on such a mixed-signal circuit anyway, and the inventive circuits are then located on the same, already existing chip. However, under other circumstances it may be advantageous to obtain the same functionality by other implementation technologies and other circuit arrangements. For example, the OR-combinedsignal 27 as described could also be obtained by full-wave-rectification of the input signal and comparison with a given reference value by a Schmitt trigger. The integrated circuit could be replaced by essentially an RC-circuit. Such an implementation could be implemented by purely analog means, but would incur a larger silicon area, greater circuit design complexity and less precision. - A typical power consumption of the circuit according to the invention is on the order of 25 microamperes for the
sniffer circuit 10 alone, whereas an additional A/D converter and pre-amplifier would draw approximately 90 microamperes. - While the invention has been described in present preferred embodiments of the invention, it is distinctly understood that the invention is not limited thereto, but may be otherwise variously embodied and practised within the scope of the claims.
-
- 1
- microphone
- 2
- telecoil
- 3
- audio input
- 4
- multiplexer
- 5
- analog-to-digital (A/D) converter
- 6
- digital signal processor (DSP)
- 7
- digital-to-analog (D/A) converter
- 8
- output amplifier
- 9
- speaker
- 10
- sniffer circuit
- 11
- further multiplexer
- 12
- detection circuit
- 13
- demultiplexer
- 14
- variable gain amplifier
- 15
- reference signal source
- 16, 17
- differential amplifier
- 18
- OR-gate
- 19
- integrator
- 20
- selection logic
- 21
- input signal
- 22
- differential input signal
- 23
- inverted differential output signal
- 24
- first comparator output
- 25
- second comparator output
- 26
- OR-combined
signal 2 - 27
- logical signal
Claims (20)
- A hearing aid with detection and automatic selection of an input signal, comprising at least two analog input signal sources (1,2,3), at least one analog-to-digital converter (5) for generating, from an analog input signal, a corresponding digital input signal, and further processing means (6) for digital processing of input signals, input signal routing means (4) for selectively routing each one of one or more selected input signals to the further processing means (6), and signal detection means (10) configured to analyse the analog input signals and to control the signal routing means (4) according to results of said analysis, characterised in that the signal detection means (10) comprises a signal detection circuit (12) configured to analyse a single analog input signal, and an input multiplexer (11) for alternately selecting one of the analog input signals and feeding it to the signal detection circuit (12).
- The hearing aid according to claim 1, configured to cause, when the signal detection means (10) detects a relevant signal on a given analog input signal, an analog-to-digital converter (5) to digitise said analog input signal and to transmit the digital input signal to the further processing means (6).
- The hearing aid according to claim 2, wherein the input signal routing means comprises an analog input multiplexer (4) for selectively routing each one of one or more selected analog input signals to an associated analog-to-digital converter (5), and where the analog input multiplexer (4) is configured to be controlled according to the analysis results of the signal detection means (10).
- The hearing aid according to claim 2, further comprising a second analog-to-digital converter that is arranged to digitise a given analog input signal, and where the hearing aid is configured to power up the second analog-to-digital converter if the signal detection means (10) indicates that said given analog input signal comprises a relevant input signal.
- The hearing aid according to claim 2, configured to maintain circuitry associated with audio signal processing (5,6,7,8) in a powered down state while the signal detection means (10) does not detect a relevant signal, and to power up said circuitry (5,6,7,8) if the signal detection means (10) does detect a relevant signal on an analog input signal.
- The hearing aid according to one of the preceding claims, wherein the processing means (6) is configured to perform a classification of a new signal, and to process the new signal and include it in the output only if the classification determines that the new signal satisfies predetermined criteria.
- The hearing aid according to one of the preceding claims, wherein the signal detection means (10) is configured to indicate the presence of a relevant signal in an input signal if the amplitude of the input signal exceeds a predetermined amplitude threshold during a predetermined minimum time within a predetermined time window, and wherein the length of said time window is dynamically adapted by a learning algorithm.
- The hearing aid according to one of the preceding claims, wherein the signal detection means (10) is configured to indicate the presence of a relevant signal in an input signal if the amplitude of the input signal exceeds a predetermined amplitude threshold during a predetermined minimum time within a predetermined time window, and wherein the amplitude threshold is dynamically adapted in accordance with user feedback and/or with a signal classification performed by the digital signal processing means.
- The hearing aid according to one of the preceding claims, wherein the further processing means (6) is configured to combine or "mix" the input signals.
- The hearing aid according to one of the preceding claims, wherein the signal detection means (10) is implemented by analog components or within a mixed-signal integrated circuit.
- A method for detecting and automatically selecting an input signal in a hearing aid in which at least two analog input signals are available, comprising the steps of• analysing with signal detection means (4) the analog input signals and detecting, for each analog input signal, whether it comprises a relevant signal, by providing a single detection circuit (12) through a further input multiplexer (11) alternately with each of the input signals,• selecting, according to results of said analysis, at least one selected input signal that comprises a relevant signal for further processing, and• controlling a signal routing means (4) to selectively route each one of the at least one selected input signals to further processing means (6).
- The method according to claim 11, further comprising the step of• causing, when the signal detection means (10) detects a relevant signal on a given analog input signal, an analog-to-digital converter (5) to digitise said analog input signal and to transmit the digital input signal to the further processing means (6).
- The method according to claim 12, further comprising the step of• controlling, according to the analysis results of the signal detection means (10), an analog input multiplexer (4) to forward each one of the at least one selected input signal to an associated analog-to-digital converter (5).
- The method according to claim 12, where the hearing aid further comprises a second analog-to-digital converter that is arranged to digitise a given analog input signal, and comprising the further step of• powering up the second analog-to-digital converter if the signal detection means (10) indicates that said given analog input signal comprises a relevant input signal.
- The method according to claim 12, comprising the further step of• maintaining circuitry associated with audio signal processing (5,6,7,8) in a powered down state while the signal detection means (10) does not detect a relevant signal, and• powering up said circuitry (5,6,7,8) if the signal detection means (10) does detect a relevant signal on an analog input signal.
- The method according to one of claims 11 to 15, further comprising the steps of• the processing means (6) performing a classification of a new signal, and• the processing means (6) including the new signal in the output only if the classification determines that the new signal satisfies predetermined criteria.
- The method according to one of claims 11 to 16, further comprising the steps of• determining whether the amplitude of the input signal exceeds a predetermined amplitude threshold during a predetermined minimum time within a predetermined time window,• indicating the presence of a relevant signal in an input signal if this is the case, and• dynamically adapting the length of the time window by a learning algorithm.
- The method according to one of claims 11 to 17, further comprising the steps of• determining whether the amplitude of the input signal exceeds a predetermined amplitude threshold during a predetermined minimum time within a predetermined time window,• indicating the presence of a relevant signal in an input signal if this is the case, and• dynamically adapting the amplitude threshold in accordance with user feedback and/or with a signal classification performed by the digital signal processing means.
- The method according to one of claims 11 to 15, wherein the step of detecting whether an analog input signal comprises a relevant signal involves analog comparison operations of the analog input signal or of analog signals derived from the analog input signal to analog reference signals.
- The method according to one of claims 11 to 19, further comprising the step of the further processing means (6) combining or "mixing" the input signals.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04405158.9A EP1443803B1 (en) | 2004-03-16 | 2004-03-16 | Hearing aid and method for the detection and automatic selection of an input signal |
DK04405158T DK1443803T3 (en) | 2004-03-16 | 2004-03-16 | Hearing aid and method for detecting and automatically selecting an input signal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04405158.9A EP1443803B1 (en) | 2004-03-16 | 2004-03-16 | Hearing aid and method for the detection and automatic selection of an input signal |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1443803A2 EP1443803A2 (en) | 2004-08-04 |
EP1443803A3 EP1443803A3 (en) | 2005-04-13 |
EP1443803B1 true EP1443803B1 (en) | 2013-12-04 |
Family
ID=32605528
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04405158.9A Expired - Lifetime EP1443803B1 (en) | 2004-03-16 | 2004-03-16 | Hearing aid and method for the detection and automatic selection of an input signal |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP1443803B1 (en) |
DK (1) | DK1443803T3 (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8284970B2 (en) * | 2002-09-16 | 2012-10-09 | Starkey Laboratories Inc. | Switching structures for hearing aid |
ATE482578T1 (en) * | 2006-06-01 | 2010-10-15 | Phonak Ag | METHOD FOR ADJUSTING A HEARING AID SYSTEM |
US7738666B2 (en) | 2006-06-01 | 2010-06-15 | Phonak Ag | Method for adjusting a system for providing hearing assistance to a user |
DE102006046703A1 (en) | 2006-10-02 | 2008-04-17 | Siemens Audiologische Technik Gmbh | Hearing device with controlled input channels and corresponding method |
DK2103177T3 (en) | 2006-12-13 | 2011-05-16 | Phonak Ag | Method of operating a hearing aid and a hearing aid |
DE102006059138B4 (en) * | 2006-12-14 | 2010-09-09 | Siemens Audiologische Technik Gmbh | Hearing aid and / or hearing protection device with an audio input |
EP2127467B1 (en) | 2006-12-18 | 2015-10-28 | Sonova AG | Active hearing protection system |
US8391522B2 (en) | 2007-10-16 | 2013-03-05 | Phonak Ag | Method and system for wireless hearing assistance |
ATE515155T1 (en) * | 2007-11-23 | 2011-07-15 | Phonak Ag | METHOD FOR OPERATING A HEARING AID AND HEARING AID |
WO2011027004A2 (en) | 2010-12-20 | 2011-03-10 | Phonak Ag | Method for operating a hearing device and a hearing device |
DK2835986T3 (en) | 2013-08-09 | 2018-01-08 | Oticon As | Hearing aid with input transducer and wireless receiver |
DE102017200680A1 (en) | 2017-01-17 | 2018-03-01 | Sivantos Pte. Ltd. | Method for operating a hearing device and hearing device |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4596902A (en) * | 1985-07-16 | 1986-06-24 | Samuel Gilman | Processor controlled ear responsive hearing aid and method |
DE10146886B4 (en) * | 2001-09-24 | 2007-11-08 | Siemens Audiologische Technik Gmbh | Hearing aid with automatic switching to Hasp coil operation |
EP1493303B1 (en) * | 2002-04-10 | 2007-08-22 | Sonion A/S | Microphone assembly with auxiliary analog input |
DK1367857T3 (en) * | 2002-05-30 | 2012-06-04 | Gn Resound As | Method of data recording in a hearing prosthesis |
-
2004
- 2004-03-16 EP EP04405158.9A patent/EP1443803B1/en not_active Expired - Lifetime
- 2004-03-16 DK DK04405158T patent/DK1443803T3/en active
Also Published As
Publication number | Publication date |
---|---|
DK1443803T3 (en) | 2014-02-24 |
EP1443803A2 (en) | 2004-08-04 |
EP1443803A3 (en) | 2005-04-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7319768B2 (en) | Hearing aid and method for the detection and automatic selection of an input signal | |
EP1443803B1 (en) | Hearing aid and method for the detection and automatic selection of an input signal | |
JP4530109B1 (en) | Hearing aid system | |
US7020296B2 (en) | Method for operating a hearing aid system and hearing aid system | |
US8494193B2 (en) | Environment detection and adaptation in hearing assistance devices | |
EP1484942B1 (en) | Automatic magnetic detection in hearing aids | |
JP5580946B2 (en) | Hearing aid and method for driving an output stage | |
EP2039218B1 (en) | Method for operating a binaural hearing system as well as a binaural hearing system | |
US9357314B2 (en) | Automated sound processor with audio signal feature determination and processing mode adjustment | |
JP5749391B1 (en) | Hearing device with switchable power supply voltage | |
US20030059076A1 (en) | Hearing aid device with automatic switching to hearing coil mode | |
US7747031B2 (en) | Hearing device and method for wind noise suppression | |
CN103379418A (en) | A binaural hearing aid system with coordinated sound processing | |
EP2638708A2 (en) | Hearing instrument and method of operating the same | |
US8054999B2 (en) | Audio system with varying time delay and method for processing audio signals | |
US8355516B2 (en) | Hearing apparatus with a special situation recognition unit and method for operating a hearing apparatus | |
AU2007306366B2 (en) | Method for operating a hearing aid, and hearing aid | |
JP2015097385A (en) | Audition apparatus having interruptible microphone power source | |
CN110475194B (en) | Method for operating a hearing aid and hearing aid | |
US7899199B2 (en) | Hearing device and method with a mute function program | |
US20090067650A1 (en) | Method and arrangements for detecting the type of acoustic signal source with a hearing device | |
US20120263478A1 (en) | Hearing aid system using wireless optical communications | |
US8139799B2 (en) | Hearing apparatus with controlled input channels and corresponding method | |
EP1635610A2 (en) | Method to operate a hearing device and a hearing device | |
EP4315884A1 (en) | An ear level audio device and a method of operating an ear level audio device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: 7H 04R 5/033 B Ipc: 7H 04R 25/00 A Ipc: 7H 04R 1/10 B |
|
17P | Request for examination filed |
Effective date: 20050912 |
|
AKX | Designation fees paid |
Designated state(s): CH DE DK LI |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20130621 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): CH DE DK LI |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602004043927 Country of ref document: DE Effective date: 20140130 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20140221 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20140325 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602004043927 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20140905 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602004043927 Country of ref document: DE Effective date: 20140905 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20150331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150331 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 602004043927 Country of ref document: DE |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20220329 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20220404 Year of fee payment: 19 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602004043927 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231003 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |