EP1234480B1 - Vorrichtung und verfahren zur kompensation von störungen der binauralen phasen- und zeitverzögerung durch das zentrale gehörnervensystem - Google Patents

Vorrichtung und verfahren zur kompensation von störungen der binauralen phasen- und zeitverzögerung durch das zentrale gehörnervensystem Download PDF

Info

Publication number
EP1234480B1
EP1234480B1 EP00968722A EP00968722A EP1234480B1 EP 1234480 B1 EP1234480 B1 EP 1234480B1 EP 00968722 A EP00968722 A EP 00968722A EP 00968722 A EP00968722 A EP 00968722A EP 1234480 B1 EP1234480 B1 EP 1234480B1
Authority
EP
European Patent Office
Prior art keywords
phase
bptd
clause
ear
phase shift
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP00968722A
Other languages
English (en)
French (fr)
Other versions
EP1234480A2 (de
Inventor
Joan Marie Burleigh
Michael Wayne Thompson
Susan Patricia James
Michael Leroy Peterson, Jr.
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Able Planet Inc
Original Assignee
Able Planet Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Able Planet Inc filed Critical Able Planet Inc
Publication of EP1234480A2 publication Critical patent/EP1234480A2/de
Application granted granted Critical
Publication of EP1234480B1 publication Critical patent/EP1234480B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/04—Time compression or expansion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural

Definitions

  • the present invention relates to apparatus and methods for diagnosing, quantifying, and correcting for human central auditory nervous system (CANS) impairment, and in particular binaural phase time delay asynchrony.
  • CANS central auditory nervous system
  • a binaural phase time delay is defined herein as a synchronization disruption (delay) in phase and time of the auditory input signals to the two ears.
  • Two types of BPTDs have been defined by the investigators: pathological BPTDs which are "built-in" to a person's CANS, as is the case with a person with neurological injury or disease process, and clinical BPTDs which are induced in a person's CANS using an external device, to compensate for a pathological phase time delay.
  • a BPTD is a combination of a phase shift and a time delay.
  • a specific phase shift results in a specific time delay.
  • a 180° phase shift results in a 0.5 ms time delay.
  • one specific time delay would result in several different frequency-dependent phase shifts. Note that a time delay can be much larger than the maximum phase shift for a given frequency.
  • binaural interaction of the CANS requires the two ears to integrate dichotic signals separated in time, frequency, and/or intensity.
  • the brain stem is crucial for binaural interaction of acoustic stimuli.
  • Stillman (1980) has emphasized that precise timing of excitatory and inhibitory inputs to each cell along the auditory pathway is critical if each cell is to respond in an appropriate manner.
  • Oertel (1997) has also studied the effects of timing in the cochlear nuclei.
  • the superior olivary complex is an important relay station of the ascending tract of the CANS and is critical for binaural listening capabilities. It is this cross correlation behavior of the two ears that afford the selective listening capability in noisy environments, and the ability to spatially localize sound sources.
  • a pathological BPTD has been observed between the two ears which is in some cases is quite large (15-20 msec).
  • the pathological BPTD not only decreases speech intelligibility in complex listening environments, but also (somewhat surprisingly) degrades motor (gross, fine, oral) and visual performance.
  • a clinically-induced BPTD designed to compensate for the pathological BPTD in the subject, significantly improves the speech intelligibility, gross and oral motor function the subject.
  • the processing of information by the central auditory nervous system is impaired and affects comprehension and recall of auditory information.
  • the central auditory nervous system typically receives auditory information from both ears and integrates the input received, even though the acoustic signals received by the ears may be somewhat separated in time, frequency, and/or intensity.
  • Such binaural integration by the central auditory nervous system may be substantially provided in the brain stem. Further, it has been observed that the precise timing of excitory and inhibitory inputs to cells of the central auditory nervous system can affect these cells' behavior to respond appropriately.
  • auditory signals from both ears must have a relatively synchronized arrive time for certain binaural cells to be activated in the superior olivary complex.
  • a delayed (e.g. millisecond) response from one ear can impair the integration of binaural response. This is not reflected in the function of the inner ear.
  • an individual with a peripheral hearing loss may also have CANS dysfunction or a mechanical effect that creates a disruption of the synchrony between the two ears.
  • Behavioral and physiological (auditory brainstem response, middle latency response, cortical evoked potentials and mismatched negativity) methods have been employed to measure time parameters of the central auditory nervous system. Previous studies, however, have only analyzed the relationship of timing differences with respect to various pathologies (e.g. a latency in response has occurred). In particular, the development of tests quantifying the changes in auditory input between a subject's ears has been solely used as a diagnostic procedure for identifying a central auditory processing dysfunction. Since the anatomy of the brain stem indicates links between binaural signal processing and integration and motor control, it is not surprising that disorders of the central auditory nervous system often affect other functions such as sensory perception, integration, fine and gross motor, oral motor and visual processing.
  • the ideal overall relative time delay portion of the BPTD for the subject is measured by separating the high and low frequencies of a variety of words, and time shifting one of the two components relative to the other. The subject's comprehension of the words will be highest or best at that subject's ideal relative time delay. Time delays can also be measured by inducing a preselected time delay of monosyllabic or bisyllabic words in one ear relative to the other ear in the presence of multitalker babble.
  • a phase analysis test measures the appropriate binaural phase shift at a variety of frequencies by assessing the subject's ability to discriminate pure tones from narrow band noise centered in frequency around the target tone.
  • the BPTD device can be used as a diagnostic tool in this situation.
  • the BPTD device is capable of interfacing with standard audiometers to generate two types of stereo signals.
  • One is the target signal that is comprised of a pure tone presented to both ears with a relative phase difference of q degrees between the target tone channels.
  • the narrowband noise signal is also processed by the BPTD device on a stereo basis to generate a relative phase difference of f degrees between the two narrowband noise channels.
  • the BPTD device then mixes these two types of signals together by performing a weighted summation operation and the output can then be presented to the subject.
  • the weighting value on the summation processes is used to vary the signal-to-noise power ratio between the target signal and the noise. Since the resulting output signal is a combination of these two signal types we call it the S q N f output signal.
  • the BPTD device can implement a variety of combinations of q and f parameters for research, diagnostic, and accommodative purposes.
  • threshold results from a specific S q N q at various frequencies represent the baseline condition. Normative threshold measures for each target frequency and phase value tested will be used to determine atypical phase results for various frequencies.
  • the optimal phase value for a given operating frequency for accommodative purposes is the one in which the tone is heard at the lowest hearing threshold value.
  • An operator interface allows the BPTD device to be used to systematically collect the optimal phase values over the range of test frequencies.
  • the PAT test also includes the synthesis of all of the phase information to form a phase correction filter as illustrated in Figure 9.
  • the BPTD device also has the capability of implementing the phase correction filter in real-time. With the correction filter in place, a speech stimulus can be used to repeat the phase analysis paradigm described above. However, since speech is a frequency rich stimulus, the narrowband noise is replaced with noise that has a broader frequency profile, such as broad-band or white noise. As before, a procedure for determining the minimum hearing threshold for when the target speech signal is heard above the broad-band noise signal is implemented. Comparisons can then be made to the situation where the correction filter is not in place and performance improvements can be verified.
  • phase correction filter can be compared or combined with optimal time delay parameters (such as those obtained from the Delayed Binaural Fusion Test).
  • optimal time delay parameters such as those obtained from the Delayed Binaural Fusion Test.
  • the BPTD device is capable of implementing this hearing threshold approach to investigate and diagnose time delay parameters such as those considered for the Delayed Binaural Fusion Test.
  • An electronic device is used for diagnosing and measuring the phase and time portion of BPTD, and verifying the best overall relative time delay for the subject.
  • An operator controls the relative time delay and phase delay applied to the subject's ears via an operator interface.
  • the test set up considers one frequency (tone) at a time and applies the selected phase shift (and/or time delay) to whatever frequency is applied.
  • the operator interface may include a keypad to enter control signals, and a display to show which control signal is being applied. Control signals set the amount of phase shift to be applied.
  • the relative time delay shifter applies the overall relative time delay, and the phase shifter applies the phase shift.
  • a real time, active, digital signal processing electronic device is used for correcting BPTD, once it has been measured in the testing phase.
  • Equivalent analog devices could also be used, but digital devices are more practical. In general, only one of the devices will be used, since sound is typically delayed to the same ear at every frequency.
  • the signal is amplified by a preamp, and is digitized in an analog to digital converter (ADC).
  • a digital signal processor DSP
  • DSP digital signal processor
  • a digital to analog converter DAC
  • the BPTD applied by the DSP is programmed according to the overall relative time shift and the phase shift versus frequency profile obtained in the testing phase.
  • the BPTD profile is unique for each subject.
  • the DSP could be reprogrammable, via a control signal, so it could be optimized for the wearer in actual use. Note that other hearing aid processing (compression or the like) may also be incorporated into the DSP if desired. Amplitude changes may also be implemented.
  • the BPTD profile used may change with the kind of background noise detected by the device, or the type of activity the subject is performing.
  • a physical filter may alternatively be used for correcting BPTD.
  • a physical device in the ear can delay the sound in the ear, and can delay different frequencies differently, as an electronic device does.
  • the passive earplug induces a BPTD to sound entering the ear by altering the propagation time of the acoustic waves.
  • the primary method of delaying an acoustic signal in this manner is through the use of ducting, through which the signal propagates.
  • the velocity of propagation of sound in air is approximately 331 meters per second, and the length of the ducting in the ear canal is about 10 cm (ducting along an eyeglass frame can be longer).
  • the time delay applied by a passive device in the ear canal is on the order of 30 us, corresponding to a phase shift of about p/3 at 5000Hz.
  • This time delay may be increased by about a factor of two by using a fluid rather than air in the ducting.
  • the frequency response of the earplug may also be tuned by using acoustical filter elements.
  • Standard elements include chambers, Helmholtz resonators, and dampers.
  • other acoustic elements such as horns, collectors, domes, trumpets, and resonators may be used.
  • Figure 1 is a flow diagram 100 showing a set of diagnostic procedures for diagnosing and quantifying pathological binaural phase time delay (BPTD) in subjects.
  • the tests may be performed in any order, but the order shown is the most logical, for reasons described below.
  • the test routine begins with step 102.
  • a series of conventional hearing tests 104 on the subject first, in order to determine whether other hearing problems or central auditory processing problems exist. These tests are shown in more detail in figure 2.
  • a series of pure tone phase analysis tests 108 are performed to determine the optimal clinical phase shift at a variety of sound frequencies.
  • the subject's ability to identify a tone out of noise centered around the tone and the resultant threshold is assessed at a variety of relative phase shifts between ears, and at a variety of frequencies, and a profile of the subject's phase shift frequency profile is generated.
  • the frequency profile will be used to complement a phase correction filter. With this filter in place, speech stimuli can be used as a target in a similar fashion with broad band noise.
  • step 112 the results for the subject are compiled in a database. If the pathological BPTD for the subject is significant, this database is used to design an electronic filter (see Figure 6) or a physical filter (see Figure 7) to apply compensating clinical BPTD to the subjects ears.
  • FIG. 2 is a flow diagram showing conventional tests 104 in more detail.
  • the conventional tests start at step 202.
  • these tests include a pure tone evaluation 204 to evaluate hearing loss at various frequencies.
  • a central auditory processing evaluation 206 is performed, and various electro-physiological assessments 208 are performed.
  • Other assessments 210 may be added.
  • the conventional tests end at step 212.
  • Central auditory processing evaluation 206 may include (but is not limited to) such tests as: Willeford central auditory test battery; Dichotic digits test; Ipsilateral/ contralateral competing messages; Synthetic sentence identification with contralateral competing messages; Masking level differences; Auditory duration patterns; Speech-in-noise; Pediatric speech intelligibility test; segment altered CVCs; pitch patterns; dichotic chords; compressed speech, with and without reverberation.
  • tests as: Willeford central auditory test battery; Dichotic digits test; Ipsilateral/ contralateral competing messages; Synthetic sentence identification with contralateral competing messages; Masking level differences; Auditory duration patterns; Speech-in-noise; Pediatric speech intelligibility test; segment altered CVCs; pitch patterns; dichotic chords; compressed speech, with and without reverberation.
  • Electro-physiological assessments include such tests as: ABR; Middle latencies; Late latencies; P300; Mismatched Negativity. Binaural interaction components will also be calculated. Since electrophysiological measurements use various latency classifications or markers, this information may yield added information to the diagnosis and quantification of auditory asynchronies.
  • FIG 3 is a flow diagram showing the pure tone phase analysis test 108, according to the present invention.
  • a device such as that shown in Figure 5 may be used in this test.
  • This test assesses the subject's ability to discriminate pure tones from narrow band noise centered around the tone.
  • the pure tone and the noise are presented to each ear at a different phase (giving a relative phase shift or clinical BPTD). Thresholds are obtained for each tone at varying phase shifts.
  • a relative phase shift is selected, and the amplitude of the tone is increased until the subject can pick it out of the noise.
  • the optimal phase shift is the phase shift that produces the smallest amplitude hearing threshold.
  • the test starts at step 302. Narrow band noise and pure tones are applied to both ears in step 304.
  • frequencies are stepped through, for example from 500 Hz to 12000 Hz.
  • phase shifts of the pure tone between the two ears are stepped through for each frequency, for example 30, 60, 90, 120, and 180 degrees. These two loops can be exchanged if desired.
  • Step 312 tests the subject's threshold for the pure tone at that frequency and phase shift, and stores the result, for example in a table.
  • Step 314 determines the optimal relative phase shift between ears at each tested frequency, by determining at which phase shift the tone was heard best (at the lowest amplitude) over the background noise, for each frequency, compared to normal phase shift function.
  • the phase analysis test ends at step 320. This test procedure is also used with speech stimuli as the target signal using a phase correction filter and broad band noise.
  • Figure 4 is a flow diagram showing delayed binaural fusion test 112. This test measures the subject's ability to comprehend words (preferably bisyllabic) at various time delays between the two ears. Thus, it provides information regarding timing differences between the two ears and adds information beyond the phase analysis test. Examples of the tests done are given below.
  • High Low Frequency Lags Test 404 tests comprehension of a series of bisyllabic words separated into two frequency components (e.g. a high frequency component from 1900-2100 Hz and a low frequency component from 500-770 Hz) presented at a variety of relative time delays to the ears.
  • the purpose of step 404 is to determine whether a significant impairment due to CANS binaural phase-time asynchrony exists for the subject. For a person without this type of impairment, the change in relative time delays does not significantly effect comprehension - the CANS can account for the changes. In addition, the best comprehension occurs for the case of no relative time delay, as would be expected.
  • step 408 determines the optimal time delay for the subject.
  • Each word is presented to both ears, the high frequency portion of the word going to one ear and the low frequency portion of the word going to the other ear.
  • the relative time delay between the ears is changed for each word, and a variety of words are used at each relative time delay.
  • the words are generally bisyllabic, familiar to most people, and the emphasis is placed on both syllables equally (e.g. woodwork, bedroom, inkwell). For example, a series of 120 words may be used, divided among the selected relative time delays.
  • Other speech stimuli can be used along with other novel ways to split or partition out speech segments.
  • a computer program for sequentially selecting the words and setting the relative time delay for each word makes this process much easier.
  • the program may also provide a score sheet for entering whether each word was correctly identified, and computing the correct averages at each phase shift.
  • Steps 404 and 408 zero in on the ideal clinical relative time delay, because it is difficult for a subject with CANS-BPTD impairment to understand a word if the high and low frequency components are not correctly time shifted relative to each other, or when they are lagged while being embedded in noise or speech-babble.
  • auditory discrimination improves with an induced time delay in one ear for individuals with a CANS disfunction.
  • Other speech modifications using a lag paradigm may be used for identifying and quantifying asynchronies.
  • the described tests are scored by computing the percentage of correct responses given by the subject at each relative time delay, and each step refines the results of the previous step.
  • a software program for sequentially selecting the words and setting the relative phase shift for each word makes this process much easier.
  • the program also provides a score sheet display for entering whether each word was correctly identified, and computes the correct averages at each phase shift when the test is completed.
  • the phase shifts tested may be selected in view of the ideal overall clinical phase shift that was computed at the end of the pure tone or speech phase test of Figure 3, in order to make this test more efficient.
  • High-low frequency lags test 404 tests comprehension of a series of words at (for example) relative time delays of 5, 10, 15, and 20 msec to the left and right ears. The best comprehension level might be achieved at, for example, 5 msec time delay to the right ear.
  • Incremental DBFT test 408 then tests comprehension of a series of words at relative time delays of 2.5, 5, and 7.5 msec (assuming a 5 msec delay gave the best results in step 404). The best comprehension level might be achieved at, for example, 7.5 msec time delay.
  • Those skilled in the art will appreciate that further fine tuning can be accomplished with smaller relative time delays using the BPTD diagnostic device, if desired.
  • Zero delay word lists test 410 then verifies the results from steps 404 and 408 by testing comprehension at the selected relative time delay, using a device such as that shown in Figure 5.
  • Step 412 stores the optimal time delay selected by the previous steps.
  • the test ends at 414.
  • a correction device such as that shown in Figure 6 may now be designed, by combining the results of the Phase Analysis Test shown in Figure 3 and the DBFT test shown in Figure 4.
  • Figure 5 is a block diagram of an electronic device 500 for diagnosing and measuring the phase and time portions of BPTD, and for verifying the best overall relative time delay for the subject (see Figure 4, step 408).
  • An operator controls the relative time delay and phase delay applied to the subject's ears via an operator interface 502.
  • the test setup shown in this figure tests one frequency (tone) at a time and applies the selected phase shift to whatever frequency is applied.
  • the steps of the phase shift test are shown in Figure 3.
  • Operator interface 502 may include, e.g. a keypad to enter control signals, and a display to show which control signal is being applied.
  • Control signals 504 set the amount of relative time delay and phase shift to be applied by digital signal processor 510.
  • Sound 506 is digitized via channels 507 and 508 (or only one microphone may be used).
  • Relative time delay shifter 512 applies the overall relative time delay per control signals 504, and phase shifter 514 applies the phase shift.
  • the output of block 510 is delivered to the left ear 522 of the subject 520 via signal 516, to the right ear 524 of the subject via signal 518.
  • Figure 6 is a block diagram of real time, active, digital signal processing electronic device 600 for correcting BPTD, once it has been measured. Equivalent analog devices could also be used, but digital devices are more practical.
  • the signal is amplified in preamp 604, and is digitized in analog to digital converter (ADC) 606.
  • Digital signal processor (DSP) 608 operates much as test device 500 in Figure 5 operated, applying a time delay and a phase shift profile (see Figure 7).
  • Digital to analog converter (DAC) 610 converts the processed signal back to an analog signal, amplifier 612 filters and amplifies the signal, and microphone 614 turns the signal into an audio signal to be delivered to the ear of the subject.
  • the BPTD applied by DSP 608 is programmed according to the BPTD versus frequency profile obtained in the testing phase. It is unique for every subject. As an option, the DSP could be reprogrammable, via control signal 616, so it could be optimized for the wearer in actual use. Note that other hearing aid processing (compression or the like) may also be incorporated into the DSP if desired.
  • BPTD's produce a very noticeable auditory effect in the presence of noise regardless of whether the subject has CAP difficulties or not.
  • target signal speech stimuli
  • BPTD's have the potential for enhancing hearing aid performance
  • the BPTD profile used may change with the kind of background noise detected by the device.
  • a different BPTD profile may be used when the wearer is in a noisy environment, for example, or for different actions, as when the wearer is walking rather than sitting and writing.
  • FIG. 7 is a more detailed block diagram of DSP 608 of Figure 6.
  • BPTD control block 702 controls the overall time delay and the phase shift profile applied to the sound signal.
  • TD correction block 704 applies the overall time delay.
  • BP correction block 706 applies a phase shift profile to the sound signal. See Figure 9 for an example of a phase shift profile.
  • FIG 8 is a flow diagram showing the process accomplished by the DSP of Figure 6.
  • the audio input signal is applied in step 802.
  • the overall time delay is applied.
  • the phase profile is applied.
  • other processing is accomplished, if desired (compression or the like).
  • the corrected output signal is output in step 810.
  • Figure 9 is a diagram showing an example of the phase shift profile correction accomplished in BP block 706 of DSP 608 of Figure 7.
  • Dotted line 902 indicates linear phase
  • solid line 904 indicates the phase profile after the phase corrections.
  • q 1 , q 2 , and q 3 indicate phase shifts at specific frequencies f1, f2, and f3 respectively. Note that a different phase shift is applied at each frequency, and that positive and negative phase shifts may be applied.
  • the overall time delay applied by block 704 means that, overall, the time delay plus the phase shift will be positive.
  • Figure 10 is a cutaway side view of a physical filter (a passive earplug) for correcting BPTD.
  • a physical device in the ear can delay the sound in the ear, and can delay different frequencies differently, as electronic device 600 (in Figure 6) does.
  • a physical device is capable of much smaller time shifts, and the control at different frequencies is far less precise. Since the physical device is much cheaper and does not require batteries, it is the preferred device is some cases, for example when a small phase shift or delay is required, and the phase shift required doesn't vary much at various frequencies.
  • the physical filter is also smaller and more convenient.
  • Passive earplug 1000 induces a BPTD to sound entering the ear by altering the propagation time of the acoustic waves.
  • the primary method of delaying an acoustic signal in this manner is through the use of ducting 1002, through which the signal propagates.
  • the velocity of propagation of sound in air is approximately 331 meters per second, and the length of the ducting in the ear canal is about 10 cm (ducting along an eyeglass frame can be longer).
  • the time delay applied by a passive device in the ear canal is on the order of 30 us, corresponding to a phase shift of about p/3 at 5000Hz.
  • This time delay may be increased by about a factor of two by using a fluid rather than air in ducting 1002.
  • the velocity of sound in iodine is around 108m/s.
  • the frequency response of earplug 1000 may also be tuned to some degree by using acoustical filter elements 1004 (limited by space available).
  • Standard elements include chambers, Helmholtz resonators, and dampers.
  • other acoustic elements such as horns, collectors, domes, trumpets, and resonator may be used.
  • a direct analog may be made to an electrical BPTD system such as that shown in Figure 6, with Helmholtz resonators and expansion chambers used to create filter characteristics.
  • the number of cavities relates to the order of filter that can be designed.
  • phase time delay provided by passive element 1000 is dependent on the length of the auditory ducting 1002 within the plug, the diameters and locations of the cavities (side branch chambers 1008 or expansion chambers 1006) and the working fluid in the ducting.
  • Clinical results indicative of the efficacy of the present invention are provided hereinafter.
  • representative results will be provided for the diagnostic effectiveness of the delayed binaural fusion test (DBFT) and for the efficacy of binaural phase-time delay (BPTD) compensating devices as clinically demonstrated by subjects having BPTD impairments, wherein the compensating device substantially alleviated the debilitating effects of such BPTD generated impairments.
  • DBFT delayed binaural fusion test
  • BPTD binaural phase-time delay
  • CAP central auditory processing
  • This battery included the Competing Sentences, Filtered Speech, and Binaural Fusion Tests of the Willeford Central Auditory Test battery (Willeford, 1977), the Ipsilateral/Contralateral Competing Sentence Test (IC/CST) (Willeford 1985a, 1985b, Willeford et al ., 1985; Willeford et al ., 1994), Synthetic Sentence Identification-Ipsilateral Competing Messages (SSI-ICM) (Jerger et al ., 1974, 1975; Speaks et al ., 1965), Dichotic Digits (Musiek, 1983; Musiek et al ., 1979; Musiek et al ., 1979) and Masking Level Differences (MLD) (Noffsinger et al ., 1972; Olsen et al ., 1976). Using one-way ANOVAs, test performance showed significant differences
  • the low-pass and high-pass frequency filtered format one version of the DBFT (404), and shown in Table 1, was used to quantify inherent BPTDs between ears.
  • Statistically significant differences in speech recognition performance between normals and atypicals in the DBFT study of 115 subjects were observed.
  • Significant differences in percent performance were also evidenced in all conditions for both ears except for a left ear lag at a 15msec delay. The reason for this decrease in function for both normal and atypical groups at a 15msec lag deserves further study.
  • filters are designed for wearing binaurally to reduce damaging noise while maintaining speech. It is not an intentional effect of the filter to produce a time delay in the acoustic signal.
  • the inventors recognized that monaural use of such a filter was a passive filter approach to inducing a BPTD.
  • the modifications to the filter to change the length of the filter were done on custom trial-and-error basis.
  • the filter, with the resultant notched frequency configuration at 2000-3000 Hz, when worn monaurally, has the effect of a BPTD.
  • the proposed passive device would be designed specifically for inducing a BPTD, and could be designed to induce the a predetermined BPTD obtained from the testing procedure described above.
  • the BPTD could be limited to a particular frequency range (depending on PAT results) for specific amplitudes within the limitations of the capabilities of passive filtering elements. This would provide the ability to control the induced BPTD for individual fitting based on the diagnostic results.
  • the current art does not offer flexibility with size of BPTDs at specific frequencies for optimal auditory and human performance enhancement.
  • Figure 13 shows speech recognition performance in noise for 22 individuals with CANS dysfunction. Five different conditions are shown in the figure.
  • condition 4 introduces a BPTD.
  • Conditions 2 and 3 result in unilateral noise reduction and condition 5 results in bilateral high frequency noise reduction. All differences are statistically significant (p ⁇ 0.05), except for the three conditions, which included the left ear muffed, and no plugs, bilateral plugging and no plugging, and left ear muffed and bilateral plugging. Of particular interest is the significant improvement in speech recognition with an induced BPTD ("unilat plug"), P ⁇ 0.0001. Noise reduction without a BPTD (unilateral muff or bilateral earplugs) does not result in enhanced speech recognition.
  • Figure 14 shows speech recognition ability in noise results for 12 individuals without CANS dysfunction. Five different conditions are shown in the figure.
  • the "no plug” results are significantly (p ⁇ 0.01) greater than any of the other conditions. These results demonstrate the importance of synchronous binaural processing of auditory input for enhanced speech discrimination in noise for individuals with a normal CANS. Furthermore, these results indicate that unilateral noise reduction (conditions 2 and 3) or introducing a BPTD (conditions 4 and 5) do not enhance speech discrimination in noise for individuals with normal CANS function. Note that speech discrimination results for the atypical group under condition 1 ("no plug”) are significantly lower than those for the normal group under condition 1 ("no plug”). Note also that under condition 4 ("unilat plug”), the atypical group performs at approximately the same level as the normal group does under condition 1 ("no plug”).
  • Ten normal CANS subjects and 10 atypical CANS subjects were selected for various human performance testing using the prototype BPTD electronic device.
  • the mean age of the 10 normal subjects was 31 years with an age range of 21-43 years. In this group, five individuals were male and five were female. In the atypical CANS group, the mean age was 29.1 years with an age range of 15 to 47 years. Seven females and 3 males were included in this group. All subjects in the two groups passed the initial subject selection criteria. The ten subjects that were included in the atypical CANS group failed at least one test in either ear in the CAP test battery. Further, to provide for a balancing of BPTDs for the normal group, subjects for the atypical group were selected when they showed maximum improvement for the DBFT with a 2.5-7.5 msec BPTD to either the right or left ear.
  • Another version of the DBFT (406) was developed to include time-lagged bisyllabic stimuli that were presented in 2.5 msec increments (the previous DBFT used 5 msec increments).
  • This version included thirty bisyllabic words per list (4 lists) that were lagged in time between ears of 0 msec, 2.5 msec, 5 msec, and 7.5 msec and recorded in a CD format with an 8-talker babble (s/n ratio of +2 dB) embedded in the background and presented binaurally. These words were presented under earphones at 40 dB sensation level relative to pure tone averages for both ears.
  • the lag ear was determined by results from the DBFT 5 msec version (404).
  • the highest speech recognition percent score for bisyllabic words was determined to be the "optimal" msec setting for the BPTD device for atypical CANS subjects.
  • the optimal condition for normal CANS subjects was randomized at 2.5 msec, 5 msec, and 7.5 msec. Statistical analysis showed that these word lists were equivalent.
  • the 5 auditory conditions used in the preliminary studies were as follows: (1) natural condition which was unoccluded with 8-talker babble presented at 40 dB HL, (2) quiet which consisted of an unoccluded condition with 8-talker babble presented at 25 dB HL, (3) optimal condition using the BPTD electronic device in the presence of 40 dB HL 8-talker babble; (4) 0 msec condition using the BPTD electronic device with 40 dB HL 8-talker babble, and (5) opposite BPTD (same setting but in opposite ear) from the optimal setting (e.g., if "optimal” was a 5 msec lag to the right ear, then "opposite” is a 5 msec lag to the left ear). Not all tests examined condition 5.
  • Percent improvement in speech recognition ability using the BPTD device was assessed using four thirty-bisyllabic word lists that were recorded on a CD at 0 msec (408). Auditory stimuli were presented in the sound field from a front facing speaker two meters from the individual. Test stimuli were presented at 45 dB sensation level (re: sound field speech reception threshold) in the presence of an 8-talker babble recorded at a +2 s/n ratio. Both stimuli were presented from the front speaker in a double-walled sound proof room.
  • Gait studies were performed in a controlled uniform sound environment -- a semi-anechoic chamber. Reverberation times were long enough (or amplitudes sufficiently low) that the room was taken as representative of the sound field in an open or large room with high damping.
  • the ambient sound level in the chamber was 45 dB SPL (Metrosonics dosimeter, Model dB307, Class Type 2A, Rochester, NY). Sound sources were then introduced into the chamber under controlled amplitude and directionality. This is a highly controlled sound field relative to all previous gait studies in the literature.
  • Speakers were placed in the anechoic chamber at 0( (far left), 45(, 90( (center), 135(, and 180( (far right) locations in a clockwise direction relative to the direction of travel.
  • the five sound sources were randomly presented to create the general localized sound condition (LS).
  • Two additional cases were run in the chamber without speaker input: walking with and without earmuffs (Peltor, Model H6AN) created the general reduced sound level condition (RS).
  • RS general reduced sound level condition
  • the center speaker was used for the BPTD device study.
  • the speaker output (i.e., sound source) was a tape-recorded eight-person multi-talker babble presented at a sound level that was within three dB of a 56 dB SPL in the chamber calibrated gait area.
  • all materials used in the chamber were monochromatic (i.e., either gray or black) and the room lighting was reduced to approximately 0.9 footcandles (equivalent to a moderately lighted parking lot).
  • a calibrated three-dimensional video gait analysis (Peak MotusTM, Englewood, Colorado) was completed with three camera views. The three cameras recorded each subject walking straight ahead within the calibrated area at a comfortable pace for two strides. The subject repeated each condition until three to five gait cycles were recorded between consecutive heel strikes of the same foot.
  • retro-reflective markers were mounted on the skin using 3MTM hypoallergenic double-sided tape. On the head, two markers were placed on a spandex swim cap pointing upward directly above the ears. Body markers were placed on the vertebra prominens (C7 vertebra), shoulders, elbows, wrists, greater trochanters, knees, and ankles.
  • the kinematic data were divided by the subject's height in meters.
  • the following gait parameters will be presented: walking speed (% height/sec), stride width (%height), and center of mass position (COM) (% height).
  • the relative COM (COM Del) was the difference of the lateral COM position from the origin between the first heel strike and the time of measurement.
  • the Root Mean Square Error (RMSE) method was used to calculate the mean lateral deviation from a straight-line path of the COM.
  • BPTD Planar Biharmonic Deformation
  • Figures 16, 17, and 18 show the walking speed, stride width and RMSE results for the atypical and normal groups under the different BPTD device conditions.
  • the data graphically presents the differences in these parameters between the three BPTD device conditions.
  • the first bar in Figure 16 shows the average of the differences in walking speed for each of the atypical subjects between the "optimal” and "0msec” conditions. It is evident that atypical group's gait is significantly improved (i.e., they walk faster) under both the "optimal" and "opposite" BPTDs, compared to the absence of a BPTD (O msec), while the BPTD settings have little effect on the normal subjects' gait.
  • the decrease in stride width and RMSE is seen as an improvement in gait as the decreases tended to bring the values of these parameters for the atypicals closer to the values for the normals. While the gait of the normal subjects was impacted very little by the device, as compared to the atypical group, the graphs indicate a trend that the "optimal" and "opposite" BPTDs actually degrade the normal subjects' gait. This trend supports the notion that while an induced BPTD in a normal CANS system is disruptive, it can be accommodated.
  • Acoustic measures of diadochokinetic rate or maximum repetition rate for non-speech material includes: duration in msec of 5 correct syllable sequences out of 7 consecutive utterances. This measure was used as an assessment of articulatory speed; however, because only correct syllable productions were counted, it probably more accurately reflected articulatory efficiency. Syllable and pause durations were also measured as were irregularities or variances among successive syllable and pause durations within each condition.
  • Results of performance of these tasks under auditory conditions in normal and atypical subjects revealed statistically significant differences in articulatory efficiency, syllable duration and variances in syllable and pause duration when comparing those persons with normal and atypical CANS function (p ⁇ .05 for each). This suggested that while all subjects were considered normal speakers, differences in abilities to make rapid alternating movements differ in persons with atypical versus normal CANS function.
  • perceptual measures were taken of the number of dysfluencies and reading speed in words per second.
  • Perceptual dysfluency types included: part and whole word repetitions, phrase repetitions/restarts, prolongations, phonatory disruptions, interjections, blocks, and pauses. This system of dysfluency classification was modified from Kent, 1994.
  • Reading speed as measured by words per second in an 85-word oral reading sample revealed statistically significant differences when comparing those persons with normal and atypical CANS function (p ⁇ .05). It should also be noted that although statistically significant differences were not observed in pairwise comparisons across auditory conditions for the subjects with atypical CANS function, the fastest reading rate condition for this group was their optimal or accommodated condition.

Landscapes

  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Physics & Mathematics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Stereophonic System (AREA)
  • Prostheses (AREA)
  • Magnetically Actuated Valves (AREA)
  • Stereophonic Arrangements (AREA)
  • Instructional Devices (AREA)

Claims (22)

  1. Vorrichtung zum Kompensieren eines gemessenen binauralen Phasen/Zeitverzögerungs-Profils (BPTD) einer Person, wobei die Vorrichtung umfasst:
    a. Mittel (704), die Schallsignale zu einem Ohr der Person entsprechend dem BPTD verzögern; und
    b. Mittel (706), die bei unterschiedlichen Frequenzen entsprechend dem BPTD unterschiedliche Phasenverschiebungen anwenden.
  2. Vorrichtung nach Anspruch 1, bei der die Verzögerungsmittel einen passiven Ohrstöpsel (1000) mit einem Durchgang (1002), der die Schallausbreitung in Bezug auf die Luft verzögert, umfassen.
  3. Vorrichtung nach Anspruch 2, bei der die Mittel zum Anwenden von Phasenverschiebungen wenigstens ein akustisches Filterelement (1004) in dem Ohrstöpsel umfassen.
  4. Vorrichtung nach Anspruch 2, bei der der Durchgang mit Fluid gefüllt ist.
  5. Vorrichtung nach Anspruch 1, bei der die Verzögerungsmittel und die Phasenverschiebungsanwendungsmittel als elektronische Hörhilfe (600) implementiert sind.
  6. Vorrichtung nach Anspruch 5, bei der die Hörhilfe eine digitale Hörhilfe ist und umfasst:
    a. einen Analog/Digital-Umsetzer (ADC) (606);
    b. einen digitalen Signalprozessor (DSP) (608);
    c. und einen Digital/Analog-Umsetzer (DAC) (610);
       wobei der DSP die Verzögerungsmittel und die Phasenverschiebungsanwendungsmittel implementiert.
  7. Vorrichtung nach Anspruch 6, bei der die Mittel zum Implementieren des Phasenverschiebungsprofils ein FIR-Filter (806) umfassen.
  8. Vorrichtung nach Anspruch 6, bei der der DSP eine andere Audiosignalverarbeitung (808) sowie die Verzögerungsmittel und die Phasenverschiebungsanwendungsmittel implementiert.
  9. Vorrichtung nach Anspruch 8, bei der die implementierte andere Audioverarbeitung eine Geräuschreduzierung umfasst.
  10. Vorrichtung nach Anspruch 8, bei der die implementierte andere Audioverarbeitung das Anwenden von Amplitudenänderungen auf die Schallsignale umfasst.
  11. Vorrichtung nach Anspruch 1, die ferner Mittel (616) zum Modifizieren der Phasenverschiebungsanwendungsmittel entsprechend den Umgebungsbedingungen umfasst.
  12. Vorrichtung zum Entwickeln eines binauralen Phasen/Zeitverzögerungs-Profils (BPTD) einer Person, wobei die Vorrichtung umfasst:
    a. Mittel (112), die eine gesamte relative Verzögerung für die Person bestimmen; und
    b. Mittel (108), die ein Phasenverschiebungsprofil für die Person bestimmen.
  13. Vorrichtung nach Anspruch 12, bei der die Mittel zum Bestimmen der gesamten relativen Verzögerung umfassen:
    a. Mittel zum Trennen gesprochener Wörter in Hochfrequenz- und Niederfrequenz-Bänder;
    b. Mittel, die eines der Bänder relativ zu dem anderen Band verzögern;
    c. Mittel, die das verzögerte Band für ein Ohr bereitstellen und das nicht verzögerte Band für das andere Ohr bereitstellen;
    d. Mittel, die das Verstehen der Wörter durch die Person bei unterschiedlichen Verzögerungen messen; und
    e. Mittel, die die gesamte Phasenverzögerung, bei der das Verstehen optimal ist, bestimmen.
  14. Vorrichtung nach Anspruch 12, bei der die Mittel für die Bestimmung eines Phasenverschiebungsprofils umfassen:
    a. Mittel, die einen reinen Ton bereitstellen;
    b. Mittel, die den reinen Ton auf zwei Kanäle aufteilen;
    c. Mittel, die auf einen der Kanäle eine Phasenverschiebung anwenden;
    d. Mittel, die den phasenverschobenen Kanal für ein Ohr bereitstellen und den nicht phasenverschobenen Kanal für das andere Ohr bereitstellen;
    e. Mittel, die die Amplitude und die Frequenz des Tons ändern;
    f. Mittel, die einen Schwellenwert (niedrigste Amplitude, bei der der Ton gehört wird) für Töne unterschiedlicher Frequenz bei unterschiedlichen Phasenverschiebungen ermitteln; und
    g. Mittel, die den Tönen mit unterschiedlicher Frequenz entsprechend der niedrigsten Amplitude, bei der jeder Ton gehört wird, eine optimale Phasenverschiebung zuweisen.
  15. Vorrichtung nach Anspruch 12, bei der die Mittel, die eine gesamte relative Verzögerung bestimmen, und die Mittel, die ein Phasenverschiebungsprofil bestimmen, als elektronische Vorrichtung (500) implementiert sind, die umfasst:
    a. Mittel (512), die die gesamte relative Verzögerung ändern;
    b. Mittel (514), die das Phasenverschiebungsprofil ändern; und
    c. Mittel, die die Person (520) bei verschiedenen gesamten relativen Verzögerungen und Phasenverschiebungsprofilen bewerten, um eine optimale gesamte relative Verzögerung und ein optimales Phasenverschiebungsprofil zu bestimmen.
  16. Vorrichtung nach Anspruch 12, die ferner Mittel umfasst, die ein Amplitudenmodifikationsprofil für die Person bestimmen.
  17. Verfahren zum Entwickeln eines binauralen Phasen/Zeitverzögerungs-Profils (BPTD) einer Person, das die folgenden Schritte umfasst:
    a. Bestimmen einer gesamten relativen Verzögerung für die Person; und
    b. Bestimmen eines Phasenverschiebungsprofils für die Person.
  18. Verfahren nach Anspruch 17, bei dem der Schritt des Bestimmens der gesamten Phasenverzögerung umfasst:
    a. Trennen gesprochener Wörter in Hochfrequenz- und Niederfrequenz-Bänder;
    b. Verzögern eines der Bänder relativ zu dem anderen Band;
    c. Bereitstellen des verzögerten Bandes für ein Ohr und des nicht verzögerten Bandes für das andere Ohr;
    d. Messen des Verstehens der Wörter durch die Person bei mehreren verschiedenen Verzögerungen; und
    e. Bestimmen der gesamten Phasenverzögerung, bei der das Verstehen optimal ist.
  19. Verfahren nach Anspruch 17, bei dem der Schritt des Bestimmens eines Phasenverschiebungsprofils umfasst:
    a. Bereitstellen eines reinen Tons;
    b. Aufteilen des reinen Tons auf zwei Kanäle;
    c. Anwenden einer Phasenverschiebung auf einen der Kanäle;
    d. Bereitstellen des phasenverschobenen Kanals für ein Ohr und des nicht phasenverschobenen Kanals für das andere Ohr;
    e. Verändern der Amplitude und der Frequenz des Tons;
    f. Ermitteln eines Schwellenwertes (niedrigste Amplitude, bei dem der Ton gehört wird) für Töne verschiedener Frequenz bei verschiedenen Phasenverschiebungen; und
    g. Zuweisen einer optimalen Phasenverschiebung an die Töne mit verschiedener Frequenz entsprechend der niedrigsten Amplitude, bei der jeder Ton gehört wird.
  20. Verfahren nach Anspruch 17, das ferner den Schritt umfasst, bei dem an der Person übliche Hörtests ausgeführt werden.
  21. Verfahren zum Kompensieren eines gemessenen binauralen Phasen/Zeitverzögerungs-Profils (BPTD) einer Person, das die folgenden Schritte umfasst:
    a. Verzögern (804) von Schallsignalen an ein Ohr der Person entsprechend dem BPTD; und
    b. Anwenden verschiedener Phasenverschiebungen (806) bei unterschiedlichen Frequenzen entsprechend dem BPTD.
  22. Verfahren nach Anspruch 21, das ferner den Schritt (808) umfasst, bei dem Amplitudenmodifikationen bei verschiedenen Frequenzen angewendet werden.
EP00968722A 1999-10-05 2000-10-05 Vorrichtung und verfahren zur kompensation von störungen der binauralen phasen- und zeitverzögerung durch das zentrale gehörnervensystem Expired - Lifetime EP1234480B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15777599P 1999-10-05 1999-10-05
US157775P 1999-10-05
PCT/US2000/027460 WO2001026420A2 (en) 1999-10-05 2000-10-05 Apparatus and method for mitigating hearing impairments

Publications (2)

Publication Number Publication Date
EP1234480A2 EP1234480A2 (de) 2002-08-28
EP1234480B1 true EP1234480B1 (de) 2004-01-07

Family

ID=22565233

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00968722A Expired - Lifetime EP1234480B1 (de) 1999-10-05 2000-10-05 Vorrichtung und verfahren zur kompensation von störungen der binauralen phasen- und zeitverzögerung durch das zentrale gehörnervensystem

Country Status (6)

Country Link
EP (1) EP1234480B1 (de)
AT (1) ATE257637T1 (de)
AU (1) AU7859500A (de)
CA (2) CA2661798C (de)
DE (1) DE60007659D1 (de)
WO (1) WO2001026420A2 (de)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7120258B1 (en) 1999-10-05 2006-10-10 Able Planet, Inc. Apparatus and methods for mitigating impairments due to central auditory nervous system binaural phase-time asynchrony
AU2001278418A1 (en) * 2000-07-14 2002-01-30 Gn Resound A/S A synchronised binaural hearing system
EP2227042B1 (de) * 2005-05-03 2011-12-28 Oticon A/S System und Verfahren zum Teilen von Netzwerkresourcen zwischen Hörgeräten
JP6673828B2 (ja) * 2013-08-13 2020-03-25 ザ・チルドレンズ・ホスピタル・オブ・フィラデルフィアＴｈｅ Ｃｈｉｌｄｒｅｎ’Ｓ Ｈｏｓｐｉｔａｌ Ｏｆ Ｐｈｉｌａｄｅｌｐｈｉａ 自閉症における言語処理向上のための装置
CN113823314B (zh) * 2021-08-12 2022-10-28 北京荣耀终端有限公司 语音处理方法和电子设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4556069A (en) * 1983-03-15 1985-12-03 Energy Optics, Inc. Method and apparatus for measuring differential auditory system
EP0349599B2 (de) * 1987-05-11 1995-12-06 Jay Management Trust Paradoxhörgerät
EP0868830A4 (de) * 1995-12-20 2006-03-22 K S Himpp Virtuelle elektroakustische audiometrie ohne prothese, mit simulation von prothese und mit prothese
EP0915639A1 (de) * 1999-01-05 1999-05-12 Phonak Ag Verfahren zur binauralen Anpassung von Hörgeräten

Also Published As

Publication number Publication date
WO2001026420A2 (en) 2001-04-12
ATE257637T1 (de) 2004-01-15
CA2661798C (en) 2013-12-10
CA2386653C (en) 2010-03-23
CA2661798A1 (en) 2001-04-12
DE60007659D1 (de) 2004-02-12
EP1234480A2 (de) 2002-08-28
WO2001026420A3 (en) 2002-01-31
AU7859500A (en) 2001-05-10
CA2386653A1 (en) 2001-04-12

Similar Documents

Publication Publication Date Title
US7929711B2 (en) Apparatus and methods for mitigating impairments due to central auditory nervous system binaural phase-time asynchrony
Warren Auditory perception: A new synthesis
Henry et al. Bone conduction: Anatomy, physiology, and communication
Gengel Temporal effects in frequency discrimination by hearing‐impaired listeners
Thielemeir et al. Audiological results in children with a cochlear implant
Weisenberger et al. The role of tactile aids in providing information about acoustic stimuli
Zhang Psychoacoustics
EP1234480B1 (de) Vorrichtung und verfahren zur kompensation von störungen der binauralen phasen- und zeitverzögerung durch das zentrale gehörnervensystem
Ifukube Sound-based assistive technology
Weisenberger et al. Comparison of two single-channel vibrotactile aids for the hearing-impaired
Maltby A Dictionary of Audiology
Boothroyd Selection of hearing aids for children
Schlauch Loudness
MARY The effects of increasing consonant/vowel intensity ratio on speech loudness
Maggu et al. Effect of temporal pattern training on specific central auditory processes
Smith et al. Consonant enhancement effects on speech recognition of hearing-impaired children
Byrne Influence of ear canal occlusion and air-conduction feedback on speech production in noise
Slade et al. Entraining alpha oscillations to facilitate auditory working memory: A TMS-EEG study
MANGAN Auditory Processes
Bustamante et al. Wideband compression and spectral sharpening for hearing‐impaired listeners
Kim et al. Low frequency perception of rhythm and intonation speech patterns by normal hearing adults
Robinson The effect of talker age and gender on speech perception of pediatric hearing aid users
Thome et al. Tactile Auditory Sensory Substitution
Ceha Investigation into the Enhancement of Voice Perception
Pohlmann Subjective Methods for Evaluating Sound Quality

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20020503

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

RTI1 Title (correction)

Free format text: APPARATUS AND METHOD FOR MITIGATING IMPAIRMENTS DUE TO THE CENTRAL AUDITORY NERVOUS SYSTEM BINAURAL PHASE-TIME ASYNCHRONY

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SYNCPHASE LABS, LLC

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ABLE PLANET, INC.

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 20040107

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: FR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040107

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60007659

Country of ref document: DE

Date of ref document: 20040212

Kind code of ref document: P

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040407

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040407

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040407

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040408

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20040418

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
LTIE Lt: invalidation of european patent or patent extension

Effective date: 20040107

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20041005

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20041005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20041031

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20041008

EN Fr: translation not filed
REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20040607

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20130925

Year of fee payment: 14

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20141005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141005