WO2004086361A1 - Noise floor estimator - Google Patents

Noise floor estimator Download PDF

Info

Publication number
WO2004086361A1
WO2004086361A1 PCT/AU2004/000390 AU2004000390W WO2004086361A1 WO 2004086361 A1 WO2004086361 A1 WO 2004086361A1 AU 2004000390 W AU2004000390 W AU 2004000390W WO 2004086361 A1 WO2004086361 A1 WO 2004086361A1
Authority
WO
WIPO (PCT)
Prior art keywords
noise floor
floor estimate
counter
magnitude
current noise
Prior art date
Application number
PCT/AU2004/000390
Other languages
French (fr)
Inventor
Konstadinos Hatzianestis
Yashodhan Moghe
Original Assignee
Cochlear Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cochlear Limited filed Critical Cochlear Limited
Publication of WO2004086361A1 publication Critical patent/WO2004086361A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00Electrotherapy; Circuits therefor
    • A61N1/18Applying electric currents by contact electrodes
    • A61N1/32Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36036Applying electric currents by contact electrodes alternating or intermittent currents for stimulation of the outer, middle or inner ear
    • A61N1/36038Cochlear stimulation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/18Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band

Definitions

  • the present invention relates to noise estimation in a number of channels in a received audio signal, and more particularly, relates to estimating the noise in any one of the channels in an audio signal received and processed by a cochlea implant system.
  • audio signals are decomposed into sub-bands with each sub-band occupying a different frequency region within the audible spectrum. It is desirable to estimate long term stationary components or noise sources that are contained in the individual channels in real time. Such detection enables the reduction of audible environmental noises, such as car engine noise or fan noise or even various internal body noises presented to a cochlea implant recipient. It also enables the reduction of energy consumed in the electrical stimulation of these noises in the cochlea implant.
  • the noise sources include external noises such as car engines or fan noise, as mentioned previously, or noise sources that are internal to the recipient which may include broadband noises such as heavy breathing, chewing or skin noises as well as narrowband noises such as the recipient's own voice. All these noises have a negative impact on the recipient intelligibility when listening to speech as they can partially or totally mask important parts in the speech spectrum. The degree of the degradation of these perceived signals depends on the instantaneous signal to noise ratio between the speech signal and the noise and the spectral characteristic of the noise itself.
  • the sub-bands are output from a filter bank and may number up to twenty, one for each electrode in the electrode array of the implant.
  • a filter such as a DC block filter.
  • a method of estimating noise floors in an audio signal comprising the steps of: determining a plurality of analysis channels of the audio signal; sampling each one of the analysis channels to determine a respective, sampled magnitude value; comparing each one of the respective, sampled magnitude values with a corresponding one of a current noise floor estimate; counting, for each one of the analysis channels, a number of times the sampled, magnitude value falls outside a predetermined limit for the corresponding one of a current noise floor estimate; and adjusting, for each one of the channels, the corresponding noise floor estimate if the counted number of samples exceeds a corresponding one of a threshold number.
  • the counting step may comprise counting a number of times a respective sampled, magnitude value is greater than the predetermined limit for the corresponding one of a current noise floor estimate, such that the method further comprises the step of increasing the corresponding one of the current noise floor estimate if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
  • the method may further comprising the step of incrementing a first counter by one each time the respective sampled, magnitude value has a magnitude greater than the predetermined limit for the corresponding one of the current noise floor estimate following the comparing step.
  • the audio signal may comprise a number of analysis channels, each analysis channel having a bandwidth equivalent to a portion of a speech spectrum, analysed in a cochlea implant system.
  • the method may further comprise conducting the comparison step over a period of time on a channel-by-channel basis.
  • the counting step may comprise counting a number of times a respective sampled, magnitude value is less than the predetermined limit for the corresponding one of a current noise floor estimate, such that the method further comprises the step of decreasing the corresponding one of the current noise floor estimate if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
  • the method may further comprise the step of incrementing a second counter by one each time the respective sampled, magnitude value has a magnitude less than the predetermined limit for the corresponding one of the current noise floor estimate after the comparing step.
  • the audio signal may represent a number of analysis channels, each analysis channel having a bandwidth equivalent to a portion of the speech spectrum, analysed in a cochlea implant system.
  • apparatus for estimating noise floors in an audio signal comprising: means for determining a plurality of analysis channels of the audio signal; means for sampling each one of the analysis channels to determine a respective, sampled magnitude value; comparator means for comparing each one of the respective, sampled magnitude values with a corresponding one of a current noise floor estimate; counter means for counting, for each one of the analysis channels, a number of times the sampled, magnitude value falls outside a predetermined limit for the corresponding one of a current noise floor estimate; wherein for each one of the channels, the corresponding noise floor estimate is adjusted if the counted number of samples exceeds a corresponding one of a threshold number.
  • the counter means may comprise a first counter for counting a number of times a respective sampled, magnitude value is greater than the predetermined limit for the corresponding one of a current noise floor estimate, such that the corresponding one of the current noise floor estimate is increased if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
  • the comparator means may be used to determine if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
  • the first counter may be incremented by one each time the respective sampled, magnitude value has a magnitude greater than the predetermined limit for the corresponding one of the current noise floor estimate as determined by the comparator means.
  • the counter means may comprise a second counter for counting a number of times a respective sampled, magnitude value is less than the predetermined limit for the corresponding one of a current noise floor estimate, such that the corresponding one of the current noise floor estimate is decreased if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
  • the further comparator means may be used to determine if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
  • a method of estimating the noise floor in an audio signal comprising the steps of: comparing the magnitude of samples of the audio signal with a current noise floor estimate; incrementing a first counter by one for each new sample having a magnitude greater than the current noise floor estimate; incrementing a second counter by one for each new sample having a magnitude less than the current noise floor estimate; further comparing the samples stored in the first counter with a first threshold value and comparing the samples stored in the second counter with a second threshold value.
  • apparatus for estimating the noise floor in an audio signal comprising: first comparator means for receiving the audio signal and comparing a magnitude of samples of the audio signal with a current noise floor estimate; a first counter linked to the first comparator means which is incremented by one for each new sample that has a magnitude greater than the current noise floor estimate as determined by the first comparator means; a second counter linked to the first comparator means for incrementing by one for each new sample that has a magnitude less than the current noise floor estimate as determined by the first comparator means; a second comparator means for comparing the samples stored in the first counter with a first threshold value and for comparing the samples stored in the second counter with a second threshold value.
  • Figure 1 is a schematic diagram illustrating the components involved in post processing in an audio processor of a cochlea implant system
  • Figure 2 is a schematic diagram showing portions of a noise floor estimator unit
  • Figure 3 is a flow diagram illustrating processes and principle steps in computing a noise floor estimate in a single channel of an audio signal.
  • Figure 4 shows a series of wave forms involved with the signal processing block of an audio processor of a cochlear implant system and a graph of the estimated noise floor.
  • FIG. 1 there is shown a block diagram of part of an audio processor in a cochlea implant.
  • Digital signals that have been converted from the original analogue speech signal via a front end or pre-processor are input to a filter bank 10 and in this particular example, a multi-rate filter bank or MRFB.
  • the filter bank 10 analyses the received digital speech signal and splits the signal into N separate channels.
  • N channels typically in a cochlea implant system there are 20 or 22 channels. Each channel is designed to have a bandwidth covering part of the spectrum of the received speech signal.
  • Each of the N channels are then input to a noise floor estimator 30 in order to estimate the noise floor of the audio channel according to the present invention.
  • Each of the channels are then input to a threshold comparator 40 to enable a comparison to be made between the signal level on each channel and the estimated noise floor and then M out of the N channels are selected by a selection unit 50 on the basis of the comparison.
  • the selected maxima M out of N channels are then forwarded to the loudness growth function (LGF).
  • LGF loudness growth function
  • the selection of maxima on various channels out of the N original channels is the subject of a further invention and a co-pending Australian provisional application No 2003901538 to the same applicant.
  • the primary focus of this invention is to provide an estimation of the noise floor and to adjust that noise floor depending on sampled values of the magnitude of each of the analysis channels.
  • the audio processor in a cochlea implant system (and more particularly in Totally Implanted Cochlea Implant Systems) employs a noise floor estimation on a channel-by-channel basis which tracks the instantaneous noise floor of each of the analysis channels.
  • the channels are continuously evaluated against these estimates and are considered in the maxima search conducted by the unit 50 only if the magnitude of the channels exceed the current channel noise floor estimate.
  • Implementation of the noise floor estimator 30 is based on a dual-bin histogram measurement of the monitored magnitudes over time.
  • Each analysis channel measures how often its magnitude lies above and below the current noise floor estimate within a certain time window. This is done by means of two incrementing counters in each analysis channel, as is to be discussed with reference to Figure 2.
  • the accumulated values of the two incrementing counters are compared against two fixed thresholds that are mutually exclusive to one another.
  • the thresholds are defined as:
  • noise floor estimator 30 whereby a channel to be analysed is input to a comparator 60 which compares the magnitude of the signal within that channel with the present noise floor estimate 61. This is performed over a window of time whereby a certain number of samples within the signal are analysed and compared with the current noise floor estimate 61. The comparison is made to find those instances where each samples magnitude values falls outside of a predetermined linit for the current noise floor estimate.
  • the number of samples having a magnitude greater than the noise floor estimate is flagged and a first counter 62, termed the "Above" counter, is incremented by one for every sample that has its magnitude greater than the noise floor.
  • the cumulative values in the counter 62 are compared against the second threshold identified above by a second comparator 64.
  • a number of samples of the input channel are compared for their magnitude against the present noise estimate 61 by comparator 60 and for those samples that have their magnitude below the present noise floor estimate, initiates a further counter 63, termed the "Below" counter, to increment by one each time the magnitude of a sample is measured to be below the present noise floor estimate.
  • the cumulative values stored in the counter 63 are compared with the first threshold identified above by comparator 60.
  • the incrementing counter 62 that measures the magnitude occurrences that are above the noise estimate, where these exceed the value Cst_NO_Above_Est a new noise floor estimate is implemented and slowly tracks the increase. More particularly, the noise estimate is increased and may be increased by 16. With regard to the thresholds above, this essentially states that if this is more than 30% of the total number of samples in the integration window, as stored in the counter 62, the new noise floor estimate is increased and is slowly tracked such that:
  • Noise_Floor_Channel(i) Noise_Floor_Channel(i) + 2
  • Noise_Floor_Channel(i) Noise_Floor_Channel(i) / 2.
  • a new noise floor which is decreased in value is used as the estimate for the noise floor, and more particularly is made to be half the present value for the noise floor estimate.
  • This is a way of boosting the number of samples having a magnitude greater than the noise floor. This in turn enhances the selection process by the unit 50 to establish the channels having various maxima to be selected to be thereby used in electrical stimulation of the auditory nerves.
  • step 80 the noise floor estimator 30 waits for new channel data to arrive at the comparator unit 60. Once received a determination is made at step 82 as to whether the time interval or window period has elapsed. If not the process moves to step 84 whereby a determination is made as to whether a particular sample has a magnitude greater than the present noise estimate. If yes, the counter 62 is incremented by one at step 86. If no, the counter 63 is incremented by one at step 88. Thereafter the integration time window is decremented by one at step 90 and the process returns to step 80 until the time interval over which the samples are taken has finished.
  • step 92 a determination is made as to whether counter 63 has more than 90% of all samples sampled within a time interval or window time. If this is the case then the process moves to step 94 where a new noise estimate is implemented which is reduced by a factor of two. The process then moves to step 96 where the counter 63 is reset and the integration window time is also reset. Alternatively, in a separate analysis, if counter 62 has more than 30% of the values sampled in the time interval or window time, then a new noise estimate is increased by 16 and limited to an upper threshold at step 100. The process then moves back to step 96 where counter 62 is reset and the integration window time is reset as well.
  • the uppermost waveform 110 shows a raw signal output of an analysis channel assuming that there is a channel response to a signal-frequency signal within the frequency band of this channel.
  • the rectified signal which effectively converts the raw signal in waveform 110 having a bipolar signal amplitude output into a unipolar signal amplitude.
  • the envelope detector 20 smooths out the rectified signal by applying a low pass filter to the signal as shown in the envelope detector output waveform 130.
  • the noise floor estimate which includes an increment step size, a decrement factor, an estimator target dynamic range, an estimator attack time and an estimator integration window.
  • the audio sampling interval is the time in which consecutive samples of the audio signal are periodically acquired and is inverse to the audio sampling frequency, which for example amounts to 13,000Hz and is thus around 77 ⁇ s.
  • the estimator attack time is the time within which the noise floor estimator 30 should increase its noise floor estimate for a given estimator target signal dynamic range. This time is generally specified in milliseconds.
  • a typical target or estimator attack time for a long-term stationary noise source is in the order of 200 ms. Within this time the noise floor estimator 30 does increase its estimate from a value practically equal to zero to the level of the anticipated strength of the noise source.
  • the estimator target signal dynamic range is expressed in decibels and specifies the increase in the noise floor estimate for a given estimator attack time.
  • An increment step size is determined by the target dynamic range which optimally matches the anticipated strength of the state-state noise source, divided by the time that the estimator will integrate the noise energy to reach the target or anticipated strength of noise source. The times that the estimator will integrate the noise source to reach this target equals the target attack time or estimator attack time divided by the integration time window (time period).
  • step size (target signal dynamic range * time period)/ target attack time.
  • the estimator integration time window involves the noise floor estimator 30 using a gliding window over the rectified signal energies for calculating the noise floor estimate for each analysis channel individually. Within this time it evaluates the incoming signal energy by comparing it with the current noise floor estimate on a channel by channel basis. Two increment counters record the instances of sampled energies which are above or below the current noise floor estimate. At the end of the integration time, a new noise floor estimate is calculated for each analysis channel based on the weighted results of the increment encounters. The new noise floor estimate is increased by the specified increment step size or decreased by the specified decrement step size.
  • the estimator increment step size is the amount by which the current noise floor estimate is increased leading to a new estimate, at the end of the integration time. It is generally expressed as a decimal number. In contrast, the estimator decrement factor is the factor by which the current noise floor estimate is arithmetically divided leading to a new estimate at the end of the integration time. This value is always equal to decimal 2.
  • the integration time window in turn equals an integer multiple of the channel energy sampling interval, where the integer is chosen in such a way that the integration time window exceeds the quasi-stationary duration of useful signal sources such as speech.
  • the integration window is between 60 and 100 ms.
  • the channel energy sampling interval is the time in which consecutive samples of the rectified signal energy of the analysis channels are periodically acquired. In one example, this is equal to 32 times the audio sampling interval, and thus amounts to approximately 2.5 ms.
  • the increment step size [(24* channel energy sampling interval)*target signal dynamic range]/estimator attack time
  • Estimate attack time is chosen to be 250 ms
  • the channel energy sampling interval is 2.5 ms
  • the target signal dynamic range equals 128 or equivalently 12 dB.
  • the calculated increment step size is approximately 30.

Landscapes

  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Neurosurgery (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Noise Elimination (AREA)

Abstract

A method and apparatus for estimating the noise floor in an audio signal having a first comparator (60) for receiving the audio signal and comparing a magnitude of samples of the audio signal with a current noise floor estimate. A first counter (62) is incremented by one for each new sample that has a magnitude greater than the current noise floor estimate (61) as determined by the first comparator. A second counter (63) is incremented by one for each new sample that has a magnitude less than the current noise floor estimate (61) as determined by the first comparator. A second comparator (64) compares the samples stored in the first counter with a threshold value, which if exceeded, initiates an increase in the noise floor estimate. The second comparator also compares the samples stored in the second counter with a second threshold value, which if exceeded, initiates a decrease in the noise floor estimate.

Description

NOISE FLOOR ESTIMATOR
Field of the Invention
The present invention relates to noise estimation in a number of channels in a received audio signal, and more particularly, relates to estimating the noise in any one of the channels in an audio signal received and processed by a cochlea implant system.
Background of the Invention
In an audio processor or speech processor, particularly in relation to hearing implant systems, audio signals are decomposed into sub-bands with each sub-band occupying a different frequency region within the audible spectrum. It is desirable to estimate long term stationary components or noise sources that are contained in the individual channels in real time. Such detection enables the reduction of audible environmental noises, such as car engine noise or fan noise or even various internal body noises presented to a cochlea implant recipient. It also enables the reduction of energy consumed in the electrical stimulation of these noises in the cochlea implant.
The noise sources, particularly in totally implantable cochlea implants, include external noises such as car engines or fan noise, as mentioned previously, or noise sources that are internal to the recipient which may include broadband noises such as heavy breathing, chewing or skin noises as well as narrowband noises such as the recipient's own voice. All these noises have a negative impact on the recipient intelligibility when listening to speech as they can partially or totally mask important parts in the speech spectrum. The degree of the degradation of these perceived signals depends on the instantaneous signal to noise ratio between the speech signal and the noise and the spectral characteristic of the noise itself.
Thus, it is desirable to detect the noise components in the individual channels of the audio processor, which processes the original speech signal, and exclude these from being used in electrical stimulation of the auditory nerves of the implant recipient. At the same time it allows for other channel energies, which contain useful speech information, to be presented for electrical stimulation of the auditory nerves.
Generally the sub-bands are output from a filter bank and may number up to twenty, one for each electrode in the electrode array of the implant. Prior to the signal being presented to the filter bank, it has already been converted from an analogue speech signal into digital form and pre-processed by a filter, such as a DC block filter. Summary of the Invention
According to a first aspect of the invention there is provided a method of estimating noise floors in an audio signal, the method comprising the steps of: determining a plurality of analysis channels of the audio signal; sampling each one of the analysis channels to determine a respective, sampled magnitude value; comparing each one of the respective, sampled magnitude values with a corresponding one of a current noise floor estimate; counting, for each one of the analysis channels, a number of times the sampled, magnitude value falls outside a predetermined limit for the corresponding one of a current noise floor estimate; and adjusting, for each one of the channels, the corresponding noise floor estimate if the counted number of samples exceeds a corresponding one of a threshold number.
The counting step may comprise counting a number of times a respective sampled, magnitude value is greater than the predetermined limit for the corresponding one of a current noise floor estimate, such that the method further comprises the step of increasing the corresponding one of the current noise floor estimate if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number. The method may further comprising the step of incrementing a first counter by one each time the respective sampled, magnitude value has a magnitude greater than the predetermined limit for the corresponding one of the current noise floor estimate following the comparing step.
The audio signal may comprise a number of analysis channels, each analysis channel having a bandwidth equivalent to a portion of a speech spectrum, analysed in a cochlea implant system.
The method may further comprise conducting the comparison step over a period of time on a channel-by-channel basis.
The counting step may comprise counting a number of times a respective sampled, magnitude value is less than the predetermined limit for the corresponding one of a current noise floor estimate, such that the method further comprises the step of decreasing the corresponding one of the current noise floor estimate if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number. The method may further comprise the step of incrementing a second counter by one each time the respective sampled, magnitude value has a magnitude less than the predetermined limit for the corresponding one of the current noise floor estimate after the comparing step. The audio signal may represent a number of analysis channels, each analysis channel having a bandwidth equivalent to a portion of the speech spectrum, analysed in a cochlea implant system.
According to a second aspect of the invention there is provided apparatus for estimating noise floors in an audio signal comprising: means for determining a plurality of analysis channels of the audio signal; means for sampling each one of the analysis channels to determine a respective, sampled magnitude value; comparator means for comparing each one of the respective, sampled magnitude values with a corresponding one of a current noise floor estimate; counter means for counting, for each one of the analysis channels, a number of times the sampled, magnitude value falls outside a predetermined limit for the corresponding one of a current noise floor estimate; wherein for each one of the channels, the corresponding noise floor estimate is adjusted if the counted number of samples exceeds a corresponding one of a threshold number.
The counter means may comprise a first counter for counting a number of times a respective sampled, magnitude value is greater than the predetermined limit for the corresponding one of a current noise floor estimate, such that the corresponding one of the current noise floor estimate is increased if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
The comparator means may be used to determine if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number. The first counter may be incremented by one each time the respective sampled, magnitude value has a magnitude greater than the predetermined limit for the corresponding one of the current noise floor estimate as determined by the comparator means.
The counter means may comprise a second counter for counting a number of times a respective sampled, magnitude value is less than the predetermined limit for the corresponding one of a current noise floor estimate, such that the corresponding one of the current noise floor estimate is decreased if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
The further comparator means may be used to determine if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
According to a third aspect of the invention there is provided a method of estimating the noise floor in an audio signal comprising the steps of: comparing the magnitude of samples of the audio signal with a current noise floor estimate; incrementing a first counter by one for each new sample having a magnitude greater than the current noise floor estimate; incrementing a second counter by one for each new sample having a magnitude less than the current noise floor estimate; further comparing the samples stored in the first counter with a first threshold value and comparing the samples stored in the second counter with a second threshold value.
According to a fourth aspect of the invention there is provided apparatus for estimating the noise floor in an audio signal comprising: first comparator means for receiving the audio signal and comparing a magnitude of samples of the audio signal with a current noise floor estimate; a first counter linked to the first comparator means which is incremented by one for each new sample that has a magnitude greater than the current noise floor estimate as determined by the first comparator means; a second counter linked to the first comparator means for incrementing by one for each new sample that has a magnitude less than the current noise floor estimate as determined by the first comparator means; a second comparator means for comparing the samples stored in the first counter with a first threshold value and for comparing the samples stored in the second counter with a second threshold value.
Brief Description of the Drawings
Preferred embodiments of the invention will hereinafter be described, by way of example only, with reference to the accompanying drawings wherein: Figure 1 is a schematic diagram illustrating the components involved in post processing in an audio processor of a cochlea implant system; Figure 2 is a schematic diagram showing portions of a noise floor estimator unit; and
Figure 3 is a flow diagram illustrating processes and principle steps in computing a noise floor estimate in a single channel of an audio signal. Figure 4 shows a series of wave forms involved with the signal processing block of an audio processor of a cochlear implant system and a graph of the estimated noise floor.
Detailed Description of a Preferred Embodiment Referring to Figure 1, there is shown a block diagram of part of an audio processor in a cochlea implant. Digital signals that have been converted from the original analogue speech signal via a front end or pre-processor are input to a filter bank 10 and in this particular example, a multi-rate filter bank or MRFB. The filter bank 10 analyses the received digital speech signal and splits the signal into N separate channels. Typically in a cochlea implant system there are 20 or 22 channels. Each channel is designed to have a bandwidth covering part of the spectrum of the received speech signal. Once the signal has been split up into N channels it is input to a further component 20 which makes gain adjustments and detects the envelope of each of the N channels. Each of the N channels are then input to a noise floor estimator 30 in order to estimate the noise floor of the audio channel according to the present invention. Each of the channels are then input to a threshold comparator 40 to enable a comparison to be made between the signal level on each channel and the estimated noise floor and then M out of the N channels are selected by a selection unit 50 on the basis of the comparison. The selected maxima M out of N channels are then forwarded to the loudness growth function (LGF). The selection of maxima on various channels out of the N original channels is the subject of a further invention and a co-pending Australian provisional application No 2003901538 to the same applicant. The primary focus of this invention is to provide an estimation of the noise floor and to adjust that noise floor depending on sampled values of the magnitude of each of the analysis channels. According to the present invention, the audio processor in a cochlea implant system (and more particularly in Totally Implanted Cochlea Implant Systems) employs a noise floor estimation on a channel-by-channel basis which tracks the instantaneous noise floor of each of the analysis channels. The channels are continuously evaluated against these estimates and are considered in the maxima search conducted by the unit 50 only if the magnitude of the channels exceed the current channel noise floor estimate.
Implementation of the noise floor estimator 30 is based on a dual-bin histogram measurement of the monitored magnitudes over time. Each analysis channel measures how often its magnitude lies above and below the current noise floor estimate within a certain time window. This is done by means of two incrementing counters in each analysis channel, as is to be discussed with reference to Figure 2. At the end of the window time, that is Win_T : [samples], the accumulated values of the two incrementing counters are compared against two fixed thresholds that are mutually exclusive to one another. The thresholds are defined as:
Cst_NO_Below_Est:=0.9*Win_T; and
Cst_NO_Above_Est:=0.3 * Win_T.
Referring to Figure 2 there is shown a part of noise floor estimator 30 whereby a channel to be analysed is input to a comparator 60 which compares the magnitude of the signal within that channel with the present noise floor estimate 61. This is performed over a window of time whereby a certain number of samples within the signal are analysed and compared with the current noise floor estimate 61. The comparison is made to find those instances where each samples magnitude values falls outside of a predetermined linit for the current noise floor estimate. In this example, the number of samples having a magnitude greater than the noise floor estimate is flagged and a first counter 62, termed the "Above" counter, is incremented by one for every sample that has its magnitude greater than the noise floor. After the window of time or the time interval has expired, the cumulative values in the counter 62 are compared against the second threshold identified above by a second comparator 64. In a different sampling period or time window, a number of samples of the input channel are compared for their magnitude against the present noise estimate 61 by comparator 60 and for those samples that have their magnitude below the present noise floor estimate, initiates a further counter 63, termed the "Below" counter, to increment by one each time the magnitude of a sample is measured to be below the present noise floor estimate. After the time interval has expired, the cumulative values stored in the counter 63 are compared with the first threshold identified above by comparator 60.
Thus with the case of the incrementing counter 62 that measures the magnitude occurrences that are above the noise estimate, where these exceed the value Cst_NO_Above_Est a new noise floor estimate is implemented and slowly tracks the increase. More particularly, the noise estimate is increased and may be increased by 16. With regard to the thresholds above, this essentially states that if this is more than 30% of the total number of samples in the integration window, as stored in the counter 62, the new noise floor estimate is increased and is slowly tracked such that:
Noise_Floor_Channel(i) = Noise_Floor_Channel(i) + 2
In the case where the incrementing counter 63, which measures the magnitude of the samples below the present noise estimate, if these exceed the threshold Cst_NO_Below_Est, a new noise floor estimate is implemented and a decrease is rapidly tracked such that:
Noise_Floor_Channel(i) = Noise_Floor_Channel(i) / 2.
Thus in essence, if more than 90% of the total number of samples in the integration window are stored in the counter 63 then a new noise floor which is decreased in value is used as the estimate for the noise floor, and more particularly is made to be half the present value for the noise floor estimate. Thus this is a way of boosting the number of samples having a magnitude greater than the noise floor. This in turn enhances the selection process by the unit 50 to establish the channels having various maxima to be selected to be thereby used in electrical stimulation of the auditory nerves.
With reference to Figure 3 there is shown a flow diagram outlining the various principle steps involved in computing the noise estimate in a single analysis channel. At step 80 the noise floor estimator 30 waits for new channel data to arrive at the comparator unit 60. Once received a determination is made at step 82 as to whether the time interval or window period has elapsed. If not the process moves to step 84 whereby a determination is made as to whether a particular sample has a magnitude greater than the present noise estimate. If yes, the counter 62 is incremented by one at step 86. If no, the counter 63 is incremented by one at step 88. Thereafter the integration time window is decremented by one at step 90 and the process returns to step 80 until the time interval over which the samples are taken has finished. Once this determination is made at step 82 the process moves to step 92 where a determination is made as to whether counter 63 has more than 90% of all samples sampled within a time interval or window time. If this is the case then the process moves to step 94 where a new noise estimate is implemented which is reduced by a factor of two. The process then moves to step 96 where the counter 63 is reset and the integration window time is also reset. Alternatively, in a separate analysis, if counter 62 has more than 30% of the values sampled in the time interval or window time, then a new noise estimate is increased by 16 and limited to an upper threshold at step 100. The process then moves back to step 96 where counter 62 is reset and the integration window time is reset as well. With reference to Figure 4 there is shown an example of the signals that are involved in the signal-processing block of the audio processor in the cochlear implant. The uppermost waveform 110 shows a raw signal output of an analysis channel assuming that there is a channel response to a signal-frequency signal within the frequency band of this channel. In the waveform 120 there is shown the rectified signal which effectively converts the raw signal in waveform 110 having a bipolar signal amplitude output into a unipolar signal amplitude. The envelope detector 20 smooths out the rectified signal by applying a low pass filter to the signal as shown in the envelope detector output waveform 130. Depicted in graph 140 is the noise floor estimate which includes an increment step size, a decrement factor, an estimator target dynamic range, an estimator attack time and an estimator integration window. The audio sampling interval is the time in which consecutive samples of the audio signal are periodically acquired and is inverse to the audio sampling frequency, which for example amounts to 13,000Hz and is thus around 77 μs.
The estimator attack time is the time within which the noise floor estimator 30 should increase its noise floor estimate for a given estimator target signal dynamic range. This time is generally specified in milliseconds. A typical target or estimator attack time for a long-term stationary noise source is in the order of 200 ms. Within this time the noise floor estimator 30 does increase its estimate from a value practically equal to zero to the level of the anticipated strength of the noise source. The estimator target signal dynamic range is expressed in decibels and specifies the increase in the noise floor estimate for a given estimator attack time. An increment step size is determined by the target dynamic range which optimally matches the anticipated strength of the state-state noise source, divided by the time that the estimator will integrate the noise energy to reach the target or anticipated strength of noise source. The times that the estimator will integrate the noise source to reach this target equals the target attack time or estimator attack time divided by the integration time window (time period).
Thus the increment step size is given by the following equation:
increment step size = (target signal dynamic range * time period)/ target attack time.
The estimator integration time window involves the noise floor estimator 30 using a gliding window over the rectified signal energies for calculating the noise floor estimate for each analysis channel individually. Within this time it evaluates the incoming signal energy by comparing it with the current noise floor estimate on a channel by channel basis. Two increment counters record the instances of sampled energies which are above or below the current noise floor estimate. At the end of the integration time, a new noise floor estimate is calculated for each analysis channel based on the weighted results of the increment encounters. The new noise floor estimate is increased by the specified increment step size or decreased by the specified decrement step size. The estimator increment step size is the amount by which the current noise floor estimate is increased leading to a new estimate, at the end of the integration time. It is generally expressed as a decimal number. In contrast, the estimator decrement factor is the factor by which the current noise floor estimate is arithmetically divided leading to a new estimate at the end of the integration time. This value is always equal to decimal 2.
The integration time window in turn equals an integer multiple of the channel energy sampling interval, where the integer is chosen in such a way that the integration time window exceeds the quasi-stationary duration of useful signal sources such as speech. Typically, the integration window is between 60 and 100 ms. The channel energy sampling interval is the time in which consecutive samples of the rectified signal energy of the analysis channels are periodically acquired. In one example, this is equal to 32 times the audio sampling interval, and thus amounts to approximately 2.5 ms.
From the above as an example where the integration time window is 60ms, the increment step size can be calculated as follows: Increment step size = [(24* channel energy sampling interval)*target signal dynamic range]/estimator attack time
An example calculation is where the estimator attack time is chosen to be 250 ms, the channel energy sampling interval is 2.5 ms and the target signal dynamic range equals 128 or equivalently 12 dB. The calculated increment step size is approximately 30.
It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive. For example, the method could be readily applied to an audio processor for other hearing prostheses, such as a hearing aid or middle ear mechanical transducer.

Claims

Claims
1. A method of estimating noise floors in an audio signal, the method comprising the steps of: determining a plurality of analysis channels of the audio signal; sampling each one of the analysis channels to determine a respective, sampled magnitude value; comparing each one of the respective, sampled magnitude values with a corresponding one of a current noise floor estimate; counting, for each one of the analysis channels, a number of times the sampled, magnitude value falls outside a predetermined limit for the corresponding one of a current noise floor estimate; and adjusting, for each one of the channels, the corresponding noise floor estimate if the counted number of samples exceeds a corresponding one of a threshold number.
2. A method according to claim 1 wherein the counting step comprises counting a number of times a respective sampled, magnitude value is greater than the predetermined limit for the corresponding one of a current noise floor estimate, such that the method further comprises the step of increasing the corresponding one of the current noise floor estimate if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
3. A method according to claim 2 further comprising the step of incrementing a first counter by one each time the respective sampled, magnitude value has a magnitude greater than the predetermined limit for the corresponding one of the current noise floor estimate following the comparing step.
4. A method according to claim 2 or claim 3 wherein the audio signal comprises a number of analysis channels, each channel in the number of analysis channels having a bandwidth equivalent to a portion of a speech spectrum and analysed in a cochlear implant system.
5. A method according to claim 4 further comprising the step of conducting the comparing step over a period of time on a channel-by-channel basis.
6. A method according to claim 5 wherein at the end of the time period the number stored in the first counter is compared with the threshold number and if the number stored exceeds the threshold number then a new increased noise floor estimate is calculated.
7. A method according to claim 6 wherein the new noise floor estimate is increased using an increment step size.
8. A method according to claim 7 further comprising the step of calculating the increment step size using the equation:
Increment step size = (target signal dynamic range * time period)/target attack time
wherein the signal dynamic range specifies the increase in the noise floor estimate for a given target attack time and the target attack time is the time within which the new noise floor estimate is reached for a given signal dynamic range.
9. A method according to claim 8 wherein the threshold number is 0.3 multiplied by the number stored in the first counter in the time period, such that if more than 30% of the samples have a magnitude greater than the current noise floor estimate then the new increased noise floor estimate is calculated.
10. A method according to claim 1 wherein the counting step comprises counting a number of times a respective sampled, magnitude value is less than the predetermined limit for the corresponding one of a current noise floor estimate, such that the method further comprises the step of decreasing the corresponding one of the current noise floor estimate if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
11. A method according to claim 10 further comprising the step of incrementing a second counter by one each time the respective sampled, magnitude value has a magnitude less than the predetermined limit for the corresponding one of the current noise floor estimate after the comparing step.
12. A method according to claim 10 or claim 11 wherein the audio signal comprises a number of analysis channels, each analysis channel having a bandwidth equivalent to a portion of a speech spectrum and analysed in a cochlear implant system.
13. A method according to claim 12 further comprising the step of conducting the comparing step over a period of time on a channel-by-channel basis.
14. A method according to claim 13 wherein at the end of the period of time, the number stored in the second counter is compared with the threshold number and if the number stored exceeds the threshold number, then a new decreased noise floor estimate is calculated.
15. A method according to claim 14 wherein the threshold number is 0.9 multiplied by the number stored in the second counter taken in the period of time, such that if more than 90 percent of the samples have a magnitude less than the current noise floor estimate then the new decreased noise floor estimate is calculated.
16. A method according to claim 15 wherein the new noise floor estimate is decreased using a decrement step size.
17. A method according to claim 16 wherein the decrement step size is 2.
18. Apparatus for estimating noise floors in an audio signal comprising: means for determining a plurality of analysis channels of the audio signal; means for sampling each one of the analysis channels to determine a respective, sampled magnitude value; comparator means for comparing each one of the respective, sampled magnitude values with a corresponding one of a current noise floor estimate; counter means for counting, for each one of the analysis channels, a number of times the sampled, magnitude value falls outside a predetermined limit for the corresponding one of a current noise floor estimate; wherein for each one of the channels, the corresponding noise floor estimate is adjusted if the counted number of samples exceeds a corresponding one of a threshold number.
19. Apparatus according to claim 18 wherein the counter means comprises a first counter for counting a number of times a respective sampled, magnitude value is greater than the predetermined limit for the corresponding one of a current noise floor estimate, such that the corresponding one of the current noise floor estimate is increased if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
20. Apparatus according to claim 19 wherein a further comparator means is used to determine if the counted number of times the respective sampled, magnitude value is greater than the predetermined limit exceeds the corresponding one of a threshold number.
21. Apparatus according to claim 20 wherein the first counter is incremented by one each time the respective sampled, magnitude value has a magnitude greater than the predetermined limit for the corresponding one of the current noise floor estimate as determined by the comparator means.
22. Apparatus according to claim 20 or claim 21 wherein the audio signal comprises a number of analysis channels, each analysis channel in the number of channels having a bandwidth equivalent to a portion of a speech spectrum and analysed in a cochlear implant system.
23. Apparatus according to claim 22 wherein the comparison of each one of the respective sampled, magnitude values with the current noise floor estimate by the comparator means is conducted over a period of time on a channel-by-channel basis.
24. Apparatus according to claim 23 wherein at the end of the time period, the number stored in the first counter is compared with the threshold number and if the number stored exceeds the threshold number then a new increased noise floor estimate is calculated.
25. Apparatus according to claim 24 wherein the new noise floor estimate is increased using an increment step size.
26. Apparatus according to claim 25 wherein the increment step size is calculated by the equation:
increment step size = (target signal dynamic range * time period)/target attack time
wherein the signal dynamic range specifies the increase in noise floor estimate for a given attack time and the attack time is the time within which the new noise floor estimate is reached for a given signal dynamic range.
27. Apparatus according to claim 26 wherein the threshold number is 0.3 multiplied by the number stored in the first counter taken in the time period, such that if more than 30 percent of the samples have a magnitude greater than the current noise floor estimate then the new increased noise floor estimate is calculated.
28. Apparatus according to claim 18 wherein the counter means comprises a second counter for counting a number of times a respective sampled, magnitude value is less than the predetermined limit for the corresponding one of a current noise floor estimate, such that the corresponding one of the current noise floor estimate is decreased if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
29. Apparatus according to claim 28 wherein a further comparator means is used to determine if the counted number of times the respective sampled, magnitude value is less than the predetermined limit exceeds the corresponding one of a threshold number.
30. Apparatus according to claim 29 wherein the second counter is incremented by one each time the respective sampled, magnitude value has a magnitude less than the predetermined limit for the corresponding one of the current noise floor estimate as determined by the comparator means.
31. Apparatus according to claim 29 or claim 30 wherein the audio signal comprises a number of analysis channels, each analysis channel having a bandwidth equivalent to a portion of a speech spectrum and analysed in a cochlear implant system.
32. Apparatus according to claim 31 wherein the comparison of each one of the respective sampled, magnitude values with the current noise floor estimate by the comparator means is conducted over a period of time on a channel-by-channel basis.
33. Apparatus according to claim 32 wherein at the end of the period of time, the number stored in the second counter is compared with the threshold number and if the number stored exceeds the threshold number, then a new decreased noise floor estimate is calculated.
34. Apparatus according to claim 33 wherein the threshold number is 0.9 multiplied by the number stored in the second counter taken in the period of time, such that if more than 90 percent of the samples have a magnitude less than the current noise floor estimate then the new decreased noise floor estimate is calculated.
35. Apparatus according to claim 34 wherein the new noise floor estimate is decreased using a decrement step size.
36. Apparatus according to claim 35 wherein the decrement step size is 2.
37. A method of estimating the noise floor in an audio signal comprising the steps of: comparing the magnitude of samples of the audio signal with a current noise floor estimate; incrementing a first counter by one for each new sample having a magnitude greater than the current noise floor estimate; incrementing a second counter by one for each new sample having a magnitude less than the current noise floor estimate; further comparing the samples stored in the first counter with a first threshold value and comparing the samples stored in the second counter with a second threshold value.
38. A method according to claim 37 wherein if the number of samples stored in the first counter over a period of time exceeds the first threshold value, the method further comprises the step of increasing the current noise floor estimate.
39. A method according to claim 37 wherein if the number of samples stored in the second counter over a period of time exceeds the second threshold value, the method further comprises the step of decreasing the current noise floor estimate.
40. Apparatus for estimating the noise floor in an audio signal comprising: first comparator means for receiving the audio signal and comparing a magnitude of samples of the audio signal with a current noise floor estimate; a first counter linked to the first comparator means which is incremented by one for each new sample that has a magnitude greater than the current noise floor estimate as determined by the first comparator means; a second counter linked to the first comparator means for incrementing by one for each new sample that has a magnitude less than the current noise floor estimate as determined by the first comparator means; a second comparator means for comparing the samples stored in the first counter with a first threshold value and for comparing the samples stored in the second counter with a second threshold value.
41. Apparatus according to claim 40 wherein if the number of samples stored in the first counter over a period of time exceeds the first threshold value then the current noise floor estimate is increased.
42. Apparatus according to claim 40 wherein if the number of samples stored in the second counter over a period of time exceeds the second threshold value, the current noise floor estimate is decreased.
PCT/AU2004/000390 2003-03-28 2004-03-29 Noise floor estimator WO2004086361A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AU2003901539A AU2003901539A0 (en) 2003-03-28 2003-03-28 Noise floor estimator
AU2003901539 2003-03-28

Publications (1)

Publication Number Publication Date
WO2004086361A1 true WO2004086361A1 (en) 2004-10-07

Family

ID=31500582

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2004/000390 WO2004086361A1 (en) 2003-03-28 2004-03-29 Noise floor estimator

Country Status (2)

Country Link
AU (1) AU2003901539A0 (en)
WO (1) WO2004086361A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108883274A (en) * 2016-02-29 2018-11-23 领先仿生公司 The system and method for determining behavioral audiogram value for using the response of induction
CN111811561A (en) * 2020-06-29 2020-10-23 南京中探海洋物联网有限公司 Method for measuring background noise of optical fiber sensor demodulation device
CN113280912A (en) * 2021-06-09 2021-08-20 湛江港(集团)股份有限公司 Industrial enterprise factory boundary multidimensional noise monitoring system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0459364B1 (en) * 1990-05-28 1996-08-14 Matsushita Electric Industrial Co., Ltd. Noise signal prediction system
EP0750291B1 (en) * 1986-06-02 1999-08-04 BRITISH TELECOMMUNICATIONS public limited company Speech processor

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0750291B1 (en) * 1986-06-02 1999-08-04 BRITISH TELECOMMUNICATIONS public limited company Speech processor
EP0459364B1 (en) * 1990-05-28 1996-08-14 Matsushita Electric Industrial Co., Ltd. Noise signal prediction system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108883274A (en) * 2016-02-29 2018-11-23 领先仿生公司 The system and method for determining behavioral audiogram value for using the response of induction
CN108883274B (en) * 2016-02-29 2022-03-18 领先仿生公司 System and method for determining behavioral audiogram values using evoked responses
CN111811561A (en) * 2020-06-29 2020-10-23 南京中探海洋物联网有限公司 Method for measuring background noise of optical fiber sensor demodulation device
CN111811561B (en) * 2020-06-29 2023-03-28 南京中探海洋物联网有限公司 Method for measuring background noise of optical fiber sensor demodulation device
CN113280912A (en) * 2021-06-09 2021-08-20 湛江港(集团)股份有限公司 Industrial enterprise factory boundary multidimensional noise monitoring system
CN113280912B (en) * 2021-06-09 2024-03-05 湛江港(集团)股份有限公司 Multi-dimensional noise monitoring system for industrial enterprise factory

Also Published As

Publication number Publication date
AU2003901539A0 (en) 2003-05-01

Similar Documents

Publication Publication Date Title
CA2203395C (en) Automatic sensitivity control
US7444280B2 (en) Emphasis of short-duration transient speech features
EP0326905B1 (en) Hearing aid signal-processing system
CA2385390C (en) Method and signal processor for intensification of speech signal components in a hearing aid
US7171272B2 (en) Sound-processing strategy for cochlear implants
US11783845B2 (en) Sound processing with increased noise suppression
EP1129448B1 (en) System for measuring signal to noise ratio in a speech signal
US9780747B2 (en) Feature-based level control using loudness growth functions
DE102009043775A1 (en) Hearing device i.e. combined hearing and tinnitus masker device, adjusting method, involves analyzing speech signal for recognizing emotional state of user and adjusting parameter of hearing device as function of recognized emotional state
WO2004086361A1 (en) Noise floor estimator
US20040175011A1 (en) Signal processing in a hearing aid
CN113257268B (en) Noise reduction and single-frequency interference suppression method combining frequency tracking and frequency spectrum correction
CN111341337B (en) Sound noise reduction algorithm and system thereof
EP0441936B1 (en) Noise suppression circuits
AU777832B2 (en) Emphasis of short-duration transient speech features
JPH04501647A (en) Noise suppression circuit
Leek et al. Auditory filters in noise‐masked normal and hearing‐impaired listeners

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase