EP2737477A2 - Audio signal processing method and audio signal processing apparatus therefor - Google Patents
Audio signal processing method and audio signal processing apparatus thereforInfo
- Publication number
- EP2737477A2 EP2737477A2 EP12820823.8A EP12820823A EP2737477A2 EP 2737477 A2 EP2737477 A2 EP 2737477A2 EP 12820823 A EP12820823 A EP 12820823A EP 2737477 A2 EP2737477 A2 EP 2737477A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- audio signal
- frequency band
- input audio
- signal
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03F—AMPLIFIERS
- H03F3/00—Amplifiers with only discharge tubes or only semiconductor devices as amplifying elements
- H03F3/20—Power amplifiers, e.g. Class B amplifiers, Class C amplifiers
- H03F3/21—Power amplifiers, e.g. Class B amplifiers, Class C amplifiers with semiconductor devices only
- H03F3/217—Class D power amplifiers; Switching amplifiers
- H03F3/2173—Class D power amplifiers; Switching amplifiers of the bridge type
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03F—AMPLIFIERS
- H03F3/00—Amplifiers with only discharge tubes or only semiconductor devices as amplifying elements
- H03F3/20—Power amplifiers, e.g. Class B amplifiers, Class C amplifiers
- H03F3/21—Power amplifiers, e.g. Class B amplifiers, Class C amplifiers with semiconductor devices only
- H03F3/217—Class D power amplifiers; Switching amplifiers
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M3/00—Conversion of analogue values to or from differential modulation
- H03M3/30—Delta-sigma modulation
- H03M3/322—Continuously compensating for, or preventing, undesired influence of physical parameters
- H03M3/358—Continuously compensating for, or preventing, undesired influence of physical parameters of non-linear distortion, e.g. instability
- H03M3/36—Continuously compensating for, or preventing, undesired influence of physical parameters of non-linear distortion, e.g. instability by temporarily adapting the operation upon detection of instability conditions
- H03M3/366—Continuously compensating for, or preventing, undesired influence of physical parameters of non-linear distortion, e.g. instability by temporarily adapting the operation upon detection of instability conditions in feed-forward mode, e.g. using look-ahead circuits
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M3/00—Conversion of analogue values to or from differential modulation
- H03M3/30—Delta-sigma modulation
- H03M3/458—Analogue/digital converters using delta-sigma modulation as an intermediate step
Definitions
- Apparatuses and methods consistent with the present disclosure relate to audio signal processing and, more particularly, to audio signal processing of sigma-delta modulation of an input audio signal.
- Class A, B, C, and Class D amplifiers are used to receive audio signals and output audibly perceptible signals.
- a Class D amplifier reduces deterioration in amplification efficiency that occur in class A, B, and C amplifiers.
- the Class D amplifier exhibits higher amplification efficiency than class A, B, and C amplifiers. Thus the Class D amplifier is widely used.
- a Class D amplifier is a digital amplifier that modulates analogously input audio signals to produce digital audio signals, and amplifies and output digitally modulated audio signals.
- Digital amplifiers have no data conversion loss and achieve amplification efficiency of 100 % theoretically and thus are widely used.
- Digital amplifiers modulate input audio signals to produce pulse signals and amplify the pulse signals.
- Sigma-delta modulation may be used to modulate audio signals to produce pulse signals.
- a modulator using sigma-delta modulation is referred to as a sigma-delta modulator.
- a high order sigma-delta modulator may be used to enhance noise shaping.
- a high order sigma-delta modulator accumulates signal values, which causes a large amount of oscillation to occur as the order of the sigma-delta modulator increases.
- the occurrence of oscillation may hinder the ability of the sigma-delta modulators to perform modulation operations, and thus an operation stability of sigma-delta modulator may not be secured.
- An aspect of the present disclosure provides an audio signal processing method of securing operation stability during sigma-delta modulation, and an audio signal processing apparatus therefor.
- Another aspect of the present disclosure is to provide an audio signal processing method of precisely detecting stability of an input audio signal so as to secure operation stability during sigma-delta modulation, and an audio signal processing apparatus therefor.
- Another aspect of the present disclosure is to provide an audio signal processing method of providing an increased signal to noise ratio (SNR) while providing high stability, and an audio signal processing apparatus therefor.
- SNR signal to noise ratio
- an audio signal processing apparatus including a stability determining unit that compares a level of an input audio signal for each of at least one sub-frequency band with a threshold for the sub-frequency band, and generates a stability determination signal according to a result of the comparison; and a sigma-delta modulation unit that sigma-delta modulates the input audio signal according to the stability determination signal, and outputs a first modulation signal.
- Each of the at least one sub-frequency band may have a different threshold which is set for each sub-frequency band as a value in proportion to a frequency value the sub-frequency band.
- the apparatus may further include a delay unit that receives the input audio signal, compensates the input audio signal for a time taken to determine stability in the stability determining unit, and outputs the compensated input audio signal to the sigma-delta modulation unit.
- the stability determining unit may determine the input audio signal in a sub-frequency band to be unstable if a level of the input audio signal in the sub-frequency band is equal to or greater than the threshold for the sub-frequency band, and may set a level of the stability determination signal to indicate that the input audio signal is unstable.
- the stability determining unit may include a detecting unit that divides a frequency band of the input audio signal into the at least one sub-frequency band, and compares the level of the input audio signal for each of the at least one sub-frequency band with the threshold for the sub-frequency band; and an adjusting unit that determines stability of the input audio signal and generates the stability determination signal according to the result of the comparisons.
- the sigma-delta modulation unit may include a loop filter that integrates the input audio signal and outputs the integrated input audio signal; and a quantization unit that quantizes the output signal of the loop filter and generates the first modulation signal.
- the sigma-delta modulation unit may further include a feedback loop that feeds back the first modulation signal and outputs a first feedback signal; and a summing unit that subtracts the feedback signal from the input audio signal and outputs the subtracted input audio signal.
- the detecting unit may include a signal level detecting unit that divides the frequency band of the input audio signal into a plurality of sub-frequency bands, and compares the input audio signal for each of the plurality of sub-frequency bands with the threshold for the sub-frequency band for a period; and a counter unit that accumulates a result of the comparison over the period.
- the detecting unit may include a frequency converting unit that converts the input audio signal into a frequency band signal; and a level detecting unit that compares the level of the input audio signal for each of the at least one sub-frequency band with the threshold for the sub-frequency band by using the frequency band signal.
- the apparatus may further include a driving signal generating unit that generates at least one driving signal used to control a switching amplifying operation according to the first modulation signal; and a power switching amplifier including at least one switching device that turns on or off in response to a corresponding one of the at least one driving signal, performing the switching amplifying operation, and outputting an amplified audio signal corresponding to the input audio signal by using the at least one switching device, wherein the at least one switching device includes at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- a driving signal generating unit that generates at least one driving signal used to control a switching amplifying operation according to the first modulation signal
- a power switching amplifier including at least one switching device that turns on or off in response to a corresponding one of the at least one driving signal, performing the switching amplifying operation, and outputting an amplified audio signal corresponding to the input audio signal
- the apparatus may further include a feedback loop that outputs a feedback signal obtained by attenuating and delaying the amplified audio signal to the sigma-delta modulation unit in order to compensate for at least one of a delay and a gain of the amplified audio signal.
- the stability determining unit may generate the stability determination signal such that at least one of a signal-to-noise ratio (SNR) value and a stability value of the sigma-delta modulation unit is adjusted according to the result of the comparison.
- SNR signal-to-noise ratio
- the stability determining unit may generate the stability determination signal in such a way that at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit is adjusted according to the result of the comparison.
- NTF noise transfer function
- the stability determining unit may generate the stability determination signal of a first level if the level of the input audio signal in a sub-frequency band of the at least one sub-frequency band is equal to or greater than the threshold for the sub-frequency band, and generates the stability determination signal of a second level if the level of the input audio signal in the sub-frequency band is less than the threshold for the sub-frequency band.
- the sigma-delta modulation unit may receive the stability determination signal of the first level and adjusts at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit such that oscillation that occurs during sigma-delta modulation is reduced.
- NTF noise transfer function
- the sigma-delta modulation unit may receive the stability determination signal of the second level and adjusts at least one of the coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit such that a signal-to-noise ratio (SNR) value of the sigma-delta modulation unit increases.
- NTF noise transfer function
- SNR signal-to-noise ratio
- an audio signal processing method including dividing a frequency band of an input audio signal into at least one sub-frequency band; comparing a level of the input audio signal for each of the at least one sub-frequency band with a threshold for the sub-frequency band; generating a stability determination signal according to a result of the comparing; performing sigma-delta modulation on the input audio signal according to the stability determination signal; and outputting the sigma-delta modulated signal as a first modulation signal.
- An audio signal processing apparatus can precisely detect a stability of an input audio signal so as to secure operation stability during sigma-delta modulation.
- n audio signal processing apparatus can increase signal to noise ratio (SNR) with high stability.
- SNR signal to noise ratio
- FIG. 1 is a block diagram of an audio signal processing apparatus according to an exemplary embodiment
- FIG. 2 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment
- FIGS. 3A and 3B are graphs for explaining oscillation that occurs during sigma-delta modulation
- FIG. 4 is a graph for explaining a threshold value for each frequency band used in an audio signal processing apparatus according to an exemplary embodiment
- FIG. 5 is a block diagram of a stability determination unit of FIG. 1;
- FIG. 6 is a detailed block diagram of a stability determination unit of FIG. 1;
- FIG. 7 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment.
- FIGS. 8A and 8B are detailed diagrams of a power switching amplifier of FIG. 7;
- FIG. 9 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment.
- FIG. 10 is a detailed diagram of a sigma-delta modulation unit of FIG. 2;
- FIG. 11 is a graph for explaining an operation of an audio signal processing apparatus according to an exemplary embodiment.
- FIG. 12 is a flowchart of an audio signal processing method according to an exemplary embodiment.
- a sigma-delta modulator performs shaping on a noise component included in an input audio signal by pushing the noise component to outside portion of a frequency band according to the characteristics of a noise transfer function (NTF).
- NTF noise transfer function
- Noise shaping of the NTF is influenced by an order of the sigma-delta modulator. More specifically, the higher the order of the sigma-delta modulator, the closer to the outside portion of the frequency band to which noise is pushed during the noise shaping. Accordingly, the higher the order of the sigma-delta modulator, the higher the signal to noise ratio (SNR).
- SNR signal to noise ratio
- a level of an input signal is greater than a specific threshold according to feedback characteristics of the sigma-delta modulator, oscillation occurs during sigma-delta modulation. If oscillation occurs, the sigma-delta modulator does not operate normally, and thus stability of a system deteriorates.
- Enhancement of the SNR is inversely proportional to the stability of the system. That is, if a high order sigma-delta modulator is designed to enhance the SNR, the stability of the system deteriorates, which increases a probability of oscillation. Furthermore, if a low order sigma-delta modulator is designed to increase the stability of the system, the SNR is reduced.
- expressions such as at least one of , when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
- FIG. 1 is a block diagram of an audio signal processing apparatus 100 according to an exemplary embodiment.
- the audio signal processing apparatus 100 of the present exemplary embodiment includes a stability determination unit 110 and a sigma-delta modulation unit 130.
- the stability determination unit 110 may divide a frequency band of an input audio signal Sin into at least one sub-frequency band.
- the stability determination unit 110 compares a level of the input audio signal Sin for the sub-frequency bands with a threshold for the sub-frequency band.
- the stability determination unit 110 generates a stability determination signal Sm according to a comparison result.
- the threshold may be a lower limit value of an input audio signal level at which oscillation occurs during sigma-delta modulation.
- the input audio signal Sin may be determined as a stable signal.
- the level of the input audio signal Sin is equal to or greater than the threshold for the sub-frequency band, the input audio signal Sin may be determined as an unstable signal.
- the stability determination unit 110 divides the frequency band of the input audio signal Sin into a number (N) of sub-frequency bands. Each of the N sub-frequency bands has an associated threshold. Thus, for N sub-frequency bands, there are N thresholds.
- the stability determination unit 110 compares the input audio signal Sin of the first sub-frequency band with a threshold for the first sub-frequency band. Then the stability determination unit 110 compares the input audio signal Sin of the second sub-frequency band with a threshold for the second sub-frequency band, and so forth.
- the threshold may differ according to coefficients of a noise transfer function (NTF) of the sigma-delta modulation unit 130. More specifically, the characteristics of the NTF, which include pole and zero values of the NTF, may differ according to a design specification of the sigma-delta modulation unit 130. In this regard, values used to determine the characteristics of the NTF, including the pole and zero values of the NTF, may be coefficients of the NTF. Furthermore, if the pole and zero values of the NTF are adjusted, an oscillation degree of the sigma-delta modulation unit 130 may be adjusted. Thus, the threshold may be experimentally optimized and designed in terms of the design specification of the sigma-delta modulation unit 130.
- NTF noise transfer function
- the stability determination unit 110 may determine the input audio signal Sin in the frequency band to be unstable.
- the stability determination unit 110 may generate a signal level of the stability determination signal Sm as a first level if the level of the input audio signal Sin is equal to or greater than the threshold, and may generate the signal level of the stability determination signal Sm as a second level if the level of the input audio signal Sin is less than the threshold.
- the sigma-delta modulation unit 130 performs sigma-delta modulation (SDM) on the input audio signal Sin according to the stability determination signal Sm transmitted from the stability determination unit 110 and outputs a first modulation signal Sout1. Accordingly, the first modulation signal Sout1 is generated after being pulse modulated corresponding to the input audio signal Sin.
- SDM sigma-delta modulation
- the sigma-delta modulation unit 130 may have an order that may differ according to the number of integrators included in the sigma-delta modulation unit 130.
- the sigma-delta modulation unit 130 may have an order that varies according to the first modulation signal Sout1 transmitted from the stability determination unit 110.
- the audio signal processing apparatus 100 of the present exemplary embodiment divides the frequency band of the input audio signal Sin into at least one sub-frequency band, and separately determines stability of the input audio signal Sin for the at least one sub-frequency band, thereby precisely determining stability of the input audio signal Sin. Accordingly, the SNR for each frequency band may be enhanced as much as possible while the stability of the sigma-delta modulation unit 130 is maintained.
- FIG. 2 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment .
- the audio signal processing apparatus 200 may further include at least one of a delay unit 220 and a feedback loop 240, compared to the audio signal processing apparatus 100 of FIG. 1.
- a stability determination unit 210 and a sigma-delta modulation unit 230 included in the audio signal processing apparatus 200 of FIG. 2 may correspond to the stability determination unit 110 and the sigma-delta modulation unit 130 included in the audio signal processing apparatus 100 of FIG. 1. Thus, redundant descriptions will not be repeated here.
- the delay unit 220 may transmit the input audio signal Sin, and compensate for a time taken to determine stability of the input audio signal Sin in the stability determination unit 210. Accordingly, the delay unit 220 outputs the input audio signal Sin for which the time is compensated, to the sigma-delta modulation unit 230.
- the delay unit 220 may delay the input audio signal Sin by the time t1, and transmit the input audio signal Sin delayed by the time t1 to the sigma-delta modulation unit 230.
- the stability determination unit 210 may include a detecting unit 211 and an adjusting unit 212.
- the detecting unit 211 divides a frequency band of the input audio signal Sin into at least one sub-frequency band, and compares a level of the input audio signal Sin for each sub-frequency band with a corresponding threshold. That is, the detecting unit 211 may perform N comparison operations if the frequency band of the input audio signal Sin is divided into N sub-frequency bands.
- the adjusting unit 212 determines the stability of the input audio signal Sin according to the comparison result of the detecting unit 211 and generates the stability determination signal Sm corresponding to the determination of stability.
- the sigma-delta modulation unit 230 may include a loop filter 231 and a quantization unit 232.
- the loop filter 231 includes at least one integrator (not shown), and integrates and outputs the input audio signal Sin.
- the loop filter 231 performs noise shaping on noise included in the input audio signal Sin to push the noise to an outband of a frequency band according to a NTF.
- the quantization unit 232 receives a signal output from the loop filter 231, quantizes the received signal, and generates the first modulation signal Sout1 in a pulse signal form.
- the sigma-delta modulation unit 230 may further include the feedback loop 240 and a summing unit 250.
- the feedback loop 240 feeds back the first modulation signal Sout1 and outputs a feedback signal Sout2.
- the summing unit 250 subtracts the first feedback signal Sout2 from the input audio signal Sin and outputs an adjusted input audio signal Sin2 to the loop filter 231. If the audio signal processing apparatus 200 includes the delay unit 220, the summing unit 250 may subtract the first feedback signal Sout2 from a delayed input audio signal Sin1 and output the subtracted signal to the loop filter 231.
- the sigma-delta modulation unit 230 may adjust at least one of a gain and a phase of the input audio signal Sin or Sin1 of the sigma-delta modulation unit 230 in view of a gain and a phase of the output signal of the sigma-delta modulation unit 230. Accordingly, the sigma-delta modulation unit 230 may perform precise gain control in accordance with a target gain or a regular maximum output of the audio signal processing apparatus 200.
- FIGS. 3A and 3B are graphs for explaining oscillation that occurs during sigma-delta modulation.
- FIG. 3A is a graph for explaining oscillation that occurs in a low frequency band.
- FIG. 3B is a graph for explaining oscillation that occurs in a high frequency band.
- an X axis indicates time
- a y axis indicates an amplitude of oscillation. If sigma-delta modulation is performed on an input audio signal having a predetermined level in the low frequency band, an intensity of oscillation rapidly increases over time.
- an X axis indicates time
- a y axis indicates an amplitude of oscillation. If sigma-delta modulation is performed on an input audio signal having a predetermined level in the high frequency band, oscillation proceeds at regular amplitude without a rapid increase.
- the intensity of oscillation differs according to frequency bands with respect to the input audio signal having the same signal level. More specifically, in FIG. 3A, amplitude of oscillation rapidly increases after a time t1 and exceeds a range of -1*100000 and 1*100000 in a low frequency region, whereas the amplitude of oscillation is generally between the range of -1*100000 and 1*100000 in a high frequency region.
- input audio signals having the same signal level show that an intensity of oscillation for each frequency band differs, and amplitude of oscillation further increases in a low frequency region.
- FIG. 4 is a graph for explaining a threshold value for each frequency band used in an audio signal processing apparatus according to an exemplary embodiment.
- the audio signal processing apparatuses 100 and 200 may set a threshold differently according to the sub-frequency bands when determining stability of the input audio signal Sin.
- the threshold may be set in proportion to frequency values of sub-frequency bands.
- first through Nth thresholds corresponding to first through Nth sub-frequency bands, respectively have different values.
- An example is illustrated in FIG. 4.
- an x axis indicates a frequency band of an input audio signal 420
- a y axis indicates a value of a threshold 410.
- a frequency band of the input audio signal 420 is divided into first through third sub-frequency bands.
- the first through third sub-frequency bands may have a same length or different lengths in the X axis.
- a first threshold Th1 is set for the first sub-frequency band having 0 through f1 frequency values
- a second threshold Th2 is set for the second sub-frequency band having f1 through f2 frequency values
- a third threshold Th3 is set for the third sub-frequency band having f2 through f3 frequency values.
- the input audio signal 420 in the first frequency band may be determined as an unstable signal.
- the signal level of the input audio signal 420 in the third frequency band is equal to or greater than the third threshold Th3
- the input audio signal 420 in the third frequency band may be determined as an unstable signal.
- FIG. 5 is a block diagram of a stability determination unit 510 of FIG. 1.
- the stability determination unit 510 of FIG. 5 may correspond to the stability determination unit 110 of FIG. 1 or the stability determination unit 210 of FIG. 2.
- a detecting unit 511 and an adjusting unit 512 may correspond to the detecting unit 211 and the adjusting unit 212 of FIG. 2. Thus, redundant descriptions thereof will not be repeated here.
- the detecting unit 511 may include a signal level detecting unit 530 and a counter unit 540.
- the signal level detecting unit 530 divides a frequency band of the input audio signal Sin into a plurality of sub-frequency bands, and compares the input audio signal Sin for each sub-frequency band with a threshold corresponding to the frequency band for a period.
- the frequency band of the input audio signal Sin is divided into first through Nth sub-frequency bands.
- the signal level detecting unit 530 may include first through Nth level detecting units 531, 532, 533, and 534 that perform a determination operation for respective sub-frequency bands.
- the first level detecting unit 531 receives the input audio signal Sin and determines whether a level of the input audio signal Sin in a first sub-frequency band is equal to or greater than a first threshold. Such a determination may be performed for a period T1.
- the counter unit 540 counts results of determination performed by the signal level detecting unit 530 over the period T1.
- the counter unit 540 may include first through Nth section counters 541, 542, 543, and 544 that perform counting operations for respective sub-frequency bands.
- the first section counter 541 may receive the determination result of the first level detecting unit 531 over the period T1, and count the number of times the level of the input audio signal in the first sub-frequency band is equal to or greater than the first threshold. For example, if a counting period of the counter unit 540 is 20*T1, and the number of times the level of the input audio signal Sin in the first sub-frequency band is equal to or greater than the first threshold is 10, the first section counter 541 may transmit the counting number, i.e. 10, to the adjusting unit 512.
- the adjusting unit 512 determines stability of the input audio signal Sin according to the counting number output by the counter unit 540. For example, if the number of times the level of the input audio signal Sin in a sub-frequency band is equal to or greater than the corresponding threshold for the sub-frequency band exceeds a threshold rate for the whole counting period, for example, 20% of 20 times, the adjusting unit 512 may determine the input audio signal Sin in the corresponding sub-frequency band to be in an unstable state.
- a reference counting number used to determine the stability of the input audio signal Sin may be set differently according to a product specification such as operation reliabilities of the audio signal processing apparatus.
- the adjusting unit 512 may generate the stability determination signal Sm having a first signal level if the input audio signal Sin is determined to be unstable, and may generate the stability determination signal Sm having a second signal level if the input audio signal Sin is determined to be stable.
- the adjusting unit 512 may determine the stability of the input audio signal Sin for each sub-frequency band, and output the stability determination signal Sm as a first signal level if the adjusting unit 512 determines the input audio signal Sin to be unstable at any one of sub-frequency bands.
- the adjusting unit 512 may determine the stability of the input audio signal Sin for each sub-frequency band, and output the stability determination signal Sm as the first signal level only when the adjusting unit 512 determines the input audio signal Sin to be unstable in all of the whole sub-frequency bands.
- the adjusting unit 512 may determine the stability of the input audio signal Sin for each sub-frequency band, and output the stability determination signal Sm as the first signal level if the adjusting unit 512 determines the input audio signal Sin to be unstable in one or more sub-frequency bands corresponding to low frequencies.
- FIG. 6 is a detailed block diagram of a stability determination unit of FIG. 1.
- the stability determination unit 610 of FIG. 6 may correspond to the stability determination unit 110 of FIG. 1 or the stability determination unit 210 of FIG. 2.
- a detecting unit 611 and an adjusting unit 612 may correspond to the detecting unit 211 and the adjusting unit 212 of FIG. 2. Thus, redundant descriptions will not be repeated here.
- the detecting unit 611 may include a frequency converting unit 630 and a level detecting unit 640.
- the frequency converting unit 630 converts the input audio signal Sin into a frequency band signal. More specifically, the frequency converting unit 630 may perform fast Fourier transformation (FFT) on the input audio signal Sin. More specifically, the frequency converting unit 630 converts a number of designated samples into frames and performs FFT on the input audio signal Sin for each frame.
- the frequency converting unit 630 may transmit frequency spectrum information generated by performing the FFT to the level detecting unit 640.
- the frequency spectrum information is information regarding a level of the input audio signal Sin for each frequency, and thus if the input audio signal Sin is converted into the frequency band signal, the level of the input audio signal Sin for each frequency may be recognized.
- the level detecting unit 640 compares the level of the input audio signal Sin for each sub-frequency band with a corresponding threshold for the sub-frequency band by using the frequency band signal converted from the input audio signal Sin by the frequency converting unit 630.
- the adjusting unit 612 receives a comparison result for each sub-frequency band from the level detecting unit 640, determines stability of the input audio signal Sin, and generates the stability determination signal Sm having a first or second level.
- the operation of the adjusting unit 612 is the same as that of the adjusting unit 512 of FIG. 5, and thus a detailed description thereof will be omitted here. While a first and second level are described, one of ordinary skill in the art will appreciate that more than two levels may be used.
- FIG. 7 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment.
- the audio signal processing apparatus 700 may further include at least one of a feedback loop 740, a driving signal generating unit 760, a power switching amplifier 770, a low pass filter 780, and a speaker unit 790.
- a stability determining unit 710 and a sigma-delta modulation unit 730 of the audio signal processing apparatus 700 may correspond to the stability determining units 110 and 210, and the sigma-delta modulation units 130 and 230 of the audio signal processing apparatuses 100 and 200 of FIGS. 1 and 2, respectively.
- a delay unit 720 of the audio signal processing apparatus 700 may correspond to the delay unit 220 of FIG. 2. Thus, redundant descriptions thereof will not be repeated here.
- the driving signal generating unit 760 receives the first modulation signal Sout1, and generates at least one driving signal CON for controlling a switching amplifying operation according to the input audio signal Sin and the first modulation signal Sout1.
- the switching amplifying operation is performed by using at least one switching device (not shown) included in the power switching amplifier 770.
- the driving signal CON is a switching control signal used to control the switching device (not shown) to be turned on or off.
- the driving signal CON is transmitted to the power switching amplifier 770.
- the power switching amplifier 770 performs the switching amplifying operation and includes at least one switching device (not shown) that turns on or off in response to the driving signal CON.
- the power switching amplifier 770 outputs an amplified audio signal Sout corresponding to the input audio signal Sin by using the switching device (not shown).
- the amplifying audio signal Sout may be a signal obtained by amplifying the amplitude of the first modulation signal Sout1.
- the power switching amplifier 770 may amplify the first modulation signal Sout1 in such a way that the audio signal Sin input to the audio signal processing apparatus 700 may be output in accordance with a regular maximum output.
- the switching device (not shown) included in the power switching amplifier 770 may include at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- GaN gallium nitride
- GaAs gallium arsenide
- SiC silicon carbide
- the gallium nitride (GaN) transistor and the gallium arsenide (GaAs) transistor have a short propagation delay and operate at high speed at a high voltage.
- the propagation delay indicates a time taken to input the driving signal CON that turns a corresponding transistor on to a gate of the transistor and to output a saturated voltage signal to a source end or a drain end that is an output end of the transistor.
- the power switching amplifier 770 may perform a switching operation at high speed. Accordingly, switching noise may be minimized, thereby reducing an SNR of the audio signal processing apparatus 700. Furthermore, a signal may be quickly amplified at a high voltage, thereby increasing a maximum output of the audio signal processing apparatus 700.
- the gallium nitride (GaN) transistor used as the switching device may be a hetero junction field effect transistor (HFET).
- HFET hetero junction field effect transistor
- the low pass filter 780 demodulates and outputs the amplifying audio signal Sout output from the power switching amplifier 770 as an analog audio signal. That is, the signal output from the power switching amplifier 770 is a digital signal in a pulse form and then is converted into an analog signal and output.
- the speaker unit 790 converts and outputs the output signal from the low pass filter 780 as a physical vibration signal audibly recognized by a user.
- the feedback loop 740 feeds back the amplifying audio signal Sout and transmits the amplifying audio signal Sout and a signal Sout3 to an input end of the sigma-delta modulation unit 730 in order to optimize a gain and a phase of the amplifying audio signal Sout in accordance with a regular output or a target gain and a target phase of the audio signal processing apparatus 700.
- the summing unit 750 subtracts the second feedback signal Sout3 from the input audio signal Sin and outputs the adjusted input audio signal Sin2 to the loop filter 731. If the audio signal processing apparatus 700 includes the delay unit 720, the summing unit 750 subtracts the second feedback signal Sout3 from the delayed input audio signal Sin1 and outputs subtracted signal by the summing unit 750 to the loop filter 731.
- the feedback loop 740 may attenuate the amplifying audio signal Sout by a predetermined rate, delay the amplifying audio signal Sout for a period of time, and output the second feedback signal Sout3.
- FIGS. 8A and 8B are detailed diagrams of the power switching amplifier 770 of FIG. 7.
- FIG. 8A shows an example of the power switching amplifier 770 of FIG. 7.
- FIG. 8B shows another example of the power switching amplifier 770 of FIG. 7.
- Driving signal generating units 860 and 890 of FIGS. 8A and 8B correspond to the driving signal generating unit 760 of FIG. 7, and thus detailed descriptions thereof will be omitted here.
- a power switching amplifier 870 may include a switching device 871 similar to the switching device described above.
- the switching device 871 may include at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- GaN gallium nitride
- GaAs gallium arsenide
- SiC silicon carbide
- a high power voltage +VDD and a low power voltage VDD are supplied to one end and another end of the switching device 871, and the driving signal CON is input into a gate terminal thereof.
- the switching device 871 outputs the amplifying audio signal Sout that is a voltage signal having a high power voltage +VDD level and a low power voltage VDD level in response to the driving signal CON.
- the driving signal generating unit 890 may generate a first driving signal CON 1 and a second driving signal CON2.
- the second driving signal CON2 may be the inverted first driving signal CON1.
- a power switching amplifier 895 may include a first switching device 896 and a second switching device 897 that are connected in series to each other. If the first switching device 896 is turned on, the high power voltage +VDD is driven. If the second switching device 897 is turned on, the low power voltage VDD is driven.
- FIG. 9 is a block diagram of an audio signal processing apparatus 900 according to another exemplary embodiment.
- the audio signal processing apparatus 900 may correspond to the audio signal processing apparatus 200 of FIG. 2. More specifically, a stability determining unit 910 and a sigma-delta modulation unit 930 of the audio signal processing apparatus 900 may correspond to the stability determining unit 210 and the sigma-delta modulation unit 230 of the audio signal processing apparatus 200 of FIG. 2. Thus, redundant descriptions will not be repeated here. Furthermore, the audio signal processing apparatus 900 does not include an element corresponding to the delay unit 220 of FIG. 2 and thus a summing unit 950 of the sigma-delta modulation unit 930 directly receives the input audio signal Sin.
- the stability determining unit 910 may generate the stability determination signal Sm that is used to adjust at least one of an SNR value and a stability value of the sigma-delta modulation unit 930 according to a comparison result of a level of the input audio signal Sin for each sub-frequency band and a threshold for each sub-frequency band as described above.
- the stability determining unit 910 may determine the input audio signal Sin to be unstable according to the comparison result, output the stability determination signal Sm of a first level, and control the sigma-delta modulation unit 930 in such a way that the SNR of the sigma-delta modulation unit 930 is maintained or reduced, and the stability value of sigma-delta modulation increases. That is, the stability determining unit 910 may control the sigma-delta modulation unit 930 in such a way that oscillation that occurs during sigma-delta modulation is reduced.
- the stability determining unit 910 may determine the input audio signal Sin to be stable according to the comparison result, output the stability determination signal Sm of a second level, and control the sigma-delta modulation unit 930 in such a way that the SNR of the sigma-delta modulation unit 930 increases, and the stability value of sigma-delta modulation is maintained or reduced.
- the stability determining unit 910 may generate the stability determination signal Sm to adjust at least one of a coefficient of a NTF and an order of the sigma-delta modulation unit 930 according to the comparison result of the level of the input audio signal Sin for each sub-frequency band and the threshold for each sub-frequency band as described above.
- the loop filter 931 may operate during a high SNR operation mode 932 and a high stability operation mode 933 according to control of the stability determination signal Sm. That is, the stability determination signal Sm may be used to control whether the signal Sin2 is fed into the high SNR operation mode loop filter 932 or the high stability operation mode loop filter 933 of the loop filter 930.
- the loop filter 931 may operate as the loop filter 932 having a high SNR. If the stability determination signal Sm of the first level is transmitted from the stability determination unit 910, the adjusted input audio signal Sin2 is switched so as to be transmitted to an N2 node. Accordingly, the loop filter 931 may operate as the loop filter 932 having high stability.
- the sigma-delta modulation unit 930 may receive the stability determination signal Sm of the first level, and adjust at least one of the coefficient of the NTF and the order of the sigma-delta modulation unit 930 in such a way that the SNR value of the sigma-delta modulation unit 930 is reduced.
- the sigma-delta modulation unit 930 may adjust at least one of the coefficient of the NTF and the order of the sigma-delta modulation unit 930 in such a way that oscillation of the sigma-delta modulation unit 930 is reduced.
- the sigma-delta modulation unit 930 may receive the stability determination signal Sm of the second level, and adjust at least one of the coefficient of the NTF and the order of the sigma-delta modulation unit 930 in such a way that the SNR value of the sigma-delta modulation unit 930 increases.
- the stability determining unit 910 determines the input audio signal Sin to be unstable according to the comparison result, and outputs the stability determination signal Sm of the first level.
- the sigma-delta modulation unit 930 may adjust the coefficient of the NTF of the of the sigma-delta modulation unit 930 in such a way that the order of the sigma-delta modulation unit 930 is reduced or oscillation that occurs during sigma-delta modulation is reduced in response to the stability determination signal Sm of the first level.
- the stability determining unit 910 determines the input audio signal Sin to be stable according to the comparison result and outputs the stability determination signal Sm of the second level.
- the sigma-delta modulation unit 930 may adjust the coefficient of the NTF of the of the sigma-delta modulation unit 930 in such a way that the order of the sigma-delta modulation unit 930 increases or the SNR value of the sigma-delta modulation unit 930 increases in response to the stability determination signal Sm of the second level.
- a quantization unit 935, a feedback loop 940, and a summing unit 950 correspond to the quantization unit 232, the feedback loop 240, and the summing unit 250 of FIG. 2, respectively, and thus detailed descriptions thereof will not be provided here.
- FIG. 10 is a detailed diagram of a sigma-delta modulation unit of FIG. 2.
- the sigma-delta modulation unit 1000, a loop filter 1031, a quantization unit 1032, a feedback loop 1040, and a summing unit 1050 of FIG. 10 correspond to the sigma-delta modulation unit 230, the loop filter 231, the quantization unit 232, the feedback loop 240, and the summing unit 250 of FIG. 2, and thus redundant descriptions will be omitted here.
- the loop filter 1031 may operate during the high SNR operation mode 932 and the high stability operation mode 933 in the same manner as the loop filter 931 of FIG. 9. Thus, a redundant description thereof will be omitted here.
- the loop filter 1031 may further include a first integrator 1055 and a second integrator 1060 for integrating the input audio signal Sin, a plurality of coefficients b1, b2, b3, g1, c1, c2, -a1, -a2, and b'1, b'2, b'3, g'1, c'1, c'2, -a'1, -a'2, and a plurality of summing units 1050, 1056, and 1057 for summing signals.
- the coefficients may be those of the NTF used for sigma-delta modulation.
- FIG. 10 shows the 2-level sigma-delta modulator 1000 including two integrators. However, one of ordinary skill in the art will understand that only one integrator may be provided, or a number of integrators greater than 2 may be provided.
- the coefficients b1, b2, b3, g1, c1, c2, -a1, and -a2 are those of the NTF used to achieve high stability of the sigma-delta modulation unit 1000. That is, the coefficients b1, b2, b3, g1, c1, c2, -a1, and -a2 may be designed to achieve a low oscillation rate of the sigma-delta modulation unit 1000.
- the coefficients b'1, b'2, b'3, g'1, c'1, c'2, -a'1, -a'2 are those of the NTF used to achieve a high SNR of the sigma-delta modulation unit 1000.
- the loop filter 1031 may include a plurality of switches 1091, 1092, 1093, 1094, 1095, 1096, 1097, and 1098 for selecting any one of the coefficients to achieve high stability of the sigma-delta modulation unit 1000 and the high SNR of the sigma-delta modulation unit 1000 in response to the stability determination signal Sm.
- the switches 1091, 1092, 1093, 1094, 1095, 1096, 1097, and 1098 are switched in such a way that the coefficients b1, b2, b3, g1, c1, c2, -a1, and -a2 used to achieve the high stability of the sigma-delta modulation unit 1000 are applied in the loop filter 1031.
- the switches 1091, 1092, 1093, 1094, 1095, 1096, 1097, and 1098 are switched in such a way that the coefficients b'1, b'2, b'3, g'1, c'1, c'2, -a'1, -a'2 used to achieve the high SNR of the sigma-delta modulation unit 1000 are applied in the loop filter 1031.
- the feedback loop 1040 includes a digital to analog converter 1070.
- the first modulation signal Sout1 output from the quantization unit 1032 is a pulse signal in a digital signal form.
- the input audio signal Sin may be in an analog signal form.
- the first modulation signal Sout1 is converted into a signal in an analog signal form and output to the summing unit 1050 so that the summing unit 1050 may easily sum or subtract signals.
- the sigma-delta modulation unit 1000 adjusts values of the coefficients used for sigma-delta modulation according to control of the stability determining unit 1010 and thus may operate in a high SNR operation mode or a high stability operation mode.
- FIG. 11 is a graph for explaining an operation of an audio signal processing apparatus according to an exemplary embodiment.
- an x axis indicates a signal level of the input audio signal Sin in a decibel (dB) unit
- a y axis indicates a SNR thereof in the decibel (dB) unit.
- a curve 1110 is a characteristic curve designed to have a high SNR.
- a curve 1120 is a characteristic curve designed to have high stability.
- a high SNR is maintained until a level of the input audio signal Sin has a level P1, and is rapidly reduced due to oscillation that occurs during sigma-delta modulation if the level of the input audio signal Sin exceeds the level P1.
- the level of the input audio signal Sin increases, stability of a system may not be secured.
- the maintained SNR has a low value.
- the audio signal processing apparatus drives a sigma-delta modulation unit to have a high SNR until the level of the input audio signal Sin does not exceed the level P1, and prevents oscillation from occurring if the level of the input audio signal Sin exceeds the level P1 and thus sigma-delta modulation may be stably performed.
- the audio signal processing apparatus may secure a maximum SNR while securing operation stability during sigma-delta modulation.
- FIG. 12 is a flowchart of an audio signal processing method 1200 according to an exemplary embodiment.
- the audio signal processing method 1200 may be performed by an audio signal processing apparatus according to any of the exemplary embodiments described above.
- the audio signal processing method 1200 divides a frequency band of the input audio signal Sin into at least one sub-frequency band (operation 1210), compares a level of the input audio signal Sin for each sub-frequency band with a threshold for the sub-frequency band (operation 1220), and generates the stability determination signal Sm according to a comparison result (operation 1230).
- Operations 1210-1230 may be performed by a stability determining unit (for example, stability determining unit 110).
- the input audio signal Sin may be determined to be unstable. If the input audio signal Sin is determined to be unstable, the stability determination signal Sm may be generated as a signal of a first level.
- Sigma-delta modulation is performed on the input audio signal Sin (operation 1240), and the first modulation signal Sout1 is output according to the stability determination signal Sm generated in operation 1210 (operation 1250).
- the audio signal processing method 1200 may further include adjusting (not shown) at least one of a coefficient of an NTF applied during sigma-delta modulation and a level of sigma-delta modulation according to the comparison result of operation 1220.
- the audio signal processing method 1200 of FIG. 12 corresponds to the operations described above and performed by the audio signal processing apparatuses described with reference to FIGS. 1 and 11. Thus, redundant descriptions thereof are omitted.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Power Engineering (AREA)
- Theoretical Computer Science (AREA)
- Nonlinear Science (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Spectroscopy & Molecular Physics (AREA)
Abstract
Description
- Apparatuses and methods consistent with the present disclosure relate to audio signal processing and, more particularly, to audio signal processing of sigma-delta modulation of an input audio signal.
- Class A, B, C, and Class D amplifiers are used to receive audio signals and output audibly perceptible signals. A Class D amplifier reduces deterioration in amplification efficiency that occur in class A, B, and C amplifiers. The Class D amplifier exhibits higher amplification efficiency than class A, B, and C amplifiers. Thus the Class D amplifier is widely used.
- A Class D amplifier is a digital amplifier that modulates analogously input audio signals to produce digital audio signals, and amplifies and output digitally modulated audio signals.
- Digital amplifiers have no data conversion loss and achieve amplification efficiency of 100 % theoretically and thus are widely used.
- Digital amplifiers modulate input audio signals to produce pulse signals and amplify the pulse signals. Sigma-delta modulation may be used to modulate audio signals to produce pulse signals. A modulator using sigma-delta modulation is referred to as a sigma-delta modulator.
- A high order sigma-delta modulator may be used to enhance noise shaping.
- However, a high order sigma-delta modulator accumulates signal values, which causes a large amount of oscillation to occur as the order of the sigma-delta modulator increases. The occurrence of oscillation may hinder the ability of the sigma-delta modulators to perform modulation operations, and thus an operation stability of sigma-delta modulator may not be secured.
- An aspect of the present disclosure provides an audio signal processing method of securing operation stability during sigma-delta modulation, and an audio signal processing apparatus therefor.
- Another aspect of the present disclosure is to provide an audio signal processing method of precisely detecting stability of an input audio signal so as to secure operation stability during sigma-delta modulation, and an audio signal processing apparatus therefor.
- Another aspect of the present disclosure is to provide an audio signal processing method of providing an increased signal to noise ratio (SNR) while providing high stability, and an audio signal processing apparatus therefor.
- According to an aspect of an exemplary embodiment, there is provided an audio signal processing apparatus including a stability determining unit that compares a level of an input audio signal for each of at least one sub-frequency band with a threshold for the sub-frequency band, and generates a stability determination signal according to a result of the comparison; and a sigma-delta modulation unit that sigma-delta modulates the input audio signal according to the stability determination signal, and outputs a first modulation signal.
- Each of the at least one sub-frequency band may have a different threshold which is set for each sub-frequency band as a value in proportion to a frequency value the sub-frequency band.
- The apparatus may further include a delay unit that receives the input audio signal, compensates the input audio signal for a time taken to determine stability in the stability determining unit, and outputs the compensated input audio signal to the sigma-delta modulation unit.
- The stability determining unit may determine the input audio signal in a sub-frequency band to be unstable if a level of the input audio signal in the sub-frequency band is equal to or greater than the threshold for the sub-frequency band, and may set a level of the stability determination signal to indicate that the input audio signal is unstable.
- The stability determining unit may include a detecting unit that divides a frequency band of the input audio signal into the at least one sub-frequency band, and compares the level of the input audio signal for each of the at least one sub-frequency band with the threshold for the sub-frequency band; and an adjusting unit that determines stability of the input audio signal and generates the stability determination signal according to the result of the comparisons.
- The sigma-delta modulation unit may include a loop filter that integrates the input audio signal and outputs the integrated input audio signal; and a quantization unit that quantizes the output signal of the loop filter and generates the first modulation signal.
- The sigma-delta modulation unit may further include a feedback loop that feeds back the first modulation signal and outputs a first feedback signal; and a summing unit that subtracts the feedback signal from the input audio signal and outputs the subtracted input audio signal.
- The detecting unit may include a signal level detecting unit that divides the frequency band of the input audio signal into a plurality of sub-frequency bands, and compares the input audio signal for each of the plurality of sub-frequency bands with the threshold for the sub-frequency band for a period; and a counter unit that accumulates a result of the comparison over the period.
- The detecting unit may include a frequency converting unit that converts the input audio signal into a frequency band signal; and a level detecting unit that compares the level of the input audio signal for each of the at least one sub-frequency band with the threshold for the sub-frequency band by using the frequency band signal.
- The apparatus may further include a driving signal generating unit that generates at least one driving signal used to control a switching amplifying operation according to the first modulation signal; and a power switching amplifier including at least one switching device that turns on or off in response to a corresponding one of the at least one driving signal, performing the switching amplifying operation, and outputting an amplified audio signal corresponding to the input audio signal by using the at least one switching device, wherein the at least one switching device includes at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- The apparatus may further include a feedback loop that outputs a feedback signal obtained by attenuating and delaying the amplified audio signal to the sigma-delta modulation unit in order to compensate for at least one of a delay and a gain of the amplified audio signal.
- The stability determining unit may generate the stability determination signal such that at least one of a signal-to-noise ratio (SNR) value and a stability value of the sigma-delta modulation unit is adjusted according to the result of the comparison.
- The stability determining unit may generate the stability determination signal in such a way that at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit is adjusted according to the result of the comparison.
- The stability determining unit may generate the stability determination signal of a first level if the level of the input audio signal in a sub-frequency band of the at least one sub-frequency band is equal to or greater than the threshold for the sub-frequency band, and generates the stability determination signal of a second level if the level of the input audio signal in the sub-frequency band is less than the threshold for the sub-frequency band.
- The sigma-delta modulation unit may receive the stability determination signal of the first level and adjusts at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit such that oscillation that occurs during sigma-delta modulation is reduced.
- The sigma-delta modulation unit may receive the stability determination signal of the second level and adjusts at least one of the coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit such that a signal-to-noise ratio (SNR) value of the sigma-delta modulation unit increases.
- According to another aspect of an exemplary embodiment, there is provided an audio signal processing method including dividing a frequency band of an input audio signal into at least one sub-frequency band; comparing a level of the input audio signal for each of the at least one sub-frequency band with a threshold for the sub-frequency band; generating a stability determination signal according to a result of the comparing; performing sigma-delta modulation on the input audio signal according to the stability determination signal; and outputting the sigma-delta modulated signal as a first modulation signal.
- An audio signal processing apparatus according to an exemplary embodiment can precisely detect a stability of an input audio signal so as to secure operation stability during sigma-delta modulation.
- And, n audio signal processing apparatus according to an exemplary embodiment can increase signal to noise ratio (SNR) with high stability.
- The above and other aspects will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which:
- FIG. 1 is a block diagram of an audio signal processing apparatus according to an exemplary embodiment ;
- FIG. 2 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment;
- FIGS. 3A and 3B are graphs for explaining oscillation that occurs during sigma-delta modulation;
- FIG. 4 is a graph for explaining a threshold value for each frequency band used in an audio signal processing apparatus according to an exemplary embodiment;
- FIG. 5 is a block diagram of a stability determination unit of FIG. 1;
- FIG. 6 is a detailed block diagram of a stability determination unit of FIG. 1;
- FIG. 7 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment;
- FIGS. 8A and 8B are detailed diagrams of a power switching amplifier of FIG. 7;
- FIG. 9 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment;
- FIG. 10 is a detailed diagram of a sigma-delta modulation unit of FIG. 2;
- FIG. 11 is a graph for explaining an operation of an audio signal processing apparatus according to an exemplary embodiment; and
- FIG. 12 is a flowchart of an audio signal processing method according to an exemplary embodiment.
- A sigma-delta modulator performs shaping on a noise component included in an input audio signal by pushing the noise component to outside portion of a frequency band according to the characteristics of a noise transfer function (NTF).
- Noise shaping of the NTF is influenced by an order of the sigma-delta modulator. More specifically, the higher the order of the sigma-delta modulator, the closer to the outside portion of the frequency band to which noise is pushed during the noise shaping. Accordingly, the higher the order of the sigma-delta modulator, the higher the signal to noise ratio (SNR).
- Furthermore, if a level of an input signal is greater than a specific threshold according to feedback characteristics of the sigma-delta modulator, oscillation occurs during sigma-delta modulation. If oscillation occurs, the sigma-delta modulator does not operate normally, and thus stability of a system deteriorates.
- Enhancement of the SNR is inversely proportional to the stability of the system. That is, if a high order sigma-delta modulator is designed to enhance the SNR, the stability of the system deteriorates, which increases a probability of oscillation. Furthermore, if a low order sigma-delta modulator is designed to increase the stability of the system, the SNR is reduced.
- An audio signal processing method and an audio signal processing apparatus therefor that secure operation stability during sigma-delta modulation while enhancing a SNR according to exemplary embodiments will now be described more fully with reference to the accompanying drawings, in which exemplary embodiments are shown.
- As used herein, expressions such as at least one of , when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
- FIG. 1 is a block diagram of an audio signal processing apparatus 100 according to an exemplary embodiment.
- Referring to FIG. 1, the audio signal processing apparatus 100 of the present exemplary embodiment includes a stability determination unit 110 and a sigma-delta modulation unit 130.
- The stability determination unit 110 may divide a frequency band of an input audio signal Sin into at least one sub-frequency band. The stability determination unit 110 compares a level of the input audio signal Sin for the sub-frequency bands with a threshold for the sub-frequency band. The stability determination unit 110 generates a stability determination signal Sm according to a comparison result.
- In this regard, the threshold may be a lower limit value of an input audio signal level at which oscillation occurs during sigma-delta modulation. Thus, if a level of the input audio signal Sin is less than the threshold for a sub-frequency band, the input audio signal Sin may be determined as a stable signal. On the other hand, if the level of the input audio signal Sin is equal to or greater than the threshold for the sub-frequency band, the input audio signal Sin may be determined as an unstable signal.
- For example, the stability determination unit 110 divides the frequency band of the input audio signal Sin into a number (N) of sub-frequency bands. Each of the N sub-frequency bands has an associated threshold. Thus, for N sub-frequency bands, there are N thresholds. The stability determination unit 110 compares the input audio signal Sin of the first sub-frequency band with a threshold for the first sub-frequency band. Then the stability determination unit 110 compares the input audio signal Sin of the second sub-frequency band with a threshold for the second sub-frequency band, and so forth.
- In this regard, the threshold may differ according to coefficients of a noise transfer function (NTF) of the sigma-delta modulation unit 130. More specifically, the characteristics of the NTF, which include pole and zero values of the NTF, may differ according to a design specification of the sigma-delta modulation unit 130. In this regard, values used to determine the characteristics of the NTF, including the pole and zero values of the NTF, may be coefficients of the NTF. Furthermore, if the pole and zero values of the NTF are adjusted, an oscillation degree of the sigma-delta modulation unit 130 may be adjusted. Thus, the threshold may be experimentally optimized and designed in terms of the design specification of the sigma-delta modulation unit 130.
- If the level of the input audio signal Sin for a frequency band is equal to or greater than the threshold, the stability determination unit 110 may determine the input audio signal Sin in the frequency band to be unstable.
- More specifically, the stability determination unit 110 may generate a signal level of the stability determination signal Sm as a first level if the level of the input audio signal Sin is equal to or greater than the threshold, and may generate the signal level of the stability determination signal Sm as a second level if the level of the input audio signal Sin is less than the threshold.
- The sigma-delta modulation unit 130 performs sigma-delta modulation (SDM) on the input audio signal Sin according to the stability determination signal Sm transmitted from the stability determination unit 110 and outputs a first modulation signal Sout1. Accordingly, the first modulation signal Sout1 is generated after being pulse modulated corresponding to the input audio signal Sin.
- In this regard, the sigma-delta modulation unit 130 may have an order that may differ according to the number of integrators included in the sigma-delta modulation unit 130. The sigma-delta modulation unit 130 may have an order that varies according to the first modulation signal Sout1 transmitted from the stability determination unit 110.
- The audio signal processing apparatus 100 of the present exemplary embodiment divides the frequency band of the input audio signal Sin into at least one sub-frequency band, and separately determines stability of the input audio signal Sin for the at least one sub-frequency band, thereby precisely determining stability of the input audio signal Sin. Accordingly, the SNR for each frequency band may be enhanced as much as possible while the stability of the sigma-delta modulation unit 130 is maintained.
- FIG. 2 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment .
- Referring to FIG. 2, the audio signal processing apparatus 200 may further include at least one of a delay unit 220 and a feedback loop 240, compared to the audio signal processing apparatus 100 of FIG. 1. A stability determination unit 210 and a sigma-delta modulation unit 230 included in the audio signal processing apparatus 200 of FIG. 2 may correspond to the stability determination unit 110 and the sigma-delta modulation unit 130 included in the audio signal processing apparatus 100 of FIG. 1. Thus, redundant descriptions will not be repeated here.
- The delay unit 220 may transmit the input audio signal Sin, and compensate for a time taken to determine stability of the input audio signal Sin in the stability determination unit 210. Accordingly, the delay unit 220 outputs the input audio signal Sin for which the time is compensated, to the sigma-delta modulation unit 230.
- More specifically, if it takes a time t1 to receive the input audio signal Sin and generate the stability determination signal Sm in the stability determination unit 210, the delay unit 220 may delay the input audio signal Sin by the time t1, and transmit the input audio signal Sin delayed by the time t1 to the sigma-delta modulation unit 230.
- The stability determination unit 210 may include a detecting unit 211 and an adjusting unit 212.
- The detecting unit 211 divides a frequency band of the input audio signal Sin into at least one sub-frequency band, and compares a level of the input audio signal Sin for each sub-frequency band with a corresponding threshold. That is, the detecting unit 211 may perform N comparison operations if the frequency band of the input audio signal Sin is divided into N sub-frequency bands.
- The adjusting unit 212 determines the stability of the input audio signal Sin according to the comparison result of the detecting unit 211 and generates the stability determination signal Sm corresponding to the determination of stability.
- The sigma-delta modulation unit 230 may include a loop filter 231 and a quantization unit 232.
- The loop filter 231 includes at least one integrator (not shown), and integrates and outputs the input audio signal Sin. The loop filter 231 performs noise shaping on noise included in the input audio signal Sin to push the noise to an outband of a frequency band according to a NTF.
- The quantization unit 232 receives a signal output from the loop filter 231, quantizes the received signal, and generates the first modulation signal Sout1 in a pulse signal form.
- The sigma-delta modulation unit 230 may further include the feedback loop 240 and a summing unit 250.
- The feedback loop 240 feeds back the first modulation signal Sout1 and outputs a feedback signal Sout2.
- The summing unit 250 subtracts the first feedback signal Sout2 from the input audio signal Sin and outputs an adjusted input audio signal Sin2 to the loop filter 231. If the audio signal processing apparatus 200 includes the delay unit 220, the summing unit 250 may subtract the first feedback signal Sout2 from a delayed input audio signal Sin1 and output the subtracted signal to the loop filter 231.
- If the sigma-delta modulation unit 230 includes the feedback loop 240 and the summing unit 250, the sigma-delta modulation unit 230 may adjust at least one of a gain and a phase of the input audio signal Sin or Sin1 of the sigma-delta modulation unit 230 in view of a gain and a phase of the output signal of the sigma-delta modulation unit 230. Accordingly, the sigma-delta modulation unit 230 may perform precise gain control in accordance with a target gain or a regular maximum output of the audio signal processing apparatus 200.
- FIGS. 3A and 3B are graphs for explaining oscillation that occurs during sigma-delta modulation.
- FIG. 3A is a graph for explaining oscillation that occurs in a low frequency band. FIG. 3B is a graph for explaining oscillation that occurs in a high frequency band.
- Referring to FIG. 3A, an X axis indicates time, and a y axis indicates an amplitude of oscillation. If sigma-delta modulation is performed on an input audio signal having a predetermined level in the low frequency band, an intensity of oscillation rapidly increases over time.
- Referring to FIG. 3B, an X axis indicates time, and a y axis indicates an amplitude of oscillation. If sigma-delta modulation is performed on an input audio signal having a predetermined level in the high frequency band, oscillation proceeds at regular amplitude without a rapid increase.
- Referring to FIGS. 3A and 3B, the intensity of oscillation differs according to frequency bands with respect to the input audio signal having the same signal level. More specifically, in FIG. 3A, amplitude of oscillation rapidly increases after a time t1 and exceeds a range of -1*100000 and 1*100000 in a low frequency region, whereas the amplitude of oscillation is generally between the range of -1*100000 and 1*100000 in a high frequency region.
- Therefore, input audio signals having the same signal level show that an intensity of oscillation for each frequency band differs, and amplitude of oscillation further increases in a low frequency region.
- FIG. 4 is a graph for explaining a threshold value for each frequency band used in an audio signal processing apparatus according to an exemplary embodiment.
- The audio signal processing apparatuses 100 and 200 according to exemplary embodiments described above may set a threshold differently according to the sub-frequency bands when determining stability of the input audio signal Sin.
- More specifically, the threshold may be set in proportion to frequency values of sub-frequency bands. For example, first through Nth thresholds corresponding to first through Nth sub-frequency bands, respectively, have different values. The higher the frequency values of the sub-frequency bands, the higher the corresponding thresholds, and thus the first threshold may have a smallest value, and the Nth threshold may have a greatest value. An example is illustrated in FIG. 4.
- Referring to FIG. 4, an x axis indicates a frequency band of an input audio signal 420, and a y axis indicates a value of a threshold 410. In FIG. 4, a frequency band of the input audio signal 420 is divided into first through third sub-frequency bands. The first through third sub-frequency bands may have a same length or different lengths in the X axis.
- For example, a first threshold Th1 is set for the first sub-frequency band having 0 through f1 frequency values, a second threshold Th2 is set for the second sub-frequency band having f1 through f2 frequency values, and a third threshold Th3 is set for the third sub-frequency band having f2 through f3 frequency values.
- Thus, if a signal level of the input audio signal 420 in the first frequency band is equal to or greater than the first threshold Th1 , the input audio signal 420 in the first frequency band may be determined as an unstable signal. On the other hand, if the signal level of the input audio signal 420 in the third frequency band is equal to or greater than the third threshold Th3, the input audio signal 420 in the third frequency band may be determined as an unstable signal.
- FIG. 5 is a block diagram of a stability determination unit 510 of FIG. 1. The stability determination unit 510 of FIG. 5 may correspond to the stability determination unit 110 of FIG. 1 or the stability determination unit 210 of FIG. 2. A detecting unit 511 and an adjusting unit 512 may correspond to the detecting unit 211 and the adjusting unit 212 of FIG. 2. Thus, redundant descriptions thereof will not be repeated here.
- Referring to FIG. 5, the detecting unit 511 may include a signal level detecting unit 530 and a counter unit 540.
- The signal level detecting unit 530 divides a frequency band of the input audio signal Sin into a plurality of sub-frequency bands, and compares the input audio signal Sin for each sub-frequency band with a threshold corresponding to the frequency band for a period. In FIG. 5, the frequency band of the input audio signal Sin is divided into first through Nth sub-frequency bands.
- More specifically, the signal level detecting unit 530 may include first through Nth level detecting units 531, 532, 533, and 534 that perform a determination operation for respective sub-frequency bands. For example, the first level detecting unit 531 receives the input audio signal Sin and determines whether a level of the input audio signal Sin in a first sub-frequency band is equal to or greater than a first threshold. Such a determination may be performed for a period T1.
- The counter unit 540 counts results of determination performed by the signal level detecting unit 530 over the period T1.
- More specifically, the counter unit 540 may include first through Nth section counters 541, 542, 543, and 544 that perform counting operations for respective sub-frequency bands. For example, the first section counter 541 may receive the determination result of the first level detecting unit 531 over the period T1, and count the number of times the level of the input audio signal in the first sub-frequency band is equal to or greater than the first threshold. For example, if a counting period of the counter unit 540 is 20*T1, and the number of times the level of the input audio signal Sin in the first sub-frequency band is equal to or greater than the first threshold is 10, the first section counter 541 may transmit the counting number, i.e. 10, to the adjusting unit 512.
- The adjusting unit 512 determines stability of the input audio signal Sin according to the counting number output by the counter unit 540. For example, if the number of times the level of the input audio signal Sin in a sub-frequency band is equal to or greater than the corresponding threshold for the sub-frequency band exceeds a threshold rate for the whole counting period, for example, 20% of 20 times, the adjusting unit 512 may determine the input audio signal Sin in the corresponding sub-frequency band to be in an unstable state. In this regard, a reference counting number used to determine the stability of the input audio signal Sin may be set differently according to a product specification such as operation reliabilities of the audio signal processing apparatus.
- The adjusting unit 512 may generate the stability determination signal Sm having a first signal level if the input audio signal Sin is determined to be unstable, and may generate the stability determination signal Sm having a second signal level if the input audio signal Sin is determined to be stable.
- More specifically, the adjusting unit 512 may determine the stability of the input audio signal Sin for each sub-frequency band, and output the stability determination signal Sm as a first signal level if the adjusting unit 512 determines the input audio signal Sin to be unstable at any one of sub-frequency bands.
- The adjusting unit 512 may determine the stability of the input audio signal Sin for each sub-frequency band, and output the stability determination signal Sm as the first signal level only when the adjusting unit 512 determines the input audio signal Sin to be unstable in all of the whole sub-frequency bands.
- Alternatively, the adjusting unit 512 may determine the stability of the input audio signal Sin for each sub-frequency band, and output the stability determination signal Sm as the first signal level if the adjusting unit 512 determines the input audio signal Sin to be unstable in one or more sub-frequency bands corresponding to low frequencies.
- FIG. 6 is a detailed block diagram of a stability determination unit of FIG. 1. The stability determination unit 610 of FIG. 6 may correspond to the stability determination unit 110 of FIG. 1 or the stability determination unit 210 of FIG. 2. A detecting unit 611 and an adjusting unit 612 may correspond to the detecting unit 211 and the adjusting unit 212 of FIG. 2. Thus, redundant descriptions will not be repeated here.
- Referring to FIG. 6, the detecting unit 611 may include a frequency converting unit 630 and a level detecting unit 640.
- The frequency converting unit 630 converts the input audio signal Sin into a frequency band signal. More specifically, the frequency converting unit 630 may perform fast Fourier transformation (FFT) on the input audio signal Sin. More specifically, the frequency converting unit 630 converts a number of designated samples into frames and performs FFT on the input audio signal Sin for each frame. The frequency converting unit 630 may transmit frequency spectrum information generated by performing the FFT to the level detecting unit 640. The frequency spectrum information is information regarding a level of the input audio signal Sin for each frequency, and thus if the input audio signal Sin is converted into the frequency band signal, the level of the input audio signal Sin for each frequency may be recognized.
- The level detecting unit 640 compares the level of the input audio signal Sin for each sub-frequency band with a corresponding threshold for the sub-frequency band by using the frequency band signal converted from the input audio signal Sin by the frequency converting unit 630.
- The adjusting unit 612 receives a comparison result for each sub-frequency band from the level detecting unit 640, determines stability of the input audio signal Sin, and generates the stability determination signal Sm having a first or second level. In this regard, the operation of the adjusting unit 612 is the same as that of the adjusting unit 512 of FIG. 5, and thus a detailed description thereof will be omitted here. While a first and second level are described, one of ordinary skill in the art will appreciate that more than two levels may be used.
- FIG. 7 is a block diagram of an audio signal processing apparatus according to another exemplary embodiment.
- Referring to FIG. 7, in addition to the elements of the audio signal processing apparatus of FIG. 2, the audio signal processing apparatus 700 may further include at least one of a feedback loop 740, a driving signal generating unit 760, a power switching amplifier 770, a low pass filter 780, and a speaker unit 790. A stability determining unit 710 and a sigma-delta modulation unit 730 of the audio signal processing apparatus 700 may correspond to the stability determining units 110 and 210, and the sigma-delta modulation units 130 and 230 of the audio signal processing apparatuses 100 and 200 of FIGS. 1 and 2, respectively. A delay unit 720 of the audio signal processing apparatus 700 may correspond to the delay unit 220 of FIG. 2. Thus, redundant descriptions thereof will not be repeated here.
- The driving signal generating unit 760 receives the first modulation signal Sout1, and generates at least one driving signal CON for controlling a switching amplifying operation according to the input audio signal Sin and the first modulation signal Sout1. In this regard, the switching amplifying operation is performed by using at least one switching device (not shown) included in the power switching amplifier 770. The driving signal CON is a switching control signal used to control the switching device (not shown) to be turned on or off. The driving signal CON is transmitted to the power switching amplifier 770.
- The power switching amplifier 770 performs the switching amplifying operation and includes at least one switching device (not shown) that turns on or off in response to the driving signal CON. The power switching amplifier 770 outputs an amplified audio signal Sout corresponding to the input audio signal Sin by using the switching device (not shown).
- In this regard, the amplifying audio signal Sout may be a signal obtained by amplifying the amplitude of the first modulation signal Sout1. For example, the power switching amplifier 770 may amplify the first modulation signal Sout1 in such a way that the audio signal Sin input to the audio signal processing apparatus 700 may be output in accordance with a regular maximum output.
- The switching device (not shown) included in the power switching amplifier 770 may include at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- The gallium nitride (GaN) transistor and the gallium arsenide (GaAs) transistor have a short propagation delay and operate at high speed at a high voltage. In this regard, the propagation delay indicates a time taken to input the driving signal CON that turns a corresponding transistor on to a gate of the transistor and to output a saturated voltage signal to a source end or a drain end that is an output end of the transistor.
- If the power switching amplifier 770 uses the gallium nitride (GaN) transistor or the gallium arsenide (GaAs) transistor as the switching device that performs the switching amplifying operation, the power switching amplifier 770 may perform a switching operation at high speed. Accordingly, switching noise may be minimized, thereby reducing an SNR of the audio signal processing apparatus 700. Furthermore, a signal may be quickly amplified at a high voltage, thereby increasing a maximum output of the audio signal processing apparatus 700.
- The gallium nitride (GaN) transistor used as the switching device may be a hetero junction field effect transistor (HFET).
- The detailed construction of the power switching amplifier 770 will be described with reference to FIG. 8 later.
- The low pass filter 780 demodulates and outputs the amplifying audio signal Sout output from the power switching amplifier 770 as an analog audio signal. That is, the signal output from the power switching amplifier 770 is a digital signal in a pulse form and then is converted into an analog signal and output.
- The speaker unit 790 converts and outputs the output signal from the low pass filter 780 as a physical vibration signal audibly recognized by a user.
- The feedback loop 740 feeds back the amplifying audio signal Sout and transmits the amplifying audio signal Sout and a signal Sout3 to an input end of the sigma-delta modulation unit 730 in order to optimize a gain and a phase of the amplifying audio signal Sout in accordance with a regular output or a target gain and a target phase of the audio signal processing apparatus 700.
- If the audio signal processing apparatus 700 includes the feedback loop 740, the summing unit 750 subtracts the second feedback signal Sout3 from the input audio signal Sin and outputs the adjusted input audio signal Sin2 to the loop filter 731. If the audio signal processing apparatus 700 includes the delay unit 720, the summing unit 750 subtracts the second feedback signal Sout3 from the delayed input audio signal Sin1 and outputs subtracted signal by the summing unit 750 to the loop filter 731.
- More specifically, the feedback loop 740 may attenuate the amplifying audio signal Sout by a predetermined rate, delay the amplifying audio signal Sout for a period of time, and output the second feedback signal Sout3.
- FIGS. 8A and 8B are detailed diagrams of the power switching amplifier 770 of FIG. 7. FIG. 8A shows an example of the power switching amplifier 770 of FIG. 7. FIG. 8B shows another example of the power switching amplifier 770 of FIG. 7. Driving signal generating units 860 and 890 of FIGS. 8A and 8B correspond to the driving signal generating unit 760 of FIG. 7, and thus detailed descriptions thereof will be omitted here.
- Referring to FIG. 8A, a power switching amplifier 870 may include a switching device 871 similar to the switching device described above. The switching device 871 may include at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- A high power voltage +VDD and a low power voltage VDD are supplied to one end and another end of the switching device 871, and the driving signal CON is input into a gate terminal thereof. The switching device 871 outputs the amplifying audio signal Sout that is a voltage signal having a high power voltage +VDD level and a low power voltage VDD level in response to the driving signal CON.
- Referring to FIG. 8B, the driving signal generating unit 890 may generate a first driving signal CON 1 and a second driving signal CON2. In this regard, the second driving signal CON2 may be the inverted first driving signal CON1.
- A power switching amplifier 895 may include a first switching device 896 and a second switching device 897 that are connected in series to each other. If the first switching device 896 is turned on, the high power voltage +VDD is driven. If the second switching device 897 is turned on, the low power voltage VDD is driven.
- FIG. 9 is a block diagram of an audio signal processing apparatus 900 according to another exemplary embodiment.
- Referring to FIG. 9, the audio signal processing apparatus 900 may correspond to the audio signal processing apparatus 200 of FIG. 2. More specifically, a stability determining unit 910 and a sigma-delta modulation unit 930 of the audio signal processing apparatus 900 may correspond to the stability determining unit 210 and the sigma-delta modulation unit 230 of the audio signal processing apparatus 200 of FIG. 2. Thus, redundant descriptions will not be repeated here. Furthermore, the audio signal processing apparatus 900 does not include an element corresponding to the delay unit 220 of FIG. 2 and thus a summing unit 950 of the sigma-delta modulation unit 930 directly receives the input audio signal Sin.
- The stability determining unit 910 may generate the stability determination signal Sm that is used to adjust at least one of an SNR value and a stability value of the sigma-delta modulation unit 930 according to a comparison result of a level of the input audio signal Sin for each sub-frequency band and a threshold for each sub-frequency band as described above.
- For example, the stability determining unit 910 may determine the input audio signal Sin to be unstable according to the comparison result, output the stability determination signal Sm of a first level, and control the sigma-delta modulation unit 930 in such a way that the SNR of the sigma-delta modulation unit 930 is maintained or reduced, and the stability value of sigma-delta modulation increases. That is, the stability determining unit 910 may control the sigma-delta modulation unit 930 in such a way that oscillation that occurs during sigma-delta modulation is reduced.
- As another example, the stability determining unit 910 may determine the input audio signal Sin to be stable according to the comparison result, output the stability determination signal Sm of a second level, and control the sigma-delta modulation unit 930 in such a way that the SNR of the sigma-delta modulation unit 930 increases, and the stability value of sigma-delta modulation is maintained or reduced.
- Alternatively, the stability determining unit 910 may generate the stability determination signal Sm to adjust at least one of a coefficient of a NTF and an order of the sigma-delta modulation unit 930 according to the comparison result of the level of the input audio signal Sin for each sub-frequency band and the threshold for each sub-frequency band as described above.
- The loop filter 931 may operate during a high SNR operation mode 932 and a high stability operation mode 933 according to control of the stability determination signal Sm. That is, the stability determination signal Sm may be used to control whether the signal Sin2 is fed into the high SNR operation mode loop filter 932 or the high stability operation mode loop filter 933 of the loop filter 930.
- More specifically, if the stability determination signal Sm of the second level is transmitted from the stability determination unit 910, the adjusted input audio signal Sin2 is switched so as to be transmitted to an N1 node. Accordingly, the loop filter 931 may operate as the loop filter 932 having a high SNR. If the stability determination signal Sm of the first level is transmitted from the stability determination unit 910, the adjusted input audio signal Sin2 is switched so as to be transmitted to an N2 node. Accordingly, the loop filter 931 may operate as the loop filter 932 having high stability.
- The sigma-delta modulation unit 930 may receive the stability determination signal Sm of the first level, and adjust at least one of the coefficient of the NTF and the order of the sigma-delta modulation unit 930 in such a way that the SNR value of the sigma-delta modulation unit 930 is reduced. Alternatively, the sigma-delta modulation unit 930 may adjust at least one of the coefficient of the NTF and the order of the sigma-delta modulation unit 930 in such a way that oscillation of the sigma-delta modulation unit 930 is reduced.
- Furthermore, the sigma-delta modulation unit 930 may receive the stability determination signal Sm of the second level, and adjust at least one of the coefficient of the NTF and the order of the sigma-delta modulation unit 930 in such a way that the SNR value of the sigma-delta modulation unit 930 increases.
- For example, the stability determining unit 910 determines the input audio signal Sin to be unstable according to the comparison result, and outputs the stability determination signal Sm of the first level. The sigma-delta modulation unit 930 may adjust the coefficient of the NTF of the of the sigma-delta modulation unit 930 in such a way that the order of the sigma-delta modulation unit 930 is reduced or oscillation that occurs during sigma-delta modulation is reduced in response to the stability determination signal Sm of the first level.
- As another example, the stability determining unit 910 determines the input audio signal Sin to be stable according to the comparison result and outputs the stability determination signal Sm of the second level. The sigma-delta modulation unit 930 may adjust the coefficient of the NTF of the of the sigma-delta modulation unit 930 in such a way that the order of the sigma-delta modulation unit 930 increases or the SNR value of the sigma-delta modulation unit 930 increases in response to the stability determination signal Sm of the second level.
- A quantization unit 935, a feedback loop 940, and a summing unit 950 correspond to the quantization unit 232, the feedback loop 240, and the summing unit 250 of FIG. 2, respectively, and thus detailed descriptions thereof will not be provided here.
- FIG. 10 is a detailed diagram of a sigma-delta modulation unit of FIG. 2.
- The sigma-delta modulation unit 1000, a loop filter 1031, a quantization unit 1032, a feedback loop 1040, and a summing unit 1050 of FIG. 10 correspond to the sigma-delta modulation unit 230, the loop filter 231, the quantization unit 232, the feedback loop 240, and the summing unit 250 of FIG. 2, and thus redundant descriptions will be omitted here.
- The loop filter 1031 may operate during the high SNR operation mode 932 and the high stability operation mode 933 in the same manner as the loop filter 931 of FIG. 9. Thus, a redundant description thereof will be omitted here.
- Referring to FIG. 10, the loop filter 1031 may further include a first integrator 1055 and a second integrator 1060 for integrating the input audio signal Sin, a plurality of coefficients b1, b2, b3, g1, c1, c2, -a1, -a2, and b'1, b'2, b'3, g'1, c'1, c'2, -a'1, -a'2, and a plurality of summing units 1050, 1056, and 1057 for summing signals. In this regard, the coefficients may be those of the NTF used for sigma-delta modulation. FIG. 10 shows the 2-level sigma-delta modulator 1000 including two integrators. However, one of ordinary skill in the art will understand that only one integrator may be provided, or a number of integrators greater than 2 may be provided.
- Referring to FIG. 10, the coefficients b1, b2, b3, g1, c1, c2, -a1, and -a2 are those of the NTF used to achieve high stability of the sigma-delta modulation unit 1000. That is, the coefficients b1, b2, b3, g1, c1, c2, -a1, and -a2 may be designed to achieve a low oscillation rate of the sigma-delta modulation unit 1000.
- The coefficients b'1, b'2, b'3, g'1, c'1, c'2, -a'1, -a'2 are those of the NTF used to achieve a high SNR of the sigma-delta modulation unit 1000.
- The loop filter 1031 may include a plurality of switches 1091, 1092, 1093, 1094, 1095, 1096, 1097, and 1098 for selecting any one of the coefficients to achieve high stability of the sigma-delta modulation unit 1000 and the high SNR of the sigma-delta modulation unit 1000 in response to the stability determination signal Sm.
- For example, if the stability determination signal Sm of a first level is transmitted from a stability determining unit 1010, the switches 1091, 1092, 1093, 1094, 1095, 1096, 1097, and 1098 are switched in such a way that the coefficients b1, b2, b3, g1, c1, c2, -a1, and -a2 used to achieve the high stability of the sigma-delta modulation unit 1000 are applied in the loop filter 1031.
- Furthermore, if the stability determination signal Sm of a second level is transmitted from the stability determining unit 1010, the switches 1091, 1092, 1093, 1094, 1095, 1096, 1097, and 1098 are switched in such a way that the coefficients b'1, b'2, b'3, g'1, c'1, c'2, -a'1, -a'2 used to achieve the high SNR of the sigma-delta modulation unit 1000 are applied in the loop filter 1031.
- In FIG. 10, the feedback loop 1040 includes a digital to analog converter 1070. The first modulation signal Sout1 output from the quantization unit 1032 is a pulse signal in a digital signal form. The input audio signal Sin may be in an analog signal form. Thus, the first modulation signal Sout1 is converted into a signal in an analog signal form and output to the summing unit 1050 so that the summing unit 1050 may easily sum or subtract signals.
- The sigma-delta modulation unit 1000 adjusts values of the coefficients used for sigma-delta modulation according to control of the stability determining unit 1010 and thus may operate in a high SNR operation mode or a high stability operation mode.
- FIG. 11 is a graph for explaining an operation of an audio signal processing apparatus according to an exemplary embodiment.
- Referring to FIG. 11, an x axis indicates a signal level of the input audio signal Sin in a decibel (dB) unit, and a y axis indicates a SNR thereof in the decibel (dB) unit.
- A curve 1110 is a characteristic curve designed to have a high SNR. A curve 1120 is a characteristic curve designed to have high stability.
- Referring to the curve 1110, a high SNR is maintained until a level of the input audio signal Sin has a level P1, and is rapidly reduced due to oscillation that occurs during sigma-delta modulation if the level of the input audio signal Sin exceeds the level P1. Thus, if the level of the input audio signal Sin increases, stability of a system may not be secured.
- Referring to the curve 1120, even if the level of the input audio signal Sin increases, although the SNR is continuously maintained at the level P1, the maintained SNR has a low value.
- The audio signal processing apparatus according to exemplary embodiments drives a sigma-delta modulation unit to have a high SNR until the level of the input audio signal Sin does not exceed the level P1, and prevents oscillation from occurring if the level of the input audio signal Sin exceeds the level P1 and thus sigma-delta modulation may be stably performed.
- Accordingly, the audio signal processing apparatus according to exemplary embodiments may secure a maximum SNR while securing operation stability during sigma-delta modulation.
- FIG. 12 is a flowchart of an audio signal processing method 1200 according to an exemplary embodiment. The audio signal processing method 1200 may be performed by an audio signal processing apparatus according to any of the exemplary embodiments described above.
- Referring to FIG. 12, the audio signal processing method 1200 divides a frequency band of the input audio signal Sin into at least one sub-frequency band (operation 1210), compares a level of the input audio signal Sin for each sub-frequency band with a threshold for the sub-frequency band (operation 1220), and generates the stability determination signal Sm according to a comparison result (operation 1230). Operations 1210-1230 may be performed by a stability determining unit (for example, stability determining unit 110).
- If the level of the input audio signal Sin in at least one sub-frequency band is equal to or greater than the threshold, the input audio signal Sin may be determined to be unstable. If the input audio signal Sin is determined to be unstable, the stability determination signal Sm may be generated as a signal of a first level.
- Sigma-delta modulation is performed on the input audio signal Sin (operation 1240), and the first modulation signal Sout1 is output according to the stability determination signal Sm generated in operation 1210 (operation 1250).
- The audio signal processing method 1200 may further include adjusting (not shown) at least one of a coefficient of an NTF applied during sigma-delta modulation and a level of sigma-delta modulation according to the comparison result of operation 1220.
- The audio signal processing method 1200 of FIG. 12 corresponds to the operations described above and performed by the audio signal processing apparatuses described with reference to FIGS. 1 and 11. Thus, redundant descriptions thereof are omitted.
- While the present inventive concept has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present inventive concept as defined by the following claims.
Claims (20)
- An audio signal processing apparatus comprising:a stability determining unit that compares a level of an input audio signal for each of at least one sub-frequency band with a threshold for the sub-frequency band, and generates a stability determination signal according to a result of the comparisons; anda sigma-delta modulation unit that sigma-delta modulates the input audio signal according to the stability determination signal, and outputs a first modulation signal.
- The apparatus of claim 1, wherein each of the at least one sub-frequency band has a different threshold which is set for each sub-frequency band as a value in proportion to a frequency value of the one sub-frequency band.
- The apparatus of claim 2, further comprising:a delay unit that receives the input audio signal, compensates the input audio signal for a time taken to determine stability in the stability determining unit, and outputs the compensated input audio signal to the sigma-delta modulation unit.
- The apparatus of claim 2, wherein the stability determining unit determines the input audio signal in a sub-frequency band to be unstable if a level of the input audio signal in the sub-frequency band is equal to or greater than the threshold for the sub-frequency band, and sets a level of the stability determination signal to indicate that the input audio signal is unstable.
- The apparatus of claim 2, wherein the stability determining unit comprises:a detecting unit that divides a frequency band of the input audio signal into the at least one sub-frequency band, and compares the level of the input audio signal for each of the at least one sub-frequency band with the threshold for the sub-frequency band; andan adjusting unit that determines stability of the input audio signal and generates the stability determination signal according to the result of the comparisons.
- The apparatus of claim 2, wherein the sigma-delta modulation unit comprises:a loop filter that integrates the input audio signal and outputs the integrated input audio signal; anda quantization unit that quantizes the output signal of the loop filter and generates the first modulation signal.
- The apparatus of claim 6, wherein the sigma-delta modulation unit further comprises:a feedback loop that feeds back the first modulation signal and outputs a first feedback signal; anda summing unit that subtracts the first feedback signal from the input audio signal and outputs the subtracted input audio signal.
- The apparatus of claim 5, wherein the detecting unit comprises:a signal level detecting unit that divides the frequency band of the input audio signal into a plurality of sub-frequency bands, and compares the input audio signal for each of the plurality of sub-frequency bands with the threshold for the sub-frequency band for a period; anda counter unit that accumulates a result of the comparison over the period.
- The apparatus of claim 5, wherein the detecting unit comprises:a frequency converting unit that converts the input audio signal into a frequency band signal; anda level detecting unit that compares the level of the input audio signal for each of the at least one sub-frequency band with the threshold for the sub-frequency band by using the frequency band signal.
- The apparatus of claim 2, further comprising:a driving signal generating unit that generates at least one driving signal used to control a switching amplifying operation according to the first modulation signal; anda power switching amplifier comprising at least one switching device that turns on or off in response to a corresponding one of the at least one driving signal, performing the switching amplifying operation, and outputting an amplified audio signal corresponding to the input audio signal by using the at least one switching device,wherein the at least one switching device comprises at least one of a gallium nitride (GaN) transistor, a gallium arsenide (GaAs) transistor, and a silicon carbide (SiC) transistor.
- The apparatus of claim 10, further comprising:a feedback loop that outputs a feedback signal obtained by attenuating and delaying the amplified audio signal to the sigma-delta modulation unit in order to compensate for at least one of a delay and a gain of the amplified audio signal.
- The apparatus of claim 1, wherein the stability determining unit generates the stability determination signal such that at least one of a signal-to-noise ratio (SNR) value and a stability value of the sigma-delta modulation unit is adjusted according to the result of the comparison.
- The apparatus of claim 1, wherein the stability determining unit generates the stability determination signal such that at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit is adjusted according to the result of the comparison.
- The apparatus of claim 1, wherein the stability determining unit generates the stability determination signal of a first level if the level of the input audio signal in a sub-frequency band of the at least one sub-frequency band is equal to or greater than the threshold for the sub-frequency band, and generates the stability determination signal of a second level if the level of the input audio signal in the sub-frequency band is less than the threshold for the sub-frequency band.
- The apparatus of claim 14, wherein the sigma-delta modulation unit receives the stability determination signal of the first level and adjusts at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit such that oscillation that occurs during sigma-delta modulation is reduced.
- The apparatus of claim 14, wherein the sigma-delta modulation unit receives the stability determination signal of the second level and adjusts at least one of a coefficient of a noise transfer function (NTF) of the sigma-delta modulation unit and an order of the sigma-delta modulation unit such that a signal-to-noise ratio (SNR) value of the sigma-delta modulation unit increases.
- An audio signal processing method comprising:dividing a frequency band of an input audio signal into at least one sub-frequency band;comparing a level of the input audio signal for each of the at least one sub-frequency band with a threshold for the sub-frequency band;generating a stability determination signal according to a result of the comparing;performing sigma-delta modulation on the input audio signal according to the stability determination signal; andoutputting the sigma-delta modulated signal as a first modulation signal.
- The method of claim 17, wherein each of the at least one sub-frequency band has a different threshold which is set for each sub-frequency band as a value in proportion to a frequency value of the sub-frequency band.
- The method of claim 17, wherein the generating of the stability determination signal comprises:determining the input audio signal to be unstable if a level of the input audio signal is equal to or greater than the threshold for the sub-frequency band.
- The method of claim 17, wherein the outputting of the first modulation signal comprises:adjusting at least one of a coefficient of a noise transfer function (NTF) applied during sigma-delta modulation and an order of sigma-delta modulation according to the result of the comparing.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110076168A KR101853818B1 (en) | 2011-07-29 | 2011-07-29 | Method for processing audio signal and apparatus for processing audio signal thereof |
PCT/KR2012/005941 WO2013019019A2 (en) | 2011-07-29 | 2012-07-25 | Audio signal processing method and audio signal processing apparatus therefor |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2737477A2 true EP2737477A2 (en) | 2014-06-04 |
EP2737477A4 EP2737477A4 (en) | 2015-04-01 |
EP2737477B1 EP2737477B1 (en) | 2016-06-29 |
Family
ID=47597250
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12820823.8A Not-in-force EP2737477B1 (en) | 2011-07-29 | 2012-07-25 | Audio signal processing method and audio signal processing apparatus therefor |
Country Status (6)
Country | Link |
---|---|
US (1) | US9184708B2 (en) |
EP (1) | EP2737477B1 (en) |
JP (1) | JP5815863B2 (en) |
KR (1) | KR101853818B1 (en) |
CN (1) | CN103843061B (en) |
WO (1) | WO2013019019A2 (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101853818B1 (en) * | 2011-07-29 | 2018-06-15 | 삼성전자주식회사 | Method for processing audio signal and apparatus for processing audio signal thereof |
KR20130142801A (en) * | 2012-06-20 | 2013-12-30 | 안국약품 주식회사 | NOVEL COMPOUNDS OR PHARMACEUTICALLY ACCEPTABLE SALTS THEREOF INHIBITING ACTIVITY OF 11β-HSD1 (11β-HYDROXYSTEROID DEHYDROGENASE TYPE 1) ENZYME, PREPARATION METHOD THEREOF AND PHARMACEUTICAL COMPOSITION CONTAINING THE SAME AS AN ACTIVE INGREDIENT |
US9794703B2 (en) | 2014-06-27 | 2017-10-17 | Cochlear Limited | Low-power active bone conduction devices |
CN106816158B (en) | 2015-11-30 | 2020-08-07 | 华为技术有限公司 | Voice quality assessment method, device and equipment |
CN106936976B (en) * | 2015-12-30 | 2020-12-04 | 北京小米移动软件有限公司 | Electronic device |
US10313218B2 (en) * | 2017-08-11 | 2019-06-04 | 2236008 Ontario Inc. | Measuring and compensating for jitter on systems running latency-sensitive audio signal processing |
CN110085215B (en) * | 2018-01-23 | 2021-06-08 | 中国科学院声学研究所 | Language model data enhancement method based on generation countermeasure network |
US10181862B1 (en) * | 2018-01-24 | 2019-01-15 | Raytheon Company | Parameterizable bandpass delta-sigma modulator |
CN110197666B (en) * | 2019-05-30 | 2022-05-10 | 广东工业大学 | Voice recognition method and device based on neural network |
US11303295B1 (en) * | 2020-11-15 | 2022-04-12 | xMEMS Labs, Inc. | SDM encoder and related signal processing system |
US20240072821A1 (en) * | 2022-08-30 | 2024-02-29 | Texas Instruments Incorporated | Digital-to-time converter mismatch compensation |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5745061A (en) * | 1995-07-28 | 1998-04-28 | Lucent Technologies Inc. | Method of improving the stability of a sigma-delta modulator employing dither |
US20050007267A1 (en) * | 2003-07-09 | 2005-01-13 | Zogakis Thomas Nicholas | Multi-standard sigma-delta modulator |
JP2008054099A (en) * | 2006-08-25 | 2008-03-06 | Renesas Technology Corp | Semiconductor integrated circuit device |
US7525465B1 (en) * | 2008-02-19 | 2009-04-28 | Newport Media, Inc. | Reconfigurable and adaptive continuous time-sigma delta data converter |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5012244A (en) | 1989-10-27 | 1991-04-30 | Crystal Semiconductor Corporation | Delta-sigma modulator with oscillation detect and reset circuit |
JPH0715281A (en) * | 1993-06-25 | 1995-01-17 | Matsushita Electric Ind Co Ltd | Noise shaping device |
JP2945570B2 (en) * | 1993-10-29 | 1999-09-06 | シャープ株式会社 | Signal processing device |
JP3432718B2 (en) * | 1997-09-30 | 2003-08-04 | シャープ株式会社 | Delta-sigma modulation circuit |
US6600789B1 (en) | 1997-10-09 | 2003-07-29 | Atmel Corporation | Signal processing method and device |
FI103745B (en) * | 1997-10-09 | 1999-08-31 | Atmel Corp | Signal processing method and device |
US6791404B1 (en) * | 1999-07-01 | 2004-09-14 | Broadcom Corporation | Method and apparatus for efficient mixed signal processing in a digital amplifier |
US6426714B1 (en) * | 2001-06-26 | 2002-07-30 | Nokia Corporation | Multi-level quantizer with current mode DEM switch matrices and separate DEM decision logic for a multibit sigma delta modulator |
US7053700B2 (en) * | 2003-06-02 | 2006-05-30 | Nortel Networks Limited | High-efficiency amplifier and method |
GB2406008B (en) * | 2003-09-15 | 2008-04-02 | Wolfson Ltd | Class D amplifier |
JP4115959B2 (en) * | 2004-03-30 | 2008-07-09 | シャープ株式会社 | Delta-sigma modulation circuit and amplifier having the same |
US7928876B2 (en) * | 2004-04-09 | 2011-04-19 | Audioasics A/S | Sigma delta modulator |
JP4580348B2 (en) * | 2006-01-31 | 2010-11-10 | 富士通株式会社 | Analog-to-digital converter |
CN101610085A (en) * | 2009-07-23 | 2009-12-23 | 复旦大学 | The audio frequency sigma-delta modulator of continuous time |
KR101853818B1 (en) * | 2011-07-29 | 2018-06-15 | 삼성전자주식회사 | Method for processing audio signal and apparatus for processing audio signal thereof |
-
2011
- 2011-07-29 KR KR1020110076168A patent/KR101853818B1/en active IP Right Grant
-
2012
- 2012-07-25 JP JP2014523836A patent/JP5815863B2/en not_active Expired - Fee Related
- 2012-07-25 EP EP12820823.8A patent/EP2737477B1/en not_active Not-in-force
- 2012-07-25 CN CN201280048160.2A patent/CN103843061B/en not_active Expired - Fee Related
- 2012-07-25 WO PCT/KR2012/005941 patent/WO2013019019A2/en active Application Filing
- 2012-07-30 US US13/561,798 patent/US9184708B2/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5745061A (en) * | 1995-07-28 | 1998-04-28 | Lucent Technologies Inc. | Method of improving the stability of a sigma-delta modulator employing dither |
US20050007267A1 (en) * | 2003-07-09 | 2005-01-13 | Zogakis Thomas Nicholas | Multi-standard sigma-delta modulator |
JP2008054099A (en) * | 2006-08-25 | 2008-03-06 | Renesas Technology Corp | Semiconductor integrated circuit device |
US7525465B1 (en) * | 2008-02-19 | 2009-04-28 | Newport Media, Inc. | Reconfigurable and adaptive continuous time-sigma delta data converter |
Non-Patent Citations (1)
Title |
---|
See also references of WO2013019019A2 * |
Also Published As
Publication number | Publication date |
---|---|
CN103843061B (en) | 2017-09-01 |
JP2014529092A (en) | 2014-10-30 |
KR20130014201A (en) | 2013-02-07 |
CN103843061A (en) | 2014-06-04 |
WO2013019019A2 (en) | 2013-02-07 |
US9184708B2 (en) | 2015-11-10 |
EP2737477B1 (en) | 2016-06-29 |
KR101853818B1 (en) | 2018-06-15 |
EP2737477A4 (en) | 2015-04-01 |
WO2013019019A3 (en) | 2013-04-11 |
JP5815863B2 (en) | 2015-11-17 |
US20130028448A1 (en) | 2013-01-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2013019019A2 (en) | Audio signal processing method and audio signal processing apparatus therefor | |
WO2013058529A1 (en) | Method and apparatus for outputting an audio signal | |
EP1120904B1 (en) | Power amplifier using upstream signal information | |
WO2014116068A1 (en) | Method and apparatus for controlling gain in communicaton system supproting beam forming scheme | |
WO2015168926A1 (en) | Power adjustment apparatus and method | |
KR101663970B1 (en) | Time alignment for an amplification stage | |
US8253489B2 (en) | Amplifier, transmitter, and method for compensating gain | |
WO2020032363A1 (en) | Method and electronic device for adjusting output level of speaker on basis of distance from external electronic device | |
JPS5936458B2 (en) | Analog signal optical transmission method and device | |
WO2016052854A1 (en) | Apparatus and method for improving nonlinearity of power amplifier in wireless communication system | |
WO2012105789A2 (en) | Method of outputting audio signal and audio signal output apparatus using the method | |
WO2016171297A1 (en) | Distributed antenna system and remote device thereof | |
US6340914B1 (en) | Pilot-assisted amplifier linearization circuit | |
WO2010008188A2 (en) | Combination-type amplifier with multiple power sources | |
WO2019083267A2 (en) | Semiconductor apparatus for reading and outputting signal of sensor | |
WO2021029699A1 (en) | Repeater and operation method therefor | |
US7091782B2 (en) | Radio apparatus comprising an amplifier for radio-frequency signals, amplifier for radio-frequency signals and method for amplifying such signals | |
JP3827130B2 (en) | Feed forward amplifier | |
WO2021085891A1 (en) | Device for amplifying loudness within limited output level, and control method therefor | |
KR102071224B1 (en) | Radiometer | |
KR200161218Y1 (en) | Apparatus for eliminating noise at transforming hifi to normal vice versa | |
WO2018139807A1 (en) | Apparatus and method for converting output current of current buffer into digital code | |
WO2013062319A2 (en) | Method for transmitting and receiving signals and device for same | |
JPH06318869A (en) | Video signal use a/d conversion circuit and agc circuit | |
AU1959597A (en) | Error path control for feed-forward amplifier |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20140129 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20150303 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/00 20130101AFI20150225BHEP Ipc: G11B 20/10 20060101ALI20150225BHEP Ipc: H03M 3/00 20060101ALI20150225BHEP Ipc: H03F 3/217 20060101ALI20150225BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20160318 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 809652 Country of ref document: AT Kind code of ref document: T Effective date: 20160715 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012020076 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160929 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160629 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160930 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 809652 Country of ref document: AT Kind code of ref document: T Effective date: 20160629 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161029 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161031 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012020076 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160731 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160731 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 |
|
26N | No opposition filed |
Effective date: 20170330 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20170505 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160725 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160829 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160725 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160929 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20120725 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160629 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20190621 Year of fee payment: 8 Ref country code: DE Payment date: 20190620 Year of fee payment: 8 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602012020076 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20200725 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200725 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210202 |