EP0809236A1 - Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method - Google Patents
Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method Download PDFInfo
- Publication number
- EP0809236A1 EP0809236A1 EP96201348A EP96201348A EP0809236A1 EP 0809236 A1 EP0809236 A1 EP 0809236A1 EP 96201348 A EP96201348 A EP 96201348A EP 96201348 A EP96201348 A EP 96201348A EP 0809236 A1 EP0809236 A1 EP 0809236A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- arrangement
- quality
- time
- differential
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/69—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for evaluating synthetic or decoded voice signals
Definitions
- the invention relates to a device for determining the quality of an output signal to be generated by a signal processing circuit with respect to a reference signal, which device is provided with a first series circuit having a first input for receiving the output signal and is provided with a second series circuit having a second input for receiving the reference signal and is provided with a combining circuit, coupled to a first output of the first series circuit and to a second output of the second series circuit, for generating a quality signal, which first series circuit is provided with
- Such a device is disclosed in the first reference: J. Audio Eng. Soc., Vol. 40, No. 12, December 1992, in particular "A Perceptual Audio Quality Measure Based on a Psychoacoustic Sound Representation" by John G. Beerends and Jan A. Stemerdink, pages 963 - 978, more particularly Figure 7.
- the device described therein determines the quality of an output signal to be generated by a signal processing circuit, such as, for example, a coder/decoder, or codec, with respect to a reference signal.
- Said reference signal is, for example, an input signal to be presented to the signal processing circuit, although the possibilities also include using as reference signal a pre-calculated ideal version of the output signal.
- the first signal parameter is generated as a function of time and frequency by means of the first signal processing arrangement, associated with the first series circuit, in response to the output signal, after which the first signal parameter is compressed by means of the first compressing arrangement associated with the first series circuit.
- intermediate operational processing of said first signal parameter should not be ruled out at all.
- the second signal parameter is compressed by means of the second compressing arrangement associated with the second series circuit in response to the reference signal. In this connection, too, further operational processing of said second signal parameter should not be ruled out at all.
- the differential signal is determined by means of the differential arrangement associated with the combining circuit, after which the quality signal is generated by integrating the differential signal with respect to frequency by means of the integrating arrangement associated with the combining circuit and by then integrating the integrated differential signal with respect to time by means of the time-averaging arrangement associated with the combining circuit.
- Such a device has, inter alia, the disadvantage that the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers have a poor correlation.
- the object of the invention is, inter alia, to provide a device of the type mentioned in the preamble, the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers having a better correlation.
- the device according to the invention has the characteristic that the combining circuit comprises
- the invention is based, inter alia, on the insight that the poor correlation between objective quality signals to be assessed by means of known devices and subjective quality signals to be assessed by human observers is the consequence, inter alia, of the fact that certain distortions are found to be more objectionable by human observers than other distortions, and is further based, inter alia, on the insight that, inside the combining circuit, some (time-intervals of) signals are more relevant than other (time-intervals of) signals.
- the problem of the poor correlation is thus solved by distinguishing more relevant signals from less relevant signals.
- a first embodiment of the device according to the invention has the characteristic that the comparing arrangement and the selecting arrangement are situated between the integrating arrangement and the time-averaging arrangement for comparing, per time-interval, the integrated differential signal with the other signal having a predefined value and for in case the integrated differential signal being larger than the other signal supplying the integrated differential signal to the time-averaging arrangement and for in case the integrated differential signal being smaller than the other signal not supplying the integrated differential signal to the time-averaging arrangement.
- the integrated differential signal can be compared with the other signal having a predefined value.
- a second embodiment of the device according to the invention has the characteristic that the comparing arrangement and the selecting arrangement are coupled to an output of the time-averaging arrangement for comparing a quality signal associated with a left channel of the signal processing circuit with a quality signal associated with a right channel of the signal processing circuit and for selecting the quality signal having the largest value.
- a quality signal associated with a left channel of the signal processing circuit can be compared with a quality signal associated with a right channel of the signal processing circuit and the quality signal having the largest value can be selected. Due to the fact that according to this embodiment the signal processing circuit has got a left and a right channel, two quality signals will have to be determined: one for the left channel, and one for the right channel. This can be done by either letting the device according to the invention determine the quality of an entire left output signal and then letting said device determine the quality of an entire right output signal, or by, per time-interval, letting said device determine the quality of the left and right output signals.
- a third embodiment of the device according to the invention has the characteristic that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected.
- the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected, the greater relevance of the left output signal of the signal processing circuit with respect to the right output signal is stressed.
- a fourth embodiment of the device according to the invention has the characteristic that the selecting arrangement is provided with a multiplying arrangement for multiplying the selected quality signal with a signal having a value which depends upon at least a correlation between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel.
- the selecting arrangement with a multiplying arrangement for multiplying the selected quality signal with a signal having a value which depends upon at least a correlation between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel, a very good correlation is obtained between the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers.
- first embodiment on the one hand and the second, third and fourth embodiment on the other hand can be regarded to be independent embodiments, the best correlation will be obtained in case the first, second, third and fourth embodiments are used together.
- the second signal parameter is generated as a function of both time and frequency.
- the input signal to be presented to the signal processing circuit such as, for example, a coder/decoder, or codec, whose quality is to be determined, is used as reference signal, in contrast to when a second signal processing arrangement is not used, in which case a pre-calculated ideal version of the output signal should be used as reference signal.
- the signal parameter is generated as a function of time and frequency by the first and/or second signal processing arrangement as a result of using the multiplying arrangement and the transforming arrangement, which transforming arrangement also performs, for example, the absolute-value determination.
- the signal parameter is generated as a function of time and frequency by the first and/or second signal processing arrangement as a result of using the subband filtering arrangement which also performs, for example, the absolute-value determination.
- the signal parameter generated by the first and/or second signal processing arrangement and represented by means of a time spectrum and a frequency spectrum is converted into a signal parameter represented by means of a time spectrum and a Bark spectrum by using the converting arrangement.
- the invention furthermore relates to a method for determining the quality of an output signal to be generated by a signal processing circuit with respect to a reference signal, which method comprises the following steps of
- a third embodiment of the method according to the invention has the characteristic that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected.
- a fourth embodiment of the method according to the invention has the characteristic that the selected quality signal is multiplied with a signal having a value which depends upon at least a correlation between differential signals which have been integrated with respect to frequency and associated with the left channel and differential signals which have been integrated with respect to frequency and associated with the right channel.
- the device according to the invention shown in Figure 1 comprises a first signal processing arrangement 1 having a first input 7 for receiving an output signal originating from a signal processing circuit such as, for example, a coder/decoder, or codec.
- a first output of first signal processing arrangement 1 is connected via a coupling 9 to a first input of a scaling circuit 3.
- the device according to the invention furthermore comprises a second signal processing arrangement 2 having a second input 8 for receiving an input signal to be fed to the signal processing circuit such as, for example, the coder/decoder, or codec.
- a second output of second signal processing arrangement 2 is connected via a coupling 10 to a second input of scaling circuit 3.
- a first output of scaling circuit 3 is connected via a coupling 11 to a first input of a first compressing arrangement 4, and a second output of scaling circuit 3 is connected via a coupling 12 to a second input of a second compressing arrangement 5.
- a first output of first compressing arrangement 4 is connected via a coupling 13 to a first input of a combining circuit 6, and a second output of second compressing arrangement 5 is connected via a coupling 16 to a second input of combining circuit 6.
- a third output of scaling circuit 3 is connected via a coupling 14 to a third input of combining circuit 6, and the second output of second compressing arrangement 5, or coupling 16, is connected via a coupling 15 to a fourth input of combining circuit 6 which has an output 17 for generating a quality signal.
- First signal processing arrangement 1 and first compressing arrangement 4 jointly correspond to a first series circuit
- second signal processing arrangement 2 and second compressing arrangement 5 jointly correspond to a second series circuit.
- the known first (or second) signal processing arrangement 1 (or 2) shown in Figure 2 comprises a first (or second) multiplying arrangement 20 for multiplying in the time domain the output signal (or input signal) to be fed to the first input 7 (or second input 8) of the first (or second) signal processing arrangement 1 (or 2) and originating from the signal processing circuit such as, for example, the coder/decoder, or codec, by a window function, a first (or second) transforming arrangement 21, coupled to the first (or second) multiplying arrangement 20, for transforming the signal originating from the first (or second) multiplying arrangement 20 to the frequency domain, a first (or second) absolute-value arrangement 22 for determining the absolute value of the signal originating from the first (or second) transforming arrangement 21 for generating a first (or second) positive signal parameter as a function of time and frequency, a first (or second) converting arrangement 23 for converting the first (or second) positive signal parameter originating from the first (or second) absolute-value arrangement 22 and represented by means of a time spectrum and
- the known first (or second) compressing arrangement 4 (or 5) shown in Figure 3 receives via coupling 11 (or 12) a signal parameter which is fed to a first (or second) input of a first (or second) adder 30, a first (or second) output of which is connected via a coupling 31, on the one hand, to a first (or second) input of a first (or second) multiplier 32 and, on the other hand, to a first (or second) nonlinear convoluting arrangement 36 which is furthermore connected to a first (or second) compressing unit 37 for generating via coupling 13 (or 16) a first (or second) compressed signal parameter.
- First (or second) multiplier 32 has a further first (or second) input for receiving a feed signal and has a first (or second) output which is connected to a first (or second) input of a first (or second) delay arrangement 34, a first (or second) output of which is coupled to a further first (or second) input of the first (or second) adder 30.
- the scaling circuit 3 shown in Figure 4 comprises a further integrating arrangement 40, a first input of which is connected to the first input of scaling circuit 3 and consequently to coupling 9 for receiving a first series circuit signal (the first signal parameter represented by means of a time spectrum and a Bark spectrum) and a second input of which is connected to the second input of scaling circuit 3 and consequently to coupling 10 for receiving a second series circuit signal (the second signal parameter represented by means of a time spectrum and a Bark spectrum).
- a first output of further integrating arrangement 40 for generating the integrated first series circuit signal is connected to a first input of a further comparing arrangement 41 and a second output of further integrating arrangement 40 for generating the integrated second series circuit signal is connected to a second input of further comparing arrangement 41.
- the first input of scaling circuit 3 is connected to the first output and, via scaling circuit 3, coupling 9 is consequently connected through to coupling 11.
- the second input of scaling circuit 3 is connected to a first input of a further scaling unit 42 and a second output is connected to an output of further scaling unit 42 and, via scaling circuit 3, coupling 10 is consequently connected through to coupling 12 via further scaling unit 42.
- An output of further comparing arrangement 41 for generating a control signal is connected to a control input of further scaling unit 42.
- the first input of scaling circuit 3, or coupling 9 or coupling 11 is connected to a first input of a ratio-determining arrangement 43 and the output of further scaling unit 42, or coupling 12, is connected to a second input of ratio-determining arrangement 43, an output of which is connected to the third output of scaling circuit 3 and consequently to coupling 14 for generating a further scaling signal.
- the combining circuit 6 shown in Figures 5 and 6 comprises a still further comparing arrangement 50, a first input of which is connected to the first input of combining circuit 6 for receiving the first compressed signal parameter via coupling 13 and a second input of which is connected to the second input of combining circuit 6 for receiving the second compressed signal parameter via coupling 16.
- the first input of combining circuit 6 is furthermore connected to a first input of a differential arrangement 54,56.
- An output of still further comparing arrangement 50 for generating a scaling signal is connected via a coupling 51 to a control input of scaling arrangement 52, an input of which is connected to the second input of combining circuit 6 for receiving the second compressed signal parameter via coupling 16 and an output of which is connected via a coupling 53 to a second input of differential arrangement 54,56 for determining a differential signal on the basis of the mutually scaled compressed signal parameters.
- a third input of the differential arrangement 54,56 is connected to the fourth input of the combining circuit 6 for receiving, via coupling 15, the second compressed signal parameter to be received via coupling 16.
- Differential arrangement 54,56 comprises a differentiator 54 for generating a differential signal and a further absolute-value arrangement 56 for determining the absolute value of the differential signal, an output of which is connected to an input of scaling unit 57, a control input of which is connected to the third input of combining circuit 6 for receiving the further scaling signal via coupling 14.
- An output of scaling unit 57 is connected to an input of an integrating arrangement 58 for integrating the scaled absolute value of the differential signal with respect to frequency.
- an output of integrating arrangement 58 is coupled to an input of selecting arrangement 61 and to a first input of comparing arrangement 60.
- a second input of comparing arrangement 60 is coupled to a connection 62 for receiving an other signal having a predefined value.
- An output of comparing arrangement 60 is coupled, via a connection 63, to a control input of selecting arrangement 61.
- An output of selecting arrangement 61 is coupled to an input of a time-averaging arrangement 59, an output of which is connected to the output 17 of combining circuit 6 for generating the quality signal.
- an output of integrating arrangement 58 is coupled to an input of a time-averaging arrangement 59, of which a first output is connected via a connection 72 to a first input of selecting arrangement 71 and a second output is connected via a connection 73 to a second input of selecting arrangement 71.
- the output of integrating arrangement 58 is also coupled to a third input of selecting arrangement 71 via a connection 75.
- the respective first and second outputs of time-averaging arrangement 59 are further coupled via the respective connections 72 and 73 to respective first and second inputs of comparing arrangement 70, of which an output is coupled via a connection 74 to a control input of selecting arrangement 71, of which an output is connected to the output 17 of combining circuit 6 for generating the quality signal.
- a standard device for determining the quality of the output signal to be generated by the signal processing circuit such as, for example, the coder/decoder, or codec, which standard device is formed without the scaling circuit 3 shown in greater detail in Figure 4, the couplings 10 and 12 consequently being mutually connected through, and which known device is formed using a standard combining circuit 6, the third input of differential arrangement 54,56 and scaling unit 57 and the comparing arrangement 60 and/or 70 and selecting arrangement 61 and/or 71, shown in greater detail in Figures 5 and 6, consequently being missing, is as follows and, indeed, as also described in the first reference.
- the output signal of the signal processing circuit such as, for example, the coder/decoder, or codec, is fed to input 7, after which the first signal processing circuit 1 converts said output signal into a first signal parameter represented by means of a time spectrum and a Bark spectrum.
- first multiplying arrangement 20 which multiplies the output signal represented by means of a time spectrum by a window function represented by means of a time spectrum, after which the signal thus obtained and represented by means of a time spectrum is transformed by means of first transforming arrangement 21 to the frequency domain, for example by means of an FFT, or fast Fourier transform, after which the absolute value of the signal thus obtained and represented by means of a time spectrum and a frequency spectrum is determined by means of the first absolute-value arrangement 22, for example by squaring, after which the signal parameter thus obtained and represented by means of a time spectrum and a frequency spectrum is converted by means of first converting arrangement 23 into a signal parameter represented by means of a time spectrum and a Bark spectrum, for example by resampling on the basis of a nonlinear frequency scale, also referred to as Bark scale, which signal parameter is then adjusted by means of first discounting arrangement 24 to a hearing function, or is filtered, for example by multiplying by a characteristic represented by means of a Bark spectrum.
- the first signal parameter thus obtained and represented by means of a time spectrum and a Bark spectrum is then converted by means of the first compressing arrangement 4 into a first compressed signal parameter represented by means of a time spectrum and a Bark spectrum.
- the input signal of the signal processing circuit such as, for example, the coder/decoder, or codec
- the second signal processing circuit 2 converts said input signal into a second signal parameter represented by means of a time spectrum and a Bark spectrum, and the latter is converted by means of the second compressing arrangement 5 into a second compressed signal parameter represented by means of a time spectrum and a Bark spectrum.
- the first and second compressed signal parameters are then fed via the respective couplings 13 and 16 to combining circuit 6, it being assumed for the time being that this is a standard combining circuit which lacks the third input of differential arrangement 54,56 and scaling unit 57 shown in greater detail in Figure 5.
- the two compressed signal parameters are integrated by still further comparing arrangement 50 and mutually compared, after which still further comparing arrangement 50 generates the scaling signal which represents, for example, the average ratio between the two compressed signal parameters.
- Said scaling signal is fed to scaling arrangement 52 which, in response thereto, scales the second compressed signal parameter (that is to say, increases or reduces it as a function of the scaling signal).
- scaling arrangement 52 could also be used, in a manner known to the person skilled in the art, for scaling the first compressed signal parameter instead of for scaling the second compressed signal parameter and use could furthermore be made, in a manner known to the person skilled in the art, of two scaling arrangements for mutually scaling the two compressed signal parameters at the same time.
- the differential signal is derived by means of differentiator 54 from the mutually scaled compressed signal parameters, the absolute value of which differential signal is then determined by means of further absolute-value arrangement 56.
- the signal thus obtained is integrated by means of integrator 58 with respect to a Bark spectrum and is integrated by means of time-averaging arrangement 59 with respect to a time spectrum and generated by means of output 17 as quality signal which indicates in an objective manner the quality of the signal processing circuit such as, for example, the coder/decoder or codec.
- an improved device for determining the quality of the output signal to be generated by the signal processing circuit such as, for example, the coder/decoder, or codec
- the signal processing circuit such as, for example, the coder/decoder, or codec
- the first series circuit signal (the first signal parameter represented by means of a time spectrum and a Bark spectrum) to be received via coupling 9 and the first input of scaling circuit 3 is fed to the first input of further integrating arrangement 40 and the second series circuit signal (the second signal parameter represented by means of a time spectrum and a Bark spectrum) to be received via the coupling 10 and the second input of scaling circuit 3 is fed to the second input of further integrating arrangement 40, which integrates the two series circuit signals with respect to frequency, after which the integrated first series circuit signal is fed via the first output of further integrating arrangement 40 to the first input of further comparing arrangement 41 and the integrated second series circuit signal is fed via the second output of further integrating arrangement 40 to the second input of further comparing arrangement 41.
- the latter compares the two integrated series circuit signals and generates, in response thereto, the control signal which is fed to the control input of further scaling unit 42.
- the latter scales the second series circuit signal (the second signal parameter represented by means of a time spectrum and a Bark spectrum) to be received via coupling 10 and the second input of scaling circuit 3 as a function of said control signal (that is to say increases or reduces the amplitude of said second series circuit signal) and generates [sic] the thus scaled second series circuit signal via the output of further scaling unit 42 to the second output of scaling circuit 3, while the first input of scaling arrangement 3 is connected through in this example in a direct manner to the first output of scaling circuit 3.
- the first series circuit signal and the scaled second series circuit signal respectively are passed via scaling circuit 3 to first compressing arrangement 4 and second compressing arrangement 5, respectively.
- ratio-determining arrangement 43 is capable of assessing the mutual ratio of the first series circuit signal and the scaled second series circuit signal and of generating a further scaling signal as a function thereof by means of the output of ratio-determining arrangement 43, which further scaling signal is fed via the third output of scaling circuit 3 and consequently via coupling 14 to the third input of combining circuit 6.
- Said further scaling signal is fed in combining circuit 6 to scaling unit 57 which scales, as a function of said further scaling signal, the absolute value of the differential signal originating from the differential arrangement 54,56 (that is to say increases or reduces the amplitude of said absolute value).
- scaling unit 57 which scales, as a function of said further scaling signal, the absolute value of the differential signal originating from the differential arrangement 54,56 (that is to say increases or reduces the amplitude of said absolute value).
- differentiator 54 or further absolute-value arrangement 56
- a further adjusting arrangement not shown in the figures, for example in the form of a subtracting circuit which somewhat reduces the amplitude of the differential signal.
- the amplitude of the differential signal is reduced as a function of a series circuit signal, just as in this example it is reduced as a function of the scaled and compressed second signal parameter originating from second compressing arrangement 5, as a result of which integrating arrangement 58 and time-averaging arrangement 59 function still better.
- the already very good correlation is improved still further.
- ratio-determining arrangement 43 could also be placed between couplings 13 and 16 (in other words between compressing arrangements 4 and 5, on the one hand, and combining circuit 6 on the other hand). In this case, the correlation is improved by using the results of both compressing arrangements 4 and 5 in a better way.
- a device for determining the quality of the output signal to be generated by the signal processing circuit such as, for example, the coder/decoder, or codec, which device according to the invention is consequently formed with either at least the first embodiment of the combining circuit 6 shown in greater detail in Figure 5 and comprising comparing arrangement 60 and selecting arrangement 70, or at least the second embodiment of the combining circuit 6 shown in greater detail in Figure 6 and comprising comparing arrangement 61 and selecting arrangement 71, is as described above, supplemented by what follows.
- the differential signal which has been integrated with respect to frequency by integrating arrangement 58 is supplied to comparing arrangement 60 and selecting arrangement 61.
- Comparing arrangement 60 compares, for each time-interval of for example 40 msec., a value of said signal with an other signal having a predefined value.
- comparing arrangement 60 controls selecting arrangement 61 such that the integrated differential signal is supplied (or multiplied by a large number) to time-averaging arrangement 59.
- comparing arrangement 60 controls selecting arrangement 61 such that the integrated differential signal is not supplied (or multiplied by a small number) to time-averaging arrangement 59. Due to this, the greater relevance of (time-intervals of) signals indicating much distortion is stressed with respect to (time-intervals of) signals indicating little distortion, which results in better correlation.
- the differential signal which has been integrated with respect to frequency by integrating arrangement 58 is supplied to time-averaging arrangement 59 and to the third input of selecting arrangement 71.
- Time-averaging arrangement generates two quality signals, a first quality signal associated with a left channel of the signal processing circuit, and a second quality signal associated with a right channel of the signal processing circuit. This can be done by either letting the device according to the invention determine the quality of an entire left output signal and then letting said device determine the quality of an entire right output signal, or by, per time-interval (of for example 10 sec.), letting said device determine the quality of firstly the left and secondly the right output signals.
- per time-interval of for example 10 sec.
- Comparing arrangement 70 compares these two quality signals.
- the selecting arrangement 71 is controlled such that the second quality signal associated with the right channel is selected.
- the selecting arrangement 71 is controlled such that the first quality signal associated with the left channel is selected.
- the selected quality signal is multiplied with a signal for example having a value (1.2-c) 4 which depends upon at least a correlation (c) between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel.
- selecting arrangement 70 comprises for example a multiplying arrangement for multiplying the selected quality signal with said value, and a correlating arrangement for correlating both integrated differential signals, and a memory for storing integrated differential signals. Due to this, the disturbance of distortions causing binaural image shift is stressed.
- first signal processing arrangement 1 The components shown in Figure 2 of first signal processing arrangement 1 are described, as stated earlier, adequately and in a manner known to the person skilled in the art in the first reference.
- a digital output signal which originates from the signal processing circuit such as, for example, the coder/decoder, or codec, and which is, for example, discrete both in time and in amplitude is multiplied by means of first multiplying arrangement 20 by a window function such as, for example, a so-called cosine square function represented by means of a time spectrum, after which the signal thus obtained and represented by means of a time spectrum is transformed by means of first transforming arrangement 21 to the frequency domain, for example by an FFT, or fast Fourier transform, after which the absolute value of the signal thus obtained and represented by means of a time spectrum and a frequency spectrum is determined by means of the first absolute-value arrangement 22, for example by squaring.
- a window function such as, for example, a so-called cosine square function represented by means of a time spectrum
- a power density function per time/frequency unit is thus obtained.
- An alternative way of obtaining said signal is to use a subband filtering arrangement for filtering the digital output signal, which subband filtering arrangement generates, after determining an absolute value, a signal parameter as a function of time and frequency in the form of the power density function per time/frequency unit.
- First converting arrangement 23 converts said power density function per time/frequency unit, for example by resampling on the basis of a nonlinear frequency scale, also referred to as Bark scale, into a power density function per time/Bark unit, which conversion is described comprehensively in Appendix A of the first reference, and first discounting arrangement 24 multiplies said power density function per time/Bark unit, for example by a characteristic, represented by means of a Bark spectrum, for performing an adjustment on a hearing function.
- a nonlinear frequency scale also referred to as Bark scale
- first compressing arrangement 4 The components, shown in Figure 3, of first compressing arrangement 4 are, as stated earlier, described adequately and in a manner known to the person skilled in the art in the first reference.
- the power density function per time/Bark unit adjusted to a hearing function is multiplied by means of multiplier 32 by an exponentially decreasing signal such as, for example, exp ⁇ -T/ ⁇ (z) ⁇ .
- T is equal to 50% of the length of the window function and consequently represents half of a certain time interval, after which certain time interval first multiplying arrangement 20 always multiplies the output signal by a window function represented by means of a time spectrum (for example, 50% of 40 msec is 20 msec).
- ⁇ (z) is a characteristic which is represented by means of the Bark spectrum and is shown in detail in Figure 6 of the first reference.
- First delay arrangement 34 delays the product of this multiplication by a delay time of length T, or half of the certain time interval.
- First nonlinear convolution arrangement 36 convolutes the signal supplied by a spreading function represented by means of a Bark spectrum, or spreads a power density function represented per time/Bark unit along a Bark scale, which is described comprehensively in Appendix B of the first reference.
- First compressing unit 37 compresses the signal supplied in the form of a power density function represented per time/Bark unit with a function which, for example, raises the power density function represented per time/Bark unit to the power ⁇ , where 0 ⁇ ⁇ ⁇ 1.
- Further integrating arrangement 40 comprises, for example, two separate integrators which separately integrate the two series circuit signals supplied by means of a Bark spectrum, after which further comparing arrangement 41 in the form of, for example, a divider, divides the two integrated signals by one another and feeds the division result or the inverse division result as control signal to further scaling unit 42 which, in the form of, for example, a multiplier or a divider, multiplies or divides the second series circuit signal by the division result or the inverse division result in order to make the two series circuit signals, viewed on average, of equal size.
- further comparing arrangement 41 in the form of, for example, a divider, divides the two integrated signals by one another and feeds the division result or the inverse division result as control signal to further scaling unit 42 which, in the form of, for example, a multiplier or a divider, multiplies or divides the second series circuit signal by the division result or the inverse division result in order to make the two series circuit signals, viewed on average, of equal size.
- Ratio-determining arrangement 43 receives the first and the scaled second series circuit signal in the form of compressed, spread power density functions represented per time/Bark unit and divides them by one another to generate the further scaling signal in the form of the division result represented per time/Bark unit or the inverse thereof, depending on whether scaling unit 57 is constructed as multiplier or as divider.
- Still further comparing arrangement 50 comprises, for example, two separate integrators which separately integrate the two series circuit signals supplied over, for example, three separate portions of a Bark spectrum and comprises, for example, a divider which divides the two integrated signals by one another per portion of the Bark spectrum and feeds the division result or the inverse division result as scaling signal to scaling arrangement 52 which, in the form of, for example, a multiplier or a divider, multiplies or divides the respective series circuit signal by the division result or the inverse division result in order to make the two series circuit signals, viewed on average, of equal size per portion of the Bark spectrum. All this is described comprehensively in Appendix F of the first reference.
- Differentiator 54 determines the difference between the two mutually scaled series circuit signals.
- said difference if the difference is negative, said difference can then be augmented by a constant value and, if the difference is positive, said difference can be reduced by a constant value, for example by detecting whether it is less or greater than the value zero and then adding or subtracting the constant value. It is, however, also possible first to determine the absolute value of the difference by means of further absolute-value arrangement 56 and then to deduct the constant value from said absolute value, in which connection a negative final result must obviously not be permitted to be obtained. In this last case, absolute-value arrangement 56 should be provided with a subtracting circuit. Furthermore, it is possible, according to the improved device, to discount from the difference a (portion of a) series circuit signal in a similar manner instead of the constant value or together with the constant value.
- integrating arrangement 58 integrates the signal originating from scaling unit 57 with respect to a Bark spectrum and comparing arrangement 60 compares the value of the integrated differential signal (comprising for example one value per time-interval of 40 msec.) with the predefined value of the other signal arriving via connection 62.
- selecting arrangement 61 blocks said integrated differential signal or supplies said integrated differential signal to time-averaging arrangement 59 which integrates the signal thus obtained with respect to a time spectrum, as a result of which the quality signal is obtained which has a value which is the smaller, the higher the quality of the signal processing circuit is.
- selecting arrangement 61 could be in the form of a switch, or for example in the form of a multiplier for multiplying said integrated differential signal with a small or a large number.
- integrating arrangement 58 integrates the signal originating from scaling unit 57 with respect to a Bark spectrum and time-averaging arrangement 59 integrates the signal thus obtained with respect to a time spectrum, as a result of which the first and second quality signals are obtained which have a value which is the smaller, the higher the quality of the left and right channel of the signal processing circuit is.
- Comparing arrangement 70 compares both quality signals, and in response to the comparison result selecting means 71 select one of both quality signals.
- Selecting means 71 comprise a memory for storing integrated differential signals, a correlating arrangement for correlating integrated differential signals associated with the left channel and integrated differential signals associated with the right channel, resulting in a value c, a calculating arrangement for calculating the value (1.2-c) 4 , and a multiplying arrangement for multiplying the selected quality signal with said value (1.2-c) 4 .
- the correlation between the objective quality signal to be assessed by means of the device according to the invention and a subjective quality signal to be assessed by human observers is improved by expanding the combining circuit 6 of the device with comparing arrangement 60 and/or 70 and selecting arrangement 61 and/or 71.
- Two factors can be viewed separately from one another:
- the signal processing circuit could be a codec, in which case the input signal is the reference signal with respect to which the quality of the output signal should be determined.
- the signal processing circuit could also be an equalizer, in which connection the quality of the output signal should be determined with respect to a reference signal which is calculated on the basis of an already existing virtually ideal equalizer or is simply calculated.
- the signal processing circuit could even be a loudspeaker, in which case a smooth output signal could be used as reference signal, with respect to which the quality of a sound output signal is then determined (scaling already takes place automatically in the device according to the invention).
- the signal processing circuit could furthermore be a loudspeaker computer model which is used to design loudspeakers on the basis of values to be set in the loudspeaker computer model, in which connection a low-volume output signal of said loudspeaker computer model serves as the reference signal and in which connection a high-volume output signal of said loudspeaker computer model then serves as the output signal of the signal processing circuit.
- a loudspeaker computer model which is used to design loudspeakers on the basis of values to be set in the loudspeaker computer model, in which connection a low-volume output signal of said loudspeaker computer model serves as the reference signal and in which connection a high-volume output signal of said loudspeaker computer model then serves as the output signal of the signal processing circuit.
- the second signal processing arrangement of the second series circuit could be omitted as a result of the fact that the operations to be performed by the second signal processing arrangement can be discounted in calculating the reference signal.
Abstract
Description
- The invention relates to a device for determining the quality of an output signal to be generated by a signal processing circuit with respect to a reference signal, which device is provided with a first series circuit having a first input for receiving the output signal and is provided with a second series circuit having a second input for receiving the reference signal and is provided with a combining circuit, coupled to a first output of the first series circuit and to a second output of the second series circuit, for generating a quality signal, which first series circuit is provided with
- a first signal processing arrangement, coupled to the first input of the first series circuit, for generating a first signal parameter as a function of time and frequency, and
- a first compressing arrangement, coupled to the first signal processing arrangement, for compressing a first signal parameter and for generating a first compressed signal parameter, which second series circuit is provided with
- a second compressing arrangement, coupled to the second input, for generating a second compressed signal parameter, which combining circuit is provided with
- a differential arrangement, coupled to the two compressing arrangements, for determining a differential signal on the basis of the compressed signal parameters,
- an integrating arrangement, coupled to the differential arrangement, for integrating the differential signal with respect to frequency, and
- a time-averaging arrangement, coupled to the integrating arrangement, for generating the quality signal by integrating the integrated differential signal with respect to time.
- Such a device is disclosed in the first reference: J. Audio Eng. Soc., Vol. 40, No. 12, December 1992, in particular "A Perceptual Audio Quality Measure Based on a Psychoacoustic Sound Representation" by John G. Beerends and Jan A. Stemerdink, pages 963 - 978, more particularly Figure 7. The device described therein determines the quality of an output signal to be generated by a signal processing circuit, such as, for example, a coder/decoder, or codec, with respect to a reference signal. Said reference signal is, for example, an input signal to be presented to the signal processing circuit, although the possibilities also include using as reference signal a pre-calculated ideal version of the output signal. The first signal parameter is generated as a function of time and frequency by means of the first signal processing arrangement, associated with the first series circuit, in response to the output signal, after which the first signal parameter is compressed by means of the first compressing arrangement associated with the first series circuit. In this connection, intermediate operational processing of said first signal parameter should not be ruled out at all. The second signal parameter is compressed by means of the second compressing arrangement associated with the second series circuit in response to the reference signal. In this connection, too, further operational processing of said second signal parameter should not be ruled out at all. Of both compressed signal parameters the differential signal is determined by means of the differential arrangement associated with the combining circuit, after which the quality signal is generated by integrating the differential signal with respect to frequency by means of the integrating arrangement associated with the combining circuit and by then integrating the integrated differential signal with respect to time by means of the time-averaging arrangement associated with the combining circuit.
- Such a device has, inter alia, the disadvantage that the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers have a poor correlation.
- The object of the invention is, inter alia, to provide a device of the type mentioned in the preamble, the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers having a better correlation.
- For this purpose, the device according to the invention has the characteristic that the combining circuit comprises
- a comparing arrangement for comparing at least one of said signals with an other signal, and
- a selecting arrangement for, in dependence of the comparison result, making a selection.
- As a result of providing the device with the comparing arrangement and the selecting arrangement, more relevant signals can be distinguished from less relevant signals. Due to said comparing and selecting, a good correlation is obtained between the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers.
- The invention is based, inter alia, on the insight that the poor correlation between objective quality signals to be assessed by means of known devices and subjective quality signals to be assessed by human observers is the consequence, inter alia, of the fact that certain distortions are found to be more objectionable by human observers than other distortions, and is further based, inter alia, on the insight that, inside the combining circuit, some (time-intervals of) signals are more relevant than other (time-intervals of) signals.
- The problem of the poor correlation is thus solved by distinguishing more relevant signals from less relevant signals.
- A first embodiment of the device according to the invention has the characteristic that the comparing arrangement and the selecting arrangement are situated between the integrating arrangement and the time-averaging arrangement for comparing, per time-interval, the integrated differential signal with the other signal having a predefined value and for in case the integrated differential signal being larger than the other signal supplying the integrated differential signal to the time-averaging arrangement and for in case the integrated differential signal being smaller than the other signal not supplying the integrated differential signal to the time-averaging arrangement.
- As a result of placing the comparing arrangement and the selecting arrangement between the integrating arrangement and the time-averaging arrangement, per time-interval, the integrated differential signal can be compared with the other signal having a predefined value. By supplying the integrated differential signal to the time-averaging arrangement in case the integrated differential signal is larger than the other signal and not supplying the integrated differential signal to the time-averaging arrangement in case the integrated differential signal is smaller than the other signal, the greater relevance of integrated differential signals having a relative high value is stressed.
- Instead of supplying or not supplying, respectively, an integrated differential signal to the time-averaging arrangement, it would also be possible to, for example, multiply an integrated differential signal with a large number or a small number, respectively, etc., to stress the greater relevance of certain signals.
- A second embodiment of the device according to the invention has the characteristic that the comparing arrangement and the selecting arrangement are coupled to an output of the time-averaging arrangement for comparing a quality signal associated with a left channel of the signal processing circuit with a quality signal associated with a right channel of the signal processing circuit and for selecting the quality signal having the largest value.
- By placing the comparing arrangement and the selecting arrangement in series with an output of the time-averaging arrangement, a quality signal associated with a left channel of the signal processing circuit can be compared with a quality signal associated with a right channel of the signal processing circuit and the quality signal having the largest value can be selected. Due to the fact that according to this embodiment the signal processing circuit has got a left and a right channel, two quality signals will have to be determined: one for the left channel, and one for the right channel. This can be done by either letting the device according to the invention determine the quality of an entire left output signal and then letting said device determine the quality of an entire right output signal, or by, per time-interval, letting said device determine the quality of the left and right output signals.
- A third embodiment of the device according to the invention has the characteristic that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected.
- Due to the fact that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected, the greater relevance of the left output signal of the signal processing circuit with respect to the right output signal is stressed.
- A fourth embodiment of the device according to the invention has the characteristic that the selecting arrangement is provided with a multiplying arrangement for multiplying the selected quality signal with a signal having a value which depends upon at least a correlation between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel.
- By providing the selecting arrangement with a multiplying arrangement for multiplying the selected quality signal with a signal having a value which depends upon at least a correlation between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel, a very good correlation is obtained between the objective quality signal to be assessed by means of said device and a subjective quality signal to be assessed by human observers.
- Although the first embodiment on the one hand and the second, third and fourth embodiment on the other hand can be regarded to be independent embodiments, the best correlation will be obtained in case the first, second, third and fourth embodiments are used together.
- A fifth embodiment of the device according to the invention has the characteristic that the second series circuit is furthermore provided with
- a second signal processing arrangement, coupled to the second input, for generating a second signal parameter as a function of both time and frequency, the second compressing arrangement being coupled to the second signal processing arrangement in order to compress the second signal parameter.
- If the second series circuit is furthermore provided with the second signal processing arrangement, the second signal parameter is generated as a function of both time and frequency. In this case, the input signal to be presented to the signal processing circuit, such as, for example, a coder/decoder, or codec, whose quality is to be determined, is used as reference signal, in contrast to when a second signal processing arrangement is not used, in which case a pre-calculated ideal version of the output signal should be used as reference signal.
- A sixth embodiment of the device according to the invention has the characteristic that a signal processing arrangement is provided with
- a multiplying arrangement for multiplying in the time domain a signal to be fed to an input of the signal processing arrangement by a window function, and
- a transforming arrangement, coupled to the multiplying arrangement, for transforming a signal originating from the multiplying arrangement to the frequency domain, which transforming arrangement generates, after determining an absolute value, a signal parameter as a function of time and frequency.
- In this connection, the signal parameter is generated as a function of time and frequency by the first and/or second signal processing arrangement as a result of using the multiplying arrangement and the transforming arrangement, which transforming arrangement also performs, for example, the absolute-value determination.
- A seventh embodiment of the device according to the invention has the characteristic that a signal processing arrangement is provided with
- a subband filtering arrangement for filtering a signal to be fed to an input of the signal processing arrangement, which subband filtering arrangement generates, after determining an absolute value, a signal parameter as a function of time and frequency.
- In this connection, the signal parameter is generated as a function of time and frequency by the first and/or second signal processing arrangement as a result of using the subband filtering arrangement which also performs, for example, the absolute-value determination.
- An eighth embodiment of the device according to the invention has the characteristic that the signal processing arrangement is furthermore provided with
- a converting arrangement for converting a signal parameter represented by means of a time spectrum and a frequency spectrum into a signal parameter represented by means of a time spectrum and a Bark spectrum.
- In this connection, the signal parameter generated by the first and/or second signal processing arrangement and represented by means of a time spectrum and a frequency spectrum is converted into a signal parameter represented by means of a time spectrum and a Bark spectrum by using the converting arrangement.
- The invention furthermore relates to a method for determining the quality of an output signal to be generated by a signal processing circuit with respect to a reference signal, which method comprises the following steps of
- generating a first signal parameter as a function of time and frequency in response to the output signal,
- compressing a first signal parameter and generating a second compressed signal parameter,
- generating a second compressed signal parameter in response to the reference signal,
- determining a differential signal on the basis of the compressed signal parameters, and
- generating a quality signal by integrating the differential signal with respect to frequency and time.
- The method according to the invention has the characteristic that the method furthermore comprises the following step of
- comparing at least one of said signals with an other signal, and making a selection in dependence of the comparison result.
- A first embodiment of the method according to the invention has the characteristic that the step of comparing comprises the step of
- comparing, per time-interval, the differential signal which has been integrated with respect to frequency with the other signal having a predefined value and in case the integrated differential signal being larger than the other signal integrating said integrated differential signal with respect to time and in case the differential signal which has been integrated with respect to frequency being smaller than the other signal not integrating said integrated differential signal with respect to time.
- A second embodiment of the method according to the invention has the characteristic that the step of comparing comprises the steps of
- comparing a quality signal associated with a left channel of the signal processing circuit with a quality signal associated with a right channel of the signal processing circuit, and
- selecting the quality signal having the largest value.
- A third embodiment of the method according to the invention has the characteristic that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected.
- A fourth embodiment of the method according to the invention has the characteristic that the selected quality signal is multiplied with a signal having a value which depends upon at least a correlation between differential signals which have been integrated with respect to frequency and associated with the left channel and differential signals which have been integrated with respect to frequency and associated with the right channel.
- A fifth embodiment of the method according to the invention has the characteristic that the step of generating a second compressed signal parameter in response to the reference signal comprises the following two steps of
- generating a second signal parameter in response to the reference signal as a function of both time and frequency, and
- compressing a second signal parameter.
-
- ■ J. Audio Eng. Soc., Vol. 40, No. 12, December 1992, in particular, "A Perceptual Audio Quality Measure Based on a Psychoacoustic Sound Representation" by John G. Beerends and Jan A. Stemerdink, pages 963 - 978
- ■ "Modelling a Cognitive Aspect in the Measurement of the Quality of Music Codecs", by John G. Beerends and Jan A. Stemerdink, presented at the 96th Convention 26 February - 1 March 1994, Amsterdam
- ■ US 4,860,360
- ■ EP 0 627 727
- ■ EP 0 417 739
- ■
DE 37 08 002 - ■ WO EP96 / 01102
- ■ WO EP96 / 01143
- ■ WO EP96 / 00849
- All the references including the literature cited in these references are deemed to be incorporated in this patent application.
- The invention will be explained in greater detail by reference to an exemplary embodiment shown in the figures. In the figures:
- Figure 1 shows a device according to the invention, comprising known signal processing arrangements, known compressing arrangements, a scaling circuit, and a combining circuit according to the invention,
- Figure 2 shows a known signal processing arrangement for use in the device according to the invention,
- Figure 3 shows a known compressing arrangement for use in the device according to the invention,
- Figure 4 shows a scaling circuit for use in the device according to the invention,
- Figure 5 shows a first embodiment of a combining circuit according to the invention for use in the device according to the invention, and
- Figure 6 shows a second embodiment of a combining circuit according to the invention for use in the device according to the invention.
- The device according to the invention shown in Figure 1 comprises a first
signal processing arrangement 1 having afirst input 7 for receiving an output signal originating from a signal processing circuit such as, for example, a coder/decoder, or codec. A first output of firstsignal processing arrangement 1 is connected via acoupling 9 to a first input of ascaling circuit 3. The device according to the invention furthermore comprises a secondsignal processing arrangement 2 having asecond input 8 for receiving an input signal to be fed to the signal processing circuit such as, for example, the coder/decoder, or codec. A second output of secondsignal processing arrangement 2 is connected via acoupling 10 to a second input of scalingcircuit 3. A first output of scalingcircuit 3 is connected via acoupling 11 to a first input of afirst compressing arrangement 4, and a second output of scalingcircuit 3 is connected via acoupling 12 to a second input of asecond compressing arrangement 5. A first output offirst compressing arrangement 4 is connected via acoupling 13 to a first input of a combiningcircuit 6, and a second output ofsecond compressing arrangement 5 is connected via acoupling 16 to a second input of combiningcircuit 6. A third output of scalingcircuit 3 is connected via acoupling 14 to a third input of combiningcircuit 6, and the second output ofsecond compressing arrangement 5, orcoupling 16, is connected via acoupling 15 to a fourth input of combiningcircuit 6 which has anoutput 17 for generating a quality signal. Firstsignal processing arrangement 1 andfirst compressing arrangement 4 jointly correspond to a first series circuit, and secondsignal processing arrangement 2 andsecond compressing arrangement 5 jointly correspond to a second series circuit. - The known first (or second) signal processing arrangement 1 (or 2) shown in Figure 2 comprises a first (or second) multiplying arrangement 20 for multiplying in the time domain the output signal (or input signal) to be fed to the first input 7 (or second input 8) of the first (or second) signal processing arrangement 1 (or 2) and originating from the signal processing circuit such as, for example, the coder/decoder, or codec, by a window function, a first (or second) transforming arrangement 21, coupled to the first (or second) multiplying arrangement 20, for transforming the signal originating from the first (or second) multiplying arrangement 20 to the frequency domain, a first (or second) absolute-value arrangement 22 for determining the absolute value of the signal originating from the first (or second) transforming arrangement 21 for generating a first (or second) positive signal parameter as a function of time and frequency, a first (or second) converting arrangement 23 for converting the first (or second) positive signal parameter originating from the first (or second) absolute-value arrangement 22 and represented by means of a time spectrum and a frequency spectrum into a first (or second) signal parameter represented by means of a time spectrum and a Bark spectrum, and a first (or second) discounting arrangement 24 for discounting a hearing function in the case of the first (or second) signal parameter originating from the first (or second) converting arrangement and represented by means of a time spectrum and a Bark spectrum, which signal parameter is then transmitted via the coupling 9 (or 10).
- The known first (or second) compressing arrangement 4 (or 5) shown in Figure 3 receives via coupling 11 (or 12) a signal parameter which is fed to a first (or second) input of a first (or second)
adder 30, a first (or second) output of which is connected via acoupling 31, on the one hand, to a first (or second) input of a first (or second)multiplier 32 and, on the other hand, to a first (or second) nonlinear convolutingarrangement 36 which is furthermore connected to a first (or second) compressingunit 37 for generating via coupling 13 (or 16) a first (or second) compressed signal parameter. First (or second)multiplier 32 has a further first (or second) input for receiving a feed signal and has a first (or second) output which is connected to a first (or second) input of a first (or second)delay arrangement 34, a first (or second) output of which is coupled to a further first (or second) input of the first (or second)adder 30. - The
scaling circuit 3 shown in Figure 4 comprises a further integratingarrangement 40, a first input of which is connected to the first input of scalingcircuit 3 and consequently tocoupling 9 for receiving a first series circuit signal (the first signal parameter represented by means of a time spectrum and a Bark spectrum) and a second input of which is connected to the second input of scalingcircuit 3 and consequently tocoupling 10 for receiving a second series circuit signal (the second signal parameter represented by means of a time spectrum and a Bark spectrum). A first output of further integratingarrangement 40 for generating the integrated first series circuit signal is connected to a first input of a further comparingarrangement 41 and a second output of further integratingarrangement 40 for generating the integrated second series circuit signal is connected to a second input of further comparingarrangement 41. The first input of scalingcircuit 3 is connected to the first output and, via scalingcircuit 3,coupling 9 is consequently connected through tocoupling 11. The second input of scalingcircuit 3 is connected to a first input of afurther scaling unit 42 and a second output is connected to an output of further scalingunit 42 and, via scalingcircuit 3,coupling 10 is consequently connected through tocoupling 12 via further scalingunit 42. An output of further comparingarrangement 41 for generating a control signal is connected to a control input of further scalingunit 42. The first input of scalingcircuit 3, orcoupling 9 orcoupling 11, is connected to a first input of a ratio-determiningarrangement 43 and the output of further scalingunit 42, orcoupling 12, is connected to a second input of ratio-determiningarrangement 43, an output of which is connected to the third output of scalingcircuit 3 and consequently tocoupling 14 for generating a further scaling signal. - The combining
circuit 6 shown in Figures 5 and 6 comprises a still further comparingarrangement 50, a first input of which is connected to the first input of combiningcircuit 6 for receiving the first compressed signal parameter viacoupling 13 and a second input of which is connected to the second input of combiningcircuit 6 for receiving the second compressed signal parameter viacoupling 16. The first input of combiningcircuit 6 is furthermore connected to a first input of adifferential arrangement arrangement 50 for generating a scaling signal is connected via acoupling 51 to a control input of scalingarrangement 52, an input of which is connected to the second input of combiningcircuit 6 for receiving the second compressed signal parameter viacoupling 16 and an output of which is connected via acoupling 53 to a second input ofdifferential arrangement differential arrangement circuit 6 for receiving, viacoupling 15, the second compressed signal parameter to be received viacoupling 16.Differential arrangement differentiator 54 for generating a differential signal and a further absolute-value arrangement 56 for determining the absolute value of the differential signal, an output of which is connected to an input of scalingunit 57, a control input of which is connected to the third input of combiningcircuit 6 for receiving the further scaling signal viacoupling 14. An output of scalingunit 57 is connected to an input of an integratingarrangement 58 for integrating the scaled absolute value of the differential signal with respect to frequency. - According to a first embodiment of combining circuit 6 (Figure 5), an output of integrating
arrangement 58 is coupled to an input of selectingarrangement 61 and to a first input of comparingarrangement 60. A second input of comparingarrangement 60 is coupled to aconnection 62 for receiving an other signal having a predefined value. An output of comparingarrangement 60 is coupled, via aconnection 63, to a control input of selectingarrangement 61. An output of selectingarrangement 61 is coupled to an input of a time-averagingarrangement 59, an output of which is connected to theoutput 17 of combiningcircuit 6 for generating the quality signal. - According to a second embodiment of combining circuit 6 (Figure 6), an output of integrating
arrangement 58 is coupled to an input of a time-averagingarrangement 59, of which a first output is connected via aconnection 72 to a first input of selectingarrangement 71 and a second output is connected via aconnection 73 to a second input of selectingarrangement 71. The output of integratingarrangement 58 is also coupled to a third input of selectingarrangement 71 via aconnection 75. The respective first and second outputs of time-averagingarrangement 59 are further coupled via therespective connections arrangement 70, of which an output is coupled via aconnection 74 to a control input of selectingarrangement 71, of which an output is connected to theoutput 17 of combiningcircuit 6 for generating the quality signal. - The operation of a standard device for determining the quality of the output signal to be generated by the signal processing circuit such as, for example, the coder/decoder, or codec, which standard device is formed without the
scaling circuit 3 shown in greater detail in Figure 4, thecouplings standard combining circuit 6, the third input ofdifferential arrangement unit 57 and the comparingarrangement 60 and/or 70 and selectingarrangement 61 and/or 71, shown in greater detail in Figures 5 and 6, consequently being missing, is as follows and, indeed, as also described in the first reference. - The output signal of the signal processing circuit such as, for example, the coder/decoder, or codec, is fed to
input 7, after which the firstsignal processing circuit 1 converts said output signal into a first signal parameter represented by means of a time spectrum and a Bark spectrum. This takes place by means of the first multiplyingarrangement 20 which multiplies the output signal represented by means of a time spectrum by a window function represented by means of a time spectrum, after which the signal thus obtained and represented by means of a time spectrum is transformed by means of first transformingarrangement 21 to the frequency domain, for example by means of an FFT, or fast Fourier transform, after which the absolute value of the signal thus obtained and represented by means of a time spectrum and a frequency spectrum is determined by means of the first absolute-value arrangement 22, for example by squaring, after which the signal parameter thus obtained and represented by means of a time spectrum and a frequency spectrum is converted by means of first convertingarrangement 23 into a signal parameter represented by means of a time spectrum and a Bark spectrum, for example by resampling on the basis of a nonlinear frequency scale, also referred to as Bark scale, which signal parameter is then adjusted by means offirst discounting arrangement 24 to a hearing function, or is filtered, for example by multiplying by a characteristic represented by means of a Bark spectrum. - The first signal parameter thus obtained and represented by means of a time spectrum and a Bark spectrum is then converted by means of the
first compressing arrangement 4 into a first compressed signal parameter represented by means of a time spectrum and a Bark spectrum. This takes place by means offirst adder 30,first multiplier 32 andfirst delay arrangement 34, the signal parameter represented by means of a time spectrum and a Bark spectrum being multiplied by a feed signal represented by means of a Bark spectrum such as, for example, an exponentially decreasing signal, after which the signal parameter thus obtained and represented by means of a time spectrum and a Bark spectrum is added, with a delay in time, to the signal parameter represented by means of a time spectrum and a Bark spectrum, after which the signal parameter thus obtained and represented by means of a time spectrum and a Bark spectrum is convoluted by means of first nonlinear convolutingarrangement 36 with a spreading function represented by means of a Bark spectrum, after which the signal parameter thus obtained and represented by means of a time spectrum and a Bark spectrum is compressed by means offirst compressing unit 37. - In a corresponding manner, the input signal of the signal processing circuit such as, for example, the coder/decoder, or codec, is fed to
input 8, after which the secondsignal processing circuit 2 converts said input signal into a second signal parameter represented by means of a time spectrum and a Bark spectrum, and the latter is converted by means of thesecond compressing arrangement 5 into a second compressed signal parameter represented by means of a time spectrum and a Bark spectrum. - The first and second compressed signal parameters, respectively, are then fed via the
respective couplings circuit 6, it being assumed for the time being that this is a standard combining circuit which lacks the third input ofdifferential arrangement unit 57 shown in greater detail in Figure 5. The two compressed signal parameters are integrated by still further comparingarrangement 50 and mutually compared, after which still further comparingarrangement 50 generates the scaling signal which represents, for example, the average ratio between the two compressed signal parameters. Said scaling signal is fed to scalingarrangement 52 which, in response thereto, scales the second compressed signal parameter (that is to say, increases or reduces it as a function of the scaling signal). Obviously, scalingarrangement 52 could also be used, in a manner known to the person skilled in the art, for scaling the first compressed signal parameter instead of for scaling the second compressed signal parameter and use could furthermore be made, in a manner known to the person skilled in the art, of two scaling arrangements for mutually scaling the two compressed signal parameters at the same time. The differential signal is derived by means ofdifferentiator 54 from the mutually scaled compressed signal parameters, the absolute value of which differential signal is then determined by means of further absolute-value arrangement 56. The signal thus obtained is integrated by means ofintegrator 58 with respect to a Bark spectrum and is integrated by means of time-averagingarrangement 59 with respect to a time spectrum and generated by means ofoutput 17 as quality signal which indicates in an objective manner the quality of the signal processing circuit such as, for example, the coder/decoder or codec. - The operation of an improved device for determining the quality of the output signal to be generated by the signal processing circuit such as, for example, the coder/decoder, or codec, which device according to the invention is consequently formed with the
scaling circuit 3 shown in greater detail in Figure 4, thecouplings circuit 6 according to the invention to which the third input ofdifferential arrangement unit 57 have consequently been added is as described above, supplemented by what follows. - The first series circuit signal (the first signal parameter represented by means of a time spectrum and a Bark spectrum) to be received via
coupling 9 and the first input of scalingcircuit 3 is fed to the first input of further integratingarrangement 40 and the second series circuit signal (the second signal parameter represented by means of a time spectrum and a Bark spectrum) to be received via thecoupling 10 and the second input of scalingcircuit 3 is fed to the second input of further integratingarrangement 40, which integrates the two series circuit signals with respect to frequency, after which the integrated first series circuit signal is fed via the first output of further integratingarrangement 40 to the first input of further comparingarrangement 41 and the integrated second series circuit signal is fed via the second output of further integratingarrangement 40 to the second input of further comparingarrangement 41. The latter compares the two integrated series circuit signals and generates, in response thereto, the control signal which is fed to the control input of further scalingunit 42. The latter scales the second series circuit signal (the second signal parameter represented by means of a time spectrum and a Bark spectrum) to be received viacoupling 10 and the second input of scalingcircuit 3 as a function of said control signal (that is to say increases or reduces the amplitude of said second series circuit signal) and generates [sic] the thus scaled second series circuit signal via the output of further scalingunit 42 to the second output of scalingcircuit 3, while the first input of scalingarrangement 3 is connected through in this example in a direct manner to the first output of scalingcircuit 3. In this example, the first series circuit signal and the scaled second series circuit signal, respectively are passed via scalingcircuit 3 tofirst compressing arrangement 4 andsecond compressing arrangement 5, respectively. - As a result of this further scaling, a good correlation is obtained between the objective quality signal to be assessed by means of the device according to the invention and a subjective quality signal to be assessed by human observers. This invention is based, inter alia, on the insight that the poor correlation between objective quality signals to be assesssed by means of known devices and subjective quality signals to be assessed by human observers is the consequence, inter alia, of the fact that certain distortions are found to be more objectionable by human observers than other distortions, which poor correlation is improved by using the two compressing arrangements, and is furthermore based, inter alia, on the insight that, as a result of using
scaling circuit 3, the two compressingarrangements arrangements scaling circuit 3. - As a result of the fact that the first input of scaling
circuit 3, orcoupling 9 orcoupling 11, is connected to the first input of ratio-determiningarrangement 43 and the output of further scalingunit 42, orcoupling 12, is connected to the second input of ratio-determiningarrangement 43, ratio-determiningarrangement 43 is capable of assessing the mutual ratio of the first series circuit signal and the scaled second series circuit signal and of generating a further scaling signal as a function thereof by means of the output of ratio-determiningarrangement 43, which further scaling signal is fed via the third output of scalingcircuit 3 and consequently viacoupling 14 to the third input of combiningcircuit 6. Said further scaling signal is fed in combiningcircuit 6 to scalingunit 57 which scales, as a function of said further scaling signal, the absolute value of the differential signal originating from thedifferential arrangement 54,56 (that is to say increases or reduces the amplitude of said absolute value). As a consequence thereof, the already improved correlation is improved further as a result of the fact an (amplitude) difference still present between the first series circuit signal and the scaled second series circuit signal in the combining circuit is discounted and integratingarrangement 58 and time-averagingarrangement 59 function better as a result. - A further improvement of the correlation is obtained if differentiator 54 (or further absolute-value arrangement 56) is provided with a further adjusting arrangement, not shown in the figures, for example in the form of a subtracting circuit which somewhat reduces the amplitude of the differential signal. Preferably, the amplitude of the differential signal is reduced as a function of a series circuit signal, just as in this example it is reduced as a function of the scaled and compressed second signal parameter originating from
second compressing arrangement 5, as a result of which integratingarrangement 58 and time-averagingarrangement 59 function still better. As a result, the already very good correlation is improved still further. - It is observed that ratio-determining
arrangement 43 could also be placed betweencouplings 13 and 16 (in other words between compressingarrangements circuit 6 on the other hand). In this case, the correlation is improved by using the results of both compressingarrangements - The operation of a device according to the invention for determining the quality of the output signal to be generated by the signal processing circuit such as, for example, the coder/decoder, or codec, which device according to the invention is consequently formed with either at least the first embodiment of the combining
circuit 6 shown in greater detail in Figure 5 and comprising comparingarrangement 60 and selectingarrangement 70, or at least the second embodiment of the combiningcircuit 6 shown in greater detail in Figure 6 and comprising comparingarrangement 61 and selectingarrangement 71, is as described above, supplemented by what follows. - In case of the first embodiment (Figure 5), the differential signal which has been integrated with respect to frequency by integrating
arrangement 58, is supplied to comparingarrangement 60 and selectingarrangement 61. Comparingarrangement 60 compares, for each time-interval of for example 40 msec., a value of said signal with an other signal having a predefined value. In case the integrated differential signal is larger (much distortion) than the other signal, comparingarrangement 60controls selecting arrangement 61 such that the integrated differential signal is supplied (or multiplied by a large number) to time-averagingarrangement 59. In case the integrated differential signal is smaller (little distortion) than the other signal, comparingarrangement 60controls selecting arrangement 61 such that the integrated differential signal is not supplied (or multiplied by a small number) to time-averagingarrangement 59. Due to this, the greater relevance of (time-intervals of) signals indicating much distortion is stressed with respect to (time-intervals of) signals indicating little distortion, which results in better correlation. - In case of the second embodiment (Figure 6), the differential signal which has been integrated with respect to frequency by integrating
arrangement 58, is supplied to time-averagingarrangement 59 and to the third input of selectingarrangement 71. Time-averaging arrangement generates two quality signals, a first quality signal associated with a left channel of the signal processing circuit, and a second quality signal associated with a right channel of the signal processing circuit. This can be done by either letting the device according to the invention determine the quality of an entire left output signal and then letting said device determine the quality of an entire right output signal, or by, per time-interval (of for example 10 sec.), letting said device determine the quality of firstly the left and secondly the right output signals. To a person skilled in the art it will be obvious that in at least one of both cases at least some of the circuits and/or arrangements will have to be provided with memories. - Comparing
arrangement 70 compares these two quality signals. In case the second quality signal associated with the right channel being larger than a sum of the first quality signal associated with the left channel and a signal having a further predefined value the selectingarrangement 71 is controlled such that the second quality signal associated with the right channel is selected. In case the second quality signal associated with the right channel being smaller than a sum of the first quality signal associated with the left channel and the signal having the further predefined value the selectingarrangement 71 is controlled such that the first quality signal associated with the left channel is selected. Then, inside selectingarrangement 71, the selected quality signal is multiplied with a signal for example having a value (1.2-c)4 which depends upon at least a correlation (c) between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel. Thereto, selectingarrangement 70 comprises for example a multiplying arrangement for multiplying the selected quality signal with said value, and a correlating arrangement for correlating both integrated differential signals, and a memory for storing integrated differential signals. Due to this, the disturbance of distortions causing binaural image shift is stressed. - The components shown in Figure 2 of first
signal processing arrangement 1 are described, as stated earlier, adequately and in a manner known to the person skilled in the art in the first reference. A digital output signal which originates from the signal processing circuit such as, for example, the coder/decoder, or codec, and which is, for example, discrete both in time and in amplitude is multiplied by means of first multiplyingarrangement 20 by a window function such as, for example, a so-called cosine square function represented by means of a time spectrum, after which the signal thus obtained and represented by means of a time spectrum is transformed by means of first transformingarrangement 21 to the frequency domain, for example by an FFT, or fast Fourier transform, after which the absolute value of the signal thus obtained and represented by means of a time spectrum and a frequency spectrum is determined by means of the first absolute-value arrangement 22, for example by squaring. Finally, a power density function per time/frequency unit is thus obtained. An alternative way of obtaining said signal is to use a subband filtering arrangement for filtering the digital output signal, which subband filtering arrangement generates, after determining an absolute value, a signal parameter as a function of time and frequency in the form of the power density function per time/frequency unit. First convertingarrangement 23 converts said power density function per time/frequency unit, for example by resampling on the basis of a nonlinear frequency scale, also referred to as Bark scale, into a power density function per time/Bark unit, which conversion is described comprehensively in Appendix A of the first reference, and first discountingarrangement 24 multiplies said power density function per time/Bark unit, for example by a characteristic, represented by means of a Bark spectrum, for performing an adjustment on a hearing function. - The components, shown in Figure 3, of
first compressing arrangement 4 are, as stated earlier, described adequately and in a manner known to the person skilled in the art in the first reference. The power density function per time/Bark unit adjusted to a hearing function is multiplied by means ofmultiplier 32 by an exponentially decreasing signal such as, for example,arrangement 20 always multiplies the output signal by a window function represented by means of a time spectrum (for example, 50% of 40 msec is 20 msec). In this expression, τ(z) is a characteristic which is represented by means of the Bark spectrum and is shown in detail in Figure 6 of the first reference.First delay arrangement 34 delays the product of this multiplication by a delay time of length T, or half of the certain time interval. Firstnonlinear convolution arrangement 36 convolutes the signal supplied by a spreading function represented by means of a Bark spectrum, or spreads a power density function represented per time/Bark unit along a Bark scale, which is described comprehensively in Appendix B of the first reference. First compressingunit 37 compresses the signal supplied in the form of a power density function represented per time/Bark unit with a function which, for example, raises the power density function represented per time/Bark unit to the power α, where 0 < α < 1. - The components, shown in Figure 4, of scaling
circuit 3 can be formed in a manner known to the person skilled in the art. Further integratingarrangement 40 comprises, for example, two separate integrators which separately integrate the two series circuit signals supplied by means of a Bark spectrum, after which further comparingarrangement 41 in the form of, for example, a divider, divides the two integrated signals by one another and feeds the division result or the inverse division result as control signal to further scalingunit 42 which, in the form of, for example, a multiplier or a divider, multiplies or divides the second series circuit signal by the division result or the inverse division result in order to make the two series circuit signals, viewed on average, of equal size. Ratio-determiningarrangement 43 receives the first and the scaled second series circuit signal in the form of compressed, spread power density functions represented per time/Bark unit and divides them by one another to generate the further scaling signal in the form of the division result represented per time/Bark unit or the inverse thereof, depending on whether scalingunit 57 is constructed as multiplier or as divider. - The components, shown in Figures 5 and 6, of combining
circuit 6 are, as stated earlier, described adequately and in a manner known to the person skilled in the art in the first reference, with the exception of thecomponent 57 and a portion ofcomponent 54 and comparingarrangement arrangement arrangement 50 comprises, for example, two separate integrators which separately integrate the two series circuit signals supplied over, for example, three separate portions of a Bark spectrum and comprises, for example, a divider which divides the two integrated signals by one another per portion of the Bark spectrum and feeds the division result or the inverse division result as scaling signal to scalingarrangement 52 which, in the form of, for example, a multiplier or a divider, multiplies or divides the respective series circuit signal by the division result or the inverse division result in order to make the two series circuit signals, viewed on average, of equal size per portion of the Bark spectrum. All this is described comprehensively in Appendix F of the first reference.Differentiator 54 determines the difference between the two mutually scaled series circuit signals. According to the improved device, if the difference is negative, said difference can then be augmented by a constant value and, if the difference is positive, said difference can be reduced by a constant value, for example by detecting whether it is less or greater than the value zero and then adding or subtracting the constant value. It is, however, also possible first to determine the absolute value of the difference by means of further absolute-value arrangement 56 and then to deduct the constant value from said absolute value, in which connection a negative final result must obviously not be permitted to be obtained. In this last case, absolute-value arrangement 56 should be provided with a subtracting circuit. Furthermore, it is possible, according to the improved device, to discount from the difference a (portion of a) series circuit signal in a similar manner instead of the constant value or together with the constant value. - According to the invention (Figure 5) integrating
arrangement 58 integrates the signal originating from scalingunit 57 with respect to a Bark spectrum and comparingarrangement 60 compares the value of the integrated differential signal (comprising for example one value per time-interval of 40 msec.) with the predefined value of the other signal arriving viaconnection 62. In response to the comparison result, selectingarrangement 61 blocks said integrated differential signal or supplies said integrated differential signal to time-averagingarrangement 59 which integrates the signal thus obtained with respect to a time spectrum, as a result of which the quality signal is obtained which has a value which is the smaller, the higher the quality of the signal processing circuit is. So, selectingarrangement 61 could be in the form of a switch, or for example in the form of a multiplier for multiplying said integrated differential signal with a small or a large number. - According to the invention (Figure 6) integrating
arrangement 58 integrates the signal originating from scalingunit 57 with respect to a Bark spectrum and time-averagingarrangement 59 integrates the signal thus obtained with respect to a time spectrum, as a result of which the first and second quality signals are obtained which have a value which is the smaller, the higher the quality of the left and right channel of the signal processing circuit is. Comparingarrangement 70 compares both quality signals, and in response to the comparison result selecting means 71 select one of both quality signals. Selecting means 71 comprise a memory for storing integrated differential signals, a correlating arrangement for correlating integrated differential signals associated with the left channel and integrated differential signals associated with the right channel, resulting in a value c, a calculating arrangement for calculating the value (1.2-c)4, and a multiplying arrangement for multiplying the selected quality signal with said value (1.2-c)4. - As already described earlier, the correlation between the objective quality signal to be assessed by means of the device according to the invention and a subjective quality signal to be assessed by human observers is improved by expanding the combining
circuit 6 of the device with comparingarrangement 60 and/or 70 and selectingarrangement 61 and/or 71. Two factors can be viewed separately from one another: - the use of comparing
arrangement 60 and selectingarrangement 61, and - the use of comparing
arrangement 70 and selectingarrangement 71. - The best correlation is obtained by simultaneous use of all the possibilities.
- The widest meaning should be reserved for the term signal processing circuit, in which connection, for example, all kinds of audio and/or video equipment can be considered. Thus, the signal processing circuit could be a codec, in which case the input signal is the reference signal with respect to which the quality of the output signal should be determined. The signal processing circuit could also be an equalizer, in which connection the quality of the output signal should be determined with respect to a reference signal which is calculated on the basis of an already existing virtually ideal equalizer or is simply calculated. The signal processing circuit could even be a loudspeaker, in which case a smooth output signal could be used as reference signal, with respect to which the quality of a sound output signal is then determined (scaling already takes place automatically in the device according to the invention). The signal processing circuit could furthermore be a loudspeaker computer model which is used to design loudspeakers on the basis of values to be set in the loudspeaker computer model, in which connection a low-volume output signal of said loudspeaker computer model serves as the reference signal and in which connection a high-volume output signal of said loudspeaker computer model then serves as the output signal of the signal processing circuit.
- In the case of a calculated reference signal, the second signal processing arrangement of the second series circuit could be omitted as a result of the fact that the operations to be performed by the second signal processing arrangement can be discounted in calculating the reference signal.
Claims (15)
- Device for determining the quality of an output signal to be generated by a signal processing circuit with respect to a reference signal, which device is provided with a first series circuit having a first input for receiving the output signal and is provided with a second series circuit having a second input for receiving the reference signal and is provided with a combining circuit, coupled to a first output of the first series circuit and to a second output of the second series circuit, for generating a quality signal, which first series circuit is provided with- a first signal processing arrangement, coupled to the first input of the first series circuit, for generating a first signal parameter as a function of time and frequency, and- a first compressing arrangement, coupled to the first signal processing arrangement, for compressing a first signal parameter and for generating a first compressed signal parameter, which second series circuit is provided with- a second compressing arrangement, coupled to the second input, for generating a second compressed signal parameter, which combining circuit is provided with- a differential arrangement, coupled to the two compressing arrangements, for determining a differential signal on the basis of the compressed signal parameters,- an integrating arrangement, coupled to the differential arrangement, for integrating the differential signal with respect to frequency, and- a time-averaging arrangement, coupled to the integrating arrangement, for generating the quality signal by integrating the integrated differential signal with respect to time, characterized in that the combining circuit comprises- a comparing arrangement for comparing at least one of said signals with an other signal, and- a selecting arrangement for, in dependence of the comparison result, making a selection.
- Device according to Claim 1, characterized in that the comparing arrangement and the selecting arrangement are situated between the integrating arrangement and the time-averaging arrangement for comparing, per time-interval, the integrated differential signal with the other signal having a predefined value and for in case the integrated differential signal being larger than the other signal supplying the integrated differential signal to the time-averaging arrangement and for in case the integrated differential signal being smaller than the other signal not supplying the integrated differential signal to the time-averaging arrangement.
- Device according to Claim 1, characterized in that the comparing arrangement and the selecting arrangement are coupled to an output of the time-averaging arrangement for comparing a quality signal associated with a left channel of the signal processing circuit with a quality signal associated with a right channel of the signal processing circuit and for selecting the quality signal having the largest value.
- Device according to Claim 3, characterized in that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected.
- Device according to Claim 4, characterized in that the selecting arrangement is provided with a multiplying arrangement for multiplying the selected quality signal with a signal having a value which depends upon at least a correlation between integrated differential signals associated with the left channel and integrated differential signals associated with the right channel.
- Device according to Claim 1, 2, 3, 4 or 5, characterized in that the second series circuit is furthermore provided with- a second signal processing arrangement, coupled to the second input, for generating a second signal parameter as a function of both time and frequency, the second compressing arrangement being coupled to the second signal processing arrangement in order to compress the second signal parameter.
- Device according to Claim 1, 2, 3, 4, 5 or 6, characterized in that a signal processing arrangement is provided with- a multiplying arrangement for multiplying in the time domain a signal to be fed to an input of the signal processing arrangement by a window function, and- a transforming arrangement, coupled to the multiplying arrangement, for transforming a signal originating from the multiplying arrangement to the frequency domain, which transforming arrangement generates, after determining an absolute value, a signal parameter as a function of time and frequency.
- Device according to Claim 1, 2, 3, 4, 5 or 6, characterized in that a signal processing arrangement is provided with- a subband filtering arrangement for filtering a signal to be fed to an input of the signal processing arrangement, which subband filtering arrangement generates, after determining an absolute value, a signal parameter as a function of time and frequency.
- Device according to Claim 7 or 8, characterized in that the signal processing arrangement is furthermore provided with- a converting arrangement for converting a signal parameter represented by means of a time spectrum and a frequency spectrum into a signal parameter represented by means of a time spectrum and a Bark spectrum.
- Method for determining the quality of an output signal to be generated by a signal processing circuit with respect to a reference signal, which method comprises the following steps of- generating a first signal parameter as a function of time and frequency in response to the output signal,- compressing a first signal parameter and generating a second compressed signal parameter,- generating a second compressed signal parameter in response to the reference signal,- determining a differential signal on the basis of the compressed signal parameters, and- generating a quality signal by integrating the differential signal with respect to frequency and time, characterized in that the method furthermore comprises the following step of- comparing at least one of said signals with an other signal, and making a selection in dependence of the comparison result.
- Method according to Claim 10, characterized in that the step of comparing comprises the step of- comparing, per time-interval, the differential signal which has been integrated with respect to frequency with the other signal having a predefined value and in case the integrated differential signal being larger than the other signal integrating said integrated differential signal with respect to time and in case the differential signal which has been integrated with respect to frequency being smaller than the other signal not integrating said integrated differential signal with respect to time.
- Method according to Claim 10, characterized in that the step of comparing comprises the steps of- comparing a quality signal associated with a left channel of the signal processing circuit with a quality signal associated with a right channel of the signal processing circuit, and- selecting the quality signal having the largest value.
- Method according to Claim 12, characterized in that in case the quality signal associated with the right channel being larger than a sum of the quality signal associated with the left channel and a signal having a further predefined value the quality signal associated with the right channel is selected and in case the quality signal associated with the right channel being smaller than a sum of the quality signal associated with the left channel and the signal having the further predefined value the quality signal associated with the left channel is selected.
- Method according to Claim 13, characterized in that the selected quality signal is multiplied with a signal having a value which depends upon at least a correlation between differential signals which have been integrated with respect to frequency and associated with the left channel and differential signals which have been integrated with respect to frequency and associated with the right channel.
- Method according to Claim 10, 11, 12, 13 or 14, characterized in that the step of generating a second compressed signal parameter in response to the reference signal comprises the following two steps of- generating a second signal parameter in response to the reference signal as a function of both time and frequency, and- compressing a second signal parameter.
Priority Applications (13)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AT96201348T ATE205009T1 (en) | 1996-05-21 | 1996-05-21 | APPARATUS AND METHOD FOR DETERMINING THE QUALITY OF AN OUTPUT SIGNAL TO BE GENERATED BY A SIGNAL PROCESSING CIRCUIT |
ES96201348T ES2161965T3 (en) | 1996-05-21 | 1996-05-21 | DEVICE AND PROCEDURE FOR THE DETERMINATION OF THE QUALITY OF AN OUTPUT SIGNAL, TO BE GENERATED BY A SIGNAL PROCESSING CIRCUIT. |
EP96201348A EP0809236B1 (en) | 1996-05-21 | 1996-05-21 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
DE69614829T DE69614829T2 (en) | 1996-05-21 | 1996-05-21 | Device and method for determining the quality of an output signal to be generated by a signal processing circuit |
AU31677/97A AU3167797A (en) | 1996-05-21 | 1997-05-16 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
DE69714585T DE69714585T2 (en) | 1996-05-21 | 1997-05-16 | DEVICE AND METHOD FOR DETERMINING THE QUALITY OF AN OUTPUT SIGNAL TO BE GENERATED BY A SIGNAL PROCESSING CIRCUIT |
JP54159097A JP3568538B2 (en) | 1996-05-21 | 1997-05-16 | Apparatus and method for determining characteristics of an output signal generated by a signal processing circuit |
CA002256064A CA2256064C (en) | 1996-05-21 | 1997-05-16 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
EP97927046A EP0901677B1 (en) | 1996-05-21 | 1997-05-16 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
PCT/EP1997/002712 WO1997044779A1 (en) | 1996-05-21 | 1997-05-16 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
AT97927046T ATE222015T1 (en) | 1996-05-21 | 1997-05-16 | APPARATUS AND METHOD FOR DETERMINING THE QUALITY OF AN OUTPUT SIGNAL TO BE GENERATED BY A SIGNAL PROCESSING CIRCUIT |
CN97196546.3A CN1121677C (en) | 1996-05-21 | 1997-05-16 | Device for determining quality of output signal to be generated by a signal processing circuit, and method therefor |
ES97927046T ES2182094T3 (en) | 1996-05-21 | 1997-05-16 | DEVICE FOR DETERMINING THE QUALITY OF AN OUTPUT SIGNAL TO BE GENERATED BY A SIGNAL TREATMENT CIRCUIT AND ASSOCIATED PROCEDURE. |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP96201348A EP0809236B1 (en) | 1996-05-21 | 1996-05-21 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
Publications (2)
Publication Number | Publication Date |
---|---|
EP0809236A1 true EP0809236A1 (en) | 1997-11-26 |
EP0809236B1 EP0809236B1 (en) | 2001-08-29 |
Family
ID=8223989
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP96201348A Expired - Lifetime EP0809236B1 (en) | 1996-05-21 | 1996-05-21 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
EP97927046A Expired - Lifetime EP0901677B1 (en) | 1996-05-21 | 1997-05-16 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP97927046A Expired - Lifetime EP0901677B1 (en) | 1996-05-21 | 1997-05-16 | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method |
Country Status (9)
Country | Link |
---|---|
EP (2) | EP0809236B1 (en) |
JP (1) | JP3568538B2 (en) |
CN (1) | CN1121677C (en) |
AT (2) | ATE205009T1 (en) |
AU (1) | AU3167797A (en) |
CA (1) | CA2256064C (en) |
DE (2) | DE69614829T2 (en) |
ES (2) | ES2161965T3 (en) |
WO (1) | WO1997044779A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19840548A1 (en) * | 1998-08-27 | 2000-03-02 | Deutsche Telekom Ag | Procedure for instrumental ("objective") language quality determination |
WO2001065543A1 (en) * | 2000-02-29 | 2001-09-07 | Telefonaktiebolaget Lm Ericsson (Publ) | Compensation for linear filtering using frequency weighting factors |
EP2048657A1 (en) * | 2007-10-11 | 2009-04-15 | Koninklijke KPN N.V. | Method and system for speech intelligibility measurement of an audio transmission system |
CN101053016B (en) * | 2004-09-20 | 2011-05-18 | 荷兰应用科学研究会(Tno) | Method and system for constructing a first frequency compensation input spacing power density function |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
NL1014075C2 (en) * | 2000-01-13 | 2001-07-16 | Koninkl Kpn Nv | Method and device for determining the quality of a signal. |
EP2733700A1 (en) * | 2012-11-16 | 2014-05-21 | Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO | Method of and apparatus for evaluating intelligibility of a degraded speech signal |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0417739A2 (en) * | 1989-09-11 | 1991-03-20 | Fujitsu Limited | Speech coding apparatus using multimode coding |
EP0673013A1 (en) * | 1994-03-18 | 1995-09-20 | Mitsubishi Denki Kabushiki Kaisha | Signal encoding and decoding system |
-
1996
- 1996-05-21 EP EP96201348A patent/EP0809236B1/en not_active Expired - Lifetime
- 1996-05-21 DE DE69614829T patent/DE69614829T2/en not_active Expired - Fee Related
- 1996-05-21 ES ES96201348T patent/ES2161965T3/en not_active Expired - Lifetime
- 1996-05-21 AT AT96201348T patent/ATE205009T1/en not_active IP Right Cessation
-
1997
- 1997-05-16 AU AU31677/97A patent/AU3167797A/en not_active Abandoned
- 1997-05-16 ES ES97927046T patent/ES2182094T3/en not_active Expired - Lifetime
- 1997-05-16 AT AT97927046T patent/ATE222015T1/en not_active IP Right Cessation
- 1997-05-16 CN CN97196546.3A patent/CN1121677C/en not_active Expired - Fee Related
- 1997-05-16 CA CA002256064A patent/CA2256064C/en not_active Expired - Fee Related
- 1997-05-16 WO PCT/EP1997/002712 patent/WO1997044779A1/en active IP Right Grant
- 1997-05-16 JP JP54159097A patent/JP3568538B2/en not_active Expired - Fee Related
- 1997-05-16 DE DE69714585T patent/DE69714585T2/en not_active Expired - Lifetime
- 1997-05-16 EP EP97927046A patent/EP0901677B1/en not_active Expired - Lifetime
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0417739A2 (en) * | 1989-09-11 | 1991-03-20 | Fujitsu Limited | Speech coding apparatus using multimode coding |
EP0673013A1 (en) * | 1994-03-18 | 1995-09-20 | Mitsubishi Denki Kabushiki Kaisha | Signal encoding and decoding system |
Non-Patent Citations (2)
Title |
---|
ALOKNATH DE ET AL: "RATE-DISTORTION FUNCTION FOR SPEECH CODING BASED ON PERCEPTUAL DISTORTION MEASURE", COMMUNICATION FOR GLOBAL USERS, INCLUDING A COMMUNICATIONS THEORY MINI CONFERENCE ORLANDO, DEC. 6 - 9, 1992, vol. 1 - 2 - 03, 6 December 1992 (1992-12-06), INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS, pages 452 - 456, XP000357828 * |
BEERENDS J G ET AL: "A PERCEPTUAL AUDIO QUALITY MESURE BASED ON A PSYCHOACOUSTIC SOUND REPRESENTATION", JOURNAL OF THE AUDIO ENGINEERING SOCIETY, vol. 40, no. 12, 1 December 1992 (1992-12-01), pages 963 - 978, XP000514954 * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19840548A1 (en) * | 1998-08-27 | 2000-03-02 | Deutsche Telekom Ag | Procedure for instrumental ("objective") language quality determination |
DE19840548C2 (en) * | 1998-08-27 | 2001-02-15 | Deutsche Telekom Ag | Procedures for instrumental language quality determination |
US7013266B1 (en) | 1998-08-27 | 2006-03-14 | Deutsche Telekom Ag | Method for determining speech quality by comparison of signal properties |
WO2001065543A1 (en) * | 2000-02-29 | 2001-09-07 | Telefonaktiebolaget Lm Ericsson (Publ) | Compensation for linear filtering using frequency weighting factors |
CN101053016B (en) * | 2004-09-20 | 2011-05-18 | 荷兰应用科学研究会(Tno) | Method and system for constructing a first frequency compensation input spacing power density function |
EP2048657A1 (en) * | 2007-10-11 | 2009-04-15 | Koninklijke KPN N.V. | Method and system for speech intelligibility measurement of an audio transmission system |
WO2009046949A1 (en) * | 2007-10-11 | 2009-04-16 | Koninklijke Kpn N.V. | Method and system for speech intelligibility measurement of an audio transmission system |
KR101148671B1 (en) * | 2007-10-11 | 2012-05-23 | 네덜란제 오르가니자티에 포오르 토에게파스트-나투우르베텐샤펠리즈크 온데르조에크 테엔오 | A method and system for speech intelligibility measurement of an audio transmission system |
Also Published As
Publication number | Publication date |
---|---|
ES2161965T3 (en) | 2001-12-16 |
WO1997044779A1 (en) | 1997-11-27 |
DE69614829D1 (en) | 2001-10-04 |
EP0809236B1 (en) | 2001-08-29 |
DE69614829T2 (en) | 2002-04-04 |
CA2256064A1 (en) | 1997-11-27 |
ES2182094T3 (en) | 2003-03-01 |
CA2256064C (en) | 2004-09-07 |
EP0901677B1 (en) | 2002-08-07 |
DE69714585D1 (en) | 2002-09-12 |
JP3568538B2 (en) | 2004-09-22 |
ATE222015T1 (en) | 2002-08-15 |
JP2000515985A (en) | 2000-11-28 |
CN1121677C (en) | 2003-09-17 |
EP0901677A1 (en) | 1999-03-17 |
ATE205009T1 (en) | 2001-09-15 |
DE69714585T2 (en) | 2003-04-03 |
CN1225738A (en) | 1999-08-11 |
AU3167797A (en) | 1997-12-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0815707B1 (en) | Signal quality determining device and method | |
US8638962B2 (en) | Method to reduce feedback in hearing aids | |
US6594307B1 (en) | Device and method for signal quality determination | |
EP0901677B1 (en) | Device for determining the quality of an output signal to be generated by a signal processing circuit, and also method | |
AU2021289742B2 (en) | Methods, apparatus, and systems for detection and extraction of spatially-identifiable subband audio sources | |
EP1766610A1 (en) | Method of evaluating perception intensity of an audio signal and a method of controlling an input audio signal on the basis of the evaluation | |
JP2004070240A (en) | Device, method, and program for time-base companding of audio signal | |
Ueda et al. | Amplitude compression method for a digital hearing aid using a composite filter | |
GB2403386A (en) | Method and apparatus for signal processing | |
Marzin et al. | A prediction of audio quality for personal audio devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LI LU NL PT SE |
|
17P | Request for examination filed |
Effective date: 19980526 |
|
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE KPN N.V. |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
RIC1 | Information provided on ipc code assigned before grant |
Free format text: 7G 10L 11/00 A, 7G 10L 19/00 B, 7G 10L 21/00 B |
|
17Q | First examination report despatched |
Effective date: 20000908 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LI LU NL PT SE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20010829 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20010829 |
|
REF | Corresponds to: |
Ref document number: 205009 Country of ref document: AT Date of ref document: 20010915 Kind code of ref document: T |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: ISLER & PEDRAZZINI AG |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 69614829 Country of ref document: DE Date of ref document: 20011004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20011129 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20011129 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20011130 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2161965 Country of ref document: ES Kind code of ref document: T3 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
EN | Fr: translation not filed | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020125 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20020521 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20020521 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
EN | Fr: translation not filed |
Free format text: BO 02/04 PAGES: 243, IL Y A LIEU DE SUPPRIMER: LA MENTION DE LA NON REMISE. LA REMISE EST PUBLIEE DANS LE PRESENT BOPI. |
|
ET | Fr: translation filed | ||
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20070514 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20070515 Year of fee payment: 12 Ref country code: CH Payment date: 20070515 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20070522 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20070529 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: BE Payment date: 20070531 Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PCAR Free format text: ISLER & PEDRAZZINI AG;POSTFACH 1772;8027 ZUERICH (CH) |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20070522 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20070525 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20070516 Year of fee payment: 12 |
|
BERE | Be: lapsed |
Owner name: KONINKLIJKE *KPN N.V. Effective date: 20080531 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20080521 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20081201 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080531 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080531 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20090119 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20081202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080521 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20080522 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080521 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080522 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080522 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080531 |