EP1458087B1 - Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal - Google Patents

Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal Download PDF

Info

Publication number
EP1458087B1
EP1458087B1 EP03405164A EP03405164A EP1458087B1 EP 1458087 B1 EP1458087 B1 EP 1458087B1 EP 03405164 A EP03405164 A EP 03405164A EP 03405164 A EP03405164 A EP 03405164A EP 1458087 B1 EP1458087 B1 EP 1458087B1
Authority
EP
European Patent Office
Prior art keywords
electrical circuit
signal
modulation
sum
evaluating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP03405164A
Other languages
German (de)
French (fr)
Other versions
EP1458087A1 (en
Inventor
Peter Seitz
Stephan Beer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Centre Suisse dElectronique et Microtechnique SA CSEM
Original Assignee
Centre Suisse dElectronique et Microtechnique SA CSEM
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to AT03405164T priority Critical patent/ATE306745T1/en
Application filed by Centre Suisse dElectronique et Microtechnique SA CSEM filed Critical Centre Suisse dElectronique et Microtechnique SA CSEM
Priority to EP03405164A priority patent/EP1458087B1/en
Priority to DE60301852T priority patent/DE60301852T2/en
Priority to CNB200480006478XA priority patent/CN100477490C/en
Priority to US10/548,753 priority patent/US7595476B2/en
Priority to PCT/CH2004/000122 priority patent/WO2004082131A1/en
Priority to KR1020057016807A priority patent/KR101033952B1/en
Priority to JP2006504150A priority patent/JP4579232B2/en
Publication of EP1458087A1 publication Critical patent/EP1458087A1/en
Application granted granted Critical
Publication of EP1458087B1 publication Critical patent/EP1458087B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03DDEMODULATION OR TRANSFERENCE OF MODULATION FROM ONE CARRIER TO ANOTHER
    • H03D3/00Demodulation of angle-, frequency- or phase- modulated oscillations
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03DDEMODULATION OR TRANSFERENCE OF MODULATION FROM ONE CARRIER TO ANOTHER
    • H03D7/00Transference of modulation from one carrier to another, e.g. frequency-changing
    • H03D7/02Transference of modulation from one carrier to another, e.g. frequency-changing by means of diodes
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03DDEMODULATION OR TRANSFERENCE OF MODULATION FROM ONE CARRIER TO ANOTHER
    • H03D3/00Demodulation of angle-, frequency- or phase- modulated oscillations
    • H03D3/02Demodulation of angle-, frequency- or phase- modulated oscillations by detecting phase difference between two signals obtained from input signal
    • H03D3/06Demodulation of angle-, frequency- or phase- modulated oscillations by detecting phase difference between two signals obtained from input signal by combining signals additively or in product demodulators
    • H03D3/08Demodulation of angle-, frequency- or phase- modulated oscillations by detecting phase difference between two signals obtained from input signal by combining signals additively or in product demodulators by means of diodes, e.g. Foster-Seeley discriminator

Definitions

  • This invention generally relates to all sensing and measurement techniques that rely on temporally modulated signals, preferably optical radiation fields, whose local variation of amplitude and phase must be measured as a function of time. More particularly, it relates to all of these sensing and measurement techniques that require dense one- or two-dimensional arrays of such amplitude- and phase-sensitive demodulation pixels. These techniques include optical coherence tomography (OCT), time-of-flight (TOF) range imaging and multiple wave interferometry.
  • OCT optical coherence tomography
  • TOF time-of-flight
  • optical sensing and measurement techniques are known that are based on temporally modulated optical radiation fields whose local amplitude and phase vary as a function of time. These techniques require the spatially and temporally resolved determination of amplitude and phase, the so-called demodulation of the modulated radiation field. While several electronic circuits and digital signal processing algorithms exist that can provide this demodulation function for a single measurement spot, none of these solutions allow the integration into dense, massively parallel and reliably operating arrays of demodulation photosensors.
  • a standard AM-demodulation consists of band-pass filtering, rectifying, and low-pass filtering the input signal. This technique is widely known for AM radio receivers. Its disadvantage is the need for large RC-constants for frequencies below 10 kHz, which are not compatible with the small pixel size and the new CMOS processes.
  • Direct detection by multiplying the input signal on one path with an oscillator signal matching the carrier frequency and on a second path with the oscillator's 90-degrees shifted signal allows detection of amplitude and phase.
  • signal multiplication is complex and power consuming compared to the power available in each pixel (typically a few ⁇ W) and therefore not suited for massive parallel integration in a pixel field.
  • the circuits should be integrable in dense one- or two-dimensional arrays due to their compact size, low electric power consumption, simplicity of driving, independent signal pre-processing capabilities and robustness of operation regarding fabrication tolerances of semiconductor processes.
  • the invention separates the envelope detection into two different tasks:
  • the electrical circuit according to the invention performs the first (i) of the two above-identified tasks.
  • the input signal is locally sensed and sampled at a frequency that is four times the modulation frequency of the signal.
  • Subtraction/summation stages accumulate differences of two samples per modulation period, separated by half the period, during several averaging periods; the two stages are time shifted with respect to each other by a defined or predetermined fraction of the modulation period, preferably a quarter period.
  • the resulting two output signals are employed for the determination of the local envelope amplitude and the temporal phase in the second task (ii), representing a mean over the averaging periods.
  • the inventive electrical circuit for the detection of a signal modulated with a modulation frequency, a modulation period being defined as the inverse of the modulation frequency comprises transduction means for transducing the modulated signal into an electrical signal, sampling means for sampling said electrical signal with a sampling frequency which is equal to four times the modulation frequency or a multiple thereof, first subtraction means for evaluating a first difference between two first samples separated by half the modulation period, and second subtraction means for evaluating a second difference between two second samples separated by half the modulation period, said second samples being time-shifted with respect to said first samples by a defined or predetermined fraction of the modulation period, preferably a quarter period.
  • the electrical circuit further comprises first summation means for evaluating a first sum of a plurality of subsequent first differences evaluated by said first subtraction means, and second summation means for evaluating a second sum of a plurality of subsequent second differences evaluated by said second subtraction means.
  • the one-dimensional or two-dimensional array sensor according to the invention comprises a plurality of pixels, at least one, and preferably each, of which comprises an electrical circuit according to the invention.
  • the inventive apparatus for the demodulation of a modulated signal comprises detection means for detecting the modulated signal, and evaluation means for evaluating an envelope amplitude and/or a temporal phase from an output of said detection means.
  • Said detection means comprise an electrical circuit according to the invention.
  • the method for the detection of a signal modulated with a modulation frequency, a modulation period being defined as the inverse of the modulation frequency comprises the steps of transducing the modulated signal into an electrical signal, sampling said electrical signal with a sampling frequency which is equal to four times the modulation frequency or a multiple thereof, evaluating a first difference between two first samples separated by half the modulation period, and evaluating a second difference between two second samples separated by half the modulation period, said second samples being time-shifted with respect to said first samples by a defined or predetermined fraction of the modulation period, preferably a quarter period.
  • a first sum of a plurality of subsequent first differences is evaluated, and a second sum of a plurality of subsequent second differences is evaluated.
  • phase shift between the sampled signals is exactly a quarter of the modulation period.
  • Numerical methods are known to treat non-uniform sampling grids to extract the mathematically correct values for amplitude and phase of the modulation (cf. A. B. Cain, and J. H. Ferziger and W. C. Reynolds, "Discrete orthogonal function expansion for non-uniform grids using the fast Fourier transform", J. computational physics 56, pp. 272-286, 1984).
  • the electrical circuit according to the invention can be used for any input signals such as electromagnetic, ultrasonic or chemical signals.
  • input signals such as electromagnetic, ultrasonic or chemical signals.
  • the invention is discussed for the example of an optical signal.
  • Figure 1 shows a block diagram of an electrical circuit 1 or a demodulation pixel according to the invention.
  • the electrical circuit 1 comprises a transduction stage T, a sampling or sample and hold stage S, two subtraction stages SUB1 and SUB2, two summation stages SUM1 and SUM2, a signal preprocessing stage PP and a readout stage RO.
  • the signal path is split into two channels 21, 22: a first channel 21 includes the first subtraction stage SUB1 and behind it the first summation stage SUM1, and a second channel 22 includes the second subtraction stage SUB2 and behind it the second summation stage SUM2.
  • An input signal I which is preferably an optical radiation field, is sensed in the transduction stage T and transduced to an electrical signal of any kind (e.g., charge, voltage or current as described for example in U.S. Patent No. 6,469,489 by S. Bourquin and P. Seitz).
  • the transduction stage T may have an approximate or exact offset compensation, non-linear signal compression or both of these. Offset compensation and signal compression increase the dynamic range of the detection system, since the input signal may have a large DC offset, which carries no useful information for the demodulation process.
  • switch is a single field-effect transistor (FET) for voltage or current signals or a charge-coupled-device (CCD) gate for charge signals.
  • FET field-effect transistor
  • CCD charge-coupled-device
  • a drift field demodulation pixel cf. patent application No. GB-0214257.8 or a pixel using the lock-in principle (cf. WO-96/15626) can replace the transduction stage T and the sampling stage S.
  • the subtraction stages SUB1, SUB2 determine the difference between two samples separated by half the modulation period.
  • the two subtraction stages SUB1, SUB2 are time-shifted with respect to each other by a quarter period.
  • Each subtraction stage SUB1 and SUB2 is followed by its corresponding summation stage SUM1 and SUM2, respectively.
  • the summation stages SUM1, SUM2 might have a non-linear signal compression to increase the dynamic of the detection system.
  • the pre-processing stage PP allows integration of certain additional functionalities such as calculation of the ratio of the two summation signals or the sum of their squares, etc.
  • a second sample and hold stage might be included if necessary.
  • the pre-processing stage PP might also be a pass-through.
  • the readout stage RO serves to read out the signals from the pre-processing stage PP. It may support parallel or sequential data transmission.
  • a third sample and hold stage can be included to make the readout timing independent of the synchronous functioning of the subtraction and summation stages SUB, SUM.
  • the readout stage is preferably laid out for random addressing.
  • All stages are synchronized on the modulation frequency f or a multiple or a fraction of it.
  • circuits for the pixel stages T, S, SUB, SUM, PP, RO are discussed.
  • FIG. 2 shows an embodiment of the transduction stage T that converts photons I to a corresponding voltage.
  • the circuit is fed by a ground voltage VSS and a supply voltage VDDA.
  • a photodiode PD is the photons-sensing element and has an internal capacitance Cpd. Absorbed photons create a negative electronic charge on the positively precharged capacitance, resulting in a voltage drop.
  • the resulting voltage is amplified by a source follower (unity gain, high input impedance, low output impedance) formed by two p-channel MOS transistors MP2 and MP3, where MP3 is the current source.
  • the bias voltage at the gate of MP3 vbias defines the current used by the source follower.
  • An output line of the transduction stage T is designated by T_out.
  • the photodiode PD is reset after a certain time to a fixed voltage vreset by the n-channel MOS transistor MN1 in order to subtract the DC offset.
  • the photodiode reset signal rspd controls transistor MN1.
  • the transduction stage T can be enhanced by a storage node SN, which allows to reduce the bandwidth of the source follower as well as of the following circuitry and thus reduces the noise in the system.
  • This modified embodiment of the transduction stage T is illustrated in Figure 3 .
  • the n-channel MOS transistors Mstore and Mrsstore function as switches controlled by their gate voltages store and rsstore, respectively.
  • the switch Mstore Before resetting the photodiode PD, the switch Mstore is closed and opened again to sample the voltage on the photodiode PD onto the capacitor Cstore.
  • the voltage stored on Cstore is amplified by the source follower MP2, MP3.
  • the switch Mrsstore closes and opens again, thus resetting the voltage on Cstore to the voltage vreset.
  • a current source MP5 which introduces a current equivalent to the photogenerated DC current through the photodiode PD, is connected in series with the photodiode PD.
  • Figure 4 shows a possible implementation. Two operation modes are possible:
  • the modes are selected by choosing the correct gate voltage rsoc of MP4.
  • the transistor MP6 is an additional switch, which allows to switch off this improved offset compensation.
  • the voltage ocswi controls the switch MP6.
  • the sampling stage S can be built of simple switches, e.g., NMOS switches or transmission gates as shown in Figures 5(a), 5(b) and 5(c), or it can contain a storage node. Additional storage nodes allow sample and hold operation.
  • the transduction stage T and the sample and hold stage S may be combined into one device, e.g., a drift field modulation pixel as shown in Figure 6 or a lock-in pixel as shown in Figure 7.
  • a drift field modulation pixel as shown in Figure 6
  • a lock-in pixel as shown in Figure 7.
  • FIG 8 shows an implementation of one of the subtraction stages SUB1 or SUB2 and its allocated summation stage SUM1 or SUM2, respectively.
  • Phase1 and phase2 are non-overlapping opposite phase clocks.
  • a charge proportional to the voltage difference between the first sample of the sampled signal and a reference voltage vref is stored on a capacitor Csub.
  • a charge proportional to the voltage difference between the next sample of the sampled signal and the voltage at the negative input of an operational transconductance amplifier OTA, which approximates vref, is stored.
  • the charge difference on the capacitor Csub between phase1 and phase2 is added to the charge on a capacitor Cint. This process is repeated a certain number of times.
  • the output signal of this stage is therefore proportional to the sum of the voltage differences.
  • Figure 9 shows an embodiment of a readout stage RO for one signal RO_in with a storage node.
  • the signal RO_in is sampled through a switch Mstore into a readout storage node RSN.
  • the capacitance of the readout storage node RSN is increased by a moscap MC to reduce the noise.
  • a read switch Mrd When a read switch Mrd is closed, the signal is driven off-pixel by a source follower built of the MOS transistors Mfollow and Mcs.
  • a plurality of electrical circuits 1.11, 1.12, ..., 1.1m; ... 1.nm as shown in Fig. 1 can be stacked in a one- or two-dimensional array, as shown in Figure 10 .
  • Each of the circuits 1.11-1.nm consists of a photodiode and electronic circuitry C comprising the stages S, SUB, SUM, PP and RO described with reference to Fig. 1.
  • the circuits 1.11-1.nm form the pixels of an array sensor, which itself is part of an apparatus 10 for the demodulation of a modulated signal according to the invention.
  • the apparatus 10 comprises a column address decoder CAD and a row address decoder RAD for selecting one circuit after the other by indicating the corresponding column address CA and row address RA.
  • the address decoders CAD, RAD are used to read out the outputs of each circuit 1.11-1.nm serially. Their electrical schematic is known art and is therefore not described here.
  • the column address decoder CAD can be followed by evaluation means EV for on-chip evaluating of an envelope amplitude and/or a temporal phase from outputs of the electrical circuits.
  • evaluation means EV are well-known.
  • the evaluation means EV might be omitted if the envelope amplitude and temporal phase evaluation is done off-chip.
  • an output amplifier OA yields an apparatus output signal on an output line OL.
  • circuits 1.11-1.nm may be arranged in a different way than in rows and columns as shown in Fig. 10. Any kind of arrangement falls within the scope of the invention.

Abstract

A modulated optical radiation field (I) whose modulation amplitude and temporal phase depend on the local position can be detected with a plurality of pixels 1. Each pixel 1 consists of a transducing stage (T) that converts incoming light (I) into a proportional electric signal, a sampling stage (S), two subtraction/summation stages (SUB1, SUM1; SUB2, SUM2), and an output stage. Each pixel can be addressed individually. The optical radiation field (I) is locally sensed and sampled at a frequency that is four times the wavefield's modulation frequency. The subtraction/summation stages (SUB1, SUM1; SUB2, SUM2) accumulate differences of two samples per modulation period, separated by half the period, during several averaging periods; the two stages are time shifted with respect to each other by a quarter period. The resulting two output signals are employed for the determination of the local envelope amplitude and the temporal phase. These pixels 1 can be realized with circuits that consume very little electric power and require small areas, enabling the realization of large numbers of pixels in linear or two-dimensional array sensors. <IMAGE>

Description

Field of the invention
This invention generally relates to all sensing and measurement techniques that rely on temporally modulated signals, preferably optical radiation fields, whose local variation of amplitude and phase must be measured as a function of time. More particularly, it relates to all of these sensing and measurement techniques that require dense one- or two-dimensional arrays of such amplitude- and phase-sensitive demodulation pixels. These techniques include optical coherence tomography (OCT), time-of-flight (TOF) range imaging and multiple wave interferometry.
Background of the invention
Many optical sensing and measurement techniques are known that are based on temporally modulated optical radiation fields whose local amplitude and phase vary as a function of time. These techniques require the spatially and temporally resolved determination of amplitude and phase, the so-called demodulation of the modulated radiation field. While several electronic circuits and digital signal processing algorithms exist that can provide this demodulation function for a single measurement spot, none of these solutions allow the integration into dense, massively parallel and reliably operating arrays of demodulation photosensors.
A standard AM-demodulation consists of band-pass filtering, rectifying, and low-pass filtering the input signal. This technique is widely known for AM radio receivers. Its disadvantage is the need for large RC-constants for frequencies below 10 kHz, which are not compatible with the small pixel size and the new CMOS processes.
Direct detection by multiplying the input signal on one path with an oscillator signal matching the carrier frequency and on a second path with the oscillator's 90-degrees shifted signal allows detection of amplitude and phase. But signal multiplication is complex and power consuming compared to the power available in each pixel (typically a few µW) and therefore not suited for massive parallel integration in a pixel field.
Several digital demodulation techniques are known based on oversampling the input signal. Due to the Nyquist Sampling theorem, the sampling rate must be more than twice the input-signal bandwidth. Digital signal demodulation algorithms are normally too complex to be implemented into a pixel (more than 50 transistors). The following non-exhaustive list gives an overview of digital demodulation techniques:
  • A widely used method applies a discrete Fourier transform, removes negative and zero frequency components and re-centers the spectrum before reverse transforming. This method is described in S. S. C. Chim and G. S. Kino, "Correlation microscope," Opt. Lett. 15, pp. 579-581, 1990.
  • If the input signal is sampled at a frequency that is four times the input signal modulation frequency, different algorithms for local envelope detection are known. An evaluation can be found in K. G. Larkin, "Efficient nonlinear algorithm for envelope detection in white light interferometry," J. Opt. Soc. Am. 13, pp. 832-843, 1996. But all of them imply multiplication and are therefore not applicable in a power efficient pixel structure.
  • US-A-4 547 737 shows a demodulation method which samples an incoming signal at four times its modulation frequency, calculates differences between samples separated by half the modulation period, and processes the difference signals obtained to demodulate the signal fully.
Summary of the invention
It is an object of the invention to provide an electric circuit with which the spatially and temporally resolved amplitude and phase of a temporally modulated signal can be detected for the purpose of demodulation, but which do not suffer from the disadvantages of the prior art. The circuits should be integrable in dense one- or two-dimensional arrays due to their compact size, low electric power consumption, simplicity of driving, independent signal pre-processing capabilities and robustness of operation regarding fabrication tolerances of semiconductor processes. It is a further object of the invention to provide a one- or two-dimensional array sensor and an apparatus for the spatially and temporally resolved demodulation of a modulated signal. It is still another object of the invention to provide a method for the detection of a modulated signal. These and other objects are achieved by the electric circuit, the array sensor, the apparatus and the method defined in the independent claims. Advantageous embodiments are defined in the dependent claims.
The invention separates the envelope detection into two different tasks:
  • (i) a low-power data compression part for in-pixel integration, and
  • (ii) the final amplitude and phase reconstruction, which involves multiplication and can be done in-pixel if the constraints admit it or off-pixel or even off-chip depending on the requirements.
  • The electrical circuit according to the invention performs the first (i) of the two above-identified tasks. The input signal is locally sensed and sampled at a frequency that is four times the modulation frequency of the signal. Subtraction/summation stages accumulate differences of two samples per modulation period, separated by half the period, during several averaging periods; the two stages are time shifted with respect to each other by a defined or predetermined fraction of the modulation period, preferably a quarter period. The resulting two output signals are employed for the determination of the local envelope amplitude and the temporal phase in the second task (ii), representing a mean over the averaging periods. These electrical circuits can be realized with circuits that consume very little electric power and require small areas, enabling the realization of large numbers of pixels in linear or two-dimensional array sensors.
    Accordingly, the inventive electrical circuit for the detection of a signal modulated with a modulation frequency, a modulation period being defined as the inverse of the modulation frequency, comprises transduction means for transducing the modulated signal into an electrical signal, sampling means for sampling said electrical signal with a sampling frequency which is equal to four times the modulation frequency or a multiple thereof, first subtraction means for evaluating a first difference between two first samples separated by half the modulation period, and second subtraction means for evaluating a second difference between two second samples separated by half the modulation period, said second samples being time-shifted with respect to said first samples by a defined or predetermined fraction of the modulation period, preferably a quarter period. The electrical circuit further comprises first summation means for evaluating a first sum of a plurality of subsequent first differences evaluated by said first subtraction means, and second summation means for evaluating a second sum of a plurality of subsequent second differences evaluated by said second subtraction means.
    The one-dimensional or two-dimensional array sensor according to the invention comprises a plurality of pixels, at least one, and preferably each, of which comprises an electrical circuit according to the invention.
    The inventive apparatus for the demodulation of a modulated signal comprises detection means for detecting the modulated signal, and evaluation means for evaluating an envelope amplitude and/or a temporal phase from an output of said detection means. Said detection means comprise an electrical circuit according to the invention.
    The method for the detection of a signal modulated with a modulation frequency, a modulation period being defined as the inverse of the modulation frequency, comprises the steps of transducing the modulated signal into an electrical signal, sampling said electrical signal with a sampling frequency which is equal to four times the modulation frequency or a multiple thereof, evaluating a first difference between two first samples separated by half the modulation period, and evaluating a second difference between two second samples separated by half the modulation period, said second samples being time-shifted with respect to said first samples by a defined or predetermined fraction of the modulation period, preferably a quarter period. A first sum of a plurality of subsequent first differences is evaluated, and a second sum of a plurality of subsequent second differences is evaluated.
    It is not necessary that the phase shift between the sampled signals is exactly a quarter of the modulation period. Numerical methods are known to treat non-uniform sampling grids to extract the mathematically correct values for amplitude and phase of the modulation (cf. A. B. Cain, and J. H. Ferziger and W. C. Reynolds, "Discrete orthogonal function expansion for non-uniform grids using the fast Fourier transform", J. computational physics 56, pp. 272-286, 1984).
    The electrical circuit according to the invention can be used for any input signals such as electromagnetic, ultrasonic or chemical signals. However, in the following, the invention is discussed for the example of an optical signal.
    Brief description of the drawings
    Embodiments of the invention are described in greater detail hereinafter relative to the attached schematic drawings.
    Figure 1
    shows a block diagram of the demodulation pixel according to the invention.
    Figure 2
    shows a circuit diagram of a transduction stage that converts photons into a corresponding voltage in the demodulation pixel according to the invention.
    Figure 3
    shows a variation of the transduction stage shown in Fig. 2 wherein a storage node has been added.
    Figure 4
    shows a circuit diagram of a transduction stage with improved offset compensation in the demodulation pixel according to the invention.
    Figures 5(a)-(c)
    show three types of sampling stages in the demodulation pixel according to the invention: (a) switches, (b) NMOS switches, (c) transmission gates.
    Figure 6
    shows a cross-section of a drift field modulation pixel according to the invention.
    Figure 7
    shows a cross-section of a lock-in pixel according to the invention.
    Figure 8
    shows a circuit diagram of a circuit containing a subtraction stage and a summation stage.
    Figure 9
    shows a circuit diagram of a readout stage in the demodulation pixel according to the invention.
    Figure 10
    schematically shows a two-dimensional array sensor according to the invention.
    Description of preferred embodiments
    Figure 1 shows a block diagram of an electrical circuit 1 or a demodulation pixel according to the invention. The electrical circuit 1 comprises a transduction stage T, a sampling or sample and hold stage S, two subtraction stages SUB1 and SUB2, two summation stages SUM1 and SUM2, a signal preprocessing stage PP and a readout stage RO. After the sampling stage S, the signal path is split into two channels 21, 22: a first channel 21 includes the first subtraction stage SUB1 and behind it the first summation stage SUM1, and a second channel 22 includes the second subtraction stage SUB2 and behind it the second summation stage SUM2.
    An input signal I, which is preferably an optical radiation field, is sensed in the transduction stage T and transduced to an electrical signal of any kind (e.g., charge, voltage or current as described for example in U.S. Patent No. 6,469,489 by S. Bourquin and P. Seitz). The transduction stage T may have an approximate or exact offset compensation, non-linear signal compression or both of these. Offset compensation and signal compression increase the dynamic range of the detection system, since the input signal may have a large DC offset, which carries no useful information for the demodulation process.
    The sampling stage S samples the electrical signal S with a frequency that is four times the modulation frequency f: S i = S(t i ), where
    Figure 00100001
    This can be done by switches or similar devices. In the simplest case the switch is a single field-effect transistor (FET) for voltage or current signals or a charge-coupled-device (CCD) gate for charge signals. A drift field demodulation pixel (cf. patent application No. GB-0214257.8) or a pixel using the lock-in principle (cf. WO-96/15626) can replace the transduction stage T and the sampling stage S.
    The subtraction stages SUB1, SUB2 determine the difference between two samples separated by half the modulation period. The two subtraction stages SUB1, SUB2 are time-shifted with respect to each other by a quarter period. Their signals d I / k and d II / k are given by d I k = S 4k+2 - S 4k for SUB1 and d II k = S 4k+3 - S 4k+1 for SUB2.
    Each subtraction stage SUB1 and SUB2 is followed by its corresponding summation stage SUM1 and SUM2, respectively. A summation stage SUM1, SUM2 builds the sum of a certain number N of differences:
    Figure 00110001
    where j = I,II for SUM1 and SUM2, respectively. The summation stages SUM1, SUM2 might have a non-linear signal compression to increase the dynamic of the detection system.
    The pre-processing stage PP allows integration of certain additional functionalities such as calculation of the ratio of the two summation signals or the sum of their squares, etc. A second sample and hold stage might be included if necessary. The pre-processing stage PP might also be a pass-through.
    The readout stage RO serves to read out the signals from the pre-processing stage PP. It may support parallel or sequential data transmission. A third sample and hold stage can be included to make the readout timing independent of the synchronous functioning of the subtraction and summation stages SUB, SUM. The readout stage is preferably laid out for random addressing.
    All stages are synchronized on the modulation frequency f or a multiple or a fraction of it.
    In the following, preferred embodiments of circuits for the pixel stages T, S, SUB, SUM, PP, RO are discussed.
    Figure 2 shows an embodiment of the transduction stage T that converts photons I to a corresponding voltage. The circuit is fed by a ground voltage VSS and a supply voltage VDDA. A photodiode PD is the photons-sensing element and has an internal capacitance Cpd. Absorbed photons create a negative electronic charge on the positively precharged capacitance, resulting in a voltage drop. The resulting voltage is amplified by a source follower (unity gain, high input impedance, low output impedance) formed by two p-channel MOS transistors MP2 and MP3, where MP3 is the current source. The bias voltage at the gate of MP3 vbias defines the current used by the source follower. An output line of the transduction stage T is designated by T_out. The photodiode PD is reset after a certain time to a fixed voltage vreset by the n-channel MOS transistor MN1 in order to subtract the DC offset. The photodiode reset signal rspd controls transistor MN1.
    The transduction stage T can be enhanced by a storage node SN, which allows to reduce the bandwidth of the source follower as well as of the following circuitry and thus reduces the noise in the system. This modified embodiment of the transduction stage T is illustrated in Figure 3. The n-channel MOS transistors Mstore and Mrsstore function as switches controlled by their gate voltages store and rsstore, respectively. Before resetting the photodiode PD, the switch Mstore is closed and opened again to sample the voltage on the photodiode PD onto the capacitor Cstore. The voltage stored on Cstore is amplified by the source follower MP2, MP3. Then the switch Mrsstore closes and opens again, thus resetting the voltage on Cstore to the voltage vreset.
    A further modification of the transduction stage T improves the offset compensation: a current source MP5, which introduces a current equivalent to the photogenerated DC current through the photodiode PD, is connected in series with the photodiode PD. Figure 4 shows a possible implementation. Two operation modes are possible:
    • Calibrated current compensation: A transistor MP4 is used as a switch. A current source MP5 behaves like a forward biased diode when the switch MP4 is closed, and the compensation current matches exactly the photogenerated current. When the switch MP4 opens again, the current through MP5 becomes independent of the photocurrent variations.
    • Low-pass filtered current compensation: The transistor MP4 is used as a resistance, forming a low-pass filter with the gate capacitance of transistor MP5. An additional capacitor might be needed to adapt the cut-off frequency of this filter. The current source MP5 generates a compensation current, which is independent of photocurrent variations of frequencies higher than the cut-off frequency of the filter.
    The modes are selected by choosing the correct gate voltage rsoc of MP4.
    The transistor MP6 is an additional switch, which allows to switch off this improved offset compensation. The voltage ocswi controls the switch MP6.
    The sampling stage S can be built of simple switches, e.g., NMOS switches or transmission gates as shown in Figures 5(a), 5(b) and 5(c), or it can contain a storage node. Additional storage nodes allow sample and hold operation.
    The transduction stage T and the sample and hold stage S may be combined into one device, e.g., a drift field modulation pixel as shown in Figure 6 or a lock-in pixel as shown in Figure 7. These types of pixels are described in patent applications No. GB-0214257.8 and WO-96/15626, which are incorporated herein by reference.
    Figure 8 shows an implementation of one of the subtraction stages SUB1 or SUB2 and its allocated summation stage SUM1 or SUM2, respectively. Phase1 and phase2 are non-overlapping opposite phase clocks. During phase1, a charge proportional to the voltage difference between the first sample of the sampled signal and a reference voltage vref is stored on a capacitor Csub. During phase2, a charge proportional to the voltage difference between the next sample of the sampled signal and the voltage at the negative input of an operational transconductance amplifier OTA, which approximates vref, is stored. The charge difference on the capacitor Csub between phase1 and phase2 is added to the charge on a capacitor Cint. This process is repeated a certain number of times. The output signal of this stage is therefore proportional to the sum of the voltage differences.
    Examples of the pre-processing stage PP include a signal-squaring stage calculating the sum of the squares of the summation stage signals, e = a I + a II , or a stage calculating their ratio
    Figure 00160001
    Such circuits are per se known from standard textbooks on semiconductor circuits.
    Figure 9 shows an embodiment of a readout stage RO for one signal RO_in with a storage node. The signal RO_in is sampled through a switch Mstore into a readout storage node RSN. The capacitance of the readout storage node RSN is increased by a moscap MC to reduce the noise. When a read switch Mrd is closed, the signal is driven off-pixel by a source follower built of the MOS transistors Mfollow and Mcs.
    A plurality of electrical circuits 1.11, 1.12, ..., 1.1m; ... 1.nm as shown in Fig. 1 can be stacked in a one- or two-dimensional array, as shown in Figure 10. Each of the circuits 1.11-1.nm consists of a photodiode and electronic circuitry C comprising the stages S, SUB, SUM, PP and RO described with reference to Fig. 1. Thus, the circuits 1.11-1.nm form the pixels of an array sensor, which itself is part of an apparatus 10 for the demodulation of a modulated signal according to the invention. The apparatus 10 comprises a column address decoder CAD and a row address decoder RAD for selecting one circuit after the other by indicating the corresponding column address CA and row address RA. The address decoders CAD, RAD are used to read out the outputs of each circuit 1.11-1.nm serially. Their electrical schematic is known art and is therefore not described here.
    The column address decoder CAD can be followed by evaluation means EV for on-chip evaluating of an envelope amplitude and/or a temporal phase from outputs of the electrical circuits. Such evaluation means EV are well-known. The evaluation means EV might be omitted if the envelope amplitude and temporal phase evaluation is done off-chip. Finally, an output amplifier OA yields an apparatus output signal on an output line OL.
    It should be noted that in a two-dimensional sensor according to the invention, the circuits 1.11-1.nm may be arranged in a different way than in rows and columns as shown in Fig. 10. Any kind of arrangement falls within the scope of the invention.
    This invention is not limited to the preferred embodiments described above, to which variations and improvements may be made, without departing from the scope of protection of the present patent.
    List of reference signs
    1
    Electrical circuit
    10
    Apparatus
    21
    First channel
    22
    Second channel
    CA
    Column address
    CAD
    Column address decoder
    EV
    Evaluation means
    I
    Input signal
    OA
    Output amplifier
    OL
    Output line
    OTA
    Operational transconductance amplifier
    PD
    Photodiode
    PP
    Pre-processing stage
    RA
    Row address
    RAD
    Row address decoder
    RO
    Readout stage
    RSN
    Readout storage node
    S
    Sampling stage
    SN
    Storage node
    SUB1, SUB2
    Subtraction stages
    SUM1, SUM2
    Summation stages
    T
    Transduction stage
    VDDA
    Supply voltage
    VSS
    Ground voltage

    Claims (13)

    1. An electrical circuit (1) for the detection of a signal (I) modulated with a modulation frequency, a modulation period being defined as the inverse of the modulation frequency, comprising:
      transduction means (T) for transducing the modulated signal (I) into an electrical signal,
      sampling means (S) for sampling said electrical signal with a sampling frequency which is equal to four times the modulation frequency or a multiple thereof,
      first subtraction means (SUB1) for evaluating a first difference between two first samples separated by half the modulation period, and
      second subtraction means (SUB2) for evaluating a second difference between two second samples separated by half the modulation period, said second samples being time-shifted with respect to said first samples by a defined fraction, preferably a quarter, of the modulation period,
      characterized by
      first summation means (SUM1) for evaluating a first sum of a plurality of subsequent first differences evaluated by said first subtraction means (SUB1), and
      second summation means (SUM2) for evaluating a second sum of a plurality of subsequent second differences evaluated by said second subtraction means (SUB2).
    2. The electrical circuit (1) according to claim 1, wherein said transduction means (T) comprise a photodiode (PD) and preferably a source follower (MP2, MP3) for amplifying an electrical output signal of said photodiode (PD).
    3. The electrical circuit (1) according to claim 2, wherein a storage node (SN) is arranged between said photodiode (PD) and said source follower (MP2, MP3).
    4. The electrical circuit (1) according to claim 2 or 3, wherein a current source (MP5) for introducing a current equivalent to a photogenerated DC current through said photodiode (PD) is connected in series with said photodiode (PD).
    5. The electrical circuit (1) according to any of the preceding claims, wherein said sampling means (S) comprise at least two switches and/or a storage node.
    6. The electrical circuit (1) according to claim 1, wherein said transduction means (T) and said sampling means (S) are combined into one element, e.g., a drift field modulation pixel or a lock-in pixel.
    7. The electrical circuit (1) according to any of the preceding claims, further comprising pre-processing means (PP) for pre-processing said first and second sum evaluated by said first and second summation means (SUM1, SUM2), respectively, e.g., for calculating a sum of the squares of said first and second sums or for calculating a ratio of said first and second sums.
    8. The electrical circuit (1) according to any of the preceding claims, further comprising readout means (RO) for reading out an output signal of said electrical circuit (1).
    9. A one-dimensional or two-dimensional array sensor comprising a plurality of pixels (1.11-1.nm),
      characterized in that
      at least one, and preferably each, of said pixels (1.11-1.nm) comprises an electrical circuit according to any of the preceding claims.
    10. An apparatus (10) for the demodulation of a modulated signal (I), comprising:
      detection means for detecting the modulated signal (I), and
      evaluation means (EV) for evaluating an envelope amplitude and/or a temporal phase from an output of said detection means,
      characterized in that
      said detection means comprise an electrical circuit (1.11-1.nm) according to any of the claims 1-8.
    11. The apparatus (10) according to claim 10, wherein said detection means comprise a plurality of pixels (1.11-1.nm) with parallel outputs, at least one, and preferably each, of said pixels (1.11-1.nm) comprising an electrical circuit according to any of the claims 1-8, and wherein said apparatus (10) further comprises at least one on-chip address decoder (CAD. RAD) for individually reading out each electrical circuit (1.11-1.nm).
    12. A method for the detection of a signal (I) modulated with a modulation frequency, a modulation period being defined as the inverse of the modulation frequency, comprising the steps of:
      transducing the modulated signal (I) into an electrical signal,
      sampling said electrical signal with a sampling frequency which is equal to four times the modulation frequency or a multiple thereof,
      evaluating a first difference between two first samples separated by half the modulation period, and
      evaluating a second difference between two second samples separated by half the modulation period, said second samples being time-shifted with respect to said first samples by a defined fraction, preferably a quarter, of the modulation period,
      characterized in that
      a first sum of a plurality of subsequent first differences is evaluated, and
      a second sum of a plurality of subsequent second differences is evaluated.
    13. The method according to claim 12, wherein said first and second sum are pre-processed prior to being used for evaluating an envelope amplitude and/or a temporal phase of the modulated signal (I), e.g., a sum of the squares of said first and second sums or a ratio of said first and second sums is calculated.
    EP03405164A 2003-03-10 2003-03-10 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal Expired - Lifetime EP1458087B1 (en)

    Priority Applications (8)

    Application Number Priority Date Filing Date Title
    EP03405164A EP1458087B1 (en) 2003-03-10 2003-03-10 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal
    DE60301852T DE60301852T2 (en) 2003-03-10 2003-03-10 Electric circuit, method and apparatus for demodulation of an intensity modulated signal
    AT03405164T ATE306745T1 (en) 2003-03-10 2003-03-10 ELECTRICAL CIRCUIT, METHOD AND DEVICE FOR DEMODULATION OF AN INTENSITY MODULATED SIGNAL
    US10/548,753 US7595476B2 (en) 2003-03-10 2004-03-03 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal
    CNB200480006478XA CN100477490C (en) 2003-03-10 2004-03-03 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal
    PCT/CH2004/000122 WO2004082131A1 (en) 2003-03-10 2004-03-03 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal
    KR1020057016807A KR101033952B1 (en) 2003-03-10 2004-03-03 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal
    JP2006504150A JP4579232B2 (en) 2003-03-10 2004-03-03 Electrical circuit, apparatus and method for demodulation of intensity modulated signals

    Applications Claiming Priority (1)

    Application Number Priority Date Filing Date Title
    EP03405164A EP1458087B1 (en) 2003-03-10 2003-03-10 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal

    Publications (2)

    Publication Number Publication Date
    EP1458087A1 EP1458087A1 (en) 2004-09-15
    EP1458087B1 true EP1458087B1 (en) 2005-10-12

    Family

    ID=32749040

    Family Applications (1)

    Application Number Title Priority Date Filing Date
    EP03405164A Expired - Lifetime EP1458087B1 (en) 2003-03-10 2003-03-10 Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal

    Country Status (8)

    Country Link
    US (1) US7595476B2 (en)
    EP (1) EP1458087B1 (en)
    JP (1) JP4579232B2 (en)
    KR (1) KR101033952B1 (en)
    CN (1) CN100477490C (en)
    AT (1) ATE306745T1 (en)
    DE (1) DE60301852T2 (en)
    WO (1) WO2004082131A1 (en)

    Cited By (3)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US10016137B1 (en) 2017-11-22 2018-07-10 Hi Llc System and method for simultaneously detecting phase modulated optical signals
    US10219700B1 (en) 2017-12-15 2019-03-05 Hi Llc Systems and methods for quasi-ballistic photon optical coherence tomography in diffusive scattering media using a lock-in camera detector
    US10299682B1 (en) 2017-11-22 2019-05-28 Hi Llc Pulsed ultrasound modulated optical tomography with increased optical/ultrasound pulse ratio

    Families Citing this family (16)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    EP1624491B1 (en) * 2004-08-04 2009-05-27 CSEM Centre Suisse d'Electronique et de Microtechnique SA - Recherche et Développement Solid-state photosensor with electronic aperture control
    EP1777811B1 (en) * 2005-10-19 2018-10-03 Heptagon Micro Optics Pte. Ltd. Method and Device for the demodulation of modulated optical signals
    EP1892501A3 (en) 2006-08-23 2009-10-07 Heliotis AG Colorimetric three-dimensional microscopy
    KR100813808B1 (en) * 2006-11-16 2008-03-13 엘에스산전 주식회사 Current measurement circuit with improved resolution and controlling method thereof and digital protection relay of using the same
    EP1939581A1 (en) 2006-12-27 2008-07-02 Heliotis AG Apparatus for the contact-less, interferometric determination of surface height profiles and depth scattering profiles
    US8053717B2 (en) * 2008-05-22 2011-11-08 Semiconductor Energy Laboratory Co., Ltd. Photoelectric conversion device having a reference voltage generation circuit with a resistor and a second diode element and electronic device having the same
    US8115152B1 (en) * 2008-06-03 2012-02-14 ADIC, Inc. Method of operating a photoconductor in an imaging system, and read-out circuit employing an AC-biased photoconductor
    KR101922907B1 (en) * 2012-03-29 2018-11-28 삼성전자주식회사 Method and apparatus for envelope detection using a difference of sampling signals
    KR102099218B1 (en) * 2012-09-10 2020-04-09 삼성전자주식회사 Method and apparatus for suppressing background light in time of flight sensor
    CN105548073B (en) * 2015-12-24 2018-07-10 中国科学院合肥物质科学研究院 A kind of simple demodulation method applied to the detection of wavelength modulated optical absorption spectra
    DE102016212765A1 (en) * 2016-07-13 2018-01-18 Robert Bosch Gmbh A pixel unit for an image sensor, an image sensor, a method of sensing a light signal, a method of driving a pixel unit, and a method of generating an image using a pixel unit
    FR3071356B1 (en) * 2017-09-21 2020-11-13 Safran Electronics & Defense DETECTION AND LOCATION DEVICE INCLUDING A PLURALITY OF PHOTODIODES
    US10368752B1 (en) 2018-03-08 2019-08-06 Hi Llc Devices and methods to convert conventional imagers into lock-in cameras
    US11206985B2 (en) 2018-04-13 2021-12-28 Hi Llc Non-invasive optical detection systems and methods in highly scattering medium
    US11857316B2 (en) 2018-05-07 2024-01-02 Hi Llc Non-invasive optical detection system and method
    EP4087233A4 (en) * 2020-02-20 2024-02-14 Hamamatsu Photonics Kk Optical coherence tomography device

    Family Cites Families (11)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    SE415397B (en) * 1978-06-02 1980-09-29 Asea Ab FIBEROPTICAL METDON
    US4547737A (en) * 1983-07-29 1985-10-15 Rca Corporation Demodulator of sampled data FM signals from sets of four successive samples
    JPS6418255A (en) * 1987-07-13 1989-01-23 Hamamatsu Photonics Kk Solid-state image sensor
    JPH0726873B2 (en) * 1987-05-08 1995-03-29 オリンパス光学工業株式会社 Photometric device
    DE4440613C1 (en) * 1994-11-14 1996-07-25 Leica Ag Device and method for the detection and demodulation of an intensity-modulated radiation field
    ES2206748T3 (en) * 1996-09-05 2004-05-16 Rudolf Schwarte PROCEDURE AND DEVICE FOR THE DETERMINATION OF INFORMATION ON PHASES AND / OR EXTENSIONS OF AN ELECTROMAGNETIC WAVE.
    JP3742491B2 (en) * 1997-07-22 2006-02-01 浜松ホトニクス株式会社 Optical waveform measuring device
    US6483381B1 (en) * 1997-10-22 2002-11-19 Jeng-Jye Shau Signal transmission and receiving methods optimized for integrated circuit implementation
    JP3832441B2 (en) * 2002-04-08 2006-10-11 松下電工株式会社 Spatial information detection device using intensity-modulated light
    GB2389960A (en) * 2002-06-20 2003-12-24 Suisse Electronique Microtech Four-tap demodulation pixel
    JP3758618B2 (en) * 2002-07-15 2006-03-22 松下電工株式会社 Ranging device and distance measuring method using image sensor

    Cited By (3)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US10016137B1 (en) 2017-11-22 2018-07-10 Hi Llc System and method for simultaneously detecting phase modulated optical signals
    US10299682B1 (en) 2017-11-22 2019-05-28 Hi Llc Pulsed ultrasound modulated optical tomography with increased optical/ultrasound pulse ratio
    US10219700B1 (en) 2017-12-15 2019-03-05 Hi Llc Systems and methods for quasi-ballistic photon optical coherence tomography in diffusive scattering media using a lock-in camera detector

    Also Published As

    Publication number Publication date
    EP1458087A1 (en) 2004-09-15
    CN100477490C (en) 2009-04-08
    JP2006524800A (en) 2006-11-02
    KR101033952B1 (en) 2011-05-11
    DE60301852D1 (en) 2005-11-17
    ATE306745T1 (en) 2005-10-15
    JP4579232B2 (en) 2010-11-10
    US20060097781A1 (en) 2006-05-11
    US7595476B2 (en) 2009-09-29
    DE60301852T2 (en) 2006-05-18
    KR20060006778A (en) 2006-01-19
    WO2004082131A1 (en) 2004-09-23
    CN1759530A (en) 2006-04-12

    Similar Documents

    Publication Publication Date Title
    EP1458087B1 (en) Electrical circuit, apparatus and method for the demodulation of an intensity-modulated signal
    US6011251A (en) Method for obtaining a high dynamic range read-out signal of a CMOS-based pixel structure and such CMOS-based pixel structure
    US6469489B1 (en) Adaptive array sensor and electrical circuit therefore
    Nelson et al. General noise processes in hybrid infrared focal plane arrays
    JP4457134B2 (en) Method for obtaining a readout signal with a high dynamic range of a pixel structure based on CMOS and a pixel structure based on CMOS
    Moore et al. Interpixel capacitance in nondestructive focal plane arrays
    Buttgen et al. Demodulation pixel based on static drift fields
    WO2010144616A1 (en) System for charge-domain electron subtraction in demodulation pixels and method therefor
    EP3772637B1 (en) Detection device and detection system
    EP1197735A1 (en) Photodetector
    Johnson Hybrid infrared focal plane signal and noise model
    US10236400B2 (en) Quantum dot film based demodulation structures
    US5936866A (en) Light-detection system with programmable offset current
    Bourquin et al. Two-dimensional smart detector array for interferometric applications
    JPH06205299A (en) Image pickup device
    US7521663B2 (en) Optoelectronic detector with multiple readout nodes and its use thereof
    Tabet Double sampling techniques for CMOS image sensors
    KR20050094875A (en) Photodetector
    Choi et al. An architecture with pipelined background suppression and in-situ noise cancelling for 2D/3D CMOS image sensor
    Degerli et al. Non-stationary noise responses of some fully differential on-chip readout circuits suitable for CMOS image sensors
    Greffe et al. Characterization of low light performance of a complementary metal-oxide semiconductor sensor for ultraviolet astronomical applications
    Pitter et al. Dual-phase synchronous light detection with 64× 64 CMOS modulated light camera
    EP0903935A1 (en) Method for obtaining a high dynamic range read-out signal of a CMOS-based pixel structure and such CMOS-based pixel structure
    KR102459755B1 (en) Imaging device and method
    Ginhac et al. An SIMD programmable vision chip with high-speed focal plane image processing

    Legal Events

    Date Code Title Description
    PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

    Free format text: ORIGINAL CODE: 0009012

    AK Designated contracting states

    Kind code of ref document: A1

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

    AX Request for extension of the european patent

    Extension state: AL LT LV MK

    17P Request for examination filed

    Effective date: 20041218

    GRAP Despatch of communication of intention to grant a patent

    Free format text: ORIGINAL CODE: EPIDOSNIGR1

    AKX Designation fees paid

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

    GRAS Grant fee paid

    Free format text: ORIGINAL CODE: EPIDOSNIGR3

    GRAA (expected) grant

    Free format text: ORIGINAL CODE: 0009210

    AK Designated contracting states

    Kind code of ref document: B1

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: AT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: SK

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: RO

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: NL

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: FI

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: BE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: IT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

    Effective date: 20051012

    Ref country code: CZ

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    Ref country code: SI

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: FG4D

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: EP

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: NV

    Representative=s name: SCHNEIDER FELDMANN AG PATENT- UND MARKENANWAELTE

    REG Reference to a national code

    Ref country code: IE

    Ref legal event code: FG4D

    REF Corresponds to:

    Ref document number: 60301852

    Country of ref document: DE

    Date of ref document: 20051117

    Kind code of ref document: P

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: DK

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060112

    Ref country code: BG

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060112

    Ref country code: SE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060112

    Ref country code: GR

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060112

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: ES

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060123

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: IE

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20060310

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: PT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060313

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: MC

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20060331

    Ref country code: LU

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20060331

    NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: HU

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20060413

    ET Fr: translation filed
    PLBE No opposition filed within time limit

    Free format text: ORIGINAL CODE: 0009261

    STAA Information on the status of an ep patent application or granted ep patent

    Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

    26N No opposition filed

    Effective date: 20060713

    REG Reference to a national code

    Ref country code: IE

    Ref legal event code: MM4A

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: EE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: TR

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: CY

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051012

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: S117

    Free format text: REQUEST FILED; REQUEST FOR CORRECTION UNDER SECTION 117 FILED ON 12 JUNE 2009

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: S117

    Free format text: CORRECTIONS ALLOWED

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: CH

    Payment date: 20110831

    Year of fee payment: 9

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: PL

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: CH

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20120331

    Ref country code: LI

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20120331

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 14

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 15

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 16

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: GB

    Payment date: 20220224

    Year of fee payment: 20

    Ref country code: DE

    Payment date: 20220223

    Year of fee payment: 20

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: FR

    Payment date: 20220221

    Year of fee payment: 20

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R071

    Ref document number: 60301852

    Country of ref document: DE

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: PE20

    Expiry date: 20230309

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: GB

    Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

    Effective date: 20230309