WO2006031962A1 - Integrated circuit infrared sensor and associated methods - Google Patents

Integrated circuit infrared sensor and associated methods Download PDF

Info

Publication number
WO2006031962A1
WO2006031962A1 PCT/US2005/032918 US2005032918W WO2006031962A1 WO 2006031962 A1 WO2006031962 A1 WO 2006031962A1 US 2005032918 W US2005032918 W US 2005032918W WO 2006031962 A1 WO2006031962 A1 WO 2006031962A1
Authority
WO
WIPO (PCT)
Prior art keywords
thermocouple junction
integrated circuit
temperature difference
thermocouple
controller
Prior art date
Application number
PCT/US2005/032918
Other languages
French (fr)
Other versions
WO2006031962A9 (en
Inventor
Dale R. Setlak
Original Assignee
Authentec, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Authentec, Inc. filed Critical Authentec, Inc.
Publication of WO2006031962A1 publication Critical patent/WO2006031962A1/en
Publication of WO2006031962A9 publication Critical patent/WO2006031962A9/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/10Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
    • G01J5/12Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
    • G01J5/14Electrical features thereof
    • G01J5/16Arrangements with respect to the cold junction; Compensating influence of ambient temperature or other variables
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1318Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing

Definitions

  • the present invention relates to sensors, and, more particularly, to sensors for infrared radiation and
  • Infrared thermal imaging is commonly used for various applications.
  • Published U.S. Patent Application No. 2005/0069180 to Setlak et al. and assigned to the assignee of the present invention discloses significant advances in infrared imaging for biometric identification of a user's finger.
  • the entire contents of the Setlak et al. application are incorporated herein by reference along with its related applications, Nos. 2005/0089203; 2005/0089202; 2005/0069181; 2005/0063573; 2005/0063572; and 2005/0063571.
  • the infrared imaging described by Setlak et al. includes thermopile sensing pixels that can be used either alone or in combination with other biometric sensing techniques for enhanced accuracy.
  • infrared sensors include automotive, spectroscopic and general imaging application as d-:.3cribed, for example, in U.S. Patent No. 5,689,087 to Jack.
  • infrared thermal imaging systems typical engineering practice is to minimize the heat flux away from the thermal pickup elements by a variety of thermal isolation methods. The temperature of the thermal sensing elements is allowed to stabilize, hopefully approaching that of the heat source target, and then that temperature is measured.
  • Typical methods of thermally isolating the sensing elements include: back thinning of the semiconductor waters oenin ⁇ the sensing elements, micromachining void spaces around the sensing elements, floating the sensing elements, etc. Unfortunately, these methods may not be available inexpensively in standard semiconductor foundry processing.
  • the ⁇ 087 patent to Jack discloses that the hot junction is thermally isolated from the substrate by being suspended from the substrate on dielectric bridges or, in another embodiment, by a thermally insulating and patterned polymer.
  • European Published Patent Application No. 1,045,233 A2 discloses an infrared sensor including a flexible diaphragm that may be disposed over a cavity, a thermoelectric element that converts heat to an electrical signal, and an electrothermic element that converts an electrical signal to heat.
  • the thermoelectric element is on the diaphragm and the electrothermic element is on the diaphragm adjacent the thermoelectric element.
  • a reference signal is supplied that is compared with the output of the thermoelectric element for controlling the driving of the electrothermic element. The reference signal and the output signal are compared and the electrothermic element is driven to compensate for the difference between the two signals.
  • the electrothermic element is controlled so as to offset the energy that is detected by the thermoelectric element more rapidly than the thermal response of the diaphragm, thereby eliminating the temperature changes in the diaphragm.
  • the application notes that free of the influence of the thermal time constant of the diaphragm, the response speed with respect to incident mtrared light can be greatly improved and the linearity of the thermoelectric conversion can be improved.
  • the approach described in the EP 1,045,233 published application requires separate sensing and temperature control elements to be positioned on the diaphragm, and the diaphragm may stiHt/ase a cavity therebeneath.
  • many of the conventional approaches to thermal isolation of the sensing elements make use of complicated processing techniques. Such techniques also typically suffer from losses due to the heat conduction across suspension members and across the measurement connections .
  • an integrated circuit sensor comprising at least one infrared sensing element on a substrate and including at least one first thermocouple junction heated from infrared radiation, at least one second thermocouple junction connected to the at least one first thermocouple junction, and a controller.
  • the controller may detect a temperature difference between the at least one first thermocouple junction and the at least one second thermocouple junction, and may pump heat between the at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value.
  • the controller may also generate an infrared radiation output signal based upon the heat pumped. For example, the controller may alternatingly switch between detecting the temperature difference and pumping heat, and the desired temperature difference may be zero.
  • the sensor may be readily made using integrated pxQcessin ⁇ technology, and example, be used in many types of applications, such as biometric identification, by including biometric processing circuitry connected to the controller.
  • the controller may comprise a detector for detecting a voltage between the at least one first thermocouple junction and the at least one second thermocouple junction indicative of a temperature difference therebetween, and a driver for driving current through the at least one first thermocouple junction and the at least one second thermocouple junction to pump heat therebetween.
  • the controller may also include a switcher for alternatingly switching the at least one first thermocouple junction and the at least one second thermocouple junction between the detector and the driver, and a regulator to operate the driver responsive to the detector so that the detected voltage is driven toward zero.
  • the controller may include a reader connected to the driver for determining the drive current provided thereby indicative of the heat pumped.
  • the at least one second thermocouple junction may be thermally coupled to the substrate via a lower thermal resistance than the at least one first thermocouple junction.
  • the integrated circuit sensor may further comprise at least one solid layer between the substrate and the at least one first thermocouple junction so that there is no void therebetween. This may greatly streamline manufacturing and/or reduce manufacturing costs.
  • the at least one solid layer may comprise at least one oxide layer, such as silicon oxide widely used as an interlevel dielectric in integrated circuit processing.
  • the at least one infrared sensing element may comprise ..a olural i-i-y thereof for m ⁇ ry.-iiypical applications.
  • the second thermocouple junctions of the plurality of infrared sensing elements may be thermally coupled to the substrate.
  • the at least one infrared sensing element may further comprise an infrared radiation antenna thermally coupled to the at least one first thermocouple junction.
  • the at least one first thermocouple junction may include a plurality thereof connected together.
  • the at least one second thermocouple junction may also include a plurality thereof connected together in a thermopile arrangement to generate larger signal amplitudes.
  • Another aspect of the invention is directed to a method for infrared sensing using an integrated circuit sensor.
  • the integrated circuit sensor may include a substrate and at least one infrared sensing element on the substrate.
  • the at least one infrared sensing element may comprise at least one first thermocouple junction heated from infrared radiation, and at least one second thermocouple junction connected to the at least one first thermocouple junction.
  • the method may include detecting a temperature difference between the at least one first thermocouple junction and the at least one second thermocouple junction; pumping heat between the at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value; and generating an infrared radiation output signal based upon the heat pumped.
  • FIG. 2 is a schematic diagram of a second embodiment of an electronic device including an infrared finger sensor in accordance with the present invention.
  • FIG. 3 is a more detailed schematic diagram, partially in section, of a portion of the electronic device as shown in FIG. 1.
  • FIG. 4 is a more detailed schematic diagram, partially in section, of a portion of the electronic device as shown in FIG. 2.
  • FIG. 5 is a schematic plan view of an embodiment of an infrared sensing pixel for the infrared sensor as shown in FIG. 2.
  • FIG. 6 is a schematic perspective view, partially in section, of an individual infrared antenna and thermocouple temperature sensor for the infrared sensing pixel as shown in FIG. 5.
  • FIG. 7 is a top plan view of the infrared antenna element and thermocouple sensor as shown in FIG. 6.
  • FIG. 8 is a schematic perspective view, partially in section, of an alternate embodiment of an individual infrared antenna and thermocouple temperature sensor for the infrared sensing pixel as shown in FIG. 5.
  • FIG. 9 is an enlarged schematic cross-sectional view through the middle of an individual infrared antenna and temperature sensor as shown in FIG. 6.
  • FIG. 10 is a top plan view of an individual infrared sensing pixel as may be used in the infrared sensor as shown in FIG. 1.
  • FIG. 11 is an enlarged top plan view from the center portion of FIG. 10.
  • FIG. 12 is a schematic diagram of the infrared sensj_D ⁇ ..r>j xe.l and associated contrcllofirrars may used in the devices of FIGS. 1 and 2.
  • FIG. 13 is a more detailed schematic diagram of an embodiment of the infrared sensing pixel and associated controller as shown in FIG. 12.
  • FIG. 14 is a more detailed schematic diagram of another embodiment of the infrared sensing pixel and associated controller as shown in FIG. 12.
  • FIGS. 15 and 16 are schematic diagrams modeling the thermal relationships of the infrared sensing pixel as shown in FIG. 12.
  • FIGS. 17 and 18 are schematic diagrams modeling the electrical relationships of the infrared sensing pixel as shown in FIG. 12.
  • the infrared sensor may measure the heat flux impinging on the sensor rather than the temperature of the sensor to reduce the need for high-quality thermal isolation.
  • the heat pumping may cool (or raise) the temperature of the sensing element. to .that- of the substrate, the temperature difference to near zero and hence the heat loss through other mechanisms to near zero.
  • a closed loop control system may be used to drive the heat pump to produce a null temperature difference between the sensing element and the substrate, hence this is a form of balanced differential measurement.
  • the first order error may be largely a function of the control loop gain and offset, which can be readily controlled using standard electronic circuit design practices.
  • This concept allows the fabrication of infrared sensors on standard process substrates without the need for special processing to produce high quality thermal isolation. Using this method, the thermal isolation supplied by standard silicon dioxide integrated circuit dielectric materials may be sufficient to allow sensitive and accurate measurements. It is particularly applicable to arrays of infrared sensors where the parameter of interest is the relative difference between the individual pixels in the array and the average of all the pixels in the array.
  • the electronic device is in the exemplary form of a cellular telephone 80 that includes a portable housing 81.
  • the portable housing 81 carries an infrared finger sensor 85, and a lighted keypad 82 that, in turn, includes a plurality .of ..user..operable i ⁇ put keys S3.
  • the p ⁇ aartable . housing 81 also carries a processor 84 that is connected to the infrared sensor 85 and the optical source 87 for lighting the keypad 82 via the optical guide 91.
  • a display 88 is illustratively carried by the upper portion of the portable housing 81 and is also connected to the processor 84.
  • the cellular phone 80 may also include a power source, such as a rechargeable battery 92, carried by the portable housing 81 and connected to the processor 84 and other electronic components within the housing as will be appreciated by those skilled in the art.
  • a memory 94 is also connected to the processor 84.
  • the infrared sensor 85 includes an integrated circuit substrate 102 and a plurality of infrared sensing pixels 103 on the integrated circuit substrate for sensing infrared radiation naturally emitted from subdermal features of the user's finger 100.
  • the processor 84 is connected to the infrared sensing pixels 83 for generating the infrared biometric data based upon naturally emitted radiation from subdermal features of the user's finger 100.
  • the processor 84 further illustratively includes a matcher 104 for determining a match between the infrared biometric data of the user's finger and stored infrared biometric data for an enrolled user.
  • This match determination may be used by a function enabler 105 of the processor 84 to enable at least one device function, such as permitting operation of the transmit and receive functions of the cellular telephone 80, for example.
  • the matcher 104 and enabler 105 may be implemented on a CPU of the processor 84 operating under stored program control, as will be appreciated by those skilled in the art without requiring further discussion Jxexein .
  • the infrared biometric data may be accurately and efficiently obtained using the compact integrated circuit-based sensor 85.
  • Another aspect of the infrared sensor 85 is that its processing may be self-contained on the integrated circuit substrate 102 itself, or, as shown in the illustrated embodiment, the integrated circuit may contain some of the processing circuitry 107. For example, pixel reading amplifiers and/or other image processing active devices may be provided on the substrate 102 using conventional CMOS technology, for example. In yet other embodiments, all or a majority of the signal processing circuitry may be located off-chip.
  • the integrated circuit substrate 102 may preferably a silicon substrate as will be appreciated by those skilled in the art.
  • the illustrated embodiment of the infrared sensor 85 is a static placement sensor.
  • the size of the array of pixels 103 is relatively large compared to a sliding placement sensor as discussed below.
  • the processor 104 generates the infrared biometric data based upon static placement of the user's finger adjacent the integrated circuit substrate 102.
  • the illustrated ⁇ frared sensor ?F' • is in the form cf-- «Q*>- sliding placement sensor that has a smaller sensing area over which the user slides his finger 100' as will be appreciated by those skilled in the art.
  • the processor 104' may collect frames of infrared image data from the infrared sensing pixels 103' .
  • FIGS. 2 and 4 Those other elements of the embodiment of the cellular telephone 80' shown in FIGS. 2 and 4 are similar to those of the embodiment of the cellular telephone 80 described above with respect to FIGS. 1 and 3, and are indicated with prime notation. Accordingly, these elements require no further discussion herein.
  • the infrared sensing pixel 103 includes an array of infrared sensing units 105 connected in series and whose output is fed to an infrared sensing circuit as described in greater detail below.
  • Each sensing unit 105 includes an infrared antenna in the form of a bowtie dipole antenna 106 having a relative small dimension to efficiently collect infrared energy as will be appreciated by those skilled in the art.
  • the length L of the dipole antenna 106 may be about 3.5 microns.
  • the overall size of the infrared sensing pixel 103 may be about 50 microns on each side as is consistent with the dimensions of a typical electric field sensing pixel as will be described in greater detail below.
  • the infrared sensing pixels 103 may be at a density of 125 pixels per inch to capture subdermal patterns, and about 250 for ridge/valley imaging. Of course, other dimensions and types of infrared antennas may also. JDR. Liseri.as vill be appreciated by ⁇ those* skilled in the art.
  • the infrared sensing unit 109 may be advantageously formed using the various metal and polycrystalline layers, separated by interlevel dielectric layers, as are commonly used in semiconductor device processing.
  • the upper metal layer is patterned to form the two dipole antenna elements 106a, 106b of the bowtie dipole antenna 106.
  • An interlevel dielectric layer 107 separates the dipole elements 106a, 106b from the underlying antenna ground plane 108 provided by patterning the second metal layer as will be appreciated by those skilled in the art.
  • Another interlevel dielectric layer 111 separates the conductive antenna ground plane 108 from the circuitry patterned using the first metal layer.
  • Two conductive vias 112a, 112b carry the signal from the dipole antenna elements 106a, 106b to a temperature sensor in the form a thermocouple having a measuring junction 114 and a reference junction 115.
  • Polysilicon dissipative regions 117a, 117b are used to match the impedance of about 300 ohms.
  • Tungsten via portions 120, 121 illustratively connect to aluminum signal lines 122, 123, respectively, patterned on the first metal layer.
  • the thermocouple junctions are defined between the polysilicon of the first poly layer and the aluminum of the first metal layer as will be appreciated by those skilled in the art.
  • the reference junction 115 is also shown relatively close to the measuring junction 114 for clarity of explanation; however, in other advantageous embodiments, the reference junction may be spaced considerably further away from the measuring junction.
  • an upper passivation layer 125 (FIG. 11) is also provided over the dipole antenna 106.
  • the infrared unit 105 uses a thermocouple rather than a resistor, for example, to reduce power dissipation during imaging.
  • a resistor or bolometer may be used as the temperature sensor.
  • Each infrared unit 105 may generate an output voltage of about 0.2 to 20 microvolts, for example.
  • Another embodiment of an infrared sensing unit 105' is explained with reference to FIG. 8. In this embodiment, the dropping resistor is provided by a portion of the substrate 117' .
  • the ohmic region could also be the channel of an FET allowing modulation of the power dissipated by changing the gate voltage.
  • the conductive vias 112a' , 112b' allow conduction of the current wave from the dipole antenna 106' through to the lower layers of the integrated circuit device.
  • a dielectric layer 124 is provided that may provide additional ESD protection as will be understood by those of skill in the art.
  • Those other elements of the embodiment of FIG. 8, not specifically mentioned, are indicated by prime notation and are similar to elements described above with reference to FIGS. 6 and 7.
  • radial strings of infrared antennas are positioned within a circular aperture 125 through the ground plane of an infrared sensing pixel IUJ.
  • the measuring junctions are positioned beneath the infrared antennas, while signal lines connect to the reference junctions that are positioned on the periphery of the overall pixel.
  • the reference junctions are therefore obscured from the in£ra ⁇ ed xadiat" 5 en by the ground pl ⁇ n ⁇ ., ⁇ -a's..,will be appreciated by those skilled in the art.
  • other layouts for the infrared pixels 103, 103' are also contemplated.
  • the method may include receiving a user's finger 100, 100' adjacent an integrated circuit substrate 102, 102', and sensing infrared radiation emitted from subdermal features of the user's finger 100, 100' positioned adjacent the integrated circuit substrate by using a plurality of infrared sensing pixels 103, 103' on the integrated circuit substrate.
  • Each infrared sensing pixel 103, 103' may comprise at least one temperature sensor, such as the thermocouple junctions 114, 115 and 114' , 115' described above, and at least one infrared antenna 106, 106' above and connected to the at least one temperature sensor.
  • the method may also include generating infrared biometric data based upon infrared radiation emitted from the subdermal features of the user's finger.
  • the conducted thermal energy is generally dominant, and in it the pattern of the finger surface friction ridges dominates.
  • the patterns of the subdermal sources such as the arterial blood supply are overwhelmed by the strong ridge pattern signal. While reading the friction ridge pattern can be useful, that is not tv.p.i.C3lly .req ⁇ .irod fr-r the infiare «k--sensors in the multi-biometric sensor embodiments.
  • the friction ridge pattern is noise
  • the pattern of the subdermal features sources is the unique data the sensor is attempting to capture.
  • the infrared sensor arrays of the prior art may also suffer from the omni-directional sensitivity pattern of the pixels.
  • Crosstalk between pixels may become a debilitating problem if the thermal structures to be imaged are farther away from the array than 3 or 4 times the pixel pitch. This is indeed the case when imaging the subdermal structures of the finger.
  • the pixels should have some form of focusing that minimizes crosstalk.
  • the infrared sensors 85, 85' as disclosed herein may use a differential thermal sensing that rejects heat conducted through the surface of the device (that contains primarily the friction ridge pattern) and detects radiant infrared heat (which contains patterns primarily representative of the subdermal arterial blood distribution) ..
  • the antenna and temperature sensor structure provides the focusing to reduce or minimize crosstalk between the pixels and develop clean image of the subdermal thermal pattern.
  • the infrared sensors 85, 85' can be fabricated in existing standard CMOS silicon foundry processes as will be appreciated by those skilled in the art.
  • the illustrated integrated circuit sensor 160 includes an infrared sensing element 161 on a substrate 162 that, in turn, includes a first thermocouple junction 163 heated from infrared radiation, a second thermocouple i ⁇ ncti-on.1S ⁇ r ⁇ nrected to first thermoj& ⁇ uple junction, and a controller 165.
  • the substrate 162 may be an integrated circuit substrate, such as comprising silicon or other similar material as will be appreciated by those skilled in the art.
  • the controller 165 may detect a temperature difference between the first (hot or measuring) thermocouple junction 163 and the second (cold or reference) thermocouple junction 164, and may pump heat therebetween to drive the detected temperature difference toward a desired value.
  • the controller 165 illustratively generates an infrared radiation output signal based upon the heat pumped.
  • the controller 165 may alternatingly switch between detecting the temperature difference and pumping heat, and the desired temperature difference may be zero.
  • the sensor 160 is readily made using integrated circuit processing technology, and may, for example, be used in many types of applications, such as biometric identification by including the biometric processing circuitry 180 connected to the controller 165.
  • the controller 165 may also output the infrared radiation signal to image processing circuitry 181 or other types of processing circuitry 182 as will be appreciated . by those of skill in the art.
  • the controller 165 includes a detector 166 for detecting a voltage between the first thermocouple junction 163 and the second thermocouple junction 164 indicative of a temperature difference therebetween.
  • the controller 165 also illustratively includes a driver 167 for driving current through the thermocouple junctions 163, 164 to pump heat therebetween.
  • the controller 165 also includes a switcher 170 for alternatingly switching the first and second .therm o couple junctions 163, If ⁇ -between the detector 166 and the driver 167.
  • controller 165 also includes a regulator 171 to operate the driver 167 responsive to the detector 166 so that the detected voltage is driven toward zero, for example.
  • controller also includes a reader 172 connected to the driver 167 for determining the drive current provided thereby indicative of the heat pumped.
  • the second thermocouple junction 164 may be thermally coupled to the substrate 162 via a lower thermal resistance than the first thermocouple junction 163.
  • the integrated circuit sensor 160 may also comprise at least one solid layer between the substrate 162 and the first thermocouple junction 163 so that there is no void therebetween. This may greatly streamline manufacturing and/or reduce manufacturing costs.
  • the at least one solid layer may comprise at least one oxide layer, such as silicon- oxide widely used as an interlevel dielectric in integrated circuit processing.
  • the more complicated thermal isolation structures incorporating voids and/or bridge elements may also be used.
  • the sensor 160 may include a plurality of infrared sensing elements 161 for many typical applications. Accordingly, the second thermocouple junctions 164 of the plurality of infrared sensing elements may be thermally coupled to the substrate 162. As noted above, the infrared sensing element 161 may further comprise an infrared radiation antenna, such as the bowtie dipole antenna element 106 (FIG. 6) , thermally coupled to the first thermocouple junction 163. As will also be appreciated by those skilled in the art, the infrared se ⁇ js ⁇ ..element -161 may include a plurality first and second thermocouple junctions 163, 164 connected together to define a thermopile to generate larger signal amplitudes.
  • the infrared se ⁇ js ⁇ ..element -161 may include a plurality first and second thermocouple junctions 163, 164 connected together to define a thermopile to generate larger signal amplitudes.
  • Another aspect of the invention is directed to a method for infrared sensing using an integrated circuit sensor 160.
  • the method may include detecting a temperature difference between the at least one first thermocouple junction 163 and the at least one second thermocouple junction 164; pumping heat between the at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value; and generating an infrared radiation output signal based upon the heat pumped.
  • FIG. 13 a digital embodiment of the infrared sensing integrated circuit 160 is now described.
  • This circuit 160 uses a thermopile on the substrate 162 that is continuously, alternatingly, switched between heat pumping mode .and heat sensing mode by the switcher 170 driven by the thermopile mode switch clock signal.
  • the second thermocouple junction 164 is thermally coupled to the substrate by the schematically illustrated thermal link 194.
  • the controller 165 provides closed loop temperature difference regulation that operates to minimize the temperature difference between the first and second junctions 163, 164. Whenever the temperature difference between the junctions 163, 164 is positive as determined at comparator 190, which serves as the temperature difference detector, and as indicated by the positive voltage measured during the measurement phase of the cycle, current is driven through the thermopile, during the heat pumping phasp. of t-ho cycle, causing thermal CFi->rgy to be driven from the first junction 163 to the second junction 164. " The current is driven by the pumping current control switch 191 as driven by the output of the NAND gate 192 that, in turn, is fed by the thermopile mode switch clock.
  • the NAND gate 192 is also fed by the D-type latch 193 that is clocked by the comparator read sync signal.
  • the heat flux pumped through the thermopile operating in the heat pump or Peltier mode is proportional to the average pulse rate of the current source.
  • This pulse signal as output from the NAND gate 191 in the illustrated embodiment may be fed to a counter, not shown, to generate the measurement.
  • the pulse signal could be simply analog averaged, to generate an analog signal representing the heat flux as will be appreciated by those skilled in the art.
  • the measurement can be scaled by changing the magnitude of the current in the current source driving the heat pump mode.
  • the circuit can also be scaled by modifying the duty cycle of the pump current.
  • Each of these approaches can generate a scaling range in excess of 10 to 1 for a composite scaling range in excess of 100 to 1.
  • Zero offset in the comparators 190 that varies from pixel to pixel, or varies over time or with temperature can become a significant source of error in the sensor 160.
  • a switched auto-zero circuit can be added to the comparator 190 to null out the offset voltage inherent in the CMOS comparator.
  • the comparator 190 can be isolated from the rest of the circuit during the heat pumping phase and the offset measured during that time. It may also be desirable to isolate the comparator 190 from the possible larger voltages applied during the heat pumping phase in •?ny -7""" 1 It . • The'ofljet can then ioe-'-held on a small capacitor, not shown, for use in compensation during the measurement phase.
  • an analog embodiment of the infrared sensor 160' and its controller 165' are now described.
  • an analog control loop is used to drive the temperature difference between the first and second thermocouple junctions 163' , 164' to zero.
  • a switched, auto-zeroed differential amplifier 195 is used with the auto zero cycle executed during the heat pumping phase.
  • the proportional plus integral controller 196 can drive the temperature difference closer to zero that the closed-loop-gain-limited accuracy of a simple proportional controller, for example, as will be appreciated by those skilled in the art.
  • a sample and hold circuit 197 is provided between the output of the amplifier 195 and the proportional plus integral controller 196 and both are.
  • the proportional plus integral controller 196 also provides an analog signal output that may be received by an analog- to-digital converter, not shown to generate the infrared output signal.
  • an analog- to-digital converter not shown to generate the infrared output signal.
  • the substrate 162" under the thermocouple junctions 163", 164" may be undoped crystalline silicon that has a fairly low thermal conductivity.
  • the metal two plate (not shown) may be adjacent to the second or cold junction region and provide a heat sink in that area, but is removed in the area of the first or hot junction. If the heat pump approach is used, heat will be drawn through the polysilicon from the hot junctions to the cold junctions, and from there dissipate through the metal two plate.
  • thermocouple junctions heat flow through the aluminum as represented by RTa will be small. Furthermore, heat flow from the thermocouple junctions to their local environment, represented by the substrate, will then be proportional to the ratio of the lees ⁇ str ⁇ rnoes f RTh/RTc. If that- ' 'tratio can be kept fairly high, then the large majority of the heat ' coming into the first junction 163" will flow through the heat pump; hence, the pumping rate, and therefore the pump drive current, will directly represent the incoming heat flux.
  • FIG. 17 illustrates the position of the metal two plate 198 and assumes that the aluminum legs of the thermocouples have negligible contribution to both the overall electrical resistance of the circuit and the Seebeck voltages generated by the circuit.
  • Rin is the amplifier input resistance
  • RIk are the leakage resistances. Rin and RIk are different when the circuit is in measurement mode versus heat pumping mode.
  • FIG. 18 illustrates the various parasitic capacitances to also be considered as will be appreciated by those skilled in the art.
  • the infrared sensors and related methods disclosed herein are particularly advantageously used in bi ⁇ metric identification, such as upon imaging the subdermal features of the finger. Of course, this infrared image collection can be used in combination with other biometrics as disclosed in the parent U.S.

Abstract

An integrated circuit sensor may include at least one infrared sensing element on a substrate. The sensing element may include at least one first thermocouple junction heated from infrared radiation, at least one second thermocouple junction connected to the first thermocouple junction, and a controller. The controller may detect a temperature difference between the first and second thermocouple junctions, and may pump heat therebetween to drive the detected temperature difference toward a desired value. The controller may also generate an infrared radiation output signal based upon the heat pumped. The controller may alternatingly switch between detecting the temperature difference and pumping heat, and the desired temperature difference may be zero. The sensor is readily made using integrated circuit processing technology, and may, for example, be used in many types of applications, such as biometric identification by including biometric processing circuitry connected to the controller.

Description

INTEGRATED CIRCUIT INFRARED SENSOR AND ASSOCIATED METHODS
Field of the Invention
[0001] The present invention relates to sensors, and, more particularly, to sensors for infrared radiation and
Background of the Invention
[0002] Infrared thermal imaging is commonly used for various applications. For example, Published U.S. Patent Application No. 2005/0069180 to Setlak et al. and assigned to the assignee of the present invention, discloses significant advances in infrared imaging for biometric identification of a user's finger. The entire contents of the Setlak et al. application are incorporated herein by reference along with its related applications, Nos. 2005/0089203; 2005/0089202; 2005/0069181; 2005/0063573; 2005/0063572; and 2005/0063571. The infrared imaging described by Setlak et al. includes thermopile sensing pixels that can be used either alone or in combination with other biometric sensing techniques for enhanced accuracy. [0003] Other uses for infrared sensors include automotive, spectroscopic and general imaging application as d-:.3cribed, for example, in U.S. Patent No. 5,689,087 to Jack. In infrared thermal imaging systems typical engineering practice is to minimize the heat flux away from the thermal pickup elements by a variety of thermal isolation methods. The temperature of the thermal sensing elements is allowed to stabilize, hopefully approaching that of the heat source target, and then that temperature is measured. Typical methods of thermally isolating the sensing elements include: back thinning of the semiconductor waters oeninα the sensing elements, micromachining void spaces around the sensing elements, floating the sensing elements, etc. Unfortunately, these methods may not be available inexpensively in standard semiconductor foundry processing. These methods may also suffer losses due to the heat conduct-lsfe acioss the suspension members and across the measurement connections. The λ087 patent to Jack, for example, discloses that the hot junction is thermally isolated from the substrate by being suspended from the substrate on dielectric bridges or, in another embodiment, by a thermally insulating and patterned polymer.
[0004] European Published Patent Application No. 1,045,233 A2 discloses an infrared sensor including a flexible diaphragm that may be disposed over a cavity, a thermoelectric element that converts heat to an electrical signal, and an electrothermic element that converts an electrical signal to heat. The thermoelectric element is on the diaphragm and the electrothermic element is on the diaphragm adjacent the thermoelectric element. A reference signal is supplied that is compared with the output of the thermoelectric element for controlling the driving of the electrothermic element. The reference signal and the output signal are compared and the electrothermic element is driven to compensate for the difference between the two signals. Accordingly, the electrothermic element is controlled so as to offset the energy that is detected by the thermoelectric element more rapidly than the thermal response of the diaphragm, thereby eliminating the temperature changes in the diaphragm. The application notes that free of the influence of the thermal time constant of the diaphragm, the response speed with respect to incident mtrared light can be greatly improved and the linearity of the thermoelectric conversion can be improved. [0005] Unfortunately, the approach described in the EP 1,045,233 published application requires separate sensing and temperature control elements to be positioned on the diaphragm, and the diaphragm may stiHt/ase a cavity therebeneath. In addition, many of the conventional approaches to thermal isolation of the sensing elements make use of complicated processing techniques. Such techniques also typically suffer from losses due to the heat conduction across suspension members and across the measurement connections .
Summary of the Invention
[0006] In view of the foregoing background, it is therefore an object of the present invention to provide an integrated circuit sensor and associated methods for infrared radiation sensing that is readily implemented using integrated circuit processing technology. [0007] This and other objects, features and advantages in accordance with the present invention are provided by an integrated circuit sensor comprising at least one infrared sensing element on a substrate and including at least one first thermocouple junction heated from infrared radiation, at least one second thermocouple junction connected to the at least one first thermocouple junction, and a controller. More particularly, the controller may detect a temperature difference between the at least one first thermocouple junction and the at least one second thermocouple junction, and may pump heat between the at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value. The controller may also generate an infrared radiation output signal based upon the heat pumped. For example, the controller may alternatingly switch between detecting the temperature difference and pumping heat, and the desired temperature difference may be zero. The sensor may be readily made using integrated pxQcessinσ technology, and
Figure imgf000005_0001
example, be used in many types of applications, such as biometric identification, by including biometric processing circuitry connected to the controller.
[0008] The controller may comprise a detector for detecting a voltage between the at least one first thermocouple junction and the at least one second thermocouple junction indicative of a temperature difference therebetween, and a driver for driving current through the at least one first thermocouple junction and the at least one second thermocouple junction to pump heat therebetween. The controller may also include a switcher for alternatingly switching the at least one first thermocouple junction and the at least one second thermocouple junction between the detector and the driver, and a regulator to operate the driver responsive to the detector so that the detected voltage is driven toward zero. In addition, the controller may include a reader connected to the driver for determining the drive current provided thereby indicative of the heat pumped. [0009] The at least one second thermocouple junction may be thermally coupled to the substrate via a lower thermal resistance than the at least one first thermocouple junction. The integrated circuit sensor may further comprise at least one solid layer between the substrate and the at least one first thermocouple junction so that there is no void therebetween. This may greatly streamline manufacturing and/or reduce manufacturing costs. For example, the at least one solid layer may comprise at least one oxide layer, such as silicon oxide widely used as an interlevel dielectric in integrated circuit processing. [0010] The at least one infrared sensing element may comprise ..a olural i-i-y thereof for mαry.-iiypical applications. Accordingly, the second thermocouple junctions of the plurality of infrared sensing elements may be thermally coupled to the substrate. The at least one infrared sensing element may further comprise an infrared radiation antenna thermally coupled to the at least one first thermocouple junction.
[0011] The at least one first thermocouple junction may include a plurality thereof connected together. The at least one second thermocouple junction may also include a plurality thereof connected together in a thermopile arrangement to generate larger signal amplitudes. [0012] Another aspect of the invention is directed to a method for infrared sensing using an integrated circuit sensor. As noted above, the integrated circuit sensor may include a substrate and at least one infrared sensing element on the substrate. The at least one infrared sensing element may comprise at least one first thermocouple junction heated from infrared radiation, and at least one second thermocouple junction connected to the at least one first thermocouple junction. The method may include detecting a temperature difference between the at least one first thermocouple junction and the at least one second thermocouple junction; pumping heat between the at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value; and generating an infrared radiation output signal based upon the heat pumped.
Brief Description of the Drawings
[0013] FIG. 1 is a schematic diagram of a first embodiment of an electronic device including an infrared .fipgex-jsensor jr ?rcordance with the £s_r&!=?ent invention. [0014] FIG. 2 is a schematic diagram of a second embodiment of an electronic device including an infrared finger sensor in accordance with the present invention. [0015] FIG. 3 is a more detailed schematic diagram, partially in section, of a portion of the electronic device as shown in FIG. 1.
[0016] FIG. 4 is a more detailed schematic diagram, partially in section, of a portion of the electronic device as shown in FIG. 2.
[0017] FIG. 5 is a schematic plan view of an embodiment of an infrared sensing pixel for the infrared sensor as shown in FIG. 2.
[0018] FIG. 6 is a schematic perspective view, partially in section, of an individual infrared antenna and thermocouple temperature sensor for the infrared sensing pixel as shown in FIG. 5.
£0019] FIG. 7 is a top plan view of the infrared antenna element and thermocouple sensor as shown in FIG. 6. [0020] FIG. 8 is a schematic perspective view, partially in section, of an alternate embodiment of an individual infrared antenna and thermocouple temperature sensor for the infrared sensing pixel as shown in FIG. 5. [0021] FIG. 9 is an enlarged schematic cross-sectional view through the middle of an individual infrared antenna and temperature sensor as shown in FIG. 6. [0022] FIG. 10 is a top plan view of an individual infrared sensing pixel as may be used in the infrared sensor as shown in FIG. 1.
[0023] FIG. 11 is an enlarged top plan view from the center portion of FIG. 10.
[0024] FIG. 12 is a schematic diagram of the infrared sensj_Dσ..r>j xe.l and associated contrcllofirrars may used in the devices of FIGS. 1 and 2.
[0025] FIG. 13 is a more detailed schematic diagram of an embodiment of the infrared sensing pixel and associated controller as shown in FIG. 12.
[0026] FIG. 14 is a more detailed schematic diagram of another embodiment of the infrared sensing pixel and associated controller as shown in FIG. 12.
[0027] FIGS. 15 and 16 are schematic diagrams modeling the thermal relationships of the infrared sensing pixel as shown in FIG. 12.
[0028] FIGS. 17 and 18 are schematic diagrams modeling the electrical relationships of the infrared sensing pixel as shown in FIG. 12.
Detailed Description of the Preferred Embodiments [0029] The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like numbers refer to like elements throughout, and prime and multiple prime notation are used to indicate similar elements in alternate embodiments. [0030] In accordance with the present invention, the infrared sensor may measure the heat flux impinging on the sensor rather than the temperature of the sensor to reduce the need for high-quality thermal isolation. The heat pumping may cool (or raise) the temperature of the sensing element. to .that- of the substrate,
Figure imgf000009_0001
the temperature difference to near zero and hence the heat loss through other mechanisms to near zero. A closed loop control system may be used to drive the heat pump to produce a null temperature difference between the sensing element and the substrate, hence this is a form of balanced differential measurement.
[0031] In this case essentially all of the incident heat flux may flow through the heat pump, and a measurement of the energy expended to pump that heat is a measurement of the incident heat flux on the sensor. As in other differential nulling measurements the first order error may be largely a function of the control loop gain and offset, which can be readily controlled using standard electronic circuit design practices. This concept allows the fabrication of infrared sensors on standard process substrates without the need for special processing to produce high quality thermal isolation. Using this method, the thermal isolation supplied by standard silicon dioxide integrated circuit dielectric materials may be sufficient to allow sensitive and accurate measurements. It is particularly applicable to arrays of infrared sensors where the parameter of interest is the relative difference between the individual pixels in the array and the average of all the pixels in the array.
[0032] Referring now to FIGS. 1-4, various embodiments of infrared sensing pixel finger sensors 85, 85' are first described. With particular reference to FIGS. 1 and 3, the electronic device is in the exemplary form of a cellular telephone 80 that includes a portable housing 81. The portable housing 81 carries an infrared finger sensor 85, and a lighted keypad 82 that, in turn, includes a plurality .of ..user..operable i^put keys S3. The p^aartable . housing 81 also carries a processor 84 that is connected to the infrared sensor 85 and the optical source 87 for lighting the keypad 82 via the optical guide 91. A display 88 is illustratively carried by the upper portion of the portable housing 81 and is also connected to the processor 84. [0033] The cellular phone 80 may also include a power source, such as a rechargeable battery 92, carried by the portable housing 81 and connected to the processor 84 and other electronic components within the housing as will be appreciated by those skilled in the art. A memory 94 is also connected to the processor 84.
[0034] The infrared sensor 85 includes an integrated circuit substrate 102 and a plurality of infrared sensing pixels 103 on the integrated circuit substrate for sensing infrared radiation naturally emitted from subdermal features of the user's finger 100. The processor 84 is connected to the infrared sensing pixels 83 for generating the infrared biometric data based upon naturally emitted radiation from subdermal features of the user's finger 100. [0035] The processor 84 further illustratively includes a matcher 104 for determining a match between the infrared biometric data of the user's finger and stored infrared biometric data for an enrolled user. This match determination, in turn, may be used by a function enabler 105 of the processor 84 to enable at least one device function, such as permitting operation of the transmit and receive functions of the cellular telephone 80, for example. The matcher 104 and enabler 105 may be implemented on a CPU of the processor 84 operating under stored program control, as will be appreciated by those skilled in the art without requiring further discussion Jxexein .
[0036] Those of skill in the art will appreciate other device functions that may be controlled, such as access to data if the electronic device were a PDA, for example. Of course, many other electronic devices may benefit from the infrared finger sensing, and these devices may include other access limiting functions. The infrared biometric data may be accurately and efficiently obtained using the compact integrated circuit-based sensor 85. [0037] Another aspect of the infrared sensor 85 is that its processing may be self-contained on the integrated circuit substrate 102 itself, or, as shown in the illustrated embodiment, the integrated circuit may contain some of the processing circuitry 107. For example, pixel reading amplifiers and/or other image processing active devices may be provided on the substrate 102 using conventional CMOS technology, for example. In yet other embodiments, all or a majority of the signal processing circuitry may be located off-chip. The integrated circuit substrate 102 may preferably a silicon substrate as will be appreciated by those skilled in the art.
[0038] The illustrated embodiment of the infrared sensor 85 is a static placement sensor. In other words, the size of the array of pixels 103 is relatively large compared to a sliding placement sensor as discussed below. Also, for the static placement sensor 105, the processor 104 generates the infrared biometric data based upon static placement of the user's finger adjacent the integrated circuit substrate 102.
[0039] Referring now more particularly to FIGS. 2 and 4, another class of embodiments of infrared finger sensor 85' is now described. In these embodiments, the illustrated ±αfrared sensor ?F' • is in the form cf--«Q*>- sliding placement sensor that has a smaller sensing area over which the user slides his finger 100' as will be appreciated by those skilled in the art. In these embodiments, the processor 104' may collect frames of infrared image data from the infrared sensing pixels 103' .
[0040] Those other elements of the embodiment of the cellular telephone 80' shown in FIGS. 2 and 4 are similar to those of the embodiment of the cellular telephone 80 described above with respect to FIGS. 1 and 3, and are indicated with prime notation. Accordingly, these elements require no further discussion herein.
[0041] Turning now additionally to FIGS. 5 through 11, other general aspects of exemplary infrared sensing pixels 103 are now described. As shown in FIG. 5, for example, the infrared sensing pixel 103 includes an array of infrared sensing units 105 connected in series and whose output is fed to an infrared sensing circuit as described in greater detail below. Each sensing unit 105 includes an infrared antenna in the form of a bowtie dipole antenna 106 having a relative small dimension to efficiently collect infrared energy as will be appreciated by those skilled in the art. For example, for infrared radiation at a wavelength of about 7 microns, the length L of the dipole antenna 106 may be about 3.5 microns. The overall size of the infrared sensing pixel 103 may be about 50 microns on each side as is consistent with the dimensions of a typical electric field sensing pixel as will be described in greater detail below. The infrared sensing pixels 103 may be at a density of 125 pixels per inch to capture subdermal patterns, and about 250 for ridge/valley imaging. Of course, other dimensions and types of infrared antennas may also. JDR. Liseri.as vill be appreciated by^those* skilled in the art.
[0042] As shown in FIGS. 6, 7 and 9, the infrared sensing unit 109 may be advantageously formed using the various metal and polycrystalline layers, separated by interlevel dielectric layers, as are commonly used in semiconductor device processing. In the illustrated embodiment, the upper metal layer is patterned to form the two dipole antenna elements 106a, 106b of the bowtie dipole antenna 106. An interlevel dielectric layer 107 separates the dipole elements 106a, 106b from the underlying antenna ground plane 108 provided by patterning the second metal layer as will be appreciated by those skilled in the art. Another interlevel dielectric layer 111 separates the conductive antenna ground plane 108 from the circuitry patterned using the first metal layer.
[0043] Two conductive vias 112a, 112b carry the signal from the dipole antenna elements 106a, 106b to a temperature sensor in the form a thermocouple having a measuring junction 114 and a reference junction 115. Polysilicon dissipative regions 117a, 117b are used to match the impedance of about 300 ohms. Tungsten via portions 120, 121 illustratively connect to aluminum signal lines 122, 123, respectively, patterned on the first metal layer. The thermocouple junctions are defined between the polysilicon of the first poly layer and the aluminum of the first metal layer as will be appreciated by those skilled in the art. The reference junction 115 is also shown relatively close to the measuring junction 114 for clarity of explanation; however, in other advantageous embodiments, the reference junction may be spaced considerably further away from the measuring junction. As will also be .understood by those of skill in the aeS«, an upper passivation layer 125 (FIG. 11) is also provided over the dipole antenna 106.
[0044] The infrared unit 105 uses a thermocouple rather than a resistor, for example, to reduce power dissipation during imaging. Of course, in other embodiments, a resistor or bolometer may be used as the temperature sensor. Each infrared unit 105 may generate an output voltage of about 0.2 to 20 microvolts, for example. [0045] Another embodiment of an infrared sensing unit 105' is explained with reference to FIG. 8. In this embodiment, the dropping resistor is provided by a portion of the substrate 117' . The ohmic region could also be the channel of an FET allowing modulation of the power dissipated by changing the gate voltage. The conductive vias 112a' , 112b' allow conduction of the current wave from the dipole antenna 106' through to the lower layers of the integrated circuit device. In addition, a dielectric layer 124 is provided that may provide additional ESD protection as will be understood by those of skill in the art. Those other elements of the embodiment of FIG. 8, not specifically mentioned, are indicated by prime notation and are similar to elements described above with reference to FIGS. 6 and 7.
[0046] As shown in top plan views of FIGS. 10 and 11, radial strings of infrared antennas are positioned within a circular aperture 125 through the ground plane of an infrared sensing pixel IUJ. The measuring junctions are positioned beneath the infrared antennas, while signal lines connect to the reference junctions that are positioned on the periphery of the overall pixel. The reference junctions are therefore obscured from the in£raχed xadiat"5 en by the ground plαnε.,<-a's..,will be appreciated by those skilled in the art. Of course, other layouts for the infrared pixels 103, 103' are also contemplated.
[0047] Referring again to FIGS. 1 through 11, another method aspect of the invention directed to infrared finger sensing is now described. The method may include receiving a user's finger 100, 100' adjacent an integrated circuit substrate 102, 102', and sensing infrared radiation emitted from subdermal features of the user's finger 100, 100' positioned adjacent the integrated circuit substrate by using a plurality of infrared sensing pixels 103, 103' on the integrated circuit substrate. Each infrared sensing pixel 103, 103' may comprise at least one temperature sensor, such as the thermocouple junctions 114, 115 and 114' , 115' described above, and at least one infrared antenna 106, 106' above and connected to the at least one temperature sensor. The method may also include generating infrared biometric data based upon infrared radiation emitted from the subdermal features of the user's finger. [0048] U.S. Patent No. 5,351,303 to Willmore schematically discloses a contact sensor for reading the infrared profile of the finger, but no successful implementation of the method described is known to date. Such an infrared sensor may suffer from sensitivity to both conducted thermal energy and radiated thermal energy. In the finger contact application, the conducted thermal energy is generally dominant, and in it the pattern of the finger surface friction ridges dominates. The patterns of the subdermal sources, such as the arterial blood supply are overwhelmed by the strong ridge pattern signal. While reading the friction ridge pattern can be useful, that is not tv.p.i.C3lly .reqυ.irod fr-r the infiare«k--sensors in the multi-biometric sensor embodiments. In this case, the friction ridge pattern is noise, and the pattern of the subdermal features sources is the unique data the sensor is attempting to capture.
[0049] The infrared sensor arrays of the prior art may also suffer from the omni-directional sensitivity pattern of the pixels. Crosstalk between pixels may become a debilitating problem if the thermal structures to be imaged are farther away from the array than 3 or 4 times the pixel pitch. This is indeed the case when imaging the subdermal structures of the finger. To be successful, the pixels should have some form of focusing that minimizes crosstalk. The infrared sensors 85, 85' as disclosed herein may use a differential thermal sensing that rejects heat conducted through the surface of the device (that contains primarily the friction ridge pattern) and detects radiant infrared heat (which contains patterns primarily representative of the subdermal arterial blood distribution) .. The antenna and temperature sensor structure provides the focusing to reduce or minimize crosstalk between the pixels and develop clean image of the subdermal thermal pattern. The infrared sensors 85, 85' can be fabricated in existing standard CMOS silicon foundry processes as will be appreciated by those skilled in the art.
[0050] Turning now additionally to FIG. 12, the differential thermal sensing approach in accordance with the present invention is now described in a greater level of detail. The illustrated integrated circuit sensor 160 includes an infrared sensing element 161 on a substrate 162 that, in turn, includes a first thermocouple junction 163 heated from infrared radiation, a second thermocouple iυncti-on.1SΛ r^nrected to first thermoj&αuple junction, and a controller 165. The substrate 162 may be an integrated circuit substrate, such as comprising silicon or other similar material as will be appreciated by those skilled in the art.
[0051] The controller 165 may detect a temperature difference between the first (hot or measuring) thermocouple junction 163 and the second (cold or reference) thermocouple junction 164, and may pump heat therebetween to drive the detected temperature difference toward a desired value. Of course, the controller 165 illustratively generates an infrared radiation output signal based upon the heat pumped. For example, the controller 165 may alternatingly switch between detecting the temperature difference and pumping heat, and the desired temperature difference may be zero. The sensor 160 is readily made using integrated circuit processing technology, and may, for example, be used in many types of applications, such as biometric identification by including the biometric processing circuitry 180 connected to the controller 165. The controller 165 may also output the infrared radiation signal to image processing circuitry 181 or other types of processing circuitry 182 as will be appreciated. by those of skill in the art. [0052] The controller 165 includes a detector 166 for detecting a voltage between the first thermocouple junction 163 and the second thermocouple junction 164 indicative of a temperature difference therebetween. The controller 165 also illustratively includes a driver 167 for driving current through the thermocouple junctions 163, 164 to pump heat therebetween. The controller 165 also includes a switcher 170 for alternatingly switching the first and second .thermocouple junctions 163, If^-between the detector 166 and the driver 167. In addition, the controller 165 also includes a regulator 171 to operate the driver 167 responsive to the detector 166 so that the detected voltage is driven toward zero, for example. The controller also includes a reader 172 connected to the driver 167 for determining the drive current provided thereby indicative of the heat pumped.
[0053] As will be described further below, the second thermocouple junction 164 may be thermally coupled to the substrate 162 via a lower thermal resistance than the first thermocouple junction 163. The integrated circuit sensor 160 may also comprise at least one solid layer between the substrate 162 and the first thermocouple junction 163 so that there is no void therebetween. This may greatly streamline manufacturing and/or reduce manufacturing costs. For example, the at least one solid layer may comprise at least one oxide layer, such as silicon- oxide widely used as an interlevel dielectric in integrated circuit processing. Of course, in other embodiments, the more complicated thermal isolation structures incorporating voids and/or bridge elements may also be used.
[0054] The sensor 160 may include a plurality of infrared sensing elements 161 for many typical applications. Accordingly, the second thermocouple junctions 164 of the plurality of infrared sensing elements may be thermally coupled to the substrate 162. As noted above, the infrared sensing element 161 may further comprise an infrared radiation antenna, such as the bowtie dipole antenna element 106 (FIG. 6) , thermally coupled to the first thermocouple junction 163. As will also be appreciated by those skilled in the art, the infrared seπjs±αα..element -161 may include a plurality first and second thermocouple junctions 163, 164 connected together to define a thermopile to generate larger signal amplitudes.
[0055] Another aspect of the invention is directed to a method for infrared sensing using an integrated circuit sensor 160. The method may include detecting a temperature difference between the at least one first thermocouple junction 163 and the at least one second thermocouple junction 164; pumping heat between the at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value; and generating an infrared radiation output signal based upon the heat pumped. [0056] Turning now additionally to FIG. 13, a digital embodiment of the infrared sensing integrated circuit 160 is now described. This circuit 160 uses a thermopile on the substrate 162 that is continuously, alternatingly, switched between heat pumping mode .and heat sensing mode by the switcher 170 driven by the thermopile mode switch clock signal. The second thermocouple junction 164 is thermally coupled to the substrate by the schematically illustrated thermal link 194.
[0057] The controller 165 provides closed loop temperature difference regulation that operates to minimize the temperature difference between the first and second junctions 163, 164. Whenever the temperature difference between the junctions 163, 164 is positive as determined at comparator 190, which serves as the temperature difference detector, and as indicated by the positive voltage measured during the measurement phase of the cycle, current is driven through the thermopile, during the heat pumping phasp. of t-ho cycle, causing thermal CFi->rgy to be driven from the first junction 163 to the second junction 164. " The current is driven by the pumping current control switch 191 as driven by the output of the NAND gate 192 that, in turn, is fed by the thermopile mode switch clock. The NAND gate 192 is also fed by the D-type latch 193 that is clocked by the comparator read sync signal. [0058] In this embodiment, the heat flux pumped through the thermopile operating in the heat pump or Peltier mode is proportional to the average pulse rate of the current source. This pulse signal as output from the NAND gate 191 in the illustrated embodiment may be fed to a counter, not shown, to generate the measurement. Alternatively, the pulse signal could be simply analog averaged, to generate an analog signal representing the heat flux as will be appreciated by those skilled in the art. The measurement can be scaled by changing the magnitude of the current in the current source driving the heat pump mode. The circuit can also be scaled by modifying the duty cycle of the pump current. Each of these approaches can generate a scaling range in excess of 10 to 1 for a composite scaling range in excess of 100 to 1.
[0059] Zero offset in the comparators 190 that varies from pixel to pixel, or varies over time or with temperature can become a significant source of error in the sensor 160. A switched auto-zero circuit can be added to the comparator 190 to null out the offset voltage inherent in the CMOS comparator. The comparator 190 can be isolated from the rest of the circuit during the heat pumping phase and the offset measured during that time. It may also be desirable to isolate the comparator 190 from the possible larger voltages applied during the heat pumping phase in •?ny -7"""1It . • The'ofljet
Figure imgf000021_0001
can then ioe-'-held on a small capacitor, not shown, for use in compensation during the measurement phase.
[0060] Turning additionally to FIG. 14, an analog embodiment of the infrared sensor 160' and its controller 165' are now described. In this embodiment, an analog control loop is used to drive the temperature difference between the first and second thermocouple junctions 163' , 164' to zero. A switched, auto-zeroed differential amplifier 195 is used with the auto zero cycle executed during the heat pumping phase. The proportional plus integral controller 196 can drive the temperature difference closer to zero that the closed-loop-gain-limited accuracy of a simple proportional controller, for example, as will be appreciated by those skilled in the art. In this embodiment, a sample and hold circuit 197 is provided between the output of the amplifier 195 and the proportional plus integral controller 196 and both are. clocked from the measurement read -sync signal as will also be appreciated by those skilled in the art. In addition, the proportional plus integral controller 196 also provides an analog signal output that may be received by an analog- to-digital converter, not shown to generate the infrared output signal. Those other elements and indicated by prime notation, are similar to the elements described above and need no further discussion herein. [0061] In an uncooled array application of these types of infrared sensors 160, 160' the heat sink or substrate will tend toward the average temperature of all of the pixels. In some pixels then the first junction 163, 163' will be warmer that the second junction 164, 164', and in some pixels the first junction will be cooler than the second jnn^ticn. Accordingly, in these'^'embodiments it may be desirable to be able to run the heat pumping in either direction. The result is to increase the contrast. This can also be accomplished from a single sided power supply circuit by using switches to reverse the connections of the current driver and its ground. An advantage of this approach is that the image does not decay with time as the sense array substrate approaches the average temperature of the target. In arrays requiring minimum per-pixel circuitry, the differential amplifier zero offset can be handled by double sampling, once for the temperature signal and once for the offset signal, and subtracting out the offset before executing the control loop and setting the pumping current.
[0062] Turning now additional to FIG. 15, further features and advantages of the sensor 160" are now discussed. The substrate 162" under the thermocouple junctions 163", 164" may be undoped crystalline silicon that has a fairly low thermal conductivity. The metal two plate (not shown) may be adjacent to the second or cold junction region and provide a heat sink in that area, but is removed in the area of the first or hot junction. If the heat pump approach is used, heat will be drawn through the polysilicon from the hot junctions to the cold junctions, and from there dissipate through the metal two plate. If heat is pumped from the first to the second junction so that the temperature difference between these junctions 163", 164" can be made to approach zero, then the heat flow through the aluminum as represented by RTa will be small. Furthermore, heat flow from the thermocouple junctions to their local environment, represented by the substrate, will then be proportional to the ratio of the lees±strεrnoesf RTh/RTc. If that-''tratio can be kept fairly high, then the large majority of the heat 'coming into the first junction 163" will flow through the heat pump; hence, the pumping rate, and therefore the pump drive current, will directly represent the incoming heat flux. [0063] Heat generated by ohmic dissipation in the thermocouple legs will appear equally split between the first and second junctions 163", 164". In traditional Peltier refrigeration, the I2R heat generation limits the current that can usefully be applied to achieve cooling. In the case of this measurement scheme the I2R heat generation term appears as an error in the measurement. It is possible to subtract out this error, up to the point where the error signal and its variability swamps the signal of interest as will be appreciated by those skilled in the art. Thermocouples with shorter legs will have less error due to the lower ohmic resistance, but will have more error induced by thermal' conductivity along the shorter legs. If the temperature difference can be brought sufficiently close to zero, the errors induced by the thermal conductivity can be minimal. This suggests that the shorter leg thermocouples in the smaller pixels may benefit more from the heat pumping scheme that the larger pixels with longer legs.
[0064] Referring now additionally to FIG. 16, dynamic thermal behavior is further described. The dynamic behavior of the sensor 160" is important to the design of the control loop that minimizes the temperature difference. The time response of the measurement loop will be limited by the thermal time constants as will be appreciated by those skilled in the art. As illustrated, there is a thermal capacity component CTh, CTc for each junction 163", l£4" ac- effects the time constants. ■•&" [0065] Referring now additionally to FIGS. 17 and 18, additional electrical circuit models for the infrared sensor 160" are now described. The electrical model illustrated in FIG. 17 illustrates the position of the metal two plate 198 and assumes that the aluminum legs of the thermocouples have negligible contribution to both the overall electrical resistance of the circuit and the Seebeck voltages generated by the circuit. During the measurement phase, Rin is the amplifier input resistance, and RIk are the leakage resistances. Rin and RIk are different when the circuit is in measurement mode versus heat pumping mode. FIG. 18 illustrates the various parasitic capacitances to also be considered as will be appreciated by those skilled in the art. [0066] The infrared sensors and related methods disclosed herein are particularly advantageously used in biόmetric identification, such as upon imaging the subdermal features of the finger. Of course, this infrared image collection can be used in combination with other biometrics as disclosed in the parent U.S. Patent Application, Serial' No. 10/935,468, filed September 3, 2004. Many other uses for the infrared sensors are also possible as will be appreciated by those skilled in the art. In addition, the integrated circuit heat sensing techniques described herein may be readily used for other heat sensing applications, such as based upon convection or conduction of heat, for example. Accordingly, many modifications and other embodiments of the invention will come to the mind of one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is iin.ders'f'c-cd' that the invention is not to?'"be limited to the specific embodiments disclosed, and that modifications and embodiments are intended to be included within the scope of the appended claims

Claims

THAT WHICH IS CLAIMED IS:
1. An integrated circuit sensor comprising: a substrate; and at least one infrared sensing element on said substrate and comprising at least one tirst rnermocouple junction heated from infrared radiation, at least one second thermocouple junction connected to said at least one first thermocouple junction, and a controller detecting a temperature difference between said at least one first thermocouple junction and said at least one second thermocouple junction, and pumping heat between said at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value, said controller also generating an infrared radiation output signal based upon the heat pumped.
2. The integrated circuit sensor according to Claim 1 wherein said controller alternatingly switches between detecting the temperature difference and pumping heat.
3. The integrated circuit sensor according to Claim 1 wherein the desired temperature difference is zero.
4. The integrated circuit sensor according to Claim 1 further comprising biometric processing circuitry connected to said controller.
5. The integrated circuit sensor according to Claim 1 wherein said controller comprises: a detector for detecting a voltage between said at least one first thermocouple junction and said at least one second thermocouple junction indicative of a temperature difference therebetween; and a driver for driving current through said at least one first thermocouple junction and said at least one .s.e.coΛd thermocouple junctiou to pump heat therebetween.
6. The integrated circuit sensor according to Claim 5 wherein said controller further comprises: a switcher for alternatingly switching said at least one first thermocouple junction and said at least one second thermocouple junction between said detector and said driver; a regulator to operate said driver responsive to said detector so that the detected voltage is driven toward zero; and a reader connected to said driver for determining the drive current provided thereby indicative of the heat pumped.
7. The integrated circuit sensor according to Claim 1 wherein said at least one second thermocouple junction is thermally coupled to said substrate via a lower thermal resistance than said at least one first thermocouple junction.
8. The integrated circuit sensor according to Claim 1 further comprising at least one solid layer between said substrate and said at least one first thermocouple junction so that there is no void therebetween.
9. The integrated circuit sensor according to Claim 8 and wherein said at least one solid layer comprises at least one oxide layer.
10. The integrated circuit sensor according to Claim 1 wherein said at least one infrared sensing element comprises a plurality thereof.
11. The integrated circuit sensor according to Claim 10 wherein said second thermocouple junctions of said plurality of infrared sensing elements are thermally coupled to said substrate.
1.2: The integraled circuit s'ensor according to Claim 1 wherein said at least one infrared sensing" element further comprises an infrared radiation antenna thermally coupled to said at least one first thermocouple junction.
13. The integrated circuit sensor according to Claim 1 wherein said at least one first thermocouple junction comprises a plurality thereof connected together; and wherein said at least one second thermocouple junction comprises a plurality thereof connected together.
14. An integrated circuit sensor comprising: a substrate; and a plurality of infrared sensing elements on said substrate, each infrared sensing element comprising at least one first thermocouple junction heated from infrared radiation, at least one solid layer between said substrate and said at least one first thermocouple junction so that there is no void therebetween, at least one second thermocouple junction connected to said at least one first thermocouple junction, and a controller alternatingly detecting a temperature difference between said at least one first thermocouple junction and said at least one second thermocouple junction, and pumping heat between said at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value.
15. The integrated circuit sensor according to Claim 14 wherein the desired temperature difference is zero.
16. The integrated circuit sensor according to (Main; 14 wherein said controller also generates an infrared radiation output signal.
17. The integrated circuit sensor according to Claim 14 further comprising biometric processing circuitry connected to said controller.
18. The integrated circuit sensor according to Claim 14 wherein said controller comprises: a detector for detecting a voltage between said at least one first thermocouple junction and said at least one second thermocouple junction indicative of a temperature difference therebetween; a driver for driving current through said at least one first thermocouple junction and said at least one second thermocouple junction to pump heat therebetween; a switcher for alternatingly switching said at least one first thermocouple junction and said at least one second thermocouple junction between said detector and said driver; a regulator to operate said driver responsive to said detector so that the detected voltage is driven toward zero; and a reader connected to said driver for determining the drive current provided thereby indicative of the heat pumped.
19. The integrated circuit sensor according to Claim 14 and wherein said at least one solid layer comprises at least one oxide layer.
20. The integrated circuit sensor according to Claim 14 wherein said second thermocouple junctions of said plurality of infrared sensing elements are thermally coupled to said substrate.
21. The integrated circuit sensor according to Cla.iϊP 14 ■wherein each of said infrared s-ejising elements further comprises an infrared radiation antenna thermally coupled to said at least one first thermocouple junction.
22. The integrated circuit sensor according to Claim 14 wherein said at least one first thermocouple junction comprises a plurality thereof connected together; and wherein said at least one second thermocouple junction comprises a plurality thereof connected together.
23. An integrated circuit biometric sensor comprising: a substrate; a plurality of infrared sensing elements on said substrate, each infrared sensing element comprising at least one first thermocouple junction heated from infrared radiation, at least one second thermocouple junction connected to said at least one first thermocouple junction, and a controller detecting a temperature difference between said at least one first thermocouple junction and said at least one second thermocouple junction, and pumping heat between said at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value, said controller also generating an infrared radiation output signal based upon the heat pumped; and biometric processing circuitry connected to said controllers.
24. The integrated circuit biometric sensor according to Claim 23 wherein said controller comprises: a detector for detecting a voltaqe between said at least one first thermocouple junction and said at least one second thermocouple junction indicative of a temperature difference therebetween; a driver for driving current through said at least one first thermocouple junction and said at least one second thermocouple junction to pump heat therebetween; a switcher for alternatingly switching said at least one first thermocouple junction and said at least one second thermocouple junction between said detector and said driver; a regulator to operate said driver responsive to said detector so that the detected voltage is driven toward zero; and a reader connected to said driver for determining the drive current provided thereby indicative of the heat pumped.
25. The integrated circuit biometric sensor according to Claim 23 wherein said second thermocouple junctions of said plurality of infrared sensing elements are thermally coupled to said substrate.
26. The integrated circuit biometric sensor according to Claim 23 wherein each of said infrared sensing elements further comprises an infrared radiation antenna thermally coupled to said at least one first thermocouple junction.
27. An integrated circuit sensor comprising: a substrate; and at least one heat sensing element on said substrate and comprising at least one first thermocouple junction, • at lsast one second thermocouple junction connected to said at least one first thermocouple junction, and a controller detecting a temperature difference between said at least one first thermocouple junction and said at least one second thermocouple junction, and pumping heat between said at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value, said controller also generating a heat output signal based upon the heat pumped.
28. The integrated circuit sensor according to Claim 27 wherein said controller alternatingly switches between detecting the temperature difference and pumping heat; and wherein the desired temperature difference is zero.
29. The integrated circuit sensor according to Claim 27 further comprising biometxic processing circuitry connected to said controller.
30. The integrated circuit sensor according to Claim 27 wherein said controller comprises: a detector for detecting a voltage between said at least one first thermocouple junction and said at least one second thermocouple junction indicative of a temperature difference therebetween; a driver for driving current through said at least one first thermocouple junction and said at least one second thermocouple junction to pump heat therebetween; a switcher for alternatingly switching said at least one first thermocouple junction and said at least one second thermocouple junction between said detector and said driver; a regulator to operate said driver responsive to said detector so that the detected voltage is driven toward zero; and a reader connected to said driver for determining the drive current provided thereby indicative of the heat pumped.
31. A method for infrared sensing using an integrated circuit sensor comprising a substrate and at least one infrared sensing element on the substrate, the at least one infrared sensing element comprising at least one first thermocouple junction heated from infrared radiation, and at least one second thermocouple junction connected to the at least one first thermocouple junction, the method comprising: detecting a temperature difference between the at least one first thermocouple junction and the at least one second thermocouple junction; pumping heat between tht at least one first thermocouple junction and at least one second thermocouple junction to drive the detected temperature difference toward a desired value; and generating an infrared radiation output signal based upon the heat pumped.
32. The method according to Claim 31 further comprising alternatingly switching between detecting the temperature difference and pumping heat; and wherein the desired temperature difference is zero.
33. The method according to Claim 31 further comprising processing the infrared radiation output signal for biometric identification.
34. The method according to Claim 31 wherein H?tecting comprises detecting a voltage rbetween the at least one first thermocouple junction and the -dt least one second thermocouple junction indicative of a temperature difference therebetween; wherein pumping heat comprises driving current through the at least one first thermocouple junction and the at least one second thermocouple junction to pump heat therebetween; and wherein generating comprises determining the drive current provided thereby indicative of the heat pumped.
35. The method according to Claim 31 wherein the integrated circuit sensor further comprises at least one solid layer between the substrate and the at least one first thermocouple junction so that there is no void therebetween.
36. The method according to Claim 31 wherein the at least one infrared sensing element further comprises an infrared radiation antenna thermally coupled to the at least one first thermocouple junction.
PCT/US2005/032918 2004-09-13 2005-09-13 Integrated circuit infrared sensor and associated methods WO2006031962A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60954204P 2004-09-13 2004-09-13
US60/609,542 2004-09-13

Publications (2)

Publication Number Publication Date
WO2006031962A1 true WO2006031962A1 (en) 2006-03-23
WO2006031962A9 WO2006031962A9 (en) 2006-08-17

Family

ID=35589608

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/032918 WO2006031962A1 (en) 2004-09-13 2005-09-13 Integrated circuit infrared sensor and associated methods

Country Status (1)

Country Link
WO (1) WO2006031962A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103256989A (en) * 2013-05-07 2013-08-21 江苏物联网研究发展中心 Structure for improving heat conduction stability of closed membrane type thermopile detector

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4472594A (en) * 1981-09-23 1984-09-18 Horiba, Ltd. Method of increasing the sensitivity of thermopile
US4582985A (en) * 1981-03-18 1986-04-15 Loefberg Bo Data carrier
EP1045233A2 (en) * 1999-04-14 2000-10-18 Nec Corporation Thermal functional device capable of high-speed response and a method of driving the device
JP2004033610A (en) * 2002-07-05 2004-02-05 Lightuning Technology Inc Temperature difference detecting cell and fingerprint thermograph reader using it

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4582985A (en) * 1981-03-18 1986-04-15 Loefberg Bo Data carrier
US4472594A (en) * 1981-09-23 1984-09-18 Horiba, Ltd. Method of increasing the sensitivity of thermopile
EP1045233A2 (en) * 1999-04-14 2000-10-18 Nec Corporation Thermal functional device capable of high-speed response and a method of driving the device
JP2004033610A (en) * 2002-07-05 2004-02-05 Lightuning Technology Inc Temperature difference detecting cell and fingerprint thermograph reader using it

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 2003, no. 12 5 December 2003 (2003-12-05) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103256989A (en) * 2013-05-07 2013-08-21 江苏物联网研究发展中心 Structure for improving heat conduction stability of closed membrane type thermopile detector

Also Published As

Publication number Publication date
WO2006031962A9 (en) 2006-08-17

Similar Documents

Publication Publication Date Title
US7351974B2 (en) Integrated circuit infrared sensor and associated methods
US4654622A (en) Monolithic integrated dual mode IR/mm-wave focal plane sensor
US7406185B2 (en) Thermoelectric sensor for fingerprint thermal imaging
US6300554B1 (en) Method of fabricating thermoelectric sensor and thermoelectric sensor device
Fuflyigin et al. Pyroelectric properties of AlN
US7501626B2 (en) Micromechanical thermal sensor
EP0429566B1 (en) Radiation detector array using radiation sensitive bridges
EP2384425A1 (en) Teramos-terahertz thermal sensor and focal plane array
US7253412B2 (en) Focal plane antenna to sensor interface for an ultra-sensitive silicon sensor
EP0354369A2 (en) Infrared detector
US20040222803A1 (en) Capacitive distance sensor
JP2001349787A (en) Infrared detecting element and thermometer
WO2005024712A1 (en) Finger sensor using optical dispersion sensing and associated methods
US9217673B2 (en) High responsivity device for thermal sensing in a terahertz radiation detector
EP1333504A3 (en) Monolithically-integrated infrared sensor
US7548053B2 (en) Wide-band antenna coupled spectrometer using CMOS transistor
US20060221568A1 (en) Apparatus for determining temperature of a portable computer system
Hashimoto et al. High performance human information sensor
WO2006031962A1 (en) Integrated circuit infrared sensor and associated methods
US7170059B2 (en) Planar thermal array
Liu et al. A CMOS uncooled heat-balancing infrared imager
US6002132A (en) Thermionic thermal detector and detector array
Cibella et al. A superconducting bolometer antenna-coupled to terahertz waves
JPH07140008A (en) Radiation thermometer
KR200282421Y1 (en) temperature revision equipment of thermopile sensor

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase