US9696457B1 - Infrared presence sensing with modeled background subtraction - Google Patents

Infrared presence sensing with modeled background subtraction Download PDF

Info

Publication number
US9696457B1
US9696457B1 US15/245,773 US201615245773A US9696457B1 US 9696457 B1 US9696457 B1 US 9696457B1 US 201615245773 A US201615245773 A US 201615245773A US 9696457 B1 US9696457 B1 US 9696457B1
Authority
US
United States
Prior art keywords
signal
background
filtered
produce
transformation filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/245,773
Other languages
English (en)
Inventor
Markus Mattes
Prometeusz Jasinski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Excelitas Technologies Singapore Pte Ltd
Original Assignee
Excelitas Technologies Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US15/245,773 priority Critical patent/US9696457B1/en
Application filed by Excelitas Technologies Singapore Pte Ltd filed Critical Excelitas Technologies Singapore Pte Ltd
Assigned to EXCELITAS TECHNOLOGIES SINGAPORE PTE LTD. reassignment EXCELITAS TECHNOLOGIES SINGAPORE PTE LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: JASINSKI, PROMETEUSZ, MATTES, MARKUS
Publication of US9696457B1 publication Critical patent/US9696457B1/en
Application granted granted Critical
Priority to TW106127468A priority patent/TWI651518B/zh
Priority to JP2017156779A priority patent/JP6420877B2/ja
Priority to EP17186914.2A priority patent/EP3287755A1/en
Priority to KR1020170106262A priority patent/KR101827680B1/ko
Priority to CN201710731075.0A priority patent/CN107782452B/zh
Priority to HK18108383.8A priority patent/HK1248802A1/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02—Constructional details
    • G01J5/08—Optical arrangements
    • G01J5/0853—Optical arrangements having infrared absorbers other than the usual absorber layers deposited on infrared detectors like bolometers, wherein the heat propagation between the absorber and the detecting element occurs within a solid
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • G01J5/0025—Living bodies
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00—Prospecting or detecting by optical means
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/44—Electric circuits
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
    • G01J3/108—Arrangements of light sources specially adapted for spectrometry or colorimetry for measurement in the infrared range
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02—Constructional details
    • G01J5/026—Control of working procedures of a pyrometer, other than calibration; Bandwidth calculation; Gain control
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02—Constructional details
    • G01J5/06—Arrangements for eliminating effects of disturbing radiation; Arrangements for compensating changes in sensitivity
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/10—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
    • G01J5/12—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/10—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
    • G01J5/20—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using resistors, thermistors or semiconductors sensitive to radiation, e.g. photoconductive devices
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00—Prospecting or detecting by optical means
    • G01V8/10—Detecting, e.g. by using light barriers
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/19—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using infrared-radiation detection systems

Definitions

  • the present invention relates to sensors and more particularly, is related to thermal sensing devices.
  • Infrared (IR) detectors for example, far IR detectors may be operated with additional optical elements, such as multifocal Fresnel lenses.
  • additional optical elements such as multifocal Fresnel lenses.
  • pyro-electric detectors traditionally consist of two oppositely connected heat sensing elements. The two heat sensing elements cancel out commonly received radiation, such as impinging sunlight, and thus need an optical system illuminating the radiation of a localized moving heat-spot for example, a person, onto only one of both elements.
  • FIG. 1 is a schematic, cross-sectional side view of a typical detector 100 configured to detect the position, motion and/or direction of a living being (e.g., a human) within a monitored space.
  • a living being e.g., a human
  • the phrase “monitored space” refers to a physical area (e.g., a room, hallway, outdoor area, etc.) where the detector 100 is positioned and where the detector 100 can potentially detect the living being.
  • the field of view (FOV) of the detector describes a region where the detector is capable of sensing a warm object, and may be a portion of the monitored space, or may include all of the monitored space.
  • FOV field of view
  • the detector 100 has a sensor module 102 with one or more thermal sensing devices (e.g., thermopiles) and a lens array 104 at least partially covering the sensor module 102 .
  • the lens array 104 has a plurality of lenses, each of which is arranged to direct incident thermal energy from the monitored space onto at least part of the sensor module 102 . Each individual lens may direct incident thermal energy from one of multiple different physical zones in the monitored space onto the sensor module 102 .
  • An integrated circuit 106 that may, in various implementations, form a computer-based processor, a computer-based memory storage device and/or other circuitry to perform and/or support one or more of the functionalities described herein.
  • Electrical conductors e.g., traces that extend along the upper and/or lower surfaces of the substrate 110 , vias 108 that extend through the substrate, solder bumps 112 , etc. are provided to connect the electrical components of the detector 100 to external components.
  • Thermal sensing devices such as thermopiles or photonic detectors are generally operable to produce a direct current (DC) output that is substantially proportional to an amount of thermal energy being received at that thermal sensing device.
  • the DC output produced by such a thermal sensing device generally remains constant as long as the amount of thermal energy being delivered to that thermal sensing device remains generally constant. Increases in the amount of thermal energy being delivered to the thermal sensing device generally result in a proportional increase in the DC output being produced by that sensing device. Likewise, decreases in the amount of thermal energy being delivered to the thermal sensing device result in a proportional decrease in the DC output being produced by that sensing device.
  • the DC output from the thermal sensing devices may be either a DC voltage or a DC current.
  • Present motion detectors typically employ pyroelectric materials, often in conjunction with the lens array 104 to detect the movement of people in a room.
  • a pyroelectric material generates a signal if the incoming heat radiation (from a heat source such as a human body) changes.
  • the pyroelectric detector generates an electrical signal that follows the time derivative of the incoming heat flux.
  • the amplitude of the signal is dependent on the temperature of the heat source and the so-called filling factor of the FOV. The higher the temperature of the source and the more the source fills the FOV of the detector, the higher the resulting signal.
  • a warm object radiates heat which can be sensed with thermal sensors such as pyroelectric sensors, thermopiles, bolometers, etc.
  • thermal sensors such as pyroelectric sensors, thermopiles, bolometers, etc.
  • the amount of radiation changes over time.
  • the background may be removed from the signal. This is called background subtraction.
  • pyroelectric detectors implement a combination of a scrambling optic and at least two sensing elements separated in space.
  • the scrambling optics segment portions of the FOV the object is moving through into segments such that the change of net radiation on one of the elements is fast enough to be sensed, and the net radiation seen by the individual elements is significantly different.
  • FIG. 2 This approach is depicted by FIG. 2 .
  • At least 2 sensing elements 221 , 222 are connected together such that commonly received radiation is canceled out at the electrical output 231 , 232 and does not give any variation of the resulting signal 230 over time 240 . If the ambient for example is heating up or cooling down, the amount of radiation rises or falls but is commonly seen by both elements and thus not sensed. To generate a signal 240 in that sensing element combination, one sensing element 221 must see a different amount of radiation than the other sensing element 222 .
  • the radiation received on the sensor varies in space as well as time. This is realized by scrambling optics which project the position of the object on one of the elements 221 , 222 depending on the position of the object in the FOV. A movement of the object through the FOV results in an unbalanced change of the radiation on the sensing elements which in turn generates a non-zero signal 240 .
  • the object In general the object must change the position from one zone (AB 210 ) to another (B/A 210 ) in order to be sensed. Objects remaining in one zone are not sensed.
  • Embodiments of the present invention provide infrared presence sensing with modeled background subtraction.
  • the present invention is directed to a motion sensing device with an infrared radiation (IR) sensor configured receive signal IR from a warm object and background IR to produce a direct current output.
  • IR infrared radiation
  • a first transformation filter receives the direct current output and produces a filtered background.
  • a second transformation filter receives the direct current output and produces a filtered signal.
  • a rating compares the filtered signal and the filtered background to produce a result signal based on a detected difference between the filtered signal and the filtered background.
  • FIG. 1A is a schematic, cross-sectional side view of an exemplary detector, in accordance with the prior art.
  • FIG. 1B is a schematic drawing showing a simplified dual-element pyroelectric detector with schematic optics and electronics, in accordance with the prior art.
  • FIG. 2A is a schematic diagram representing an object of interest and a background in the field of view of an exemplary detector.
  • FIG. 2B plots the amplitude of the signal, background, and sum of the scene shown by FIG. 2A over time.
  • FIG. 3 is a schematic diagram of a first embodiment of a motion and presence sensing device.
  • FIG. 4 is a schematic diagram of a second embodiment of a motion and presence sensing device.
  • FIG. 5 is a schematic diagram illustrating an example of a system for executing functionality of the present invention.
  • FIG. 6 is a flowchart of an exemplary method for distinguishing a signal from the background of a single-element thermal sensor.
  • FIG. 7 is a schematic diagram of a third embodiment of a motion and presence sensing device.
  • a “detector” refers to a thermal sensing device with one or more thermal sensing elements.
  • a single-element detector contains a single thermal sensing element, while a multi-element detector contains two or more thermal sensing elements.
  • a multi-element detector may include hundreds or thousands of individual thermal sensors or pixels.
  • a first exemplary embodiment of a motion sensing device 300 may operate with a single-element detector 325 .
  • the single-element detector 325 may be similar to the typical detector 100 ( FIG. 1 ), having a single sensing element 102 ( FIG. 1 ) which is able to sense even very slow variations of radiation down to static cases, for example, a thermopile, a bolometer, photonic sensors, and/or semiconductor-based IR sensors (bulk or epitaxial, intrinsic or extrinsic, etc.).
  • the single-element detector 325 is generally configured to produce a direct current (DC) or voltage output that is substantially proportional to an amount of thermal energy being received.
  • Such a single-element detector 325 may optionally be equipped with scrambling optics 104 ( FIG. 1 ).
  • the warm object may move in any direction (in contrast to the traditional approach with a segmented space) and the movement generally results in a variation of the radiation in time received by the motion sensing device 300 .
  • a steady state ambient background may be measured and subtracted from the motion sensing device 300 output.
  • changes to the ambient background with time effectively defeats this approach.
  • a warm foreground object may be distinguished from the background (for example a change of the temperature of the ambient) by a time based signal analysis.
  • the first embodiment applies a model of the background, which may have different functional properties, for example, rise or fall time of the signal, signal form, and signal amplitude, among others. This model may be used to filter/separate the background from the signal which has substantially different functional properties in time.
  • FIGS. 2A and 2B An object of interest 250 , for example, a person, is in the FOV 290 of the single-element detector 325 , and the FOV 290 is exposed to sunlight, for example, via a window in the monitored space.
  • the sun 260 is shining but clouds 270 are passing by, resulting in the background area monitored within the FOV 290 of the single-element detector 325 randomly heating up and cooling.
  • the object of interest 250 is moving in the FOV 290 toward the single-element detector 325 , and the amount of radiation received by the sensor due to the object of interest is denoted as “signal,” denoted as a dash-dot line in FIG.
  • the signal 281 may be subtracted from the background 282 , denoted as a dashed line.
  • the total output of the single-element detector 325 represents the sum 280 of the signal 281 and background 282 , is represented as a solid line in the graph in FIG. 2B . Since the signal 281 is rising significantly faster than the background 282 , the background 282 can be filtered by the application of a simple low-pass with a time constant comparable to the one of the background in order to subtract the filtered signal from the sum 280 . What remains is the signal 281 which may be analyzed by means of simple thresholds.
  • a model of the signal may be applied to the sum which is seen by the single-element detector 325 . Then a simple subtraction of the filtered signal and filtered background may be evaluated by means of thresholds. More sophisticated signal analysis, for example, fast Fourier transform (FFT), fitting of functions, machine learning and modeling, among others, may be applied to this basic principle to further improve distinction between the signal and the background.
  • FFT fast Fourier transform
  • This principle is not restricted to the time domain, but may be performed with any other mathematical transformation, for example, frequency domain, Laplace-transformations, multi-variable expansions, etc.
  • the first embodiment is not restricted to the above example. Any source can be denoted as “signal” and another as “background” as long as the behavior of the radiation in time of both sources can be modeled and/or described in a separable way.
  • the background may be for example a person moving in a large distance from the sensor and the signal may be a person moving in the foreground of the FOV.
  • the background/signal may be sources with different amplitudes in the amount of radiation produced (cars, pets, persons, fires, etc.) but same spatial position.
  • the embodiments described herein are not restricted to spatial changes. For example the detector 300 may distinguish a local fire from a heater, or a pet/child may be distinguished from an adult human.
  • Exemplary embodiments of the present invention include single-element background subtracted thermopile sensor (TP), which may be operated without additional optical elements, such as multifocal Fresnel lenses.
  • TP background subtracted thermopile sensor
  • a detector including a thermopile sensor provides a current or voltage which is proportional to the net radiation and senses DC components.
  • a resting heat-spot such as an immobile human, may be sensed after being separated from any detected background radiation, which may be produced by a heater, a varying sun load, air-conditioning etc.
  • the first embodiment incorporates subtraction of that background by modeling techniques described in further detail below.
  • the simplest background subtraction may be realized by the measurement of the net radiation without the object of interest being present, thereby only measuring the background.
  • the recorded value is used as an offset to be subtracted from the sensor output.
  • An object moving into the field-of-view of the TP may be recognized by a simple threshold on the offset-subtracted signal.
  • simple background subtraction may be insufficient when the ambient conditions are changing with time, thereby invalidating the offset.
  • FIG. 3 is a schematic diagram of a first embodiment of a sensing device 300 .
  • IR radiation 310 includes a signal 312 from a warm object, for example, a person 250 ( FIG. 2A ) and background radiation 314 , for example, ambient heat within the FOV of the sensing device 300 .
  • the sensing device 300 discerns the presence and/or motion of a warm object in the FOV to generate an action, for example, in a switch 380 .
  • the switch 380 may be actuated as a result of detection and/or lack of detection of the warm object in the FOV.
  • the device 300 splits the raw output of the single-element detector 325 for independent processing of background and signal to determine the action of the switch 380 .
  • the output of the sensing device 300 may be something other than the switch 380 , for example, an output signal, or a visual indicator, such as an indicator lamp or an indicator icon on a display monitor.
  • the single-element detector 325 detects the IR radiation 310 , along with some noise 320 , for example, self-noise, or system noise.
  • the single-element detector 325 provides a raw data output 330 , for example, an analog voltage/current level, or a digital conversion of such an analog output signal, for example from an analog-to-digital converter (ADC), which is proportional to the received net IR radiation 310 .
  • ADC analog-to-digital converter
  • a multi-sensor detector may produce multiple output signals from each sensor, and/or an aggregate output signal from each of the sensors.
  • the single-element detector 325 has a single sensor producing a single raw detector output 330 .
  • the raw detector output 330 may be split, for example, with a mux (not shown) and fed into two or more data analysis branches. For simplicity, only two branches are described under the first embodiment. However, in alternative embodiments three or more branches may be used, for example, to distinguish multiple signals from one another and the background.
  • a first branch is fed into a first transforming filter 340 producing a filtered background 345
  • a second branch is routed to the input of a second transformation filter 350 producing a filtered signal 355 .
  • the first transforming filter 340 may transform the raw data as a function of time into a variable which can separate background from the signal and noise, resulting in the filtered background signal 345 .
  • the second transforming filter 350 may transform the raw data as a function of time into a variable which can separate the signal from the background and noise.
  • the transformation filters 340 , 350 may be steered by variable parameters, for example, background model parameters 342 and signal model parameters 352 , for example, frequency ranges, amplitude ranges, etc.
  • the first transforming filter 340 and the second transforming filter 350 may have dissimilar mathematical operation.
  • a comparison for example, performed by a rating device 370 , for example, a comparator, is performed to distinguish the filtered background 345 from the filtered signal 355 before a decision to change the state of a switch 380 is taken.
  • the rating may determine that the filtered signal 355 is sufficiently distinguishable from the filtered background 345 to indicate the presence/absence/motion of a warm object in the FOV of the motion sensing device 300 .
  • the rating 370 may access a store of rating model parameters 372 , for example, thresholds, time constants, tolerance windows, signal variance indicators, etc.
  • FIG. 4 shows a second exemplary embodiment of a motion sensing device 400 .
  • a liquid crystal display (LCD) with an integral single channel thermopile 425 screen may sense IR radiation 410 from an approaching person while the sun is heating up a surrounding room in the FOV of the motion sensing device.
  • the single channel thermopile 425 senses a slowly rising component from the sun 414 and a rapidly rising signal component from the person 212 .
  • Applying a first transformation filter 440 for example, a low pass filter with a cut-on eight second rise time 442 on the thermopile ADC output 430 signal removes the signal component and any ADC fluctuations 420 , producing a filtered background 445 .
  • thermopile ADC output 430 While the filtered background 445 may be subtracted from the thermopile ADC output 430 , a second transformation filter 450 , for example, a low pass filter with a cut-on one second rise time 452 on the thermopile ADC output 430 signal removes the background component and any ADC fluctuations 420 , producing a filtered signal 455 .
  • a threshold comparator 470 may be applied to perform an action, for example, an interrupt 480 used to turn the LCD on within the LCD display unit 425 .
  • the threshold comparator 470 may access one or more sets of threshold parameters 472 to adapt to different detection scenarios, as may the transformation filters 440 , 450 .
  • the background may be an air flow which provides a fast change of the raw data output due to air turbulences. If the background fluctuations are faster than the motion of the person, a low pass filter stage not only separates the signal from the ADC fluctuations, but also from the air turbulences. This improves the result after subtraction of the filtered background 445 from the filtered signal 455 .
  • Changing one or more parameter for the signal to a higher cut-off value may result in suppressing the signal of a person moving in front of the sensor 425 which would trigger further events, even if the person is in the field of view of the sensor 425 . With such a higher cut-off parameter, a delay may be steered to switch the sensor 425 , thus a person passing through the FOV of the sensor 425 may be differentiated from a stationary person.
  • Changing the filter parameters of the first and second transformation filters 440 , 450 may be used, for example, to distinguish a fast temperature change from a slow one temperature, such as burning power electronics.
  • distinguishing two or more inputs to the thermopile 425 may be realized using other types of mathematical operations.
  • thermopile ADC signal may be applied to the thermopile ADC signal as a function of time which for recognizing specific signatures, such as a signature signal produced by a person is walking through the FOV of the single-element detector 325 ( FIG. 3 ), a dog is passing through the FOV, and a car is passing through the FOV.
  • These 3 cases may be distinguished by a combination of the signal amplitude, signal speed and eventually a signal pattern.
  • This model can be analyzed by the means of a multi-variable expansion. Passing the raw data through this filtering stage produces a likelihood that the object passing through the FOV is a person, car or pet.
  • the output of the device may be a likelihood estimation indicating the closest match.
  • Fourier transformations may be used.
  • a fast Fourier transform (FFT) output may distinguish a periodic background from a non-periodic signal.
  • FFT fast Fourier transform
  • a model is applied to the background component which follows the background signature as a function of time.
  • the model may be determined in various different ways.
  • the model may provide dynamic analysis of the detector output 350 without relying on previously stored (memorized) data.
  • the analysis may be performed by filtering the background out and subtracting it afterwards. For example, if the signal is varying very slowly, a simple low-pass stage may be applied which does not respond to a fast change of the thermopile output when the object is moving in the field-of-view. The result can be improved by “filtering” the signal with a low-pass of faster response as well to be subtracted afterwards.
  • the learning procedure may be performed in a parameter space, which may be suitable to separate the background 345 from the signal 355 .
  • the learning procedure may be performed, for example, by a mathematical (multi) variable expansion, such as a Fourier transform, Laplace transform or others, where the data is transformed into the frequency domain, or other domains. Instead, or in addition, the learning may be performed in time domain as well.
  • FIG. 6 shows an exemplary embodiment of a method 600 for distinguishing a signal of interest from a background from the output of a single-element infrared radiation (IR) sensor 325 ( FIG. 3 ).
  • the steps of the method 600 will be made with reference to elements shown by FIG. 3 .
  • persons having ordinary skill in the art will appreciate this method is also applicable to the multi-element IR sensor of FIG. 7 , described below.
  • a direct current output 330 from an IR sensor 325 is divided into a first portion and a second portion, for example, via a mux (not shown) as shown by block 610 .
  • the first portion is transformed with a first transformation filter 340 to produce a filtered background 345 , as shown by block 620 .
  • the second portion is transformed with a second transformation filter 350 to produce a filtered signal 355 , as shown by block 630 .
  • the filtered signal and the filtered background are compared, for example, by a rating 770 , as shown by block 640 , to distinguish the signal from the background.
  • the rating 770 may access a store of rating model parameters 772 , for example, to adapt to different comparison scenarios.
  • the filtered signal is compared to a stored signal signature, as shown by block 650 .
  • the stored signal signature may include a range of parameters and/or thresholds used in the comparison step to determine if the filtered signal 355 and/or the filtered background 345 matches, or is similar in one or more aspects, to the stored signal signature.
  • the filtered signal is identified as shown by block 660 , for example, if the filtered signal matches the stored signal signature, an action is performed, as shown by block 670 , for example, actuating a switch 380 .
  • the action 670 may be performed even if the filtered signal 355 is not positively identified, but is clearly differentiated from the filtered background 345 .
  • first and/or second filter 340 , 350 may include other mathematical modeling processes in the time and/or frequency domain, in addition to or instead of traditional high pass, low pass, bandpass, or notch filtering.
  • the first and/or second transformation filter 340 , 350 may include fitting of functions, a Fourier transform, such as an FFT, a Laplace transform, a multi-variable expansion, among other operations, on the raw detector output 330 .
  • FIG. 7 shows a third embodiment of a motion sensing device 700 where a multi-element sensor (detector) 725 is used instead of the single-element sensor 325 ( FIG. 3 ) of the first embodiment.
  • the multi-element sensor 725 may have 2, 3, 4, or more elements, for example, a multi-pixel sensor.
  • the third exemplary embodiment of a sensing device 700 shown by FIG. 7 may operate with a multi-element detector 725 having multiple sensing elements, for example, thermopiles, bolometers, photonic sensors, semiconductor-based IR sensors (bulk or epitaxial, intrinsic or extrinsic, etc.), able to sense even very slow variations of radiation down to static cases.
  • the multi-element detector 725 is generally configured to produce a direct current (DC) output that is substantially proportional to an amount of thermal energy being received.
  • DC direct current
  • Such a multi-element detector 725 may optionally be equipped with scrambling optics 104 ( FIG. 1 ).
  • IR radiation 310 may include a signal 312 from a warm object, for example, a person 250 ( FIG. 2A ) and background radiation 314 , for example, environmental heat.
  • the sensing device 700 discerns the presence and/or motion of a warm object to generate an action in a switch 380 .
  • the switch 380 may be actuated as a result of detection and/or lack of detection of the warm object.
  • the sensing device 700 splits the signal of the multi-element detector 725 into two or more branches for independent processing of background and signal to determine the action of the switch 380 .
  • the output of the system may be something other than the switch 380 , for example, an output signal, or an indicator for viewing on a display device or monitor.
  • the multi-element detector 725 detects the IR radiation, along with some noise 320 , for example, self-noise, or system noise.
  • the multi-element detector 725 provides a raw multi-sensor output 730 , for example, an analog voltage/current level, or a digital conversion of such an analog output signal, for example, by an analog to digital converter (ADC), which is proportional to the received net IR radiation 310 .
  • ADC analog to digital converter
  • the multi-element detector 725 has two or more sensors producing the raw multi-sensor output 730 .
  • the raw multi-sensor output 730 may be split and fed into two or more data analysis branches.
  • a first branch is fed into a first transforming filter 740 producing a filtered background 745
  • a second branch is routed to the input of a second transformation filter 750 producing a filtered signal 755 .
  • the first transforming filter 740 transforms the raw data as a function of time into a variable which can separate background from the signal and noise, resulting in the filtered background signal 745 .
  • the second transforming filter 750 may transform the raw multi-sensor output 730 as a function of time into a variable which can separate the signal from the background and noise.
  • the transformation filters 740 , 750 may be steered by variable parameters, for example, background and signal model parameters 742 , 752 .
  • the first transforming filter 740 and the second transforming filter 750 may have dissimilar mathematical operation.
  • a comparison, for example, by a rating 770 is performed if the background was sensed and/or distinguished from the signal before the decision to change the state of a switch 380 is made.
  • the present system for executing the functionality described in detail above may be a computer, an example of which is shown in the schematic diagram of FIG. 5 .
  • the system 500 contains a processor 502 , a storage device 504 , a memory 506 having software 508 stored therein that defines the abovementioned functionality, input and output (I/O) devices 510 (or peripherals), and a local bus, or local interface 512 allowing for communication within the system 500 .
  • the local interface 512 can be, for example but not limited to, one or more buses or other wired or wireless connections, as is known in the art.
  • the local interface 512 may have additional elements, which are omitted for simplicity, such as controllers, buffers (caches), drivers, repeaters, and receivers, to enable communications. Further, the local interface 512 may include address, control, and/or data connections to enable appropriate communications among the aforementioned components.
  • the processor 502 is a hardware device for executing software, particularly that stored in the memory 506 .
  • the processor 502 can be any custom made or commercially available single core or multi-core processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the present system 500 , a semiconductor based microprocessor (in the form of a microchip or chip set), a macroprocessor, or generally any device for executing software instructions.
  • the memory 506 can include any one or combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)) and nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.). Moreover, the memory 506 may incorporate electronic, magnetic, optical, and/or other types of storage media. Note that the memory 506 can have a distributed architecture, where various components are situated remotely from one another, but can be accessed by the processor 502 .
  • the software 508 defines functionality performed by the system 500 , in accordance with the present invention.
  • the software 508 in the memory 506 may include one or more separate programs, each of which contains an ordered listing of executable instructions for implementing logical functions of the system 500 , as described below.
  • the memory 506 may contain an operating system (O/S) 520 .
  • the operating system essentially controls the execution of programs within the system 500 and provides scheduling, input-output control, file and data management, memory management, and communication control and related services.
  • the I/O devices 510 may include input devices, for example but not limited to, a keyboard, mouse, scanner, microphone, etc. Furthermore, the I/O devices 510 may also include output devices, for example but not limited to, a printer, display, etc. Finally, the I/O devices 510 may further include devices that communicate via both inputs and outputs, for instance but not limited to, a modulator/demodulator (modem; for accessing another device, system, or network), a radio frequency (RF) or other transceiver, a telephonic interface, a bridge, a router, or other device.
  • modem for accessing another device, system, or network
  • RF radio frequency
  • the processor 502 When the system 500 is in operation, the processor 502 is configured to execute the software 508 stored within the memory 506 , to communicate data to and from the memory 506 , and to generally control operations of the system 500 pursuant to the software 508 , as explained above.
  • the processor 502 When the functionality of the system 500 is in operation, the processor 502 is configured to execute the software 508 stored within the memory 506 , to communicate data to and from the memory 506 , and to generally control operations of the system 500 pursuant to the software 508 .
  • the operating system 520 is read by the processor 502 , perhaps buffered within the processor 502 , and then executed.
  • a computer-readable medium for use by or in connection with any computer-related device, system, or method.
  • Such a computer-readable medium may, in some embodiments, correspond to either or both the memory 506 or the storage device 504 .
  • a computer-readable medium is an electronic, magnetic, optical, or other physical device or means that can contain or store a computer program for use by or in connection with a computer-related device, system, or method.
  • Instructions for implementing the system can be embodied in any computer-readable medium for use by or in connection with the processor or other such instruction execution system, apparatus, or device.
  • such instruction execution system, apparatus, or device may, in some embodiments, be any computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
  • a “computer-readable medium” can be any means that can store, communicate, propagate, or transport the program for use by or in connection with the processor or other such instruction execution system, apparatus, or device.
  • Such a computer-readable medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a nonexhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic) having one or more wires, a portable computer diskette (magnetic), a random access memory (RAM) (electronic), a read-only memory (ROM) (electronic), an erasable programmable read-only memory (EPROM, EEPROM, or Flash memory) (electronic), an optical fiber (optical), and a portable compact disc read-only memory (CDROM) (optical).
  • an electrical connection having one or more wires
  • a portable computer diskette magnetic
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • EPROM erasable programmable read-only memory
  • CDROM portable compact disc read-only memory
  • the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
  • system 500 can be implemented with any or a combination of the following technologies, which are each well known in the art: a discreet logic circuit(s) having logic gates for implementing logic functions upon data signals, an application specific integrated circuit (ASIC) having appropriate combinational logic gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), etc.
  • ASIC application specific integrated circuit
  • PGA programmable gate array
  • FPGA field programmable gate array
  • the difference between two low-pass filtered signals may not be able to sense presence of a human entering the field-of-view by only measuring a positive value above a threshold but also by measuring the absence of the signal after the human has left the field-of-view.
  • the human may be considered to become part of the background, for example, when the human is resting longer than the time constant of the background filter.
  • the time-constant of the background filter (as well as the signal filter) may be reduced to a fast response when the object is sensed in order to reach the zero difference between the two filters faster (reset) and be ready to sense the absence of the object.
  • fast filter settings may be chosen to reset the system for when the same object or a different object enters the FOV.
  • Periodic behavior of background may be implemented to be subtracted in order to forecast the background. This can be a simple case such as day-night temperature fluctuations but can be expanded to machine learning by recording the repetitive behavior of any background.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geophysics (AREA)
  • Photometry And Measurement Of Optical Pulse Characteristics (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Radiation Pyrometers (AREA)
US15/245,773 2016-08-24 2016-08-24 Infrared presence sensing with modeled background subtraction Active US9696457B1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
US15/245,773 US9696457B1 (en) 2016-08-24 2016-08-24 Infrared presence sensing with modeled background subtraction
TW106127468A TWI651518B (zh) 2016-08-24 2017-08-14 具有模型化背景減除之紅外線存在感測技術
JP2017156779A JP6420877B2 (ja) 2016-08-24 2017-08-15 モデル化された背景差分による赤外線在感知
EP17186914.2A EP3287755A1 (en) 2016-08-24 2017-08-18 Infrared presence sensing with modeled background subtraction
KR1020170106262A KR101827680B1 (ko) 2016-08-24 2017-08-22 모델링된 배경 차분을 이용한 적외선 존재 감지
CN201710731075.0A CN107782452B (zh) 2016-08-24 2017-08-23 使用建模背景减除法的红外存在感测装置
HK18108383.8A HK1248802A1 (zh) 2016-08-24 2018-06-29 具有模型化背景減法的紅外存在傳感器

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/245,773 US9696457B1 (en) 2016-08-24 2016-08-24 Infrared presence sensing with modeled background subtraction

Publications (1)

Publication Number Publication Date
US9696457B1 true US9696457B1 (en) 2017-07-04

Family

ID=59152516

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/245,773 Active US9696457B1 (en) 2016-08-24 2016-08-24 Infrared presence sensing with modeled background subtraction

Country Status (7)

Country Link
US (1) US9696457B1 (ja)
EP (1) EP3287755A1 (ja)
JP (1) JP6420877B2 (ja)
KR (1) KR101827680B1 (ja)
CN (1) CN107782452B (ja)
HK (1) HK1248802A1 (ja)
TW (1) TWI651518B (ja)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11232688B1 (en) * 2017-11-29 2022-01-25 Amazon Technologies, Inc. Auto-configuration for a motion detector of a security device
WO2023288166A1 (en) * 2021-07-15 2023-01-19 Leviton Manufacturing Co., Inc. Methods and arrangements for an occupancy sensor
US20230152161A1 (en) * 2021-10-28 2023-05-18 Stmicroelectronics S.R.L. Enhanced cooker hood with sensors for remote temperature measurement and presence detection
US11928846B2 (en) * 2018-05-18 2024-03-12 Essity Hygiene And Health Aktiebolag Presence and absence detection

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109407746A (zh) * 2018-11-22 2019-03-01 中国航空工业集团公司洛阳电光设备研究所 一种制冷型红外探测器低噪声电源供电电路
CN110631229B (zh) * 2019-09-30 2022-02-08 广东美的制冷设备有限公司 空调器及其线控器控制方法、控制装置和可读存储介质
FR3141306A1 (fr) * 2022-10-21 2024-04-26 Legrand France Système de gestion d’éclairage autonome avec imageur thermique

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6384414B1 (en) * 1997-11-25 2002-05-07 Board Of Regents, The University Of Texas System Method and apparatus for detecting the presence of an object
US20050077469A1 (en) * 2002-02-02 2005-04-14 Kaushal Tej Paul Head position sensor
US20140002667A1 (en) * 2011-03-25 2014-01-02 Joseph M. Cheben Differential Infrared Imager for Gas Plume Detection
US9217672B2 (en) 2014-03-04 2015-12-22 Excelitas Technologies Singapore Pte. Ltd. Motion and gesture recognition by a passive single pixel thermal sensor system
US20150379851A1 (en) * 2013-01-03 2015-12-31 Icrealisations Bvba Dual sensor system and related data manipulation methods and uses
US20160138976A1 (en) 2013-04-22 2016-05-19 Excelitas Technologies Singapore Pte Ltd. Dual element pyroelectric motion and presence detector
US9377365B2 (en) 2013-04-22 2016-06-28 Excelitas Technologies Singapore Pte. Ltd. Thermal sensor module with lens array

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2102564B (en) * 1981-07-22 1985-06-12 Rolls Royce Pyrometer signal processing
JPH0412836A (ja) * 1990-05-02 1992-01-17 Komatsu Kasei Kk 樹脂被覆金属蛇腹管の製造方法
JP3050587B2 (ja) * 1990-11-02 2000-06-12 ヨツギ株式会社 赤外線センサ装置
JP3548847B2 (ja) * 1995-07-27 2004-07-28 オムロン株式会社 物体等の検知装置
US6518574B1 (en) * 1996-03-01 2003-02-11 Fire Sentry Corporation Fire detector with multiple sensors
US6192322B1 (en) * 1996-04-19 2001-02-20 Raytheon Company Moving object and transient event detection using rotation strip aperture image measurements
JP4014188B2 (ja) * 1998-06-02 2007-11-28 ホーチキ株式会社 炎検出装置及び炎検出方法
AU768582B2 (en) * 1998-06-02 2003-12-18 Hochiki Kabushiki Kaisha Flame detection device and flame detection method
JP3815643B2 (ja) * 1998-12-18 2006-08-30 ホーチキ株式会社 炎検出装置
JP4037802B2 (ja) * 2003-07-15 2008-01-23 能美防災株式会社 炎検出装置
JP2006018480A (ja) * 2004-06-30 2006-01-19 Matsushita Electric Works Ltd 赤外線防犯装置
JP2006098223A (ja) * 2004-09-29 2006-04-13 Sanyo Electric Co Ltd ノイズ除去回路及びそれを備えた温度測定処理装置
CN102183795B (zh) * 2011-02-28 2013-12-25 中北大学 基于动态下使用热释电红外传感器的目标探测系统及其方法
JP5668157B1 (ja) * 2014-02-05 2015-02-12 佐鳥　新 対象物探索装置、対象物探索プログラムおよび人命救助用探索システム

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6384414B1 (en) * 1997-11-25 2002-05-07 Board Of Regents, The University Of Texas System Method and apparatus for detecting the presence of an object
US20050077469A1 (en) * 2002-02-02 2005-04-14 Kaushal Tej Paul Head position sensor
US20140002667A1 (en) * 2011-03-25 2014-01-02 Joseph M. Cheben Differential Infrared Imager for Gas Plume Detection
US20150379851A1 (en) * 2013-01-03 2015-12-31 Icrealisations Bvba Dual sensor system and related data manipulation methods and uses
US20160138976A1 (en) 2013-04-22 2016-05-19 Excelitas Technologies Singapore Pte Ltd. Dual element pyroelectric motion and presence detector
US9377365B2 (en) 2013-04-22 2016-06-28 Excelitas Technologies Singapore Pte. Ltd. Thermal sensor module with lens array
US9217672B2 (en) 2014-03-04 2015-12-22 Excelitas Technologies Singapore Pte. Ltd. Motion and gesture recognition by a passive single pixel thermal sensor system
US9410848B2 (en) 2014-03-04 2016-08-09 Excelitas Technologies Singapore Pte Ltd. Motion and gesture recognition by a passive thermal sensor system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11232688B1 (en) * 2017-11-29 2022-01-25 Amazon Technologies, Inc. Auto-configuration for a motion detector of a security device
US11928846B2 (en) * 2018-05-18 2024-03-12 Essity Hygiene And Health Aktiebolag Presence and absence detection
WO2023288166A1 (en) * 2021-07-15 2023-01-19 Leviton Manufacturing Co., Inc. Methods and arrangements for an occupancy sensor
US20230152161A1 (en) * 2021-10-28 2023-05-18 Stmicroelectronics S.R.L. Enhanced cooker hood with sensors for remote temperature measurement and presence detection

Also Published As

Publication number Publication date
CN107782452B (zh) 2019-04-30
EP3287755A1 (en) 2018-02-28
JP2018036260A (ja) 2018-03-08
HK1248802A1 (zh) 2018-10-19
JP6420877B2 (ja) 2018-11-07
TWI651518B (zh) 2019-02-21
CN107782452A (zh) 2018-03-09
TW201809615A (zh) 2018-03-16
KR101827680B1 (ko) 2018-02-08

Similar Documents

Publication Publication Date Title
US9696457B1 (en) Infrared presence sensing with modeled background subtraction
US9140609B2 (en) Infrared presence detector for detecting a presence of an object in a surveillance area
TWI575481B (zh) 具有透鏡陣列的熱感測器模組
US10018510B2 (en) Motion and presence detector
JP6009016B2 (ja) 受動型単画素熱センサシステムによる動作及びジェスチャ認識
JP6010936B2 (ja) 赤外線センサ装置
US5637040A (en) Infrared object detector
Roselyn et al. Development and implementation of novel sensor fusion algorithm for occupancy detection and automation in energy efficient buildings
TWI776798B (zh) 運動及存在檢測器
CN107608002A (zh) 多传感器融合人体探测装置及探测方法
EP2775465A1 (de) Gefahrenmelder mit einem kontaktlos arbeitenden Wärmestrahlungssensor zur Ermittlung einer Umgebungstemperatur
US20220113195A1 (en) Nir motion detection system and method
KR100554617B1 (ko) 지능형 인체감지 열선 센서 장치
JP2014202614A (ja) 赤外線検知装置および検知対象の検知方法
JPH09304188A (ja) 赤外線検出装置
KR102322871B1 (ko) 필터 어레이, 이를 포함하는 이미지 센서 및 적외선 카메라
JP4182499B2 (ja) 移動物体検知装置
TW201724037A (zh) 一種利用紅外線偵測溫度差異的方法
CN107577213A (zh) 用于传感器的控制设备及方法
JPH0547884U (ja) 複合型検知装置
KR19980014304A (ko) 경비시스템의 열선 감지 장치 및 방법
CN113538823A (zh) 存在检测设备和方法
KR20200120975A (ko) 수동 적외선(PIR:Passive Infrared) 센서의 출력 데이터를 활용하여 인체만 감지하는 방법

Legal Events

Date Code Title Description
AS Assignment

Owner name: EXCELITAS TECHNOLOGIES SINGAPORE PTE LTD., SINGAPO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MATTES, MARKUS;JASINSKI, PROMETEUSZ;REEL/FRAME:039716/0851

Effective date: 20160902

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4