WO2008010832A2

WO2008010832A2 - Detection of concealed objects based on differential emissivity

Info

Publication number: WO2008010832A2
Application number: PCT/US2006/045355
Authority: WO
Inventors: Sarath D. Gunapala; Amjad Abdallat; Sandeep Gulati
Original assignee: Arroyo Sciences, Inc.
Priority date: 2005-11-21
Filing date: 2006-11-21
Publication date: 2008-01-24
Also published as: WO2008010832A3

Abstract

Techniques for monitoring thermal emissivity levels of human traffic within a plurality of sections of a zone of interest are presented. The thermal emissivity levels are monitored using an infrared detector with sensitivity range of less than fifty milliKelvin, and in some variations, about fifteen to thirty milliKelvin, such as a quantum well infrared photodetector (QWIP) equipped camera. In some variations, an infrared detector operating at two or more wavelengths is utilized. Based on differential emissivity calculations, a determination is made whether the monitored emissivity level corresponds to at least one calibrated emissivity level associated with an explosive material.

Description

DETECTION OF OBJECTS OF INTEREST BASED ON DIFFERENTIAL EMISSIVITY

RELATED APPLICATIONS

[0001] The present application claims benefit of priority from U.S. application serial no. 11/523,776, filed on September 18, 2006, which is a continuation-in-part of U.S. Patent Application Serial No 11/350,683, filed on February 8, 2006, which in turn claims benefit from U.S. Provisional Application No. 60/739,055, filed on November 21, 2005, the disclosures of which are hereby fully incorporated by reference.

TECHNICAL FIELD

[0002] The present disclosure relates to real-time imaging systems for detecting differential levels of emissivity. In particular, the disclosure relates to detecting objects of interest such as concealed explosive devices.

BACKGROUND

[0003] Safety is an important consideration, especially at locations where the volume of human traffic is high. At airports, subway entrances, border crossing, sporting events, concerts, and other public gatherings, an intentional detonation of a concealed explosive device may result in numerous human injuries. In such environments, it is difficult to detect a person carrying a concealed explosive device. In addition, it is desirable to identify the person carrying the concealed explosive device at a safe distance from a crowd of people in order to have enough time to react once the detection is confirmed. Past efforts for standoff explosive detection have relied upon X-ray, millimeter wave radar, mass spectrometry and neutron spectrometry. However, these methods have been successful only when in close proximity with the human subject (distances < 5m).

SUMMARY

[0004] The methods and apparatus described herein implement techniques for detecting concealed objects based on differential emissivity levels. In one aspect, the methods and apparatus described herein implement techniques for creating a virtual portal representing a zone of interest and monitoring the emissivity levels of human traffic within the zone of interest. The techniques can be implemented to determine if the monitored emissivity level corresponds to at least one calibrated emissivity level associated with a concealed explosive material. [0005] In another aspect, the techniques can be implemented to create a virtual portal representing a zone of interest and to monitor thermal emissivity levels of human traffic within a plurality of sections of the zone of interest. The monitored thermal emissivity can be processed to determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a synthetic material concealed on a human body. [0006] In another aspect the techniques can be implemented to include a quantum well infrared photodetector having sensitivity range of about fifteen to thirty milliKelvin to monitor thermal emissivity levels of human traffic within a plurality of sections of a zone of interest Such an infrared photodetector may be a single wavelength detector operating in the midwave or longwave IR spectrum or may be a two-color or dual band wavelength detector operating and detecting in multiple wavelengths simultaneously. In other variations, the infrared detector is operable to simultaneously make measurements in more than two wavelengths A processor can be coupled to the quantum well infrared photodetector and determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a concealed explosive material on a human body by performing differential emissivity calculation and black body algebra. The processor can also track the detected concealed explosive material as the human body moves through the zone of interest. In addition, a data repository can be coupled to the processor to store data associated with calibrated thermal emissivity levels for factors selected from a group including ambient background, an exterior surface of a human, clothing, personal articles, computing devices, and an explosive material.

[0007] With the use of a two-color or dual-band detector a processor can be coupled to the quantum well infrared photodetector so that it can be determined whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a concealed explosive material on a human body by performing differential emissivity calculations based on ratios (or other comparisons) between emissivitly levels detected at or between two or more wavelengths. Similar measurements can be made if an infrared detector is used that operates at more than two wavelengths or if two or more infrared detectors are utilized that each operate at a single wavelength.

[0008] In some implementations, the following features can be included. A human associated with each thermal emissivity level corresponding to the concealed explosive material can be identified. The identified human can also be tracked by comparing the detected emissivity level against multiple pre-determined empirical models The monitored thermal emissivity levels can also be calibrated to distinguish between the concealed explosive material and a non-explosive material including a cell phone, a pager, a key chain, and other non-explosive synthetic objects based on differential emissivity measured between different synthetic objects. The monitored thermal emissivity levels can also be calibrated to identity a differential emissivity between a clothing material including fabric, leather, synthetic polymer, and other clothing material and the concealed explosive material. In addition, the zone of interest can extend from three feet to five kilometers Further, monitoring die emissivity levels to identify the concealed explosive material can include identifying temperature differences within a range of about five milliKelvin and fifty milliKelvin The emissivity levels can be monitored using a long wave infrared detector such as a quantum well infrared photodetector The plurality of sections of the zone of interest can correspond to pixels of the quantum well infrared photodetector

[0009] In some implementations, the following features can be included singly or in combination (depending on the desired configuration). The techniques may be implemented to determine if the monitored thermal emissivity level for a section of the zone of interest is associated with a calibrated thermal emissivity level for a factor selected from a group including ambient background, an exterior surface of a human, a clothing material, a personal article, a computing device, and/or an explosive material The thermal emissivity levels can be monitored from a fixed distance and empirically associated with one or more factors selected from a group including ambient background, an exterior surface of a human, clothing material, a personal article, a computing device, and/or an explosive material. In some variations, successive quantum well infrared photodetector image frame can be processed to confirm detection of the concealed explosive material, identify a specific human carrying the concealed explosive material, and/or identify a specific location of the concealed explosive material with a margin of error less than a fraction of an inch. The techniques can be implemented to detect plastic explosive materials, timing mechanisms, wiring devices, explosive trigger mechanisms, dud explosives, and wired devices.

[0010] In some implementations, the following features can be included. A facial expression and sweat on a human target can be detected to facilitate the detection of the concealed explosive material. Monitored thermal emissivity levels corresponding to at least one calibrated thermal emissivity level associated with the concealed explosive material can be based on a differential emissivity, wherein the differential emissivity is buffered against changes in the ambient background including temperature, wind condition, humidity, hail, and/or snow Pixels of a quantum well infrared photodetector array can be repeatedly scanned to detect a change in emissivity to detect a concealed object. A texture in an estimated emissivity map can be processed to identify a type of explosive material detected and increase accuracy of detection Also, a morphology of an estimated emissivity map can be processed to identify a type of explosive material detected, and a contour of the estimated emissivity map can be processed to further increase accuracy of detection. [0011] The techniques can be implemented to detect explosive material concealed on a human suicide bomber. In addition, the thermal emissivity levels of human traffic can be monitored at airports, border crossings, entrance to subways and other transportation facilities and sensitive facilities, and public functions and sporting events.

[0012] In some implementations, one or more of the following features can also be included singly or in combination. Data associated with calibrated thermal emissivity levels for factors selected from a group including ambient background, an exterior surface of a human, clothing, personal articles, computing devices, and/or an explosive material can be stored in a data repository. The calibrated thermal emissivity levels can be determined by empirically associating the factors at a distance corresponding to a length between the radiation detection unit and the zone of interest. The emissivity levels can be monitored by a radiation detection unit having an optical element with a focal length corresponding to the zone of interest. In addition, a video camera can be positioned to monitor the zone of interest and display video images captured from the video camera on a video display device.

[0013] A secondary detection system can alternatively implemented to confirm detection of the concealed explosive material. The radiation detection unit can be portable including a portable camera, a wireless device, and a hand-held device. Alternatively, the radiation detection unit can be a fixed device mounted on a building or a vehicle. The radiation detection unit can be a quantum well infrared photodetector sensor disguised as a regular CCD camera. The emissivity levels monitored from a fixed distance are robust and thus buffered against variations in human gait or movement to allow easy tracking of a person carrying the concealed explosive material as the person moves through the zone of interest. The emissivity levels are not affected by variations in environmental factors such as temperature.

[0014] The techniques described herein can be implemented to realize one or more of the following advantages. For example, the real-time explosive device detection system can be implemented to detect a concealed explosive material in a high traffic zone of interest Alternatively, the emissivity levels of human traffic can be monitored in enterprise, departmental and retail facilities to prevent theft by detecting stolen goods concealed on a person. Further, the emissivity levels of human traffic can be monitored to prevent theft and removal of proprietary material on portable storage media including memory stick, portable hard drive, removable storage media, and CD. [0015] These general and specific aspects can be implemented using an apparatus, a method, a system, or any combination of an apparatus, methods, and systems The details of one or more implementations are set forth in the accompanying drawings and the description below Further features, aspects, and advantages will become apparent from the desciiption, the drawings, and the claims.

BRIEF DESCRIPTION OF DRAWINGS [0016] FIGS. 1A-1B are block diagrams of a real-time explosive device detection system

[0017] FIG 2 is a flow chart of a process of monitoring emissivity levels of human traffic within a zone of interest to determine a presence of concealed explosive material.

[0018] FIG 3 is a flow chart of a process of implementing the real-time explosive device detection system

[0019] Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

[0020] The following describes techniques for detecting object of interest such as explosive material concealed on a human body based on a differential emissivity between the explosive material and non-explosive materials including the human body, an ambient background, a synthetic personal object (such as a cell phone, car keys, etc ), and/or clothing. In the following description, for the purpose of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. It will be apparent, however, to one of ordinary skill in the art that the present disclosure may be practiced without these specific details In other instances, well-known structures are shown in block diagram form. Further, although the foregoing descriptions focus on monitoring emissivity levels to identify explosive materials, it will be apparent to one of ordinary skill in the art that the techniques can be implemented to detect any ob_ject of interest with different emissivity levels [0021] Bmissivity. A blackbody emits energy with a Planck distribution. A blackbody emitter is useful for comparison with materials that do not emit perfectly at all wavelengths, which is the case for most of the matter in the universe. Molecules that make up different materials (gases, liquids, and solids) are formed from atoms bonding together. The molecules vibrate when agitated, and this agitation arises when light of just the right wavelength hits a particular molecule. Once the molecule starts vibrating, the molecule re-radiates the same wavelength of light. This is the process of absorption and emission The wavelengths of light that cause the molecules to vibrate occur in the infrared region Every unique molecule has its own characteristic frequency of vibration. So, unlike a blackbody emitter, molecules emit energy that departs from a Planck distribution. Thus, infrared energy emitted by the vibrating molecules can be used to identify the molecules. [0022] One of the ways to describe the infrared energy emitted by molecules is in terms of radiance: watts of energy per unit of area. With changes in temperature, come changes in radiance For example, the radiance from a material at one temperature will be different from that at another temperature. In order to make comparisons of emission from materials at different temperatures, the temperature effect needs to be removed This removal is accomplished mathematically by dividing the radiance spectrum of a selective emitter by that of a blackbody (perfect emitter) at the same temperature. The result is called an emissivity spectrum. Because emissivity results from dividing one radiance spectrum by another, the units of watts /area cancel Emissivity then, is a fractional representation of the amount of energy from some material vs. the energy that would come from a blackbody at the same temperature. The places in an emissivity spectrum that have a value less than one are the wavelength regions that molecules are absorbing energy. [0023] Most surfaces are not blackbody emitters, and emit some fraction of the amount of thermal radiation as component of a blackbody. This fraction is known as emissivity. If a surface emits ¹A or 0.5 as much radiation at a given wavelength and temperature as a blackbody, it is said to have an emissivity of 0.5. If it emits 1/ 10 or 0.1 as much as a blackbody, it has an emissivity of 0.1 and so on A blackbody has an emissivity of 1.0 at all temperatures and wavelengths. [0024] A sensor with high resolution of emissivity may be used to process real-time differential emissivity levels. Ideally, the sensor should have substantially a 10⁶ resolution based on 15-30 milliKelvin. For example, a quantum well infrared photodetector (QWIP) sensor (available from QWIP Technologies, Inc.) may be used. Thermal imaging systems with sensitivity less than 50 milliKelvin can be ineffective when performing detections at standoff distances of interest (> 10 meters) or for detecting explosives camouflaged below thick clothing

[0025] A fast acting sensor (e.g., a QWIP sensor), with interpretation time < 10 millisecond is implemented to create a real-time improved explosive device (IED) detector for imaging and isolating a target subject in a crowd.

[0026] Real-Time Improved Explosive Device Detection System. FIGS. 1A-1B are block diagrams describing an improved explosive device detection (IED) system 100. The IED system 100 can include a radiation detection unit 110, an IED processing unit 130, and a display unit 120 The IED processing unit 130 can also include at least a storage unit 132 for storing computer executable instructions to be processed by a processor 134. The storage unit 132 can also include storage repositories such as database for storing various data. The system 100 can also include a secondary detection system 150 coupled to the processing unit 130 and configured to confirm detection of the concealed explosive material. The secondary detection unit 150 can be implemented to include either a X-ray imaging system, a millimeter wave radar, and/or a laser ranging device for performing a high resolution scan or neutron spectral analyzer. The secondary detection system 150 may not include a radiation detector with high sensitivity such as the QWIP camera included in the IED system 100. By implementing alternative detection components with less sensitivity, the secondary detection system 150 provides additional simple information to complement the data obtained from the IED system 100.

[0027] The radiation detection unit 110 can be configured to monitor thermal emissivity levels of human traffic within a zone of interest 140. The zone of interest 140 may include multiple sections and can extend various distances. For example, the zone of interest can extend from about three feet to about five kilometers. The radiation detection unit 100 can be coupled to the IED processing unit 130 through a communication link 112 The communication link 112 can be a bidirectional communication link between the radiation detection unit 110 and the IED processing unit 130. In some implementations, the communication link 112 is a physical cable or wire link compatible with typical data communication standards including IEEE 1394 (FireWire) connection, Universal Serial Bus (USB) connection, or other serial or parallel data connections. In other implementations, the communication link 112 is a physical cable or wire link compatible with typical digital video communication standards including high-definition multimedia interface (HDMI), digital visual interface (DVI), S-Video, composite video, component video, and other suitable video data connections. In yet other implementations, the communication link 112 may be a wireless communication link (e.g., Bluetooth, infrared, or other wireless communication). [0028] The radiation detection unit 110 can be implemented as a long wave infrared detector. One example of a long wave infrared detector may be an infrared camera configured with a highly sensitive array of infrared photodetectors known as quantum-well infrared photodetectors (QWIPs). Advances in the growth of gallium arsenide semiconductors have led to QWIPs sensitive to mid to long-wavelength infrared radiation. A camera equipped with a QWIP sensor has a sensitivity to distinguish temperature differences of fifty milliKelvin or less In addition QWIP sensors may be implemented with capabilities to detect infrared radiation in two spectral bands concurrendy i e both mid and long wave. A high performance two-color MWIR/LWIR FPA allows detection of radiations in two spectral bands from the same target points in space with registration within the optical limit correlated in time Two-color camera system will improve target detection, discrimination and identification in a highly cluttered and camouflage background condition Two- color camera also decreases vulnerability to countermeasures and decoys, and has the advantage of being able to show specific features that are not present in a single color along, and it also provides a better estimate of absolute temperature. Multiwavelength QWIPs and other infrared detectors may also be utilized that result in measurements at three or more wavelengths. In such variations, the measurements at the three or more measurements can be compared / utikzed to increase accuracy. [0029] The radiation detection unit 110 may include an optical element having a focal length corresponding to the zone of interest to facilitate monitoring emissivity levels of human traffic at a fixed distance In some implementations, the radiation detection unit 110 may be a portable device including a portable camera, a wireless device, and a hand-held device In other implementations, the radiation detection unit 110 may be a fixed device mounted on a building, or a vehicle In yet other implementations, the radiation detection unit 110 may be a QWIP sensor camera disguised as a regular CCD camera.

[0030] The radiation detection unit 110 is used to monitor human traffic by capturing real-time images and sending the images to the IED processing unit 130 to determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a concealed synthetic object including an explosive material, a weapon, and stolen goods. FIG 2 is a flow chart describing a process of detecting an explosive material concealed on a human body based on differential emissivity between the explosive material and non-explosive materials including the human body, an ambient background, a synthetic personal object (e.g., a cell phone, car keys, and other synthetic objects with a know emissivity level), and clothing. The radiation detection unit 110 is configured at 210 to monitor human traffic within a zone of interest 140. The zone of interest 140 may be divided into multiple segments. The radiation detection unit 110 may be a QWIP sensor camera calibrated to monitor emissivity levels of human traffic within a zone of interest 140 at a fixed distance. Real-time thermal radiation images of human traffic within the zone of interest 140 at the fixed distance are captured at 212 by the radiation detection unit 110. The captured real-time images are processed by the IED processing unit 130 to detect target ob_jects concealed on a human body.

[0031] Typically, a bomb detection system is implemented using a real physical scanning and detection portal, where a target human must walk through the portal. For example, an metal detector is a portal physically stationed at a set location for having people walk through the metal detector. This may not be effective for many reasons. For example, a potential target human carrying a concealed explosive material has the option of not walking dirough the detector. Also, the metal detector is a close proximity detector in that the detector is in close proximity of human casualty. Further, this physical portal cannot be used to track the target human carrying concealed explosive material.

[0032] According to one aspect, the drawbacks of requiring a physical detection portal and close proximity to the subject are eliminated. The IED system 100 allows creation of a arbitrary virtual portal in any free space that is setup as a monitoring focal point at various distances from the detection system, IED system 100 (e.g., 50 feet away, 200 feet away, etc.). The created virtual portal determines the area represented by the zone of interest 140. As the target of interest moves closer to the detection system, the detected emissivity, as a function of distance from blackbody (human carrying an explosive) is compared against models stored in a calibrated database. The detection system uploads different models and performs model switching as the target moves. Each model in the calibrated database is at least based on a specific distance. For example, the detection system may initially create a virtual portal in free space 500 meters away from the detection system. Thus the detection system detects the emissivity level of a human target initially at a distance of 500 meters. As the human target moves either closer or further away from the initial detection point, the detection system compares the measured emissivity in real time against a set of calibrated data models stored in the calibrated database corresponding to a specific distance. If the human target is moving closer to the detection system, the detected emissivity of the moving human target is compared against calibrated models set for each decremental distances (e g , 500 meters, 490 meters, 480 meters, and so forth) until a match is detected and confirmed or it is concluded that human target is not carrying a concealed IED. If the human target is moving away from the detection system, the system compares the detected ermssivity against calibrated models set for each incremental distance. If the first model does not provide a match, a different model set for the next distance is uploaded. By switching through a set of models corresponding to different distances, the detection system eliminates the need to keep track of or measure the distance between the target of interest and the detection system. Further, by comparing against stored calibrated data models, target tracking is accomplished without any additional processing as long as the target of interest is within the field of view The rate of model switching is based on a pre-cahbrated and stored estimate of human gait. For example a typical walking subject would exhibit speeds of 0.5 mph to 5 mph [0033] In one implementation, die radiation detection unit 110 is configured to monitor human traffic at a fixed distance far enough to reduce each person down to a few pixels in the captured image. Each pixel represents emissivity level of all black bodies at that location. For example, when a person is concealing an explosive material under multiple layers of clothing, the pixel represents the combined emissivity level of a combined black body, which is a combination of a natural black body (e.g. human body) and man made or synthetic black body (e.g., clothing). The clothing material acts as an interfering black body In one aspect of the techniques, a pixel of interest is selected and processed at 212 by performing differential emissivity calculation The pixel of interest must have a different emissivity level when compared to neighboring pixels to infer presence of a different nonlinear combination of black bodies represented by the pixel of interest in comparison to neighboring pixels. This differential emissivity calculation is a practical advantage of monitoring emissivity levels of human traffic at the fixed distance where each person is reduced down to a few pixels Since each pixel at such distance represent a higher surface area, the differential emissivity levels between neighboring pixels can be exploited to quickly identify presence of different combinations of black bodies.

[0034] One pixel at a time (or an aggregation of multiple pixels), the emissivity levels at the fixed distance are empirically associated with one or more factors selected from a group comprising ambient background, an exterior surface of a human, clothing, personal articles, computing devices, and an explosive. In some implementations, pixels of a QWIP array may be scanned repeatedly to detect a change in emissivity corresponding to a concealed ob_ject. The emissivity levels can be calibrated by empirically measuring the emissivity levels of a known object and a combination of known objects For example, people wearing different combinations of known clothing and concealing synthetic ob_jects including explosive devices are monitored as they walk through the zone of interest 140. The monitored emissivity levels are stored in a storage location such as an emissivity signature database at 216. These known signatures of emissivity levels can be used to facilitate real-time detection of concealed devices including explosive materials

[0035] In some implementations, as the target of interest moves within the created virtual portal, the detection system performs pixel by pixel scan processing As stated above, the detection system creates a virtual portal in any free space to monitor emissivity levels of human traffic Initially, the virtual portal is created at an arbitrary distance far away from the detection system For example, the initial detection range may be set for 500 meters away from the detection system When a target of interest is a human carrying a concealed explosive, the concealed explosive material at the initial 500 meter distance may be represented by a single pixel in a captured image. As the human target moves closer to the detection system, the explosive material will be represented by more and more pixels. At 400 meters, three pixels may represent the explosive material, for example Conversely, if the person moves further away from the detection system, the explosive material will be represented by lesser and lesser pixels This pixel by pixel scan processing allows the detection system to monitor and tract the target of interest both as the target moves closer and further away from the virtual portal.

[0036] In addition, this pixel by pixel scanning strategy is a control system that allows the detection of a single pixel and using the pixel information to back infer to the source, such as the human body Therefore, the pixel by pixel scanning strategy eliminates the need to identify the human target first and allows monitoring and tracking of emissivity levels to be performed in real time and at a considerable distance away from the detection system. Being able to detect explosive material concealed on a human body far away from the detection system provides more time to prevent detonation of the explosive material. If detection of the target human was required before making a positive detection of the explosive material, there may be no time left to safely deal with the explosive material and avoid harm.

[0037] In developing an empirical knowledge base for emissivity signatures, a test matrix with at least six variable attributes are implemented The attributes can include the following: 1 standoff distance from scanning portal;

2. clothing materials (e g , cotton, polymers, polyester, jute, denim) and types of clothing (e.g., jackets, sweatshirts and sports windbreaker);

3. ambient temperature and wind velocity;

4. objects of interest (e.g., explosives of interest and portable electronic devices such as cell phones, portable radios, mp3 players, and RFID-based key chains);

5. background field of view including road, vehicles, human cluster, buildings, foliage, and glass; and/or

6 human gait

[0038] Series of controlled images can be captured, in duplicate or triplicate, over a test space defined as the cross product of above mentioned attributes. The series of images can be captured using a QWIP camera The individuals pixels from each captured image are grouped based on a condition represented by the corresponding pixel. For example, all pixels corresponding to a building in the background are grouped together to obtain an emissivity statistic for that background condition. Once the images are deconstructed to form pixel groupings with the homologous attribute, emissivity statistics for a particular condition are calculated. Emissivity statistics can be represented to include at least the mean, standard deviation, and skewness. Model parameters are then used to develop an emissivity signature database.

[0039] The IED processing unit 130 processes each pixel of the captured image at 214 to determine if the monitored emissivity level corresponds to a predetermined differential emissivity level between different materials so that the presence of an explosive material concealed on a human body can be identified. The differential emissivity levels are calibrated against the calibrated emissivity levels of known objects stored in the emissivity signature database at 216 In one implementation, the radiation detection unit 110 is configured to monitor human traffic at a fixed distance far enough to reduce each person down to a few pixels in the captured image. Each pixel represents emissivity level of all black bodies at that pixel location. For example, when a person is concealing an explosive material under multiple layers of clothing, the pixel represents a non-linear combined emissivity level of a combined black body, which is a combination of a natural black body (e.g. human body) and man made or synthetic black body (e.g., clothing). The clothing material acts as an interfering black body. For each pixel, the emissivity levels at the fixed distance are empirically associated with one or more factors selected from a group comprising ambient background, an exterior surface of a human, clothing, personal articles, computing devices, and an explosive material. The differential emissivity between a human body, a background black body, and a camouflaged object acting as a black body of interest can be exploited.

[0040] In some implementations, additive black body algebra may be implemented to infer the presence of the camouflaged object on a human body. The camouflaged object is a target object to be detected. When the detection system detects an emissivity level, the detected emissivity level is automatically processed to determine if the emissivity level corresponds to an emissivity level produces by a combination of harmless blackbodies (e.g., a person wearing a sweater and carrying a mobile phone) or an emissivity level produces by a combination of blackbodies that include explosive material (e.g., a person wearing a jacket and concealing explosive material underneath die jacket). This determination is performed by comparing the detected emissivity level against empirically derived and calibrated data models and performing black body algebra. The detected emissivity level is deconstructed to identify the individual constituent black body that produced the detected emissivity when combined together using black body algebra. This determination is perform for each pixel and neighboring pixels are checked using differential emissivity calculations. Since, a target human does not cover his entire body with explosive material, there will be a difference in emissivity levels from one pixel to an adjacent pixel. Therefore the differential emissivity calculation is performed to compare the pixels of one area (e.g., the area representing the explosive material) against pixels of adjacent area (e.g., the area representing human body not covered by the explosive material). Thus, the differential emissivity is calculated over different materials, over time, and over adjacent pixels.

[0041] Blackbody algebra incorporates the following concepts. The spectral radiance (L_n) of electromagnetic radiation from a blackbody at temperature T is given by Planck's law in Equation 1.

2hc²

L -¹X₁ (Equation 1)

h = Plank's constant (joule per hertz)

c = speed of light (meters per second) λ = wavelength (meters)

k = Bolt2mann's constant (joules pet Kelvin)

T = temperature of the blackbody (Kelvin)

e — base of natural logarithm

Ab a blackbody is Lambertian, emittance is linked to spectral radiance by a normalization factor D as shown in Equation 2.

[0042] Natural substances on the Earth's surface and the atmosphere are not true blackbodies, and thus emit less energy than forecasted by Planck's law at different wavelengths as compared to synthetic objects. These natural substances are graybodies, absorbing and emitting energy only at certain wavelengths. Emissivity is the ratio between graybody emittance and blackbody emittance at the same temperature, and can be defined spectrally or integrated throughout all wavelengths. In addition, total blackbody emittance (M) is proportional to the fourth power of thermodynamic temperature T⁴ according to Stephan-Boltzmann law or Stephan's law as defined in Equation 3.

M = σ - T⁴ (Equation 3)

σ = Stephan-Boltzmann constant

W σ = 5.67x 10^"* m²K^A

T = temperature (Kelvin)

W = Watts

m = meter K = Kelvin

Accordingly total emittance (M) for a natural substance can be defined by Equation 4.

M - £ ' σ T (Equation 4)

ε = graybody emissivity

[0043] For synthetic blackbodies, (such as camouflaged explosives), linearized radiative heat transfer law is applied as shown in Equation 5

g = ε - σ - A(τ,⁴ -T₂ή _{(Equatlon 5)}

A — Area

[0044] The synthetic object has "full view" of a blackbody environment at absolute temperature T₂. Assume the camouflaged black body is a system enclosure with average surface temperature T₁ that is completely surrounded by an ambient temperature T₂ (e g , clothing), T₁ and T₂ should be of similar magnitude on the absolute temperature scale. Then, emittance for synthetic objects can be solved by applying Equation 6.

q = h_rA(T_λ - T₂ ) (Equation 6)

h_r = radiative "heat transfer coefficient"

This provides a good approximation of radiative "heat transfer coefficient" (h,) quantity as given by Equation 7.

r^m (Equation 7)

T_n, = arithmetic mean of T₁ and T₂.

Using these equations, empirical experiments can be implemented to determine the heat transfer coefficient (h,) for different bodies of interest. Based on the determined value of the heat transfer coefficient, (hj each analyzed pixel in a captured image can be used to back infer the type of material or camouflaged material.

[0045] If the pixel value is not within a range of calibrated emissivity level representing the nonlinear combination of the human body (natural black body), layers of clothing (synthetic black body), and an explosive material (target synthetic black body), then the IED processor 130 moves on to process the next pixel of interest. If a pixel is identified to have an emissivity value corresponding to a calibrated emissivity level associated with a person concealing an explosive material, the pixel is further processed to identify the type and location of the explosive material. The person concealing the explosive material is also identified and tracked while moving through the zone of interest 140. [0046] When monitoring and tracking a person moving across the zone of interest 140, the emissivity levels stay substantially constant over approximately 100 frames The IED processing unit 130 may process successive QWIP image frames to confirm detection of the concealed explosive material. When the detection is confirmed, an alarm may, at 210, be activated In addition, the successive QWIP image frames may be processed to confirmation identification of a specific human carrying the concealed explosive material. The IED processing unit 130 may be able to identify a specific location of the concealed explosive material on the human body with a margin of error less than a fraction of an inch.

[0047] Equations (l)-(8) below describes a process of processing successive image frames (e.g., QWIP image frames). Image I₁ at time t, (1) Image I₂ at time t₂ (2) Image I₃ at time t₃ (3)

Image I_k at time t_k (4)

A₁ = I₂ - I₁ (5)

A₂ = I₃ - I₂ (6)

Δ₃ = I, - I₄ (7)

[0048] Where A₁ are scalable denoting differential emissivities from IED object estimated by image differences Also, Δ, -> converges or Δ_ - A_{1 j} -> 0 as time i, _j, k exceeds 5-15 frame grabs [0049] The above equations are implemented to compute changes in pixel emissivity over time and changes from the model These equations facilitate calculations that provide a system to automatically detect when the emissivity estimated from a single pixel corresponds to a detection of a concealed explosive. The pixel information allows a determination of whether the emissivity detected originated from a natural object (e g , human and background) or from an explosive acting as a black body

[0050] With a fast responding camera, P_rA -> 0 and P_D -> 1 as system reaches an adiabattc (or stable) state, where P_FΛ is the probability of false alarm and P_D is the probability of detection Empirically, integration time > 5 millisecond and > 10 frames have been found to be necessary to achieve detection

[0051] Based on the differential emissivity calculated, the IED processing unit 130 may be able to detect concealed explosive materials including plastic explosive material, timing mechanisms, explosive trigger mechanisms, and wiring devices The techniques for calculating the differential emissivity may also be implemented to detect concealed explosive material comprising dud explosives and wired devices In some implementations, the real-time IED detection system 100 may be implemented to determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a synthetic material concealed on a human body, wherein the synthetic material comprises a firearm, a portable electronic device, a chemical material, and a stolen good For example, the real-time IED detection system 100 may be implemented to prevent theft in enterprise, departmental and retail stores, and other facilities where theft of merchandise is a concern Application — theft and removal of proprietary material on memory stick, media, CD etc

[0052] By effectively calibrating the monitored emissivity levels and taking advantage of the robustness of monitoring at a fixed distance, the calculated differential emissivity is buffered against large changes in the ambient background including temperature, wind conditions, humidity, hail, and snow. Also, when tracking the specific human identified to have a concealed explosive material, the thermal emissivity levels monitored from a fixed distance are buffered against variations in human gait or movement. In some implementations, the real-time IED detection system 100 may be implemented to monitor human traffic at airports, border crossing, entrance to subways and other transportation facilities and sensitive facilities. In other implementations, the real-time IED detection system 100 may be implemented to monitor human traffic at public functions and sporting events.

[0053] In some implementations, properties of an estimated emissivity map may be processed to identify a type of explosive material and to increase accuracy of detection. The properties of the estimated emissivity map may include a texture, a morphology, and contour. A pixel-based analysis having multiple pixels represent an object of interest can result in some variation in the estimated intensity from pixel to pixel This variation can be due to several reasons such as background noise, electronic noise, clutter, and imaging imperfections However, information obtained by performing statistics of variation in the estimated intensity of ad_jacent pixels provides valuable insights on the concealed object of interest or the absence of such an object Texture refers to the variation in adjacent pixel intensities Grouping of pixels with similar intensities leads to object morphology and contour Texture, morphology, and contour can be used to increase the confidence of the assessment. For example, a Laplacian filter can reveal low frequency artifacts in the image coming from natural variations due to clothing High frequency artifacts on the other hand can reveal present of a anomaly corresponding to some concealed ob_ject such as cell phone or explosive Texture analysis can further reveal information to separate a electronic device from explosive based on the edge and curvature properties Overlaying emissivity contours on segmented human individual contour can provide further evidence for presence of concealed ob_jects [0054] In some implementations, die techniques may further be implemented to identify facial expressions and detect the presence of sweat on a human target On a human body, the emissivity level of the head, is higher than other parts of die body Therefore, a black body algebra of a single human body may be performed to identify the differential emissivity as the person's head and to immediately recognize that the emissivity reading does not represent an explosive material. For example, a person on a cold day may be wearing a muffler wrapped around his face, and the pixel representing the emissivity level of a combination of his face and the muffler may appear as a concealed object. By recognizing human facial expression in addition to detecting the presence of sweat on the human body may facilitate eliminations of false positive detections of the concealed explosive material

[0055] FIG 3 is a flow chart describing a general process of detecting concealed explosive device A radiation detection unit is configured to monitor emissivity levels of human traffic within a zone of interest at a fixed distance at 310 The emissivity levels of human traffic are monitored within a plurality of sections of a zone of interest at 312 The monitored emissivity levels are processed to determine if they correspond to at least one calibrated emissivity level associated with a concealed explosive device. In some implementations, the monitored emissivity levels may be implemented to detect stolen goods concealed on a person.

[0056] Processors suitable for the execution of the techniques described above include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer, including graphics processors, such as a GPU Generally, the processor will receive instructions and data from a read only memory or a random access memory or both The essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks. Information carriers suitable for embodying computer program instructions and data include all forms of non volatile memory, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e g., internal hard disks or removable disks; magneto optical disks; and CD ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.

[0057] To provide for interaction with a user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e g , a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0058] A number of implementations of the disclosure has been described. Nevertheless, it will be understood that various modifications may be made without departing from the scope of the disclosure.

Claims

WHAT IS CLAIMED IS:

1. A method comprising: creating a virtual portal representing a zone of interest; monitoring thermal emissivity levels of human traffic within a plurality of sections of the zone of interest; and determining whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with an object of interest.

2 A method as in claim 1 , wherein the ob_ject of interest is a concealed explosive material.

3. A method as in claim 1, further comprising: identifying a human associated with each thermal emissivity level corresponding to the ob_ject of interest.

4. A method as in claim 3, further comprising: uploading a plurality of pre-determined empirical models to compare the monitored emissivity levels against the models; performing model switching to compensate for a change in distance between the human and a emissivity monitoring system as the human carrying the object of interest moves, and tracking the identified human within the zone of interest by comparing the detected emissivity level against the plurality of pre-determined empirical models

5. A method as in claim 2, further comprising: calibrating the monitored thermal emissivity levels to distinguish between the concealed explosive material and a non-explosive material including a cell phone, a pager, a key chain, and other non-explosive synthetic ob_jects based on differential emissivity between different synthetic objects.

6. A method as in claim 1, further comprising: calibrating the monitored thermal emissivity levels to identify a differential emissivity between a clothing material including fabric, leather, synthetic polymer, and the object of interest hidden under the clothing material.

7 A method as in claim 1 , wherein the zone of interest extends from three feet to five kilometers.

8. A method as in claim 1, wherein the monitoring is operable to identify temperature differences within a range of about five milliKelvin to fifty milliKelvin to identify the concealed explosive material.

9. A method as in claim 1, wherein the monitoring utilizes a long wave infrared detector.

10 A method as in claim 1 , wherein the infrared detector is a quantum well infrared photodetector QWIP.

11. A method as in claim 10, wherein the plurality of sections of the zone of interest correspond to pixels of the quantum well infrared photodetector.

12. A method as in claim 1, wherein the determining whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with the ob_ject of interest comprises: determining whether the monitored thermal emissivity level for a section of the zone of interest is associated with a calibrated thermal emissivity level for a factor selected from a group comprising: ambient background, an exterior surface of a human, a clothing material, a personal article, a computing device, and an explosive material.

13. A method as in claim 1, wherein the thermal emissivity levels are monitored from a fixed distance; and further comprising. empirically associating thermal emissivity levels at the fixed distance with one or more factors selected from a group comprising, ambient background, an exterior surface of a human, a clothing material, a personal article, a computing device, and an explosive material.

14. A method as in claim 10, further comprising processing successive quantum well infrared photodetector image frames to confirm detection of the object of interest.

15. A method as in claim 14, further comprising processing successive quantum well infrared photodetector image frames to confirm identification of a specific human carrying the object of interest.

16 A method as in claim 15, wherein processing successive quantum well infrared photodetector image frames to confirm identification of a specific human carrying the object of interest further comprises identifying a specific location of the object of interest with a margin of error less than a fraction of an inch.

17. A method as in claim 2, wherein the concealed explosive material includes at least one of a plastic explosive material, a timing mechanism, a wiring device, an explosive trigger mechanism, a dud explosive, and a wired device.

18. A method as in claim 2, further comprising. detecting a facial expression and sweat on a human target to facilitate the detection of the concealed explosive material.

19. A method as in claim 1, wherein determining whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with the object of interest is based on a differential emissivity, wherein the differential emissivity is buffered against changes in the ambient background including temperature, wind condition, humidity, hail, and snow.

20. A method as in claim 10, further comprising repeatedly scanning pixels of a quantum well infrared photodetector array to detect a change in emissivity to detect a concealed object.

21. A method as in claim 2, further comprising processing a texture in an estimated emissivity map to identify a type of explosive material detected and increase accuracy of detection.

22 A method as in claim 21, further comprising processing a morphology of an estimated emissivity map to identify a type of explosive material detected, and processing a contour of the estimated emissivity map to further increase accuracy of detection

23. A method as in claim 2, wherein the explosive material is concealed on a human suicide bomber

24- A method as in claim 1 , wherein monitoring thermal emissivity levels of human traffic within a plurality of sections of a zone of interest further comprises monitoring human traffic at at least one of an airport, a border crossing, an entrance to subways and other transportation faculties, an entrance to sensitive facilities, a public function, and a sporting event

25. A method comprising- creating a virtual portal representing a zone of interest; monitoring thermal emissivity levels of human traffic within a plurality of sections of the zone of interest using a quantum well infrared photodetector; and determining whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a synthetic material concealed on a human body

26. An apparatus comprising a radiation detection unit operable to monitor thermal emissivity levels of human traffic within a plurality of sections of a zone of interest; and a processor coupled to the radiation detection unit operable to determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with an ob_ject of interest.

27 An apparatus as in claim 26, wherein the ob_ject of interest is a concealed explosive material

28. An apparatus as in claim 26, wherein the processor is operable to identify a human associated with each thermal emissivity level associated with the object of interest.

29. An apparatus as in claim 26, further comprising a display unit; and wherein the processor is operable to track the identified human within the zone of interest and display the tracked identified human on the display.

30 An apparatus as in claim 26, wherein the radiation detection unit is operable to distinguish temperature differences within a range of about five milliKelvin to fifty milliKelvin to identify the object of interest.

31. An apparatus as in claim 26, wherein the radiation detection unit is a long wave infrared detector.

32. An apparatus as in claim 26, wherein the long wave infrared detector is a quantum well infrared photodetector.

33. An apparatus as in claim 32, wherein the plurality of sections of the zone of interest correspond to pixels of the quantum well infrared photodetector.

34. An apparatus as in claim 32, further comprising: a data repository coupled to the processor operable to store data associated with calibrated thermal emissivity levels for factors selected from a group comprising ambient background, an exterior surface of a human, clothing, personal articles, computing devices, and an explosive material.

35. An apparatus as in claim 34, wherein the calibrated thermal emissivity levels are determined by empirically associating the factors at a distance corresponding to a length between the radiation detection unit and the zone of interest.

36. An apparatus as in claim 32, wherein the radiation detection unit includes an optical element having a focal length corresponding to the zone of interest.

37. An apparatus as in claim 32, further comprising- a video camera positioned to monitor the zone of interest; and a video display unit operable to display the zone of interest as monitored by the video camera.

38. An apparatus as in claim 32, further comprising a secondary detection system coupled to the processor operable to confirm detection of the object of interest.

39 An apparatus as in claim 32, wherein the radiation detection unit is a portable device including a portable camera, a wireless device, and a hand-held device

40 An apparatus as in claim 32, wherein the radiation detection unit is a fixed device mounted on a building, or a vehicle.

41 An apparatus as in claim 32, wherein the radiation detection unit is a quantum well infrared photodetector sensor disguised as a regular CCD camera

42. An apparatus comprising: a quantum well infrared photodetector having sensitivity range of less than fifty milliKelvin operable to monitor thermal emissivity levels of human traffic within a plurality of sections of a zone of interest; a processor coupled to the quantum well infrared photodetector operable to: determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a concealed explosive material on a human body by performing differential emissivity calculation and black body algebra; track the detected concealed explosive material as the human body moves through the zone of interest; and a data repository coupled to the processor operable to store data associated with calibrated thermal emissivity levels for factors selected from a group comprising: ambient background, an exterior surface of a human, clothing, personal articles, computing devices, and an explosive material.

43. A method comprising. creating a virtual portal representing a zone of interest, monitoring thermal emissivity levels of human traffic within a plurality of sections of the zone of interest at two or more wavelengths; and determining whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with an ob_ject of interest by comparing the monitored thermal emissivity levels at the two or more wavelengths

44. A method as in claim 43, wherein the object of interest is a concealed explosive material

45. A method as in claim 43, further comprising: identifying a human associated with each thermal emissivity level corresponding to the object of interest.

46. A method as in claim 45, further comprising: uploading a plurality of pre-determined empirical models to compare the monitored emissivity levels against the models; performing model switching to compensate for a change in distance between the human and a emissivity monitoring system as the human carrying the object of interest moves; and tracking the identified human within the zone of interest by comparing the detected emissivity level against the plurality of pre-determined empirical models.

47 A method as in claim 44, further comprising: calibrating the monitored thermal emissivity levels to distinguish between the concealed explosive material and a non-explosive material based on differential emissivity between different synthetic objects.

48. A method as in claim 43, wherein the monitoring is operable to identify temperature differences within a range of about five milkKelvin to fifty milliKelvin to identify the concealed explosive material.

49 A method as in claim 43, wherein the monitoring utilizes a long wave infrared detector

50 A method as in claim 43, wherein the infrared detector is a quantum well infrared photodetector

51 A method as in claim 43, wherein the infrared detector compiises two or more quantum well infrared photodetectors

52. A method as in claim 43, wherein the infrared detector comprises a quantum well infrared photodetector operating at two or more bands

53. A method as in claim 50, wherein the plurality of sections of the zone of interest correspond to pixels of die quantum well infrared photodetector

54 A method as in claim 43, wherein the determining whether die monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with the object of interest comprises determining whether the monitored thermal emissivity level for a section of die zone of interest is associated with a predetermined calibrated thermal emissivity level

55 A method as in claim 50, further comprising processing successive quantum well infrared photodetector image frames to confirm detection of the ob_ject of interest.

56. A method as in claim 55, further comprising processing successive quantum well infrared photodetector image frames to confirm identification of a specific human carrying the object of interest.

57 A mediod as in claim 50, further comprising repeatedly scanning pixels of a quantum well infrared photodetector array to detect a change in emissivity to detect a concealed object.

58 A method as in claim 43, wherein determining whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with the object of interest is based on a differential emissivity, wherein the differential emissivity is buffered against changes in the ambient background.

59 A method as in claim 44, further comprising processing a texture in an estimated emissivity map to identify a type of explosive material detected and increase accuracy of detection

60 A method as in claim 59, further comprising processing a morphology of an estimated emissivity map to identify a type of explosive material detected, and processing a contour of the estimated emissivity map to further increase accuracy of detection

61. An apparatus comprising' a radiation detection unit operable to simultaneously monitor thermal emissivity levels of human traffic at two or more wavelengths within a plurality of sections of a zone of interest, and a processor coupled to the radiation detection unit operable to determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with an object of interest.

62 An apparatus comprising: a quantum well infrared photodetector having sensitivity range of less than fifty rnilliKelvin operable to monitor thermal emissivity levels at two more or wavelengths of human traffic within a plurality of sections of a zone of interest; and a processor coupled to the quantum well infrared photodetector operable to determine whether the monitored thermal emissivity levels correspond to at least one calibrated thermal emissivity level associated with a concealed explosive material on a human body by performing differential emissivity calculation and black body algebra.