US20090121135A1 - Portable radiometry and imaging apparatus - Google Patents

Portable radiometry and imaging apparatus Download PDF

Info

Publication number
US20090121135A1
US20090121135A1 US12/189,670 US18967008A US2009121135A1 US 20090121135 A1 US20090121135 A1 US 20090121135A1 US 18967008 A US18967008 A US 18967008A US 2009121135 A1 US2009121135 A1 US 2009121135A1
Authority
US
United States
Prior art keywords
portions
scene
image
portable device
selected temperature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/189,670
Inventor
Charles C. Warner
Scott A. Foster
Stewart W. Evans
Raul Krivoy
Michael W. Burke
John R. Rae
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FLIR Systems Inc
Original Assignee
FLIR Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US09/210,167 priority Critical patent/US6255650B1/en
Priority to US09/561,266 priority patent/US6849849B1/en
Priority to US11/048,105 priority patent/US7411193B2/en
Application filed by FLIR Systems Inc filed Critical FLIR Systems Inc
Priority to US12/189,670 priority patent/US20090121135A1/en
Assigned to FLIR SYSTEMS, INC. reassignment FLIR SYSTEMS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WARNER, CHARLES C., FOSTER, SCOTT A., BURKE, MICHAEL W., EVANS, STEWART W., KRIVOY, RAUL, RAE, JOHN R.
Publication of US20090121135A1 publication Critical patent/US20090121135A1/en
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B23/00Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/12Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification
    • G02B23/125Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification head-mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0112Head-up displays characterised by optical features comprising device for genereting colour display
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0118Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0123Head-up displays characterised by optical features comprising devices increasing the field of view
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Abstract

Systems, including devices and methods, for infrared imaging, and more particularly to systems for infrared imaging.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 11/048,105, filed Jan. 31, 2005, now U.S. Pat. No. 7,411,193, which in turn is a continuation of U.S. patent application Ser. No. 09/561,266, filed Apr. 27, 2000, now U.S. Pat. No. 6,849,849, which in turn is a continuation of U.S. patent application Ser. No. 09/210,167, filed Dec. 11, 1998, now U.S. Pat. No. 6,255,650. These priority applications are each incorporated herein by reference in their entirety for all purposes.
  • BACKGROUND ART
  • Fire fighting is extremely hazardous and demanding because of extreme temperatures and obscurants that can blind or disable a fire fighter from locating the fire's source or human beings at risk within a burning building. When there are no visible flames, e.g., when alcohol, hydrogen, hydrocarbons, etc. burn, there can be lethally high temperatures caused by gases that burn without visible ignition or flaming. Whether there are visible or invisible flames, nevertheless there can be dense smoke or airborne particulate that makes normal vision impossible. At night or in dark locations, even without extremely high temperatures and even without obscurants, vision is essential to containing a fire or saving a life.
  • Conventionally, infrared (IR) vision subsystems for fire fighters have been bulky and integrated with other fire fighting protective equipment worn by fire fighters. They also typically have required an umbilical cord to equipment worn on the body of the fire fighter. Typically, IR equipment is connected with protective body gear referred to herein as a bunker suit typically including or augmented by self-contained breathing apparatus (SCBA).
  • Other vision systems for fire detection are not designed for hands-free operation as is required of a system used by firefighters that must enter the scene of the fire. For example, U.S. Pat. Nos. 5,422,484 and 5,726,632, the disclosures of which are incorporated herein by reference, disclose various hand-held or pedestal-mounted flame sensors.
  • So-called night vision systems relying on IR detection and imaging often are useless in the presence within the detector's field of view of such extreme temperatures that the location of a human being or animal, for example, in a burning building goes undetected by a display phenomenon called blooming whereby a high-temperature gas cloud is represented by a color, e.g., white, that tends to wash out critical detail such as a low-temperature human form represented in another area of the display by a different gray scale. Effectively, the high-temperature cloud within view of the IR detector bleaches out needed detail in another area of the display, such as that of a human form. For example, the video systems of U.S. Pat. No. 5,200,827, the disclosure of which is incorporated herein by reference, do not address these problems unique to the firefighting and rescue fields.
  • DISCLOSURE OF THE INVENTION
  • The present teachings relate generally to systems, including devices and methods, for infrared imaging.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIGS. 1A and 1B are side elevations of the invented apparatus, with FIG. 1A showing the apparatus in infrared (IR) mode of deployment and with FIG. 1B showing the apparatus in a tilted-back, direct-view mode of deployment.
  • FIGS. 2A and 2B are isometric views of the invention, with FIG. 2A showing an exploded, partly assembled version and with FIG. 2B showing a fully assembled version, with certain portions of the imaging apparatus's housing cut away to reveal certain interior details.
  • FIG. 3 is an optical schematic diagram corresponding with FIG. 1A illustrating the IR optical geometry of the invention.
  • FIGS. 4A and 4B are schematic diagrams respectively showing an overhead and lateral view of a user and a camera head-mounted camera, the views illustrating line-of-sight and focal axes and their convergence in front of the user.
  • FIG. 5 is a block diagram of the opto-electronics within the housing of the invented apparatus.
  • FIG. 6 is a flowchart illustrating the color mapping method used in the invented apparatus for image enhancement.
  • FIGS. 7A and 7B are graphs that illustrate the color mapping method used in the invented apparatus for image enhancement, with FIG. 7A showing an entire palette mapped, and with FIG. 7B showing a detail of a portion of FIG. 7A.
  • DETAILED DESCRIPTION
  • Referring first to FIGS. 1A, 1B, 2A and 2B, a preferred embodiment of the invented wrap-around, head-up display apparatus is indicated generally at 10. Apparatus 10 may be seen to include a left arching region 12, a right arching region 14 and a forward arching region 16 that hovers preferably just above the user's eye level on the face. Apparatus 10 preferably includes a lightweight, preferably molded polymer housing with an interior void in which are located all essential components including an IR (thermal) optical engine 18 located adjacent forward region 16.
  • Optical engine 18 includes an un-cooled bolometric IR detector array 20, preferably of the type described and illustrated in commonly owned U.S. Pat. No. 5,554,849 entitled MICRO-BOLOMETRIC INFRARED STARING ARRAY and issued Sep. 10, 1996, the disclosure of which is incorporated herein by reference. Array 20 produces a high-resolution, two-dimensional, temperature pixel image of a scene within its field of view. The image produced by array 20 is stored in a digital memory 22 managed by a microprocessor 24. Left region 14 includes a battery subsystem 26 for integrally powering all components.
  • Bolometric IR detector array 20, because it is un-cooled (by which is meant it is not cryogenically cooled), produces only slight heat itself, but nevertheless is sensitive to heat in the ambient environment around it. Thus, an important contribution of the invention is a fluid heatsink 28 for removing heat from opto-electronics 30 including optical engine 18, array 20, memory 22 and processor 24. Opto-electronics 30 typically are subject to extreme environmental heat that may be produced by a fire. Accordingly, heatsink 28 is provided to ensure continuous, long-term, accurate temperature profile detection and imaging by the detector array despite the environmental extremes.
  • FIG. 1A shows apparatus 10 in its deployed position whereby the user is blinded in a left eye and vision-enhanced in a right eye, as described above. The choice of the right or left eye for blinding and viewing is predetermined for each apparatus 10, but a mirror-image version of apparatus 10 may be constructed for those users that prefer blinding the right eye, and vision-enhancing the left eye. All of the drawings and the discussion herein is for a right-eye-enhanced embodiment.
  • FIG. 1B corresponds directly with FIG. 1A and shows the same features as those described above but in a different orientation. FIG. 1B shows apparatus 10 in a tilted-back or stowed position in which the user is able to see relatively unobstructed and unenhanced with the naked eyes when the vision-enhancement features of apparatus 10 are not needed. The configuration of front region 16 of apparatus 10 wherein the lower edge 16 a of region 16 terminates in a line just below eye-level makes it possible to tilt apparatus 10 back toward the forehead ever so slightly to afford the user a direct unenhanced and relatively unobstructed view, as indicated.
  • This configuration of apparatus 10 may be preferable to alternative arrangements whereby, for example, a visor section flips up away from the frame on a hinge along the top or is removable or whereby the left lens is rendered transparent for direct viewing with the left eye or whereby the right and/or left lens is rendered only translucent such that an IR image and direct view are superimposed within the view of the user. The lens hinge or removal configurations over which apparatus 10 is believed to represent an improvement require a hinge or connection between the active display surface and the frame, thus potentially disturbing or destabilizing the optical path from the IR camera to the user's eye.
  • The translucent display lens configuration over which apparatus 10 distinguishes itself is known to cause eye-strain and confusion in many users due to the superposition of often slightly conflicting images. Confusion from superimposed images is unavoidable, since the natures of infrared energy and visible spectral energy are by definition different, and amorphous object or target boundaries result in confusion when the different images are superimposed. Often the infrared image will lag the direct image, for example, as the user's head is turned. Invented apparatus 10 avoids these problems by going against conventional wisdom in head-up IR displays and provides the user with the option of choosing to view a scene in either monocular IR or in binocular direct view modes of operation by a simple tilt or rotate of the apparatus about the user's ears.
  • Referring next to FIG. 3, the optical imaging technique used in accordance with the invention is illustrated schematically. Optical engine 18 may be seen in a slightly different form here to include array 20, a preferably back-lit liquid crystal display (LCD) 32 providing preferably at least 320×240 pixel resolution with a minimum 6-bit gray scale, a partially (preferably 50%) reflective planar mirror or mirrored lens 34 that turns the LCD image onto a focusing curved 100% reflective mirrored surface 36 that reflects the 50% intensity image back through 50% reflective surface 34 into the firefighter's eye. The display expanse may be viewed by looking through mirror 34 at focusing mirror 36, providing an approximately 25% polychromatic spectral energy efficiency, IR-representative field of view below which the firefighter may view the scene directly as indicated. Optical engine 18 also includes an IR camera unit 37 mounted as better illustrated in FIGS. 7A and 7B to intercept a frontal infrared scene along its focal axis.
  • The objective lens optical components within optical engine 18 preferably meet the F 1.3 optical standard in operation. The objective lens preferably is a 1″ diameter lens having a 300 azimuth (horizontal) field of view for wide-angle scene imaging. The lens also preferably is transmissive of IR energy in the 8 to 12 micron spectral bandwidth. The focus range of the lens is preferably set to 2 to 24 feet for normal viewing, but may be manually adjusted to 100 feet optimum focus distance.
  • Forward region 16 of apparatus 10 thus may be seen from FIGS. 1A, 1B, 2A, 2B and 3 to include a curved display expanse within and extending across an upper portion of a user's right eye field of view and a ‘blind’ or opaque expanse 38 within the user's left eye field of view. The left eye of the user thus is preferably covered, or ‘blinded.’ By enabling through one eye an IR image of the fire scene and through the other eye an obstructed or ‘blind’ view (as the parallax view resulting from a user's slightly laterally separated eyes and the depth perception obtained as a result of the parallax view are relatively unimportant in this so-called night-vision environment), weight, power and cost are saved without significant compromise of IR image.
  • Importantly, prior art difficulties with the user resolving a visual image through one eye and an IR image through the other, or resolving a visual image and an IR image through the same one or more eyes, are avoided. Depth distortion whereby one image suggests a foreground scene or shorter distance to an object and a different superimposed image suggests a background scene or greater distance to an object—a distortion of visual perception that is inherent in superimposition vision systems—also is avoided.
  • Placement of the eyeglass forward region of apparatus 10 relative to the user's head and particularly the user's face such that its bottom edge effectively cuts across the bridge of the nose is an important feature of the invention. Configuring apparatus 10 to achieve this strategic placement permits the user normally to view the fire scene monoscopically via LCD 32 and mirrored lens 36, and, alternatively, to view the scene stereoscopically and unaided beneath the eyeglass portion, by looking below the display expanse. Such dual mode viewing is very easily accomplished by a momentary, slight backward tilt of the user's head around which apparatus 10 wraps or by a momentary, slight backward tilt of the apparatus relative to the user's head. This invented feature will be referred to herein as bi-focality.
  • The dimension and configuration of the apparatus—and its resulting automatic positioning relative to the elevation of the user's eyes by its conformation with the bridge of the nose and the ears such that it perches at a given elevation on the user's face—results in bifocal operation, i.e., the dual mode operation achieved by a slight tilting forward or backward of the head or the slight tilting backward or forward of the apparatus. This is perceived to represent a great advantage over prior art systems that require the user's mind to resolve simultaneous inputs to either eye (in a left-and-right bifurcated system) or both eyes (in a head-up, see-through system), one of which is unaided vision and the other of which is IR imaged vision, which superposition is believed to be confusing and potentially hazardous.
  • FIGS. 2A and 2B show apparatus 10 in isometric view corresponding generally with FIGS. 1A, 1B and 3, with identical component parts identically designated by reference designators. FIGS. 2A and 2B are exploded, partly assembled, and fully assembled versions of apparatus 10, respectively. Also shown in FIGS. 2A and 2B are the internal configuration of various subsystems within a housing of apparatus 10. The subsystems include battery subsystem 26, opto-electronics indicated generally at 40, and a clamshell housing assembly, or simply housing, 42. Opto-electronics 40 include optical engine 18 and electronics, to be described in more detail by reference to FIG. 5, most or all of which are mounted within housing 42.
  • The subsystems listed above that form a part of apparatus 10 are operatively connected as suggested by FIGS. 2A and 2B. For example, battery subsystem 26 provides regulated DC power to opto-electronics 40 within housing 42 via one or more electrical conductors 44 that route power and ground, as well as control and communication signals between the two subsystems and more particularly to electronics 46 of opto-electronics 40. Preferably, battery subsystem 26 includes a Sanyo HR-4/3FAU or Panasonic HHR-450AB01 battery.
  • Battery subsystem 26 may also include circuitry, not shown, that monitors usage of battery 26 so that warning messages may be produced if the remaining charge of battery 26 has dropped below a certain level, or if battery 26 has been subjected to too many charge cycles or excessive temperature. The interactive nature of battery 26 is indicated in FIG. 5 by the control and communication signal that leads to and from battery 26. The plurality of contacts 44 shown on battery subsystem 26 in FIG. 2A allow for the transmission of the power, control and communication signals from and to battery subsystem 26.
  • Battery subsystem 26 preferably is mounted to housing 42 in such a manner that it can be easily and quickly removed for maintenance, repair or replacement with a fresh, fully charged battery subsystem. Finally, as seen from FIG. 2B, preferably substantially all of opto-electronics 40—including the integral display that enables a user to ‘see’ though obscurants such as smoke or to ‘see’ in the absence of light—are contained within housing 42. This holds true except for those insubstantial portions that extend from the housing such as the forward region of optical engine 18 including forward portions of IR camera unit 37.
  • A helmet clip 42C also may be seen from the drawings to extend slightly forward and above the upper front edge of housing 42. Other quick release mechanisms may be used to attach apparatus 10 to a protective helmet of the type typically worn by firefighters. A headband or strap B, shown in FIG. 1A, may be attached to apparatus 10 for additional support, at eyelets 42E. It is intended but not essential that apparatus 10 may be passed between firefighters as needed, while the firefighters are fully clothed in typical protective gear including hoods and gloves.
  • The preferred horseshoe shape of housing 42 is designed, in part, to ease handling of apparatus 10 by a gloved hand. The horseshoe shape is defined by left arching region 12 and right arching region 14 (the legs of the horseshoe) interconnected by front region 16. Legs 12 and 14 function as carrying handles for apparatus 10, if needed. Legs 12 and 14 even allow a firefighter to hold apparatus 10 in a viewing position without attaching apparatus 10 to a helmet or strapping it to a user's head. This may be particularly useful if apparatus 10 is passed frequently between firefighters in the midst of a fire, or if apparatus 10 or a firefighter's helmet becomes dislodged or structurally damaged.
  • Opto-electronics 40 including electronics 46 will be described now by reference to the schematic block diagram of FIG. 5, which, for completeness, also includes battery subsystem 26 and external options to be described. Detector array 20 preferably is mounted on a camera/buffer printed circuit board (PCB) 48 which includes digital memory 22 for buffering digital scenery data obtained by the optical engine. Optical engine 18 and battery subsystem 26 counterbalance one another along the legs.
  • Heatsink, or phase change module, 28 may be mounted in close physical proximity to detector 20 and other sensitive electronics mounted on camera/buffer PCB 48 and microprocessor PCB 50, so as to dissipate heat radiating therefrom and to maintain the detector and the electronics within predefined limits compatible with proper operation thereof. Preferably, heatsink 28 is placed far enough back in leg 14 of housing 42 so that it counterbalances detector 20 along leg 14. Battery subsystem 26 in leg 12 further counterbalances detector 20 along leg 12, while at the same time offsetting the weight of heatsink 28 so that apparatus 10 is balanced laterally as well, in a direction extending along forward region 16.
  • Microprocessor 24 preferably is separately mounted on a microprocessor PCB 50 located nearby so that timing, control, gain, image data and power are shared between the PCBs. Optical engine 18 preferably includes an NUC shutter 52 and IR optics 54 and drive and heat signals are routed to shutter 52 from camera/buffer PCB 48 as shown. An optional software development connector 56 may be provided as shown in FIG. 5 that facilitates future software development and upgrades that may be implemented in the form of programmable read-only memory (PROM) that preferably is an integral part of microprocessor 24.
  • Microprocessor PCB 50, with camera/buffer PCB 48 preferably mounted thereon, is mounted on a printed circuit motherboard/display board 58 and routes power, audio, control and digital LCD video signals therebetween. Board 58 also mounts LCD backlight electronics 60, LCD 32 and display optics 62 as shown. Board 58 provides power and control via a power distribution board 64 to battery subsystem 26. Optionally, a video transmitter 66 or video recorder 68 or both may be supported as external options to apparatus 10 via a provided NTSC/PAL video (RS-170) input/output port mounted on motherboard/display board 58. Other external options may be provided, within the spirit and scope of the invention. However, current implementation of these added options may seriously limit the portability and exchangeability of apparatus 10 between firefighters.
  • Battery subsystem 26 is an important contributor to the portability and high functional density of apparatus 10. Battery subsystem 26 includes a switch 70 and a light-emitting diode (LED) 72 for switching power on and off in apparatus 10 and for indicating when power is on. These are battery save features of apparatus 10 intended to extend its useful operating life without the user having to replace the battery subsystem.
  • In accordance with a preferred embodiment of the invention, battery subsystem 26 provides power conversion from battery voltage to the regulated +3.3 volts direct current (VDC), ±5VDC, ±12VDC required by opto-electronics 40. It also provides sufficient holdover (internal capacitance) to support low-power operation of apparatus 10 when the battery is unexpectedly removed. The battery that forms a preferably lightweight, low-cost, removable and rechargeable part of battery subsystem 26 when fully charged provides a minimum of 1 hour's operation when new, and a minimum of 40 minutes' operation after 500 charge/discharge cycles. Importantly, the battery contacts disconnect prior to external environmental exposure when installing and removing the battery into and from housing 42 to avoid possible explosive atmospheric exposure to electrical potential. This is accomplished via the mechanical design of the mounting structure and seal configurations.
  • Self-contained, sealed, liquid or plural-phase heatsink 28 may take any suitable form, but in accordance with the preferred embodiment of the invention, may be thought of as a plural-phase heatsink that by its solid/fluid character may be contained within a finite volume over its operating curve. Importantly, only a self-contained system enables a firefighter to easily employ and deploy such a vision/display system in a fire without a restraining umbilical, for example, to a separate coolant source. The use of a high-temperature-range plural phase polymer as a heatsink material avoids exhaust problems or the removal of high-temperature by-products, e.g., the steam produced by heating water.
  • Heatsink 28 is low-mass including sealed container and material contents, and provides for the thermal storage of 3100 calories of heat of fusion at a 65° C. (149° F.) to 75° C. (167° F.) melting point. Heatsink 28 in its preferred embodiment utilizes organic paraffin, such as beeswax, or n-hexatriacontane, C36H74. Organic paraffins typically have high heats of fusion per unit weight, melt homogeneously, and do not supercool.
  • One particular heatsink material believed to work well is available from Le Technologies, Inc., Hillsboro, Oreg., as product 04000850. It includes approximately 80% or less modified paraffin wax, CAS 64742-51-4, up to 25% amide wax, CAS 13276-08-9, up to 25% ethylene vinyl acetate copolymer, CAS 24937-78-8, and up to 3% antioxidant, CAS10081-67-1. Many other phase-change materials might be used, including fatty acids, salt hydrates, fused salt hydrates, and metallic eutectic compounds. Heatsink 28 is intended to maintain the IR detector array hot side temperature below 80° C. under all rated environmental conditions, at least for a limited time.
  • The use of the invented liquid or plural-phase heatsink permits apparatus 10 to operate usefully, depending upon the ambient temperature of the environment in which it is used, over varying periods of time. For example, apparatus 10 may be operated indefinitely without interruption in ambient temperatures −10° C.≦TA≦30° C. (14° F.≦TA≦86° F.); up to 2 hours at TA=40° C. (104° F.); one hour at TA=50° C. (˜120° F.); twenty minutes at TA=80° C. (176° F.); ten minutes at TA=100° C. (212° F.); five minutes at TA=150° C. (302° F.); and two minutes at TA=315° C. (˜600° F.).
  • Other important features of the invention that complement the self-contained, head-mount features of vision/display system 10 include its ergonomics and colorized display. Ergonomically speaking, apparatus 10 is easily employed and deployed by simply slipping it onto the face and over the ears, and perhaps by securing it with a clip 42C and a band B that extends over the brim or bill of the firefighter's helmet, as shown best in FIG. 1A, with no connections to other equipment being required. Apparatus 10 is dimensioned and configured to avoid interference with other gear such as typically may be worn by users of apparatus, e.g., helmets, respirator or gas masks, e.g., SCBA, and attire. Thus the size and shape of apparatus 10 is designed for more than low weight or volume, it also is sized and shaped to conform to and extend around an average user's head and face at approximately eye level, while not extending laterally around the head of the user any more than is necessary or radially therefrom more than ˜3-inches.
  • The colorization of the IR display is of great benefit in avoiding temperature extrema which tend to saturate the image field. Apparatus 10 has a very wide thermal dynamic range that enables it to accurately survey scenes having temperatures ranging between 0° C.≦TS≦815° C. (32° F.≦TS≦1500° F.). Where there are present extreme temperature ranges, it is difficult in monochrome or color display systems to differentiate extremely high temperatures, e.g., a gaseous, flammable vapor that may be several hundred degrees Centigrade, and relatively low temperatures, e.g., a living human being the surface temperature of which typically is under forty degrees Centigrade.
  • Color coding temperature ranges, via microprocessor 24 in cooperation with one or more image buffers in memory 22, may, for example, represent dangerously high avoidance zones having avoidance temperature ranges like fires, e.g., TS1≧600° C. in shades of red, intermediate temperature ranges, e.g., 100° C.≦TS2≦600° C., in shades of gray and relatively low target temperature ranges that might be rescue targets like human beings, e.g., 25° C.≦TS3≦100° C. in shades of blue. This preferred color coding allows a user to readily distinguish hazardous temperature zones from ‘safe’ target temperatures, which may be targets of particular interest to the firefighter. The representation of intermediate temperature ranges in the color range of gray de-emphasizes those zones of the scene that are normally of little interest to a firefighter, because the zones are of too high a temperature to be a rescue target, and too low a temperature to be a threat to the protective gear used by the firefighter.
  • Some other neutral color may be used instead of or addition to gray for the representation of the intermediate temperature ranges, such as brown or copper. Similarly, some color other than red or blue may be used for target and avoidance temperature ranges, provided, preferably, that the color of the target and/or avoidance portions are visually distinct from all other portions of the color image. Red is believed to readily distinguish those portions of the scene that are at a dangerously high temperature. The novel color coding also avoids occurrences of monochrome or polychromatic saturation of displays by which object profile and character often are obscured.
  • Other inventive features briefly include the provision of remote wireless monitoring via an optional pocket-sized, belt-worn transmitter 66 operatively connected to an input/output port of the microprocessor via suitable means such as a video cable and adding radiometric, e.g., numerical temperature readout, capability to apparatus 10. The latter feature requires calibration, which is facilitated in accordance with the preferred embodiment of the invention by the fact that bolometric detectors are relatively easier to calibrate than are prior art ferro-electric detector or cryogenically cooled elements. Apparatus 10 also preferably provides a NTSC/PAL output port for the digital video signals to be provided to an external display monitor.
  • The invented apparatus represents a step-wise decrease in volume and weight in IR imaging systems, with the weight of apparatus 10 under 4-pounds and the internal and external volume of apparatus 10 under 80, e.g., 71, cubic inches and 120, e.g., 105, cubic inches, respectively. Such is made possible, in part, by forming housing 42 using a suitably durable but lightweight polymer preferably via suitable injection molding techniques. Such volume and weight, coupled with the increase in functionality, will be referred to herein as high functional density. It involves miniaturizing IR imaging systems to render them more self-contained, portable, low-cost, etc., and results in a significant utility improvement.
  • In accordance with a preferred embodiment of the invention, apparatus 10 weighs less than 4-pounds, making it extremely portable and comfortably wearable by a user. This extremely low weight renders apparatus 10 comfortably worn, and transported and stored on the person of the user or a vehicle or storage area, and makes it easily ported among users. In other words, apparatus 10 by virtue of its extremely low weight is as easy to deploy and stow and handle as a piece of clothing or accessory, yet it is extremely valuable as a firefighting or surveillance tool. Such low weight is achieved in accordance with the invention by a combination of component selection, especially in the selection of low-weight batteries, heatsinks and optical elements, and a preferably integrally molded clam-shell type housing requiring little or no hardware to seal its contents against environmental extremes such as salt or fresh water spray or airborne contaminants.
  • Another aspect of the invention is the color or other coding of images whereby temperature-representing pixels are classified into selected temperature ranges and color coded to represent particular ranges for visual image enhancement, e.g., to highlight visually those portions of the scene that may contain a living human being whose temperature is within a certain relatively low predefined range and/or to visually diminish a flaming background whose temperature is within a certain relatively high predefined range. This concept is not limited to fire fighting, but is broadly applicable to IR imaging wherein a broad range of temperatures is expected and wherein an important feature within a field of view might otherwise be masked from view by color saturation due to the prevalence of extreme temperatures around the target object. For example, it may be useful in temperature-condition monitoring, law enforcement and television broadcast. This aspect of the invention will be referred to herein as a high-contrast ratio visual image enhancement method.
  • FIGS. 6, 7A and 7B illustrate the preferred technique by which color mapping is accomplished in apparatus 10 in accordance with the invention. It is noted in this connection that monochrome displays lend themselves to shape identification, whereas polychrome displays lend themselves to temperature identification. Thus, the invention in its preferred embodiment uses a combination of monochrome and color displays in which normal temperature ranges are presented on LCD 30 in monochrome to facilitate feature ID and extreme temperature ranges might be presented thereon in polychrome to facilitate temperature ID. In this way, background may be presented in gray-scale and highlights of particular interest may be presented in color. All such temperature zone identification, isothermal boundary imaging and color coding readily are accomplished by software and firmware operating within self-contained microprocessor 24.
  • A gray-scale image in the present invention is created on LCD 32 by mapping the image in pixels, with any particular pixel being produced on the screen by equal levels of the red, green and blue portions of an RGB multicolor signal. The luminance produced by the combined RGB signal for each pixel is modulated as a function of the temperature of each portion of the sensed scene. This is done by firmware in microprocessor 24, preferably using histogram-equalization image processing. Examples of such histogram equalization used in connection with machine vision systems are found in U.S. Pat. Nos. 5,083,204 and 5,563,962, the disclosures of which are incorporated herein by reference.
  • Preferably, IR camera unit 37 is radiometrically calibrated so that the image on LCD 30 accurately represents the thermal profile of the scene within the field of view of IR camera unit 37, and not just a relative temperature as found in prior art devices. Optionally, the calibrated signal from unit 37 is further processed to highlight selected temperature ranges in a selected color. A unique aspect of this highlighting is that the signal is mapped so that the highlighting within the selected temperature range is within a range of the selected color, as described below.
  • The graphs in FIGS. 7A and 7B illustrate how the highlighting is mapped to the displayed image. The RGB luminance as a function of temperature is represented in FIGS. 7A and 7B as three linear regions, each a linear function of temperature. This linear representation is a gross simplification, particularly when histogram equalization and automatic gain control is used, but it clarifies the color mapping routine of the present invention. The luminance of the red and green signals of the RGB signal have been shifted slightly so that it is easier to distinguish the individual R, G, and B signals.
  • Within a particular temperature range, such as near human body temperature, or at extreme temperatures (above 550° C. in FIG. 7A), the equalized mapping of the RGB portion of the signal is shifted to favor one color, with compensating decreases in the corresponding portions of the RGB signal. The preferred color highlighting is to emphasize one of the base components of the RGB signal, such as blue for the human target zone, and red for the extreme temperature zone. The highlighting of the human temperature zone in shades of blue is shown in detail in FIG. 7B.
  • The luminance of the highlighted portions of the image are maintained relative to the non-highlighted portions adjacent in temperature range to the highlighted temperature range by the compensation discussed above. However, luminance highlighting in addition to the described color highlighting may be added, by changing the compensation routine. For example, by increasing the blue portion of the RGB signal as desired within the selected temperature range, without making any compensation to the red or green portions of the RGB signal, the relative luminance will be increased within the selected temperature range, and the portions of the image in the selected temperature range will be highlighted in ranges of blue.
  • It is intended that the color highlighting of the present invention may be applied to various or multiple temperature ranges as the situation requires or allows. For firefighting and other life-threatening activities, it may be safer to highlight only a few key portions of the image, such as those representing a human target and excessive heat. Other highlighted temperature ranges may be identified based on a particular activity such as fire control, in which the image might be highlighted to show different levels of combustion, or such as fire cleanup, in which the image might be highlighted to show dangerous hotspots within walls or other structure.
  • The software and firmware within microprocessor 24 provides other advantages. Preferably the firmware upon the application of power automatically uses default settings for many operating parameters of apparatus 10, with such default settings stored in non-volatile memory such as read-only memory (ROM). Such permanently stored default settings preferably include control settings for image temperature range, and display brightness. The firmware preferably indicates to the user normal operating conditions including the elapsed time on the battery and the battery charge level. The firmware preferably provides user warnings of critical operating conditions such as failed power, critical battery level (e.g., <5 operating minutes remaining) and internal temperature alarm indicating that the opto-electronics are operating above their nominal maximum operating temperature.
  • Many of the system parameters may be reprogrammed. For example, apparatus 10 may first be used for a rescue operation, and then used for a fire control operation, in which case different temperature ranges of the scene may be highlighted in the image. Such a change might be accomplished by an external switch on housing 42, not shown, which triggers different routines within the firmware of apparatus 10. Currently, reprogramming is accomplished by connecting a programming computer to the power/control/communication contacts associated with battery subsystem 26, or to software development connector 56.
  • Referring now to FIGS. 4A and 4B, a head-mounted camera such as IR camera 37 of apparatus 10 and a head of a user wearing such apparatus including the camera are shown schematically in overhead and side views. The camera and its positioning and mounting within housing 42 (not shown in the simplified schematic diagram but in keeping with the teachings of the present application) of apparatus 10 achieves an important advantage over prior art portable thermal imaging systems. A parallax problem exists in conventional systems wherein the optical axis of the camera is parallel with the line of sight of the user.
  • This problem results from the off-axis, asymmetric location of the camera relative to the eye or centerline of the eyes of the user. The problem is a serious one, especially in life-threatening or hazardous situations such as firefighting. In the near field of ‘view’ through the camera, the user has difficulty handling objects within arm's reach because the camera effectively misrepresents to the user the object's location to the extent of the vertical and lateral offset between the user's eyes and the camera's “eye.” A user thus tends to reach for an object imaged by the camera only to grope for it where its position is falsely indicated, a few inches typically from where the object actually is located in space.
  • Apparatus 10 solves this problem by providing convergence of optical axis A defined by optical engine 18 (of which IR camera 37 is a part) and an axis describing the user's virtual or nominal line of sight through the right eye that is viewing the scene on LCD 32. This is accomplished by mounting optical engine 18 within housing 42 such that the optical axis converges the nominal line of sight to define a point of convergence F. In accordance with the invention, the user's line of sight is actually to a virtual scene produced for display on a mirrored lens within apparatus 10 but that the user's nominal line-of-sight axis Au may be projected into the scene, as illustrated, for purposes of explaining another feature of the invention. Accordingly, FIGS. 4A and 4B illustrate a virtual line of sight of the user and the focal point along such virtual line of sight representing the effective focal path of the user viewing a scene on such a display.
  • The angle of convergence is chosen such that convergence F of the axes occurs at a nominal arm's length spaced away or in front of the user's right eye, e.g., between 2- and 4-feet, and typically approximately 3-feet away. This distance is indicated in FIGS. 4A and 4B by a solid horizontal line 74 extending from the point of convergence F and the user's eye. The angles of convergence between the optical axis A and line of sight LOS in the horizontal plane and in the vertical plane are indicated as 76 and 78 in FIGS. 4A and 4B, respectively.
  • Objects within the user's grasp will be found where indicated by the image projected on LCD 32 because the camera is targeting and imaging the object with the angular offset that overcomes the above problem, typically in a range of between approximately 4- and 10-degrees. In accordance with a preferred embodiment of the invention, the optical axis of optical engine 18 is aimed down in a vertical plane by and angle of approximately 6-degrees and to the side in a horizontal vertical plane by and angle of approximately 8-degrees by configuring housing 42 to mount IR camera 37 at corresponding angles that converge approximately 3 feet in front of the user's right eye with the user's line of sight from the right eye.
  • Users of apparatus 10 thus reach to grasp an object in front of them based upon the image projected on LCD 32 and find the object where they reach without difficulty and without groping as with prior art systems in which the camera's optical axis and the user's line of sight are parallel with one another. In the user's very far field of view, objects' location are slightly offset vertically and laterally as a result of the alignment of IR camera 37, but it is believed that there is little difficulty for a user to proceed toward a distant object and locate the object readily once the object is a few feet in front of the user. Thus the invented solution to the prior art parallax problem surprisingly is without disorientation when ‘viewing’ a distant object.
  • The invention may include an apparatus and a method of representing a thermal image in a portable device, as described above. The steps of the method include generating an electronic signal representative of a scene in front of a user using an infrared camera, identifying target portions of the electronic signal that represent portions of the scene that are within an identified target temperature range, and mapping the electronic signal to display a color image of the scene. Preferably, the target portions of the electronic signal are mapped in a color range that is visually distinct from all other portions of the color image. The method may also include the steps of identifying avoidance portions of the electronic signal that represent portions of the scene that are above an identified avoidance temperature; mapping the avoidance portions of the electronic signal to the color image in a color range that is visually distinct from all other portions of the color image, and mapping those portions of the electronic signal that do not represent target and/or avoidance portions to the color image in a neutral color range. Preferably, this is done by producing a multicolor RGB signal representative of the image, and emphasizing at least one color of the multicolor signal. Other colors of the multicolor signal may be de-emphasized so that the relative luminance of the target portions of the image remain approximately equivalent to the relative luminance of portions of the image that represent portions of the scene that are near to the identified temperature target range.
  • The foregoing description of the preferred embodiment of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and many modifications and variations are possible in light of the above teaching. The embodiment was chosen and described in order to best explain the principles of the invention and its practical application to thereby enable others skilled in the art to best utilize the invention in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined only by the claims.

Claims (16)

1. A method of producing thermal images, comprising:
providing a portable device adapted to produce images of scenes adjacent to a user using an infrared camera;
programming the portable device to identify portions of scenes within a first selected temperature range;
using the portable device to produce a first thermal image of a first scene, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in a color range that is visually distinct from all other portions of the first image;
reprogramming the portable device to identify portions of scenes within a second selected temperature range different than the first selected temperature range; and
using the portable device to produce a second thermal image of a second scene, wherein the portions of the second image corresponding to the portions of the second scene within the second selected temperature range are displayed in a color range that is visually distinct from all other portions of the second image;
wherein the step of using the portable device to produce a first thermal image includes using the device for a rescue operation.
2. The method of claim 1, wherein the step of using the portable device to produce a second thermal image further includes using the device for a fire fighting operation.
3. The method of claim 1, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in the same color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
4. The method of claim 1, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in a different color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
5. A method of producing thermal images, comprising:
providing a portable device adapted to produce images of scenes adjacent to a user using an infrared camera;
programming the portable device to identify portions of scenes within a first selected temperature range;
using the portable device to produce a first thermal image of a first scene, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in a color range that is visually distinct from all other portions of the first image;
reprogramming the portable device to identify portions of scenes within a second selected temperature range different than the first selected temperature range; and
using the portable device to produce a second thermal image of a second scene, wherein the portions of the second image corresponding to the portions of the second scene within the second selected temperature range are displayed in a color range that is visually distinct from all other portions of the second image;
wherein the step of using the portable device to produce a first thermal image includes using the device for a fire fighting operation.
6. The method of claim 5, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in the same color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
7. The method of claim 5, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in a different color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
8. A method of using a portable device adapted to display thermal images of scenes adjacent to a user using a thermal camera, comprising:
programming the portable device to have a first set of system parameters that cause the portable device to display portions of thermal images corresponding to portions of scenes within a first selected temperature range in a color range that is visually distinct from all other portions of the image;
reprogramming the portable device to have a second set of system parameters that cause the portable device to display portions of thermal images corresponding to portions of scenes within a second selected temperature range in a color range that is visually distinct from all other portions of the image; and
using the portable device programmed to have the first set of system parameters to display a first thermal image of a first scene;
wherein the step of using the portable device to produce a first thermal image includes using the device for a rescue operation.
9. The method of claim 8, wherein the step of using the portable device to produce a second thermal image includes using the device for a fire fighting operation.
10. The method of claim 8, further comprising using the portable device reprogrammed to have the second set of system parameters to display a second thermal image of a second scene.
11. The method of claim 10, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in the same color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
12. The method of claim 10, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in a different color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
13. A method of using a portable device adapted to display thermal images of scenes adjacent to a user using a thermal camera, comprising:
programming the portable device to have a first set of system parameters that cause the portable device to display portions of thermal images corresponding to portions of scenes within a first selected temperature range in a color range that is visually distinct from all other portions of the image;
reprogramming the portable device to have a second set of system parameters that cause the portable device to display portions of thermal images corresponding to portions of scenes within a second selected temperature range in a color range that is visually distinct from all other portions of the image; and
using the portable device programmed to have the first set of system parameters to display a first thermal image of a first scene;
wherein the step of using the portable device to produce a first thermal image includes using the device for a fire fighting operation.
14. The method of claim 13, further comprising using the portable device reprogrammed to have the second set of system parameters to display a second thermal image of a second scene.
15. The method of claim 14, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in the same color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
16. The method of claim 14, wherein the portions of the first image corresponding to the portions of the first scene within the first selected temperature range are displayed in a different color range as the portions of the second image corresponding to the portions of the second scene within the second selected temperature range.
US12/189,670 1998-12-11 2008-08-11 Portable radiometry and imaging apparatus Abandoned US20090121135A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US09/210,167 US6255650B1 (en) 1998-12-11 1998-12-11 Extreme temperature radiometry and imaging apparatus
US09/561,266 US6849849B1 (en) 1998-12-11 2000-04-27 Portable radiometry and imaging apparatus
US11/048,105 US7411193B2 (en) 1998-12-11 2005-01-31 Portable radiometry and imaging apparatus
US12/189,670 US20090121135A1 (en) 1998-12-11 2008-08-11 Portable radiometry and imaging apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/189,670 US20090121135A1 (en) 1998-12-11 2008-08-11 Portable radiometry and imaging apparatus

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/048,105 Continuation US7411193B2 (en) 1998-12-11 2005-01-31 Portable radiometry and imaging apparatus

Publications (1)

Publication Number Publication Date
US20090121135A1 true US20090121135A1 (en) 2009-05-14

Family

ID=22781837

Family Applications (4)

Application Number Title Priority Date Filing Date
US09/210,167 Expired - Lifetime US6255650B1 (en) 1998-12-11 1998-12-11 Extreme temperature radiometry and imaging apparatus
US09/561,266 Expired - Lifetime US6849849B1 (en) 1998-12-11 2000-04-27 Portable radiometry and imaging apparatus
US11/048,105 Expired - Lifetime US7411193B2 (en) 1998-12-11 2005-01-31 Portable radiometry and imaging apparatus
US12/189,670 Abandoned US20090121135A1 (en) 1998-12-11 2008-08-11 Portable radiometry and imaging apparatus

Family Applications Before (3)

Application Number Title Priority Date Filing Date
US09/210,167 Expired - Lifetime US6255650B1 (en) 1998-12-11 1998-12-11 Extreme temperature radiometry and imaging apparatus
US09/561,266 Expired - Lifetime US6849849B1 (en) 1998-12-11 2000-04-27 Portable radiometry and imaging apparatus
US11/048,105 Expired - Lifetime US7411193B2 (en) 1998-12-11 2005-01-31 Portable radiometry and imaging apparatus

Country Status (1)

Country Link
US (4) US6255650B1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110115747A1 (en) * 2009-11-17 2011-05-19 Karlton Powell Infrared vision with liquid crystal display device
CN104251738A (en) * 2013-06-25 2014-12-31 南京理工大学 Helmet type infrared temperature measurer and method
US20150124102A1 (en) * 2013-11-01 2015-05-07 Flir Systems Ab Enhanced visual representation of infrared data values
US20150249044A1 (en) * 2014-03-01 2015-09-03 Manish Arora Circuit board with phase change material
WO2016040566A1 (en) * 2014-09-12 2016-03-17 Seek Thermal, Inc. Selective color display of a thermal image
US9331053B2 (en) 2013-08-31 2016-05-03 Advanced Micro Devices, Inc. Stacked semiconductor chip device with phase change material
US20170088098A1 (en) * 2009-03-02 2017-03-30 Flir Systems, Inc. Systems and methods for monitoring vehicle occupants
US9723229B2 (en) 2010-08-27 2017-08-01 Milwaukee Electric Tool Corporation Thermal detection systems, methods, and devices
US9883084B2 (en) 2011-03-15 2018-01-30 Milwaukee Electric Tool Corporation Thermal imager

Families Citing this family (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6995665B2 (en) * 2002-05-17 2006-02-07 Fireeye Development Incorporated System and method for identifying, monitoring and evaluating equipment, environmental and physiological conditions
US6388254B1 (en) * 1998-09-10 2002-05-14 Knox Company Handheld heat detection device
DE69835240T2 (en) * 1998-09-24 2007-06-06 Elgems Ltd. Photon detector in the form of a pixel matrix
US6255650B1 (en) * 1998-12-11 2001-07-03 Flir Systems, Inc. Extreme temperature radiometry and imaging apparatus
US6232602B1 (en) * 1999-03-05 2001-05-15 Flir Systems, Inc. Enhanced vision system sensitive to infrared radiation
US7057582B2 (en) * 2000-03-15 2006-06-06 Information Decision Technologies, Llc Ruggedized instrumented firefighter's self contained breathing apparatus
US6728030B2 (en) * 1999-10-22 2004-04-27 David Bellefuil Electronic binoculars having a single display
US6335526B1 (en) * 2000-02-01 2002-01-01 The United States Of America As Represented By The Secretary Of The Army Infrared sensor system technique
US6616454B2 (en) * 2000-03-15 2003-09-09 Information Decision Technologies, Llc Method of simulating nozzle spray interaction with fire, smoke and other aerosols and gases
US6704044B1 (en) * 2000-06-13 2004-03-09 Omnivision Technologies, Inc. Completely integrated baseball cap camera
US6476392B1 (en) * 2001-05-11 2002-11-05 Irvine Sensors Corporation Method and apparatus for temperature compensation of an uncooled focal plane array
US20020180866A1 (en) * 2001-05-29 2002-12-05 Monroe David A. Modular sensor array
JP2003172868A (en) * 2001-09-28 2003-06-20 Pentax Corp Optical viewer instrument with photographing function provided with automatic focussing mechanism
TW594046B (en) * 2001-09-28 2004-06-21 Pentax Corp Optical viewer instrument with photographing function
JP2003107369A (en) * 2001-09-28 2003-04-09 Pentax Corp Binocular telescope with photographing function
JP3887242B2 (en) * 2001-09-28 2007-02-28 ペンタックス株式会社 Shooting function with an observation optical system
US7369174B2 (en) * 2001-12-27 2008-05-06 Sage Technologies Ltd. Helmet-mounted thermal imaging system
US6906725B2 (en) * 2002-02-22 2005-06-14 L-3 Communications Corporation Apparatus and method for simulating sensor imagery
US6737639B2 (en) * 2002-03-27 2004-05-18 Raytheon Company Display uniformity calibration system and method for a staring forward looking infrared sensor
US7477309B2 (en) * 2002-07-10 2009-01-13 Lockheed Martin Corporation Infrared camera system and method
US6909495B2 (en) 2002-08-13 2005-06-21 Diamond Power International, Inc. Emissivity probe
DE10259123B3 (en) * 2002-12-18 2004-09-09 Dräger Safety AG & Co. KGaA Apparatus and method for monitoring the use of respiratory protective equipment makers
ITMI20030121A1 (en) * 2003-01-27 2004-07-28 Giuseppe Donato modular surveillance system for monitoring critical environments.
US7348562B2 (en) * 2004-02-02 2008-03-25 Mikron Infrared, Inc. Method for adapting an existing thermal imaging device
US7132648B2 (en) * 2003-04-15 2006-11-07 Science & Technology Corporation@Unm Uniform, non-disruptive, and radiometrically accurate calibration of infrared focal plane arrays using global scene motion
WO2005096780A2 (en) * 2004-04-07 2005-10-20 Hackney Ronald F Thermal direction unit
US7570301B2 (en) * 2004-06-03 2009-08-04 Electronic Security Products, Inc. Device, system and method of mounting audio/video capturing equipment
US7321119B2 (en) * 2004-08-12 2008-01-22 E.D. Bullard Company Method and system for thermal imaging having a selective temperature imaging mode
US8531562B2 (en) 2004-12-03 2013-09-10 Fluke Corporation Visible light and IR combined image camera with a laser pointer
US7535002B2 (en) * 2004-12-03 2009-05-19 Fluke Corporation Camera with visible light and infrared image blending
EP1831657B1 (en) * 2004-12-03 2018-12-05 Fluke Corporation Method for a visible light and ir combined image camera
US20060126085A1 (en) * 2004-12-10 2006-06-15 Owen Robert A Non-linear colorization for imaging systems
DE102004062582A1 (en) * 2004-12-24 2006-07-13 Carl Zeiss Ag Optical focussing device for projection exposure system for semiconductor manufacture, has phase change materials for temperature regulation
US20070035626A1 (en) * 2005-01-31 2007-02-15 United States Of America As Represented By The Dept Of The Army Interchangeable donut helmet apparatus
US7329869B2 (en) * 2005-09-13 2008-02-12 Autoliv Development Ab Camera system
US7528372B2 (en) 2005-10-19 2009-05-05 Csi Technology, Inc. Apparatus and method for infrared imaging with performance algorithm
US7470902B1 (en) * 2006-03-20 2008-12-30 Flir Systems, Inc. Infrared camera electronic architectures
WO2008035612A1 (en) * 2006-09-19 2008-03-27 Nikon Corporation Output device and wearable display
JP5119636B2 (en) * 2006-09-27 2013-01-16 ソニー株式会社 Display device, a display method
US9109945B1 (en) * 2006-10-06 2015-08-18 Fluke Corporation System and method for configuring a thermal imaging instrument
US7767963B1 (en) 2006-12-08 2010-08-03 Draeger Safety, Inc. Thermal imaging camera internal damping system
US8531592B2 (en) * 2007-01-11 2013-09-10 Wilcox Industries Corp. Head-mounted video recording system
US8339457B1 (en) 2007-02-28 2012-12-25 Fluke Corporation Systems and methods for time-shared memory access in a thermal imaging device
US8300981B1 (en) * 2007-02-28 2012-10-30 Fluke Corporation System and method for analyzing multiple thermal images
US7460304B1 (en) 2007-03-12 2008-12-02 Epstein Jay F Thermal vision mask
US20090040296A1 (en) * 2007-08-06 2009-02-12 Moscato Jonathan D Head mounted display assembly
US20110279673A1 (en) 2007-11-28 2011-11-17 Flir Systems, Inc. Maritime controls systems and methods
US8384780B1 (en) 2007-11-28 2013-02-26 Flir Systems, Inc. Infrared camera systems and methods for maritime applications
US8817106B2 (en) 2007-11-28 2014-08-26 Flir Systems, Inc. Infrared camera with image processing modes for maritime applications
US9047745B2 (en) 2007-11-28 2015-06-02 Flir Systems, Inc. Infrared camera systems and methods
FR2926641B1 (en) * 2008-01-23 2010-02-19 Thales Sa Helmet comprising a helmet visor and a heat sink integrated
US20100001187A1 (en) * 2008-07-02 2010-01-07 Rex Systems, Inc. Headwear-mountable situational awareness unit
US8400510B2 (en) * 2008-10-27 2013-03-19 Devcar, Llc Night vision system
US8773537B2 (en) * 2008-10-27 2014-07-08 Devcar, Llc Night vision system
US8116015B2 (en) * 2008-12-18 2012-02-14 Sheltered Wings, Inc. Monocular with attachment points
US8108147B1 (en) * 2009-02-06 2012-01-31 The United States Of America As Represented By The Secretary Of The Navy Apparatus and method for automatic omni-directional visual motion-based collision avoidance
US8749635B2 (en) 2009-06-03 2014-06-10 Flir Systems, Inc. Infrared camera systems and methods for dual sensor applications
US8941734B2 (en) * 2009-07-23 2015-01-27 International Electronic Machines Corp. Area monitoring for detection of leaks and/or flames
US20110043360A1 (en) * 2009-08-19 2011-02-24 Novatac, Inc. Portable collapsible ir detection system
US20120050607A1 (en) * 2010-08-27 2012-03-01 Rhino Outdoors, LLC Portable sensor
ES2399761B1 (en) * 2010-09-07 2014-02-25 Salduie Inversiones S.L. Screen acoustic absorbent concrete and prefabricated panels of chipboard and cement
US8976086B2 (en) * 2010-12-03 2015-03-10 Esight Corp. Apparatus and method for a bioptic real time video system
WO2012116112A1 (en) 2011-02-25 2012-08-30 Flir Systems, Inc. Modular infrared camera systems and methods
CN102186054A (en) * 2011-03-25 2011-09-14 谢丹玫 Adaptive bottom video online mining system and method based on contrast resolution compensation
US9509924B2 (en) * 2011-06-10 2016-11-29 Flir Systems, Inc. Wearable apparatus with integrated infrared imaging module
EP2791865B1 (en) * 2011-12-12 2016-03-02 Aselsan Elektronik Sanayi ve Ticaret Anonim Sirketi System and method for estimating target size
US9622529B2 (en) 2012-07-18 2017-04-18 Wilcox Industries Corp. Helmet edge trim wiring harness
US9413988B2 (en) * 2012-07-24 2016-08-09 Fluke Corporation Thermal imaging camera with graphical temperature plot
US9438825B2 (en) * 2012-12-10 2016-09-06 Fluke Corporation Infrared sensor amplification techniques for thermal imaging
US20150022667A1 (en) * 2013-07-17 2015-01-22 Fluke Corporation Activity and/or environment driven annotation prompts for thermal imager
FR3021123A1 (en) * 2014-05-16 2015-11-20 Jean Paul Granier Method for display hmd augmented reality image of a camera and other sensor data
US9791704B2 (en) 2015-01-20 2017-10-17 Microsoft Technology Licensing, Llc Bonded multi-layer graphite heat pipe
US10028418B2 (en) 2015-01-20 2018-07-17 Microsoft Technology Licensing, Llc Metal encased graphite layer heat pipe
US20160209661A1 (en) * 2015-01-20 2016-07-21 Michael Nikkhoo Carbon infused frame with bonded graphite heatpipe
US10108017B2 (en) 2015-01-20 2018-10-23 Microsoft Technology Licensing, Llc Carbon nanoparticle infused optical mount
US20160269646A1 (en) * 2015-03-13 2016-09-15 Paul John Grata Diversionary system
US20160377328A1 (en) * 2015-06-26 2016-12-29 Erin Hurbi Electromagnetic pumping of particle dispersion
WO2017166231A1 (en) * 2016-03-31 2017-10-05 深圳市柔宇科技有限公司 Head-mounted display device
US20180231404A1 (en) * 2017-02-13 2018-08-16 Lockheed Martin Corporation Sensor system
WO2019120525A1 (en) * 2017-12-20 2019-06-27 Ecole Polytechnique Federale De Lausanne (Epfl) Method of displaying an image on a see-through display

Citations (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4156292A (en) * 1978-05-23 1979-05-29 The United States Of America As Represented By The Secretary Of The Army Display carrying and protective helmet
US4254338A (en) * 1978-04-18 1981-03-03 Bergwerksverband Gmbh Determination of temperature distributions on awkwardly located or low-access surfaces
US4286339A (en) * 1978-12-04 1981-09-01 Coombs Peter A Fireman's helmet with energy absorbing liner
US4301998A (en) * 1980-04-25 1981-11-24 Pfizer Inc. Vertical gunning apparatus with television monitor
US4363691A (en) * 1979-02-12 1982-12-14 Energy Conversion Devices, Inc. Heat-sink imaging apparatus for live skin tissue using pulsed energy source
US4449787A (en) * 1980-07-22 1984-05-22 International Telephone And Telegraph Corporation Night vision imaging system adapted for helmet mounting
US4821711A (en) * 1987-01-09 1989-04-18 Draegerwerk Ag Protective breathing device
US4878116A (en) * 1988-06-02 1989-10-31 Wayne State University Vector lock-in imaging system
US4884137A (en) * 1986-07-10 1989-11-28 Varo, Inc. Head mounted video display and remote camera system
US4970589A (en) * 1986-07-10 1990-11-13 Varo, Inc. Head mounted video display and remote camera system
US5005213A (en) * 1986-07-10 1991-04-02 Varo, Inc. Head mounted video display and remote camera system
US5035474A (en) * 1984-04-16 1991-07-30 Hughes Aircraft Company Biocular holographic helmet mounted display
US5036841A (en) * 1991-02-22 1991-08-06 Computer Assisted Engineering Self contained closed circuit breathing apparatus
US5044016A (en) * 1987-12-23 1991-09-03 Cairns & Brother, Inc. Protective helmet assembly including releasable head retaining assembly
US5083204A (en) * 1984-10-01 1992-01-21 Hughes Aircraft Company Signal processor for an imaging sensor system
US5089914A (en) * 1989-10-02 1992-02-18 Eev Limited Thermal camera arrangement
US5200827A (en) * 1986-07-10 1993-04-06 Varo, Inc. Head mounted video display and remote camera system
US5386117A (en) * 1993-06-07 1995-01-31 Computational Systems Incorporated Infrared thermography system including mobile unit
US5389788A (en) * 1993-12-13 1995-02-14 Hughes Aircraft Company Infrared transducer and goggles incorporating the same
US5420828A (en) * 1992-06-25 1995-05-30 Geiger; Michael B. Viewing screen assembly
US5422484A (en) * 1989-12-20 1995-06-06 Alenia Spazio Spa Infrared sensor suitable for fire fighting applications
USH1599H (en) * 1995-07-05 1996-10-01 The United States Of America As Represented By The Secretary Of The Air Force Synthetic-color night vision
US5563962A (en) * 1994-03-08 1996-10-08 The University Of Connecticut Two dimensional digital hysteresis filter for smoothing digital images
US5637389A (en) * 1992-02-18 1997-06-10 Colvin; David P. Thermally enhanced foam insulation
US5660549A (en) * 1995-01-23 1997-08-26 Flameco, Inc. Firefighter training simulator
US5675149A (en) * 1994-09-30 1997-10-07 Honeywell Inc. Compact thermal camera
US5677532A (en) * 1996-04-22 1997-10-14 Duncan Technologies, Inc. Spectral imaging method and apparatus
US5726632A (en) * 1996-03-13 1998-03-10 The United States Of America As Represented By The Administrator Of The National Aeronautics & Space Administration Flame imaging system
US5815126A (en) * 1993-10-22 1998-09-29 Kopin Corporation Monocular portable communication and display system
US5856811A (en) * 1996-01-31 1999-01-05 Delco Electronics Corp. Visual display and helmet assembly
US5895972A (en) * 1996-12-31 1999-04-20 Intel Corporation Method and apparatus for cooling the backside of a semiconductor device using an infrared transparent heat slug
US5910842A (en) * 1995-01-19 1999-06-08 Kla-Tencor Corporation Focused beam spectroscopic ellipsometry method and system
US5936245A (en) * 1996-06-03 1999-08-10 Institut Francais Du Petrole Method and system for remote sensing of the flammability of the different parts of an area flown over by an aircraft
US5949583A (en) * 1992-02-07 1999-09-07 I-O Display Systems Llc Head-mounted display with image generator, fold mirror and mirror for transmission to the eye position of the user
US6016160A (en) * 1993-03-31 2000-01-18 Cairns & Brother Inc. Combination head-protective helmet and thermal imaging apparatus
US6023061A (en) * 1995-12-04 2000-02-08 Microcam Corporation Miniature infrared camera
US6232602B1 (en) * 1999-03-05 2001-05-15 Flir Systems, Inc. Enhanced vision system sensitive to infrared radiation
US6255650B1 (en) * 1998-12-11 2001-07-03 Flir Systems, Inc. Extreme temperature radiometry and imaging apparatus
US6317321B1 (en) * 1994-11-04 2001-11-13 Compaq Computer Corporation Lap-top enclosure having surface coated with heat-absorbing phase-change material
US7302101B2 (en) * 2002-05-20 2007-11-27 Simmonds Precision Products, Inc. Viewing a compartment

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB773898A (en) 1953-09-24 1957-05-01 Leonard Peter Frieder Improvements in or relating to close-fitting helmet
GB1533859A (en) 1975-04-29 1978-11-29 Elliott Bros Headgear incorporating optical display systems
GB2167644B (en) 1984-02-15 1988-01-27 Ms Instr Limited Night vision goggle arrangement with automatic release
WO1986005281A1 (en) 1985-03-01 1986-09-12 Fjw Industries, Inc. Objective lens system, relay lens system, and eyepiece lens system for night-vision goggles
GB8622378D0 (en) 1986-09-17 1987-01-14 Gec Avionics Helmet systems
GB9014604D0 (en) 1990-06-30 1990-08-22 Kesteven Hargreaves Limited Camera mounting apparatus
CA2045241C (en) 1990-07-13 1997-03-25 Lawrence H. Zuckerman Combination head-protective helmet with local and remote voice triggered communication system
US5291880A (en) 1990-08-16 1994-03-08 Cairns & Brother Inc. Protective helmet with protective facepiece connection and adjustment provision
GB2247822B (en) 1990-09-14 1994-02-16 Gec Ferranti Defence Syst Pilot's helmet
WO2000037970A2 (en) 1998-12-11 2000-06-29 Flir Systems, Inc. Extreme temperature radiometry and imaging apparatus

Patent Citations (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4254338A (en) * 1978-04-18 1981-03-03 Bergwerksverband Gmbh Determination of temperature distributions on awkwardly located or low-access surfaces
US4156292A (en) * 1978-05-23 1979-05-29 The United States Of America As Represented By The Secretary Of The Army Display carrying and protective helmet
US4286339A (en) * 1978-12-04 1981-09-01 Coombs Peter A Fireman's helmet with energy absorbing liner
US4363691A (en) * 1979-02-12 1982-12-14 Energy Conversion Devices, Inc. Heat-sink imaging apparatus for live skin tissue using pulsed energy source
US4301998A (en) * 1980-04-25 1981-11-24 Pfizer Inc. Vertical gunning apparatus with television monitor
US4449787A (en) * 1980-07-22 1984-05-22 International Telephone And Telegraph Corporation Night vision imaging system adapted for helmet mounting
US5035474A (en) * 1984-04-16 1991-07-30 Hughes Aircraft Company Biocular holographic helmet mounted display
US5083204A (en) * 1984-10-01 1992-01-21 Hughes Aircraft Company Signal processor for an imaging sensor system
US5200827A (en) * 1986-07-10 1993-04-06 Varo, Inc. Head mounted video display and remote camera system
US4884137A (en) * 1986-07-10 1989-11-28 Varo, Inc. Head mounted video display and remote camera system
US5005213A (en) * 1986-07-10 1991-04-02 Varo, Inc. Head mounted video display and remote camera system
US4970589A (en) * 1986-07-10 1990-11-13 Varo, Inc. Head mounted video display and remote camera system
US4821711A (en) * 1987-01-09 1989-04-18 Draegerwerk Ag Protective breathing device
US5044016A (en) * 1987-12-23 1991-09-03 Cairns & Brother, Inc. Protective helmet assembly including releasable head retaining assembly
US4878116A (en) * 1988-06-02 1989-10-31 Wayne State University Vector lock-in imaging system
US5089914A (en) * 1989-10-02 1992-02-18 Eev Limited Thermal camera arrangement
US5422484A (en) * 1989-12-20 1995-06-06 Alenia Spazio Spa Infrared sensor suitable for fire fighting applications
US5036841A (en) * 1991-02-22 1991-08-06 Computer Assisted Engineering Self contained closed circuit breathing apparatus
US5949583A (en) * 1992-02-07 1999-09-07 I-O Display Systems Llc Head-mounted display with image generator, fold mirror and mirror for transmission to the eye position of the user
US5637389A (en) * 1992-02-18 1997-06-10 Colvin; David P. Thermally enhanced foam insulation
US5420828A (en) * 1992-06-25 1995-05-30 Geiger; Michael B. Viewing screen assembly
US6016160A (en) * 1993-03-31 2000-01-18 Cairns & Brother Inc. Combination head-protective helmet and thermal imaging apparatus
US6023288A (en) * 1993-03-31 2000-02-08 Cairns & Brother Inc. Combination head-protective helmet and thermal imaging apparatus
US5386117A (en) * 1993-06-07 1995-01-31 Computational Systems Incorporated Infrared thermography system including mobile unit
US5386117B1 (en) * 1993-06-07 1997-06-10 Computational Systems Inc Infrared thermography system including mobile unit
US5815126A (en) * 1993-10-22 1998-09-29 Kopin Corporation Monocular portable communication and display system
US5389788A (en) * 1993-12-13 1995-02-14 Hughes Aircraft Company Infrared transducer and goggles incorporating the same
US5563962A (en) * 1994-03-08 1996-10-08 The University Of Connecticut Two dimensional digital hysteresis filter for smoothing digital images
US5675149A (en) * 1994-09-30 1997-10-07 Honeywell Inc. Compact thermal camera
US6317321B1 (en) * 1994-11-04 2001-11-13 Compaq Computer Corporation Lap-top enclosure having surface coated with heat-absorbing phase-change material
US5910842A (en) * 1995-01-19 1999-06-08 Kla-Tencor Corporation Focused beam spectroscopic ellipsometry method and system
US5660549A (en) * 1995-01-23 1997-08-26 Flameco, Inc. Firefighter training simulator
USH1599H (en) * 1995-07-05 1996-10-01 The United States Of America As Represented By The Secretary Of The Air Force Synthetic-color night vision
US6023061A (en) * 1995-12-04 2000-02-08 Microcam Corporation Miniature infrared camera
US5856811A (en) * 1996-01-31 1999-01-05 Delco Electronics Corp. Visual display and helmet assembly
US5726632A (en) * 1996-03-13 1998-03-10 The United States Of America As Represented By The Administrator Of The National Aeronautics & Space Administration Flame imaging system
US5677532A (en) * 1996-04-22 1997-10-14 Duncan Technologies, Inc. Spectral imaging method and apparatus
US5936245A (en) * 1996-06-03 1999-08-10 Institut Francais Du Petrole Method and system for remote sensing of the flammability of the different parts of an area flown over by an aircraft
US5895972A (en) * 1996-12-31 1999-04-20 Intel Corporation Method and apparatus for cooling the backside of a semiconductor device using an infrared transparent heat slug
US6255650B1 (en) * 1998-12-11 2001-07-03 Flir Systems, Inc. Extreme temperature radiometry and imaging apparatus
US6849849B1 (en) * 1998-12-11 2005-02-01 Flir Systems, Inc. Portable radiometry and imaging apparatus
US6232602B1 (en) * 1999-03-05 2001-05-15 Flir Systems, Inc. Enhanced vision system sensitive to infrared radiation
US7302101B2 (en) * 2002-05-20 2007-11-27 Simmonds Precision Products, Inc. Viewing a compartment

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170088098A1 (en) * 2009-03-02 2017-03-30 Flir Systems, Inc. Systems and methods for monitoring vehicle occupants
US9998697B2 (en) * 2009-03-02 2018-06-12 Flir Systems, Inc. Systems and methods for monitoring vehicle occupants
US20110115747A1 (en) * 2009-11-17 2011-05-19 Karlton Powell Infrared vision with liquid crystal display device
US8384694B2 (en) 2009-11-17 2013-02-26 Microsoft Corporation Infrared vision with liquid crystal display device
US9723229B2 (en) 2010-08-27 2017-08-01 Milwaukee Electric Tool Corporation Thermal detection systems, methods, and devices
US9883084B2 (en) 2011-03-15 2018-01-30 Milwaukee Electric Tool Corporation Thermal imager
CN104251738A (en) * 2013-06-25 2014-12-31 南京理工大学 Helmet type infrared temperature measurer and method
US9331053B2 (en) 2013-08-31 2016-05-03 Advanced Micro Devices, Inc. Stacked semiconductor chip device with phase change material
US10298859B2 (en) * 2013-11-01 2019-05-21 Flir Systems Ab Enhanced visual representation of infrared data values
US20150124102A1 (en) * 2013-11-01 2015-05-07 Flir Systems Ab Enhanced visual representation of infrared data values
US20150249044A1 (en) * 2014-03-01 2015-09-03 Manish Arora Circuit board with phase change material
WO2016040566A1 (en) * 2014-09-12 2016-03-17 Seek Thermal, Inc. Selective color display of a thermal image

Also Published As

Publication number Publication date
US7411193B2 (en) 2008-08-12
US6849849B1 (en) 2005-02-01
US20060081778A1 (en) 2006-04-20
US6255650B1 (en) 2001-07-03

Similar Documents

Publication Publication Date Title
US9298002B2 (en) Optical configurations for head worn computing
US5420828A (en) Viewing screen assembly
US7496293B2 (en) Versatile camera for various visibility conditions
US9122054B2 (en) Stray light suppression for head worn computing
EP2488135B1 (en) Welding helmet with integral user interface
US4915487A (en) Heads up display for night vision goggle
US6762884B2 (en) Enhanced night vision goggle assembly
US6521892B2 (en) Uncooled driver viewer enhancement system
CN104567543B (en) Targeting system and operating method thereof
US4805988A (en) Personal video viewing device
EP0436845B1 (en) Liquid crystal light valve goggles for eye protection
US8325263B2 (en) Camera and wearable image display apparatus
CA2116895C (en) Combination head-protective helmet and thermal imaging apparatus
US6195206B1 (en) Optical system for day and night use
CA1318528C (en) Compact see-through night vision goggles
US5497266A (en) Telescopic day and night sight
US6574030B1 (en) Multi-mode display using an electronically controlled mirror
US5189512A (en) Helmet integrated display system
US6909539B2 (en) System and method for combining multiple energy bands to improve scene viewing
US5200827A (en) Head mounted video display and remote camera system
US5005213A (en) Head mounted video display and remote camera system
US4884137A (en) Head mounted video display and remote camera system
US4786966A (en) Head mounted video display and remote camera system
EP1007994B1 (en) Panoramic night vision goggles
US8269159B2 (en) Modular panoramic night vision goggles having configurable attachments

Legal Events

Date Code Title Description
AS Assignment

Owner name: FLIR SYSTEMS, INC., OREGON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WARNER, CHARLES C.;FOSTER, SCOTT A.;EVANS, STEWART W.;AND OTHERS;REEL/FRAME:022384/0216;SIGNING DATES FROM 20000419 TO 20000421

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION