US20200253483A1 - Automatic fever detection system and method - Google Patents
Automatic fever detection system and method Download PDFInfo
- Publication number
- US20200253483A1 US20200253483A1 US16/863,043 US202016863043A US2020253483A1 US 20200253483 A1 US20200253483 A1 US 20200253483A1 US 202016863043 A US202016863043 A US 202016863043A US 2020253483 A1 US2020253483 A1 US 2020253483A1
- Authority
- US
- United States
- Prior art keywords
- thermal
- individuals
- individual
- processor
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 title claims abstract description 64
- 206010037660 Pyrexia Diseases 0.000 title claims abstract description 20
- 230000036760 body temperature Effects 0.000 claims abstract description 51
- 208000015181 infectious disease Diseases 0.000 claims abstract description 8
- 230000009471 action Effects 0.000 claims description 30
- 230000008859 change Effects 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 16
- 230000003213 activating effect Effects 0.000 claims description 9
- 230000001747 exhibiting effect Effects 0.000 claims description 6
- 230000002159 abnormal effect Effects 0.000 claims description 5
- 238000010606 normalization Methods 0.000 claims description 5
- 230000002596 correlated effect Effects 0.000 claims 2
- 230000000694 effects Effects 0.000 claims 2
- 230000033001 locomotion Effects 0.000 description 38
- 230000008569 process Effects 0.000 description 21
- 241001465754 Metazoa Species 0.000 description 20
- 238000012544 monitoring process Methods 0.000 description 12
- 238000004458 analytical method Methods 0.000 description 9
- 230000000007 visual effect Effects 0.000 description 9
- 230000001965 increasing effect Effects 0.000 description 8
- 230000037361 pathway Effects 0.000 description 7
- 230000004044 response Effects 0.000 description 7
- 241000282994 Cervidae Species 0.000 description 6
- 230000001815 facial effect Effects 0.000 description 5
- 241000282412 Homo Species 0.000 description 4
- 230000004913 activation Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000000630 rising effect Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000001931 thermography Methods 0.000 description 3
- 238000013475 authorization Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 244000052769 pathogen Species 0.000 description 2
- 230000001717 pathogenic effect Effects 0.000 description 2
- 230000037081 physical activity Effects 0.000 description 2
- 238000001556 precipitation Methods 0.000 description 2
- 230000002028 premature Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 230000003612 virological effect Effects 0.000 description 2
- 208000035143 Bacterial infection Diseases 0.000 description 1
- 208000031636 Body Temperature Changes Diseases 0.000 description 1
- 206010005908 Body temperature conditions Diseases 0.000 description 1
- 241000283690 Bos taurus Species 0.000 description 1
- 241000282832 Camelidae Species 0.000 description 1
- 208000003322 Coinfection Diseases 0.000 description 1
- 241000283086 Equidae Species 0.000 description 1
- 241000282818 Giraffidae Species 0.000 description 1
- 241000282887 Suidae Species 0.000 description 1
- 241000282458 Ursus sp. Species 0.000 description 1
- 208000036142 Viral infection Diseases 0.000 description 1
- 241000700605 Viruses Species 0.000 description 1
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000009118 appropriate response Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000001580 bacterial effect Effects 0.000 description 1
- 208000022362 bacterial infectious disease Diseases 0.000 description 1
- 238000009529 body temperature measurement Methods 0.000 description 1
- 238000009395 breeding Methods 0.000 description 1
- 230000001488 breeding effect Effects 0.000 description 1
- 230000000981 bystander Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000002498 deadly effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000001976 improved effect Effects 0.000 description 1
- 230000002458 infectious effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000000116 mitigating effect Effects 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 230000009385 viral infection Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
- A61B5/015—By temperature mapping of body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6893—Cars
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7271—Specific aspects of physiological measurement analysis
- A61B5/7282—Event detection, e.g. detecting unique waveforms indicative of a medical condition
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0003—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiant heat transfer of samples, e.g. emittance meter
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/143—Sensing or illuminating at different wavelengths
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
Definitions
- the present disclosure generally relates to systems and methods for identifying an individual(s) with elevated temperature that may be indicative of a contagious condition (viral, bacterial or other pathogen) in an individual(s) that may pose potential infection danger to other individuals that may be in proximate distance with an incubating or infected individual(s).
- a contagious condition viral, bacterial or other pathogen
- the present disclosure provides an Automatic Fever Detection System (AFDS) having a passive infra-red based thermal detection system.
- AFDS Automatic Fever Detection System
- the system is configured for automatic passive thermal detection of a thermal signature indicative of an elevated human body temperature.
- the system provides a superior approach to the detection and identification of individuals exhibiting elevated thermal profiles from among a plurality of individuals even when the individuals exhibiting the elevated thermal profiles are amongst a large, moving crowd of people.
- the present disclosure utilizes at least one forward-looking passive infra-red (PIR) image sensor mounted in a fixed position relative to the movement of passing humans.
- PIR passive infra-red
- the system in accordance with the present disclosure provides an automatic means for instantly (or nearly instantly) detecting specifically-selected and filtered thermal wavelengths that are characteristic of humans that have elevated skin (or body) temperatures above what is expected for a healthy human (typically about 98.6° F.) as they are walking or otherwise moving by or laterally crossing the sensor(s) detection field. Since the body temperature for a healthy human may not be exactly 98.6° F. (e.g. may be 98.4° F.), the system may be set with a pre-defined range for what is considered the body temperature for a healthy human (e.g. 98.1° F.
- the system may be configured with any other predetermined temperature or range of interest set by an administrator of the system.
- This information may be used to provide an augmented video and/or warning on a display screen.
- the video may show the positions of the individual or individuals with and/or without a detected elevated temperature and augment the video by providing graphical images, annotations and/or highlighting to identify individuals with and/or without an elevated temperature.
- Audible alerts may also be provided, as well as automatic video recording of any individual that triggers an alert condition.
- an AFDS in accordance with the present disclosure allows multiple individuals to be scanned at the same time and at a safe distance from the operator. Further, unlike conventional systems that utilize fixed thermal displays that do not provide automatic annotation of specific elevated temperature individuals, the AFDS of the present disclosure does not require an operator to constantly watch a display to identify individuals with elevated temperatures from amongst a moving crowd.
- Another feature of the AFDS in accordance with embodiments of the present disclosure provides for the normalization of expected body temperatures in groups of individuals that have been traveling together and have been subjected to similar ambient conditions such as temperature, atmospheric pressures, and humidity as well as similar limits of physical activity (e.g. limited mobility within an aircraft).
- the AFDS has the capability to continually (or substantially continually) average the body temperatures of a number of arriving individuals to arrive at a mean body temperature for the group, and then look for those individuals that exhibit statistically higher body temperature relative to the normalized group temperature.
- the normalized temperature figure may also be used to set or adjust the expected mean-normal temperature of the system's thermal acceptance window, as well as set or adjust the system's thermal acceptance window width. In the event the system detects a statistical anomaly such as when a normalized group mean temperature rises above a set expected value, the system warns the operator for the potential of an infected group as a whole.
- AFDSs may also be located and employed in a variety of other settings, such as schools, universities, shopping malls, hospitals, arenas, office buildings, or any other spaces where multiple individuals have close contact with one another and may need to be monitored.
- FIG. 1 provides an illustration of a vehicle on a roadway using the system in accordance with the present disclosure to detect direct or lateral human threats to the vehicle.
- FIG. 2 provides a schematic of a first embodiment of a passive infra-red pedestrian avoidance system in accordance with the present disclosure.
- FIG. 3 provides a flow chart generally illustrating an embodiment of a lateral threat detection method in accordance with the present disclosure.
- FIG. 4 provides a flow chart generally illustrating another embodiment of a lateral threat detection method in accordance with the present disclosure.
- FIG. 5 provides an illustration of a vehicle on a roadway using the system in accordance with an alternate embodiment of the present disclosure to detect lateral threats to the vehicle.
- FIG. 6 provides a schematic of a second embodiment of a passive infra-red pedestrian avoidance system in accordance with the present disclosure.
- FIG. 7 provides a flow chart generally illustrating an embodiment of a lateral threat detection method in accordance with the present disclosure.
- FIG. 8 provides a flow chart generally illustrating an embodiment of a method of operating an Automatic Fever Detection System in accordance with the present disclosure.
- FIG. 9 provides an illustration of an Automatic Fever Detection System in accordance with an embodiment of the present disclosure.
- FIG. 10 provides an illustration of an Automatic Fever Detection System in accordance with another embodiment of the present disclosure.
- FIG. 11 provides a flow chart generally illustrating an embodiment of a method of operating an Automatic Fever Detection System in accordance with the present disclosure.
- FIG. 12 provides a flow chart generally illustrating a portion of the method shown in FIG. 11 in accordance with the present disclosure.
- a vehicle 100 generally travels within a travel lane 102 on a roadway 104 .
- the system generally designated by reference numeral 10 , comprises at least one forward-looking passive IR image sensor or sensor array, generally designated as reference numeral 106 , mounted on the vehicle 100 and directed outwardly in front of the vehicle 100 , as the vehicle 100 moves, so that the IR sensor(s) 106 can detect any stationary or moving object(s) 108 containing a human thermal profile in the vehicle's travel lane 102 , or in the process of heading towards the vehicle's predicted pathway.
- a single, forward-looking IR sensor 106 is mounted on the vehicle 100 , preferably on the front of the vehicle 100 , and more preferably centered on the front of the vehicle 100 so that it can detect moving objects 108 relative to both sides of the vehicle 100 on the left and right edges of the roadway 104 ahead of the vehicle 100 , as well as any object 108 moving or stationary, already in the vehicle's path.
- a forward-looking IR sensor 106 could dynamically vary the number and area of sensor pixels analyzed depending on a vehicle's forward speed.
- an image processor 110 associated with the IR sensor 106 could prioritize the central region of the sensor 106 , but as the vehicle's speed decreases, the number and area of pixels analyzed can be increased to effectively widen the sensor's field area(s) of interest.
- the area of analysis would generally cover a relatively close range in front of the vehicle 100 —about 10 to 20 feet in front of the vehicle 100 effectively representing a range from the IR sensor 106 of approximately ⁇ 45 degrees from the centerline of the vehicle 100 , so as to be able to image the left and right sides of the roadway 104 or travel lane 102 ahead of the moving vehicle 100 .
- each IR sensor 106 has a relatively large pixel array in order to effectuate dynamic fields of reference, for example, at least 640 ⁇ 480, from which laterally moving objects can be discerned in accordance with the present disclosure.
- the number and area of sensor pixels for the thermal acceptance window can also be dynamically varied depending on ambient temperature or weather conditions, roadway conditions, or movement of the object relative to the vehicle.
- the thermal imaging sensor assembly provided on the vehicle 100
- multiple forward-looking IR sensors 106 can be mounted to the vehicle 100 , preferably on the front end thereof.
- Such IR sensors 106 can functionally operate in an independent, over-lapping and/or redundant fashion with each other.
- the vehicle 100 may include a dedicated right-side IR sensor 106 R—directed toward the right edge of the roadway/travel lane ahead of the vehicle 100 in a forward-looking manner—and a dedicated left-side IR sensor 106 L—directed toward the left edge of the roadway/travel lane ahead of the vehicle 100 in a forward-looking manner.
- the sensors 106 R and 106 L may be positioned on the front end of the vehicle 100 , or alternately, on the lateral sides of the vehicle 100 , but directed forwardly from the vehicle 100 so as to detect objects ahead of the moving vehicle 100 . More preferably, the sensors 106 R and 106 L can be directed to be able to detect upcoming objects 108 (e.g., pedestrians and cyclist, as illustrated) on the lateral side of the vehicle 100 in a predictive fashion while also accommodating the movement and speed of the vehicle 100 , and further taking into account possible or likely responsive actions the vehicle 100 can take upon detection of a laterally moving threat.
- upcoming objects 108 e.g., pedestrians and cyclist, as illustrated
- the vehicle 100 can be provided with a combination of front and side IR sensors 106 , each still preferably forward-looking, to optimize the detection areas of the system.
- IR sensors 106 can functionally operate in an independent, over-lapping and/or redundant fashion with one another.
- the use of multiple IR sensors 106 can also assist in compensating for variable vehicle speed and ensure that actual and potential threats are quickly identified regardless of the speed of the vehicle 100 , the speed of the object 108 , the ambient lighting conditions, roadway conditions, or weather conditions.
- IR sensors and IR sensor array in regards to the present disclosure are intended to be interchangeable, and each embodiment in accordance with the present disclosure covers scenarios using a single sensor as well as an array or set of sensors operating to a collective end of monitoring the lateral sides of the roadway/travel lane ahead of the moving vehicle 100 for potential threats to the vehicle 100 , such as pedestrians walking in front of the vehicle 100 .
- the IR sensors 106 are in operative communication with an image processor 110 , such as a video processor, tied into the operational system of the vehicle 100 , such as via a central CAN Bus unit 112 .
- the CAN Bus 112 is in constant communication with various vehicle sensors, such as the IR sensors 106 , for analysis and output processing, preferably immediately in real-time, based on the detected data.
- the image processor 110 filters out any object that is outside a narrow or predefined thermal acceptance window indicative of a normal human thermal profile (e.g., about 98.6° Fahrenheit) before analyzing whether any thermally detected objects are in or are about to enter the roadway 104 .
- the acceptance window can be dynamically widened or narrowed, and/or the thermal center point shifted in accordance with ambient temperature or weather conditions, roadway conditions, lighting conditions, vehicular speed, etc.
- a method for identifying laterally moving dangers for a moving vehicle 100 and adjusting operation of the vehicle 100 accordingly comprises first detecting an object 108 , associated with a human thermal signature, on the side of, on a path towards, or already within the roadway 104 along a predicted pathway of the vehicle 100 , using thermal imaging (e.g., the IR sensors 106 and the image processor 110 ).
- thermal imaging e.g., the IR sensors 106 and the image processor 110 .
- the system 10 Upon detection and subsequent selection of qualifying objects 108 , or potential “threats”, the system 10 first determines how many qualified pixels meet the target criteria, as dynamically modified by the vehicle's forward travelling speed. The rate of target pixel change, relative to the vehicle's forward travelling speed, determines how close the vehicle 100 is to a potential object 108 .
- the system 10 determines if the object 108 is already in the roadway travel lane(s) 102 , or moving in a direction toward the roadway travel lane(s) 102 , and at what speed, and assesses the need for responsive action in the vehicle's operation.
- the image processor 110 While the system 10 normally tracks movement of an object 108 relative to the vehicle 100 that has already met the human thermal characteristics, the image processor 110 is also capable of operating in an alternate mode whereby if the qualified object 108 is not moving relative to the vehicle 100 , but the vehicle 100 is heading directly toward a stationary qualified object 108 , the image processor 110 will count the number of contiguous pixels in a grouping that have met the human thermal profile criteria (“qualified pixels”) and consider that increasing numbers of qualified pixels as movement towards a qualified object 108 .
- the numeric threshold of said qualified pixels that are needed to trigger any responsive action(s) may be dynamically changed by the image processor 110 in response to the vehicle's speed and/or the location of the qualified pixels on the sensor array.
- the system 10 triggers such responsive action in the vehicle's operation, such as by providing adjustment input to the vehicle's steering system 114 ; activating the vehicle's braking system 116 ; sounding an audible alert 118 associated with the vehicle 100 , such as activating the vehicle's horn; and/or activating a visual alert 120 associated with the vehicle 100 , such as flashing the vehicle's headlights.
- responsive action such as by providing adjustment input to the vehicle's steering system 114 ; activating the vehicle's braking system 116 ; sounding an audible alert 118 associated with the vehicle 100 , such as activating the vehicle's horn; and/or activating a visual alert 120 associated with the vehicle 100 , such as flashing the vehicle's headlights.
- additional interior audible alerts, haptic feedback, and/or alerts displayed in front of the driver on the windshield could also be provided.
- the step of determining if the human thermal signature is moving in a direction potentially converging with the vehicle 100 can involve first, determining if the human thermal signature is moving or stationary upon initial detection thereof; then, determining, if moving, whether the direction of the human thermal signature is generally perpendicular to the roadway 104 ; and then, determining if the movement is toward the roadway travel lane 102 .
- the step of assessing whether there is a need for responsive action includes determining the speed and direction of movement of the target 108 and/or by determining if the target 108 is within close range of, or already in, the vehicle's predicted pathway.
- the system 10 can note an increasing number of contiguous qualified thermal pixels reaching a numerical threshold, indicating a proximity reactive threshold.
- other factors can be analyzed, such as ambient temperature, weather conditions, road conditions, vehicle speed, and the like, to modify the reactive algorithm threshold, as described in more detail below.
- the system 10 of the present disclosure can also be used in driven vehicles, either having a quasi-autonomous mode or as a back-up redundancy to the human operator.
- the detected human thermal signature information and suggested corrective action may be provided, for instance, as a “heads up” or overlaid display outline 122 on a driven vehicle 100 , or as a data input to the navigation and automatic braking systems 114 and 116 , respectively, of the vehicle 100 .
- the driver may be able to adjust the vehicle's position and speed manually, or in the alternative, the vehicle 100 may automatically adjust the vehicle's position, speed, and braking based on such continuous monitoring of any laterally moving threats to the vehicle's operation. If the system 10 detects reactive driver input(s), it can then focus on warning the detected target(s) through the audible and visual signaling systems 118 and 120 , respectively, while a driver is focusing on the overall vehicle control.
- the image processor 110 can also be used to detect the presence of human thermal profiles on the side of the roadway 104 , and more importantly, when such humans traverse onto the roadway 104 itself. More preferably, the image processor 110 using the system 10 in accordance with the present disclosure, can not only detect the presence of a target object 108 on the side of the roadway/travel lane using thermal imaging, but also determine if the object 108 is moving, in what direction, and at what speed, and adjust operation of the vehicle 100 accordingly.
- the system 10 can predict if a detected human thermal signature is likely to be struck by the vehicle 100 by also taking into account the speed and location of the vehicle 100 relative to the detected human thermal signature; the location of the vehicle 100 on the roadway 104 (e.g., outer lane or inner lane on a multi-lane roadway); the location of the vehicle 100 within a particular travel lane 102 ; and ambient weather conditions that would potentially impact reaction times for the system and the level of braking force, mindful of distances required to react to a situation properly.
- the roadway 104 e.g., outer lane or inner lane on a multi-lane roadway
- ambient weather conditions that would potentially impact reaction times for the system and the level of braking force, mindful of distances required to react to a situation properly.
- a simultaneous analysis mode is available for an autonomous vehicle 100 .
- the system 10 uses a proprietary algorithm to initially detect the location of objects 108 possessing a human thermal signature (e.g., pedestrians, bystanders, bikers, wheelchairs with human occupants), namely, objects exhibiting a thermal signature that is plus/minus the “nominal” human body temperature of 98.6° Fahrenheit.
- the algorithm determines if the detected human thermal signature in said thermal range is already located in, or is moving within, or towards the vehicle's travel area (which would be indicative of a pedestrian or biker), or is maintaining travel in a safe manner within designated bicycle lanes, or at the side of the road for instance.
- a logic circuit output will automatically trigger a responsive action in an autonomous vehicle 100 , such as activating a vehicle's braking system 116 and/or biasing the steering control system 114 to redirect the vehicle 100 away from the impinging or potentially impinging object 108 .
- the system 10 may activate the vehicle's horn 118 and lights 120 in a distinctive manner to visually and aurally alert and warn distracted pedestrians (such as those looking down at their mobile devices), visually impaired pedestrians, and children running after an object in the roadway, etc.
- a further implementation of the system 10 would also transmit a warning signal via Bluetooth, V2P, or other signaling means to area mobile devices that are so equipped to receive such safety signals.
- the image processor 110 is specifically looking for and determining whether there is either perpendicular or diagonal movement of human thermal signatures that are about to and/or are in the process of impinging on the upcoming roadway surface of a moving vehicle 100 , or stationary human thermal signatures that are existing within the roadway 104 or travel lane 102 , while concurrently ignoring strictly parallel “body temperature” movement such as would be typical of bikers or pedestrians walking or biking with traffic along sidewalks or roadway edges or shoulders.
- the system 10 only turns on and operates when the vehicle 100 is turned on, and even more preferably when the vehicle 100 is moving.
- the vehicle 100 is turned on and the system 10 is activated, preferably in connection with the vehicle's ignition.
- the system 10 queries the vehicle's operating systems to determine whether the vehicle 100 is moving or not. If not, then the system 10 continues to query about movement on a loop until there is actual vehicle movement, as represented in Block 204 .
- the vehicle 100 can include a single IR sensor 106 positioned on the front-center of the vehicle 100 for detecting objects 108 ahead that may be approaching the vehicle's path from straight ahead, as well as from both lateral sides of the vehicle 100 , or in conjunction with two IR sensors 106 R and 106 L positioned on respective sides of the vehicle 100 for respectively monitoring both sides of the roadway 104 ahead of the moving vehicle 100 to detect objects 108 .
- the system 10 further determines at Block 208 if the detected thermal object(s) is characteristic of a human thermal profile by passing through a dynamic qualifying thermal gate that is nominally centered around 98.6° F. If not, then the system 10 ignores the object and continues to search for and qualify other detected thermal signatures, again at Block 204 . If the object 108 is, however, within the pre-determined human thermal range, it is then classified as a valid detected human thermal signature, and the system 10 then subsequently determines if said human thermal signature is moving, as indicated at Block 210 .
- the system 10 continues to monitor this and other human thermal signature targets for changes in their movement status without informing the vehicle 100 to take operative action (Block 204 ). If no movement is detected, and the object 108 is within the travel lane 102 , then the system 10 informs the vehicle 100 to take operative action such as holding its present position or adjusting vehicle operation, as necessary (Block 226 ). If no movement is detected, and the object 108 is safely adjacent to, or within the edges or shoulder of the travel lane 102 , then the system takes no operative action.
- the system 10 determines the direction of the movement at Block 214 —e.g., is the movement of the human thermal signature parallel with the vehicle's present and predicted travel, moving away from the vehicle's travel path, or moving towards the vehicle's predicted travel path? In this regard, the system 10 first determines if the movement is parallel to the vehicle 100 at Block 216 (indicating, for example, a person walking or biking within a dedicated lane on the side of the road). If such movement is parallel, then the system 10 determines that the human thermal signature is not in immediate danger from the travel pathway of the vehicle 100 and returns to monitoring this and other thermal signatures for changes (Block 204 ).
- the system 10 keeps tracking movement of the detected human thermal signature(s) (Block 218 ) to identify if its direction of movement shifts to one that could be considered a threat—e.g., a bicyclist turns into the travel lane 102 to cross the roadway 104 —until the object 108 is no longer in the filed of view of the IR sensor 106 . If such movement is detected, the system 10 re-assesses the actual threat level (Block 220 ) and determines if any responsive action is needed, as discussed below.
- a threat e.g., a bicyclist turns into the travel lane 102 to cross the roadway 104
- the system 10 can utilize a dynamic lateral angle acceptance window to prevent any temperature-qualified slow-speed laterally moving objects outside the lateral angle acceptance window from falsely triggering the system 10 . That is, the lateral angle acceptance window, in proportionality to the current speed of the vehicle 100 and the speed of the detected human object 108 , can eliminate potential threats that are too far away from the side of the roadway 104 , or are calculated as to not present a future danger as the vehicle 100 passes by the detected object 108 .
- the angle window is defined from the centerline of the moving vehicle 100 —for example, ⁇ 45 degrees from the vehicle's centerline. More preferably, the width of the lateral acceptance window can proportionally adjust with the speed of the vehicle 100 , such that the window is narrower at lower speeds and wider at higher speeds.
- the system 10 determines if the movement is moving towards or away from the roadway 104 to assess the threat level to the detected human thermal signature. If the movement is determined to be moving away from the roadway 104 , or outside the vehicle's predicted pathway (Block 222 ), then the threat level is low and is disregarded by the system 10 as it continues to monitor for other qualifying thermal signatures and movements (Block 204 ).
- the system 10 triggers, at Block 226 , one or more evasive action responses, including but not limited to activating the vehicle's braking system 116 , providing direct input to and activating the vehicle's “Driver Assist” steering system 114 , and/or providing visual and audio alerts, such as activating and flashing the vehicle's lights 120 and rhythmically sounding the vehicle's horn 118 .
- the system 10 can dismiss the detected human thermal signature as being no threat but can keep tracking the movement of the human thermal signature in case the speed and/or direction of movement changes, at which time the threat level can be reassessed.
- an algorithm analyzes the detected human thermal signature's present location, direction of travel, and forward lateral speed relative to the vehicle's present location, travel direction, and forward lateral speed to determine whether the combined travel vectors will result in a collision.
- the system 10 communicates with the vehicle 100 to return to a normal driving mode and again monitoring for thermal signatures, represented by Block 228 , essentially starting the process over again to be on the alert for the next unknown, unexpected, and unpredicted situation.
- the system 10 dynamically matches the timing of the vehicle's response system and activation thereof by taking into account both the real-time speed of the vehicle and the forward and lateral speed of any detected human thermal signature, as represented in the flow chart illustrated in FIG. 4 . For example, if the vehicle 100 is travelling at a high speed, the system 10 triggers responsive actions (such as braking and steering adjustments) more quickly and with faster responsiveness and braking effort than at slower travelling speeds.
- responsive actions such as braking and steering adjustments
- Similar proactive adjustments to the system's timing of responsive actions and reactive response level thereof can be made in bad weather conditions, such when snow or frozen precipitation are detected by the vehicle's temperature and rain sensors, or in other situations where there is potential for braking/steering impairment.
- these sensor inputs adjust the system's responses to allow for an earlier (and more gentle) initiation of responsive actions so that severe response actions (such as a “panic” immediate stops) on a wet or frozen roadway can be avoided, if possible. That is, if the system 10 is aware of road conditions that would make severe braking responsive actions dangerous, the detection and analysis of potential threats can be automatically modified and/or overridden so that earlier activation and more gradual adjustments to the vehicle's speed and steering are made.
- a vehicle speed bias (Block 250 ), as well as a temperature bias (Block 264 ) and an object movement speed bias (Block 262 ), are factored into the step of analyzing the outputs(s) of the IR sensors 106 and motion algorithms, which are already active and searching for and/or detecting qualified targets 108 (Block 206 ).
- the threat detection process from FIG. 3 and as described above, is represented in FIG. 4 by Block 240 .
- the adjustment of the vehicle's operation can take the form of one or more of a braking activation (Block 254 ), a visual alert (Block 256 ), an aural alert (Block 258 ) and an override and adjustment of the vehicle's steering (Block 260 ).
- the system 10 of the present disclosure is designed to be an adjunct to other sensors and guidance systems, especially during times of challenging ambient conditions, and as such would enhance an autonomous vehicle's guidance system.
- optional IR sensors 106 R and 106 L that are located on each side of the vehicle 100 with a forward-looking bias would aid in enhancing the detection of potential threats on the side of the roadway 104 ahead of the vehicle 100 , as illustrated in FIGS. 5-6 . That is, the system 10 could identify an object on the side of the upcoming roadway 104 , determine if it is moving toward the roadway 104 and at what speed, and assess whether responsive action would be needed by the time the vehicle 100 approaches the detected human thermal signature's anticipated location.
- the system 10 of the present disclosure potentially functions even more efficiently at night due to the typically expected greater thermal contrasts between ambient background and detectable targets, especially humans.
- the use of cooling elements for the infra-red imager(s) would further enhance the sensor's temperature discrimination ability.
- FIG. 7 an IR lateral detection process using the system 10 in accordance with the present invention is illustrated.
- the process shown in FIG. 7 is similar to the lateral threat detection process discussed above in connection with FIG. 3 and, therefore, steps 200 through 228 , which are the same as those discussed in connection with FIG. 3 , will not be described in detail.
- the process proceeds to Block 266 for determining whether an animal thermal signature of an animal (non-pedestrian) is detected. If no animal thermal signature is detected at Block 266 , the process proceeds to Block 204 for further operating and monitoring of thermal signatures.
- Block 268 determines if the vehicle 100 is moving greater than a predetermined speed or velocity. If the vehicle 100 is not moving greater than a predetermined speed or velocity, the process proceeds to Block 204 for further operating and monitoring of thermal signatures. If the vehicle 100 is moving greater than the predetermined speed or velocity, the process proceeds to block 270 to determine a potential intercept solution. If the speed and direction (or velocity) of the encroaching animal (e.g. deer) results in a calculated vector of the animal's estimated future position that is in conflict with the vehicle's 100 estimated future position, then the system proceeds to Block 226 to adjust vehicle operation to avoid contact with the animal.
- the speed and direction (or velocity) of the encroaching animal e.g. deer
- the system may immediately apply the vehicle's brakes and/or override steering of the vehicle in an effort to remove a potential intercept between the vehicle and the animal's path. If the distance from the animal, the animal's heading and/or movement speeds of the vehicle 100 and animal indicate that vehicle 100 will “miss” the animal, then the process proceeds to Block 204 for further operating and monitoring of thermal signatures.
- the vehicle 100 may optionally activate horn and/or lights to alarm the animal in an effort to prevent the animal from entering the vehicle 100 travel path or remaining in the vehicle 100 travel path.
- the thermal gate may be centered about a thermal profile of a specific animal, such as deer, moose, bears, cows, pigs, horses, giraffes, camels, etc.
- the thermal gate is configured to detect a plurality of different animal thermal signatures.
- the thermal gate may be a dynamic thermal gate and/or be configured to detect a thermal signature centered approximately around 104° F., for example, in a range of 103° F. to 105° F. or 99° F. to 109° F., which is indicative of a deer.
- the thermal gate may be configured based on the species, health, season and breeding fluctuations of the deer. As discussed above, the thermal gate center point and thermal window may be dynamically skewed depending on ambient temperature.
- a passive infra-red pedestrian and animal vehicle avoidance system may be configured to optimize vehicle safety for autonomous, semi-autonomous and/or non-autonomous vehicles.
- the system may be additionally configured and/or optimized for animal behavior which is different than pedestrian behavior.
- the system may be optimized for detection and avoidance of deer, which may move at higher rates of speed than pedestrians, for example, up to 30 MPH.
- a system 10 equipped vehicle 100 may be traveling at highway speeds (e.g. 55-70 MPH) and be able to detect and initiate preventative measures for avoiding impact and/or mitigating the potential damage of an impact. Collisions with large and heavy animals at speed can be disastrous for a vehicle's occupant(s).
- such collisions may be avoided or mitigated in accordance with the present disclosure by being configured to detect, warn and/or avoid specific animals.
- Operation of the automatic fever detection system begins at block 700 where passive thermal emission detection scanning starts.
- thermal parameters are selected for setting an alarm thermal range.
- Thermal parameters may include, but are not limited to, a thermal acceptance window center temperature, one or more windows about the thermal acceptance window center temperature, and/or one or more window widths.
- the scanning process may further optionally be modified at block 702 to normalize a sampled group detected by the scanning, and the normalized group temperature of this sample group may be used as input to set the alarm thermal range at step 701 .
- the processor searches for any “qualified” pixels representing elevated body temperatures at block 703 .
- a qualified pixel is a pixel that represents a temperature outside the one or more windows set at block 701 and, if applicable, as modified at block 702 for normalization.
- An elevated temperature is a thermal signature detected through scanning that is above the one or more windows about the thermal acceptance window center temperature. If no qualified pixels are detected or if the number of qualified pixels detected is below a predetermined pixel threshold value, then the process proceeds to block 704 and scanning for qualified pixels continues.
- the methods and systems may be configured to be adjustable for a “center” point of each window, a ⁇ temperature range “skew” of each window, and/or a “width” of each window.
- the center point of a thermal window may have ⁇ X/+X degrees of deviation or ⁇ Y/+Z degrees of deviation about a center point.
- the process proceeds to block 705 where the individual(s) corresponding to the qualified pixels are annotated on one or more device interfaces, such as, for example, a display device configured to display images or video detected by a visible wavelength camera or other sensor. Then the process proceeds to block 706 and optional audio alarms on or associated with the device interface(s) are activated, such as through a speaker or the like. Audible notifications or indications may be advantageous when the display device is not being actively monitored by an operator (or an administrator or other user).
- the process then proceeds to block 707 to begin optional image documentation and/or video documentation (or video recording) of the individual(s) identified as having the elevated body temperature.
- the image and/or video may always be documented, e.g., recorded, and the portions with the individual(s) detected as having qualified pixels may be copied and sent to a monitoring database, flagged, or timestamp recorded for future reference, if necessary.
- an image from the visible wavelength camera may be paired or associated with a thermal record or thermal image from the passive thermal emission detector or sensor for each individual detected by the camera and detector/sensor. Accordingly, an operator or administrator can later view the associated record(s) of an individual and recognize which individual is associated with the thermal signature, e.g.
- the image(s) and/or video may be provided to facial recognition software or other identification processing methods and systems, e,g. methods and systems for obtaining individual identification information from a pre-issued identification or entry authorization, including but not limited to passports, driver licenses, boarding pass information, etc., as is discussed in greater detail herein.
- the system may automatically alter or allow the thermal window to be manually altered in order to normalize the center and width of the thermal acceptance window based on a plurality of previously detected thermal signatures.
- the thermal acceptance window may be manually altered in the system by an operator when conditions warrant a different thermal window range and/or width, such as when weather conditions or interior air temperature, pressure, and/or humidity conditions would make it difficult to detect elevated body temperatures.
- the thermal acceptance window may be skewed to bias the temperature acceptance window exclusively toward the “above normal” direction.
- a group of individuals 800 is shown traveling across the field of vision 801 of the thermal sensor array assembly 802 .
- the system 810 comprises at least one forward-looking passive infra-red (or PIR) thermal image sensor or sensor array 802 mounted at a fixed location and directed toward the individuals 800 as the individuals 800 move past the system 810 in the field of vision 801 .
- PIR passive infra-red
- a display device 900 being operatively connected to the system 810 of FIG. 8 is showing a representative condition where the system 810 has detected and annotated an individual 901 that has been detected as having an abnormally elevated body temperature indicative of an active viral or bacterial infection (or other pathogen).
- an audible notification alarm speaker 902 may become active as well, to ensure that a system operator (or administrator or other user) monitoring the system 810 is notified of the individual(s) having the elevated temperature in case the system operator (or administrator or user) is looking away from the display device 900 .
- Time is often of the essence in not only detecting active cases of deadly viruses or other infections at a point of entry into a country, area, hospital, public venue, or other location, but also the need for fast identification of persons that have been potentially infected by individuals that enter the country with an incubating and non-detectable condition.
- the AFDS has the capability to continually (or substantially continually) or periodically average the body temperatures of arriving individuals to arrive at a mean body temperature for the group, and then detect those individuals that exhibit body temperature higher than a predetermined amount relative to the group temperature.
- the system may be configured to generate an alert that the group as a whole is detected as having elevated body temperatures, which an operator may determine is an indication that the group as a whole is infected.
- the detection of abnormal temperatures may be used to detect arriving individuals to a country through immigration control.
- the detected thermal profiles of individuals are paired with the identification of said individuals in order to generate paired identification/visual image information records.
- the paired information may be used in real-time applications, but also may be stored for use with subsequent comparisons of future thermal detection sessions of each individual having paired information stored, which may be automatically compared and analyzed. As an example, if a person were thermally scanned on Monday and a subsequent thermal scan was done on Tuesday which showed a statistically significant temperature variation and/or a series of temperature rises, the system would note said variation, generate a report, provide a notification, and/or otherwise flag the individual as exhibiting an abnormal temperature (for that individual) even though the recorded temperatures were outside of commonly used temperature definitions of a human “fever”.
- One or more AFDSs may be located at entrances to office buildings, transportation facilities, hotels, schools, businesses, arenas, prisons, hospitals (either at entrances or in clinician's offices), or other spaces or locations where multiple individuals may have close contact with one another.
- Conventional facial recognition software may be utilized in conjunction with the AFDS(s) to provide an individual identification basis.
- the sensor 802 may be an integrated visible wavelength camera and passive infra-red sensor or, alternatively, the visible wavelength camera may be separate from the sensor 802 and both the camera readings and the passive infra-red sensor 802 readings may be transmitted to a processor of the AFDS.
- the identification information obtained from such item(s) may be automatically or manually passed on to the AFDS, paired with a contemporaneous thermal reading, and then forwarded to a central processing facility of the AFDS.
- the system may then file each individual's record, and if there existed one or more existing records for that individual, the system would add subsequent records to that individual's file, and may then make a comparison to the one or more previous thermal records from that individual in order to determine if there was a thermal difference that could indicate a rising (or falling) temperature that would fit a pre-determined criteria for further analysis, processing, alarm notification, and/or other action.
- the AFDS includes a processor that is operatively connected to the sensor or integrated camera sensor 802 , camera, interface devices 900 , one or more databases and central storage and processing facility.
- the processor may be physically connected to the elements the processor is in operative connection with, or the processor may be physically separate from those elements but operatively connected through one or more wireless and/or wired communication systems.
- the process may be contained within a computer or display device and wireless connected to integrated camera sensor 802 .
- the systems, methods and devices according to embodiments of the present disclosure provide an automatic means for instantly (or nearly instantly) detecting individuals with elevated body temperatures via specifically-selected and filtered thermal wavelengths that are characteristic of people with elevated skin (or body) temperatures as they are walking by, laterally crossing, or stationary in front of the sensor(s) and camera(s).
- the AFDS according to the present disclosure advantageously avoids or mitigates drawbacks associated with thermally scanning individuals via manual means, which is fraught with deficiencies.
- the manual thermal scan operator has no ability to properly judge an individual's normal or healthy body temperature relative to that temperature which would represent a true elevated body temperature for that individual at least because each individual's normal body temperature can vary relative to that of another individual making such wild (non-contextual) temperature measurements lacking in substantively useful diagnostic value.
- the method of manual spot scanning does not provide for any additional or ongoing continual monitoring of the temperature change of an individual and, therefore, the manual spot scanning may completely miss the detection of infected individuals in the early stage of infection.
- the methods and systems according to the present disclosure provide for improved detection of individuals experiencing elevated body temperatures.
- the AFDS may be configured to go beyond the one-time, generalized fever determination and, instead, may look for a true contextual elevated temperature change with that same individual over time, thereby generating individualized thermal assessments for specific individuals over time, regardless of their normal temperature range.
- the AFDS may advantageously be configured to simultaneously pair each thermal scan of an individual with corresponding identity information that is self-determined by the AFDS and/or is confirmed or provided by external data sources or databases.
- Each thermal scan may be recorded and stored, thereby generating a dynamic library of thermal scans performed for each individual scanned by the system, which subsequently allows for either a manual or automatic thermal comparison to be done for the purpose of detecting an elevated body temperature change based on comparing the latest thermal scan with one or more prior scans or based on an average of prior scans. If a thermal scan is the first for that individual to be stored by the system, and thus there is no prior scan for that individual to be compared to, then a generic thermal profile may be temporarily used to determine if that individual is presenting with an elevated body temperature condition.
- the identification information for an individual being scanned may be obtained either through onboard commonly used facial recognition software program(s), or by ingesting identification information presented by the individuals themselves as part of an entry process. Such information may be presented to, and then forwarded to, the AFDS by passport readers, identification card or badge readers, entry ticket readers, building pass readers, driver's license Information, or the like.
- a thermal reading is successfully paired with identification information (or identity information), it is recorded and passed along to a Central Processing Facility(s) for storage and analysis.
- Said storage may take place on-site, off-site, in a cloud database or computing service, and/or at other locations. In some embodiments, the storage and analysis may occur at a single location or at multiple locations, in some embodiments even simultaneously in multiple locations.
- the analysis may include one or more processors of the system comparing any prior thermal signatures stored over time from an individual to determine a normal temperature for that individual. Typically, the most recent thermal signature detection would be compared to the most recent prior thermal signature detection, but may also be compared to an average of prior thermal signature detections (or readings).
- thermal signature detection results in a variation from the normal reading beyond a predetermined threshold, or a continuing series of increased temperature rises even if still below the strict “fever” definition criteria, the most recent reading is flagged and sent on for further analysis or processing.
- additional information such as time and date of the detection, the location of the thermal reader performing the detection, the identity of the individual, a bus, ship, train or flight number associated with that time period, or the like may also be stored with the thermal signature detection and stored in a database for future reference or use and is appended to the record.
- the AFDS may also be configured to determine whether there are any clusters of elevated temperatures among numerous individuals, which may be determined and/or sorted by various criteria such as location of the thermal readings, age of the readings, personal data such as flight history, etc. In this way, there can be a near real-time determination of an infectious cluster spread in a highly automated and time-efficient manner.
- Operation of the automatic fever detection system begins at block 1002 where passive thermal emission detection scanning with one or more thermal AFDS scanners starts.
- the system generates a thermal record of one or more individuals.
- identification information is associated with or added to the thermal record. The identification information is received from facial recognition software processing systems or methods at block 1008 and/or received from external identification system output(s) at block 1010 as discussed above.
- an identified thermal record is generated for each individual of the one or more individuals.
- the identified thermal record is stored as discussed above.
- the method proceeds to block 1016 , where it is determined if the Central Processing Facility(s) contain a library of identified thermal records for each individual. If no library exists for the individual, the method proceeds to block 1018 to generate a new record file library for each individual, and then to block 1020 to add or store the identified thermal record for each individual in their respective new file library. Since there are no prior thermal records to compare the most current thermal record for the individual(s) with no prior thermal records, the system may compare the thermal records of those individuals with a thermal template in order to determine whether the thermal record fits a general indication of an elevated skin or body temperature as discussed above, and an alarm may be activated if applicable.
- the method proceeds to block 1022 and adds or stores the identified thermal record for each individual in their respective existing record file library. Then the method proceeds to block 1024 to compare the most current identified thermal record generated at block 1012 with one or more previously stored thermal records for the individual.
- the system determines whether the most current identified thermal record indicates a skin or body temperature increase for the individual. If it is determined that the skin or body temperature did increase, an alarm is activated at block 1028 as discussed above. If it is determined that the skin or body temperature did not increase, the method ends at block 1030 , or returns to scanning individuals at block 1002 (or is continuously scanning individuals while performing other steps of the operating method).
- the determination 1026 begins at block 1032 where it is determined whether the current thermal reading indicates a temperature increased above a predetermined threshold (e.g. above 100° F.). If it is determined the temperature increased above the predetermined threshold, then the method proceeds to activate an alarm at block 1028 . If it is determined that the temperature did not increase above the predetermined threshold, the method proceeds to block 1034 to determine whether the indicated temperature of the individual increased from a temperature indicated by a prior thermal record or average of prior thermal records by an amount greater than a predetermined amount (e.g. an increase in an amount of 2.0° F. or more).
- a predetermined threshold e.g. above 100° F.
- the method proceeds to activate the alarm at block 1028 . If it is determined that the temperature increase was greater than the predetermined amount, the method proceeds to activate the alarm at block 1028 . If it is determined that the temperature increase was not greater than a predetermined amount, the method proceeds to block 1036 to determine whether the indicated temperature of the individual constitutes an increase with a rate of change in conjunction with indicated temperature(s) from one or more prior thermal records that is greater than a predetermined rate of change (e.g. if the individual's temperature is increasing at a rate of change of 0.5° F. per day or 0.5° F. per thermal scan). If it is determined that the rate of change of temperature for the individual is greater than the predetermined rate of change, the method proceeds to activate the alarm at block 1028 .
- a predetermined rate of change e.g. if the individual's temperature is increasing at a rate of change of 0.5° F. per day or 0.5° F. per thermal scan.
- the method ends at block 1030 , or returns to scanning individuals at block 1002 as discussed above.
- the determination at block 1036 may also be configured to proceed to activate the alarm at block 1028 if the rate of change persists for a number of consecutive or successive readings indicating a rising body skin or body temperature greater than a predetermined number of consecutive (successive) readings, even if the rate of change is not greater than the predetermined rate of change, or the absolute temperature readings do not indicate a “formal” definition of a fever in a human. For example, if the individual is recorded as having a rising temperature rate of change three or more consecutive times in a single day, or a rising temperature for three consecutive days.
- the predetermined number of consecutive (successive) readings is configured to be adjustable by an operator or administrator.
- the determination at block 1026 may comprise all three determinations at blocks 1032 , 1034 , 1036 . In some embodiments, the determination at block 1026 may comprise only one or two of the determinations at blocks 1032 , 1034 , 1036 . It should be readily understood that the order of the determinations at block 1032 , 1034 , 1036 may be in any order.
- the determinations at blocks 1034 , 1036 may be configured to activate “pre-alarms” when the alarm is activated at block 1028 . These alarms would be “pre-alarms” because the individuals with temperatures that result in a “yes” determination at blocks 1034 , 1036 do not yet exhibit an absolute temperature that would indicate a fever or elevated skin or body temperature (e.g.
- the Central Processing Facility(s) may be co-located on-side, e.g. in the case of a facility housing a large number of employees, workers, or visitors, or the records may be optionally forwarded in real-time to one or more off-site storage and processing facilities that receives records from numerous locations and other storage and processing facilities.
- a computer readable storage medium may store thereon instructions that when executed by a machine, such as computer, result in the performance according to any of the embodiments described herein.
Abstract
A passive infra-red automatic fever detection system and method for identifying individuals presenting a thermal profile indicative of an abnormally elevated body temperature, either after an initial thermal reading or after the initial thermal reading and one or more subsequent thermal readings. The system and method may be configured for automatic detection, notification, and alarming of individuals with elevated body temperatures that may be indicative of an infection.
Description
- This application is a continuation-in-part application of U.S. patent application Ser. No. 16/673,295, filed Nov. 4, 2019, which is a continuation-in-part application of U.S. patent application Ser. No. 16/354,833, filed Mar. 15, 2019, which claims the benefit of U.S. Provisional Patent Application No. 62/670,209, filed May 11, 2018, each of which is incorporated herein by reference in its entirety.
- The present disclosure generally relates to systems and methods for identifying an individual(s) with elevated temperature that may be indicative of a contagious condition (viral, bacterial or other pathogen) in an individual(s) that may pose potential infection danger to other individuals that may be in proximate distance with an incubating or infected individual(s).
- Current fever detection methods typically rely on a designated person(s) thermally scanning individuals in a manual sequential manner in an attempt to detect only those individuals that exhibit an elevated body temperature as an indication of possible virus infection. Because this approach is dependent on being carried out by the designated person(s), it is fraught with vulnerabilities such as the designated person(s) being swarmed and overwhelmed by a large crowd, potentially missing the scanning of small children while being focused on their parents, etc. Furthermore, said manual scanning methods only result in a snapshot detection opportunity and may greatly miss an individual already infected but not yet presenting an elevated body temperature.
- The present disclosure provides an Automatic Fever Detection System (AFDS) having a passive infra-red based thermal detection system. The system is configured for automatic passive thermal detection of a thermal signature indicative of an elevated human body temperature. The system provides a superior approach to the detection and identification of individuals exhibiting elevated thermal profiles from among a plurality of individuals even when the individuals exhibiting the elevated thermal profiles are amongst a large, moving crowd of people.
- The present disclosure utilizes at least one forward-looking passive infra-red (PIR) image sensor mounted in a fixed position relative to the movement of passing humans.
- In operation, the system in accordance with the present disclosure provides an automatic means for instantly (or nearly instantly) detecting specifically-selected and filtered thermal wavelengths that are characteristic of humans that have elevated skin (or body) temperatures above what is expected for a healthy human (typically about 98.6° F.) as they are walking or otherwise moving by or laterally crossing the sensor(s) detection field. Since the body temperature for a healthy human may not be exactly 98.6° F. (e.g. may be 98.4° F.), the system may be set with a pre-defined range for what is considered the body temperature for a healthy human (e.g. 98.1° F. to 98.9° F.), and/or the system may be configured with any other predetermined temperature or range of interest set by an administrator of the system. This information may be used to provide an augmented video and/or warning on a display screen. The video may show the positions of the individual or individuals with and/or without a detected elevated temperature and augment the video by providing graphical images, annotations and/or highlighting to identify individuals with and/or without an elevated temperature. Audible alerts may also be provided, as well as automatic video recording of any individual that triggers an alert condition.
- Unlike conventional thermal detection systems, which require one or more designated person(s) or operator(s) to be in close contact with selected individuals having their temperatures measured (which presents a secondary infection danger to said operator(s)), an AFDS in accordance with the present disclosure allows multiple individuals to be scanned at the same time and at a safe distance from the operator. Further, unlike conventional systems that utilize fixed thermal displays that do not provide automatic annotation of specific elevated temperature individuals, the AFDS of the present disclosure does not require an operator to constantly watch a display to identify individuals with elevated temperatures from amongst a moving crowd.
- Another feature of the AFDS in accordance with embodiments of the present disclosure provides for the normalization of expected body temperatures in groups of individuals that have been traveling together and have been subjected to similar ambient conditions such as temperature, atmospheric pressures, and humidity as well as similar limits of physical activity (e.g. limited mobility within an aircraft). The AFDS has the capability to continually (or substantially continually) average the body temperatures of a number of arriving individuals to arrive at a mean body temperature for the group, and then look for those individuals that exhibit statistically higher body temperature relative to the normalized group temperature. The normalized temperature figure may also be used to set or adjust the expected mean-normal temperature of the system's thermal acceptance window, as well as set or adjust the system's thermal acceptance window width. In the event the system detects a statistical anomaly such as when a normalized group mean temperature rises above a set expected value, the system warns the operator for the potential of an infected group as a whole.
- Although the AFDS has been exemplified in a transportation setting, AFDSs according to the present disclosure may also be located and employed in a variety of other settings, such as schools, universities, shopping malls, hospitals, arenas, office buildings, or any other spaces where multiple individuals have close contact with one another and may need to be monitored.
- Objects, features and advantages of the present disclosure will become apparent in light of the description of embodiments and features thereof, as enhanced by the accompanying figures.
-
FIG. 1 provides an illustration of a vehicle on a roadway using the system in accordance with the present disclosure to detect direct or lateral human threats to the vehicle. -
FIG. 2 provides a schematic of a first embodiment of a passive infra-red pedestrian avoidance system in accordance with the present disclosure. -
FIG. 3 provides a flow chart generally illustrating an embodiment of a lateral threat detection method in accordance with the present disclosure. -
FIG. 4 provides a flow chart generally illustrating another embodiment of a lateral threat detection method in accordance with the present disclosure. -
FIG. 5 provides an illustration of a vehicle on a roadway using the system in accordance with an alternate embodiment of the present disclosure to detect lateral threats to the vehicle. -
FIG. 6 provides a schematic of a second embodiment of a passive infra-red pedestrian avoidance system in accordance with the present disclosure. -
FIG. 7 provides a flow chart generally illustrating an embodiment of a lateral threat detection method in accordance with the present disclosure. -
FIG. 8 provides a flow chart generally illustrating an embodiment of a method of operating an Automatic Fever Detection System in accordance with the present disclosure. -
FIG. 9 provides an illustration of an Automatic Fever Detection System in accordance with an embodiment of the present disclosure. -
FIG. 10 provides an illustration of an Automatic Fever Detection System in accordance with another embodiment of the present disclosure. -
FIG. 11 provides a flow chart generally illustrating an embodiment of a method of operating an Automatic Fever Detection System in accordance with the present disclosure. -
FIG. 12 provides a flow chart generally illustrating a portion of the method shown inFIG. 11 in accordance with the present disclosure. - Referring to
FIGS. 1-2 , a first operational mode of a passive infra-red pedestrian avoidance system in accordance with the present disclosure is illustrated. As illustrated inFIG. 1 , avehicle 100 generally travels within atravel lane 102 on aroadway 104. The system, generally designated byreference numeral 10, comprises at least one forward-looking passive IR image sensor or sensor array, generally designated asreference numeral 106, mounted on thevehicle 100 and directed outwardly in front of thevehicle 100, as thevehicle 100 moves, so that the IR sensor(s) 106 can detect any stationary or moving object(s) 108 containing a human thermal profile in the vehicle'stravel lane 102, or in the process of heading towards the vehicle's predicted pathway. - In preferred embodiments of the present disclosure, as generally illustrated in
FIG. 1 , a single, forward-lookingIR sensor 106 is mounted on thevehicle 100, preferably on the front of thevehicle 100, and more preferably centered on the front of thevehicle 100 so that it can detectmoving objects 108 relative to both sides of thevehicle 100 on the left and right edges of theroadway 104 ahead of thevehicle 100, as well as anyobject 108 moving or stationary, already in the vehicle's path. Such a forward-lookingIR sensor 106 could dynamically vary the number and area of sensor pixels analyzed depending on a vehicle's forward speed. At higher speeds, animage processor 110 associated with theIR sensor 106 could prioritize the central region of thesensor 106, but as the vehicle's speed decreases, the number and area of pixels analyzed can be increased to effectively widen the sensor's field area(s) of interest. At low speeds, the area of analysis would generally cover a relatively close range in front of thevehicle 100—about 10 to 20 feet in front of thevehicle 100 effectively representing a range from theIR sensor 106 of approximately ±45 degrees from the centerline of thevehicle 100, so as to be able to image the left and right sides of theroadway 104 ortravel lane 102 ahead of the movingvehicle 100. Optimally, eachIR sensor 106 has a relatively large pixel array in order to effectuate dynamic fields of reference, for example, at least 640×480, from which laterally moving objects can be discerned in accordance with the present disclosure. The number and area of sensor pixels for the thermal acceptance window can also be dynamically varied depending on ambient temperature or weather conditions, roadway conditions, or movement of the object relative to the vehicle. - In alternate set-ups of the thermal imaging sensor assembly provided on the
vehicle 100, multiple forward-lookingIR sensors 106 can be mounted to thevehicle 100, preferably on the front end thereof.Such IR sensors 106 can functionally operate in an independent, over-lapping and/or redundant fashion with each other. In an embodiment of the present disclosure as illustrated inFIGS. 5-6 , thevehicle 100 may include a dedicated right-side IR sensor 106R—directed toward the right edge of the roadway/travel lane ahead of thevehicle 100 in a forward-looking manner—and a dedicated left-side IR sensor 106L—directed toward the left edge of the roadway/travel lane ahead of thevehicle 100 in a forward-looking manner. In such an embodiment, thesensors vehicle 100, or alternately, on the lateral sides of thevehicle 100, but directed forwardly from thevehicle 100 so as to detect objects ahead of the movingvehicle 100. More preferably, thesensors vehicle 100 in a predictive fashion while also accommodating the movement and speed of thevehicle 100, and further taking into account possible or likely responsive actions thevehicle 100 can take upon detection of a laterally moving threat. - In yet another embodiment, the
vehicle 100 can be provided with a combination of front andside IR sensors 106, each still preferably forward-looking, to optimize the detection areas of the system. Again,such IR sensors 106 can functionally operate in an independent, over-lapping and/or redundant fashion with one another. The use ofmultiple IR sensors 106 can also assist in compensating for variable vehicle speed and ensure that actual and potential threats are quickly identified regardless of the speed of thevehicle 100, the speed of theobject 108, the ambient lighting conditions, roadway conditions, or weather conditions. - The discussion of IR sensors and IR sensor array in regards to the present disclosure are intended to be interchangeable, and each embodiment in accordance with the present disclosure covers scenarios using a single sensor as well as an array or set of sensors operating to a collective end of monitoring the lateral sides of the roadway/travel lane ahead of the moving
vehicle 100 for potential threats to thevehicle 100, such as pedestrians walking in front of thevehicle 100. - Referring to the schematic illustrated in
FIG. 2 , theIR sensors 106 are in operative communication with animage processor 110, such as a video processor, tied into the operational system of thevehicle 100, such as via a centralCAN Bus unit 112. Preferably, the CAN Bus 112 is in constant communication with various vehicle sensors, such as theIR sensors 106, for analysis and output processing, preferably immediately in real-time, based on the detected data. Theimage processor 110 filters out any object that is outside a narrow or predefined thermal acceptance window indicative of a normal human thermal profile (e.g., about 98.6° Fahrenheit) before analyzing whether any thermally detected objects are in or are about to enter theroadway 104. The acceptance window can be dynamically widened or narrowed, and/or the thermal center point shifted in accordance with ambient temperature or weather conditions, roadway conditions, lighting conditions, vehicular speed, etc. - In operation, a method for identifying laterally moving dangers for a moving
vehicle 100 and adjusting operation of thevehicle 100 accordingly comprises first detecting anobject 108, associated with a human thermal signature, on the side of, on a path towards, or already within theroadway 104 along a predicted pathway of thevehicle 100, using thermal imaging (e.g., theIR sensors 106 and the image processor 110). Upon detection and subsequent selection of qualifying objects 108, or potential “threats”, thesystem 10 first determines how many qualified pixels meet the target criteria, as dynamically modified by the vehicle's forward travelling speed. The rate of target pixel change, relative to the vehicle's forward travelling speed, determines how close thevehicle 100 is to apotential object 108. Thesystem 10 then determines if theobject 108 is already in the roadway travel lane(s) 102, or moving in a direction toward the roadway travel lane(s) 102, and at what speed, and assesses the need for responsive action in the vehicle's operation. - While the
system 10 normally tracks movement of anobject 108 relative to thevehicle 100 that has already met the human thermal characteristics, theimage processor 110 is also capable of operating in an alternate mode whereby if thequalified object 108 is not moving relative to thevehicle 100, but thevehicle 100 is heading directly toward a stationaryqualified object 108, theimage processor 110 will count the number of contiguous pixels in a grouping that have met the human thermal profile criteria (“qualified pixels”) and consider that increasing numbers of qualified pixels as movement towards aqualified object 108. The numeric threshold of said qualified pixels that are needed to trigger any responsive action(s) may be dynamically changed by theimage processor 110 in response to the vehicle's speed and/or the location of the qualified pixels on the sensor array. - If responsive action is identified as being needed, the
system 10 triggers such responsive action in the vehicle's operation, such as by providing adjustment input to the vehicle'ssteering system 114; activating the vehicle'sbraking system 116; sounding anaudible alert 118 associated with thevehicle 100, such as activating the vehicle's horn; and/or activating avisual alert 120 associated with thevehicle 100, such as flashing the vehicle's headlights. For manually drivenvehicles 100, additional interior audible alerts, haptic feedback, and/or alerts displayed in front of the driver on the windshield could also be provided. - The step of determining if the human thermal signature is moving in a direction potentially converging with the
vehicle 100, for example, with the vehicle's predicted pathway based on direction and speed of thevehicle 100, can involve first, determining if the human thermal signature is moving or stationary upon initial detection thereof; then, determining, if moving, whether the direction of the human thermal signature is generally perpendicular to theroadway 104; and then, determining if the movement is toward theroadway travel lane 102. The step of assessing whether there is a need for responsive action includes determining the speed and direction of movement of thetarget 108 and/or by determining if thetarget 108 is within close range of, or already in, the vehicle's predicted pathway. For example, thesystem 10 can note an increasing number of contiguous qualified thermal pixels reaching a numerical threshold, indicating a proximity reactive threshold. In this regard, other factors can be analyzed, such as ambient temperature, weather conditions, road conditions, vehicle speed, and the like, to modify the reactive algorithm threshold, as described in more detail below. - While generally described herein for use in connection with autonomous—or driverless—vehicles, the
system 10 of the present disclosure can also be used in driven vehicles, either having a quasi-autonomous mode or as a back-up redundancy to the human operator. For example, the detected human thermal signature information and suggested corrective action may be provided, for instance, as a “heads up” or overlaiddisplay outline 122 on a drivenvehicle 100, or as a data input to the navigation andautomatic braking systems vehicle 100. The driver may be able to adjust the vehicle's position and speed manually, or in the alternative, thevehicle 100 may automatically adjust the vehicle's position, speed, and braking based on such continuous monitoring of any laterally moving threats to the vehicle's operation. If thesystem 10 detects reactive driver input(s), it can then focus on warning the detected target(s) through the audible andvisual signaling systems - As noted, the
image processor 110 can also be used to detect the presence of human thermal profiles on the side of theroadway 104, and more importantly, when such humans traverse onto theroadway 104 itself. More preferably, theimage processor 110 using thesystem 10 in accordance with the present disclosure, can not only detect the presence of atarget object 108 on the side of the roadway/travel lane using thermal imaging, but also determine if theobject 108 is moving, in what direction, and at what speed, and adjust operation of thevehicle 100 accordingly. In determining if responsive actions are needed for safe operation of thevehicle 100, as well as what responsive actions are available, thesystem 10 can predict if a detected human thermal signature is likely to be struck by thevehicle 100 by also taking into account the speed and location of thevehicle 100 relative to the detected human thermal signature; the location of thevehicle 100 on the roadway 104 (e.g., outer lane or inner lane on a multi-lane roadway); the location of thevehicle 100 within aparticular travel lane 102; and ambient weather conditions that would potentially impact reaction times for the system and the level of braking force, mindful of distances required to react to a situation properly. - In accordance with the present disclosure, a simultaneous analysis mode, as illustrated in
FIG. 3 , is available for anautonomous vehicle 100. In operation, thesystem 10 uses a proprietary algorithm to initially detect the location ofobjects 108 possessing a human thermal signature (e.g., pedestrians, bystanders, bikers, wheelchairs with human occupants), namely, objects exhibiting a thermal signature that is plus/minus the “nominal” human body temperature of 98.6° Fahrenheit. The algorithm then determines if the detected human thermal signature in said thermal range is already located in, or is moving within, or towards the vehicle's travel area (which would be indicative of a pedestrian or biker), or is maintaining travel in a safe manner within designated bicycle lanes, or at the side of the road for instance. If both the temperature and conflicting movement criteria are simultaneously met, then a logic circuit output will automatically trigger a responsive action in anautonomous vehicle 100, such as activating a vehicle'sbraking system 116 and/or biasing thesteering control system 114 to redirect thevehicle 100 away from the impinging or potentially impingingobject 108. Additionally, upon mode activation, thesystem 10 may activate the vehicle'shorn 118 andlights 120 in a distinctive manner to visually and aurally alert and warn distracted pedestrians (such as those looking down at their mobile devices), visually impaired pedestrians, and children running after an object in the roadway, etc. A further implementation of thesystem 10 would also transmit a warning signal via Bluetooth, V2P, or other signaling means to area mobile devices that are so equipped to receive such safety signals. - In operation, the
image processor 110 is specifically looking for and determining whether there is either perpendicular or diagonal movement of human thermal signatures that are about to and/or are in the process of impinging on the upcoming roadway surface of a movingvehicle 100, or stationary human thermal signatures that are existing within theroadway 104 ortravel lane 102, while concurrently ignoring strictly parallel “body temperature” movement such as would be typical of bikers or pedestrians walking or biking with traffic along sidewalks or roadway edges or shoulders. These parallel movement(s), unless already located in, or potentially heading into a travel lane or area of pedestrian/vehicle conflict, would lock-out the image processor's output to the vehicle's steering and braking systems so as to avoid untimely or premature triggering of thebraking system 116, or untimely or premature steering adjustments by thesteering system 114. Detection of thermal objects outside of human thermal signatures would generally be ignored, as these objects would be flagged by other detection systems, such as LIDAR or proximity sensors, which would trigger an appropriate response from those systems based on criteria other than a human thermal profile. - Referring to
FIG. 3 , an IR lateral detection process using thesystem 10 in accordance with the present disclosure is illustrated. In preferred embodiments, thesystem 10 only turns on and operates when thevehicle 100 is turned on, and even more preferably when thevehicle 100 is moving. AtBlock 200, thevehicle 100 is turned on and thesystem 10 is activated, preferably in connection with the vehicle's ignition. AtBlock 202, thesystem 10 queries the vehicle's operating systems to determine whether thevehicle 100 is moving or not. If not, then thesystem 10 continues to query about movement on a loop until there is actual vehicle movement, as represented inBlock 204. Once thesystem 10 is informed that thevehicle 100 is moving, the outputs(s) of theIR sensors 106 and motion algorithms, which are already active and searching for and/or detectingqualified targets 108, are analyzed and allowed atBlock 206 to pass along the information to the vehicle's operational systems. As noted above, thevehicle 100 can include asingle IR sensor 106 positioned on the front-center of thevehicle 100 for detectingobjects 108 ahead that may be approaching the vehicle's path from straight ahead, as well as from both lateral sides of thevehicle 100, or in conjunction with twoIR sensors vehicle 100 for respectively monitoring both sides of theroadway 104 ahead of the movingvehicle 100 to detectobjects 108. - If thermal signatures are detected, then the
system 10 further determines atBlock 208 if the detected thermal object(s) is characteristic of a human thermal profile by passing through a dynamic qualifying thermal gate that is nominally centered around 98.6° F. If not, then thesystem 10 ignores the object and continues to search for and qualify other detected thermal signatures, again atBlock 204. If theobject 108 is, however, within the pre-determined human thermal range, it is then classified as a valid detected human thermal signature, and thesystem 10 then subsequently determines if said human thermal signature is moving, as indicated atBlock 210. If no movement is detected, and theobject 108 is outside of thetravel lane 102 or the vehicle's pathway (Block 212), then thesystem 10 continues to monitor this and other human thermal signature targets for changes in their movement status without informing thevehicle 100 to take operative action (Block 204). If no movement is detected, and theobject 108 is within thetravel lane 102, then thesystem 10 informs thevehicle 100 to take operative action such as holding its present position or adjusting vehicle operation, as necessary (Block 226). If no movement is detected, and theobject 108 is safely adjacent to, or within the edges or shoulder of thetravel lane 102, then the system takes no operative action. If movement is subsequently detected, then thesystem 10 determines the direction of the movement atBlock 214—e.g., is the movement of the human thermal signature parallel with the vehicle's present and predicted travel, moving away from the vehicle's travel path, or moving towards the vehicle's predicted travel path? In this regard, thesystem 10 first determines if the movement is parallel to thevehicle 100 at Block 216 (indicating, for example, a person walking or biking within a dedicated lane on the side of the road). If such movement is parallel, then thesystem 10 determines that the human thermal signature is not in immediate danger from the travel pathway of thevehicle 100 and returns to monitoring this and other thermal signatures for changes (Block 204). Thesystem 10 keeps tracking movement of the detected human thermal signature(s) (Block 218) to identify if its direction of movement shifts to one that could be considered a threat—e.g., a bicyclist turns into thetravel lane 102 to cross theroadway 104—until theobject 108 is no longer in the filed of view of theIR sensor 106. If such movement is detected, thesystem 10 re-assesses the actual threat level (Block 220) and determines if any responsive action is needed, as discussed below. - At this stage, where a human thermal signature has been detected and the
system 10 is determining if there is movement of the detected human thermal signature, thesystem 10 can utilize a dynamic lateral angle acceptance window to prevent any temperature-qualified slow-speed laterally moving objects outside the lateral angle acceptance window from falsely triggering thesystem 10. That is, the lateral angle acceptance window, in proportionality to the current speed of thevehicle 100 and the speed of the detectedhuman object 108, can eliminate potential threats that are too far away from the side of theroadway 104, or are calculated as to not present a future danger as thevehicle 100 passes by the detectedobject 108. The angle window is defined from the centerline of the movingvehicle 100—for example, ±45 degrees from the vehicle's centerline. More preferably, the width of the lateral acceptance window can proportionally adjust with the speed of thevehicle 100, such that the window is narrower at lower speeds and wider at higher speeds. - If movement is detected as generally perpendicular to the
roadway 104, then atBlock 220, thesystem 10 determines if the movement is moving towards or away from theroadway 104 to assess the threat level to the detected human thermal signature. If the movement is determined to be moving away from theroadway 104, or outside the vehicle's predicted pathway (Block 222), then the threat level is low and is disregarded by thesystem 10 as it continues to monitor for other qualifying thermal signatures and movements (Block 204). If the movement is determined to be moving towards theroadway 104 in a manner that is calculated to result in a vehicular collision with a pedestrian 108 (Block 224), thesystem 10 triggers, atBlock 226, one or more evasive action responses, including but not limited to activating the vehicle'sbraking system 116, providing direct input to and activating the vehicle's “Driver Assist”steering system 114, and/or providing visual and audio alerts, such as activating and flashing the vehicle'slights 120 and rhythmically sounding the vehicle'shorn 118. Again, if movement is determined to be moving away from the roadway 104 (Block 222), thesystem 10 can dismiss the detected human thermal signature as being no threat but can keep tracking the movement of the human thermal signature in case the speed and/or direction of movement changes, at which time the threat level can be reassessed. - For more accurate assessment of laterally moving detected human thermal signatures within the lateral acceptance window, an algorithm analyzes the detected human thermal signature's present location, direction of travel, and forward lateral speed relative to the vehicle's present location, travel direction, and forward lateral speed to determine whether the combined travel vectors will result in a collision.
- After triggering evasive action responses, as shown in
Block 226, thesystem 10 communicates with thevehicle 100 to return to a normal driving mode and again monitoring for thermal signatures, represented byBlock 228, essentially starting the process over again to be on the alert for the next unknown, unexpected, and unpredicted situation. - In operation, as the vehicle speed increases, the braking speed/braking force increases proportionally to be able to properly respond to a threat trigger in an optimized and appropriate manner. As a result, the
system 10 dynamically matches the timing of the vehicle's response system and activation thereof by taking into account both the real-time speed of the vehicle and the forward and lateral speed of any detected human thermal signature, as represented in the flow chart illustrated inFIG. 4 . For example, if thevehicle 100 is travelling at a high speed, thesystem 10 triggers responsive actions (such as braking and steering adjustments) more quickly and with faster responsiveness and braking effort than at slower travelling speeds. Similar proactive adjustments to the system's timing of responsive actions and reactive response level thereof can be made in bad weather conditions, such when snow or frozen precipitation are detected by the vehicle's temperature and rain sensors, or in other situations where there is potential for braking/steering impairment. Optimally, these sensor inputs adjust the system's responses to allow for an earlier (and more gentle) initiation of responsive actions so that severe response actions (such as a “panic” immediate stops) on a wet or frozen roadway can be avoided, if possible. That is, if thesystem 10 is aware of road conditions that would make severe braking responsive actions dangerous, the detection and analysis of potential threats can be automatically modified and/or overridden so that earlier activation and more gradual adjustments to the vehicle's speed and steering are made. - Referring to
FIG. 4 , a vehicle speed bias (Block 250), as well as a temperature bias (Block 264) and an object movement speed bias (Block 262), are factored into the step of analyzing the outputs(s) of theIR sensors 106 and motion algorithms, which are already active and searching for and/or detecting qualified targets 108 (Block 206). The threat detection process fromFIG. 3 , and as described above, is represented inFIG. 4 byBlock 240. Where a threat is detected and requires responsive action in operation of thevehicle 100, such adjustment of the vehicle's operation (Block 226) factors in the vehicle speed bias (Block 250) as well as a temperature/precipitation bias (Block 252), which may affect the vehicle's immediate adjustment. As further illustrated inFIG. 4 , the adjustment of the vehicle's operation can take the form of one or more of a braking activation (Block 254), a visual alert (Block 256), an aural alert (Block 258) and an override and adjustment of the vehicle's steering (Block 260). - The
system 10 of the present disclosure is designed to be an adjunct to other sensors and guidance systems, especially during times of challenging ambient conditions, and as such would enhance an autonomous vehicle's guidance system. - As noted,
optional IR sensors vehicle 100 with a forward-looking bias would aid in enhancing the detection of potential threats on the side of theroadway 104 ahead of thevehicle 100, as illustrated inFIGS. 5-6 . That is, thesystem 10 could identify an object on the side of theupcoming roadway 104, determine if it is moving toward theroadway 104 and at what speed, and assess whether responsive action would be needed by the time thevehicle 100 approaches the detected human thermal signature's anticipated location. - Unlike many optically-based guidance systems that have diminished effectiveness at night, especially in poorly light sections of the
roadway 104, thesystem 10 of the present disclosure potentially functions even more efficiently at night due to the typically expected greater thermal contrasts between ambient background and detectable targets, especially humans. Optionally, the use of cooling elements for the infra-red imager(s) would further enhance the sensor's temperature discrimination ability. - Referring to
FIG. 7 , an IR lateral detection process using thesystem 10 in accordance with the present invention is illustrated. The process shown inFIG. 7 is similar to the lateral threat detection process discussed above in connection withFIG. 3 and, therefore, steps 200 through 228, which are the same as those discussed in connection withFIG. 3 , will not be described in detail. In the embodiment shown inFIG. 7 , if the determination atBlock 208 of determining whether a human thermal profile is detected is no, rather than returning to Block 204 and continuing to monitor, the process proceeds to Block 266 for determining whether an animal thermal signature of an animal (non-pedestrian) is detected. If no animal thermal signature is detected at Block 266, the process proceeds to Block 204 for further operating and monitoring of thermal signatures. Alternatively, if an animal thermal signature is detected, the process proceeds to Block 268 to determine if thevehicle 100 is moving greater than a predetermined speed or velocity. If thevehicle 100 is not moving greater than a predetermined speed or velocity, the process proceeds to Block 204 for further operating and monitoring of thermal signatures. If thevehicle 100 is moving greater than the predetermined speed or velocity, the process proceeds to block 270 to determine a potential intercept solution. If the speed and direction (or velocity) of the encroaching animal (e.g. deer) results in a calculated vector of the animal's estimated future position that is in conflict with the vehicle's 100 estimated future position, then the system proceeds to Block 226 to adjust vehicle operation to avoid contact with the animal. For example, the system may immediately apply the vehicle's brakes and/or override steering of the vehicle in an effort to remove a potential intercept between the vehicle and the animal's path. If the distance from the animal, the animal's heading and/or movement speeds of thevehicle 100 and animal indicate thatvehicle 100 will “miss” the animal, then the process proceeds to Block 204 for further operating and monitoring of thermal signatures. Thevehicle 100 may optionally activate horn and/or lights to alarm the animal in an effort to prevent the animal from entering thevehicle 100 travel path or remaining in thevehicle 100 travel path. - The thermal gate may be centered about a thermal profile of a specific animal, such as deer, moose, bears, cows, pigs, horses, giraffes, camels, etc. In some embodiments, the thermal gate is configured to detect a plurality of different animal thermal signatures. The thermal gate may be a dynamic thermal gate and/or be configured to detect a thermal signature centered approximately around 104° F., for example, in a range of 103° F. to 105° F. or 99° F. to 109° F., which is indicative of a deer. The thermal gate may be configured based on the species, health, season and breeding fluctuations of the deer. As discussed above, the thermal gate center point and thermal window may be dynamically skewed depending on ambient temperature.
- Advantageously, in embodiments according to the present disclosure, a passive infra-red pedestrian and animal vehicle avoidance system may be configured to optimize vehicle safety for autonomous, semi-autonomous and/or non-autonomous vehicles. In some embodiments, the system may be additionally configured and/or optimized for animal behavior which is different than pedestrian behavior. For example, the system may be optimized for detection and avoidance of deer, which may move at higher rates of speed than pedestrians, for example, up to 30 MPH. A
system 10 equippedvehicle 100 may be traveling at highway speeds (e.g. 55-70 MPH) and be able to detect and initiate preventative measures for avoiding impact and/or mitigating the potential damage of an impact. Collisions with large and heavy animals at speed can be disastrous for a vehicle's occupant(s). Advantageously, such collisions may be avoided or mitigated in accordance with the present disclosure by being configured to detect, warn and/or avoid specific animals. - Referring to
FIG. 8 , a flow chart of an operational mode of an automatic fever detection system is shown in accordance with the present disclosure. Operation of the automatic fever detection system begins at block 700 where passive thermal emission detection scanning starts. Atblock 701, thermal parameters are selected for setting an alarm thermal range. Thermal parameters may include, but are not limited to, a thermal acceptance window center temperature, one or more windows about the thermal acceptance window center temperature, and/or one or more window widths. The scanning process may further optionally be modified atblock 702 to normalize a sampled group detected by the scanning, and the normalized group temperature of this sample group may be used as input to set the alarm thermal range atstep 701. The processor then searches for any “qualified” pixels representing elevated body temperatures atblock 703. A qualified pixel is a pixel that represents a temperature outside the one or more windows set atblock 701 and, if applicable, as modified atblock 702 for normalization. An elevated temperature is a thermal signature detected through scanning that is above the one or more windows about the thermal acceptance window center temperature. If no qualified pixels are detected or if the number of qualified pixels detected is below a predetermined pixel threshold value, then the process proceeds to block 704 and scanning for qualified pixels continues. In some embodiments, the methods and systems may be configured to be adjustable for a “center” point of each window, a ±temperature range “skew” of each window, and/or a “width” of each window. For example, the center point of a thermal window may have −X/+X degrees of deviation or −Y/+Z degrees of deviation about a center point. - Alternatively, at
block 703, if one or more qualified pixels are detected and/or if the number of qualified pixels detected is greater than a predetermined threshold value of qualified pixels, then the process proceeds to block 705 where the individual(s) corresponding to the qualified pixels are annotated on one or more device interfaces, such as, for example, a display device configured to display images or video detected by a visible wavelength camera or other sensor. Then the process proceeds to block 706 and optional audio alarms on or associated with the device interface(s) are activated, such as through a speaker or the like. Audible notifications or indications may be advantageous when the display device is not being actively monitored by an operator (or an administrator or other user). The process then proceeds to block 707 to begin optional image documentation and/or video documentation (or video recording) of the individual(s) identified as having the elevated body temperature. In some embodiments, the image and/or video may always be documented, e.g., recorded, and the portions with the individual(s) detected as having qualified pixels may be copied and sent to a monitoring database, flagged, or timestamp recorded for future reference, if necessary. For example, an image from the visible wavelength camera may be paired or associated with a thermal record or thermal image from the passive thermal emission detector or sensor for each individual detected by the camera and detector/sensor. Accordingly, an operator or administrator can later view the associated record(s) of an individual and recognize which individual is associated with the thermal signature, e.g. by viewing a still image or video of the individual (with or without annotations) in combination with the thermal record. The image(s) and/or video may be provided to facial recognition software or other identification processing methods and systems, e,g. methods and systems for obtaining individual identification information from a pre-issued identification or entry authorization, including but not limited to passports, driver licenses, boarding pass information, etc., as is discussed in greater detail herein. - In some embodiments the system may automatically alter or allow the thermal window to be manually altered in order to normalize the center and width of the thermal acceptance window based on a plurality of previously detected thermal signatures. For example, the thermal acceptance window may be manually altered in the system by an operator when conditions warrant a different thermal window range and/or width, such as when weather conditions or interior air temperature, pressure, and/or humidity conditions would make it difficult to detect elevated body temperatures. In some embodiments the thermal acceptance window may be skewed to bias the temperature acceptance window exclusively toward the “above normal” direction.
- As illustrated in
FIG. 9 , a group ofindividuals 800 is shown traveling across the field ofvision 801 of the thermalsensor array assembly 802. Thesystem 810 comprises at least one forward-looking passive infra-red (or PIR) thermal image sensor orsensor array 802 mounted at a fixed location and directed toward theindividuals 800 as theindividuals 800 move past thesystem 810 in the field ofvision 801. This allows the IR sensor(s) 802 to detect if any stationary or moving person(s) 800 are emitting a human thermal profile indicative of an above-normal thermal condition. - As illustrated in
FIG. 10 , adisplay device 900 being operatively connected to thesystem 810 ofFIG. 8 is showing a representative condition where thesystem 810 has detected and annotated an individual 901 that has been detected as having an abnormally elevated body temperature indicative of an active viral or bacterial infection (or other pathogen). In addition to the visual notification, an audiblenotification alarm speaker 902 may become active as well, to ensure that a system operator (or administrator or other user) monitoring thesystem 810 is notified of the individual(s) having the elevated temperature in case the system operator (or administrator or user) is looking away from thedisplay device 900. - While the visual notification for annotation of the individual 901 detected as having the elevated body temperature has been shown in a particular manner in
FIG. 10 , it should be understood that any visual means of identifying the individual(s) through graphical means is within the scope of the present disclosure. Additionally, while thedisplay device 900 is shown as having thespeaker 902 integrated therein, in some embodiments thedisplay device 900 andspeaker 902 may be separate components. - Time is often of the essence in not only detecting active cases of deadly viruses or other infections at a point of entry into a country, area, hospital, public venue, or other location, but also the need for fast identification of persons that have been potentially infected by individuals that enter the country with an incubating and non-detectable condition.
- As groups of individuals traveling together have been subjected to similar ambient conditions such as, for example, temperature, atmospheric pressures, and humidity as well as similar limits of physical activity (e.g. limited mobility within an aircraft), the AFDS has the capability to continually (or substantially continually) or periodically average the body temperatures of arriving individuals to arrive at a mean body temperature for the group, and then detect those individuals that exhibit body temperature higher than a predetermined amount relative to the group temperature.
- If the group temperature rises above a predetermined normalization threshold value, the system may be configured to generate an alert that the group as a whole is detected as having elevated body temperatures, which an operator may determine is an indication that the group as a whole is infected.
- In some embodiments, the detection of abnormal temperatures may be used to detect arriving individuals to a country through immigration control.
- In some embodiments according to the present disclosure, the detected thermal profiles of individuals are paired with the identification of said individuals in order to generate paired identification/visual image information records. The paired information may be used in real-time applications, but also may be stored for use with subsequent comparisons of future thermal detection sessions of each individual having paired information stored, which may be automatically compared and analyzed. As an example, if a person were thermally scanned on Monday and a subsequent thermal scan was done on Tuesday which showed a statistically significant temperature variation and/or a series of temperature rises, the system would note said variation, generate a report, provide a notification, and/or otherwise flag the individual as exhibiting an abnormal temperature (for that individual) even though the recorded temperatures were outside of commonly used temperature definitions of a human “fever”.
- One or more AFDSs according to the present disclosure may be located at entrances to office buildings, transportation facilities, hotels, schools, businesses, arenas, prisons, hospitals (either at entrances or in clinician's offices), or other spaces or locations where multiple individuals may have close contact with one another. Conventional facial recognition software may be utilized in conjunction with the AFDS(s) to provide an individual identification basis. In such embodiments, the
sensor 802 may be an integrated visible wavelength camera and passive infra-red sensor or, alternatively, the visible wavelength camera may be separate from thesensor 802 and both the camera readings and the passive infra-red sensor 802 readings may be transmitted to a processor of the AFDS. Alternatively or in addition to facial recognition, in locations in which each individual presents a ticket, boarding pass, passport, building pass, ID card, admittance ticket, visitor's pass, or other type of pre-issued identification or entry authorization, the identification information obtained from such item(s) may be automatically or manually passed on to the AFDS, paired with a contemporaneous thermal reading, and then forwarded to a central processing facility of the AFDS. At the central processing facility, the system may then file each individual's record, and if there existed one or more existing records for that individual, the system would add subsequent records to that individual's file, and may then make a comparison to the one or more previous thermal records from that individual in order to determine if there was a thermal difference that could indicate a rising (or falling) temperature that would fit a pre-determined criteria for further analysis, processing, alarm notification, and/or other action. - The AFDS according to the present disclosure includes a processor that is operatively connected to the sensor or
integrated camera sensor 802, camera,interface devices 900, one or more databases and central storage and processing facility. The processor may be physically connected to the elements the processor is in operative connection with, or the processor may be physically separate from those elements but operatively connected through one or more wireless and/or wired communication systems. For example, the process may be contained within a computer or display device and wireless connected tointegrated camera sensor 802. - The systems, methods and devices according to embodiments of the present disclosure provide an automatic means for instantly (or nearly instantly) detecting individuals with elevated body temperatures via specifically-selected and filtered thermal wavelengths that are characteristic of people with elevated skin (or body) temperatures as they are walking by, laterally crossing, or stationary in front of the sensor(s) and camera(s). The AFDS according to the present disclosure advantageously avoids or mitigates drawbacks associated with thermally scanning individuals via manual means, which is fraught with deficiencies. For example, the manual thermal scan operator has no ability to properly judge an individual's normal or healthy body temperature relative to that temperature which would represent a true elevated body temperature for that individual at least because each individual's normal body temperature can vary relative to that of another individual making such wild (non-contextual) temperature measurements lacking in substantively useful diagnostic value. Additionally, the method of manual spot scanning does not provide for any additional or ongoing continual monitoring of the temperature change of an individual and, therefore, the manual spot scanning may completely miss the detection of infected individuals in the early stage of infection.
- The methods and systems according to the present disclosure provide for improved detection of individuals experiencing elevated body temperatures. As discussed herein, in some embodiments, the AFDS may be configured to go beyond the one-time, generalized fever determination and, instead, may look for a true contextual elevated temperature change with that same individual over time, thereby generating individualized thermal assessments for specific individuals over time, regardless of their normal temperature range.
- The AFDS may advantageously be configured to simultaneously pair each thermal scan of an individual with corresponding identity information that is self-determined by the AFDS and/or is confirmed or provided by external data sources or databases. Each thermal scan may be recorded and stored, thereby generating a dynamic library of thermal scans performed for each individual scanned by the system, which subsequently allows for either a manual or automatic thermal comparison to be done for the purpose of detecting an elevated body temperature change based on comparing the latest thermal scan with one or more prior scans or based on an average of prior scans. If a thermal scan is the first for that individual to be stored by the system, and thus there is no prior scan for that individual to be compared to, then a generic thermal profile may be temporarily used to determine if that individual is presenting with an elevated body temperature condition.
- The identification information for an individual being scanned may be obtained either through onboard commonly used facial recognition software program(s), or by ingesting identification information presented by the individuals themselves as part of an entry process. Such information may be presented to, and then forwarded to, the AFDS by passport readers, identification card or badge readers, entry ticket readers, building pass readers, driver's license Information, or the like.
- Once a thermal reading is successfully paired with identification information (or identity information), it is recorded and passed along to a Central Processing Facility(s) for storage and analysis. Said storage may take place on-site, off-site, in a cloud database or computing service, and/or at other locations. In some embodiments, the storage and analysis may occur at a single location or at multiple locations, in some embodiments even simultaneously in multiple locations. The analysis may include one or more processors of the system comparing any prior thermal signatures stored over time from an individual to determine a normal temperature for that individual. Typically, the most recent thermal signature detection would be compared to the most recent prior thermal signature detection, but may also be compared to an average of prior thermal signature detections (or readings). If any successive thermal signature detection results in a variation from the normal reading beyond a predetermined threshold, or a continuing series of increased temperature rises even if still below the strict “fever” definition criteria, the most recent reading is flagged and sent on for further analysis or processing. As each thermal signature detection is recorded, additional information such as time and date of the detection, the location of the thermal reader performing the detection, the identity of the individual, a bus, ship, train or flight number associated with that time period, or the like may also be stored with the thermal signature detection and stored in a database for future reference or use and is appended to the record.
- In addition to analyzing any abnormal thermal changes for individuals themselves, the AFDS may also be configured to determine whether there are any clusters of elevated temperatures among numerous individuals, which may be determined and/or sorted by various criteria such as location of the thermal readings, age of the readings, personal data such as flight history, etc. In this way, there can be a near real-time determination of an infectious cluster spread in a highly automated and time-efficient manner.
- Referring to
FIG. 11 , a flow chart of an operational mode of an automatic fever detection system is shown in accordance with the present disclosure. Operation of the automatic fever detection system begins atblock 1002 where passive thermal emission detection scanning with one or more thermal AFDS scanners starts. Atblock 1004, the system generates a thermal record of one or more individuals. Atblock 1006, identification information is associated with or added to the thermal record. The identification information is received from facial recognition software processing systems or methods atblock 1008 and/or received from external identification system output(s) atblock 1010 as discussed above. Atblock 1012, an identified thermal record is generated for each individual of the one or more individuals. Atblock 1014, the identified thermal record is stored as discussed above. - The method proceeds to block 1016, where it is determined if the Central Processing Facility(s) contain a library of identified thermal records for each individual. If no library exists for the individual, the method proceeds to block 1018 to generate a new record file library for each individual, and then to block 1020 to add or store the identified thermal record for each individual in their respective new file library. Since there are no prior thermal records to compare the most current thermal record for the individual(s) with no prior thermal records, the system may compare the thermal records of those individuals with a thermal template in order to determine whether the thermal record fits a general indication of an elevated skin or body temperature as discussed above, and an alarm may be activated if applicable. If at
block 1016 it is determined that a library exists for the recorded individual, the method proceeds to block 1022 and adds or stores the identified thermal record for each individual in their respective existing record file library. Then the method proceeds to block 1024 to compare the most current identified thermal record generated atblock 1012 with one or more previously stored thermal records for the individual. Atblock 1026, the system determines whether the most current identified thermal record indicates a skin or body temperature increase for the individual. If it is determined that the skin or body temperature did increase, an alarm is activated atblock 1028 as discussed above. If it is determined that the skin or body temperature did not increase, the method ends atblock 1030, or returns to scanning individuals at block 1002 (or is continuously scanning individuals while performing other steps of the operating method). - Referring to
FIG. 12 , a flow chart of a method that may be implemented for the determination atblock 1026 ofFIG. 11 is shown in accordance with the present disclosure. Thedetermination 1026 begins atblock 1032 where it is determined whether the current thermal reading indicates a temperature increased above a predetermined threshold (e.g. above 100° F.). If it is determined the temperature increased above the predetermined threshold, then the method proceeds to activate an alarm atblock 1028. If it is determined that the temperature did not increase above the predetermined threshold, the method proceeds to block 1034 to determine whether the indicated temperature of the individual increased from a temperature indicated by a prior thermal record or average of prior thermal records by an amount greater than a predetermined amount (e.g. an increase in an amount of 2.0° F. or more). If it is determined that the temperature increase was greater than the predetermined amount, the method proceeds to activate the alarm atblock 1028. If it is determined that the temperature increase was not greater than a predetermined amount, the method proceeds to block 1036 to determine whether the indicated temperature of the individual constitutes an increase with a rate of change in conjunction with indicated temperature(s) from one or more prior thermal records that is greater than a predetermined rate of change (e.g. if the individual's temperature is increasing at a rate of change of 0.5° F. per day or 0.5° F. per thermal scan). If it is determined that the rate of change of temperature for the individual is greater than the predetermined rate of change, the method proceeds to activate the alarm atblock 1028. If it is determined that the rate of change is not greater than the predetermined rate of change, the method ends atblock 1030, or returns to scanning individuals atblock 1002 as discussed above. The determination atblock 1036 may also be configured to proceed to activate the alarm atblock 1028 if the rate of change persists for a number of consecutive or successive readings indicating a rising body skin or body temperature greater than a predetermined number of consecutive (successive) readings, even if the rate of change is not greater than the predetermined rate of change, or the absolute temperature readings do not indicate a “formal” definition of a fever in a human. For example, if the individual is recorded as having a rising temperature rate of change three or more consecutive times in a single day, or a rising temperature for three consecutive days. The predetermined number of consecutive (successive) readings is configured to be adjustable by an operator or administrator. - In some embodiments, the determination at
block 1026 may comprise all three determinations atblocks block 1026 may comprise only one or two of the determinations atblocks block blocks block 1028. These alarms would be “pre-alarms” because the individuals with temperatures that result in a “yes” determination atblocks - It should be readily understood that the Central Processing Facility(s) may be co-located on-side, e.g. in the case of a facility housing a large number of employees, workers, or visitors, or the records may be optionally forwarded in real-time to one or more off-site storage and processing facilities that receives records from numerous locations and other storage and processing facilities.
- The system, computers, devices and the like described herein have the necessary electronics, computer processing power, interfaces, memory, hardware, software, firmware, logic/state machines, databases, microprocessors, communication links, displays or other visual or audio interfaces, printing devices, and any other input/output interfaces, to provide the functions or achieve the results described herein. In addition, a computer readable storage medium may store thereon instructions that when executed by a machine, such as computer, result in the performance according to any of the embodiments described herein.
- The foregoing description of embodiments of the present disclosure has been presented for the purpose of illustration and description. It is not intended to be exhaustive or to limit the invention to the form disclosed. Obvious modifications and variations are possible in light of the above disclosure. The embodiments described were chosen to best illustrate the principles of the disclosure and practical applications thereof to enable one of ordinary skill in the art to utilize the invention in various embodiments and with various modifications as suited to the particular use contemplated.
Claims (30)
1. A method for automatically determining and alerting an operator to the presence of one or more individuals presenting an elevated body temperature, the method comprising:
detecting one or more thermal signatures using passive thermal emission detection, the one or more thermal signatures being generated by one or more individuals amongst a plurality of individuals, the one or more individuals presenting an elevated body temperature;
determining if there is a need for a responsive action to the presence of the one or more individuals presenting an elevated body temperature; and
triggering an alert for an operator if a need for responsive action is determined.
2. The method according to claim 1 , wherein the detecting the one or more thermal signatures comprises using a thermal emission sensor array assembly disposed at a fixed position.
3. The method according to claim 1 , wherein the step of determining if there is a need for responsive action comprises:
determining if the one or more thermal signatures is above a predetermined threshold;
determining if the one or more thermal signatures indicates a temperature increase from a temperature indicated by one or more prior thermal records that is greater than a predetermined amount; and/or
determining whether the one or more thermal signatures indicates a temperature constituting a rate of change increase in conjunction with one or more temperatures from the one or more prior thermal records that is greater than a predetermined rate of change or that the rate of change persists for a number of consecutive readings greater than a predetermined number of consecutive readings.
4. The method according to claim 1 , wherein the detecting the one or more thermal signatures comprises using detected thermal emission data that is passed through a predefined thermal acceptance window correlated to a thermal emission range of a human.
5. The method according to claim 4 , wherein the predefined thermal acceptance window is configured to be manually and dynamically altered to compensate for the effect of ambient temperature conditions on the thermal emission range of a human.
6. The method according to claim 4 , wherein the predefined thermal acceptance window is configured to be automatically and dynamically altered to normalize the center and width of the thermal acceptance window based on a plurality of previously detected thermal signatures.
7. The method according to claim 6 , wherein an abnormal indication notification and alarm is presented to an operator if the predefined thermal acceptance window is dynamically altered beyond a predetermined normalization threshold.
8. The method according to claim 1 , wherein the determining a need for responsive action comprises determining if the one or more thermal signatures is above an expected thermal signature reading for a healthy human.
9. The method according to claim 1 , wherein the alert comprises:
providing an annotation and/or highlighting to one or more images or to a video on an operationally connected display of each individual exhibiting an elevated body temperature; and/or
activating an audible alert.
10. The method according to claim 1 , further comprising recording one or more images of the one or more individuals presenting an elevated body temperature or recording video of the one or more individuals presenting an elevated body temperature.
11. The method according to claim 1 , further comprising:
obtaining identification information for each individual of the plurality of individuals;
pairing each individual's identification information with each individual's respective detected thermal signature as paired information; and
storing the paired information at a central storage and processing facility.
12. The method according to claim 11 , further comprising:
subsequent detecting one or more subsequent thermal signatures using passive thermal emission detection, the one or more subsequent thermal signatures being generated by one or more individuals amongst a subsequent plurality of individuals, the subsequent plurality of individuals having at least one individual that is part of the plurality of individuals;
subsequent obtaining identification information for each individual of the subsequent plurality of individuals;
comparing the subsequent detections of the one or more thermal signatures with the paired information for each respective individual if the respective individual has paired information stored in the central storage and processing facility; and
determining if the subsequent detection of a thermal signature for an individual of the subsequent plurality of individuals indicates an elevated body temperature in comparison to the paired information for the individual or an average of the detected thermal signatures of the paired information for the individual.
13. The method according to claim 12 , further comprising sorting the comparisons of the subsequent detections of the one or more subsequent thermal signatures to dynamically identify clusters of infection amongst individuals, wherein the sorting is based on criteria comprising prior detected locations and/or prior detection times.
14. A system for automatically determining and alerting an operator to the presence of one or more individuals presenting an elevated body temperature, the system comprising:
a thermal sensor array assembly configured to detect one or more thermal signatures using passive thermal emission detection, the one or more thermal signatures generated by one or more individuals amongst a plurality of individuals, the one or more individuals presenting an elevated body temperature;
a processor operatively connected to the thermal sensor array assembly, the processor configured to determine if there is a need for a responsive action to the presence of the one or more individuals presenting an elevated body temperature; and
an interface device operatively connected to the processor;
wherein the processor is configured to trigger the interface device to provide an alert to an operator if a need for responsive action is determined.
15. The system according to claim 14 , wherein the thermal emission sensor array assembly is disposed at a fixed position.
16. The system according to claim 15 , wherein the thermal emission sensor array assembly comprises a forward-looking thermal sensor aimed at the plurality of individuals.
17. The system according to claim 14 , wherein the thermal sensor array assembly is configured to output detected thermal emission data through a predefined thermal acceptance window correlated to a thermal emission range of a human.
18. The system according to claim 17 , wherein the predefined thermal acceptance window is configured to be manually and dynamically altered to compensate for the effect of ambient temperature conditions on the thermal emission range of a human.
19. The system according to claim 17 , wherein the predefined thermal acceptance window is configured to be automatically and dynamically altered to normalize the center and width of the thermal acceptance window based on a plurality of previously detected thermal signatures.
20. The system according to claim 19 , wherein the processor is configured to cause the interface device to generate an abnormal indication notification and alarm for an operator if the predefined thermal acceptance window is dynamically altered beyond a predetermined normalization threshold.
21. The system according to claim 14 , wherein processor is configured to determine if the one or more thermal signatures is above an expected thermal signature reading for a healthy human.
22. The system according to claim 14 , wherein the wherein the alert comprises:
providing an annotation and/or highlighting to one or more images or to a video on a display of the interface device of each individual exhibiting an elevated body temperature; and/or
activating an audible alert.
23. The system according to claim 14 , further comprising a visible wavelength camera operatively connected to the processor, wherein the processor is configured record one or more images generated by the visible wavelength camera of the one or more individuals presenting an elevated body temperature or record video generated by the visible wavelength camera of the one or more individuals presenting an elevated body temperature.
24. The system according to claim 14 , wherein the thermal sensor array assembly includes an integrated camera, wherein the processor is configured record one or more images generated by the integrated camera of the one or more individuals presenting an elevated body temperature or record video generated by the integrated camera of the one or more individuals presenting an elevated body temperature.
25. The system according to claim 14 ,
wherein the processor is configured to obtain identification information for each individual of the plurality of individuals,
wherein the processor is configured to pair each individual's identification information with each individual's respective detected thermal signature as paired information; and
wherein the processor is configured to store the paired information at a central storage and processing facility.
26. The system according to claim 25 ,
wherein the thermal sensor array assembly is configured to subsequently detect one or more subsequent thermal signatures using passive thermal emission detection, the one or more subsequent thermal signatures being generated by one or more individuals amongst a subsequent plurality of individuals, the subsequent plurality of individuals having at least one individual that is part of the plurality of individuals;
wherein the processor is configured to obtain identification information for each individual of the subsequent plurality of individuals;
wherein the processor is configured to compare the subsequent detections of the one or more thermal signatures with the paired information for each respective individual if the respective individual has paired information stored in the central storage and processing facility; and
wherein the processor is configured to determine if the subsequent detection of a thermal signature for an individual indicates an elevated body temperature in comparison to the paired information for the individual or an average of the detected thermal signatures of the paired information for the individual.
27. The system according to claim 26 , wherein the processor is configured to sort the comparisons of the subsequent detections of the one or more subsequent thermal signatures to dynamically identify clusters of infection amongst individuals, and wherein the processor is configured to sort the comparisons based on criteria comprising prior detected locations and/or prior detection times.
28. An automatic fever detection system comprising:
a thermal sensor array assembly configured to detect each thermal signature of a plurality of individuals simultaneously;
a visible wavelength camera configured to detect each individual of the plurality of individuals simultaneously;
a display device configured to display images detected by the visible wavelength camera; and
a processor operatively connected to the thermal sensor array assembly, the visible wavelength camera and the display device;
wherein the processor is configured to associate each thermal signature detected by the thermal sensor array assembly with each individual detected by the visible wavelength camera;
wherein the processor is configured to determine whether each thermal signature detected by the thermal sensor array assembly is above a predetermined temperature; and
wherein the processor is configured to cause the display device to display highlight and/or annotated each individual associated with each thermal signature determined by the processor to be above the predetermined temperature.
29. The fever detection system according to claim 28 , further comprising a speaker operatively connected to the processor, and wherein the processor is configured to cause the speaker to emit a sound when the processor determines one or more thermal signatures is above the predetermined temperature.
30. The fever detection system according to claim 28 , wherein the processor is configured to determine an identity of each individual of the plurality of individuals, and wherein the processor is configured to store each thermal signature of the plurality of individuals in association with each identity of each individual.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/863,043 US10750953B1 (en) | 2018-05-11 | 2020-04-30 | Automatic fever detection system and method |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201862670209P | 2018-05-11 | 2018-05-11 | |
US16/354,833 US10467903B1 (en) | 2018-05-11 | 2019-03-15 | Passive infra-red pedestrian detection and avoidance system |
US16/673,295 US11062608B2 (en) | 2018-05-11 | 2019-11-04 | Passive infra-red pedestrian and animal detection and avoidance system |
US16/863,043 US10750953B1 (en) | 2018-05-11 | 2020-04-30 | Automatic fever detection system and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/673,295 Continuation-In-Part US11062608B2 (en) | 2018-05-11 | 2019-11-04 | Passive infra-red pedestrian and animal detection and avoidance system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200253483A1 true US20200253483A1 (en) | 2020-08-13 |
US10750953B1 US10750953B1 (en) | 2020-08-25 |
Family
ID=71944931
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/863,043 Active US10750953B1 (en) | 2018-05-11 | 2020-04-30 | Automatic fever detection system and method |
Country Status (1)
Country | Link |
---|---|
US (1) | US10750953B1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210344851A1 (en) * | 2020-05-04 | 2021-11-04 | Rebellion Photonics, Inc. | Apparatuses, systems, and methods for thermal imaging |
US11204281B1 (en) * | 2020-09-03 | 2021-12-21 | Sensormatic Electronics, LLC | Enhanced temperature measurement techniques |
US20220230018A1 (en) * | 2021-01-21 | 2022-07-21 | Hitachi Automotive Systems, Ltd. | Combining visible light camera and thermal camera information |
US11766180B1 (en) | 2020-12-07 | 2023-09-26 | Mark Newton | Identification of a true febrile state in humans through comparison of simultaneously measured core and peripheral temperatures |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11151858B2 (en) * | 2020-06-24 | 2021-10-19 | Paul Edward Moshe Modiano | Crowd management in an enclosed premises |
Family Cites Families (47)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB9317983D0 (en) | 1993-08-28 | 1993-10-13 | Lucas Ind Plc | A driver assistance system for a vehicle |
DE19741631B4 (en) | 1997-09-20 | 2013-08-14 | Volkswagen Ag | Method and device for avoiding and / or minimizing conflict situations in road traffic |
EP0913751B1 (en) | 1997-11-03 | 2003-09-03 | Volkswagen Aktiengesellschaft | Autonomous vehicle and guiding method for an autonomous vehicle |
EP1083076A3 (en) | 1999-09-07 | 2005-01-12 | Mazda Motor Corporation | Display apparatus for vehicle |
US9558663B2 (en) * | 2000-10-04 | 2017-01-31 | Intelligent Technologies International, Inc. | Animal detecting and notification method and system |
US6759949B2 (en) | 2002-05-23 | 2004-07-06 | Visteon Global Technologies, Inc. | Image enhancement in far infrared camera |
US20050084659A1 (en) | 2003-10-20 | 2005-04-21 | General Atomics | Vehicle windshield head-up display |
DE10349631A1 (en) | 2003-10-24 | 2005-05-19 | Robert Bosch Gmbh | Driver assistance method and apparatus based on lane information |
JP4376653B2 (en) | 2004-02-17 | 2009-12-02 | 富士重工業株式会社 | Outside monitoring device |
US7786898B2 (en) | 2006-05-31 | 2010-08-31 | Mobileye Technologies Ltd. | Fusion of far infrared and visible images in enhanced obstacle detection in automotive applications |
JP4434234B2 (en) | 2007-05-30 | 2010-03-17 | トヨタ自動車株式会社 | VEHICLE IMAGING SYSTEM AND VEHICLE CONTROL DEVICE |
JP2009217682A (en) | 2008-03-12 | 2009-09-24 | Yazaki Corp | Display for vehicle |
US8103604B2 (en) * | 2008-03-18 | 2012-01-24 | Manchester Metropolitan University | Remote detection and measurement of objects |
US8988525B2 (en) | 2009-08-27 | 2015-03-24 | Robert Bosch Gmbh | System and method for providing guidance information to a driver of a vehicle |
EP2481012A2 (en) | 2009-12-02 | 2012-08-01 | Tata Consultancy Services Limited | Cost-effective system and method for detecting, classifying and tracking the pedestrian using near infrared camera |
US20120038778A1 (en) | 2010-08-11 | 2012-02-16 | United States Of America, As Represented By The Secretary Of The Army | Self-Scanning Passive Infrared Personnel Detection Sensor |
US9963145B2 (en) | 2012-04-22 | 2018-05-08 | Emerging Automotive, Llc | Connected vehicle communication with processing alerts related to traffic lights and cloud systems |
JP5742937B2 (en) | 2011-06-02 | 2015-07-01 | トヨタ自動車株式会社 | Visibility support device for vehicle |
AU2012272543B2 (en) * | 2011-06-24 | 2017-03-09 | Surveillance Guard Co Limited | An accident prevention system and a vehicle including the accident prevention system |
KR101349025B1 (en) | 2011-11-25 | 2014-01-10 | 현대자동차주식회사 | Lane image composite device and method for smart night view |
GB2497091B (en) * | 2011-11-29 | 2013-11-20 | Qhi Group Ltd | Monitoring an electrical joint |
EP2810267A1 (en) | 2012-02-03 | 2014-12-10 | Continental Teves AG&Co. Ohg | Signal generator, system and method for highlighting objects in road traffic, use of the system, and use of the signal generator |
DE102012201896A1 (en) | 2012-02-09 | 2013-08-14 | Robert Bosch Gmbh | Driver assistance system and driver assistance system for snowy roads |
JP5529910B2 (en) * | 2012-03-12 | 2014-06-25 | 本田技研工業株式会社 | Vehicle periphery monitoring device |
EP2827318A4 (en) | 2012-03-12 | 2016-01-13 | Honda Motor Co Ltd | Vehicle periphery monitor device |
DE102013210826A1 (en) | 2013-06-11 | 2014-12-11 | Robert Bosch Gmbh | A method of operating a display device, computer program product, display device |
JP6035207B2 (en) | 2013-06-14 | 2016-11-30 | 日立オートモティブシステムズ株式会社 | Vehicle control system |
KR101543105B1 (en) | 2013-12-09 | 2015-08-07 | 현대자동차주식회사 | Method And Device for Recognizing a Pedestrian and Vehicle supporting the same |
US20160180175A1 (en) * | 2014-12-18 | 2016-06-23 | Pointgrab Ltd. | Method and system for determining occupancy |
WO2016138518A1 (en) * | 2015-02-27 | 2016-09-01 | Braeburn Inc. | Vehicle extreme temperature safety systems |
JP6637686B2 (en) | 2015-06-30 | 2020-01-29 | 株式会社デンソーテン | Information presentation device, in-vehicle device, information presentation system, and information presentation method |
WO2017073348A1 (en) | 2015-10-27 | 2017-05-04 | 富士フイルム株式会社 | Infrared imaging device, control method for same, and vehicle |
US10019902B2 (en) | 2015-11-06 | 2018-07-10 | Continental Automotive Systems, Inc. | Enhanced sound generation for quiet vehicles with vehicle-to-vehicle communication capabilities |
US20170219240A1 (en) * | 2016-02-03 | 2017-08-03 | Avaya Inc. | Method and apparatus for a fan auto adaptive noise |
SE539816C2 (en) | 2016-04-19 | 2017-12-05 | Scania Cv Ab | Method and control unit in a vehicle for estimating a stretch of a road based on a set of tracks of another vehicle |
JP6310503B2 (en) | 2016-06-06 | 2018-04-11 | 本田技研工業株式会社 | Vehicle and lane change timing determination method |
US9898005B2 (en) | 2016-06-24 | 2018-02-20 | Toyota Motor Engineering & Manufacturing North America, Inc. | Driving path determination for autonomous vehicles |
US10656640B2 (en) | 2016-07-07 | 2020-05-19 | Applied Minds, Llc | Systems and methods for centralized control of autonomous vehicles |
US10737702B2 (en) | 2016-07-27 | 2020-08-11 | Toyota Motor Engineering & Manufacturing North America, Inc. | Visually simulating driving plans in autonomous vehicles |
US11321572B2 (en) | 2016-09-27 | 2022-05-03 | Nissan Motor Co., Ltd. | Self-position estimation method and self-position estimation device |
US10053089B2 (en) | 2016-11-16 | 2018-08-21 | Nio Usa, Inc. | System for controlling a vehicle based on thermal profile tracking |
KR101996418B1 (en) | 2016-12-30 | 2019-07-04 | 현대자동차주식회사 | Sensor integration based pedestrian detection and pedestrian collision prevention apparatus and method |
KR101996419B1 (en) | 2016-12-30 | 2019-07-04 | 현대자동차주식회사 | Sensor integration based pedestrian detection and pedestrian collision prevention apparatus and method |
JP6741603B2 (en) | 2017-01-16 | 2020-08-19 | 株式会社Soken | Estimator |
JP7013727B2 (en) | 2017-08-25 | 2022-02-01 | 株式会社デンソー | Vehicle control device |
US10175112B1 (en) | 2017-12-14 | 2019-01-08 | Adasky, Ltd | Compact infrared camera for automotive safety and driving systems |
JP6965739B2 (en) | 2017-12-27 | 2021-11-10 | 株式会社デンソー | Vehicle control device |
-
2020
- 2020-04-30 US US16/863,043 patent/US10750953B1/en active Active
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210344851A1 (en) * | 2020-05-04 | 2021-11-04 | Rebellion Photonics, Inc. | Apparatuses, systems, and methods for thermal imaging |
US11204281B1 (en) * | 2020-09-03 | 2021-12-21 | Sensormatic Electronics, LLC | Enhanced temperature measurement techniques |
US11766180B1 (en) | 2020-12-07 | 2023-09-26 | Mark Newton | Identification of a true febrile state in humans through comparison of simultaneously measured core and peripheral temperatures |
US20220230018A1 (en) * | 2021-01-21 | 2022-07-21 | Hitachi Automotive Systems, Ltd. | Combining visible light camera and thermal camera information |
US11676403B2 (en) * | 2021-01-21 | 2023-06-13 | Hitachi Astemo, Ltd. | Combining visible light camera and thermal camera information |
Also Published As
Publication number | Publication date |
---|---|
US10750953B1 (en) | 2020-08-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10750953B1 (en) | Automatic fever detection system and method | |
KR101967610B1 (en) | Multi lane monitoring system that can recognize vehicle velocity and license plate number of multi lane | |
US9524643B2 (en) | Orientation sensitive traffic collision warning system | |
EP2523174B1 (en) | Vision based night-time rear collision warning system, controller, and method of operating the same | |
US11062608B2 (en) | Passive infra-red pedestrian and animal detection and avoidance system | |
CN111402612A (en) | Traffic incident notification method and device | |
JP2018195301A (en) | Control device and control method | |
US10745030B2 (en) | Providing location and driving behavior based alerts | |
KR102033858B1 (en) | Prediction system for traffic accident | |
US10861336B2 (en) | Monitoring drivers and external environment for vehicles | |
Forslund et al. | Night vision animal detection | |
KR102101956B1 (en) | Enforcement system for school-zone using pedestrian detection | |
US20110098892A1 (en) | Method of detecting object in the vicinity of a vehicle | |
JP2004362586A (en) | Image processing system for vehicle | |
JP2006508437A (en) | Method for detecting the forward perimeter of a road vehicle by a perimeter sensing system | |
JP2009069885A (en) | State determination device and program | |
KR20140014987A (en) | Safe cross-walk system on school zone | |
KR20170077317A (en) | Apparatus for controlling autonomous emergency braking system and method thereof | |
WO2017030494A1 (en) | Method, control unit and system for detecting and tracking vulnerable road users | |
KR102147527B1 (en) | Smart security light system | |
Kumar et al. | Smart and Safety Traffic System for the vehicles on the Road | |
KR102290353B1 (en) | Unauthorized alerting system and method using object recognition | |
KR101806322B1 (en) | Management system of rest area on road using image information | |
KR20190090221A (en) | Intelligence safety device | |
US10745029B2 (en) | Providing relevant alerts to a driver of a vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |