GB2570247A - Detecting physiological responses using thermal and visible-light head-mounted cameras - Google Patents

Detecting physiological responses using thermal and visible-light head-mounted cameras Download PDF

Info

Publication number
GB2570247A
GB2570247A GB1906592.9A GB201906592A GB2570247A GB 2570247 A GB2570247 A GB 2570247A GB 201906592 A GB201906592 A GB 201906592A GB 2570247 A GB2570247 A GB 2570247A
Authority
GB
United Kingdom
Prior art keywords
head
physiological response
thermal
visible
physiological responses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1906592.9A
Other versions
GB201906592D0 (en
GB2570247B (en
Inventor
Tzvieli Arie
Thieberger Gil
M Frank Ari
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Facense Ltd
Original Assignee
Facense Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facense Ltd filed Critical Facense Ltd
Priority to GB2114500.8A priority Critical patent/GB2596733B/en
Publication of GB201906592D0 publication Critical patent/GB201906592D0/en
Publication of GB2570247A publication Critical patent/GB2570247A/en
Application granted granted Critical
Publication of GB2570247B publication Critical patent/GB2570247B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A61B5/015—By temperature mapping of body part
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • G01J5/0025—Living bodies
    • G—PHYSICS
    • G02—OPTICS
    • G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
    • G02C11/00—Non-optical adjuncts; Attachment thereof
    • G02C11/10—Electronic devices other than hearing aids
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A61B5/0816—Measuring devices for examining respiratory frequency
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/41—Detecting, measuring or recording for evaluating the immune or lymphatic systems
    • A61B5/411—Detecting or monitoring allergy or intolerance reactions to an allergenic agent or substance
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J2005/0077—Imaging

Abstract

Some aspects of this disclosure involve head-mounted systems that are utilized to take thermal measurements of a user's face to detect various physiological responses, such as an allergic reaction, stress, a headache, a stroke, to name a few. Typically, these systems involve one or more head-mounted thermal cameras that may be physically coupled to a frame worn on the user's head and are utilized to take thermal measurements of one or more regions of interest (ROIs). Some of the systems described in this disclosure are intended for "real world", uncontrolled day-to-day use, in which detection of the physiological response may be hampered by "confounding factors". A confounding factor can be a cause of warming and/or cooling of certain ROIs the face, which is unrelated to a physiological response being detected, and as such, can reduce the accuracy of the detection of the physiological response.
GB1906592.9A 2016-10-14 2017-10-02 Detecting physiological responses based on facial skin color changes Active GB2570247B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB2114500.8A GB2596733B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing thermal camera

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662408677P 2016-10-14 2016-10-14
US201762456105P 2017-02-07 2017-02-07
US201762480496P 2017-04-02 2017-04-02
PCT/IB2017/056069 WO2018069791A1 (en) 2016-10-14 2017-10-02 Detecting physiological responses using thermal and visible-light head-mounted cameras

Publications (3)

Publication Number Publication Date
GB201906592D0 GB201906592D0 (en) 2019-06-26
GB2570247A true GB2570247A (en) 2019-07-17
GB2570247B GB2570247B (en) 2021-12-01

Family

ID=61905195

Family Applications (5)

Application Number Title Priority Date Filing Date
GB2114500.8A Active GB2596733B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing thermal camera
GB1906669.5A Active GB2569936B (en) 2016-10-14 2017-10-02 Calculating respiratory parameters from thermal measurements
GB2116877.8A Active GB2598245B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing visible-light camera
GB1906592.9A Active GB2570247B (en) 2016-10-14 2017-10-02 Detecting physiological responses based on facial skin color changes
GB1906670.3A Active GB2570829B (en) 2016-10-14 2017-10-02 Detecting physiological responses based on thermal asymmetry of the face

Family Applications Before (3)

Application Number Title Priority Date Filing Date
GB2114500.8A Active GB2596733B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing thermal camera
GB1906669.5A Active GB2569936B (en) 2016-10-14 2017-10-02 Calculating respiratory parameters from thermal measurements
GB2116877.8A Active GB2598245B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing visible-light camera

Family Applications After (1)

Application Number Title Priority Date Filing Date
GB1906670.3A Active GB2570829B (en) 2016-10-14 2017-10-02 Detecting physiological responses based on thermal asymmetry of the face

Country Status (3)

Country Link
CN (2) CN110072438A (en)
GB (5) GB2596733B (en)
WO (3) WO2018069791A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2561537B (en) 2017-02-27 2022-10-12 Emteq Ltd Optical expression detection
IL261235A (en) * 2018-08-19 2020-02-27 Sensority Ltd Machine classification of significant psychophysiological response
EP3716151A1 (en) * 2019-03-25 2020-09-30 Steffen Wirth Stress monitor and stress-monitoring method
WO2021065853A1 (en) * 2019-10-04 2021-04-08 日本アビオニクス株式会社 Diseased person distinguishing device and diseased person distinguishing system
TWI750531B (en) * 2019-11-12 2021-12-21 國立勤益科技大學 Detection device and detection method for apnea based on chest respiratory signal
CN111202502B (en) * 2020-01-19 2021-06-15 珠海格力电器股份有限公司 Health index detection method and system, storage medium and health monitoring equipment
CN111248922B (en) * 2020-02-11 2022-05-17 中国科学院半导体研究所 Human body respiration condition acquisition paste based on accelerometer and gyroscope and preparation method thereof
CN111128387A (en) * 2020-02-26 2020-05-08 上海鹰瞳医疗科技有限公司 Method and equipment for establishing epileptic seizure detection model
EP4143793A1 (en) * 2020-04-30 2023-03-08 Marsupial Holdings Inc. Extended field-of-view near-to-eye wearable display
US11790586B2 (en) * 2020-06-19 2023-10-17 Microsoft Technology Licensing, Llc Generating physio-realistic avatars for training non-contact models to recover physiological characteristics
CN112057074A (en) * 2020-07-21 2020-12-11 北京迈格威科技有限公司 Respiration rate measuring method, respiration rate measuring device, electronic equipment and computer storage medium
US11803237B2 (en) * 2020-11-14 2023-10-31 Facense Ltd. Controlling an eye tracking camera according to eye movement velocity
CN113576452A (en) * 2021-07-30 2021-11-02 深圳市商汤科技有限公司 Respiration rate detection method and device based on thermal imaging and electronic equipment
CN113729725B (en) * 2021-09-30 2024-02-06 东南大学 Method for extracting respiratory waveform from electrocardiosignal based on power spectrum first moment and smoother
CN115738075A (en) * 2021-12-08 2023-03-07 国家康复辅具研究中心 Electrical stimulation rehabilitation training system
CN116110539B (en) * 2023-02-14 2024-03-26 苏州睿酷医疗科技有限责任公司 Pain relief virtual reality system and method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130124039A1 (en) * 2003-04-22 2013-05-16 Marcio Marc Abreu Thermal Imaging System
WO2016025323A1 (en) * 2014-08-10 2016-02-18 Autonomix Medical, Inc. Ans assessment systems, kits, and methods
US20160270656A1 (en) * 2015-03-16 2016-09-22 Magic Leap, Inc. Methods and systems for diagnosing and treating health ailments
US20160360970A1 (en) * 2015-06-14 2016-12-15 Facense Ltd. Wearable device for taking thermal and visual measurements from fixed relative positions
US20170095157A1 (en) * 2015-10-03 2017-04-06 Facense Ltd. Systems for collecting thermal measurements of the face

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2639212A1 (en) * 1988-11-18 1990-05-25 Hennson Int DEVICE FOR MEASURING AND ANALYZING MOVEMENTS OF THE HUMAN BODY OR PARTS THEREOF
JPH09140677A (en) * 1995-11-20 1997-06-03 Matsushita Electric Ind Co Ltd Body temperature measuring apparatus
DE29913602U1 (en) * 1999-08-04 1999-11-25 Oculus Optikgeraete Gmbh Device for eye examination with a Scheimpflug camera and a slit projector for taking sectional images of an eye
GB2385451A (en) * 2002-02-13 2003-08-20 Loadpoint Ltd Monitoring drowsiness
US7066180B2 (en) * 2003-07-09 2006-06-27 Airmatrix Technologies, Inc. Method and system for measuring airflow of nares
CN102670163B (en) * 2004-04-01 2016-04-13 威廉·C·托奇 The system and method for controlling calculation device
US8472682B2 (en) * 2005-09-12 2013-06-25 Dvp Technologies Ltd. Medical image processing
US20090221888A1 (en) * 2008-03-03 2009-09-03 Ravindra Wijesiriwardana Wearable sensor system for environmental and physiological information monitoring and information feedback system
EP2233071A1 (en) * 2009-03-27 2010-09-29 Koninklijke Philips Electronics N.V. Breathing feedback device
EP2619724A2 (en) * 2010-09-23 2013-07-31 Stryker Corporation Video monitoring system
JP2013030959A (en) * 2011-07-28 2013-02-07 Seiko Instruments Inc Doze monitoring alarm device and doze monitoring alarm method
EP3639733B1 (en) * 2012-05-30 2022-10-26 ResMed Sensor Technologies Limited Apparatus for monitoring cardio-pulmonary health
WO2014012070A1 (en) * 2012-07-12 2014-01-16 Flir Systems, Inc. Infant monitoring systems and methods using thermal imaging
CN102973273B (en) * 2012-11-29 2014-12-17 中国人民解放军第四军医大学 Sleep respiratory function monitoring system based on infrared radiation detection
JP6054543B2 (en) * 2012-12-04 2016-12-27 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． Device and method for obtaining vital sign information of a living body
EP2967315B1 (en) * 2013-03-15 2022-07-27 Vasoptic Medical, Inc. Ophthalmic examination and disease management with multiple illumination modalities
US10863098B2 (en) * 2013-06-20 2020-12-08 Microsoft Technology Licensing. LLC Multimodal image sensing for region of interest capture
TWI549649B (en) * 2013-09-24 2016-09-21 廣達電腦股份有限公司 Head mounted system
JP2015092646A (en) * 2013-11-08 2015-05-14 ソニー株式会社 Information processing device, control method, and program
US9672416B2 (en) * 2014-04-29 2017-06-06 Microsoft Technology Licensing, Llc Facial expression tracking
GB2528044B (en) * 2014-07-04 2018-08-22 Arc Devices Ni Ltd Non-touch optical detection of vital signs
CA3081166A1 (en) * 2015-01-06 2016-07-14 David Burton Mobile wearable monitoring systems
CN104665787B (en) * 2015-01-26 2017-08-22 周常安 Physiological feedback system
DE102016101661A1 (en) * 2015-01-29 2016-08-04 Affectomatics Ltd. BASED ON DATA PRIVACY CONSIDERATIONS BASED ON CROWD BASED EVALUATIONS CALCULATED ON THE BASIS OF MEASURES OF THE AFFECTIVE REACTION
US20160228037A1 (en) * 2015-02-10 2016-08-11 Oridion Medical 1987 Ltd. Homecare asthma management
KR20160108967A (en) * 2015-03-09 2016-09-21 한국전자통신연구원 Device and method for bio-signal measurement
CN105447441B (en) * 2015-03-19 2019-03-29 北京眼神智能科技有限公司 Face authentication method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130124039A1 (en) * 2003-04-22 2013-05-16 Marcio Marc Abreu Thermal Imaging System
WO2016025323A1 (en) * 2014-08-10 2016-02-18 Autonomix Medical, Inc. Ans assessment systems, kits, and methods
US20160270656A1 (en) * 2015-03-16 2016-09-22 Magic Leap, Inc. Methods and systems for diagnosing and treating health ailments
US20160360970A1 (en) * 2015-06-14 2016-12-15 Facense Ltd. Wearable device for taking thermal and visual measurements from fixed relative positions
US20170095157A1 (en) * 2015-10-03 2017-04-06 Facense Ltd. Systems for collecting thermal measurements of the face

Also Published As

Publication number Publication date
GB201906592D0 (en) 2019-06-26
CN110072438A (en) 2019-07-30
GB2598245A (en) 2022-02-23
WO2018069791A1 (en) 2018-04-19
GB201906669D0 (en) 2019-06-26
GB202116877D0 (en) 2022-01-05
GB202114500D0 (en) 2021-11-24
GB2569936A (en) 2019-07-03
GB2596733B (en) 2022-07-06
WO2018069789A1 (en) 2018-04-19
GB2596733A (en) 2022-01-05
GB2570829B (en) 2021-12-01
GB2570247B (en) 2021-12-01
GB2569936B (en) 2021-12-01
CN110099601A (en) 2019-08-06
GB2598245B (en) 2022-09-28
GB201906670D0 (en) 2019-06-26
WO2018069790A1 (en) 2018-04-19
GB2570829A (en) 2019-08-07

Similar Documents

Publication Publication Date Title
GB2570247A (en) Detecting physiological responses using thermal and visible-light head-mounted cameras
MX2018012608A (en) Systems and devices for motion tracking, assessment, and monitoring and methods of use thereof.
MX2020002094A (en) Optical detection of skin disease.
WO2015066491A3 (en) Hand hygiene use and tracking in the clinical setting via wearable computers
BR112018016726A2 (en) display device used on the head for virtual and mixed reality with interior-exterior positional tracking of the user's body and environment
WO2017091730A3 (en) Automated health data acquisition, processing and communication system and method
MX2018002156A (en) Device and system for monitoring of pulse-related information of a subject.
WO2017165231A9 (en) Head mounted display system configured to exchange biometric information
NZ741863A (en) Eye pose identification using eye features
MX2016009335A (en) Portable electronic hemodynamic sensor systems.
IN2013CH05637A (en)
MX366945B (en) A system and method to detect significant arrhythmic events through a photoplethysmogram (ppg) and accelerometer.
BR112016002488A2 (en) processor for use in a monitoring system for monitoring an individual's hemodynamic state, monitoring system for monitoring an individual's hemodynamic state, processing method for use in a monitoring system for monitoring an individual's hemodynamic state, method of monitoring to monitor an individual's hemodynamic state, and, computer program
SA515360128B1 (en) Device for evaluating condition of skin or hair
BR112017009829A2 (en) image interpretation system and security interpretation image interpretation method containing video analysis
MX2014015052A (en) System for camera-based vital sign measurement.
MX2015009946A (en) System and method for determining vital sign information of a subject.
WO2015015454A3 (en) Gaze tracking system
WO2017006313A3 (en) Apparatus, system and method for pain monitoring
WO2013111033A3 (en) Medical selection system
SE1851277A1 (en) Equipment recommendation system and method
EP4273672A3 (en) Head mounted display and information processing method
MX2018002458A (en) System, method and processor for monitoring a vital sign of a subject.
GB2517629A (en) Device and method for eye tracking data trigger arrangement
WO2014085438A3 (en) Methods, systems, and media for detecting gaze locking