GB2570247A - Detecting physiological responses using thermal and visible-light head-mounted cameras - Google Patents

Detecting physiological responses using thermal and visible-light head-mounted cameras Download PDF

Info

Publication number
GB2570247A
GB2570247A GB1906592.9A GB201906592A GB2570247A GB 2570247 A GB2570247 A GB 2570247A GB 201906592 A GB201906592 A GB 201906592A GB 2570247 A GB2570247 A GB 2570247A
Authority
GB
United Kingdom
Prior art keywords
head
physiological response
thermal
visible
physiological responses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1906592.9A
Other versions
GB201906592D0 (en
GB2570247B (en
Inventor
Tzvieli Arie
Thieberger Gil
M Frank Ari
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Facense Ltd
Original Assignee
Facense Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facense Ltd filed Critical Facense Ltd
Priority to GB2114500.8A priority Critical patent/GB2596733B/en
Publication of GB201906592D0 publication Critical patent/GB201906592D0/en
Publication of GB2570247A publication Critical patent/GB2570247A/en
Application granted granted Critical
Publication of GB2570247B publication Critical patent/GB2570247B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A61B5/015—By temperature mapping of body part
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • G01J5/0025—Living bodies
    • G—PHYSICS
    • G02—OPTICS
    • G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
    • G02C11/00—Non-optical adjuncts; Attachment thereof
    • G02C11/10—Electronic devices other than hearing aids
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A61B5/0816—Measuring devices for examining respiratory frequency
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/41—Detecting, measuring or recording for evaluating the immune or lymphatic systems
    • A61B5/411—Detecting or monitoring allergy or intolerance reactions to an allergenic agent or substance
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J2005/0077—Imaging

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Otolaryngology (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Optics & Photonics (AREA)
  • Acoustics & Sound (AREA)
  • Developmental Disabilities (AREA)
  • Physiology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Pulmonology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Radiation Pyrometers (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

Some aspects of this disclosure involve head-mounted systems that are utilized to take thermal measurements of a user's face to detect various physiological responses, such as an allergic reaction, stress, a headache, a stroke, to name a few. Typically, these systems involve one or more head-mounted thermal cameras that may be physically coupled to a frame worn on the user's head and are utilized to take thermal measurements of one or more regions of interest (ROIs). Some of the systems described in this disclosure are intended for "real world", uncontrolled day-to-day use, in which detection of the physiological response may be hampered by "confounding factors". A confounding factor can be a cause of warming and/or cooling of certain ROIs the face, which is unrelated to a physiological response being detected, and as such, can reduce the accuracy of the detection of the physiological response.
GB1906592.9A 2016-10-14 2017-10-02 Detecting physiological responses based on facial skin color changes Active GB2570247B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB2114500.8A GB2596733B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing thermal camera

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662408677P 2016-10-14 2016-10-14
US201762456105P 2017-02-07 2017-02-07
US201762480496P 2017-04-02 2017-04-02
PCT/IB2017/056069 WO2018069791A1 (en) 2016-10-14 2017-10-02 Detecting physiological responses using thermal and visible-light head-mounted cameras

Publications (3)

Publication Number Publication Date
GB201906592D0 GB201906592D0 (en) 2019-06-26
GB2570247A true GB2570247A (en) 2019-07-17
GB2570247B GB2570247B (en) 2021-12-01

Family

ID=61905195

Family Applications (5)

Application Number Title Priority Date Filing Date
GB1906592.9A Active GB2570247B (en) 2016-10-14 2017-10-02 Detecting physiological responses based on facial skin color changes
GB2114500.8A Expired - Fee Related GB2596733B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing thermal camera
GB1906670.3A Expired - Fee Related GB2570829B (en) 2016-10-14 2017-10-02 Detecting physiological responses based on thermal asymmetry of the face
GB1906669.5A Expired - Fee Related GB2569936B (en) 2016-10-14 2017-10-02 Calculating respiratory parameters from thermal measurements
GB2116877.8A Active GB2598245B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing visible-light camera

Family Applications After (4)

Application Number Title Priority Date Filing Date
GB2114500.8A Expired - Fee Related GB2596733B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing thermal camera
GB1906670.3A Expired - Fee Related GB2570829B (en) 2016-10-14 2017-10-02 Detecting physiological responses based on thermal asymmetry of the face
GB1906669.5A Expired - Fee Related GB2569936B (en) 2016-10-14 2017-10-02 Calculating respiratory parameters from thermal measurements
GB2116877.8A Active GB2598245B (en) 2016-10-14 2017-10-02 Clip-on device with inward-facing visible-light camera

Country Status (3)

Country Link
CN (2) CN110099601A (en)
GB (5) GB2570247B (en)
WO (3) WO2018069789A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2561537B (en) * 2017-02-27 2022-10-12 Emteq Ltd Optical expression detection
IL261235A (en) * 2018-08-19 2020-02-27 Sensority Ltd Machine classification of significant psychophysiological response
EP3716151A1 (en) * 2019-03-25 2020-09-30 Steffen Wirth Stress monitor and stress-monitoring method
US20220346651A1 (en) * 2019-10-04 2022-11-03 Nippon Avionics Co., Ltd. Diseased person distinguishing device and diseased person distinguishing system
TWI750531B (en) * 2019-11-12 2021-12-21 國立勤益科技大學 Detection device and detection method for apnea based on chest respiratory signal
CN111202502B (en) * 2020-01-19 2021-06-15 珠海格力电器股份有限公司 Health index detection method and system, storage medium and health monitoring equipment
CN111248922B (en) * 2020-02-11 2022-05-17 中国科学院半导体研究所 Human body respiration condition acquisition paste based on accelerometer and gyroscope and preparation method thereof
CN111128387A (en) * 2020-02-26 2020-05-08 上海鹰瞳医疗科技有限公司 Method and equipment for establishing epileptic seizure detection model
AU2021263437A1 (en) * 2020-04-30 2022-12-15 Marsupial Holdings, Inc. Extended field-of-view near-to-eye wearable display
US11790586B2 (en) 2020-06-19 2023-10-17 Microsoft Technology Licensing, Llc Generating physio-realistic avatars for training non-contact models to recover physiological characteristics
CN112057074A (en) * 2020-07-21 2020-12-11 北京迈格威科技有限公司 Respiration rate measuring method, respiration rate measuring device, electronic equipment and computer storage medium
US11803237B2 (en) * 2020-11-14 2023-10-31 Facense Ltd. Controlling an eye tracking camera according to eye movement velocity
CN113576452A (en) * 2021-07-30 2021-11-02 深圳市商汤科技有限公司 Respiration rate detection method and device based on thermal imaging and electronic equipment
CN113729725B (en) * 2021-09-30 2024-02-06 东南大学 Method for extracting respiratory waveform from electrocardiosignal based on power spectrum first moment and smoother
CN115738075A (en) * 2021-12-08 2023-03-07 国家康复辅具研究中心 Electrical stimulation rehabilitation training system
CN116110539B (en) * 2023-02-14 2024-03-26 苏州睿酷医疗科技有限责任公司 Pain relief virtual reality system and method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130124039A1 (en) * 2003-04-22 2013-05-16 Marcio Marc Abreu Thermal Imaging System
WO2016025323A1 (en) * 2014-08-10 2016-02-18 Autonomix Medical, Inc. Ans assessment systems, kits, and methods
US20160270656A1 (en) * 2015-03-16 2016-09-22 Magic Leap, Inc. Methods and systems for diagnosing and treating health ailments
US20160360970A1 (en) * 2015-06-14 2016-12-15 Facense Ltd. Wearable device for taking thermal and visual measurements from fixed relative positions
US20170095157A1 (en) * 2015-10-03 2017-04-06 Facense Ltd. Systems for collecting thermal measurements of the face

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2639212A1 (en) * 1988-11-18 1990-05-25 Hennson Int DEVICE FOR MEASURING AND ANALYZING MOVEMENTS OF THE HUMAN BODY OR PARTS THEREOF
JPH09140677A (en) * 1995-11-20 1997-06-03 Matsushita Electric Ind Co Ltd Body temperature measuring apparatus
DE29913602U1 (en) * 1999-08-04 1999-11-25 Oculus Optikgeraete Gmbh Device for eye examination with a Scheimpflug camera and a slit projector for taking sectional images of an eye
GB2385451A (en) * 2002-02-13 2003-08-20 Loadpoint Ltd Monitoring drowsiness
US7066180B2 (en) * 2003-07-09 2006-06-27 Airmatrix Technologies, Inc. Method and system for measuring airflow of nares
RU2395228C2 (en) * 2004-04-01 2010-07-27 Уилльям С. ТОРЧ Biosensors, communicators and controllers for eye movement monitoring and methods of their application
US8472682B2 (en) * 2005-09-12 2013-06-25 Dvp Technologies Ltd. Medical image processing
US20090221888A1 (en) * 2008-03-03 2009-09-03 Ravindra Wijesiriwardana Wearable sensor system for environmental and physiological information monitoring and information feedback system
EP2233071A1 (en) * 2009-03-27 2010-09-29 Koninklijke Philips Electronics N.V. Breathing feedback device
EP2619724A2 (en) * 2010-09-23 2013-07-31 Stryker Corporation Video monitoring system
JP2013030959A (en) * 2011-07-28 2013-02-07 Seiko Instruments Inc Doze monitoring alarm device and doze monitoring alarm method
WO2013177621A1 (en) * 2012-05-30 2013-12-05 Resmed Sensor Technologies Limited Method and apparatus for monitoring cardio-pulmonary health
CN104684465B (en) * 2012-07-12 2017-07-07 菲力尔系统公司 Use the monitoring babies system and method for thermal imaging
CN102973273B (en) * 2012-11-29 2014-12-17 中国人民解放军第四军医大学 Sleep respiratory function monitoring system based on infrared radiation detection
RU2675083C2 (en) * 2012-12-04 2018-12-14 Конинклейке Филипс Н.В. Device and method for obtaining vital sign information of living being
EP2967315B1 (en) * 2013-03-15 2022-07-27 Vasoptic Medical, Inc. Ophthalmic examination and disease management with multiple illumination modalities
US10863098B2 (en) * 2013-06-20 2020-12-08 Microsoft Technology Licensing. LLC Multimodal image sensing for region of interest capture
TWI549649B (en) * 2013-09-24 2016-09-21 廣達電腦股份有限公司 Head mounted system
JP2015092646A (en) * 2013-11-08 2015-05-14 ソニー株式会社 Information processing device, control method, and program
US9672416B2 (en) * 2014-04-29 2017-06-06 Microsoft Technology Licensing, Llc Facial expression tracking
GB2528044B (en) * 2014-07-04 2018-08-22 Arc Devices Ni Ltd Non-touch optical detection of vital signs
US10572679B2 (en) * 2015-01-29 2020-02-25 Affectomatics Ltd. Privacy-guided disclosure of crowd-based scores computed based on measurements of affective response
CA3081166A1 (en) * 2015-01-06 2016-07-14 David Burton Mobile wearable monitoring systems
CN104665787B (en) * 2015-01-26 2017-08-22 周常安 Physiological feedback system
US20160228037A1 (en) * 2015-02-10 2016-08-11 Oridion Medical 1987 Ltd. Homecare asthma management
KR20160108967A (en) * 2015-03-09 2016-09-21 한국전자통신연구원 Device and method for bio-signal measurement
CN105447441B (en) * 2015-03-19 2019-03-29 北京眼神智能科技有限公司 Face authentication method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130124039A1 (en) * 2003-04-22 2013-05-16 Marcio Marc Abreu Thermal Imaging System
WO2016025323A1 (en) * 2014-08-10 2016-02-18 Autonomix Medical, Inc. Ans assessment systems, kits, and methods
US20160270656A1 (en) * 2015-03-16 2016-09-22 Magic Leap, Inc. Methods and systems for diagnosing and treating health ailments
US20160360970A1 (en) * 2015-06-14 2016-12-15 Facense Ltd. Wearable device for taking thermal and visual measurements from fixed relative positions
US20170095157A1 (en) * 2015-10-03 2017-04-06 Facense Ltd. Systems for collecting thermal measurements of the face

Also Published As

Publication number Publication date
GB202114500D0 (en) 2021-11-24
GB2570829B (en) 2021-12-01
GB2596733A (en) 2022-01-05
GB2569936B (en) 2021-12-01
GB201906592D0 (en) 2019-06-26
CN110072438A (en) 2019-07-30
GB2569936A (en) 2019-07-03
GB201906670D0 (en) 2019-06-26
CN110099601A (en) 2019-08-06
GB2598245A (en) 2022-02-23
WO2018069791A1 (en) 2018-04-19
GB2598245B (en) 2022-09-28
WO2018069789A1 (en) 2018-04-19
GB201906669D0 (en) 2019-06-26
GB2570247B (en) 2021-12-01
GB2570829A (en) 2019-08-07
WO2018069790A1 (en) 2018-04-19
GB2596733B (en) 2022-07-06
GB202116877D0 (en) 2022-01-05

Similar Documents

Publication Publication Date Title
GB2570247A (en) Detecting physiological responses using thermal and visible-light head-mounted cameras
WO2015066491A8 (en) Hand hygiene use and tracking in the clinical setting via wearable computers
BR112018016726A2 (en) display device used on the head for virtual and mixed reality with interior-exterior positional tracking of the user's body and environment
WO2017091730A3 (en) Automated health data acquisition, processing and communication system and method
RU2016121419A (en) SYSTEM AND METHOD FOR DETERMINING INFORMATION ON INDICATORS OF Vital IMPORTANT FUNCTIONS OF A SUBJECT
NZ741863A (en) Eye pose identification using eye features
NZ746117A (en) Head mounted display system configured to exchange biometric information
BR112018071163A8 (en) SYSTEMS AND DEVICES FOR MOTION TRACKING, EVALUATION AND MONITORING AND THEIR METHODS OF USE
WO2014138925A8 (en) Wearable computing apparatus and method
WO2015193177A3 (en) User-wearable device and system for personal computing
MX2016009335A (en) Portable electronic hemodynamic sensor systems.
IN2013CH05637A (en)
BR112016021493A2 (en) heart rate data processing method, computer program product and system for processing heart rate data
MX366945B (en) A system and method to detect significant arrhythmic events through a photoplethysmogram (ppg) and accelerometer.
BR112016002488A2 (en) processor for use in a monitoring system for monitoring an individual's hemodynamic state, monitoring system for monitoring an individual's hemodynamic state, processing method for use in a monitoring system for monitoring an individual's hemodynamic state, method of monitoring to monitor an individual's hemodynamic state, and, computer program
BR112015008754A2 (en) stress measurement system to determine a user's stress level
SA515360128B1 (en) Device for evaluating condition of skin or hair
MX2015009946A (en) System and method for determining vital sign information of a subject.
WO2015191183A3 (en) Vision protection method and system thereof
IN2015MN00033A (en)
WO2015015454A3 (en) Gaze tracking system
WO2013165646A3 (en) User input processing with eye tracking
EP4349242A3 (en) Imaging apparatus and method which utilizes multidirectional field of view endoscopy
WO2013111033A3 (en) Medical selection system
SE1851277A1 (en) Equipment recommendation system and method