JP2023505111A - 光学データからの生理学的測定のためのシステムおよび方法 - Google Patents

光学データからの生理学的測定のためのシステムおよび方法 Download PDF

Info

Publication number
JP2023505111A
JP2023505111A JP2022532066A JP2022532066A JP2023505111A JP 2023505111 A JP2023505111 A JP 2023505111A JP 2022532066 A JP2022532066 A JP 2022532066A JP 2022532066 A JP2022532066 A JP 2022532066A JP 2023505111 A JP2023505111 A JP 2023505111A
Authority
JP
Japan
Prior art keywords
face
optical data
camera
data
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022532066A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023505111A5 (https=
Inventor
ママン,デイビッド
ゲダリン,コンスタンティン
マルクゾン,マイケル
Original Assignee
ビナー.エーアイ リミテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ビナー.エーアイ リミテッド filed Critical ビナー.エーアイ リミテッド
Publication of JP2023505111A publication Critical patent/JP2023505111A/ja
Publication of JP2023505111A5 publication Critical patent/JP2023505111A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • G06T7/0014Biomedical image inspection using an image reference approach
    • G06T7/0016Biomedical image inspection using an image reference approach involving temporal comparison
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024Measuring pulse rate or heart rate
    • A61B5/02405Determining heart rate variability
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024Measuring pulse rate or heart rate
    • A61B5/02416Measuring pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A61B5/14551Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A61B5/14551Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
    • A61B5/14557Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases specially adapted to extracorporeal circuits
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/021Measuring pressure in heart or blood vessels
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024Measuring pulse rate or heart rate
    • A61B5/02438Measuring pulse rate or heart rate with portable devices, e.g. worn by the patient
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/14542Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue for measuring blood gases
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30076Plethysmography

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Cardiology (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Theoretical Computer Science (AREA)
  • Physiology (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Optics & Photonics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Investigating Or Analysing Materials By The Use Of Chemical Reactions (AREA)
  • Image Analysis (AREA)
JP2022532066A 2019-12-02 2020-12-01 光学データからの生理学的測定のためのシステムおよび方法 Pending JP2023505111A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962942247P 2019-12-02 2019-12-02
US62/942,247 2019-12-02
PCT/IL2020/051238 WO2021111436A1 (en) 2019-12-02 2020-12-01 System and method for physiological measurements from optical data

Publications (2)

Publication Number Publication Date
JP2023505111A true JP2023505111A (ja) 2023-02-08
JP2023505111A5 JP2023505111A5 (https=) 2023-12-05

Family

ID=76222491

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022532066A Pending JP2023505111A (ja) 2019-12-02 2020-12-01 光学データからの生理学的測定のためのシステムおよび方法

Country Status (7)

Country Link
US (1) US20230000376A1 (https=)
EP (1) EP4033972A4 (https=)
JP (1) JP2023505111A (https=)
CN (1) CN114929101A (https=)
CA (1) CA3159539A1 (https=)
IL (1) IL293538A (https=)
WO (1) WO2021111436A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013102144A2 (en) 2011-12-30 2013-07-04 Halozyme, Inc. Ph20 polypeptede variants, formulations and uses thereof
US12226188B2 (en) 2012-12-31 2025-02-18 Omni Medsci, Inc. Active illumination and time-of-flight camera system to evaluate facial blood flow, eye movements and physiological parameters
US12193790B2 (en) 2012-12-31 2025-01-14 Omni Medsci, Inc. Wearable devices comprising semiconductor diode light sources with improved signal-to-noise ratio
US10660526B2 (en) 2012-12-31 2020-05-26 Omni Medsci, Inc. Near-infrared time-of-flight imaging using laser diodes with Bragg reflectors
US12484787B2 (en) 2012-12-31 2025-12-02 Omni Medsci, Inc. Measurements using camera imaging tissue comprising skin or the hand
US12502080B2 (en) 2012-12-31 2025-12-23 Omni Medsci, Inc. Camera based wearable devices with artificial intelligence assistants
USD958171S1 (en) * 2020-08-14 2022-07-19 Cooey Health, Inc. Display screen with graphical user interface for clinician-patient video conference
US20230320667A1 (en) * 2022-04-07 2023-10-12 Faceheart Inc Corporation Contactless physiological measurement device and method
WO2023214957A1 (en) * 2022-05-02 2023-11-09 Elite HRV, Inc. Machine learning models for estimating physiological biomarkers
US20240041334A1 (en) * 2022-08-04 2024-02-08 Biotrillion, Inc. Systems and methods for measuring physiologic vital signs and biomarkers using optical data
TWI874153B (zh) * 2024-03-06 2025-02-21 國立成功大學 用於辨識心律不整之影像重建ecg訊號方法及其偵測系統

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007072861A (ja) * 2005-09-08 2007-03-22 Omron Corp なりすまし検出装置及び顔認証装置
JP2011091510A (ja) * 2009-10-20 2011-05-06 Canon Inc 画像処理装置およびその制御方法
JP2014198201A (ja) * 2013-03-29 2014-10-23 富士通株式会社 脈波検出プログラム、脈波検出方法および脈波検出装置
JP2015515873A (ja) * 2012-05-01 2015-06-04 コーニンクレッカ フィリップス エヌ ヴェ 遠隔検出される特性信号から情報を抽出するデバイス及び方法
CN105147274A (zh) * 2015-08-04 2015-12-16 河北工业大学 一种从可见光谱段人脸视频信号中提取心率的方法
JP2016083342A (ja) * 2014-10-27 2016-05-19 タタ コンサルタンシー サービシズ リミテッドTATA Consultancy Services Limited 生理学的パラメータの推定
WO2016162980A1 (ja) * 2015-04-08 2016-10-13 オリンパス株式会社 画像処理装置、撮像装置、画像処理方法およびプログラム
JP2016214519A (ja) * 2015-05-19 2016-12-22 日本電信電話株式会社 本人確認システム、本人確認方法、ユーザ端末、本人確認機器、及び血圧測定装置
JP2017000625A (ja) * 2015-06-15 2017-01-05 フォスター電機株式会社 信号処理方法、生体信号処理方法、信号処理装置及び生体信号処理装置
WO2017163248A1 (en) * 2016-03-22 2017-09-28 Multisense Bv System and methods for authenticating vital sign measurements for biometrics detection using photoplethysmography via remote sensors
US20180085009A1 (en) * 2016-09-27 2018-03-29 OCR Labs Pty Ltd Method and system for detecting user heart rate using live camera feed
JP2018068720A (ja) * 2016-10-31 2018-05-10 三星電子株式会社Samsung Electronics Co.,Ltd. 脈拍検出装置及び脈拍検出方法
JP2018102906A (ja) * 2016-12-27 2018-07-05 三星電子株式会社Samsung Electronics Co.,Ltd. 接触型血圧測定装置及びその血圧測定方法
US20180360330A1 (en) * 2015-12-18 2018-12-20 Xim Limited A method, information processing apparatus and server for determining a physiological parameter of an individual
EP3440996A1 (en) * 2017-08-08 2019-02-13 Koninklijke Philips N.V. Device, system and method for determining a physiological parameter of a subject
JP2019511941A (ja) * 2016-03-01 2019-05-09 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. 対象のバイタルサインを決定するデバイス、システム及び方法
WO2019110312A1 (en) * 2017-12-05 2019-06-13 Koninklijke Philips N.V. A system and method for detecting motion sickness
JP2021096537A (ja) * 2019-12-13 2021-06-24 シャープ株式会社 生体情報取得装置、端末装置、生体情報取得方法、生体情報取得プログラム、及びコンピュータ読み取り可能な記録媒体

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10667723B2 (en) * 2016-02-19 2020-06-02 Covidien Lp Systems and methods for video-based monitoring of vital signs
US11259710B2 (en) * 2018-05-16 2022-03-01 Mitsubishi Electric Research Laboratories, Inc. System and method for remote measurements of vital signs
US10799182B2 (en) * 2018-10-19 2020-10-13 Microsoft Technology Licensing, Llc Video-based physiological measurement using neural networks

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007072861A (ja) * 2005-09-08 2007-03-22 Omron Corp なりすまし検出装置及び顔認証装置
JP2011091510A (ja) * 2009-10-20 2011-05-06 Canon Inc 画像処理装置およびその制御方法
JP2015515873A (ja) * 2012-05-01 2015-06-04 コーニンクレッカ フィリップス エヌ ヴェ 遠隔検出される特性信号から情報を抽出するデバイス及び方法
JP2014198201A (ja) * 2013-03-29 2014-10-23 富士通株式会社 脈波検出プログラム、脈波検出方法および脈波検出装置
JP2016083342A (ja) * 2014-10-27 2016-05-19 タタ コンサルタンシー サービシズ リミテッドTATA Consultancy Services Limited 生理学的パラメータの推定
WO2016162980A1 (ja) * 2015-04-08 2016-10-13 オリンパス株式会社 画像処理装置、撮像装置、画像処理方法およびプログラム
JP2016214519A (ja) * 2015-05-19 2016-12-22 日本電信電話株式会社 本人確認システム、本人確認方法、ユーザ端末、本人確認機器、及び血圧測定装置
JP2017000625A (ja) * 2015-06-15 2017-01-05 フォスター電機株式会社 信号処理方法、生体信号処理方法、信号処理装置及び生体信号処理装置
CN105147274A (zh) * 2015-08-04 2015-12-16 河北工业大学 一种从可见光谱段人脸视频信号中提取心率的方法
US20180360330A1 (en) * 2015-12-18 2018-12-20 Xim Limited A method, information processing apparatus and server for determining a physiological parameter of an individual
JP2019511941A (ja) * 2016-03-01 2019-05-09 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. 対象のバイタルサインを決定するデバイス、システム及び方法
WO2017163248A1 (en) * 2016-03-22 2017-09-28 Multisense Bv System and methods for authenticating vital sign measurements for biometrics detection using photoplethysmography via remote sensors
US20180085009A1 (en) * 2016-09-27 2018-03-29 OCR Labs Pty Ltd Method and system for detecting user heart rate using live camera feed
JP2018068720A (ja) * 2016-10-31 2018-05-10 三星電子株式会社Samsung Electronics Co.,Ltd. 脈拍検出装置及び脈拍検出方法
JP2018102906A (ja) * 2016-12-27 2018-07-05 三星電子株式会社Samsung Electronics Co.,Ltd. 接触型血圧測定装置及びその血圧測定方法
EP3440996A1 (en) * 2017-08-08 2019-02-13 Koninklijke Philips N.V. Device, system and method for determining a physiological parameter of a subject
WO2019110312A1 (en) * 2017-12-05 2019-06-13 Koninklijke Philips N.V. A system and method for detecting motion sickness
JP2021096537A (ja) * 2019-12-13 2021-06-24 シャープ株式会社 生体情報取得装置、端末装置、生体情報取得方法、生体情報取得プログラム、及びコンピュータ読み取り可能な記録媒体

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FREDERIC BOUSEFSAF ET AL.: "3D Convolutional Neural Networks for Remote Pulse Rate Measurement and Mapping from Facial Video", APPLIED SCIENCES, vol. 9, no. 20, JPN7024003862, 2019, pages 4364 - 1, ISSN: 0005416681 *
YUNYOUNG NAM ET AL.: "Photoplethysmography Signal Analysis for Optimal Region-of-Interest Determination in Video Imaging o", SENSORS, vol. 17, no. 10, JPN7024003863, 2017, pages 17102385 - 1, ISSN: 0005416680 *

Also Published As

Publication number Publication date
CA3159539A1 (en) 2021-06-10
CN114929101A (zh) 2022-08-19
WO2021111436A1 (en) 2021-06-10
IL293538A (en) 2022-08-01
EP4033972A4 (en) 2024-01-10
EP4033972A1 (en) 2022-08-03
US20230000376A1 (en) 2023-01-05

Similar Documents

Publication Publication Date Title
JP2023505111A (ja) 光学データからの生理学的測定のためのシステムおよび方法
JP2023546451A (ja) 光学データからの血圧測定値のためのシステム及び方法
Sarkar et al. Cardiogan: Attentive generative adversarial network with dual discriminators for synthesis of ecg from ppg
CN115003215A (zh) 根据光学数据进行脉搏传播时间测量的系统和方法
Qiao et al. Measuring heart rate and heart rate variability with smartphone camera
Gudi et al. Efficient real-time camera based estimation of heart rate and its variability
Qiao et al. Revise: Remote vital signs measurement using smartphone camera
JP2023545426A (ja) 光学データによる血中アルコール測定値のためのシステム及び方法
US20250082212A1 (en) System and method for blood pressure estimate based on ptt from the face
JP2019097757A5 (https=)
WO2022067439A1 (en) Method and apparatus for generating an electrocardiogram from a photoplethysmogram
US12533040B2 (en) Non-contact image-based blood pressure measurement method and system based on advanced visual intelligence
Hwang et al. Phase-shifted remote photoplethysmography for estimating heart rate and blood pressure from facial video
WO2025175923A1 (zh) 血压估计方法及装置、电子设备、存储介质
Pursche et al. Using the Hilbert-Huang transform to increase the robustness of video based remote heart-rate measurement from human faces
Le et al. Heart rate estimation based on facial image sequence
CN117958777A (zh) 非侵入式血压检测系统、方法、电子设备和存储介质
Lee et al. Video-based bio-signal measurements for a mobile healthcare system
CN116269285B (zh) 一种非接触式常态化心率变异性估计系统
Abdelwahab et al. Enhanced DeepPhys: Leveraging Deep Learning for Heart Rate Detection from Facial Videos
Penke An Efficient Approach to Estimating Heart Rate from Facial Videos with Accurate Region of Interest
Wang et al. Generative Adversarial Network for Photoplethysmography Reconstruction
Kadam et al. Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs Monitoring
CN120814799A (zh) 一种无创动态血压监测方法、装置、存储介质及计算机
Regis et al. Robust probabilistic modeling of photoplethysmography signals with application to the classification of premature beats

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231127

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20231127

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231214

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240909

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240917

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20241216

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20250311