JP7286022B2 - 乗員状態検出装置および乗員状態検出方法 - Google Patents

乗員状態検出装置および乗員状態検出方法 Download PDF

Info

Publication number
JP7286022B2
JP7286022B2 JP2022534604A JP2022534604A JP7286022B2 JP 7286022 B2 JP7286022 B2 JP 7286022B2 JP 2022534604 A JP2022534604 A JP 2022534604A JP 2022534604 A JP2022534604 A JP 2022534604A JP 7286022 B2 JP7286022 B2 JP 7286022B2
Authority
JP
Japan
Prior art keywords
occupant
temperature
movement
hand
detection unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022534604A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022009401A5 (https=
JPWO2022009401A1 (https=
Inventor
浩隆 坂本
俊之 八田
信太郎 渡邉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of JPWO2022009401A1 publication Critical patent/JPWO2022009401A1/ja
Publication of JPWO2022009401A5 publication Critical patent/JPWO2022009401A5/ja
Application granted granted Critical
Publication of JP7286022B2 publication Critical patent/JP7286022B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W40/09—Driving style or behaviour
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A61B5/015—By temperature mapping of body part
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique using image analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/09626—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages where the origin of the information is within the own vehicle, e.g. a local storage device, digital map
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/26—Incapacity

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Mathematical Physics (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Child & Adolescent Psychology (AREA)
  • Dentistry (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Physiology (AREA)
  • Psychology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Developmental Disabilities (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
JP2022534604A 2020-07-09 2020-07-09 乗員状態検出装置および乗員状態検出方法 Active JP7286022B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/026913 WO2022009401A1 (ja) 2020-07-09 2020-07-09 乗員状態検出装置および乗員状態検出方法

Publications (3)

Publication Number Publication Date
JPWO2022009401A1 JPWO2022009401A1 (https=) 2022-01-13
JPWO2022009401A5 JPWO2022009401A5 (https=) 2022-09-09
JP7286022B2 true JP7286022B2 (ja) 2023-06-02

Family

ID=79552356

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022534604A Active JP7286022B2 (ja) 2020-07-09 2020-07-09 乗員状態検出装置および乗員状態検出方法

Country Status (4)

Country Link
US (1) US12240469B2 (https=)
JP (1) JP7286022B2 (https=)
DE (1) DE112020007404T5 (https=)
WO (1) WO2022009401A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112020007404T5 (de) * 2020-07-09 2023-05-17 Mitsubishi Electric Corporation Insassenzustandserkennungsvorrichtung und insassenzustandserkennungsverfahren
JP2024037353A (ja) * 2022-09-07 2024-03-19 いすゞ自動車株式会社 車両制御装置
WO2026013777A1 (ja) * 2024-07-10 2026-01-15 三菱電機モビリティ株式会社 運転支援装置、運転支援方法、および、運転支援システム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012164040A (ja) 2011-02-04 2012-08-30 Nissan Motor Co Ltd 覚醒低下検出装置
JP2017127616A (ja) 2015-07-22 2017-07-27 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 覚醒度予測方法および覚醒度予測装置
JP2018127112A (ja) 2017-02-08 2018-08-16 パナソニックＩｐマネジメント株式会社 覚醒度推定装置及び覚醒度推定方法
US20190049267A1 (en) 2018-03-28 2019-02-14 Intel Corporation Safety enhanced computer assisted driving method and apparatus

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001137194A (ja) * 1999-11-12 2001-05-22 Matsushita Electric Ind Co Ltd 居眠り検出装置
JP2005075198A (ja) * 2003-09-02 2005-03-24 Calsonic Kansei Corp 車両用空調装置
US7183932B2 (en) * 2005-03-21 2007-02-27 Toyota Technical Center Usa, Inc Inter-vehicle drowsy driver advisory system
RU2011119211A (ru) * 2008-11-13 2012-12-20 Асер Рич Лимитед. Система и способ повышения безопасности транспортного средства путем улучшения знания ситуации водителем транспортного средства
JP2011123653A (ja) 2009-12-10 2011-06-23 Sumitomo Rubber Ind Ltd 運転者覚醒度検査装置
US9789869B2 (en) * 2012-11-02 2017-10-17 Toyota Jidosha Kabushiki Kaisha Driving support apparatus and driving support method
US9821657B2 (en) * 2015-04-22 2017-11-21 Motorola Mobility Llc Drowsy driver detection
KR20160139756A (ko) * 2015-05-28 2016-12-07 주식회사 엠투브 차량간 비콘 메시지 송수신 시스템 및 방법
US10716502B2 (en) 2015-07-22 2020-07-21 Panasonic Intellectual Property Corporation Of America Method for predicting arousal level and arousal level prediction apparatus
US10137848B2 (en) * 2016-01-13 2018-11-27 Ford Global Technologies, Llc System identifying a driver before they approach the vehicle using wireless communication protocols
US10562412B1 (en) * 2016-03-24 2020-02-18 Xsensor Technology Corporation Intelligent seat systems
US11279279B2 (en) * 2016-12-22 2022-03-22 Sri International Driver monitoring and response system
JP2019074791A (ja) * 2017-10-12 2019-05-16 株式会社デンソー 車両用運転支援装置
US10322728B1 (en) * 2018-02-22 2019-06-18 Futurewei Technologies, Inc. Method for distress and road rage detection
WO2019221240A1 (ja) * 2018-05-16 2019-11-21 社会医療法人蘇西厚生会 まつなみリサーチパーク 安全運転支援システム
JP2021530069A (ja) * 2018-06-26 2021-11-04 カッツ，イテイ 状況的ドライバ監視システム
DE112020007404T5 (de) * 2020-07-09 2023-05-17 Mitsubishi Electric Corporation Insassenzustandserkennungsvorrichtung und insassenzustandserkennungsverfahren

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012164040A (ja) 2011-02-04 2012-08-30 Nissan Motor Co Ltd 覚醒低下検出装置
JP2017127616A (ja) 2015-07-22 2017-07-27 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 覚醒度予測方法および覚醒度予測装置
JP2018127112A (ja) 2017-02-08 2018-08-16 パナソニックＩｐマネジメント株式会社 覚醒度推定装置及び覚醒度推定方法
US20190049267A1 (en) 2018-03-28 2019-02-14 Intel Corporation Safety enhanced computer assisted driving method and apparatus

Also Published As

Publication number Publication date
DE112020007404T5 (de) 2023-05-17
WO2022009401A1 (ja) 2022-01-13
US12240469B2 (en) 2025-03-04
US20230211791A1 (en) 2023-07-06
JPWO2022009401A1 (https=) 2022-01-13

Similar Documents

Publication Publication Date Title
Ramzan et al. A survey on state-of-the-art drowsiness detection techniques
CN115439832B (zh) 监测车辆乘员的方法和系统
JP7286022B2 (ja) 乗員状態検出装置および乗員状態検出方法
JP2023171650A (ja) プライバシーの保護を伴う人物の識別しおよび／または痛み、疲労、気分、および意図の識別および定量化のためのシステムおよび方法
JP5326521B2 (ja) 覚醒状態判断装置及び覚醒状態判断方法
Kuru et al. Biomedical visual data analysis to build an intelligent diagnostic decision support system in medical genetics
CN106716515A (zh) 驾驶员状态判定装置
CN114423343A (zh) 认知功能推测装置、学习装置及认知功能推测方法
JP7118136B2 (ja) 搭乗者状態判定装置、警告出力制御装置及び搭乗者状態判定方法
US11161470B2 (en) Occupant observation device
CN109657550B (zh) 一种疲劳度检测方法及装置
US11077814B2 (en) Occupant eye(s) observation device
Rosero-Montalvo et al. Multivariate approach to alcohol detection in drivers by sensors and artificial vision
JP7611839B2 (ja) 異常状態推定装置および異常状態推定方法
CN112740221A (zh) 生物测定数据捕获和分析
JP5139470B2 (ja) 眠気度推定装置および眠気度推定方法
Alam et al. Vision-based driver’s attention monitoring system for smart vehicles
JP6344254B2 (ja) 眠気検知装置
Yin et al. A driver fatigue detection method based on multi-sensor signals
KR20170028631A (ko) 정면 얼굴 영상의 복원을 통한 운전자 부주의 검출 방법 및 장치
CN114084145A (zh) 车辆及其控制方法
JP2020057198A (ja) 眠気発生予測装置
Kamble Driver drowsiness detection system based on yawn detection
JP5493676B2 (ja) 眼位置認識装置
JP2017209262A (ja) 眠気検知装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220705

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220705

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230425

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230523

R150 Certificate of patent or registration of utility model

Ref document number: 7286022

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150