CN110199318B - 驾驶员状态推定装置以及驾驶员状态推定方法 - Google Patents

驾驶员状态推定装置以及驾驶员状态推定方法 Download PDF

Info

Publication number
CN110199318B
CN110199318B CN201780084001.0A CN201780084001A CN110199318B CN 110199318 B CN110199318 B CN 110199318B CN 201780084001 A CN201780084001 A CN 201780084001A CN 110199318 B CN110199318 B CN 110199318B
Authority
CN
China
Prior art keywords
driver
distance
head
unit
seat
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780084001.0A
Other languages
English (en)
Chinese (zh)
Other versions
CN110199318A (zh
Inventor
日向匡史
诹访正树
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omron Corp
Original Assignee
Omron Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omron Corp filed Critical Omron Corp
Publication of CN110199318A publication Critical patent/CN110199318A/zh
Application granted granted Critical
Publication of CN110199318B publication Critical patent/CN110199318B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/529—Depth or shape recovery from texture
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30268—Vehicle interior

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Mathematical Physics (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Measurement Of Optical Distance (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Length Measuring Devices By Optical Means (AREA)
CN201780084001.0A 2017-03-14 2017-07-27 驾驶员状态推定装置以及驾驶员状态推定方法 Active CN110199318B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2017-048503 2017-03-14
JP2017048503A JP6737212B2 (ja) 2017-03-14 2017-03-14 運転者状態推定装置、及び運転者状態推定方法
PCT/JP2017/027245 WO2018167996A1 (ja) 2017-03-14 2017-07-27 運転者状態推定装置、及び運転者状態推定方法

Publications (2)

Publication Number Publication Date
CN110199318A CN110199318A (zh) 2019-09-03
CN110199318B true CN110199318B (zh) 2023-03-07

Family

ID=63522872

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780084001.0A Active CN110199318B (zh) 2017-03-14 2017-07-27 驾驶员状态推定装置以及驾驶员状态推定方法

Country Status (5)

Country Link
US (1) US20200065595A1 (enExample)
JP (1) JP6737212B2 (enExample)
CN (1) CN110199318B (enExample)
DE (1) DE112017007243T5 (enExample)
WO (1) WO2018167996A1 (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7313211B2 (ja) * 2019-07-03 2023-07-24 株式会社Fuji 組付機
JP7170609B2 (ja) * 2019-09-12 2022-11-14 株式会社東芝 画像処理装置、測距装置、方法及びプログラム
WO2021058455A1 (en) * 2019-09-26 2021-04-01 Smart Eye Ab Distance determination between an image sensor and a target area
JP7509157B2 (ja) * 2022-01-18 2024-07-02 トヨタ自動車株式会社 ドライバ監視装置、ドライバ監視用コンピュータプログラム及びドライバ監視方法
US20240166153A1 (en) * 2022-11-18 2024-05-23 Aptiv Technologies AG Camera-Based Vehicle Occupant Sensing
US20240428447A1 (en) * 2023-06-22 2024-12-26 Honeywell International S.R.O. System and method for detecting the positioning of a person relative to a seat
JP7731959B2 (ja) * 2023-11-30 2025-09-01 財団法人車輌研究測試中心 自動運転引継ぎ判定方法及びそのシステム

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1937763A (zh) * 2005-09-19 2007-03-28 乐金电子（昆山）电脑有限公司 移动通讯终端机的困倦感知装置及其困倦驾驶感知方法
JP2015170306A (ja) * 2014-03-10 2015-09-28 サクサ株式会社 画像処理装置
JP2015194884A (ja) * 2014-03-31 2015-11-05 パナソニックＩｐマネジメント株式会社 運転者監視システム
CN105227847A (zh) * 2015-10-30 2016-01-06 上海斐讯数据通信技术有限公司 一种手机的相机拍照方法和系统
JP2016045713A (ja) * 2014-08-22 2016-04-04 株式会社デンソー 車載制御装置
US9338363B1 (en) * 2014-11-06 2016-05-10 General Electric Company Method and system for magnification correction from multiple focus planes
CN105678802A (zh) * 2014-04-21 2016-06-15 杨祖立 辨识二维影像产生三维信息的方法
CN105829965A (zh) * 2013-12-18 2016-08-03 株式会社电装 脸部图像拍摄装置、以及驾驶员状态判定装置
CN106463065A (zh) * 2014-06-23 2017-02-22 株式会社电装 驾驶员的驾驶不能状态检测装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7570785B2 (en) * 1995-06-07 2009-08-04 Automotive Technologies International, Inc. Face monitoring system and method for vehicular occupants
US7508979B2 (en) * 2003-11-21 2009-03-24 Siemens Corporate Research, Inc. System and method for detecting an occupant and head pose using stereo detectors
JP6140935B2 (ja) * 2012-05-17 2017-06-07 キヤノン株式会社 画像処理装置、画像処理方法、画像処理プログラム、および撮像装置
WO2014107434A1 (en) * 2013-01-02 2014-07-10 California Institute Of Technology Single-sensor system for extracting depth information from image blur
JP2014218140A (ja) 2013-05-07 2014-11-20 株式会社デンソー 運転者状態監視装置、および運転者状態監視方法
JP2015036632A (ja) * 2013-08-12 2015-02-23 キヤノン株式会社 距離計測装置、撮像装置、距離計測方法
JP6429444B2 (ja) * 2013-10-02 2018-11-28 キヤノン株式会社 画像処理装置、撮像装置及び画像処理方法
CN103905735B (zh) * 2014-04-17 2017-10-27 深圳市世尊科技有限公司 具有动态追拍功能的移动终端及其动态追拍方法
JP2016110374A (ja) * 2014-12-05 2016-06-20 富士通テン株式会社 情報処理装置、情報処理方法、および、情報処理システム

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1937763A (zh) * 2005-09-19 2007-03-28 乐金电子（昆山）电脑有限公司 移动通讯终端机的困倦感知装置及其困倦驾驶感知方法
CN105829965A (zh) * 2013-12-18 2016-08-03 株式会社电装 脸部图像拍摄装置、以及驾驶员状态判定装置
JP2015170306A (ja) * 2014-03-10 2015-09-28 サクサ株式会社 画像処理装置
JP2015194884A (ja) * 2014-03-31 2015-11-05 パナソニックＩｐマネジメント株式会社 運転者監視システム
CN105678802A (zh) * 2014-04-21 2016-06-15 杨祖立 辨识二维影像产生三维信息的方法
CN106463065A (zh) * 2014-06-23 2017-02-22 株式会社电装 驾驶员的驾驶不能状态检测装置
JP2016045713A (ja) * 2014-08-22 2016-04-04 株式会社デンソー 車載制御装置
US9338363B1 (en) * 2014-11-06 2016-05-10 General Electric Company Method and system for magnification correction from multiple focus planes
CN105227847A (zh) * 2015-10-30 2016-01-06 上海斐讯数据通信技术有限公司 一种手机的相机拍照方法和系统

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Active depth from defocus system using coherent illumination and a no moving parts camera;M. Junaid Amin et al.;《Optics Communications》;20160115;第359卷;第135-145页 *
基于双目视觉的植物叶片三维形态与光照度同步测量;于合龙等;《农业工程学报》;20160531;第32卷(第10期);第149-156页 *
基于图像处理的自动对焦技术综述;尤玉虎等;《激光与红外》;20130228;第43卷(第2期);第132-136页 *

Also Published As

Publication number Publication date
WO2018167996A1 (ja) 2018-09-20
JP2018151931A (ja) 2018-09-27
DE112017007243T5 (de) 2019-12-12
CN110199318A (zh) 2019-09-03
JP6737212B2 (ja) 2020-08-05
US20200065595A1 (en) 2020-02-27

Similar Documents

Publication Publication Date Title
CN110199318B (zh) 驾驶员状态推定装置以及驾驶员状态推定方法
US11281288B2 (en) Eye and head tracking
US9405982B2 (en) Driver gaze detection system
EP2360638B1 (en) Method, system and computer program product for obtaining a point spread function using motion information
CN104573623B (zh) 人脸检测装置、方法
US8620066B2 (en) Three-dimensional object determining apparatus, method, and computer program product
US11455810B2 (en) Driver attention state estimation
JP7019394B2 (ja) 視認対象検知装置、視認対象検知方法、およびプログラム
US11144756B2 (en) Method and system of distinguishing between a glance event and an eye closure event
JP2010191793A (ja) 警告表示装置及び警告表示方法
CN111052174A (zh) 图像处理设备、图像处理方法和程序
JP6971582B2 (ja) 状態検出装置、状態検出方法、及びプログラム
JP5498183B2 (ja) 行動検出装置
WO2018168038A1 (ja) 運転者の着座判定装置
WO2018167995A1 (ja) 運転者状態推定装置、及び運転者状態推定方法
CN110235178A (zh) 驾驶员状态推定装置以及驾驶员状态推定方法
KR20230096530A (ko) 주행 제어 장치 및 방법
KR101610496B1 (ko) 시선 추적 방법 및 장치
US20210082140A1 (en) Estimation device, estimation method, and computer program product
JP2019020171A (ja) 車幅検出装置、車幅検出方法、およびプログラム
JP4825737B2 (ja) 開眼度判定装置
JP2021043637A (ja) 運転者モニタ装置
JP2017194345A (ja) 顔向き計測装置
KR102038371B1 (ko) 운전자의 눈 위치 검출 장치 및 방법
JP6519499B2 (ja) 車両用システム及びコンピュータプログラム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant