KR102479049B1 - 주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법 - Google Patents

주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법 Download PDF

Info

Publication number
KR102479049B1
KR102479049B1 KR1020180053895A KR20180053895A KR102479049B1 KR 102479049 B1 KR102479049 B1 KR 102479049B1 KR 1020180053895 A KR1020180053895 A KR 1020180053895A KR 20180053895 A KR20180053895 A KR 20180053895A KR 102479049 B1 KR102479049 B1 KR 102479049B1
Authority
KR
South Korea
Prior art keywords
driver
information
driving
face
pupil
Prior art date
Application number
KR1020180053895A
Other languages
English (en)
Korean (ko)
Other versions
KR20190134909A (ko
Inventor
김진우
김기태
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR1020180053895A priority Critical patent/KR102479049B1/ko
Priority to JP2018209047A priority patent/JP7154959B2/ja
Publication of KR20190134909A publication Critical patent/KR20190134909A/ko
Application granted granted Critical
Publication of KR102479049B1 publication Critical patent/KR102479049B1/ko

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/14—Adaptive cruise control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0809—Driver authorisation; Driver identity check
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B60W2420/42—

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
KR1020180053895A 2018-05-10 2018-05-10 주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법 KR102479049B1 (ko)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020180053895A KR102479049B1 (ko) 2018-05-10 2018-05-10 주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법
JP2018209047A JP7154959B2 (ja) 2018-05-10 2018-11-06 走行状況判断情報基盤の運転者状態認識装置及び方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020180053895A KR102479049B1 (ko) 2018-05-10 2018-05-10 주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법

Publications (2)

Publication Number Publication Date
KR20190134909A KR20190134909A (ko) 2019-12-05
KR102479049B1 true KR102479049B1 (ko) 2022-12-20

Family

ID=68538442

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020180053895A KR102479049B1 (ko) 2018-05-10 2018-05-10 주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법

Country Status (2)

Country Link
JP (1) JP7154959B2 (ja)
KR (1) KR102479049B1 (ja)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112188288B (zh) * 2020-09-04 2023-03-14 青岛海尔科技有限公司 用于控制电视的方法及系统、装置、设备
CN112622892B (zh) * 2020-12-14 2023-03-24 深圳技术大学 基于人脸和肢体姿态识别的紧急制动方法及系统
CN113569674A (zh) * 2021-07-16 2021-10-29 深圳昌恩智能股份有限公司 一种基于智能车载终端的驾驶行为识别方法
KR102411864B1 (ko) * 2021-08-31 2022-06-22 (주)에이아이매틱스 운전자의 익명성을 보장하는 공유 차량의 주행 정보 관리 시스템 및 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007257043A (ja) * 2006-03-20 2007-10-04 Nissan Motor Co Ltd 乗員状態推定装置および乗員状態推定方法
JP2010097379A (ja) 2008-10-16 2010-04-30 Denso Corp ドライバモニタリング装置およびドライバモニタリング装置用のプログラム
JP2011128966A (ja) 2009-12-18 2011-06-30 Denso Corp 顔特徴点検出装置および眠気検出装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007265377A (ja) 2006-03-01 2007-10-11 Toyota Central Res & Dev Lab Inc 運転者状態判定装置及び運転支援装置
US8698639B2 (en) * 2011-02-18 2014-04-15 Honda Motor Co., Ltd. System and method for responding to driver behavior
KR101327007B1 (ko) 2011-10-17 2013-11-13 현대자동차주식회사 차량 운행상태 정보 기반 운전 집중도 판단 방법 및 그 시스템
JP6282769B2 (ja) * 2016-06-23 2018-02-21 株式会社ガイア・システム・ソリューション エンゲージメント値処理システム及びエンゲージメント値処理装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007257043A (ja) * 2006-03-20 2007-10-04 Nissan Motor Co Ltd 乗員状態推定装置および乗員状態推定方法
JP2010097379A (ja) 2008-10-16 2010-04-30 Denso Corp ドライバモニタリング装置およびドライバモニタリング装置用のプログラム
JP2011128966A (ja) 2009-12-18 2011-06-30 Denso Corp 顔特徴点検出装置および眠気検出装置

Also Published As

Publication number Publication date
JP7154959B2 (ja) 2022-10-18
KR20190134909A (ko) 2019-12-05
JP2019197522A (ja) 2019-11-14

Similar Documents

Publication Publication Date Title
KR102479049B1 (ko) 주행상황 판단 정보 기반 운전자 상태 인식 장치 및 방법
US11977675B2 (en) Primary preview region and gaze based driver distraction detection
US11787408B2 (en) System and method for controlling vehicle based on condition of driver
CN112389448B (zh) 一种基于车辆状态和驾驶员状态的异常驾驶行为识别方法
US10372972B2 (en) Face detection apparatus, face detection method, and program
US10417512B2 (en) Driver abnormality detection device and driver abnormality detection method
KR101276770B1 (ko) 사용자 적응형 특이행동 검출기반의 안전운전보조시스템
US10430677B2 (en) Method for classifying driver movements
EP3561720A1 (en) Providing location and driving behavior based alerts
US11572071B2 (en) Method and system for determining awareness data
JP2017151694A (ja) 安全確認診断システム及び安全確認診断方法
EP3588372A1 (en) Controlling an autonomous vehicle based on passenger behavior
KR102161908B1 (ko) 운전자 상태 모니터링 방법 및 장치
CN111434553A (zh) 制动系统、方法、装置、疲劳驾驶模型的训练方法和装置
CN117227740A (zh) 一种智能驾驶车辆的多模态感知系统及方法
JPH0796768A (ja) 前方注視度検知装置
CN111267865B (zh) 基于视觉的安全驾驶预警方法、系统及存储介质
WO2021262166A1 (en) Operator evaluation and vehicle control based on eyewear data
RU2703341C1 (ru) Способ определения опасных состояний на дорогах общего пользования на основе мониторинга ситуации в кабине транспортного средства
KR20120071220A (ko) 시선추적을 통한 안전운전 지원 장치 및 방법
US20240300509A1 (en) Guiding a vehicle based on gaze tracking data
Nair et al. Smart System for Drowsiness and Accident Detection
KR102331937B1 (ko) 주행 위험도 및 운전자 상태 분석에 기초한 차량 긴급 구난 장치
KR102038371B1 (ko) 운전자의 눈 위치 검출 장치 및 방법
CN115158325A (zh) 用于确定人的注视区域的方法和车辆

Legal Events

Date Code Title Description
E902 Notification of reason for refusal
E90F Notification of reason for final refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant