JP7278425B2 - 瞳孔検出装置、視線検出装置、搭乗者監視システム及び瞳孔検出方法 - Google Patents

瞳孔検出装置、視線検出装置、搭乗者監視システム及び瞳孔検出方法 Download PDF

Info

Publication number
JP7278425B2
JP7278425B2 JP2021569641A JP2021569641A JP7278425B2 JP 7278425 B2 JP7278425 B2 JP 7278425B2 JP 2021569641 A JP2021569641 A JP 2021569641A JP 2021569641 A JP2021569641 A JP 2021569641A JP 7278425 B2 JP7278425 B2 JP 7278425B2
Authority
JP
Japan
Prior art keywords
evaluation value
image
unit
pupil
evaluation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021569641A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021140579A1 (https=
Inventor
篤 松本
亮介 虎間
信太郎 渡邉
遼平 村地
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of JPWO2021140579A1 publication Critical patent/JPWO2021140579A1/ja
Application granted granted Critical
Publication of JP7278425B2 publication Critical patent/JP7278425B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30268—Vehicle interior

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Software Systems (AREA)
  • Psychology (AREA)
  • Pathology (AREA)
  • Psychiatry (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • Social Psychology (AREA)
  • Image Analysis (AREA)
  • Eye Examination Apparatus (AREA)
  • Image Processing (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
JP2021569641A 2020-01-08 2020-01-08 瞳孔検出装置、視線検出装置、搭乗者監視システム及び瞳孔検出方法 Active JP7278425B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/000213 WO2021140579A1 (ja) 2020-01-08 2020-01-08 瞳孔検出装置、視線検出装置、搭乗者監視システム及び瞳孔検出方法

Publications (2)

Publication Number Publication Date
JPWO2021140579A1 JPWO2021140579A1 (https=) 2021-07-15
JP7278425B2 true JP7278425B2 (ja) 2023-05-19

Family

ID=76788835

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021569641A Active JP7278425B2 (ja) 2020-01-08 2020-01-08 瞳孔検出装置、視線検出装置、搭乗者監視システム及び瞳孔検出方法

Country Status (4)

Country Link
US (1) US12277728B2 (https=)
JP (1) JP7278425B2 (https=)
DE (1) DE112020006447T5 (https=)
WO (1) WO2021140579A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7746738B2 (ja) * 2021-08-27 2025-10-01 Ｔｏｐｐａｎホールディングス株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム
WO2023144951A1 (ja) * 2022-01-27 2023-08-03 三菱電機株式会社 乗員状態検知装置および乗員状態検知方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002056394A (ja) 2000-08-09 2002-02-20 Matsushita Electric Ind Co Ltd 眼位置検出方法および眼位置検出装置
WO2010035472A1 (ja) 2008-09-26 2010-04-01 パナソニック株式会社 視線方向判定装置及び視線方向判定方法
US20100092049A1 (en) 2008-04-08 2010-04-15 Neuro Kinetics, Inc. Method of Precision Eye-Tracking Through Use of Iris Edge Based Landmarks in Eye Geometry
JP2012024154A (ja) 2010-07-20 2012-02-09 Panasonic Corp 瞳孔検出装置及び瞳孔検出方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5872818B2 (ja) * 2010-08-20 2016-03-01 パナソニック株式会社 測位処理装置、測位処理方法、および画像処理装置
JP4893862B1 (ja) * 2011-03-11 2012-03-07 オムロン株式会社 画像処理装置、および画像処理方法
US9505413B2 (en) * 2015-03-20 2016-11-29 Harman International Industries, Incorporated Systems and methods for prioritized driver alerts
JP2017182739A (ja) * 2016-03-31 2017-10-05 富士通株式会社 視線検出装置、視線検出方法及び視線検出用コンピュータプログラム
US10521659B2 (en) * 2016-11-21 2019-12-31 Yazaki Corporation Image processing device, image processing method, and image processing program
JP7052256B2 (ja) * 2017-08-25 2022-04-12 富士通株式会社 画像処理装置、画像処理方法、及び画像処理プログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002056394A (ja) 2000-08-09 2002-02-20 Matsushita Electric Ind Co Ltd 眼位置検出方法および眼位置検出装置
US20100092049A1 (en) 2008-04-08 2010-04-15 Neuro Kinetics, Inc. Method of Precision Eye-Tracking Through Use of Iris Edge Based Landmarks in Eye Geometry
WO2010035472A1 (ja) 2008-09-26 2010-04-01 パナソニック株式会社 視線方向判定装置及び視線方向判定方法
JP2012024154A (ja) 2010-07-20 2012-02-09 Panasonic Corp 瞳孔検出装置及び瞳孔検出方法

Also Published As

Publication number Publication date
WO2021140579A1 (ja) 2021-07-15
JPWO2021140579A1 (https=) 2021-07-15
US12277728B2 (en) 2025-04-15
DE112020006447T5 (de) 2022-10-27
US20230043992A1 (en) 2023-02-09

Similar Documents

Publication Publication Date Title
JP6695503B2 (ja) 車両の運転者の状態を監視するための方法及びシステム
US11455810B2 (en) Driver attention state estimation
CN104573623B (zh) 人脸检测装置、方法
US9405982B2 (en) Driver gaze detection system
US7599524B2 (en) Method and apparatus for providing a robust object finder
US7362885B2 (en) Object tracking and eye state identification method
KR101914362B1 (ko) 차량 내/외부 정보 통합 분석 기반의 위험 상황 경고 시스템 및 그 방법
CN113661495A (zh) 视线校准方法及装置、设备、计算机可读存储介质、系统、车辆
EP3893090A1 (en) Method for eye gaze tracking
CN113632098A (zh) 人脸图像处理方法、装置和车辆
WO2015019542A1 (ja) 視野算出装置および視野算出方法
CN103493100B (zh) 眼睑检测装置、眼睑检测方法
CN114290998A (zh) 一种天窗显示控制装置、方法及设备
JP7278425B2 (ja) 瞳孔検出装置、視線検出装置、搭乗者監視システム及び瞳孔検出方法
JP2010191793A (ja) 警告表示装置及び警告表示方法
CN115035499A (zh) 用于确定注视区域的方法、车辆控制方法及装置
JP2020086956A (ja) 撮影異常診断装置
US20190259279A1 (en) Luminance control device, luminance control system, and luminance control method
JP2018101212A (ja) 車載器および顔正面度算出方法
JP2022128697A (ja) 視線検出装置
KR102906380B1 (ko) 운전자의 뇌졸증 전조증상을 검출하기 위한 장치 및 방법
US12511780B2 (en) Device, method, and computer program for estimating seat position
CN118544806A (zh) 一种信息显示方法、装置、车辆及介质
CN115937246B (zh) 动目标检测方法及装置、电子设备及计算机可读存储介质
WO2021171395A1 (ja) 瞳孔位置検出装置、視線検出装置、及び瞳孔位置検出方法

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220324

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221115

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221219

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230411

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230509

R150 Certificate of patent or registration of utility model

Ref document number: 7278425

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150