CN109076176A - 眼睛位置检测装置和方法、带滚动快门驱动系统的图像传感器的成像装置及其照明控制方法 - Google Patents

眼睛位置检测装置和方法、带滚动快门驱动系统的图像传感器的成像装置及其照明控制方法 Download PDF

Info

Publication number
CN109076176A
CN109076176A CN201680085009.4A CN201680085009A CN109076176A CN 109076176 A CN109076176 A CN 109076176A CN 201680085009 A CN201680085009 A CN 201680085009A CN 109076176 A CN109076176 A CN 109076176A
Authority
CN
China
Prior art keywords
unit
light
image
illumination
camera unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201680085009.4A
Other languages
English (en)
Chinese (zh)
Inventor
康世珍
姜度荣
尹汉老
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MtekVision Co Ltd
Original Assignee
MtekVision Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020160070843A external-priority patent/KR101810956B1/ko
Application filed by MtekVision Co Ltd filed Critical MtekVision Co Ltd
Publication of CN109076176A publication Critical patent/CN109076176A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143—Sensing or illuminating at different wavelengths
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/65—Control of camera operation in relation to power supply
    • H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/53—Control of the integration time
    • H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30268—Vehicle interior

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Mathematical Physics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)
  • Blocking Light For Cameras (AREA)
  • Stroboscope Apparatuses (AREA)
  • Exposure Control For Cameras (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
CN201680085009.4A 2016-05-25 2016-07-14 眼睛位置检测装置和方法、带滚动快门驱动系统的图像传感器的成像装置及其照明控制方法 Pending CN109076176A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
KR1020160064189 2016-05-25
KR10-2016-0064189 2016-05-25
KR1020160070843A KR101810956B1 (ko) 2016-06-08 2016-06-08 롤링 셔터 구동 방식의 이미지 센서를 구비한 촬상 장치 및 그 조명 제어 방법
KR10-2016-0070843 2016-06-08
PCT/KR2016/007695 WO2017204406A1 (ko) 2016-05-25 2016-07-14 운전자의 눈 위치 검출 장치와 방법, 및 롤링 셔터 구동 방식의 이미지 센서를 구비한 촬상 장치와 그 조명 제어 방법

Publications (1)

Publication Number Publication Date
CN109076176A true CN109076176A (zh) 2018-12-21

Family

ID=60412422

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680085009.4A Pending CN109076176A (zh) 2016-05-25 2016-07-14 眼睛位置检测装置和方法、带滚动快门驱动系统的图像传感器的成像装置及其照明控制方法

Country Status (4)

Country Link
US (2) US20190141264A1 (ja)
JP (2) JP2019514302A (ja)
CN (1) CN109076176A (ja)
WO (1) WO2017204406A1 (ja)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10775605B2 (en) * 2016-06-16 2020-09-15 Intel Corporation Combined biometrics capture system with ambient free IR
JP7078386B2 (ja) * 2017-12-07 2022-05-31 矢崎総業株式会社 画像処理装置
CN108388781B (zh) * 2018-01-31 2021-01-12 Oppo广东移动通信有限公司 移动终端、图像数据获取方法及相关产品
CN112204453B (zh) * 2018-06-05 2024-01-16 索尼半导体解决方案公司 影像投射系统、影像投射装置、影像显示光衍射光学元件、器具以及影像投射方法
US11570370B2 (en) * 2019-09-30 2023-01-31 Tobii Ab Method and system for controlling an eye tracking system
KR20210059060A (ko) * 2019-11-13 2021-05-25 삼성디스플레이 주식회사 검출 장치
KR102460660B1 (ko) * 2020-08-24 2022-10-31 현대모비스 주식회사 카메라 내장 헤드램프의 램프 제어기 연동 시스템 및 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999027844A1 (en) * 1997-12-01 1999-06-10 Sensar, Inc. Method and apparatus for illuminating and imaging eyes through eyeglasses using multiple sources of illumination
CN101374202A (zh) * 2007-08-23 2009-02-25 欧姆龙株式会社 摄像装置以及摄像控制方法
US20140375785A1 (en) * 2013-06-19 2014-12-25 Raytheon Company Imaging-based monitoring of stress and fatigue
WO2015031942A1 (en) * 2013-09-03 2015-03-12 Seeing Machines Limited Low power eye tracking system and method
US20150186722A1 (en) * 2013-12-26 2015-07-02 Samsung Electro-Mechanics Co., Ltd. Apparatus and method for eye tracking
WO2016035901A1 (ko) * 2014-09-02 2016-03-10 삼성전자주식회사 홍채 인식하기 위한 방법 및 그 전자 장치

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3316725B2 (ja) * 1995-07-06 2002-08-19 三菱電機株式会社 顔画像撮像装置
JP2000028315A (ja) * 1998-07-13 2000-01-28 Honda Motor Co Ltd 対象物検出装置
US7777778B2 (en) * 2004-10-27 2010-08-17 Delphi Technologies, Inc. Illumination and imaging system and method
JP2007004448A (ja) * 2005-06-23 2007-01-11 Honda Motor Co Ltd 視線検出装置
KR100716370B1 (ko) * 2005-09-15 2007-05-11 현대자동차주식회사 운전자의 눈 위치 검출 방법
JP4265600B2 (ja) * 2005-12-26 2009-05-20 船井電機株式会社 複眼撮像装置
US8803978B2 (en) * 2006-05-23 2014-08-12 Microsoft Corporation Computer vision-based object tracking system
JP4356733B2 (ja) * 2006-11-09 2009-11-04 アイシン精機株式会社 車載用画像処理装置とその制御方法
DE112007003452T5 (de) * 2007-04-18 2010-04-08 Opticon Inc. Verfahren und Gerät zum Abbilden eines sich bewegenden Objekts
US20090097704A1 (en) * 2007-10-10 2009-04-16 Micron Technology, Inc. On-chip camera system for multiple object tracking and identification
US8570176B2 (en) * 2008-05-28 2013-10-29 7352867 Canada Inc. Method and device for the detection of microsleep events
JP2010219826A (ja) * 2009-03-16 2010-09-30 Fuji Xerox Co Ltd 撮像装置、位置計測システムおよびプログラム
US8115855B2 (en) * 2009-03-19 2012-02-14 Nokia Corporation Method, an apparatus and a computer readable storage medium for controlling an assist light during image capturing process
US20130089240A1 (en) * 2011-10-07 2013-04-11 Aoptix Technologies, Inc. Handheld iris imager
JP2013097223A (ja) * 2011-11-02 2013-05-20 Ricoh Co Ltd 撮像方法及び撮像ユニット
JP5800288B2 (ja) * 2012-10-30 2015-10-28 株式会社デンソー 車両用画像処理装置
KR20150016723A (ko) * 2013-08-05 2015-02-13 (주)유아이투 스마트기기의 조도센서를 이용하는 정보분석시스템 및 이에 의한 정보분석방법
US9294687B2 (en) * 2013-12-06 2016-03-22 Intel Corporation Robust automatic exposure control using embedded data
EP3092601A4 (en) * 2014-01-06 2017-11-29 Eyelock Llc Methods and apparatus for repetitive iris recognition
GB2523356A (en) * 2014-02-21 2015-08-26 Tobii Technology Ab Apparatus and method for robust eye/gaze tracking
KR102237479B1 (ko) * 2014-06-03 2021-04-07 (주)아이리스아이디 홍채 인식 단말기 및 방법
KR102230691B1 (ko) * 2014-07-09 2021-03-23 삼성전자주식회사 생체정보를 인식하는 방법 및 장치
JP2016049260A (ja) * 2014-08-29 2016-04-11 アルプス電気株式会社 車載用撮像装置
KR101619651B1 (ko) * 2014-11-26 2016-05-10 현대자동차주식회사 운전자 감시장치 및 그의 조명제어방법
WO2016131075A1 (en) * 2015-02-20 2016-08-25 Seeing Machines Limited Glare reduction
US9961258B2 (en) * 2015-02-23 2018-05-01 Facebook, Inc. Illumination system synchronized with image sensor
US9864119B2 (en) * 2015-09-09 2018-01-09 Microsoft Technology Licensing, Llc Infrared filter with screened ink and an optically clear medium
US10594974B2 (en) * 2016-04-07 2020-03-17 Tobii Ab Image sensor for vision based on human computer interaction
JP2017204685A (ja) * 2016-05-10 2017-11-16 ソニー株式会社 情報処理装置、情報処理方法
KR20180133076A (ko) * 2017-06-05 2018-12-13 삼성전자주식회사 이미지 센서 및 이를 구비하는 전자 장치

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999027844A1 (en) * 1997-12-01 1999-06-10 Sensar, Inc. Method and apparatus for illuminating and imaging eyes through eyeglasses using multiple sources of illumination
CN101374202A (zh) * 2007-08-23 2009-02-25 欧姆龙株式会社 摄像装置以及摄像控制方法
US20140375785A1 (en) * 2013-06-19 2014-12-25 Raytheon Company Imaging-based monitoring of stress and fatigue
WO2015031942A1 (en) * 2013-09-03 2015-03-12 Seeing Machines Limited Low power eye tracking system and method
US20150186722A1 (en) * 2013-12-26 2015-07-02 Samsung Electro-Mechanics Co., Ltd. Apparatus and method for eye tracking
WO2016035901A1 (ko) * 2014-09-02 2016-03-10 삼성전자주식회사 홍채 인식하기 위한 방법 및 그 전자 장치

Also Published As

Publication number Publication date
US20200169678A1 (en) 2020-05-28
JP2019514302A (ja) 2019-05-30
US20190141264A1 (en) 2019-05-09
JP2020145724A (ja) 2020-09-10
WO2017204406A1 (ko) 2017-11-30

Similar Documents

Publication Publication Date Title
CN109076176A (zh) 眼睛位置检测装置和方法、带滚动快门驱动系统的图像传感器的成像装置及其照明控制方法
US10521683B2 (en) Glare reduction
Soo Object detection using Haar-cascade Classifier
EP1732028B1 (en) System and method for detecting an eye
JP4187651B2 (ja) 顔検知において使用するための近赤外線の方法およびシステム
CA2411992C (en) Near-infrared disguise detection
CN101271517B (zh) 面部区域检测装置和方法
Kurylyak et al. Detection of the eye blinks for human's fatigue monitoring
US7940962B2 (en) System and method of awareness detection
CN106682578B (zh) 基于眨眼检测的弱光人脸识别方法
US9646215B2 (en) Eye part detection apparatus
CN105260731A (zh) 一种基于光脉冲的人脸活体检测系统及方法
CN104200192A (zh) 驾驶员注视检测系统
Różanowski et al. An infrared sensor for eye tracking in a harsh car environment
EP3572975A1 (en) A multispectral image processing system for face detection
CN107909063B (zh) 基于灰度变化的生物识别视频回放攻击检测方法
Hyder et al. Real-time non-intrusive eye-gaze tracking based wheelchair control for the physically challenged
CN113140093A (zh) 一种基于AdaBoost算法的疲劳驾驶检测方法
CN113920591B (zh) 基于多模态生物特征识别的中远距离身份认证方法及装置
Mu et al. Research on a driver fatigue detection model based on image processing
JP2004192552A (ja) 開閉眼判定装置
Zhou Eye-Blink Detection under Low-Light Conditions Based on Zero-DCE
WO2021181775A1 (ja) 映像処理装置、映像処理方法および映像処理プログラム
Horak et al. Eyes detection and tracking for monitoring driver vigilance
KR20200079989A (ko) 특징점 변동을 이용한 위조 홍채 판별장치 및 그 방법

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20181221

WD01 Invention patent application deemed withdrawn after publication