CN111557007A - 一种检测眼睛睁闭状态的方法及电子设备 - Google Patents

一种检测眼睛睁闭状态的方法及电子设备 Download PDF

Info

Publication number
CN111557007A
CN111557007A CN201880085463.9A CN201880085463A CN111557007A CN 111557007 A CN111557007 A CN 111557007A CN 201880085463 A CN201880085463 A CN 201880085463A CN 111557007 A CN111557007 A CN 111557007A
Authority
CN
China
Prior art keywords
eye
electronic device
image
eyes
opening
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201880085463.9A
Other languages
English (en)
Other versions
CN111557007B (zh
Inventor
李宏宝
董辰
姜永涛
郜文美
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN111557007A publication Critical patent/CN111557007A/zh
Application granted granted Critical
Publication of CN111557007B publication Critical patent/CN111557007B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/457—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by analysing connectivity, e.g. edge linking, connected component analysis or slices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • G06V10/507—Summing image-intensity values; Histogram projection analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/72—Data preparation, e.g. statistical preprocessing of image or video features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种检测眼睛睁闭状态的方法及电子设备，用于解决现有存在的仅通过眼睛开度与单一阈值的比较来判断眼睛睁闭状态准确性较低的问题。上述方法和电子设备不在仅仅通过眼睛开度特征，而是增加黑眼球性状特征和/或垂直方向特征，其中，所述眼睛开度特征用于表征眼睛睁开的程度，所述黑眼球形状特征用于表征人眼中黑眼球的形状，所述垂直方向特征用于表征眼睑曲线的变化程度。通过多个特征来识别眼睛睁闭状态，进而可以提高检测的准确性。

Description

PCT国内申请，说明书已公开。

Claims (11)

  1. PCT国内申请，权利要求书已公开。
CN201880085463.9A 2018-07-16 2018-09-18 一种检测眼睛睁闭状态的方法及电子设备 Active CN111557007B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2018107762841 2018-07-16
CN201810776284 2018-07-16
PCT/CN2018/106226 WO2020015145A1 (zh) 2018-07-16 2018-09-18 一种检测眼睛睁闭状态的方法及电子设备

Publications (2)

Publication Number Publication Date
CN111557007A true CN111557007A (zh) 2020-08-18
CN111557007B CN111557007B (zh) 2022-08-19

Family

ID=69163851

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880085463.9A Active CN111557007B (zh) 2018-07-16 2018-09-18 一种检测眼睛睁闭状态的方法及电子设备

Country Status (4)

Country Link
US (1) US11430264B2 (zh)
EP (1) EP3809310B1 (zh)
CN (1) CN111557007B (zh)
WO (1) WO2020015145A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111598866B (zh) * 2020-05-14 2023-04-11 四川大学 一种基于眼部b超图像的晶状体关键特征定位方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010071021A1 (ja) * 2008-12-17 2010-06-24 アイシン精機株式会社 眼開閉判別装置及びプログラム
CN104091147A (zh) * 2014-06-11 2014-10-08 华南理工大学 一种近红外眼睛定位及眼睛状态识别方法
CN105117681A (zh) * 2015-06-29 2015-12-02 电子科技大学 基于安卓的多特征疲劳实时检测方法
CN107133595A (zh) * 2017-05-11 2017-09-05 南宁市正祥科技有限公司 红外图像的眼睛开闭检测方法

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06308918A (ja) * 1993-04-21 1994-11-04 Fujitsu Ltd 画面表示制御方法及び画面表示制御装置
JP3350296B2 (ja) * 1995-07-28 2002-11-25 三菱電機株式会社 顔画像処理装置
US7792335B2 (en) * 2006-02-24 2010-09-07 Fotonation Vision Limited Method and apparatus for selective disqualification of digital images
JP5262243B2 (ja) * 2008-03-31 2013-08-14 アイシン精機株式会社 眼開閉判別装置、及びプログラム
JP5270415B2 (ja) * 2009-03-19 2013-08-21 トヨタ自動車株式会社 眠気判定装置及びプログラム
JP4748244B2 (ja) * 2009-03-31 2011-08-17 カシオ計算機株式会社 画像選択装置、画像選択方法及びプログラム
FR2945883B1 (fr) * 2009-05-25 2012-03-09 St Ericsson Sa St Ericsson Ltd Procede et systeme de detection de l'etat ouvert ou ferme des yeux d'un visage.
CN101692980B (zh) * 2009-10-30 2011-06-08 深圳市汉华安道科技有限责任公司 疲劳驾驶检测方法及装置
JP5180997B2 (ja) * 2010-07-14 2013-04-10 株式会社豊田中央研究所 まぶた検出装置及びプログラム
WO2012144020A1 (ja) * 2011-04-19 2012-10-26 アイシン精機株式会社 瞼検出装置、瞼検出方法及びプログラム
JP5418579B2 (ja) * 2011-12-06 2014-02-19 株式会社デンソー 開閉眼検出装置
TWI498857B (zh) * 2012-09-14 2015-09-01 Utechzone Co Ltd 瞌睡提醒裝置
TWI466070B (zh) * 2012-09-14 2014-12-21 Utechzone Co Ltd 眼睛搜尋方法及使用該方法的眼睛狀態檢測裝置與眼睛搜尋裝置
JP5999013B2 (ja) * 2013-04-12 2016-09-28 株式会社デンソー 開眼状態判定装置
JP6314435B2 (ja) * 2013-11-13 2018-04-25 株式会社デンソー ドライバ監視装置
CN105224285A (zh) * 2014-05-27 2016-01-06 北京三星通信技术研究有限公司 眼睛开闭状态检测装置和方法
KR20160051411A (ko) * 2014-11-03 2016-05-11 삼성전자주식회사 외부의 물체를 제어하는 전자 장치 및 그 방법
CN104951070A (zh) * 2015-06-02 2015-09-30 无锡天脉聚源传媒科技有限公司 一种基于眼睛操控设备的方法及装置
US9922238B2 (en) * 2015-06-25 2018-03-20 West Virginia University Apparatuses, systems, and methods for confirming identity
CN106203293A (zh) * 2016-06-29 2016-12-07 广州鹰瞰信息科技有限公司 一种检测疲劳驾驶的方法和装置
US10257414B2 (en) * 2016-07-15 2019-04-09 Qualcomm Incorporated Method and system for smart group portrait
DE112017005233B4 (de) * 2017-01-17 2021-08-26 Mitsubishi Electric Corporation Augenliderkennungsvorrichtung, Schläfrigkeitsbestimmungsvorrichtung und Augenliderkennungsverfahren
JP7369184B2 (ja) * 2018-09-28 2023-10-25 シーイング マシーンズ リミテッド 運転者注意状態推定

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010071021A1 (ja) * 2008-12-17 2010-06-24 アイシン精機株式会社 眼開閉判別装置及びプログラム
CN104091147A (zh) * 2014-06-11 2014-10-08 华南理工大学 一种近红外眼睛定位及眼睛状态识别方法
CN105117681A (zh) * 2015-06-29 2015-12-02 电子科技大学 基于安卓的多特征疲劳实时检测方法
CN107133595A (zh) * 2017-05-11 2017-09-05 南宁市正祥科技有限公司 红外图像的眼睛开闭检测方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PENGFEI CAI 等: "An Eyelid Detection Algorithm for the Iris Recognition", 《INTERNATIONAL JOURNAL OF SECURITY AND ITS APPLICATIONS》 *
SOUKUPOVA TEREZA 等: "Real-Time Eye Blink Detection using Facial Landmarks", 《HTTP://VISION.FE.UNI-LJ.SI/CVWW2016/PROCEEDINGS/PAPERS/05.PDF》 *

Also Published As

Publication number Publication date
EP3809310A4 (en) 2021-09-01
EP3809310A1 (en) 2021-04-21
WO2020015145A1 (zh) 2020-01-23
CN111557007B (zh) 2022-08-19
US20210264148A1 (en) 2021-08-26
US11430264B2 (en) 2022-08-30
EP3809310B1 (en) 2023-11-08

Similar Documents

Publication Publication Date Title
CN112333380B (zh) 一种拍摄方法及设备
CN112215802B (zh) 一种皮肤检测方法和电子设备
CN112037162B (zh) 一种面部痤疮的检测方法及设备
CN111543049B (zh) 一种拍照方法及电子设备
CN111343907B (zh) 一种色素检测方法及电子设备
CN111566693B (zh) 一种皱纹检测方法及电子设备
CN110851067A (zh) 屏幕显示模式的切换方法、装置及电子设备
CN112446832A (zh) 一种图像处理方法及电子设备
CN111147667A (zh) 一种熄屏控制方法及电子设备
CN111417982B (zh) 一种色斑检测方法及电子设备
CN111557007B (zh) 一种检测眼睛睁闭状态的方法及电子设备
CN111460942B (zh) 接近检测方法及装置、计算机可读介质及终端设备
CN114302063A (zh) 一种拍摄方法及设备
CN114885086A (zh) 一种图像处理方法、头戴式设备和计算机可读存储介质
CN117523077A (zh) 一种虚拟形象生成方法及装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210429

Address after: Unit 3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong 518040

Applicant after: Honor Device Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant