CN111626087A - 神经网络训练及眼睛睁闭状态检测方法、装置及设备 - Google Patents
神经网络训练及眼睛睁闭状态检测方法、装置及设备 Download PDFInfo
- Publication number
- CN111626087A CN111626087A CN201910153463.4A CN201910153463A CN111626087A CN 111626087 A CN111626087 A CN 111626087A CN 201910153463 A CN201910153463 A CN 201910153463A CN 111626087 A CN111626087 A CN 111626087A
- Authority
- CN
- China
- Prior art keywords
- eye
- neural network
- open
- detection
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 335
- 238000012549 training Methods 0.000 title claims abstract description 247
- 238000013528 artificial neural network Methods 0.000 title claims abstract description 195
- 238000000034 method Methods 0.000 claims abstract description 89
- 238000012545 processing Methods 0.000 claims abstract description 39
- 238000004590 computer program Methods 0.000 claims abstract description 23
- 238000002372 labelling Methods 0.000 claims abstract description 17
- 239000011521 glass Substances 0.000 description 50
- 230000008569 process Effects 0.000 description 21
- 238000004891 communication Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 230000004424 eye movement Effects 0.000 description 8
- 230000008921 facial expression Effects 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 230000002349 favourable effect Effects 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000004397 blinking Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000011478 gradient descent method Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 229920003023 plastic Polymers 0.000 description 2
- 239000002985 plastic film Substances 0.000 description 2
- 238000011176 pooling Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 206010011469 Crying Diseases 0.000 description 1
- 235000019658 bitter taste Nutrition 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- Ophthalmology & Optometry (AREA)
- Human Computer Interaction (AREA)
- Image Analysis (AREA)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910153463.4A CN111626087A (zh) | 2019-02-28 | 2019-02-28 | 神经网络训练及眼睛睁闭状态检测方法、装置及设备 |
PCT/CN2019/118127 WO2020173135A1 (zh) | 2019-02-28 | 2019-11-13 | 神经网络训练及眼睛睁闭状态检测方法、装置及设备 |
JP2021541183A JP7227385B2 (ja) | 2019-02-28 | 2019-11-13 | ニューラルネットワークのトレーニング及び目開閉状態の検出方法、装置並び機器 |
KR1020217023286A KR20210113621A (ko) | 2019-02-28 | 2019-11-13 | 뉴럴 네트워크의 트레이닝 및 눈 개폐 상태의 검출 방법, 장치 및 기기 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910153463.4A CN111626087A (zh) | 2019-02-28 | 2019-02-28 | 神经网络训练及眼睛睁闭状态检测方法、装置及设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111626087A true CN111626087A (zh) | 2020-09-04 |
Family
ID=72238751
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910153463.4A Pending CN111626087A (zh) | 2019-02-28 | 2019-02-28 | 神经网络训练及眼睛睁闭状态检测方法、装置及设备 |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP7227385B2 (ja) |
KR (1) | KR20210113621A (ja) |
CN (1) | CN111626087A (ja) |
WO (1) | WO2020173135A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113537176A (zh) * | 2021-09-16 | 2021-10-22 | 武汉未来幻影科技有限公司 | 一种驾驶员疲劳状态的确定方法、装置以及设备 |
WO2022252871A1 (zh) * | 2021-05-31 | 2022-12-08 | 北京字跳网络技术有限公司 | 视频生成方法、装置、设备及存储介质 |
CN117687313A (zh) * | 2023-12-29 | 2024-03-12 | 广东福临门世家智能家居有限公司 | 基于智能门锁的智能家居设备控制方法及系统 |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114283488B (zh) * | 2022-03-08 | 2022-06-14 | 北京万里红科技有限公司 | 生成检测模型的方法及利用检测模型检测眼睛状态的方法 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106529402A (zh) * | 2016-09-27 | 2017-03-22 | 中国科学院自动化研究所 | 基于多任务学习的卷积神经网络的人脸属性分析方法 |
CN107003834A (zh) * | 2014-12-15 | 2017-08-01 | 北京市商汤科技开发有限公司 | 行人检测设备和方法 |
CN108614999A (zh) * | 2018-04-16 | 2018-10-02 | 贵州大学 | 基于深度学习的眼睛睁闭状态检测方法 |
CN108805185A (zh) * | 2018-05-29 | 2018-11-13 | 腾讯科技(深圳)有限公司 | 模型的训练方法、装置、存储介质及计算机设备 |
CN108932536A (zh) * | 2018-07-18 | 2018-12-04 | 电子科技大学 | 基于深度神经网络的人脸姿态重建方法 |
CN108960071A (zh) * | 2018-06-06 | 2018-12-07 | 武汉幻视智能科技有限公司 | 一种睁眼闭眼状态检测方法 |
US20190050981A1 (en) * | 2017-08-09 | 2019-02-14 | Shenzhen Keya Medical Technology Corporation | System and method for automatically detecting a target object from a 3d image |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4687150B2 (ja) * | 2005-03-08 | 2011-05-25 | 日産自動車株式会社 | 直射光検出装置 |
JP4770218B2 (ja) * | 2005-03-22 | 2011-09-14 | 日産自動車株式会社 | 視認行動判定装置 |
JP4978227B2 (ja) * | 2007-02-15 | 2012-07-18 | トヨタ自動車株式会社 | 画像検出装置 |
JP2016176699A (ja) * | 2015-03-18 | 2016-10-06 | 株式会社オートネットワーク技術研究所 | 経路探索装置、経路探索方法及びコンピュータプログラム |
JP6582604B2 (ja) * | 2015-06-23 | 2019-10-02 | 富士通株式会社 | 瞳孔検出プログラム、瞳孔検出方法、瞳孔検出装置および視線検出システム |
US10002415B2 (en) * | 2016-04-12 | 2018-06-19 | Adobe Systems Incorporated | Utilizing deep learning for rating aesthetics of digital images |
JP6892231B2 (ja) * | 2016-07-29 | 2021-06-23 | アルパイン株式会社 | 瞼開閉検出装置および瞼開閉検出方法 |
JP6762794B2 (ja) * | 2016-07-29 | 2020-09-30 | アルパイン株式会社 | 瞼開閉検出装置および瞼開閉検出方法 |
JP2018075208A (ja) * | 2016-11-10 | 2018-05-17 | パナソニックIpマネジメント株式会社 | 運転者の状態検出システムおよび状態検出方法 |
CN106585629B (zh) * | 2016-12-06 | 2019-07-12 | 广东泓睿科技有限公司 | 一种车辆控制方法和装置 |
CN110490177A (zh) * | 2017-06-02 | 2019-11-22 | 腾讯科技(深圳)有限公司 | 一种人脸检测器训练方法及装置 |
WO2019028798A1 (zh) * | 2017-08-10 | 2019-02-14 | 北京市商汤科技开发有限公司 | 驾驶状态监控方法、装置和电子设备 |
-
2019
- 2019-02-28 CN CN201910153463.4A patent/CN111626087A/zh active Pending
- 2019-11-13 WO PCT/CN2019/118127 patent/WO2020173135A1/zh active Application Filing
- 2019-11-13 KR KR1020217023286A patent/KR20210113621A/ko not_active Application Discontinuation
- 2019-11-13 JP JP2021541183A patent/JP7227385B2/ja active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107003834A (zh) * | 2014-12-15 | 2017-08-01 | 北京市商汤科技开发有限公司 | 行人检测设备和方法 |
CN106529402A (zh) * | 2016-09-27 | 2017-03-22 | 中国科学院自动化研究所 | 基于多任务学习的卷积神经网络的人脸属性分析方法 |
US20190050981A1 (en) * | 2017-08-09 | 2019-02-14 | Shenzhen Keya Medical Technology Corporation | System and method for automatically detecting a target object from a 3d image |
CN108614999A (zh) * | 2018-04-16 | 2018-10-02 | 贵州大学 | 基于深度学习的眼睛睁闭状态检测方法 |
CN108805185A (zh) * | 2018-05-29 | 2018-11-13 | 腾讯科技(深圳)有限公司 | 模型的训练方法、装置、存储介质及计算机设备 |
CN108960071A (zh) * | 2018-06-06 | 2018-12-07 | 武汉幻视智能科技有限公司 | 一种睁眼闭眼状态检测方法 |
CN108932536A (zh) * | 2018-07-18 | 2018-12-04 | 电子科技大学 | 基于深度神经网络的人脸姿态重建方法 |
Non-Patent Citations (1)
Title |
---|
WEIYANG LIU等: "SphereFace: Deep Hypersphere Embedding for Face Recognition", 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, pages 3 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022252871A1 (zh) * | 2021-05-31 | 2022-12-08 | 北京字跳网络技术有限公司 | 视频生成方法、装置、设备及存储介质 |
CN113537176A (zh) * | 2021-09-16 | 2021-10-22 | 武汉未来幻影科技有限公司 | 一种驾驶员疲劳状态的确定方法、装置以及设备 |
CN117687313A (zh) * | 2023-12-29 | 2024-03-12 | 广东福临门世家智能家居有限公司 | 基于智能门锁的智能家居设备控制方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
JP2022517398A (ja) | 2022-03-08 |
WO2020173135A1 (zh) | 2020-09-03 |
KR20210113621A (ko) | 2021-09-16 |
JP7227385B2 (ja) | 2023-02-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11551377B2 (en) | Eye gaze tracking using neural networks | |
KR102319177B1 (ko) | 이미지 내의 객체 자세를 결정하는 방법 및 장치, 장비, 및 저장 매체 | |
CN111626087A (zh) | 神经网络训练及眼睛睁闭状态检测方法、装置及设备 | |
JP6871416B2 (ja) | 顔画像品質を決定する方法および装置、電子機器ならびにコンピュータ記憶媒体 | |
WO2019223382A1 (zh) | 单目深度估计方法及其装置、设备和存储介质 | |
WO2022156640A1 (zh) | 一种图像的视线矫正方法、装置、电子设备、计算机可读存储介质及计算机程序产品 | |
CN110956060A (zh) | 动作识别、驾驶动作分析方法和装置及电子设备 | |
EP4345777A1 (en) | Living body detection method and apparatus, and training method and apparatus for living body detection system | |
CN111950723A (zh) | 神经网络模型训练方法、图像处理方法、装置及终端设备 | |
JP7093427B2 (ja) | オブジェクト追跡方法および装置、電子設備並びに記憶媒体 | |
US20210041945A1 (en) | Machine learning based gaze estimation with confidence | |
JP5833507B2 (ja) | 画像処理装置 | |
CN112348778B (zh) | 一种物体识别方法、装置、终端设备及存储介质 | |
CN112069887B (zh) | 一种人脸识别方法、装置、终端设备及存储介质 | |
WO2023178906A1 (zh) | 活体检测方法及装置、电子设备、存储介质、计算机程序、计算机程序产品 | |
CN114140844A (zh) | 人脸静默活体检测方法、装置、电子设备及存储介质 | |
CN107368817B (zh) | 人脸识别方法和装置 | |
CN113344796A (zh) | 一种图像处理方法、装置、设备及存储介质 | |
CN108509876B (zh) | 针对视频的物体检测方法、装置、设备、存储介质及程序 | |
CN115471439A (zh) | 显示面板缺陷的识别方法、装置、电子设备及存储介质 | |
CN114663418A (zh) | 图像处理的方法及装置、存储介质及电子设备 | |
CN112818728A (zh) | 年龄识别的方法及相关产品 | |
CN113780322B (zh) | 一种安全检测的方法和装置 | |
CN116152345B (zh) | 一种嵌入式系统实时物体6d位姿和距离估计方法 | |
CN106250852A (zh) | 虚拟现实终端及手型识别方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |