JP7290930B2 - 乗員モデリング装置、乗員モデリング方法および乗員モデリングプログラム - Google Patents
乗員モデリング装置、乗員モデリング方法および乗員モデリングプログラム Download PDFInfo
- Publication number
- JP7290930B2 JP7290930B2 JP2018182750A JP2018182750A JP7290930B2 JP 7290930 B2 JP7290930 B2 JP 7290930B2 JP 2018182750 A JP2018182750 A JP 2018182750A JP 2018182750 A JP2018182750 A JP 2018182750A JP 7290930 B2 JP7290930 B2 JP 7290930B2
- Authority
- JP
- Japan
- Prior art keywords
- face
- determination
- unit
- model
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 78
- 238000012545 processing Methods 0.000 claims description 114
- 230000001815 facial effect Effects 0.000 claims description 64
- 238000003384 imaging method Methods 0.000 claims description 29
- 210000004709 eyebrow Anatomy 0.000 claims description 9
- 230000008569 process Effects 0.000 description 66
- 230000009471 action Effects 0.000 description 21
- 238000001514 detection method Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 13
- 230000000694 effects Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 4
- 238000002485 combustion reaction Methods 0.000 description 3
- 230000004397 blinking Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000002945 steepest descent method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
- G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
- B60R21/0153—Passenger detection systems using field detection presence sensors
- B60R21/01538—Passenger detection systems using field detection presence sensors for image processing, e.g. cameras or sensor arrays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/167—Detection; Localisation; Normalisation using comparisons between temporally consecutive images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
- B60R21/01552—Passenger detection systems detecting position of specific human body parts, e.g. face, eyes or hands
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20112—Image segmentation details
- G06T2207/20121—Active appearance model [AAM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20112—Image segmentation details
- G06T2207/20124—Active shape model [ASM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30268—Vehicle interior
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Mechanical Engineering (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Mathematical Physics (AREA)
- Transportation (AREA)
- Image Analysis (AREA)
Description
Claims (5)
- 車両内において乗員の顔が存在する可能性のある領域を撮像することで得られる画像を取得する取得部と、
前記取得部が取得する第1の画像に基づき前記顔のモデルを生成するモデルフィッティング部と、
前記取得部が取得する前記第1の画像より後に取得された第2の画像に前記モデルを適合させるトラッキング部と、
前記顔の顔部品位置に関する正解情報と不正解情報とに基づき学習させた学習済み情報を用いて、前記モデルが適合される前記第2の画像に含まれる前記顔部品位置の正否を判定する判定部と、
前記判定部の判定結果に応じて、前記トラッキング部による処理を継続するか、前記モデルフィッティング部による処理を再実行するかを決定する処理部と、
を備え、
前記判定部は、前記顔部品位置の正否の判定として、前記顔の眼の位置の正否を判定する第1の判定と、前記顔に含まれる前記眼以外の複数の顔部品の位置の正否を判定する第2の判定と、を実行する、乗員モデリング装置。 - 前記判定部は、前記トラッキング部の処理により顔部品位置と認識された情報に基づき、前記第2の画像の顔部品位置を特定し、前記学習済み情報との正否を判定する、請求項1に記載の乗員モデリング装置。
- 前記判定部は、前記第2の判定として、前記顔に含まれる複数の顔部品である鼻、口、眉毛の位置および輪郭の形状を含む前記眼以外の顔の全体構成の正否を判定する、請求項1または請求項2に記載の乗員モデリング装置。
- 車両内において乗員の顔が存在する可能性のある領域を撮像することで得られる画像を取得する取得ステップと、
前記取得ステップで取得した第1の画像に基づき前記顔のモデルを生成するモデルフィッティングステップと、
前記取得ステップが取得した前記第1の画像より後に取得された第2の画像に前記モデルを適合させるトラッキングステップと、
前記顔の顔部品位置に関する正解情報と不正解情報とに基づき学習させた学習済み情報を用いて、前記第2の画像に含まれる前記顔部品位置の正否を判定する判定ステップと、
前記判定ステップの判定結果に応じて、前記トラッキングステップによる処理を継続するか、前記モデルフィッティングステップによる処理を再実行するかを決定する処理ステップと、
を備え、
前記判定ステップは、前記顔部品位置の正否の判定として、前記顔の眼の位置の正否を判定する第1の判定と、前記顔に含まれる前記眼以外の複数の顔部品の位置の正否を判定する第2の判定と、を実行する、乗員モデリング方法。 - コンピュータに、
車両内において乗員の顔が存在する可能性のある領域を撮像することで得られる画像を取得する取得ステップと、
前記取得ステップで取得した第1の画像に基づき前記顔のモデルを生成するモデルフィッティングステップと、
前記取得ステップが取得した前記第1の画像より後に取得された第2の画像に前記モデルを適合させるトラッキングステップと、
前記顔の顔部品位置に関する正解情報と不正解情報とに基づき学習させた学習済み情報を用いて、前記第2の画像に含まれる前記顔部品位置の正否を判定するステップであって、前記顔の眼の位置の正否を判定する第1の判定と、前記顔に含まれる前記眼以外の複数の顔部品の位置の正否を判定する第2の判定と、を実行する判定ステップと、
前記判定ステップの判定結果に応じて、前記トラッキングステップによる処理を継続するか、前記モデルフィッティングステップによる処理を再実行するかを決定する処理ステップと、
を実行させるための、乗員モデリングプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018182750A JP7290930B2 (ja) | 2018-09-27 | 2018-09-27 | 乗員モデリング装置、乗員モデリング方法および乗員モデリングプログラム |
US16/578,686 US11210497B2 (en) | 2018-09-27 | 2019-09-23 | Occupant modeling device, occupant modeling method, and occupant modeling program |
DE102019125921.5A DE102019125921A1 (de) | 2018-09-27 | 2019-09-26 | Insassenmodelliervorrichtung, Insassenmodellierverfahren und Insassenmodellierprogramm |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018182750A JP7290930B2 (ja) | 2018-09-27 | 2018-09-27 | 乗員モデリング装置、乗員モデリング方法および乗員モデリングプログラム |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2020052827A JP2020052827A (ja) | 2020-04-02 |
JP7290930B2 true JP7290930B2 (ja) | 2023-06-14 |
Family
ID=69781263
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2018182750A Active JP7290930B2 (ja) | 2018-09-27 | 2018-09-27 | 乗員モデリング装置、乗員モデリング方法および乗員モデリングプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US11210497B2 (ja) |
JP (1) | JP7290930B2 (ja) |
DE (1) | DE102019125921A1 (ja) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11205083B2 (en) * | 2019-04-02 | 2021-12-21 | Magna Electronics Inc. | Vehicular driver monitoring system |
DE102019004692B3 (de) * | 2019-07-03 | 2020-11-12 | Daimler Ag | Vorrichtung und Verfahren zur Ermittlung von Bilddaten der Augen, von Augenpositionen und/oder einer Blickrichtung eines Fahrzeugnutzers in einem Fahrzeug |
JPWO2021193528A1 (ja) | 2020-03-24 | 2021-09-30 | ||
KR102672095B1 (ko) * | 2020-07-06 | 2024-06-04 | 주식회사 씽크아이 | 차량에 설치되는 인캐빈 안전센서 및 그 서비스 플랫폼 제공 방법 |
DE102021211739B4 (de) | 2021-10-18 | 2023-07-06 | Volkswagen Aktiengesellschaft | Bestimmung der Sternumsposition |
US20230362560A1 (en) * | 2022-05-08 | 2023-11-09 | Tuned Ltd. | System and method for personalized, image analysis based positioning of hearing aids |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015075916A (ja) | 2013-10-09 | 2015-04-20 | アイシン精機株式会社 | 顔検出装置、方法およびプログラム |
JP2017215897A (ja) | 2016-06-02 | 2017-12-07 | 株式会社デンソーアイティーラボラトリ | 特徴点位置推定装置、特徴点位置推定システム、特徴点位置推定方法、および特徴点位置推定プログラム |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2715511B2 (ja) | 1989-01-31 | 1998-02-18 | 日産自動車株式会社 | 運転者の目の位置認識装置 |
JP4895847B2 (ja) | 2007-02-08 | 2012-03-14 | アイシン精機株式会社 | 瞼検出装置及びプログラム |
CN103632136B (zh) * | 2013-11-11 | 2017-03-29 | 北京天诚盛业科技有限公司 | 人眼定位方法和装置 |
CN104217350B (zh) * | 2014-06-17 | 2017-03-22 | 北京京东尚科信息技术有限公司 | 实现虚拟试戴的方法和装置 |
CN107679448B (zh) * | 2017-08-17 | 2018-09-25 | 平安科技(深圳)有限公司 | 眼球动作分析方法、装置及存储介质 |
US20200065559A1 (en) * | 2018-08-22 | 2020-02-27 | Nitin Vats | Generating a video using a video and user image or video |
-
2018
- 2018-09-27 JP JP2018182750A patent/JP7290930B2/ja active Active
-
2019
- 2019-09-23 US US16/578,686 patent/US11210497B2/en active Active
- 2019-09-26 DE DE102019125921.5A patent/DE102019125921A1/de active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015075916A (ja) | 2013-10-09 | 2015-04-20 | アイシン精機株式会社 | 顔検出装置、方法およびプログラム |
JP2017215897A (ja) | 2016-06-02 | 2017-12-07 | 株式会社デンソーアイティーラボラトリ | 特徴点位置推定装置、特徴点位置推定システム、特徴点位置推定方法、および特徴点位置推定プログラム |
Non-Patent Citations (2)
Title |
---|
J. M. Wang et al,Extracting driver's facial features during driving,2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC),米国,IEEE,2011年10月07日,https://ieeexplore.ieee.org/document/6082890 |
回 盻 他3名,顔特徴点の信頼度と配置を用いた顔の誤検出除去,SSII2012 第18回画像センシングシンポジウム 講演論文集 [CD-ROM],日本,画像センシング技術研究会,2012年06月06日,p.IS1-19-1~IS1-19-6 |
Also Published As
Publication number | Publication date |
---|---|
DE102019125921A1 (de) | 2020-04-02 |
US20200104571A1 (en) | 2020-04-02 |
US11210497B2 (en) | 2021-12-28 |
JP2020052827A (ja) | 2020-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7290930B2 (ja) | 乗員モデリング装置、乗員モデリング方法および乗員モデリングプログラム | |
US10089543B2 (en) | System and method for detecting distraction and a downward vertical head pose in a vehicle | |
CN105769120B (zh) | 疲劳驾驶检测方法和装置 | |
US20210078609A1 (en) | Method and Device for Determining an Estimate of the Capability of a Vehicle Driver to take over Control of a Vehicle | |
JP4926437B2 (ja) | 車両の運転支援装置 | |
US20170291544A1 (en) | Adaptive alert system for autonomous vehicle | |
TWI653170B (zh) | 駕駛提示方法與系統 | |
US20160171321A1 (en) | Determination apparatus and determination method | |
JP5233322B2 (ja) | 情報処理装置および方法、並びに、プログラム | |
US10706585B2 (en) | Eyeball information estimation device, eyeball information estimation method, and eyeball information estimation program | |
JP6323510B2 (ja) | 運転者体調検知装置及び方法 | |
JP2016115117A (ja) | 判定装置および判定方法 | |
JP2014096632A (ja) | 撮像システム | |
US20180053061A1 (en) | Method for identifying a driver change in a motor vehicle | |
US20190057261A1 (en) | Method of classifying a condition of a road surface | |
JP2016115120A (ja) | 開閉眼判定装置および開閉眼判定方法 | |
US20190295400A1 (en) | Driving assistance device | |
JP2019073255A (ja) | 運転支援装置 | |
JP6572538B2 (ja) | 下方視判定装置および下方視判定方法 | |
US10945651B2 (en) | Arousal level determination device | |
JP2016115119A (ja) | 開閉眼判定装置、及び開閉眼判定方法 | |
JP7046748B2 (ja) | 運転者状態判定装置および運転者状態判定方法 | |
JP7501548B2 (ja) | ドライバモニタ装置、ドライバモニタ方法及びドライバモニタ用コンピュータプログラム | |
JP7312971B2 (ja) | 車両表示装置 | |
US10733438B2 (en) | Eyeball information detection device, eyeball information detection method, and occupant monitoring device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20210806 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220107 |
|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20220107 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20220107 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20220713 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220726 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220922 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230124 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230222 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230509 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20230602 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7290930 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |