JP7548914B2 - 情報処理装置 - Google Patents

情報処理装置 Download PDF

Info

Publication number
JP7548914B2
JP7548914B2 JP2021543605A JP2021543605A JP7548914B2 JP 7548914 B2 JP7548914 B2 JP 7548914B2 JP 2021543605 A JP2021543605 A JP 2021543605A JP 2021543605 A JP2021543605 A JP 2021543605A JP 7548914 B2 JP7548914 B2 JP 7548914B2
Authority
JP
Japan
Prior art keywords
information processing
data
processing device
pupil
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021543605A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021044249A5 (https=
JPWO2021044249A1 (https=
Inventor
哲平 小國
達也 岡野
健吾 秋元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Semiconductor Energy Laboratory Co Ltd
Original Assignee
Semiconductor Energy Laboratory Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Semiconductor Energy Laboratory Co Ltd filed Critical Semiconductor Energy Laboratory Co Ltd
Publication of JPWO2021044249A1 publication Critical patent/JPWO2021044249A1/ja
Publication of JPWO2021044249A5 publication Critical patent/JPWO2021044249A5/ja
Priority to JP2024150460A priority Critical patent/JP7836865B2/ja
Application granted granted Critical
Publication of JP7548914B2 publication Critical patent/JP7548914B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/11—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils
    • A61B3/112—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils for measuring diameter of pupils
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/094—Adversarial learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1103—Detecting muscular movement of the eye, e.g. eyelid movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168—Evaluating attention deficit, hyperactivity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20061—Hough transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Ophthalmology & Optometry (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Psychiatry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Geometry (AREA)
  • Child & Adolescent Psychology (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Pathology (AREA)
  • Developmental Disabilities (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
JP2021543605A 2019-09-06 2020-08-25 情報処理装置 Active JP7548914B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024150460A JP7836865B2 (ja) 2019-09-06 2024-09-02 情報処理装置

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2019162687 2019-09-06
JP2019162687 2019-09-06
PCT/IB2020/057918 WO2021044249A1 (ja) 2019-09-06 2020-08-25 情報処理装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024150460A Division JP7836865B2 (ja) 2019-09-06 2024-09-02 情報処理装置

Publications (3)

Publication Number Publication Date
JPWO2021044249A1 JPWO2021044249A1 (https=) 2021-03-11
JPWO2021044249A5 JPWO2021044249A5 (https=) 2023-08-31
JP7548914B2 true JP7548914B2 (ja) 2024-09-10

Family

ID=74852843

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021543605A Active JP7548914B2 (ja) 2019-09-06 2020-08-25 情報処理装置
JP2024150460A Active JP7836865B2 (ja) 2019-09-06 2024-09-02 情報処理装置

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024150460A Active JP7836865B2 (ja) 2019-09-06 2024-09-02 情報処理装置

Country Status (3)

Country Link
US (2) US12333859B2 (https=)
JP (2) JP7548914B2 (https=)
WO (1) WO2021044249A1 (https=)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017083567A1 (en) 2015-11-10 2017-05-18 Diagnosys LLC Method and apparatus for the assessment of electrophysiological signals
WO2023023226A2 (en) * 2021-08-18 2023-02-23 Diagnosys LLC System comprising integrated dichoptic flash and pupillometry monitoring, and method for using the same
KR102615650B1 (ko) * 2022-08-09 2023-12-20 저지앙 대학 생성적 적대 신경망 기반의 군중 이동 예측 방법
CN115937595A (zh) * 2022-12-20 2023-04-07 中交公路长大桥建设国家工程研究中心有限公司 一种基于智能数据处理的桥梁表观异常识别方法及系统
CN117077086B (zh) * 2023-07-25 2024-12-27 中国人民解放军空军军医大学 一种超前脑疲劳预警系统、设备和存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007295946A (ja) 2006-04-27 2007-11-15 Konica Minolta Holdings Inc 酒気帯び検知システム及び酒気帯び検知方法
JP2012212990A (ja) 2011-03-30 2012-11-01 Brother Ind Ltd ヘッドマウントディスプレイ
CN104013414A (zh) 2014-04-30 2014-09-03 南京车锐信息科技有限公司 一种基于移动智能手机的驾驶员疲劳检测系统
JP2015132783A (ja) 2014-01-16 2015-07-23 日本電信電話株式会社 音の顕著度推定装置、その方法、及びプログラム
CN105354985A (zh) 2015-11-04 2016-02-24 中国科学院上海高等研究院 疲劳驾驶监控装置及方法
CN105513278A (zh) 2014-09-23 2016-04-20 付宁婧 一种汽车疲劳驾驶预警器
CN106137181A (zh) 2015-04-13 2016-11-23 上海帝仪科技有限公司 用于获取用户的疲劳特征的系统、方法和设备
US20190073533A1 (en) 2017-09-01 2019-03-07 Magic Leap, Inc. Detailed eye shape model for robust biometric applications

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09218375A (ja) 1996-02-08 1997-08-19 Canon Inc 疲労判定方法及びそれを用いた観察装置
KR100224889B1 (ko) * 1996-11-18 1999-10-15 윤종용 디스크 플레이어의 디스크 트레이 위치 감지장치
JP4971340B2 (ja) 2007-03-29 2012-07-11 パナソニック株式会社 炭化珪素半導体素子の製造方法
JP4974788B2 (ja) 2007-06-29 2012-07-11 キヤノン株式会社 画像処理装置、画像処理方法、プログラム、及び記憶媒体
KR20120093952A (ko) 2009-11-06 2012-08-23 가부시키가이샤 한도오따이 에네루기 켄큐쇼 반도체 소자 및 반도체 장치 제조 방법과, 성막 장치
JP2012073876A (ja) * 2010-09-29 2012-04-12 Fujitsu Ltd 電子機器、状態制御プログラム、および状態制御方法
EP2807605A2 (en) * 2012-01-26 2014-12-03 Umoove Services Ltd. Eye tracking
KR101224889B1 (ko) * 2012-07-03 2013-01-22 한국해양과학기술원 선원 피로도 측정 방법 및 장치
JP5829590B2 (ja) 2012-09-10 2015-12-09 日本電信電話株式会社 疲労感評価装置、疲労感評価方法、及びプログラム
WO2014046222A1 (en) 2012-09-24 2014-03-27 Semiconductor Energy Laboratory Co., Ltd. Display device
JP6582604B2 (ja) * 2015-06-23 2019-10-02 富士通株式会社 瞳孔検出プログラム、瞳孔検出方法、瞳孔検出装置および視線検出システム
US9888845B2 (en) * 2015-06-30 2018-02-13 Antonio Visconti System and method for optical detection of cognitive impairment
JP2017064325A (ja) * 2015-10-02 2017-04-06 富士通株式会社 縮瞳検出方法及び縮瞳検出装置
US11194405B2 (en) 2015-10-08 2021-12-07 Panasonic Intellectual Property Corporation Of America Method for controlling information display apparatus, and information display apparatus
KR20170049997A (ko) * 2015-10-29 2017-05-11 에스케이플래닛 주식회사 안구 상태로부터 피로도를 판단하여 추천장소를 제공하는 웨어러블 디바이스, 추천장소 제공서버 및 방법
JP2017130201A (ja) 2016-01-20 2017-07-27 株式会社半導体エネルギー研究所 入力システム、および電子機器
JP6714402B2 (ja) 2016-03-18 2020-06-24 国立大学法人大阪大学 眼疲労検査装置及び眼疲労検査方法
WO2018020368A1 (en) 2016-07-29 2018-02-01 Semiconductor Energy Laboratory Co., Ltd. Display method, display device, electronic device, non-temporary memory medium, and program
US20190159716A1 (en) 2016-08-03 2019-05-30 Akili Interactive Labs, Inc. Cognitive platform including computerized evocative elements
US11049147B2 (en) 2016-09-09 2021-06-29 Sony Corporation System and method for providing recommendation on an electronic device based on emotional state detection
WO2018100875A1 (ja) * 2016-11-30 2018-06-07 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
WO2019025895A1 (ja) 2017-07-31 2019-02-07 株式会社半導体エネルギー研究所 表示装置
CN111372735A (zh) * 2017-11-17 2020-07-03 三菱电机株式会社 3维空间监视装置、3维空间监视方法及3维空间监视程序
JP7350735B2 (ja) 2018-06-22 2023-09-26 株式会社半導体エネルギー研究所 画像表示装置
JP7014129B2 (ja) * 2018-10-29 2022-02-01 オムロン株式会社 推定器生成装置、モニタリング装置、推定器生成方法及び推定器生成プログラム

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007295946A (ja) 2006-04-27 2007-11-15 Konica Minolta Holdings Inc 酒気帯び検知システム及び酒気帯び検知方法
JP2012212990A (ja) 2011-03-30 2012-11-01 Brother Ind Ltd ヘッドマウントディスプレイ
JP2015132783A (ja) 2014-01-16 2015-07-23 日本電信電話株式会社 音の顕著度推定装置、その方法、及びプログラム
CN104013414A (zh) 2014-04-30 2014-09-03 南京车锐信息科技有限公司 一种基于移动智能手机的驾驶员疲劳检测系统
CN105513278A (zh) 2014-09-23 2016-04-20 付宁婧 一种汽车疲劳驾驶预警器
CN106137181A (zh) 2015-04-13 2016-11-23 上海帝仪科技有限公司 用于获取用户的疲劳特征的系统、方法和设备
CN105354985A (zh) 2015-11-04 2016-02-24 中国科学院上海高等研究院 疲劳驾驶监控装置及方法
US20190073533A1 (en) 2017-09-01 2019-03-07 Magic Leap, Inc. Detailed eye shape model for robust biometric applications

Also Published As

Publication number Publication date
JP2024161623A (ja) 2024-11-19
JP7836865B2 (ja) 2026-03-27
US12333859B2 (en) 2025-06-17
US20250329192A1 (en) 2025-10-23
WO2021044249A1 (ja) 2021-03-11
JPWO2021044249A1 (https=) 2021-03-11
US20220292880A1 (en) 2022-09-15

Similar Documents

Publication Publication Date Title
JP7548914B2 (ja) 情報処理装置
US11503998B1 (en) Method and a system for detection of eye gaze-pattern abnormalities and related neurological diseases
Baldwin et al. Time-ordered recent event (tore) volumes for event cameras
Zavrtanik et al. Reconstruction by inpainting for visual anomaly detection
JP7282810B2 (ja) 視線追跡方法およびシステム
Swallow et al. The role of perspective in event segmentation
JP2021523785A (ja) 毛髪被覆率分析のためのシステム及び方法
EP3271869B1 (fr) Procédé de traitement d'un signal asynchrone
US11915430B2 (en) Image analysis apparatus, image analysis method, and storage medium to display information representing flow quantity
US11704563B2 (en) Classifying time series image data
KR102388535B1 (ko) 인공지능에 기반하여 내시경 영상을 분석하기 위한 방법 및 장치
US20210165993A1 (en) Neural network training and line of sight detection methods and apparatus, and electronic device
WO2020222785A1 (en) Facial action unit detection
JPWO2021044249A5 (https=)
JP7040539B2 (ja) 視線推定装置、視線推定方法、およびプログラム
WO2021047453A1 (zh) 图像质量确定方法、装置及设备
JP7552698B2 (ja) 画像処理装置、画像処理方法、及び、記録媒体
CN108256633A (zh) 一种测试深度神经网络稳定性的方法
JP7054603B2 (ja) 判定装置、判定方法、及び判定プログラム
CN112528713B (zh) 一种注视点估计方法、系统、处理器及设备
Dimas et al. MedGaze: Gaze estimation on WCE images based on a CNN autoencoder
CA3177238C (en) A method and a system for detection of eye gaze-pattern abnormalities and related neurological diseases
Momtaz et al. Differences of eye movement pattern in natural and man-made scenes and image categorization with the help of these patterns
FR3092423A1 (fr) Cartographie de saillance d'images pendant une classification d'images par intelligence artificielle
JP7334415B2 (ja) 画像処理装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230823

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230823

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240423

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240619

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240806

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240829

R150 Certificate of patent or registration of utility model

Ref document number: 7548914

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150