JP2016521411A - 頭部及び眼球追跡 - Google Patents

頭部及び眼球追跡 Download PDF

Info

Publication number
JP2016521411A
JP2016521411A JP2016507510A JP2016507510A JP2016521411A JP 2016521411 A JP2016521411 A JP 2016521411A JP 2016507510 A JP2016507510 A JP 2016507510A JP 2016507510 A JP2016507510 A JP 2016507510A JP 2016521411 A JP2016521411 A JP 2016521411A
Authority
JP
Japan
Prior art keywords
eyeball
frames
frame
video
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2016507510A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016521411A5 (https=
Inventor
ベン トンプソン
ベン トンプソン
ジェイソン トゥルフェヌア
ジェイソン トゥルフェヌア
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Auckland Uniservices Ltd
Original Assignee
Auckland Uniservices Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Auckland Uniservices Ltd filed Critical Auckland Uniservices Ltd
Publication of JP2016521411A publication Critical patent/JP2016521411A/ja
Publication of JP2016521411A5 publication Critical patent/JP2016521411A5/ja
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14—Arrangements specially adapted for eye photography
    • A61B3/145—Arrangements specially adapted for eye photography by video means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
    • A61B5/1114—Tracking parts of the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique using image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30041—Eye; Retina; Ophthalmic
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Pathology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)
  • Eye Examination Apparatus (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Studio Devices (AREA)
JP2016507510A 2013-04-10 2014-04-10 頭部及び眼球追跡 Pending JP2016521411A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
NZ609259 2013-04-10
NZ60925913 2013-04-10
NZ618558 2013-12-03
NZ61855813 2013-12-03
PCT/NZ2014/000063 WO2014168492A1 (en) 2013-04-10 2014-04-10 Head and eye tracking

Publications (2)

Publication Number Publication Date
JP2016521411A true JP2016521411A (ja) 2016-07-21
JP2016521411A5 JP2016521411A5 (https=) 2017-06-01

Family

ID=51689804

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016507510A Pending JP2016521411A (ja) 2013-04-10 2014-04-10 頭部及び眼球追跡

Country Status (8)

Country Link
US (2) US10506924B2 (https=)
EP (1) EP2984628B1 (https=)
JP (1) JP2016521411A (https=)
KR (1) KR20150140814A (https=)
CN (1) CN105324794A (https=)
AU (2) AU2014251486A1 (https=)
SG (1) SG11201508399RA (https=)
WO (1) WO2014168492A1 (https=)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020500640A (ja) * 2016-12-07 2020-01-16 オークランド ユニサービシズ リミテッド 刺激及び視標追跡システム
JP2022096388A (ja) * 2020-12-17 2022-06-29 凸版印刷株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム
JP2023032863A (ja) * 2021-08-27 2023-03-09 凸版印刷株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム
JP2023511723A (ja) * 2020-01-29 2023-03-22 イノコ ビジョン スポルカ ジー オグラニクゾナ オドパウイエドジアルノシア 軌道決定及びイメージングのための方法及び装置

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10506924B2 (en) 2013-04-10 2019-12-17 Auckland Uniservices Limited Head and eye tracking
US10664705B2 (en) 2014-09-26 2020-05-26 Nec Corporation Object tracking apparatus, object tracking system, object tracking method, display control device, object detection device, and computer-readable medium
WO2016081852A1 (en) * 2014-11-20 2016-05-26 The Trustees Of The Universtiy Of Pennsylvania Methods and systems for testing opticokinetic nystagmus
US10582125B1 (en) * 2015-06-01 2020-03-03 Amazon Technologies, Inc. Panoramic image generation from video
CN105787901B (zh) * 2016-03-21 2018-07-24 昆明理工大学 一种用于太阳高分辨图像序列中相邻两帧间的多尺度速度场测量方法
EP3239870B1 (en) * 2016-04-28 2021-06-02 Essilor International A method for monitoring the behavior of a cohort group of members
US20180068449A1 (en) * 2016-09-07 2018-03-08 Valve Corporation Sensor fusion systems and methods for eye-tracking applications
CN106447604B (zh) * 2016-09-30 2021-07-13 北京奇虎科技有限公司 一种变换视频中面部画面的方法和装置
KR102349543B1 (ko) 2016-11-22 2022-01-11 삼성전자주식회사 사용자의 눈을 추적하는 방법 및 장치와 역변환된 저조도 영상을 생성하는 방법
EP3592204B1 (en) * 2017-03-05 2024-05-08 Virtuoptica Ltd. Eye examination method and apparatus therefor
CN107595291A (zh) * 2017-08-04 2018-01-19 上海志听医疗科技有限公司 一种安装到移动视觉记录设备的计算机可读介质
CN107661086A (zh) * 2017-08-04 2018-02-06 上海志听医疗科技有限公司 一种使用移动视觉记录设备收集眼睛运动数据的系统
CN107661085A (zh) * 2017-08-04 2018-02-06 上海志听医疗科技有限公司 一种实时收集眼动和头部位置及稳定性数据的方法
US11207011B2 (en) * 2018-02-07 2021-12-28 RightEye, LLC Systems and methods for assessing user physiology based on eye tracking data
CN109222890A (zh) * 2018-08-24 2019-01-18 微云（武汉）科技有限公司 一种眼睛健康情况确定方法、装置和存储介质
GB201814071D0 (en) * 2018-08-29 2018-10-10 Provost Fellows Found Scholars And The Other Members Of Board Of The College Of The Holy And Undivid Optical device and method
CN109254662A (zh) * 2018-09-04 2019-01-22 平安普惠企业管理有限公司 移动设备操作方法、装置、计算机设备及存储介质
US12144546B2 (en) * 2018-09-19 2024-11-19 Avedro, Inc. Systems and methods for eye tracking during eye treatment
CN119743610A (zh) * 2018-12-14 2025-04-01 苹果公司 注视驱动的视频录制
SE542553C2 (en) * 2018-12-17 2020-06-02 Tobii Ab Gaze tracking via tracing of light paths
US11644897B2 (en) * 2019-04-01 2023-05-09 Evolution Optiks Limited User tracking system using user feature location and method, and digital display device and digital image rendering system and method using same
US11600109B2 (en) 2019-05-20 2023-03-07 Barry Katz Smart eyeglasses for special needs children and adults
DE102019116381A1 (de) * 2019-06-17 2020-12-17 Schölly Fiberoptic GmbH Verfahren zur Bestimmung der Bildposition eines Markierungspunktes in einem Bild einer Bildsequenz
KR102824646B1 (ko) 2019-08-26 2025-06-25 삼성전자주식회사 영상 처리 방법 및 장치
CN112764706B (zh) * 2021-01-27 2024-07-02 无锡唐古半导体有限公司 图像处理方法、装置、系统、设备及介质
CN112515626B (zh) * 2021-02-18 2021-05-14 上海志听医疗科技有限公司 位置时间曲线绘制方法及系统、头脉冲试验评估方法及系统
US20230270337A1 (en) * 2022-02-28 2023-08-31 Hb Innovations, Inc. System and method for video detection of breathing rates
WO2023244830A1 (en) 2022-06-16 2023-12-21 Welch Allyn, Inc. Vision screening device including oversampling sensor
JP7409732B1 (ja) 2023-08-15 2024-01-09 株式会社Parafeed 眼振解析装置、プログラム、及び解析システム
CN117796745B (zh) * 2024-02-29 2024-05-03 四川大学 一种估计消化内镜镜头进退距离的方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0670885A (ja) * 1992-07-09 1994-03-15 A T R Shichokaku Kiko Kenkyusho:Kk 視線検出を用いた医療診断装置
JPH10146319A (ja) * 1996-11-20 1998-06-02 Yukinobu Kunihiro 眼球運動解析装置
US6364845B1 (en) * 1998-09-17 2002-04-02 University Of Rochester Methods for diagnosing visuospatial disorientation or assessing visuospatial orientation capacity
JP2003319907A (ja) * 2002-05-07 2003-11-11 New Opto Corp 眼球運動解析システム及び眼球撮像装置
JP2004504684A (ja) * 2000-07-24 2004-02-12 シーイング・マシーンズ・プロプライエタリー・リミテッド 顔画像処理システム
JP2005013626A (ja) * 2003-06-27 2005-01-20 Nissan Motor Co Ltd 覚醒状態検出装置
JP2010131401A (ja) * 2002-10-15 2010-06-17 Volvo Technology Corp 被験者の頭及び目の動きを分析する方法及び装置
EP2261772A1 (en) * 2009-06-12 2010-12-15 Star Nav Method for controlling an input device based on the detection of attitude or eye gaze

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9308952D0 (en) * 1993-04-30 1993-06-16 Philips Electronics Uk Ltd Tracking objects in video sequences
US5617872A (en) * 1994-07-25 1997-04-08 Beth Israel Hospitcal Assoc. Inc. Hypersensitive constriction velocity method for diagnosing Alzheimer's disease in a living human
GB0119859D0 (en) * 2001-08-15 2001-10-10 Qinetiq Ltd Eye tracking system
US7380938B2 (en) 2003-03-25 2008-06-03 Sarnoff Corporation Apparatus to detect and measure saccade and pupilary changes
CN1225375C (zh) * 2003-07-02 2005-11-02 北京交通大学 基于多特征融合的困倦驾驶检测方法
GB0315412D0 (en) * 2003-07-02 2003-08-06 Queen Mary & Westfield College Optical flow estimation method
JP4687252B2 (ja) * 2005-06-02 2011-05-25 ソニー株式会社 画像処理装置、その方法、そのプログラムおよび記録媒体
CA2639125A1 (en) * 2006-03-13 2007-09-13 Imotions-Emotion Technology A/S Visual attention and emotional response detection and display system
US8781162B2 (en) * 2011-01-05 2014-07-15 Ailive Inc. Method and system for head tracking and pose estimation
DE102006062061B4 (de) * 2006-12-29 2010-06-10 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung, Verfahren und Computerprogramm zum Bestimmen einer Position basierend auf einem Kamerabild von einer Kamera
CN101030316B (zh) * 2007-04-17 2010-04-21 北京中星微电子有限公司 一种汽车安全驾驶监控系统和方法
EP2577963A1 (en) * 2010-05-26 2013-04-10 Ramot at Tel Aviv University, Ltd. Method and system for correcting gaze offset
US20120068858A1 (en) * 2010-09-22 2012-03-22 Edward Fredkin Traffic negotiation system
US8911087B2 (en) * 2011-05-20 2014-12-16 Eyefluence, Inc. Systems and methods for measuring reactions of head, eyes, eyelids and pupils
JP6120837B2 (ja) * 2011-06-27 2017-04-26 スウィング・プロファイル・リミテッド スポーツ動作のビデオを解析する方法
CN102547123B (zh) * 2012-01-05 2014-02-26 天津师范大学 基于人脸识别技术的自适应视线跟踪系统及其跟踪方法
US20140172555A1 (en) * 2012-12-19 2014-06-19 Wal-Mart Stores, Inc. Techniques for monitoring the shopping cart of a consumer
US10506924B2 (en) 2013-04-10 2019-12-17 Auckland Uniservices Limited Head and eye tracking

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0670885A (ja) * 1992-07-09 1994-03-15 A T R Shichokaku Kiko Kenkyusho:Kk 視線検出を用いた医療診断装置
JPH10146319A (ja) * 1996-11-20 1998-06-02 Yukinobu Kunihiro 眼球運動解析装置
US6364845B1 (en) * 1998-09-17 2002-04-02 University Of Rochester Methods for diagnosing visuospatial disorientation or assessing visuospatial orientation capacity
JP2004504684A (ja) * 2000-07-24 2004-02-12 シーイング・マシーンズ・プロプライエタリー・リミテッド 顔画像処理システム
JP2003319907A (ja) * 2002-05-07 2003-11-11 New Opto Corp 眼球運動解析システム及び眼球撮像装置
JP2010131401A (ja) * 2002-10-15 2010-06-17 Volvo Technology Corp 被験者の頭及び目の動きを分析する方法及び装置
JP2005013626A (ja) * 2003-06-27 2005-01-20 Nissan Motor Co Ltd 覚醒状態検出装置
EP2261772A1 (en) * 2009-06-12 2010-12-15 Star Nav Method for controlling an input device based on the detection of attitude or eye gaze

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ＷＵ ＴＵＮＨＵＡ，外４名: "Real-time non-intrusive eye tracking for human-computer interaction", COMPUTER SCIENCE AND EDUCATION (ICCSE), 2010 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUC, JPN6018016927, 2010, pages 1092 - 1096, ISSN: 0004086176 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020500640A (ja) * 2016-12-07 2020-01-16 オークランド ユニサービシズ リミテッド 刺激及び視標追跡システム
JP7141396B2 (ja) 2016-12-07 2022-09-22 オークランド ユニサービシズ リミテッド 刺激及び視標追跡システム
JP2023511723A (ja) * 2020-01-29 2023-03-22 イノコ ビジョン スポルカ ジー オグラニクゾナ オドパウイエドジアルノシア 軌道決定及びイメージングのための方法及び装置
JP7650890B2 (ja) 2020-01-29 2025-03-25 イノコ ビジョン スポルカ ジー オグラニクゾナ オドパウイエドジアルノシア 軌道決定及びイメージングのための方法及び装置
JP2022096388A (ja) * 2020-12-17 2022-06-29 凸版印刷株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム
JP7631780B2 (ja) 2020-12-17 2025-02-19 Ｔｏｐｐａｎホールディングス株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム
JP2023032863A (ja) * 2021-08-27 2023-03-09 凸版印刷株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム
JP7746738B2 (ja) 2021-08-27 2025-10-01 Ｔｏｐｐａｎホールディングス株式会社 眼球運動計測装置、眼球運動計測方法及びプログラム

Also Published As

Publication number Publication date
SG11201508399RA (en) 2015-11-27
WO2014168492A1 (en) 2014-10-16
CN105324794A (zh) 2016-02-10
US20200069179A1 (en) 2020-03-05
KR20150140814A (ko) 2015-12-16
EP2984628B1 (en) 2019-03-27
EP2984628A4 (en) 2016-12-14
US20160066781A1 (en) 2016-03-10
EP2984628A1 (en) 2016-02-17
AU2014251486A1 (en) 2015-11-26
US10506924B2 (en) 2019-12-17
AU2018264135A1 (en) 2018-12-06

Similar Documents

Publication Publication Date Title
JP2016521411A (ja) 頭部及び眼球追跡
JP5841538B2 (ja) 関心度推定装置および関心度推定方法
CN105326471B (zh) 婴幼儿视力测试装置
JP2017522104A (ja) 目状態決定システム
Turuwhenua et al. A method for detecting optokinetic nystagmus based on the optic flow of the limbus
CN111067474B (zh) 使用动态速度阈值滤波器的客观视敏度测量的装置和方法
Sangi et al. An optokinetic nystagmus detection method for use with young children
CN114007488B (zh) 用于确定对比敏感度阈值的方法和装置
JP2020061194A (ja) 顔の見た目印象の決定部位の抽出方法、顔の見た目印象の決定因子の抽出方法、顔の見た目印象の鑑別方法
CN115590462A (zh) 一种基于摄像头的视力检测方法和装置
CN116997288B (zh) 用于确定视觉表现的方法和设备
Panigrahi et al. A method for localizing the eye pupil for point-of-gaze estimation
Larsson Event detection in eye-tracking data for use in applications with dynamic stimuli
JP2016193175A (ja) 顔の見た目印象の決定部位の抽出方法、顔の見た目印象の決定因子の抽出方法、顔の見た目印象の鑑別方法
CN114761999A (zh) 图像处理方法、图像处理装置以及图像处理程序
JP6269177B2 (ja) 瞳孔検出装置、視線検出装置および瞳孔検出方法
Huang et al. Development a low-cost smart eyewear system for eye & head movement measurement and analysis
Chaudhary et al. Enhancing the precision of remote eye-tracking using iris velocity estimation
Chaudhary et al. $ pi_t $-Enhancing the Precision of Eye Tracking using Iris Feature Motion Vectors
Sangi et al. A head tracking method for improved eye movement detection in children
Belyaev et al. Oculomotor reactions in fixations and saccades with visual perception of information
Guo et al. A 2D feature space representation of the optokinetic velocity signal
AU2022377227A1 (en) Method and system for determining eye test screen distance
Quang et al. Mobile traumatic brain injury assessment system
GB2612364A (en) Method and system for determining user-screen distance

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170410

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170410

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20170420

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180412

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180514

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180814

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180913

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20190131

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190528

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20190710

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20190802