JP2016524709A - 能動照明を備えるセンサシステム - Google Patents

能動照明を備えるセンサシステム Download PDF

Info

Publication number
JP2016524709A
JP2016524709A JP2016517191A JP2016517191A JP2016524709A JP 2016524709 A JP2016524709 A JP 2016524709A JP 2016517191 A JP2016517191 A JP 2016517191A JP 2016517191 A JP2016517191 A JP 2016517191A JP 2016524709 A JP2016524709 A JP 2016524709A
Authority
JP
Japan
Prior art keywords
imaging system
time
illumination light
imaging
flight
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2016517191A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016524709A5 (enExample
Inventor
オッジェ,ティエリー
デシュラー,マティアス
カロースティアン,ステファン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ams Sensors Singapore Pte Ltd
Original Assignee
Heptagon Micro Optics Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heptagon Micro Optics Pte Ltd filed Critical Heptagon Micro Optics Pte Ltd
Publication of JP2016524709A publication Critical patent/JP2016524709A/ja
Publication of JP2016524709A5 publication Critical patent/JP2016524709A5/ja
Priority to JP2019075455A priority Critical patent/JP6983192B2/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483Details of pulse systems
    • G01S7/484Transmitters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/8943D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491Details of non-pulse systems
    • G01S7/4911Transmitters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491Details of non-pulse systems
    • G01S7/4912Receivers
    • G01S7/4915Time delay measurement, e.g. operational details for pixel components; Phase measurement

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Input (AREA)
  • Image Analysis (AREA)
JP2016517191A 2013-06-06 2014-06-05 能動照明を備えるセンサシステム Pending JP2016524709A (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019075455A JP6983192B2 (ja) 2013-06-06 2019-04-11 撮像システムおよびそれを動作させる方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361831647P 2013-06-06 2013-06-06
US61/831,647 2013-06-06
PCT/EP2014/001526 WO2014195020A1 (en) 2013-06-06 2014-06-05 Sensor system with active illumination

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2019075455A Division JP6983192B2 (ja) 2013-06-06 2019-04-11 撮像システムおよびそれを動作させる方法

Publications (2)

Publication Number Publication Date
JP2016524709A true JP2016524709A (ja) 2016-08-18
JP2016524709A5 JP2016524709A5 (enExample) 2017-07-20

Family

ID=50942645

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2016517191A Pending JP2016524709A (ja) 2013-06-06 2014-06-05 能動照明を備えるセンサシステム
JP2019075455A Active JP6983192B2 (ja) 2013-06-06 2019-04-11 撮像システムおよびそれを動作させる方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2019075455A Active JP6983192B2 (ja) 2013-06-06 2019-04-11 撮像システムおよびそれを動作させる方法

Country Status (7)

Country Link
US (1) US10401498B2 (enExample)
EP (1) EP3004924B1 (enExample)
JP (2) JP2016524709A (enExample)
KR (1) KR102203318B1 (enExample)
CN (1) CN105705962B (enExample)
SG (2) SG10201710025WA (enExample)
WO (1) WO2014195020A1 (enExample)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019533134A (ja) * 2017-08-14 2019-11-14 シェンチェン グディックス テクノロジー カンパニー,リミテッド 三次元イメージングシステム及び電子デバイス
JP2020101377A (ja) * 2018-12-20 2020-07-02 三星電子株式会社Samsung Electronics Co.,Ltd. 3次元情報算出装置、3次元計測装置、3次元情報算出方法及び3次元情報算出プログラム
JP2020109977A (ja) * 2020-02-28 2020-07-16 シェンチェン グディックス テクノロジー カンパニー,リミテッド 三次元イメージングシステム及び電子デバイス
WO2021172070A1 (ja) * 2020-02-26 2021-09-02 株式会社デンソー 光学式検出装置および光学式検出装置における光軸ずれ判定方法
JP2021135292A (ja) * 2020-02-26 2021-09-13 株式会社デンソー 光学式検出装置および光学式検出装置における光軸ずれ判定方法

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016204363A1 (en) 2015-06-17 2016-12-22 Lg Electronics Inc. Mobile terminal and method for controlling the same
KR102311688B1 (ko) * 2015-06-17 2021-10-12 엘지전자 주식회사 이동단말기 및 그 제어방법
DE102015010421A1 (de) 2015-08-11 2017-02-16 Daimler Ag Dreidimensionale Erfassung des Fahrzeuginnenraums
US10101154B2 (en) * 2015-12-21 2018-10-16 Intel Corporation System and method for enhanced signal to noise ratio performance of a depth camera system
EP3232224B1 (de) * 2016-04-12 2018-06-13 Sick Ag Entfernungsmessender optoelektronischer sensor und verfahren zur erfassung und abstandsbestimmung von objekten
US10924638B2 (en) * 2016-06-27 2021-02-16 Intel Corporation Compact, low cost VCSEL projector for high performance stereodepth camera
US20180064399A1 (en) * 2016-09-07 2018-03-08 Heptagon Micro Optics Pte. Ltd. Imaging systems including multi-tap demodulation pixels for biometric measurements
US10451713B2 (en) * 2016-09-16 2019-10-22 Analog Devices, Inc. Interference handling in time-of-flight depth sensing
DE102016219099A1 (de) * 2016-09-30 2018-04-05 Robert Bosch Gmbh Optischer Sensor zur Entfernungs- und/oder Geschwindigkeitsmessung, System zur Mobilitätsüberwachung von autonomen Fahrzeugen und Verfahren zur Mobilitätsüberwachung von autonomen Fahrzeugen
EP3301479A1 (en) 2016-10-03 2018-04-04 Xenomatix NV Method for subtracting background light from an exposure value of a pixel in an imaging array, and pixel for use in same
US10582178B2 (en) * 2016-11-02 2020-03-03 Omnivision Technologies, Inc. Systems and methods for active depth imager with background subtract
US10771768B2 (en) 2016-12-15 2020-09-08 Qualcomm Incorporated Systems and methods for improved depth sensing
CN110214262A (zh) * 2017-01-25 2019-09-06 国立研究开发法人产业技术综合研究所 图像处理方法
CN106934394B (zh) * 2017-03-09 2024-01-19 奥比中光科技集团股份有限公司 双波长图像采集系统及方法
US10445893B2 (en) 2017-03-10 2019-10-15 Microsoft Technology Licensing, Llc Dot-based time of flight
US10928489B2 (en) * 2017-04-06 2021-02-23 Microsoft Technology Licensing, Llc Time of flight camera
US10401956B2 (en) 2017-05-11 2019-09-03 Microsoft Technology Licensing, Llc Infrared eye-tracking in high ambient light conditions
US10613228B2 (en) 2017-09-08 2020-04-07 Microsoft Techology Licensing, Llc Time-of-flight augmented structured light range-sensor
CN107607957B (zh) 2017-09-27 2020-05-22 维沃移动通信有限公司 一种深度信息获取系统及方法、摄像模组和电子设备
US10215856B1 (en) 2017-11-27 2019-02-26 Microsoft Technology Licensing, Llc Time of flight camera
US11675048B2 (en) 2017-11-30 2023-06-13 Sony Semiconductor Solutions Corporation Time-of-flight acquisition method and time-of-flight camera
JP7357539B2 (ja) * 2017-12-22 2023-10-06 ソニーセミコンダクタソリューションズ株式会社 信号生成装置
WO2019123830A1 (ja) 2017-12-22 2019-06-27 ソニーセミコンダクタソリューションズ株式会社 信号生成装置
US11592536B2 (en) * 2018-01-10 2023-02-28 Sony Semiconductor Solutions Corporation Control of image capture
US10901087B2 (en) 2018-01-15 2021-01-26 Microsoft Technology Licensing, Llc Time of flight camera
DE102018204902A1 (de) * 2018-03-29 2019-10-02 Zf Friedrichshafen Ag Funktionale Sicherheit für eine dreidimensionale Innenraumkamera
US10663567B2 (en) 2018-05-04 2020-05-26 Microsoft Technology Licensing, Llc Field calibration of a structured light range-sensor
JP2020031120A (ja) * 2018-08-22 2020-02-27 ソニーセミコンダクタソリューションズ株式会社 光源装置、温度検出方法、センシングモジュール
DE102018215513A1 (de) * 2018-09-12 2020-03-12 Zf Friedrichshafen Ag Anordnung von TOF-Sensoren zur Erfassung eines Passagierraums eines Peoplemovers, Auswerteeinrichtung zum Wahrnehmen eines Passagierraums eines Peoplemovers und Wahrnehmungssystem zum Wahrnehmen eines Blockierens einer Passagiertür eines Peoplemovers, einer Anzahl von Passagieren in dem Peoplemover und von Positionen, Körperposen und Aktivitäten der Passagiere
EP3640677B1 (en) 2018-10-17 2023-08-02 Trimble Jena GmbH Tracker of a surveying apparatus for tracking a target
EP3640590B1 (en) 2018-10-17 2021-12-01 Trimble Jena GmbH Surveying apparatus for surveying an object
EP3696498B1 (en) 2019-02-15 2025-04-09 Trimble Jena GmbH Surveying instrument and method of calibrating a survey instrument
CN109916279B (zh) * 2019-03-04 2020-09-22 Oppo广东移动通信有限公司 终端盖板的平整度检测方法、装置、测试机台及存储介质
WO2021030034A1 (en) 2019-08-15 2021-02-18 Apple Inc. Depth mapping using spatial multiplexing of illumination phase
US11474249B2 (en) * 2019-08-29 2022-10-18 Wisconsin Alumni Reseach Foundation Systems, methods, and media for stochastic exposure coding that mitigates multi-camera interference in continuous wave time-of-flight imaging
US11592568B2 (en) 2019-10-18 2023-02-28 Ai4 International Oy Measurement device and method of operating therefor
US12181273B2 (en) * 2020-02-21 2024-12-31 Hamamatsu Photonics K.K. Three-dimensional measurement device
US11763472B1 (en) 2020-04-02 2023-09-19 Apple Inc. Depth mapping with MPI mitigation using reference illumination pattern
CN115552285A (zh) 2020-06-11 2022-12-30 苹果公司 具有飞行时间感测能力的全局快门图像传感器
CN112379389B (zh) * 2020-11-11 2024-04-26 杭州蓝芯科技有限公司 一种结合结构光相机和tof深度相机的深度信息获取装置和方法
US11611685B2 (en) * 2021-05-10 2023-03-21 X Development Llc Enhanced synchronization framework
WO2024170540A1 (en) * 2023-02-15 2024-08-22 Ams-Osram International Gmbh Eye tracker module, eye tracking method and eye tracker system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002123837A (ja) * 2000-08-30 2002-04-26 Microsoft Corp 顔の特徴をアニメーション化する方法およびシステムならびに表情変換のための方法およびシステム
JP2006071784A (ja) * 2004-08-31 2006-03-16 Tokyo Seimitsu Co Ltd 共焦点顕微鏡、外観検査装置及び半導体外観検査装置
JP2010091569A (ja) * 2008-10-13 2010-04-22 Koh Young Technology Inc 3次元形状の測定方法及び測定装置
JP2011027707A (ja) * 2009-06-25 2011-02-10 Sharp Corp 人物動作検出装置、遊具装置、人物動作検出方法、ゲーム方法、制御プログラムおよび可読記録媒体
JP2011520116A (ja) * 2008-05-09 2011-07-14 フリーイェ・ユニヴェルシテイト・ブリュッセル バックグランド放射光の抑制に有利なtof領域
US20130002823A1 (en) * 2011-06-28 2013-01-03 Samsung Electronics Co., Ltd. Image generating apparatus and method

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS60174905A (ja) * 1984-02-22 1985-09-09 Hitachi Ltd 距離測定装置
RU2182385C2 (ru) * 1996-09-05 2002-05-10 Рудольф ШВАРТЕ Способ и устройство для определения информации об амплитуде и фазе электромагнитной волны
JP2917953B2 (ja) * 1997-02-05 1999-07-12 日本電気株式会社 視点位置検出装置
WO2001031570A2 (en) * 1999-10-27 2001-05-03 Digital Ink, Inc. Tracking motion of a writing instrument
US7420148B2 (en) * 2002-09-13 2008-09-02 Conti Temic Microelectronic Gmbh Method and device for determining a pixel gray scale value image
JP4161910B2 (ja) 2004-01-28 2008-10-08 株式会社デンソー 距離画像データ生成装置及び生成方法,プログラム
US7583863B2 (en) * 2004-05-10 2009-09-01 Avago Technologies General Ip (Singapore) Pte. Ltd. Method and system for wavelength-dependent imaging and detection using a hybrid filter
WO2007105205A2 (en) * 2006-03-14 2007-09-20 Prime Sense Ltd. Three-dimensional sensing using speckle patterns
US7586077B2 (en) 2007-07-18 2009-09-08 Mesa Imaging Ag Reference pixel array with varying sensitivities for time of flight (TOF) sensor
EP2026097A1 (en) * 2007-08-08 2009-02-18 Harman Becker Automotive Systems GmbH Vehicle illumination system
JP2009180690A (ja) * 2008-02-01 2009-08-13 Nikon Corp 三次元形状測定装置
CN102027388B (zh) * 2008-04-11 2013-08-28 瑞士联邦理工大学,洛桑(Epfl) 采用显示器作为照明源的基于飞行时间的成像系统
JP2010002326A (ja) * 2008-06-20 2010-01-07 Stanley Electric Co Ltd 移動ベクトル検出装置
US20110063437A1 (en) * 2008-08-20 2011-03-17 Tatsumi Watanabe Distance estimating device, distance estimating method, program, integrated circuit, and camera
JP2010219436A (ja) * 2009-03-18 2010-09-30 Sony Corp 多波長半導体レーザおよび光学記録再生装置
JP5799211B2 (ja) * 2009-04-24 2015-10-21 パナソニックIpマネジメント株式会社 距離画像センサ
JP5469446B2 (ja) * 2009-12-22 2014-04-16 パナソニック株式会社 物体検知装置
JP5740413B2 (ja) * 2010-01-06 2015-06-24 メサ・イメージング・アー・ゲーMesa Imaging Ag ピクセルアレイと記憶アレイを別個に備える復調センサ
JP2012002780A (ja) * 2010-06-21 2012-01-05 Shinko Electric Ind Co Ltd 形状計測装置、形状計測方法、および半導体パッケージの製造方法
JP5671281B2 (ja) * 2010-08-20 2015-02-18 キヤノン株式会社 位置姿勢計測装置、位置姿勢計測装置の制御方法及びプログラム
KR101753312B1 (ko) * 2010-09-17 2017-07-03 삼성전자주식회사 뎁스 영상 생성 장치 및 방법
EP2477043A1 (en) * 2011-01-12 2012-07-18 Sony Corporation 3D time-of-flight camera and method
GB2490872B (en) * 2011-05-09 2015-07-29 Toshiba Res Europ Ltd Methods and systems for capturing 3d surface geometry
KR101799522B1 (ko) * 2011-06-07 2017-11-21 삼성전자 주식회사 교환렌즈 형태를 채용한 3차원 영상 획득 장치
TWI575494B (zh) * 2011-08-19 2017-03-21 半導體能源研究所股份有限公司 半導體裝置的驅動方法
JP2014207493A (ja) * 2011-08-24 2014-10-30 パナソニック株式会社 撮像装置
US8982363B2 (en) * 2011-10-07 2015-03-17 Massachusetts Institute Of Technology Method and apparatus to determine depth information for a scene of interest
JP2013096941A (ja) * 2011-11-04 2013-05-20 Sony Corp 撮像装置、撮像方法、及びプログラム
US9046359B2 (en) * 2012-05-23 2015-06-02 Jds Uniphase Corporation Range imaging devices and methods

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002123837A (ja) * 2000-08-30 2002-04-26 Microsoft Corp 顔の特徴をアニメーション化する方法およびシステムならびに表情変換のための方法およびシステム
JP2006071784A (ja) * 2004-08-31 2006-03-16 Tokyo Seimitsu Co Ltd 共焦点顕微鏡、外観検査装置及び半導体外観検査装置
JP2011520116A (ja) * 2008-05-09 2011-07-14 フリーイェ・ユニヴェルシテイト・ブリュッセル バックグランド放射光の抑制に有利なtof領域
JP2010091569A (ja) * 2008-10-13 2010-04-22 Koh Young Technology Inc 3次元形状の測定方法及び測定装置
JP2011027707A (ja) * 2009-06-25 2011-02-10 Sharp Corp 人物動作検出装置、遊具装置、人物動作検出方法、ゲーム方法、制御プログラムおよび可読記録媒体
US20130002823A1 (en) * 2011-06-28 2013-01-03 Samsung Electronics Co., Ltd. Image generating apparatus and method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019533134A (ja) * 2017-08-14 2019-11-14 シェンチェン グディックス テクノロジー カンパニー,リミテッド 三次元イメージングシステム及び電子デバイス
US10659765B2 (en) 2017-08-14 2020-05-19 Shenzhen GOODIX Technology Co., Ltd. Three-dimensional (3D) image system and electronic device
JP2020101377A (ja) * 2018-12-20 2020-07-02 三星電子株式会社Samsung Electronics Co.,Ltd. 3次元情報算出装置、3次元計測装置、3次元情報算出方法及び3次元情報算出プログラム
JP7130544B2 (ja) 2018-12-20 2022-09-05 三星電子株式会社 3次元情報算出装置、3次元計測装置、3次元情報算出方法及び3次元情報算出プログラム
WO2021172070A1 (ja) * 2020-02-26 2021-09-02 株式会社デンソー 光学式検出装置および光学式検出装置における光軸ずれ判定方法
JP2021135292A (ja) * 2020-02-26 2021-09-13 株式会社デンソー 光学式検出装置および光学式検出装置における光軸ずれ判定方法
JP7322908B2 (ja) 2020-02-26 2023-08-08 株式会社デンソー 光学式検出装置および光学式検出装置における光軸ずれ判定方法
JP2020109977A (ja) * 2020-02-28 2020-07-16 シェンチェン グディックス テクノロジー カンパニー,リミテッド 三次元イメージングシステム及び電子デバイス

Also Published As

Publication number Publication date
KR20160039177A (ko) 2016-04-08
KR102203318B1 (ko) 2021-01-15
JP2019144261A (ja) 2019-08-29
SG10201710025WA (en) 2018-01-30
JP6983192B2 (ja) 2021-12-17
SG11201509788QA (en) 2015-12-30
CN105705962B (zh) 2019-02-01
EP3004924A1 (en) 2016-04-13
WO2014195020A1 (en) 2014-12-11
CN105705962A (zh) 2016-06-22
US20160109575A1 (en) 2016-04-21
US10401498B2 (en) 2019-09-03
EP3004924B1 (en) 2021-10-06

Similar Documents

Publication Publication Date Title
JP6983192B2 (ja) 撮像システムおよびそれを動作させる方法
CN109863418B (zh) 飞行时间深度感测中的干扰处理
US11212512B2 (en) System and method of imaging using multiple illumination pulses
CN109791205B (zh) 用于从成像阵列中的像素单元的曝光值减除背景光的方法以及用于该方法的像素单元
CN108010073B (zh) 用于具有背景去除的有源深度成像仪的系统和方法
CN110868518B (zh) 使用动态视觉传感器进行脉冲光图案捕获的系统和方法
JP7249953B2 (ja) ピクセル構造
JP6243402B2 (ja) 読み出し毎の複数のゲーテッド画素
EP3301477A1 (en) System for determining a distance to an object
US11375174B2 (en) System and method of reducing ambient background light in a pulse-illuminated image
EP3519860A1 (en) System and method for determining a distance to an object
US10958885B2 (en) Filtering imaging system including a light source to output an optical signal modulated with a code
WO2017068199A1 (en) System and method for determining a distance to an object
JP2018531374A6 (ja) 物体までの距離を測定するためのシステムおよび方法
EP4168825B1 (en) Low power operation of differential time-of-flight pixels
WO2018053292A1 (en) Interference handling in time-of-flight depth sensing

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170605

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170605

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180329

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180410

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180709

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180906

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190115

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20191203