JP7436509B2 - 情報処理装置、撮像装置、情報処理方法、及びプログラム - Google Patents

情報処理装置、撮像装置、情報処理方法、及びプログラム Download PDF

Info

Publication number
JP7436509B2
JP7436509B2 JP2021565366A JP2021565366A JP7436509B2 JP 7436509 B2 JP7436509 B2 JP 7436509B2 JP 2021565366 A JP2021565366 A JP 2021565366A JP 2021565366 A JP2021565366 A JP 2021565366A JP 7436509 B2 JP7436509 B2 JP 7436509B2
Authority
JP
Japan
Prior art keywords
light
distance measurement
distance
image
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021565366A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021124730A1 (https=
JPWO2021124730A5 (https=
Inventor
智紀 増田
健吉 林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Publication of JPWO2021124730A1 publication Critical patent/JPWO2021124730A1/ja
Publication of JPWO2021124730A5 publication Critical patent/JPWO2021124730A5/ja
Priority to JP2024017961A priority Critical patent/JP2024063018A/ja
Application granted granted Critical
Publication of JP7436509B2 publication Critical patent/JP7436509B2/ja
Priority to JP2025105845A priority patent/JP2025138721A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/703SSIS architectures incorporating pixels for producing signals other than image signals
    • H04N25/705Pixels for depth measurement, e.g. RGBZ
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00Measuring distances in line of sight; Optical rangefinders
    • G01C3/02Details
    • G01C3/06Use of electric means to obtain final indication
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only
    • G01S17/10Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87Combinations of systems using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/30Systems for automatic generation of focusing signals using parallactic triangle with a base line
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/30Systems for automatic generation of focusing signals using parallactic triangle with a base line
    • G02B7/32Systems for automatic generation of focusing signals using parallactic triangle with a base line using active means, e.g. light emitter
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/34Systems for automatic generation of focusing signals using different areas in a pupil plane
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/36Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32Means for focusing
    • G03B13/34Power focusing
    • G03B13/36Autofocus systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/671Focus control based on electronic image sensor signals in combination with active ranging signals, e.g. using light or sound signals emitted toward objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/672Focus control based on electronic image sensor signals based on the phase difference signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/673Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/703SSIS architectures incorporating pixels for producing signals other than image signals
    • H04N25/704Pixels specially adapted for focusing, e.g. phase difference pixel sets

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Optics & Photonics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
JP2021565366A 2019-12-17 2020-11-10 情報処理装置、撮像装置、情報処理方法、及びプログラム Active JP7436509B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2024017961A JP2024063018A (ja) 2019-12-17 2024-02-08 情報処理装置、撮像装置、情報処理方法、及びプログラム
JP2025105845A JP2025138721A (ja) 2019-12-17 2025-06-23 情報処理装置、撮像装置、情報処理方法、及びプログラム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2019227582 2019-12-17
JP2019227582 2019-12-17
PCT/JP2020/041849 WO2021124730A1 (ja) 2019-12-17 2020-11-10 情報処理装置、撮像装置、情報処理方法、及びプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024017961A Division JP2024063018A (ja) 2019-12-17 2024-02-08 情報処理装置、撮像装置、情報処理方法、及びプログラム

Publications (3)

Publication Number Publication Date
JPWO2021124730A1 JPWO2021124730A1 (https=) 2021-06-24
JPWO2021124730A5 JPWO2021124730A5 (https=) 2022-08-23
JP7436509B2 true JP7436509B2 (ja) 2024-02-21

Family

ID=76476598

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2021565366A Active JP7436509B2 (ja) 2019-12-17 2020-11-10 情報処理装置、撮像装置、情報処理方法、及びプログラム
JP2024017961A Pending JP2024063018A (ja) 2019-12-17 2024-02-08 情報処理装置、撮像装置、情報処理方法、及びプログラム
JP2025105845A Pending JP2025138721A (ja) 2019-12-17 2025-06-23 情報処理装置、撮像装置、情報処理方法、及びプログラム

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2024017961A Pending JP2024063018A (ja) 2019-12-17 2024-02-08 情報処理装置、撮像装置、情報処理方法、及びプログラム
JP2025105845A Pending JP2025138721A (ja) 2019-12-17 2025-06-23 情報処理装置、撮像装置、情報処理方法、及びプログラム

Country Status (4)

Country Link
US (2) US12120425B2 (https=)
JP (3) JP7436509B2 (https=)
CN (2) CN120358422A (https=)
WO (1) WO2021124730A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024063018A (ja) * 2019-12-17 2024-05-10 富士フイルム株式会社 情報処理装置、撮像装置、情報処理方法、及びプログラム

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021235033A1 (ja) * 2020-05-20 2021-11-25 ソニーグループ株式会社 センシングシステム
CN117321632A (zh) * 2021-05-18 2023-12-29 斯纳普公司 利用立体视觉和相位检测自动对焦(pdaf)的不同深度确定
EP4636473A4 (en) * 2023-01-20 2026-03-18 Samsung Electronics Co Ltd COMPUTER-READABLE ELECTRONIC DEVICE, METHOD AND NON-TRANSITORY STORAGE MEDIA FOR ADJUSTING THE LOCATION OF A LENS ASSEMBLY BASED ON RELIABILITY DATA OBTAINED USING A LASER SENSOR
JP2024120227A (ja) * 2023-02-24 2024-09-05 キヤノン株式会社 制御装置、光検出システム、撮像装置、制御方法、およびプログラム

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003107159A (ja) 2001-09-28 2003-04-09 Honda Motor Co Ltd 車両用物体検知装置における軸ずれ調整装置
JP2011013135A (ja) 2009-07-03 2011-01-20 Nippon Signal Co Ltd:The 光測距装置
WO2014119241A1 (ja) 2013-01-31 2014-08-07 パナソニック株式会社 測距方法および測距システム
JP2017173298A (ja) 2016-03-16 2017-09-28 株式会社リコー 物体検出装置及び移動体装置
WO2018101049A1 (ja) 2016-11-29 2018-06-07 パナソニックIpマネジメント株式会社 固体撮像装置及び測距撮像装置
WO2018150998A1 (ja) 2017-02-17 2018-08-23 北陽電機株式会社 物体捕捉装置、捕捉対象物及び物体捕捉システム
JP2019047486A (ja) 2017-08-31 2019-03-22 キヤノン株式会社 固体撮像素子及び撮像装置
US20190310371A1 (en) 2018-04-04 2019-10-10 Melexis Technologies Nv Pulsed-light detection and ranging apparatus, system and method of detection and ranging of an object in a pulsed light detection and ranging system

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2853694B2 (ja) * 1997-02-07 1999-02-03 オムロン株式会社 光電検出器
JP3516567B2 (ja) * 1997-02-18 2004-04-05 京セラ株式会社 パワーズーム機能を備えた合焦検出装置
EP0971242A1 (en) * 1998-07-10 2000-01-12 Cambridge Consultants Limited Sensor signal processing
JP2001311619A (ja) * 2000-05-01 2001-11-09 Asahi Optical Co Ltd 測距装置及び測距方法
JP2003057343A (ja) 2001-08-17 2003-02-26 Hitachi Ltd レーザ測距装置
US8134637B2 (en) * 2004-01-28 2012-03-13 Microsoft Corporation Method and system to increase X-Y resolution in a depth (Z) camera using red, blue, green (RGB) sensing
US7098999B1 (en) * 2004-03-05 2006-08-29 Raytheon Company High-speed readout circuit and system incorporating same
JP2007114831A (ja) * 2005-10-18 2007-05-10 Omron Corp 物体検出装置
JP4345783B2 (ja) 2006-08-10 2009-10-14 オムロン株式会社 物体検知装置および方法
EP2598909B1 (en) * 2010-07-26 2017-01-04 Koninklijke Philips N.V. Apparatus for measuring a distance
JP2012154719A (ja) * 2011-01-25 2012-08-16 Omron Corp 物体検出ユニット
JP5942343B2 (ja) * 2011-05-25 2016-06-29 株式会社リコー 撮像装置
AU2012282072B2 (en) * 2011-07-13 2017-10-19 Hunter Safety Lab, Llc A system for preventing friendly fire accidents
US8860930B2 (en) * 2012-06-02 2014-10-14 Richard Kirby Three dimensional surface mapping system using optical flow
JP5902354B2 (ja) * 2013-07-16 2016-04-13 富士フイルム株式会社 撮影装置及び3次元計測装置
JP6458343B2 (ja) * 2014-02-27 2019-01-30 株式会社ニコン 撮像装置
JP2015194356A (ja) * 2014-03-31 2015-11-05 パナソニックIpマネジメント株式会社 距離測定装置
DE102015201317B4 (de) * 2015-01-27 2025-03-20 Bayerische Motoren Werke Aktiengesellschaft Vermessen einer Abmessung auf einer Oberfläche
WO2017134880A1 (ja) * 2016-02-04 2017-08-10 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
US12146960B2 (en) * 2016-03-01 2024-11-19 Brightway Vision Ltd. Gated imaging apparatus, system and method
EP3223034B1 (en) 2016-03-16 2022-07-20 Ricoh Company, Ltd. Object detection apparatus and moveable apparatus
JP6915615B2 (ja) * 2016-06-06 2021-08-04 ソニーグループ株式会社 撮像素子、撮像装置、電子機器
US10594920B2 (en) * 2016-06-15 2020-03-17 Stmicroelectronics, Inc. Glass detection with time of flight sensor
EP3508814B1 (en) * 2016-09-01 2023-08-23 Sony Semiconductor Solutions Corporation Imaging device
EP3301476B1 (en) * 2016-09-28 2023-03-15 STMicroelectronics (Research & Development) Limited Apparatus having a camera and a time of flight single photon avalanche diode based range detecting module for controlling the camera and corresponding method
JP6929094B2 (ja) * 2017-03-27 2021-09-01 キヤノン株式会社 電子機器、撮像装置、及び制御方法、並びにプログラム
EP3460509B1 (en) * 2017-09-22 2024-12-11 ams AG Method for calibrating a time-of-flight system and time-of-flight system
JP6914158B2 (ja) * 2017-09-25 2021-08-04 シャープ株式会社 測距センサ
US10690773B2 (en) * 2017-12-07 2020-06-23 Velodyne Lidar, Inc. Systems and methods for efficient multi-return light detectors
JP7119444B2 (ja) * 2018-03-13 2022-08-17 株式会社リコー 測距システム、測距方法、車載装置、車両
EP3859394B1 (en) * 2018-09-28 2025-08-27 Panasonic Intellectual Property Management Co., Ltd. Depth acquisition device, depth acquisition method, and program
CN110398748B (zh) * 2019-07-19 2022-05-31 Oppo广东移动通信有限公司 距离测量装置及设备、方法
CN121432447A (zh) * 2019-09-30 2026-01-30 富士胶片株式会社 处理装置、电子设备、处理方法及存储介质
JP7321290B2 (ja) * 2019-11-29 2023-08-04 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
CN120358422A (zh) * 2019-12-17 2025-07-22 富士胶片株式会社 信息处理装置、摄像装置、信息处理方法及存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003107159A (ja) 2001-09-28 2003-04-09 Honda Motor Co Ltd 車両用物体検知装置における軸ずれ調整装置
JP2011013135A (ja) 2009-07-03 2011-01-20 Nippon Signal Co Ltd:The 光測距装置
WO2014119241A1 (ja) 2013-01-31 2014-08-07 パナソニック株式会社 測距方法および測距システム
JP2017173298A (ja) 2016-03-16 2017-09-28 株式会社リコー 物体検出装置及び移動体装置
WO2018101049A1 (ja) 2016-11-29 2018-06-07 パナソニックIpマネジメント株式会社 固体撮像装置及び測距撮像装置
WO2018150998A1 (ja) 2017-02-17 2018-08-23 北陽電機株式会社 物体捕捉装置、捕捉対象物及び物体捕捉システム
JP2019047486A (ja) 2017-08-31 2019-03-22 キヤノン株式会社 固体撮像素子及び撮像装置
US20190310371A1 (en) 2018-04-04 2019-10-10 Melexis Technologies Nv Pulsed-light detection and ranging apparatus, system and method of detection and ranging of an object in a pulsed light detection and ranging system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024063018A (ja) * 2019-12-17 2024-05-10 富士フイルム株式会社 情報処理装置、撮像装置、情報処理方法、及びプログラム

Also Published As

Publication number Publication date
JPWO2021124730A1 (https=) 2021-06-24
CN120358422A (zh) 2025-07-22
WO2021124730A1 (ja) 2021-06-24
JP2025138721A (ja) 2025-09-25
CN114868037A (zh) 2022-08-05
US12120425B2 (en) 2024-10-15
US20220294990A1 (en) 2022-09-15
JP2024063018A (ja) 2024-05-10
CN114868037B (zh) 2025-06-27
US20250008216A1 (en) 2025-01-02

Similar Documents

Publication Publication Date Title
JP7436509B2 (ja) 情報処理装置、撮像装置、情報処理方法、及びプログラム
JP7614264B2 (ja) 情報処理装置、情報処理方法、及びプログラム
JPWO2017213052A1 (ja) 測距システム及び測距方法
JP7633317B2 (ja) 処理装置、電子機器、処理方法、及びプログラム
US20240418862A1 (en) Processing apparatus, electronic apparatus, processing method, and program
JP6314688B2 (ja) 入力装置
US20210063850A1 (en) Imaging device, method for controlling imaging device, and system including imaging device
JP2026068027A (ja) 情報処理装置、情報処理方法、及びプログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220614

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220614

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230613

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230810

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231010

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231207

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240109

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240208

R150 Certificate of patent or registration of utility model

Ref document number: 7436509

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150