KR102878641B1 - Lidar 측정을 위한 처리 시스템 - Google Patents

Lidar 측정을 위한 처리 시스템

Info

Publication number
KR102878641B1
KR102878641B1 KR1020227007027A KR20227007027A KR102878641B1 KR 102878641 B1 KR102878641 B1 KR 102878641B1 KR 1020227007027 A KR1020227007027 A KR 1020227007027A KR 20227007027 A KR20227007027 A KR 20227007027A KR 102878641 B1 KR102878641 B1 KR 102878641B1
Authority
KR
South Korea
Prior art keywords
registers
delete delete
histogram
peaks
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227007027A
Other languages
English (en)
Korean (ko)
Other versions
KR20220042202A (ko
Inventor
안구스 파칼라
마빈 슈
Original Assignee
아우스터, 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 아우스터, 인크. filed Critical 아우스터, 인크.
Publication of KR20220042202A publication Critical patent/KR20220042202A/ko
Application granted granted Critical
Publication of KR102878641B1 publication Critical patent/KR102878641B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/894—Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/42—Simultaneous measurement of distance and other co-ordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/487—Extracting wanted echo signals, e.g. pulse detection
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)
KR1020227007027A 2019-08-05 2020-08-05 Lidar 측정을 위한 처리 시스템 Active KR102878641B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962882907P 2019-08-05 2019-08-05
US62/882,907 2019-08-05
PCT/US2020/045016 WO2021026241A1 (en) 2019-08-05 2020-08-05 Processing system for lidar measurements

Publications (2)

Publication Number Publication Date
KR20220042202A KR20220042202A (ko) 2022-04-04
KR102878641B1 true KR102878641B1 (ko) 2025-10-31

Family

ID=74504173

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020227007027A Active KR102878641B1 (ko) 2019-08-05 2020-08-05 Lidar 측정을 위한 처리 시스템

Country Status (6)

Country Link
US (3) US12189038B2 (enExample)
EP (2) EP3990946B1 (enExample)
JP (1) JP7663551B2 (enExample)
KR (1) KR102878641B1 (enExample)
CN (1) CN114424086B (enExample)
WO (1) WO2021026241A1 (enExample)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021072380A1 (en) 2019-10-10 2021-04-15 Ouster, Inc. Processing time-series measurements for lidar accuracy
DE102020201636A1 (de) * 2020-02-11 2021-08-12 Ibeo Automotive Systems GmbH Einrichtung zur Erzeugung von Rückstreuungs-Histogrammdaten für die Bestimmung einer diffusen Rückstreuung bei einer optischen Laufzeitmessung und Verfahren
US11885915B2 (en) * 2020-03-30 2024-01-30 Stmicroelectronics (Research & Development) Limited Time to digital converter
JP7616871B2 (ja) * 2020-11-20 2025-01-17 株式会社Soken 信号処理装置
CN117099016A (zh) * 2021-03-23 2023-11-21 欧司朗股份有限公司 检测系统和执行时间测量的方法
US20220308187A1 (en) * 2021-03-26 2022-09-29 Aeye, Inc. Hyper Temporal Lidar Using Multiple Matched Filters to Determine Target Retro-Reflectivity
US12663518B2 (en) 2021-03-26 2026-06-23 Aeye, Inc. Hyper temporal lidar with switching between a baseline scan mode and a pulse burst mode
CN115144863B (zh) * 2021-03-31 2025-12-09 上海禾赛科技有限公司 确定噪声水平的方法、激光雷达以及测距方法
CN115144864B (zh) * 2021-03-31 2025-07-29 上海禾赛科技有限公司 存储方法、数据处理方法、激光雷达和计算机可读存储介质
US12164031B2 (en) 2021-04-30 2024-12-10 Waymo Llc Method and system for a threshold noise filter
JP2022176812A (ja) * 2021-05-17 2022-11-30 ソニーセミコンダクタソリューションズ株式会社 光検出装置および光検出システム
DE102022113233A1 (de) * 2021-06-02 2022-12-08 Ifm Electronic Gmbh Lichtlaufzeitkamera mit SPAD-Lichtlaufzeitpixel
JP2022185842A (ja) * 2021-06-03 2022-12-15 ソニーセミコンダクタソリューションズ株式会社 光検出装置、光検出システム、および光検出方法
US12429568B2 (en) 2021-06-11 2025-09-30 Aeva, Inc. Techniques for peak detection in a LIDAR system
WO2023001363A1 (en) * 2021-07-19 2023-01-26 Huawei Technologies Co., Ltd. Time-of-flight sensor
US12405376B2 (en) 2021-07-27 2025-09-02 Samsung Electronics Co., Ltd. SPAD image sensor
CN115902835B (zh) * 2021-09-30 2024-02-27 深圳市速腾聚创科技有限公司 一种雷达数据收发装置、测距方法及激光雷达
KR102488500B1 (ko) * 2021-11-12 2023-01-13 주식회사 에스오에스랩 라이다 데이터 처리 방법
KR102488494B1 (ko) * 2021-11-12 2023-01-13 주식회사 에스오에스랩 라이다 데이터 처리 방법
WO2023085466A1 (ko) * 2021-11-12 2023-05-19 주식회사 에스오에스랩 라이다 데이터 처리 방법.
KR102505602B1 (ko) * 2021-11-12 2023-03-03 주식회사 에스오에스랩 라이다 데이터 처리 방법
CN116413730B (zh) * 2021-12-29 2024-05-31 深圳市速腾聚创科技有限公司 测距方法、装置、存储介质及激光雷达
US12105224B2 (en) * 2022-01-11 2024-10-01 Samsung Electronics Co., Ltd LiDAR adaptive single-pass histogramming for low power LiDAR system
JP2023108937A (ja) * 2022-01-26 2023-08-07 ソニーセミコンダクタソリューションズ株式会社 測距装置および測距装置の制御方法
GB202205893D0 (en) * 2022-04-22 2022-06-08 Univ Edinburgh Single photon avalanche diode macropixel
US20230417908A1 (en) * 2022-06-23 2023-12-28 Taiwan Semiconductor Manufacturing Company Ltd. Periodical correlation detection for background light suppression in direct time-of-flight sensor
CN117368882A (zh) * 2022-07-01 2024-01-09 上海禾赛科技有限公司 基于动态阈值的回波信号检测方法、系统和激光雷达
US20240036209A1 (en) * 2022-08-01 2024-02-01 Pixart Imaging Inc. Optical sensor capable of cancelling interference
CN120051708A (zh) * 2022-08-18 2025-05-27 Lg伊诺特有限公司 传感器装置、lidar装置及其控制方法
KR102825394B1 (ko) 2022-08-31 2025-06-27 주식회사 솔리드뷰 거리 측정 장치
US20240094359A1 (en) * 2022-09-16 2024-03-21 Huawei Technologies Co., Ltd. Iterative histogram binwidth optimization method for a lidar system and lidar system implementing same
WO2024081230A1 (en) * 2022-10-11 2024-04-18 Zoox, Inc. Lidar background noise detection and compensation
KR102862102B1 (ko) * 2022-11-29 2025-09-22 (주)시그봇 센서 장치 및 센서 장치의 데이터 처리 방법
JP2024085067A (ja) * 2022-12-14 2024-06-26 株式会社小糸製作所 視界支援表示装置、視界支援表示システム、および視界支援表示方法
KR102597480B1 (ko) * 2022-12-15 2023-11-02 주식회사 에스오에스랩 라이다 데이터 생성 방법 및 이를 이용하는 라이다 장치
EP4418005A1 (de) 2023-02-16 2024-08-21 Elmos Semiconductor SE Verfahren und schaltung zur ermittlung des abstandes eines objekts von einer optischen tof-messeinrichtung sowie verwendung dieses verfahrens und dieser schaltung für eine lidar-vorrichtung
KR20250168441A (ko) * 2023-03-31 2025-12-02 소니 세미컨덕터 솔루션즈 가부시키가이샤 이벤트 검출 회로부, 이벤트 검출 센서, 이벤트 검출 방법
US12652475B2 (en) * 2023-06-01 2026-06-09 Meta Platforms Technologies, Llc Intensity imaging and depth sensing with histogram overflow prevention
CN116540953B (zh) * 2023-07-07 2023-09-29 苏州识光芯科技术有限公司 时差区间分布直方图数据生成方法、装置、芯片及设备
KR20250092511A (ko) * 2023-12-15 2025-06-24 주식회사 솔리드뷰 수광소자의 신호처리방법 및 그 장치
KR20250098541A (ko) 2023-12-22 2025-07-01 주식회사 솔리드뷰 노출 시간을 조절할 수 있는 라이다 센서
CN121232198B (zh) * 2025-12-04 2026-03-10 吉林大学 光学相控阵激光雷达、激光雷达系统及其扫描方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018091760A (ja) * 2016-12-05 2018-06-14 株式会社豊田中央研究所 光学測定装置、光学測定方法、及び光学測定プログラム
WO2018160886A1 (en) * 2017-03-01 2018-09-07 Ouster, Inc. Accurate photo detector measurements for lidar
WO2019112733A1 (en) * 2017-12-07 2019-06-13 Velodyne Lidar, Inc. Systems and methods for efficient multi-return light detectors

Family Cites Families (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3566402A (en) 1968-11-18 1971-02-23 Westinghouse Electric Corp Mti radar system utilizing unique patterns of interpulse period choices to simplify weighting coefficients for individual echo pulses
JPS5114409B1 (enExample) 1971-06-02 1976-05-10
US6101294A (en) 1997-06-02 2000-08-08 Sarnoff Corporation Extended dynamic imaging system and method
JP3695170B2 (ja) * 1998-09-17 2005-09-14 オムロン株式会社 光式センサ
AUPR301401A0 (en) 2001-02-09 2001-03-08 Commonwealth Scientific And Industrial Research Organisation Lidar system and method
US6897434B1 (en) 2002-02-28 2005-05-24 Northwestern University All-fiber photon-pair source for quantum communications
US6737642B2 (en) * 2002-03-18 2004-05-18 Syagen Technology High dynamic range analog-to-digital converter
US7830442B2 (en) 2002-04-30 2010-11-09 ARETé ASSOCIATES Compact economical lidar system
US7456970B1 (en) 2005-06-17 2008-11-25 Itt Manufacturing Enterprises, Inc. Pulse finding apparatus and method
CN101688774A (zh) 2006-07-13 2010-03-31 威力登音响公司 高精确度激光雷达系统
DE102007029959A1 (de) 2007-06-28 2009-01-02 Robert Bosch Gmbh Verfahren und Vorrichtung zur Erfassung einer Umgebung
US7945408B2 (en) 2007-09-20 2011-05-17 Voxis, Inc. Time delay estimation
US7640122B2 (en) 2007-11-07 2009-12-29 Institut National D'optique Digital signal processing in optical systems used for ranging applications
US8119971B2 (en) 2008-01-17 2012-02-21 Ball Corporation Pulse data recorder in which a value held by a bit of a memory is determined by a state of a switch
US8081922B2 (en) 2008-05-30 2011-12-20 Qualcomm Incorporated Methods and apparatuses for processing satellite positioning system signals
US8364334B2 (en) 2008-10-30 2013-01-29 Honeywell International Inc. System and method for navigating an autonomous vehicle using laser detection and ranging
CN102006402B (zh) 2009-08-28 2014-02-19 鸿富锦精密工业（深圳）有限公司 摄像装置及其身份识别方法
DE102009054835A1 (de) 2009-12-17 2011-06-22 Robert Bosch GmbH, 70469 Objektsensor
US8054464B2 (en) 2010-01-25 2011-11-08 Sigma Space Corp. Polarization switching lidar device and method
GB2485995B (en) * 2010-11-30 2014-01-01 St Microelectronics Res & Dev Improved proximity sensor and associated method, computer readable medium and firmware
DE102010061382B4 (de) 2010-12-21 2019-02-14 Sick Ag Optoelektronischer Sensor und Verfahren zur Erfassung und Abstandsbestimmung von Objekten
FR2984522B1 (fr) 2011-12-20 2014-02-14 St Microelectronics Grenoble 2 Dispositif de detection de la proximite d'un objet, comprenant des photodiodes spad
US9081096B2 (en) 2012-08-31 2015-07-14 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Apparatus, method, and computer program for a resolution-enhanced pseudo-noise code technique
US20140211194A1 (en) 2013-01-27 2014-07-31 Quanergy Systems, Inc. Cost-effective lidar sensor for multi-signal detection, weak signal detection and signal disambiguation and method of using same
US10354849B2 (en) 2013-07-09 2019-07-16 Micromass Uk Limited Method of recording ADC saturation
GB2520232A (en) 2013-08-06 2015-05-20 Univ Edinburgh Multiple Event Time to Digital Converter
US8836922B1 (en) 2013-08-20 2014-09-16 Google Inc. Devices and methods for a rotating LIDAR platform with a shared transmit/receive path
US10203399B2 (en) 2013-11-12 2019-02-12 Big Sky Financial Corporation Methods and apparatus for array based LiDAR systems with reduced interference
GB201413564D0 (en) * 2014-07-31 2014-09-17 Stmicroelectronics Res & Dev Time of flight determination
US9594155B2 (en) 2014-08-08 2017-03-14 Delphi Technologies, Inc. Vehicle radar system with trailer detection
GB201418731D0 (en) 2014-10-20 2014-12-03 Univ Heriot Watt Viewing and tracking of hidden objects in a scene
WO2016126250A1 (en) 2015-02-05 2016-08-11 Board Of Regents, The University Of Texas System Particle tracking using spatiotemporal offset light beams
US10036801B2 (en) 2015-03-05 2018-07-31 Big Sky Financial Corporation Methods and apparatus for increased precision and improved range in a multiple detector LiDAR array
US10620300B2 (en) * 2015-08-20 2020-04-14 Apple Inc. SPAD array with gated histogram construction
EP3159711A1 (en) 2015-10-23 2017-04-26 Xenomatix NV System and method for determining a distance to an object
EP3182162B1 (en) 2015-12-18 2022-02-16 STMicroelectronics (Grenoble 2) SAS Multi-zone ranging and intensity mapping using spad based tof system
CN108885263B (zh) 2016-03-21 2024-02-23 威力登激光雷达有限公司 具有可变脉冲重复的基于lidar的3d成像
US20180081041A1 (en) 2016-09-22 2018-03-22 Apple Inc. LiDAR with irregular pulse sequence
US11105925B2 (en) 2017-03-01 2021-08-31 Ouster, Inc. Accurate photo detector measurements for LIDAR
EP3370079B1 (en) * 2017-03-01 2021-04-28 STMicroelectronics (Grenoble 2) SAS Range and parameter extraction using processed histograms generated from a time of flight sensor - pulse detection
US10295668B2 (en) 2017-03-30 2019-05-21 Luminar Technologies, Inc. Reducing the number of false detections in a lidar system
US10641876B2 (en) 2017-04-06 2020-05-05 Quanergy Systems, Inc. Apparatus and method for mitigating LiDAR interference through pulse coding and frequency shifting
US10416679B2 (en) 2017-06-27 2019-09-17 GM Global Technology Operations LLC Method and apparatus for object surface estimation using reflections delay spread
WO2019014494A1 (en) 2017-07-13 2019-01-17 Apple Inc. EARLY-DELAYED PULSE COUNTING FOR DEPTH SENSORS EMITTING LIGHT
US10996323B2 (en) 2018-02-22 2021-05-04 Stmicroelectronics (Research & Development) Limited Time-of-flight imaging device, system and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018091760A (ja) * 2016-12-05 2018-06-14 株式会社豊田中央研究所 光学測定装置、光学測定方法、及び光学測定プログラム
WO2018160886A1 (en) * 2017-03-01 2018-09-07 Ouster, Inc. Accurate photo detector measurements for lidar
WO2019112733A1 (en) * 2017-12-07 2019-06-13 Velodyne Lidar, Inc. Systems and methods for efficient multi-return light detectors

Also Published As

Publication number Publication date
WO2021026241A1 (en) 2021-02-11
US20230273320A1 (en) 2023-08-31
US20250138193A1 (en) 2025-05-01
EP4675315A3 (en) 2026-04-01
EP3990946A4 (en) 2023-08-09
US12189038B2 (en) 2025-01-07
CN114424086B (zh) 2025-11-07
EP3990946A1 (en) 2022-05-04
JP2022543389A (ja) 2022-10-12
EP3990946B1 (en) 2025-11-19
KR20220042202A (ko) 2022-04-04
EP4675315A2 (en) 2026-01-07
US20230176223A1 (en) 2023-06-08
CN114424086A (zh) 2022-04-29
JP7663551B2 (ja) 2025-04-16

Similar Documents

Publication Publication Date Title
US20250138193A1 (en) Processing system for lidar measurements
CN114467038B (zh) 处理lidar准确度的时间序列测量
US12153133B2 (en) Independent per-pixel integration registers for LIDAR measurements
JP7392067B2 (ja) ライダーのための正確な光検出器測定
EP4025934B1 (en) Processing of lidar images
US12487362B2 (en) Configurable memory blocks for LIDAR measurements

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E13 Pre-grant limitation requested

Free format text: ST27 STATUS EVENT CODE: A-2-3-E10-E13-LIM-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D22-EXM-PE0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

F11 Ip right granted following substantive examination

Free format text: ST27 STATUS EVENT CODE: A-2-4-F10-F11-EXM-PR0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

U12 Designation fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U12-OTH-PR1002 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

Q13 Ip right document published

Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q13-NAP-PG1601 (AS PROVIDED BY THE NATIONAL OFFICE)