KR102627189B1 - 2차원 포인트 클라우드들을 인코딩 및 디코딩하기 위한 방법 및 장치 - Google Patents

2차원 포인트 클라우드들을 인코딩 및 디코딩하기 위한 방법 및 장치 Download PDF

Info

Publication number
KR102627189B1
KR102627189B1 KR1020180049976A KR20180049976A KR102627189B1 KR 102627189 B1 KR102627189 B1 KR 102627189B1 KR 1020180049976 A KR1020180049976 A KR 1020180049976A KR 20180049976 A KR20180049976 A KR 20180049976A KR 102627189 B1 KR102627189 B1 KR 102627189B1
Authority
KR
South Korea
Prior art keywords
point cloud
frame
operator
matrix
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020180049976A
Other languages
English (en)
Korean (ko)
Other versions
KR20180122947A (ko
Inventor
줄리앙 플뢰로
베르트랑 쉬뽀
르노 도흐
Original Assignee
인터디지털 브이씨 홀딩스 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인터디지털 브이씨 홀딩스 인코포레이티드 filed Critical 인터디지털 브이씨 홀딩스 인코포레이티드
Publication of KR20180122947A publication Critical patent/KR20180122947A/ko
Application granted granted Critical
Publication of KR102627189B1 publication Critical patent/KR102627189B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/70Media network packetisation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/06Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • G06T9/001Model-based coding, e.g. wire frame
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Processing Or Creating Images (AREA)
KR1020180049976A 2017-05-04 2018-04-30 2차원 포인트 클라우드들을 인코딩 및 디코딩하기 위한 방법 및 장치 Active KR102627189B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP17305504.7 2017-05-04
EP17305504.7A EP3399757A1 (en) 2017-05-04 2017-05-04 Method and apparatus to encode and decode two-dimension point clouds

Publications (2)

Publication Number Publication Date
KR20180122947A KR20180122947A (ko) 2018-11-14
KR102627189B1 true KR102627189B1 (ko) 2024-01-22

Family

ID=58709420

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020180049976A Active KR102627189B1 (ko) 2017-05-04 2018-04-30 2차원 포인트 클라우드들을 인코딩 및 디코딩하기 위한 방법 및 장치

Country Status (9)

Country Link
US (1) US11122101B2 (enExample)
EP (2) EP3399757A1 (enExample)
JP (1) JP7166782B2 (enExample)
KR (1) KR102627189B1 (enExample)
CN (1) CN108810571B (enExample)
BR (1) BR102018009143A2 (enExample)
CA (1) CA3003608A1 (enExample)
MX (1) MX383636B (enExample)
RU (1) RU2762005C2 (enExample)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109460535B (zh) * 2018-11-14 2023-02-03 深圳职业技术学院 一种基于云的有限域矩阵求逆装置及求逆方法
KR102256913B1 (ko) * 2018-12-03 2021-05-27 고려대학교 산학협력단 삼차원 동적 포인트 클라우드 압축방법
CN111327897B (zh) * 2018-12-13 2022-01-14 华为技术有限公司 点云编码方法和编码器
CN111327902B (zh) * 2018-12-13 2022-11-22 华为技术有限公司 点云的编解码方法及装置
US11095900B2 (en) * 2018-12-19 2021-08-17 Sony Group Corporation Point cloud coding structure
US11039115B2 (en) * 2018-12-21 2021-06-15 Samsung Electronics Co., Ltd. Low complexity color smoothing of reconstructed point clouds
WO2020146341A1 (en) * 2019-01-07 2020-07-16 Futurewei Technologies, Inc. Point cloud bitstream structure and auxiliary information differential coding
KR102640235B1 (ko) * 2019-01-11 2024-02-23 삼성전자주식회사 3차원 데이터 부호화 방법 및 장치 및 3차원 데이터 복호화 방법 및 장치
US11190803B2 (en) * 2019-01-18 2021-11-30 Sony Group Corporation Point cloud coding using homography transform
US12132935B2 (en) 2019-02-07 2024-10-29 Interdigital Vc Holdings, Inc. Processing a point cloud
DK3935857T3 (da) * 2019-03-08 2025-08-18 Interdigital Vc Holdings Inc Fremgangsmåder og indretninger til adaptiv streaming af punktskyer
CN111739111B (zh) * 2019-03-20 2023-05-30 上海交通大学 一种点云投影编码的块内偏移优化方法及系统
KR102677294B1 (ko) * 2019-03-20 2024-06-21 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
WO2020190097A1 (ko) * 2019-03-20 2020-09-24 엘지전자 주식회사 포인트 클라우드 데이터 수신 장치, 포인트 클라우드 데이터 수신 방법, 포인트 클라우드 데이터 처리 장치 및 포인트 클라우드 데이터 처리 방법
EP3713238A1 (en) * 2019-03-20 2020-09-23 InterDigital VC Holdings, Inc. Processing a point cloud
WO2020190114A1 (ko) * 2019-03-21 2020-09-24 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
KR102699246B1 (ko) * 2019-03-21 2024-08-27 엘지전자 주식회사 포인트 클라우드 데이터 부호화 장치, 포인트 클라우드 데이터 부호화 방법, 포인트 클라우드 데이터 복호화 장치 및 포인트 클라우드 데이터 복호화 방법
WO2020235979A1 (ko) 2019-05-23 2020-11-26 삼성전자 주식회사 포인트 클라우드 기반 데이터를 렌더링하는 방법 및 장치
WO2020256244A1 (ko) * 2019-06-21 2020-12-24 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
CN114041169B (zh) * 2019-07-03 2025-11-04 Lg电子株式会社 点云数据发送设备、点云数据发送方法、点云数据接收设备、以及点云数据接收方法
EP4011088B1 (en) * 2019-10-03 2024-07-03 LG Electronics Inc. Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
CN110730364B (zh) * 2019-10-14 2021-08-31 广州微算互联信息技术有限公司 一种云手机数据传输方法、装置及存储介质
US11348285B2 (en) * 2019-12-10 2022-05-31 Sony Group Corporation Mesh compression via point cloud representation
CN114762356B (zh) * 2019-12-13 2024-06-11 索尼集团公司 图像处理装置和方法
US12081719B2 (en) * 2019-12-20 2024-09-03 Interdigital Ce Patent Holdings, Sas Method and apparatus for coding and decoding volumetric video with view-driven specularity
WO2021140276A1 (en) * 2020-01-10 2021-07-15 Nokia Technologies Oy Storage of multiple atlases from one v-pcc elementary stream in isobmff
US11743501B2 (en) * 2020-04-07 2023-08-29 Qualcomm Incorporated High-level syntax design for geometry-based point cloud compression
CN118138737A (zh) * 2020-04-11 2024-06-04 Lg电子株式会社 对点云数据进行编解码的方法和存储介质
CN115428467B (zh) * 2020-04-14 2024-03-08 Lg电子株式会社 点云数据发送设备和方法、点云数据接收设备和方法
CN116980624A (zh) 2020-12-31 2023-10-31 Oppo广东移动通信有限公司 点云编解码方法、编码器、解码器以及计算机存储介质
CN115474041B (zh) * 2021-06-11 2023-05-26 腾讯科技(深圳)有限公司 点云属性的预测方法、装置及相关设备
WO2023280129A1 (en) * 2021-07-04 2023-01-12 Beijing Bytedance Network Technology Co., Ltd. Method, apparatus, and medium for point cloud coding
EP4141794A1 (en) * 2021-08-31 2023-03-01 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus of encoding/decoding point cloud geometry data sensed by at least one sensor

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013161133A (ja) 2012-02-01 2013-08-19 Toshiba Plant Systems & Services Corp 三次元データ処理装置、三次元データ処理プログラムおよび三次元データ処理方法

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6701028B1 (en) * 2000-01-11 2004-03-02 Applied Materials, Inc. Method and apparatus for fast signal convolution using spline kernel
US7236613B2 (en) * 2003-08-29 2007-06-26 The Boeing Company Methods and apparatus for infrared resolution of closely-spaced objects
WO2005025404A2 (en) * 2003-09-08 2005-03-24 Vanderbilt University Apparatus and methods of cortical surface registration and deformation tracking for patient-to-image alignment in relation to image-guided surgery
US8042056B2 (en) * 2004-03-16 2011-10-18 Leica Geosystems Ag Browsers for large geometric data visualization
CN102047287B (zh) 2008-06-17 2013-03-13 株式会社Ntt都科摩 利用稀疏变换的图像/视频质量增强和超分辨率
US8179393B2 (en) * 2009-02-13 2012-05-15 Harris Corporation Fusion of a 2D electro-optical image and 3D point cloud data for scene interpretation and registration performance assessment
US9445072B2 (en) 2009-11-11 2016-09-13 Disney Enterprises, Inc. Synthesizing views based on image domain warping
US8525848B2 (en) * 2009-11-16 2013-09-03 Autodesk, Inc. Point cloud decimation engine
US20110222757A1 (en) * 2010-03-10 2011-09-15 Gbo 3D Technology Pte. Ltd. Systems and methods for 2D image and spatial data capture for 3D stereo imaging
US9182492B2 (en) * 2010-07-29 2015-11-10 Waikatolink Ltd Apparatus and method for measuring the distance and/or intensity characteristics of objects
GB201103822D0 (en) * 2011-03-07 2011-04-20 Isis Innovation System for providing locality information and associated devices
TWI538474B (zh) * 2011-03-15 2016-06-11 杜比實驗室特許公司 影像資料轉換的方法與設備
US9565450B2 (en) 2012-03-07 2017-02-07 Lg Electronics Inc. Method and device for processing video signal
RU2013100160A (ru) 2013-01-09 2014-07-20 ЭлЭсАй Корпорейшн Обработка изображений со сверхразрешением с использованием обратимой разреженной матрицы
CN103761744B (zh) * 2014-02-21 2016-06-15 哈尔滨工业大学 通用型二维点云分组方法
EP2947630A1 (en) * 2014-05-23 2015-11-25 My Virtual Reality Software AS Method for compressing coordinate data
US9940727B2 (en) * 2014-06-19 2018-04-10 University Of Southern California Three-dimensional modeling from wide baseline range scans
US9836283B2 (en) * 2014-11-14 2017-12-05 Cavium, Inc. Compiler architecture for programmable application specific integrated circuit based network devices
CN106339208B (zh) * 2015-07-15 2019-12-13 腾讯科技(深圳)有限公司 一种多媒体信息弹窗的处理方法及设备
US10193904B2 (en) * 2015-07-16 2019-01-29 Qatar University Data-driven semi-global alignment technique for masquerade detection in stand-alone and cloud computing systems
CN105427239B (zh) * 2015-12-05 2018-05-22 刘忠艳 一种二维点云匹配方法
US10043305B2 (en) * 2016-01-06 2018-08-07 Meta Company Apparatuses, methods and systems for pre-warping images for a display system with a distorting optical component
US20170214943A1 (en) * 2016-01-22 2017-07-27 Mitsubishi Electric Research Laboratories, Inc. Point Cloud Compression using Prediction and Shape-Adaptive Transforms
CN106228570B (zh) * 2016-07-08 2019-04-09 百度在线网络技术(北京)有限公司 一种真值数据确定方法和装置
US10417533B2 (en) * 2016-08-09 2019-09-17 Cognex Corporation Selection of balanced-probe sites for 3-D alignment algorithms
US20180053324A1 (en) * 2016-08-19 2018-02-22 Mitsubishi Electric Research Laboratories, Inc. Method for Predictive Coding of Point Cloud Geometries
US11514613B2 (en) 2017-03-16 2022-11-29 Samsung Electronics Co., Ltd. Point cloud and mesh compression using image/video codecs
US20190116372A1 (en) * 2017-10-16 2019-04-18 Mitsubishi Electric Research Laboratories, Inc. Systems and Methods for Compressing, Representing and Processing Point Clouds

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013161133A (ja) 2012-02-01 2013-08-19 Toshiba Plant Systems & Services Corp 三次元データ処理装置、三次元データ処理プログラムおよび三次元データ処理方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Daribo ET AL:"Point cloud compression for grid-pattern-based 3D scanning system", 2011 Visual Communications and Image Processing (VCIP) ]공개일:2011.11.06
J.E.Castillo ET AL:"A practical guide to direct optimization for planar grid-generation", Computers &Mathematics with Applications, Volume 37, Issue 9, May 1999, Pages 123-156 ]공개일:1999.05.01
Tim Golla ET AL:"Real-time point cloud compression", 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ]공개일:2015.09.28

Also Published As

Publication number Publication date
JP2018198421A (ja) 2018-12-13
RU2762005C2 (ru) 2021-12-14
EP3399757A1 (en) 2018-11-07
KR20180122947A (ko) 2018-11-14
CA3003608A1 (en) 2018-11-04
JP7166782B2 (ja) 2022-11-08
CN108810571A (zh) 2018-11-13
MX383636B (es) 2025-03-14
BR102018009143A2 (pt) 2019-03-19
MX2018005496A (es) 2018-11-09
EP3399758A1 (en) 2018-11-07
US20180324240A1 (en) 2018-11-08
RU2018115810A (ru) 2019-10-30
CN108810571B (zh) 2022-04-05
EP3399758B1 (en) 2020-09-16
RU2018115810A3 (enExample) 2021-06-23
US11122101B2 (en) 2021-09-14

Similar Documents

Publication Publication Date Title
KR102627189B1 (ko) 2차원 포인트 클라우드들을 인코딩 및 디코딩하기 위한 방법 및 장치
JP7359153B2 (ja) 画像処理装置および方法
JP7424299B2 (ja) 画像処理装置および方法
JPWO2019198523A1 (ja) 画像処理装置および方法
US20250301160A1 (en) Bit plane encoding of data arrays
WO2021065536A1 (ja) 情報処理装置および方法
JP2014039257A (ja) デコーダおよび復号方法
KR20240093534A (ko) 메시 압축을 위한 변위 코딩
JP2021531548A (ja) 点群のジオメトリを符号化/復号する方法及び装置
Li et al. Background knowledge
WO2019142665A1 (ja) 情報処理装置および方法
KR20240108466A (ko) 동적 메시 압축에서의 모션 필드 코딩
KR20230121865A (ko) 포인트 클라우드 지오메트리 데이터를 부호화/복호화하는구면 좌표의 양자화 방법 및 장치
WO2021029226A1 (ja) 情報処理装置および方法
US20250045971A1 (en) Hybrid framework for point cloud compression
KR20240090790A (ko) 메시 압축을 위한 적응형 지오메트리 필터링
CN112017292A (zh) 网格译码方法和装置
KR20240105394A (ko) 바이너리 복셀 그리드 코딩에 대한 상태 요약
CN118043849A (zh) 编码/解码由至少一个传感器感测的点云几何数据的方法和装置
WO2021193088A1 (ja) 画像処理装置および方法
US20250358444A1 (en) Model sharing for point cloud compression
JP2022063882A (ja) 情報処理装置および方法、並びに、再生装置および方法
KR20240089246A (ko) 하이브리드 딥 엔트로피 코딩을 사용한 포인트 클라우드 압축 방법 및 장치
WO2025096197A1 (en) Entropy bottleneck layer for learning-based mesh compression
CN117957570A (zh) 对由至少一个传感器感测到的点云几何数据进行编码/解码的方法和装置

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20180430

PG1501 Laying open of application
PN2301 Change of applicant

Patent event date: 20191202

Comment text: Notification of Change of Applicant

Patent event code: PN23011R01D

PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20210430

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20180430

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20230328

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20231016

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20240116

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20240117

End annual number: 3

Start annual number: 1

PG1601 Publication of registration