KR102915906B1 - 합성 이미지들을 생성하는 방법 및 이미징 시스템 - Google Patents

합성 이미지들을 생성하는 방법 및 이미징 시스템

Info

Publication number
KR102915906B1
KR102915906B1 KR1020227000237A KR20227000237A KR102915906B1 KR 102915906 B1 KR102915906 B1 KR 102915906B1 KR 1020227000237 A KR1020227000237 A KR 1020227000237A KR 20227000237 A KR20227000237 A KR 20227000237A KR 102915906 B1 KR102915906 B1 KR 102915906B1
Authority
KR
South Korea
Prior art keywords
metalens
filter
images
composite
imaging system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227000237A
Other languages
English (en)
Korean (ko)
Other versions
KR20220017480A (ko
Inventor
진신 푸
용안 쑤
루도빅 고뎃
나아마 아르가만
로버트 얀 비저
Original Assignee
어플라이드 머티어리얼스, 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 어플라이드 머티어리얼스, 인코포레이티드 filed Critical 어플라이드 머티어리얼스, 인코포레이티드
Publication of KR20220017480A publication Critical patent/KR20220017480A/ko
Application granted granted Critical
Publication of KR102915906B1 publication Critical patent/KR102915906B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/201—Filters in the form of arrays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00—Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/002—Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of materials engineered to provide properties not available in nature, e.g. metamaterials
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0015—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • G02B27/005—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • H04N23/16—Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/957—Light-field or plenoptic cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611—Correction of chromatic aberration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/806—Optical elements or arrangements associated with the image sensors
    • H10F39/8063—Microlenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Lenses (AREA)
  • Cameras In General (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Blocking Light For Cameras (AREA)
  • Solid State Image Pick-Up Elements (AREA)
KR1020227000237A 2019-06-06 2020-04-27 합성 이미지들을 생성하는 방법 및 이미징 시스템 Active KR102915906B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962858258P 2019-06-06 2019-06-06
US62/858,258 2019-06-06
PCT/US2020/030036 WO2020247109A1 (en) 2019-06-06 2020-04-27 Imaging system and method of creating composite images

Publications (2)

Publication Number Publication Date
KR20220017480A KR20220017480A (ko) 2022-02-11
KR102915906B1 true KR102915906B1 (ko) 2026-01-20

Family

ID=73651674

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020227000237A Active KR102915906B1 (ko) 2019-06-06 2020-04-27 합성 이미지들을 생성하는 방법 및 이미징 시스템

Country Status (7)

Country Link
US (2) US11610925B2 (https=)
EP (1) EP3980830A4 (https=)
JP (2) JP7650244B2 (https=)
KR (1) KR102915906B1 (https=)
CN (2) CN118348657A (https=)
TW (1) TWI857068B (https=)
WO (1) WO2020247109A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3980830A4 (en) * 2019-06-06 2023-06-07 Applied Materials, Inc. IMAGING SYSTEM AND METHOD OF GENERATING COMPOSITE IMAGES
JP7475731B2 (ja) * 2019-09-26 2024-04-30 ファーストライト ファーマシューティカルズ，エルエルシー カンナビノイドプロドラッグ化合物
WO2023012110A1 (en) * 2021-08-02 2023-02-09 Nil Technology Aps Multi-channel high-resolution imaging devices incorporating metalenses
WO2023012078A1 (en) * 2021-08-02 2023-02-09 Nil Technology Aps Multi-channel high-resolution imaging devices incorporating metalenses for color images
CN113905165A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及利用光场成像系统采集光场信息的方法
CN113905164A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及通过光场成像系统采集光场信息的方法
KR20240151196A (ko) * 2022-02-14 2024-10-17 튜놉틱스, 인크. 색상 분할 메타 광학 계산 카메라를 사용한 고품질 이미징을 위한 시스템 및 방법
CN119768715A (zh) * 2022-07-12 2025-04-04 新加坡科技研究局 光学系统及形成光学系统的方法、形成多色图像的方法
WO2024225663A1 (ko) 2023-04-24 2024-10-31 삼성전자 주식회사 이미지를 복원하기 위한 전자 장치 및 그 동작 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160316147A1 (en) * 2015-04-23 2016-10-27 Apple Inc. Digital viewfinder user interface for multiple cameras
US20180284428A1 (en) * 2017-03-29 2018-10-04 Microsoft Technology Licensing, Llc Achromatized metasurface lens
US20190098187A1 (en) * 2017-09-28 2019-03-28 Motorola Mobility Llc Display with Interspaced Microlenses and Corresponding Devices and Methods

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPQ289099A0 (en) 1999-09-16 1999-10-07 Silverbrook Research Pty Ltd Method and apparatus for manipulating a bayer image
US7019890B2 (en) 2001-10-05 2006-03-28 E-Vision, Llc Hybrid electro-active lens
US7924327B2 (en) 2003-10-22 2011-04-12 Panasonic Corporation Imaging apparatus and method for producing the same, portable equipment, and imaging sensor and method for producing the same
US7123298B2 (en) 2003-12-18 2006-10-17 Avago Technologies Sensor Ip Pte. Ltd. Color image sensor with imaging elements imaging on respective regions of sensor elements
EP1812968B1 (en) * 2004-08-25 2019-01-16 Callahan Cellular L.L.C. Apparatus for multiple camera devices and method of operating same
US7206136B2 (en) 2005-02-18 2007-04-17 Eastman Kodak Company Digital camera using multiple lenses and image sensors to provide an extended zoom range
EP2016620A2 (en) * 2006-04-17 2009-01-21 Omnivision Cdm Optics, Inc. Arrayed imaging systems and associated methods
JP4985183B2 (ja) 2007-07-26 2012-07-25 東京エレクトロン株式会社 基板処理装置及び基板処理方法並びに記憶媒体
JP2009252978A (ja) * 2008-04-04 2009-10-29 Panasonic Corp 固体撮像素子およびその製造方法
EP4336447B1 (en) 2008-05-20 2025-05-07 Adeia Imaging LLC Capturing and processing of images using monolithic camera array with heterogeneous imagers
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
WO2011100070A1 (en) 2010-02-12 2011-08-18 The Regents Of The University Of California Metamaterial-based optical lenses
JP5820143B2 (ja) 2010-06-22 2015-11-24 株式会社ニューフレアテクノロジー 半導体製造装置、半導体製造方法及び半導体製造装置のクリーニング方法
US8478123B2 (en) * 2011-01-25 2013-07-02 Aptina Imaging Corporation Imaging devices having arrays of image sensors and lenses with multiple aperture sizes
US9231013B2 (en) * 2011-11-08 2016-01-05 Semiconductor Components Industries, Llc Resonance enhanced absorptive color filters having resonance cavities
US9298060B2 (en) 2011-12-20 2016-03-29 Washington University Imaging using metamaterials
US8988566B2 (en) * 2012-08-09 2015-03-24 Omnivision Technologies, Inc. Lens array for partitioned image sensor having color filters
FR3002242B1 (fr) 2013-02-21 2015-04-03 Altatech Semiconductor Dispositif de depot chimique en phase vapeur
JP6480919B2 (ja) * 2013-05-21 2019-03-13 クラレト，ホルヘ ヴィセンテ ブラスコ プレノプティックセンサとその製造方法およびプレノプティックセンサを有する配置
JP6376920B2 (ja) 2014-03-07 2018-08-22 キヤノン株式会社 複眼撮像装置
CN103986867B (zh) * 2014-04-24 2017-04-05 宇龙计算机通信科技(深圳)有限公司 一种图像拍摄终端和图像拍摄方法
KR102157675B1 (ko) * 2014-07-25 2020-09-18 삼성전자주식회사 촬영 장치 및 그 촬영 방법
KR102394277B1 (ko) * 2014-08-22 2022-05-06 에스케이하이닉스 주식회사 이미지 센서 및 이를 구비하는 전자장치
US9583522B2 (en) * 2014-09-04 2017-02-28 SK Hynix Inc. Image sensor and electronic device including the same
TWI531852B (zh) * 2014-09-16 2016-05-01 聚晶半導體股份有限公司 影像擷取裝置及數位變焦方法
KR102251483B1 (ko) * 2014-10-23 2021-05-14 삼성전자주식회사 영상을 처리하는 전자 장치 및 방법
US10816815B2 (en) 2014-12-10 2020-10-27 President And Fellows Of Harvard College Achromatic metasurface optical components by dispersive phase compensation
CN104506771B (zh) 2014-12-18 2018-04-27 北京智谷睿拓技术服务有限公司 图像处理方法及装置
JP6486149B2 (ja) * 2015-03-03 2019-03-20 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
WO2016168173A1 (en) 2015-04-14 2016-10-20 California Institute Of Technology Multi-wavelength optical dielectric metasurfaces
US9946051B2 (en) * 2015-04-22 2018-04-17 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
US10403668B2 (en) 2015-07-29 2019-09-03 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
US10790325B2 (en) 2015-07-29 2020-09-29 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN106803872A (zh) * 2017-03-02 2017-06-06 苏州苏大维格光电科技股份有限公司 相机镜头及手机
JP6863787B2 (ja) 2017-03-17 2021-04-21 ソニー・オリンパスメディカルソリューションズ株式会社 内視鏡システム
US11257856B2 (en) * 2017-10-13 2022-02-22 Trustees Of Boston University Lens-free compound eye cameras based on angle-sensitive meta-surfaces
KR20190051670A (ko) * 2017-11-07 2019-05-15 삼성전자주식회사 전자 장치 및 그의 이미지 처리 방법
CN109348114A (zh) * 2018-11-26 2019-02-15 Oppo广东移动通信有限公司 成像装置和电子设备
EP3980830A4 (en) * 2019-06-06 2023-06-07 Applied Materials, Inc. IMAGING SYSTEM AND METHOD OF GENERATING COMPOSITE IMAGES

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160316147A1 (en) * 2015-04-23 2016-10-27 Apple Inc. Digital viewfinder user interface for multiple cameras
US20180284428A1 (en) * 2017-03-29 2018-10-04 Microsoft Technology Licensing, Llc Achromatized metasurface lens
US20190098187A1 (en) * 2017-09-28 2019-03-28 Motorola Mobility Llc Display with Interspaced Microlenses and Corresponding Devices and Methods

Also Published As

Publication number Publication date
US20230230991A1 (en) 2023-07-20
CN113924517B (zh) 2024-03-22
EP3980830A4 (en) 2023-06-07
US20200388642A1 (en) 2020-12-10
EP3980830A1 (en) 2022-04-13
US12021102B2 (en) 2024-06-25
TW202113422A (zh) 2021-04-01
US11610925B2 (en) 2023-03-21
CN118348657A (zh) 2024-07-16
TWI857068B (zh) 2024-10-01
WO2020247109A1 (en) 2020-12-10
TW202503354A (zh) 2025-01-16
CN113924517A (zh) 2022-01-11
JP2022535238A (ja) 2022-08-05
KR20220017480A (ko) 2022-02-11
JP2025108420A (ja) 2025-07-23
JP7650244B2 (ja) 2025-03-24

Similar Documents

Publication Publication Date Title
KR102915906B1 (ko) 합성 이미지들을 생성하는 방법 및 이미징 시스템
KR102830280B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
US11664400B2 (en) Image sensor and electronic apparatus including the same
US11756975B2 (en) Image sensor and image sensing method to generate high sensitivity image through thin lens element and micro lens array
US10044959B2 (en) Mask-less phase detection autofocus
US9973678B2 (en) Phase-detect autofocus
KR102765854B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
CN103703413B (zh) 使用颜色相关波前编码扩展透镜系统中景深的系统和方法
CN204697179U (zh) 具有像素阵列的图像传感器
KR102693695B1 (ko) 이미지 센서 및 그 준비 방법 및 전자 장치
US20050128335A1 (en) Imaging device
US20230336848A1 (en) Multi-cameras with shared camera apertures
US20150098005A1 (en) Image sensor and image capturing system
KR102906610B1 (ko) 색분리 소자 및 이를 포함하는 이미지 센서
CN104064577A (zh) 自动对焦的图像传感器
US20180288306A1 (en) Mask-less phase detection autofocus
EP4528338A1 (en) Spectral filter and electronic device including the same
CN112822366B (zh) 电子设备及其摄像模组
TWI916962B (zh) 創造複合影像的成像系統及方法
JP2024501031A (ja) 電子機器及びその撮像モジュール
JP2009182550A (ja) カメラモジュール
KR102202196B1 (ko) 카메라 모듈
CN112788218A (zh) 电子设备及其摄像模组
CN112616009A (zh) 电子设备及其摄像模组
JP4545734B2 (ja) モバイルカメラ光学系の光学レンズシステム

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

R17-X000 Change to representative recorded

St.27 status event code: A-3-3-R10-R17-oth-X000

D13-X000 Search requested

St.27 status event code: A-1-2-D10-D13-srh-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D22-EXM-PE0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

F11 Ip right granted following substantive examination

Free format text: ST27 STATUS EVENT CODE: A-2-4-F10-F11-EXM-PR0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

U12 Designation fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U12-OTH-PR1002 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

Q13 Ip right document published

Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q13-NAP-PG1601 (AS PROVIDED BY THE NATIONAL OFFICE)