CN113924517B - 生成复合影像的成像系统及方法 - Google Patents

生成复合影像的成像系统及方法 Download PDF

Info

Publication number
CN113924517B
CN113924517B CN202080041362.9A CN202080041362A CN113924517B CN 113924517 B CN113924517 B CN 113924517B CN 202080041362 A CN202080041362 A CN 202080041362A CN 113924517 B CN113924517 B CN 113924517B
Authority
CN
China
Prior art keywords
metalens
composite image
superlens
filter
imaging system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080041362.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN113924517A (zh
Inventor
傅晋欣
徐永安
卢多维克·葛德特
拿玛·阿加曼
罗伯特·杨·维塞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Applied Materials Inc
Original Assignee
Applied Materials Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Applied Materials Inc filed Critical Applied Materials Inc
Priority to CN202410257855.6A priority Critical patent/CN118348657A/zh
Publication of CN113924517A publication Critical patent/CN113924517A/zh
Application granted granted Critical
Publication of CN113924517B publication Critical patent/CN113924517B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/002Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of materials engineered to provide properties not available in nature, e.g. metamaterials
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/001Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0015Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/001Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0055Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • G02B27/005Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/20Filters
    • G02B5/201Filters in the form of arrays
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • H04N23/16Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/957Light-field or plenoptic cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611Correction of chromatic aberration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing
    • HELECTRICITY
    • H10SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10FINORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80Constructional details of image sensors
    • H10F39/805Coatings
    • H10F39/8053Colour filters
    • HELECTRICITY
    • H10SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10FINORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80Constructional details of image sensors
    • H10F39/806Optical elements or arrangements associated with the image sensors
    • H10F39/8063Microlenses
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Cameras In General (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Blocking Light For Cameras (AREA)
  • Lenses (AREA)
  • Solid State Image Pick-Up Elements (AREA)
CN202080041362.9A 2019-06-06 2020-04-27 生成复合影像的成像系统及方法 Active CN113924517B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410257855.6A CN118348657A (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962858258P 2019-06-06 2019-06-06
US62/858,258 2019-06-06
PCT/US2020/030036 WO2020247109A1 (en) 2019-06-06 2020-04-27 Imaging system and method of creating composite images

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202410257855.6A Division CN118348657A (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Publications (2)

Publication Number Publication Date
CN113924517A CN113924517A (zh) 2022-01-11
CN113924517B true CN113924517B (zh) 2024-03-22

Family

ID=73651674

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202080041362.9A Active CN113924517B (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法
CN202410257855.6A Pending CN118348657A (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202410257855.6A Pending CN118348657A (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Country Status (7)

Country Link
US (2) US11610925B2 (enExample)
EP (1) EP3980830A4 (enExample)
JP (2) JP7650244B2 (enExample)
KR (1) KR102915906B1 (enExample)
CN (2) CN113924517B (enExample)
TW (1) TWI857068B (enExample)
WO (1) WO2020247109A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113924517B (zh) * 2019-06-06 2024-03-22 应用材料公司 生成复合影像的成像系统及方法
CA3152168A1 (en) 2019-09-26 2021-04-01 Kieran John Cannabinoid prodrug compounds
CN117999795A (zh) * 2021-08-02 2024-05-07 尼尔技术有限公司 并入用于彩色图像的超透镜的多通道高分辨率成像装置
KR20240045243A (ko) * 2021-08-02 2024-04-05 닐 테크놀로지 에이피에스 메타렌즈들을 통합한 다채널 고해상도 촬상 디바이스들
CN113905165A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及利用光场成像系统采集光场信息的方法
CN113905164A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及通过光场成像系统采集光场信息的方法
WO2023154946A1 (en) * 2022-02-14 2023-08-17 Tunoptix, Inc. Systems and methods for high quality imaging using a color-splitting meta-optical computation camera
CN119768715A (zh) * 2022-07-12 2025-04-04 新加坡科技研究局 光学系统及形成光学系统的方法、形成多色图像的方法
WO2024225663A1 (ko) 2023-04-24 2024-10-31 삼성전자 주식회사 이미지를 복원하기 위한 전자 장치 및 그 동작 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101427372A (zh) * 2004-08-25 2009-05-06 美商新美景股份有限公司 用于多个相机装置的设备和操作该设备的方法
CN106803872A (zh) * 2017-03-02 2017-06-06 苏州苏大维格光电科技股份有限公司 相机镜头及手机
WO2019075335A1 (en) * 2017-10-13 2019-04-18 Trustees Of Boston University LENS-FREE COMPOSITE EYE CAMERAS BASED ON ANGLE-SENSITIVE METASURFACES

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPQ289099A0 (en) 1999-09-16 1999-10-07 Silverbrook Research Pty Ltd Method and apparatus for manipulating a bayer image
US7019890B2 (en) 2001-10-05 2006-03-28 E-Vision, Llc Hybrid electro-active lens
JP4071793B2 (ja) * 2003-10-22 2008-04-02 松下電器産業株式会社 撮像装置とその製造方法、及び携帯機器
US7123298B2 (en) * 2003-12-18 2006-10-17 Avago Technologies Sensor Ip Pte. Ltd. Color image sensor with imaging elements imaging on respective regions of sensor elements
US7206136B2 (en) * 2005-02-18 2007-04-17 Eastman Kodak Company Digital camera using multiple lenses and image sensors to provide an extended zoom range
JP5934459B2 (ja) * 2006-04-17 2016-06-15 オムニビジョン テクノロジーズ, インコーポレイテッド アレイ化撮像システムおよび関連方法
JP4985183B2 (ja) 2007-07-26 2012-07-25 東京エレクトロン株式会社 基板処理装置及び基板処理方法並びに記憶媒体
JP2009252978A (ja) * 2008-04-04 2009-10-29 Panasonic Corp 固体撮像素子およびその製造方法
US8866920B2 (en) * 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
EP3328048B1 (en) * 2008-05-20 2021-04-21 FotoNation Limited Capturing and processing of images using monolithic camera array with heterogeneous imagers
WO2011100070A1 (en) 2010-02-12 2011-08-18 The Regents Of The University Of California Metamaterial-based optical lenses
JP5820143B2 (ja) 2010-06-22 2015-11-24 株式会社ニューフレアテクノロジー 半導体製造装置、半導体製造方法及び半導体製造装置のクリーニング方法
US8478123B2 (en) * 2011-01-25 2013-07-02 Aptina Imaging Corporation Imaging devices having arrays of image sensors and lenses with multiple aperture sizes
US9231013B2 (en) 2011-11-08 2016-01-05 Semiconductor Components Industries, Llc Resonance enhanced absorptive color filters having resonance cavities
US9298060B2 (en) 2011-12-20 2016-03-29 Washington University Imaging using metamaterials
US8988566B2 (en) * 2012-08-09 2015-03-24 Omnivision Technologies, Inc. Lens array for partitioned image sensor having color filters
FR3002242B1 (fr) 2013-02-21 2015-04-03 Altatech Semiconductor Dispositif de depot chimique en phase vapeur
CN110061018B (zh) 2013-05-21 2023-11-28 弗托斯传感与算法公司 全光透镜在光传感器衬底上的单片集成
JP6376920B2 (ja) * 2014-03-07 2018-08-22 キヤノン株式会社 複眼撮像装置
CN103986867B (zh) * 2014-04-24 2017-04-05 宇龙计算机通信科技(深圳)有限公司 一种图像拍摄终端和图像拍摄方法
KR102157675B1 (ko) * 2014-07-25 2020-09-18 삼성전자주식회사 촬영 장치 및 그 촬영 방법
KR102394277B1 (ko) * 2014-08-22 2022-05-06 에스케이하이닉스 주식회사 이미지 센서 및 이를 구비하는 전자장치
US9583522B2 (en) * 2014-09-04 2017-02-28 SK Hynix Inc. Image sensor and electronic device including the same
TWI531852B (zh) * 2014-09-16 2016-05-01 聚晶半導體股份有限公司 影像擷取裝置及數位變焦方法
KR102251483B1 (ko) * 2014-10-23 2021-05-14 삼성전자주식회사 영상을 처리하는 전자 장치 및 방법
WO2016140720A2 (en) 2014-12-10 2016-09-09 President And Fellows Of Harvard College Achromatic metasurface optical components by dispersive phase compensation
CN104506771B (zh) * 2014-12-18 2018-04-27 北京智谷睿拓技术服务有限公司 图像处理方法及装置
JP6486149B2 (ja) 2015-03-03 2019-03-20 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
WO2016168173A1 (en) 2015-04-14 2016-10-20 California Institute Of Technology Multi-wavelength optical dielectric metasurfaces
US9946051B2 (en) * 2015-04-22 2018-04-17 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
EP3286915B1 (en) * 2015-04-23 2021-12-08 Apple Inc. Digital viewfinder user interface for multiple cameras
US10790325B2 (en) * 2015-07-29 2020-09-29 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
US10403668B2 (en) * 2015-07-29 2019-09-03 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
JP6863787B2 (ja) * 2017-03-17 2021-04-21 ソニー・オリンパスメディカルソリューションズ株式会社 内視鏡システム
US10678047B2 (en) * 2017-03-29 2020-06-09 Microsoft Technology Licensing, Llc Achromatized metasurface lens
US10284759B2 (en) * 2017-09-28 2019-05-07 Motorola Mobility Llc Display with interspaced microlenses and corresponding devices and methods
KR20190051670A (ko) * 2017-11-07 2019-05-15 삼성전자주식회사 전자 장치 및 그의 이미지 처리 방법
CN109348114A (zh) * 2018-11-26 2019-02-15 Oppo广东移动通信有限公司 成像装置和电子设备
CN113924517B (zh) * 2019-06-06 2024-03-22 应用材料公司 生成复合影像的成像系统及方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101427372A (zh) * 2004-08-25 2009-05-06 美商新美景股份有限公司 用于多个相机装置的设备和操作该设备的方法
CN106803872A (zh) * 2017-03-02 2017-06-06 苏州苏大维格光电科技股份有限公司 相机镜头及手机
WO2019075335A1 (en) * 2017-10-13 2019-04-18 Trustees Of Boston University LENS-FREE COMPOSITE EYE CAMERAS BASED ON ANGLE-SENSITIVE METASURFACES

Also Published As

Publication number Publication date
EP3980830A4 (en) 2023-06-07
TW202113422A (zh) 2021-04-01
JP2025108420A (ja) 2025-07-23
JP7650244B2 (ja) 2025-03-24
EP3980830A1 (en) 2022-04-13
TWI857068B (zh) 2024-10-01
US20200388642A1 (en) 2020-12-10
KR20220017480A (ko) 2022-02-11
US12021102B2 (en) 2024-06-25
CN113924517A (zh) 2022-01-11
KR102915906B1 (ko) 2026-01-20
CN118348657A (zh) 2024-07-16
TW202503354A (zh) 2025-01-16
WO2020247109A1 (en) 2020-12-10
JP2022535238A (ja) 2022-08-05
US11610925B2 (en) 2023-03-21
US20230230991A1 (en) 2023-07-20

Similar Documents

Publication Publication Date Title
CN113924517B (zh) 生成复合影像的成像系统及方法
KR102830280B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
US11756975B2 (en) Image sensor and image sensing method to generate high sensitivity image through thin lens element and micro lens array
JP5399215B2 (ja) 多眼カメラ装置および電子情報機器
KR102765854B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
KR102693695B1 (ko) 이미지 센서 및 그 준비 방법 및 전자 장치
CN204697179U (zh) 具有像素阵列的图像传感器
JP5842146B2 (ja) 固体撮像装置、撮像装置、及び分光素子
US20110164156A1 (en) Image pickup device and solid-state image pickup element
CN108141571A (zh) 无掩模相位检测自动聚焦
JP7425104B2 (ja) 色分離レンズアレイを備えるイメージセンサ及びそれを含む電子装置
CN110112155A (zh) 像素单元、图像传感器以及图像处理方法和存储介质
US12231749B2 (en) Sensing with liquid crystal polarization holograms and metasurface
CN102959434A (zh) 分色滤光阵列,固体摄像元件,摄像装置和显示装置
US12604109B2 (en) Image sensor including imaging pixels and autofocusing pixels and electronic apparatus including the image sensor
JP5018125B2 (ja) 固体撮像装置および撮像装置
US20250093562A1 (en) Spectral filter and electronic device including the same
TWI916962B (zh) 創造複合影像的成像系統及方法
US20260046530A1 (en) Image sensor and electronic apparatus including the same
US20230420480A1 (en) Image sensor and electronic apparatus including the image sensor
KR102202196B1 (ko) 카메라 모듈
JP4545734B2 (ja) モバイルカメラ光学系の光学レンズシステム
JP5234165B2 (ja) 固体撮像装置および撮像装置
TW202503361A (zh) 影像感測器及包括影像感測器之電子設備

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant