KR102503029B1 - 픽셀 재분할 최적화를 갖는 방법 및 디스플레이 디바이스 - Google Patents

픽셀 재분할 최적화를 갖는 방법 및 디스플레이 디바이스 Download PDF

Info

Publication number
KR102503029B1
KR102503029B1 KR1020167035037A KR20167035037A KR102503029B1 KR 102503029 B1 KR102503029 B1 KR 102503029B1 KR 1020167035037 A KR1020167035037 A KR 1020167035037A KR 20167035037 A KR20167035037 A KR 20167035037A KR 102503029 B1 KR102503029 B1 KR 102503029B1
Authority
KR
South Korea
Prior art keywords
image
display device
viewer
perceived
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020167035037A
Other languages
English (en)
Korean (ko)
Other versions
KR20170020351A (ko
Inventor
씰방 띠보
로렁 블롱데
띠에리 따삐
발떼르 드라직
Original Assignee
인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스 filed Critical 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Publication of KR20170020351A publication Critical patent/KR20170020351A/ko
Application granted granted Critical
Publication of KR102503029B1 publication Critical patent/KR102503029B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G06T3/053—Detail-in-context presentations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N3/00—Scanning details of television systems; Combination thereof with generation of supply voltages
    • H04N3/10—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical
    • H04N3/16—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by deflecting electron beam in cathode-ray tube, e.g. scanning corrections
    • H04N3/22—Circuits for controlling dimensions, shape or centering of picture on screen
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0147—Head-up displays characterised by optical features comprising a device modifying the resolution of the displayed image
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20104—Interactive definition of region of interest [ROI]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Image Processing (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
KR1020167035037A 2014-06-17 2015-06-16 픽셀 재분할 최적화를 갖는 방법 및 디스플레이 디바이스 Active KR102503029B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP14305923.6 2014-06-17
EP14305923.6A EP2958074A1 (en) 2014-06-17 2014-06-17 A method and a display device with pixel repartition optimization
PCT/EP2015/063435 WO2015193287A1 (en) 2014-06-17 2015-06-16 A method and a display device with pixel repartition optimization

Publications (2)

Publication Number Publication Date
KR20170020351A KR20170020351A (ko) 2017-02-22
KR102503029B1 true KR102503029B1 (ko) 2023-02-23

Family

ID=51162628

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020167035037A Active KR102503029B1 (ko) 2014-06-17 2015-06-16 픽셀 재분할 최적화를 갖는 방법 및 디스플레이 디바이스

Country Status (10)

Country Link
US (1) US11593914B2 (https=)
EP (2) EP2958074A1 (https=)
JP (1) JP6684728B2 (https=)
KR (1) KR102503029B1 (https=)
CN (1) CN106461951B (https=)
CA (1) CA2952710C (https=)
MX (1) MX371370B (https=)
RU (1) RU2693329C2 (https=)
TW (1) TWI660201B (https=)
WO (1) WO2015193287A1 (https=)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016130941A1 (en) * 2015-02-12 2016-08-18 Google Inc. Combining a high resolution narrow field display and a mid resolution wide field display
CN106293047B (zh) * 2015-06-26 2020-01-10 微软技术许可有限责任公司 通过动态分辨率缩放来减少移动设备的功耗
US10694102B2 (en) * 2016-07-22 2020-06-23 Immervision, Inc. Method to capture, store, distribute, share, stream and display panoramic image or video
JP6844210B2 (ja) * 2016-11-16 2021-03-17 凸版印刷株式会社 視覚的顕著性マップ生成装置、視覚的顕著性マップ生成方法及びプログラム
CA3056924A1 (en) * 2017-03-22 2018-09-27 Magic Leap, Inc. Dynamic field of view variable focus display system
US10764552B2 (en) 2017-05-26 2020-09-01 Google Llc Near-eye display with sparse sampling super-resolution
EP3635515A1 (en) * 2017-06-09 2020-04-15 Sony Interactive Entertainment Inc. Optimized shadows and adaptive mesh skinning in a foveated rendering system
US20190079284A1 (en) * 2017-09-08 2019-03-14 Mediatek Inc. Variable DPI Across A Display And Control Thereof
US10521881B1 (en) * 2017-09-28 2019-12-31 Apple Inc. Error concealment for a head-mountable device
US10511842B2 (en) 2017-10-06 2019-12-17 Qualcomm Incorporated System and method for foveated compression of image frames in a system on a chip
JP7228584B2 (ja) 2017-10-22 2023-02-24 ラマス リミテッド 光学ベンチを用いるヘッドマウント拡張現実デバイス
KR20200097289A (ko) 2017-12-10 2020-08-18 루머스 리미티드 이미지 프로젝터
JP7325408B2 (ja) * 2018-05-15 2023-08-14 ソニーセミコンダクタソリューションズ株式会社 表示装置
IL259518B2 (en) * 2018-05-22 2023-04-01 Lumus Ltd Optical system and method for improving light field uniformity
US11221494B2 (en) * 2018-12-10 2022-01-11 Facebook Technologies, Llc Adaptive viewport optical display systems and methods
BR112021022229A2 (pt) 2019-06-27 2022-02-22 Lumus Ltd Aparelho
KR102837402B1 (ko) * 2019-07-28 2025-07-23 구글 엘엘씨 포비에이티드 메시들로 몰입형 비디오 콘텐츠를 렌더링하기 위한 방법들, 시스템들, 및 매체들
EP4042232B1 (en) 2019-12-08 2025-02-19 Lumus Ltd. Optical systems with compact image projector
IL294102A (en) 2019-12-25 2022-08-01 Lumus Ltd Optical systems and methods for tracking eyes based on directing light from the eye through an optical arrangement associated with a light-directing optical element
JP7786371B2 (ja) * 2020-05-27 2025-12-16 ソニーグループ株式会社 表示装置及び表示方法
US12039958B2 (en) 2020-08-03 2024-07-16 Arizona Board Of Regents On Behalf Of The University Of Arizona Perceptual-driven foveated displays
WO2022130372A1 (en) 2020-12-17 2022-06-23 Lumus Ltd. Optical systems and methods for eye tracking based on eye imaging via collimating element and light-guide optical element
WO2022130393A1 (en) 2020-12-20 2022-06-23 Lumus Ltd. Image projector with laser scanning over spatial light modulator
US11899215B1 (en) * 2022-07-29 2024-02-13 Htc Corporation Head mounted display, display device and image display method thereof
EP4542343A4 (en) 2022-12-29 2025-11-19 Samsung Electronics Co Ltd VISIO-HELMET DEVICE INCLUDING AN EYE-TRACKING SENSOR AND OPERATING METHOD FOR VISIO-HELMET DEVICE

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000310747A (ja) * 1999-02-26 2000-11-07 Mr System Kenkyusho:Kk 画像観察装置
JP2001281594A (ja) * 2000-03-30 2001-10-10 Denso Corp 網膜走査ディスプレイ装置及び光走査装置
US20120320463A1 (en) 2011-06-17 2012-12-20 Gal Shabtay Auto-focus actuator for field curvature correction of zoom lenses

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01252993A (ja) 1988-04-01 1989-10-09 Nippon Telegr & Teleph Corp <Ntt> 画像表示方法
JPH0638219A (ja) 1992-07-20 1994-02-10 Olympus Optical Co Ltd 映像表示装置
JP2896291B2 (ja) 1993-06-14 1999-05-31 株式会社エイ・ティ・アール通信システム研究所 画像表示装置
JP2638444B2 (ja) * 1993-10-04 1997-08-06 日本電気株式会社 頭部搭載型画像表示装置
JP3283367B2 (ja) * 1993-11-11 2002-05-20 三菱プレシジョン株式会社 潜望鏡映像表示装置
JP3604443B2 (ja) * 1995-02-28 2004-12-22 株式会社島津製作所 テレビジョンシステム
US6734838B1 (en) 1998-05-18 2004-05-11 Dimension Technologies Inc. Enhanced resolution for image generation
US20020063807A1 (en) 1999-04-19 2002-05-30 Neal Margulis Method for Performing Image Transforms in a Digital Display System
WO2002067235A2 (en) 2001-02-21 2002-08-29 Koninklijke Philips Electronics N.V. Display system for processing a video signal
US7068813B2 (en) 2001-03-28 2006-06-27 Koninklijke Philips Electronics N.V. Method and apparatus for eye gazing smart display
US20060145945A1 (en) 2002-01-07 2006-07-06 Lewis John R Scanned beam system with distortion compensation
US7495638B2 (en) * 2003-05-13 2009-02-24 Research Triangle Institute Visual display with increased field of view
RU2322771C2 (ru) 2005-04-25 2008-04-20 Святослав Иванович АРСЕНИЧ Стереопроекционная система
US20090309811A1 (en) 2006-10-31 2009-12-17 Bae Systems Plc Image display systems
US8314814B2 (en) * 2007-12-20 2012-11-20 Raytheon Company Imaging system
US8941559B2 (en) 2010-09-21 2015-01-27 Microsoft Corporation Opacity filter for display device
US9529191B2 (en) * 2010-11-03 2016-12-27 Trex Enterprises Corporation Dynamic foveal vision display
US9690099B2 (en) 2010-12-17 2017-06-27 Microsoft Technology Licensing, Llc Optimized focal area for augmented reality displays
JP5414946B2 (ja) 2011-06-16 2014-02-12 パナソニック株式会社 ヘッドマウントディスプレイおよびその位置ずれ調整方法
US8817379B2 (en) * 2011-07-12 2014-08-26 Google Inc. Whole image scanning mirror display system
US20130147686A1 (en) * 2011-12-12 2013-06-13 John Clavin Connecting Head Mounted Displays To External Displays And Other Communication Networks
US20130215147A1 (en) 2012-02-17 2013-08-22 Esight Corp. Apparatus and Method for Enhancing Human Visual Performance in a Head Worn Video System
US20130246967A1 (en) * 2012-03-15 2013-09-19 Google Inc. Head-Tracked User Interaction with Graphical Interface
US9720231B2 (en) * 2012-09-26 2017-08-01 Dolby Laboratories Licensing Corporation Display, imaging system and controller for eyewear display device
JP5935640B2 (ja) 2012-10-01 2016-06-15 ソニー株式会社 情報処理装置、表示制御方法及びプログラム
CN103593051B (zh) * 2013-11-11 2017-02-15 百度在线网络技术（北京）有限公司 头戴式显示设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000310747A (ja) * 1999-02-26 2000-11-07 Mr System Kenkyusho:Kk 画像観察装置
JP2001281594A (ja) * 2000-03-30 2001-10-10 Denso Corp 網膜走査ディスプレイ装置及び光走査装置
US20120320463A1 (en) 2011-06-17 2012-12-20 Gal Shabtay Auto-focus actuator for field curvature correction of zoom lenses

Also Published As

Publication number Publication date
RU2693329C2 (ru) 2019-07-02
CA2952710A1 (en) 2015-12-23
KR20170020351A (ko) 2017-02-22
US20170132757A1 (en) 2017-05-11
CA2952710C (en) 2024-01-02
CN106461951A (zh) 2017-02-22
MX2016016718A (es) 2017-04-13
RU2017101239A3 (https=) 2018-12-13
EP2958074A1 (en) 2015-12-23
MX371370B (es) 2020-01-28
EP3158531B1 (en) 2024-04-24
JP6684728B2 (ja) 2020-04-22
CN106461951B (zh) 2020-07-17
RU2017101239A (ru) 2018-07-17
EP3158531A1 (en) 2017-04-26
US11593914B2 (en) 2023-02-28
WO2015193287A1 (en) 2015-12-23
TW201600887A (zh) 2016-01-01
TWI660201B (zh) 2019-05-21
JP2017522591A (ja) 2017-08-10

Similar Documents

Publication Publication Date Title
KR102503029B1 (ko) 픽셀 재분할 최적화를 갖는 방법 및 디스플레이 디바이스
US11816820B2 (en) Gaze direction-based adaptive pre-filtering of video data
US10984756B2 (en) Adaptive parameters in image regions based on eye tracking information
CN111602082B (zh) 用于包括传感器集成电路的头戴式显示器的位置跟踪系统
US9372348B2 (en) Apparatus and method for a bioptic real time video system
CA3043204C (en) Apparatus and method for a dynamic &#34;region of interest&#34; in a display system
US9911214B2 (en) Display control method and display control apparatus
US10082867B2 (en) Display control method and display control apparatus
US20130235169A1 (en) Head-mounted display and position gap adjustment method
WO2019217260A1 (en) Dynamic foveated display
CN106297611B (zh) 显示控制方法和装置
US20190079284A1 (en) Variable DPI Across A Display And Control Thereof
US10083675B2 (en) Display control method and display control apparatus
HK1236670A1 (en) A method and a display device with pixel repartition optimization
HK1236670B (en) A method and a display device with pixel repartition optimization
US20260030793A1 (en) Dynamic attentional region generation and rendering
US20250168320A1 (en) Extended-reality rendering using hardware pixels-per-degree estimations, and systems and methods of use thereof

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

R17-X000 Change to representative recorded

St.27 status event code: A-3-3-R10-R17-oth-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

A201 Request for examination
AMND Amendment
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

AMND Amendment
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E601 Decision to refuse application
PE0601 Decision on rejection of patent

St.27 status event code: N-2-6-B10-B15-exm-PE0601

X091 Application refused [patent]
AMND Amendment
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PX0901 Re-examination

St.27 status event code: A-2-3-E10-E12-rex-PX0901

PX0701 Decision of registration after re-examination

St.27 status event code: A-3-4-F10-F13-rex-PX0701

X701 Decision to grant (after re-examination)
GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-OTH-PR1001 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 4