KR102340617B1 - 제어장치, 제어 시스템, 제어 방법, 프로그램, 및 기억 매체 - Google Patents

제어장치, 제어 시스템, 제어 방법, 프로그램, 및 기억 매체 Download PDF

Info

Publication number
KR102340617B1
KR102340617B1 KR1020207006659A KR20207006659A KR102340617B1 KR 102340617 B1 KR102340617 B1 KR 102340617B1 KR 1020207006659 A KR1020207006659 A KR 1020207006659A KR 20207006659 A KR20207006659 A KR 20207006659A KR 102340617 B1 KR102340617 B1 KR 102340617B1
Authority
KR
South Korea
Prior art keywords
zoom
zoom lens
control
information indicating
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020207006659A
Other languages
English (en)
Korean (ko)
Other versions
KR20200039725A (ko
Inventor
히로야스 모리타
Original Assignee
캐논 가부시끼가이샤
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 캐논 가부시끼가이샤 filed Critical 캐논 가부시끼가이샤
Publication of KR20200039725A publication Critical patent/KR20200039725A/ko
Application granted granted Critical
Publication of KR102340617B1 publication Critical patent/KR102340617B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/665Control of cameras or camera modules involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G02B7/10Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
    • G02B7/102Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64CAEROPLANES; HELICOPTERS
    • B64C39/00Aircraft not otherwise provided for
    • B64C39/02Aircraft not otherwise provided for characterised by special use
    • B64C39/024Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00Equipment not otherwise provided for
    • B64D47/08Arrangements of cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U10/00Type of UAV
    • B64U10/10Rotorcrafts
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U30/00Means for producing lift; Empennages; Arrangements thereof
    • B64U30/20Rotors; Rotor supports
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U50/00Propulsion; Power supply
    • B64U50/10Propulsion
    • B64U50/13Propulsion using external fans or propellers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/006Apparatus mounted on flying objects
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B5/00Adjustment of optical system relative to image or object surface other than for focusing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634Warning indications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661Transmitting camera control signals through networks, e.g. control via the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H04N5/23206
    • H04N5/23296
    • B64C2201/024
    • B64C2201/108
    • B64C2201/127
    • B64C2201/141
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2201/00UAVs characterised by their flight controls
    • B64U2201/10UAVs characterised by their flight controls autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0046Movement of one or more optical elements for zooming
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2109/00Types of controlled vehicles
    • G05D2109/20Aircraft, e.g. drones

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Mechanical Engineering (AREA)
  • Remote Sensing (AREA)
  • Optics & Photonics (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Automation & Control Theory (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Devices (AREA)
  • Lens Barrels (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
KR1020207006659A 2017-08-23 2018-07-04 제어장치, 제어 시스템, 제어 방법, 프로그램, 및 기억 매체 Active KR102340617B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JPJP-P-2017-160529 2017-08-23
JP2017160529A JP7057637B2 (ja) 2017-08-23 2017-08-23 制御装置、制御システム、制御方法、プログラム、及び記憶媒体
PCT/JP2018/025341 WO2019039099A1 (ja) 2017-08-23 2018-07-04 制御装置、制御システム、制御方法、プログラム、及び記憶媒体

Publications (2)

Publication Number Publication Date
KR20200039725A KR20200039725A (ko) 2020-04-16
KR102340617B1 true KR102340617B1 (ko) 2021-12-20

Family

ID=65440031

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020207006659A Active KR102340617B1 (ko) 2017-08-23 2018-07-04 제어장치, 제어 시스템, 제어 방법, 프로그램, 및 기억 매체

Country Status (6)

Country Link
US (1) US11310416B2 (enExample)
EP (1) EP3687159B1 (enExample)
JP (1) JP7057637B2 (enExample)
KR (1) KR102340617B1 (enExample)
CN (1) CN111034172B (enExample)
WO (1) WO2019039099A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020107372A1 (zh) * 2018-11-30 2020-06-04 深圳市大疆创新科技有限公司 拍摄设备的控制方法、装置、设备及存储介质
US12055396B2 (en) 2019-08-08 2024-08-06 Sony Group Corporation Information processing apparatus, moving body, information processing system, information processing method, and program
JP6878738B1 (ja) * 2020-02-12 2021-06-02 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd 制御装置、撮像システム、移動体、制御方法、及びプログラム
WO2022020238A1 (en) * 2020-07-20 2022-01-27 Canon U.S.A., Inc. Control system for an unmanned autonomous vehicle
JP7104114B2 (ja) 2020-08-21 2022-07-20 楽天グループ株式会社 飛行体、システム、及び、方法
CN112401752B (zh) 2020-11-04 2022-05-17 北京石头创新科技有限公司 一种检测未知障碍物的方法、装置、介质和电子设备
CN114788253B (zh) * 2020-12-31 2024-05-28 深圳市大疆创新科技有限公司 拍摄设备、控制设备、遥控设备、移动控制系统和可穿戴设备
WO2022141348A1 (en) 2020-12-31 2022-07-07 SZ DJI Technology Co., Ltd. Systems, devices, and methods supporting multiple photography modes with a control device
JP7696769B2 (ja) 2021-06-29 2025-06-23 キヤノン株式会社 無人飛行装置および無人飛行装置の制御方法
US20230058405A1 (en) * 2021-08-20 2023-02-23 Sony Group Corporation Unmanned aerial vehicle (uav) swarm control
JP7776972B2 (ja) 2021-11-25 2025-11-27 キヤノン株式会社 撮像装置、制御方法およびプログラム
CN114849234B (zh) * 2022-06-01 2025-07-25 网易(杭州)网络有限公司 虚拟镜头控制方法、装置、存储介质和电子设备
JP2024033521A (ja) 2022-08-30 2024-03-13 キヤノン株式会社 撮像システム及びその制御方法とプログラム

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI55682C (fi) 1977-09-06 1979-09-10 Viljanmaa Antti Spaennanordning foer skinn
JPS56159165A (en) 1980-05-14 1981-12-08 Hiraoka Shokusen Resin coated cloth silk having large tear strength
US5305038A (en) * 1991-07-30 1994-04-19 Asahi Kogaku Kogyo Kabushiki Kaisha Zoom lens camera
JP2004288100A (ja) * 2003-03-25 2004-10-14 Minolta Co Ltd 撮像装置及び移動体カメラ
JP2012023546A (ja) * 2010-07-14 2012-02-02 Jvc Kenwood Corp 制御装置、立体映像撮像装置、および制御方法
CN102809969A (zh) * 2011-06-03 2012-12-05 鸿富锦精密工业(深圳)有限公司 无人飞行载具控制系统及方法
JP6003530B2 (ja) * 2012-10-25 2016-10-05 リコーイメージング株式会社 ズームレンズ系
JP5561843B1 (ja) * 2013-01-07 2014-07-30 株式会社amuse oneself 制御装置、測量システム、プログラム及び記録媒体並びに計測方法
US8903568B1 (en) 2013-07-31 2014-12-02 SZ DJI Technology Co., Ltd Remote control method and terminal
CN103426282A (zh) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 遥控方法及终端
CN107168352B (zh) 2014-07-30 2020-07-14 深圳市大疆创新科技有限公司 目标追踪系统及方法
JP2016111414A (ja) * 2014-12-03 2016-06-20 コニカミノルタ株式会社 飛行体の位置検出システム及び飛行体
JP6475568B2 (ja) 2015-05-19 2019-02-27 オリンパス株式会社 撮像装置および飛行制御方法
US11140326B2 (en) * 2015-05-22 2021-10-05 The United States Of America, As Represented By The Secretary Of The Navy Aerial video based point, distance, and velocity real-time measurement system
JP6367759B2 (ja) 2015-06-01 2018-08-01 日本電信電話株式会社 表示画像ズーム端末、表示画像ズーム方法及び表示画像ズームプログラム
JP2017034444A (ja) * 2015-07-31 2017-02-09 オリンパス株式会社 撮像装置および撮像方法
FR3041134B1 (fr) * 2015-09-10 2017-09-29 Parrot Drone avec camera a visee frontale dont les parametres de controle, notamment l'autoexposition, sont rendus independant de l'attitude.
CN119645078A (zh) * 2015-09-15 2025-03-18 深圳市大疆创新科技有限公司 控制可移动物体跟踪目标的系统和方法
JP6596745B2 (ja) * 2015-10-20 2019-10-30 エスゼット ディージェイアイ テクノロジー カンパニー リミテッド 対象物体を撮像するシステム
JP6758828B2 (ja) * 2015-12-15 2020-09-23 キヤノン株式会社 撮像システムおよびその制御方法
JP6318455B1 (ja) * 2016-06-13 2018-05-09 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd 制御装置、撮像装置、移動体、制御方法及びプログラム
JP6500849B2 (ja) * 2016-06-23 2019-04-17 カシオ計算機株式会社 撮像装置、撮像方法及びプログラム
JP6146520B1 (ja) * 2016-07-12 2017-06-14 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co., Ltd 光学装置、移動体、保持位置調整方法、及びプログラム
WO2018010095A1 (en) * 2016-07-12 2018-01-18 SZ DJI Technology Co., Ltd. System for balancing center of gravity of a zoom lens
WO2018014254A1 (en) * 2016-07-20 2018-01-25 SZ DJI Technology Co., Ltd. Method and apparatus for zooming relative to an object copyright notice
JP6103672B1 (ja) * 2016-07-20 2017-03-29 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd 制御装置、撮像装置、移動体、制御方法、及びプログラム
WO2018053825A1 (zh) * 2016-09-26 2018-03-29 深圳市大疆创新科技有限公司 对焦方法和装置、图像拍摄方法和装置及摄像系统
WO2018098678A1 (zh) 2016-11-30 2018-06-07 深圳市大疆创新科技有限公司 飞行器的控制方法、装置和设备以及飞行器

Also Published As

Publication number Publication date
CN111034172B (zh) 2021-11-16
EP3687159B1 (en) 2023-05-10
US11310416B2 (en) 2022-04-19
WO2019039099A1 (ja) 2019-02-28
US20200162667A1 (en) 2020-05-21
JP7057637B2 (ja) 2022-04-20
EP3687159A4 (en) 2021-08-18
KR20200039725A (ko) 2020-04-16
EP3687159A1 (en) 2020-07-29
CN111034172A (zh) 2020-04-17
JP2019041185A (ja) 2019-03-14

Similar Documents

Publication Publication Date Title
KR102340617B1 (ko) 제어장치, 제어 시스템, 제어 방법, 프로그램, 및 기억 매체
CN107580161B (zh) 摄影设备及方法、移动摄影装置、摄影用移动体及其控制装置
JP2017142354A (ja) 撮像装置、撮像装置の制御方法及びプログラム並びに記憶媒体
CN116339037A (zh) 摄像装置及可换镜头
WO2018163571A1 (ja) 情報処理装置、情報処理方法および情報処理プログラム
JP2017175366A (ja) 撮影機器、撮影用移動体及び移動体用撮影制御装置
WO2021212445A1 (zh) 拍摄方法、可移动平台、控制设备和存储介质
CN110058474B (zh) 可换镜头
JP6818798B2 (ja) 画像処理装置および画像処理方法、ならびに撮像装置
CN108737698B (zh) 图像稳定设备和方法、摄像设备、摄像系统和存储介质
US12063435B2 (en) Image capturing apparatus, control method, and storage medium
JP7131541B2 (ja) 画像処理装置、画像処理方法および画像処理プログラム
JP7562323B2 (ja) 撮像装置及び撮像システム
JP6136189B2 (ja) 補助撮像装置および主撮像装置
JP2019092036A (ja) 撮像装置及び制御方法
JP6080825B2 (ja) 撮像装置及びその制御方法
US12338009B2 (en) Image capturing system equipped with device capable of flying, method of controlling image capturing system, and storage medium
JP2021033177A (ja) アダプタ、撮像装置、支持機構および移動体
JP7483357B2 (ja) レンズ装置および撮像装置
JP2010206434A (ja) 撮像装置
WO2023008102A1 (ja) 撮影制御装置、撮影システム、撮影制御方法、及び撮影制御プログラム
CN105847685A (zh) 一种可通过智能终端App操控单反相机的单反相机控制器
JP2020095071A (ja) 交換レンズおよび撮像装置
JP2014164206A (ja) 撮像装置およびその制御方法、プログラム、記憶媒体
JP2018197880A (ja) 撮像装置

Legal Events

Date Code Title Description
A201 Request for examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E90F Notification of reason for final refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000