CN106526576B - Satellite remote sensing instrument ground imaging test optical axis alignment methods - Google Patents
Satellite remote sensing instrument ground imaging test optical axis alignment methods Download PDFInfo
- Publication number
- CN106526576B CN106526576B CN201611083771.7A CN201611083771A CN106526576B CN 106526576 B CN106526576 B CN 106526576B CN 201611083771 A CN201611083771 A CN 201611083771A CN 106526576 B CN106526576 B CN 106526576B
- Authority
- CN
- China
- Prior art keywords
- optical axis
- remote sensing
- sensing instrument
- satellite remote
- parallel light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
Abstract
The present invention provides a kind of satellite remote sensing instrument ground imaging test optical axis alignment methods, comprising the following steps: step 1: the position of satellite imagery optical axis is determined using four vertex of laser tracker measurement hood；Step 2: position of the parallel light tube optical axis under laser tracker coordinate system is calculated；Step 3: the angular deviation of two optical axises is calculated in satellite remote sensing instrument coordinates system, and adjusts parallel light tube direction, step 2 measurement process is repeated, iterates, until angular deviation meets imaging requirements；Step 4: the range deviation of two optical axises is calculated in satellite remote sensing instrument coordinates system, and translates parallel light tube, the measurement process of step 2 is repeated, iterates, until optical axis distance deviation meets imaging requirements.Measurement range of the present invention is big, can be used for the optical axis alignment of a wide range of deviation；Measurement accuracy is high, can adjust angular deviation and the range deviation between optical axis simultaneously；It is independently measured using laser tracker, adjustment process time-consuming is short, easily operated.
Description
Technical field
The present invention relates to a kind of alignment methods, and in particular, to a kind of satellite remote sensing instrument ground imaging test optical axis pair
Quasi- method.
Background technique
When carrying out high-precision optical imaging test, there are small deviations for the optical axis of each optical module, it is possible to cause into
The decline of image quality amount, even deviates from imaging system visual field, can not be imaged.Therefore the requirement being aligned to imaging system to optical axis is increasingly
It is high.Traditional optical axis alignment methods are adjusted according to the imaging results of optical system, are iterated up to meeting the requirements, but
The premise of this method is that the deviation of initial optical axis is smaller, and optical system can be imaged, moreover, this method time-consuming is more long, is needed
It to be corrected repeatedly by being repeatedly imaged.
By literature search, Chinese invention patent number 201510362869.5, patent name are " by rotary table laser direct-writing
Optical axis alignment to prospective component and method " Chinese patent give it is a kind of based on laser emitter, reflecting mirror, laser pickoff
With the optical axis alignment methods of turntable, which needs for alignment device to be mounted on optical imaging system, and scheme is complicated, has
Certain limitation.Chinese invention patent number 201410001653.1, patent name are the " support for the alignment of preset lens optical axis
The Chinese patent of micromatic setting " introduces a kind of device suitable for preset lens optical axis angle and fine position, not
Provide the measurement scheme of optical axis deviation.
Summary of the invention
For the defects in the prior art, the object of the present invention is to provide a kind of satellite remote sensing instrument ground imaging test light
Axis alignment methods, measurement range is big, can be used for the optical axis alignment of a wide range of deviation；Measurement accuracy is high, can adjust optical axis simultaneously
Between angular deviation and range deviation；It is independently measured using laser tracker, adjustment process time-consuming is short, easily operated.
According to an aspect of the present invention, a kind of satellite remote sensing instrument ground imaging test optical axis alignment methods are provided,
It is characterized in that, comprising the following steps:
Step 1: establishing satellite remote sensing instrument coordinates system and as measuring basis, and laser tracker is utilized to measure hood
Four vertex determine the position of satellite imagery optical axis, and calculate satellite remote sensing instrument coordinates system and laser tracker coordinate system
Transformational relation；Step 2: it using any three points on the side of laser tracker measurement parallel light tube circular end face, calculates parallel
Position of the light pipe optical axis under laser tracker coordinate system, and converted by coordinate, parallel light tube optical axis is obtained in satellite remote sensing
Position under instrument coordinates system；Step 3: the angular deviation of two optical axises is calculated in satellite remote sensing instrument coordinates system, and is adjusted flat
Row light pipe is directed toward, and is repeated two or two measurement process of step, is iterated, until angular deviation meets imaging requirements；Step 4: it is defending
Star remote sensing instrument coordinate system calculates the range deviation of two optical axises, and translates parallel light tube, repeats the measurement process of step 2,
It iterates, until optical axis distance deviation meets imaging requirements.
Preferably, the step 1 measures four vertex of satellite remote sensing instrument hood by laser tracker, according to
Four points construct two disjoint vectors, and two phasor differences multiply, and obtain the direction of satellite imagery optical axis；To four measurement points
Be averaging, obtain the centre coordinate of hood, it is contemplated that satellite imagery optical axis pass through hood center, therefore can determine satellite at
As the position of optical axis；Finally, the coordinate according to four vertex under satellite remote sensing instrument coordinates system and laser tracker coordinate system
Component calculates the transformational relation of satellite remote sensing instrument coordinates system and laser tracker coordinate system.
Preferably, the step 2 measures on the side of the circular end face of parallel light tube any three by laser tracker
Point constructs two disjoint vectors according to three measurement points, and two phasor differences multiply, and obtain the direction of parallel light tube optical axis.
Then, the coordinate in the center of circle can be found out according to the coordinate value of three measurement points, it is contemplated that parallel light tube optical axis, therefore can by the center of circle
Determine position of the parallel light tube optical axis under laser tracker coordinate system；It is converted by coordinate, obtains optical axis in satellite remote sensing instrument
Position under device coordinate system.
Preferably, the step 3 is according to two optical axises between the positional relationship of satellite remote sensing instrument coordinates system calculates optical axis
Angular deviation, and the optical axis for adjusting parallel light tube is directed toward, and is repeated the measurement process of step 2, is iterated, until angle
Deviation meets imaging requirements.
Preferably, the step 4 calculates the intersection point of two optical axises and satellite imagery plane, and the alternate position spike of two intersection points is
For the range deviation of optical axis, parallel light tube is translated according to calculated result, the measurement process of step 2 is repeated, iterates, directly
Meet imaging requirements to range deviation.
Compared with prior art, the present invention has following the utility model has the advantages that one, and measurement range of the present invention is big, can be used for big
The optical axis of coverage bias is aligned.Two, measurement accuracy of the present invention is high, can adjust angular deviation and the range deviation between optical axis simultaneously.
Three, the present invention is independently measured using laser tracker, and adjustment process time-consuming is short, easily operated.
Detailed description of the invention
Upon reading the detailed description of non-limiting embodiments with reference to the following drawings, other feature of the invention,
Objects and advantages will become more apparent upon:
Fig. 1 is the structural diagram of the present invention；
Fig. 2 is flow chart of the invention；
Fig. 3 is satellite imagery optical axis measurement method schematic diagram；.
Fig. 4 is parallel light tube optical axis measurement method schematic diagram；
Fig. 5 is the schematic diagram of optical axis deviation.
Specific embodiment
The present invention is described in detail combined with specific embodiments below.Following embodiment will be helpful to the technology of this field
Personnel further understand the present invention, but the invention is not limited in any way.It should be pointed out that the ordinary skill of this field
For personnel, without departing from the inventive concept of the premise, various modifications and improvements can be made.These belong to the present invention
Protection scope.
In Fig. 1,1 indicates satellite bracket；2 indicate satellite；3 indicate remote sensing instrument；4 indicate remote sensing instrument hood；5 indicate
Remote sensing instrument characteristic point measures target ball；6 indicate parallel light tube；7 indicate that laser tracker measures the optical axis；8 indicate that parallel light tube is special
Sign point measurement target ball；9 indicate laser tracker；10 indicate four-dimensional regulating mechanism；11 indicate imaging target；12 indicate integrating sphere.
In Fig. 3,41 indicate the first measurement point；42 indicate that first laser tracker measures sight；43 indicate first laser tracker；44 tables
Show hood；45 indicate hood end face center；46 indicate the first satellite imagery optical axis.In Fig. 4,21 indicate that parallel light tube is round
End face；22 indicate that second laser tracker measures sight；23 indicate second laser tracker；24 indicate the first parallel light tube light
Axis；25 indicate the second measurement point；26 indicate the parallel light tube circular end face center of circle.In Fig. 5,31 indicate the second satellite imagery optical axis,
32 indicate the second parallel light tube optical axis.
In the present embodiment, a kind of satellite remote sensing instrument ground imaging test optical axis alignment methods are provided, for realizing
Precisely aligning for ground imaging test various parts optical axis, meets imaging requirements.The present invention is with satellite remote sensing instrument coordinates system
The angle between optical axis is calculated using direction and position of the laser tracker measurement optical axis under the frame of reference for measuring basis
Deviation and range deviation are finally modified with four-dimension regulating mechanism.The present invention includes: step 1, establishes satellite remote sensing instrument
Coordinate system and as measuring basis, determines the position of satellite imagery optical axis, and calculate satellite remote sensing instrument coordinates system and laser with
The transformational relation of track instrument coordinate system；Step 2 calculates position of the parallel light tube optical axis under satellite remote sensing instrument coordinates system；Step
Three, the angular deviation of two optical axises is calculated, and be modified；Step 4, calculates the range deviation of two optical axises, and is repaired
Just.Detailed step is as follows:
Step 1: establishing satellite remote sensing instrument coordinates system and as measuring basis, determines the position of satellite imagery optical axis, and
Calculate the transformational relation of satellite remote sensing instrument coordinates system and laser tracker coordinate system, comprising the following steps: initially set up satellite
Remote sensing instrument coordinate system and as measuring basis, origin is hood center, and x-axis is parallel with hood coboundary, y-axis and shading
Cover lateral boundaries are parallel, and z-axis is vertical with hood end face, as shown in Figure 3.Secondly, four vertex for choosing hood are measurement point,
The boundary dimensions of hood can be calculated according to measurement result, and then obtains four measurement points under satellite remote sensing instrument coordinates system
Coordinate components A1Z、A2Z、A3ZAnd A4Z.The vector that may make up two intersections by four measurement points, such as formula (1):
r1Z=A1Z-A3Z r2Z=A2Z-A4Z (1)
Two phasor differences are multiplied, new vector r is obtained3Z=r1Z×r2Z, direction is vertical with hood end face, which is
For the direction of instrument optical axis.The average value of four measurement point position coordinates, the as center of hood are taken, since optical axis passes through
The center of hood is crossed, therefore can determine the position of optical axis.Finally, in satellite remote sensing instrument coordinates system and being swashed according to four vertex
Coordinate components under optical tracker system coordinate system, the conversion for calculating satellite remote sensing instrument coordinates system and laser tracker coordinate system are closed
System.
Step 2: position of the parallel light tube optical axis under satellite remote sensing instrument coordinates system is calculated, comprising the following steps: flat
Three measurement points are arbitrarily chosen on the side of the circular end face of row light pipe, and end face can be obtained according to laser tracker measurement result
The coordinate value in the center of circle.Two disjoint vectors, two phasor differences can be constructed according to three measurement points on circular end face side
Multiply, it is vertical with parallel light tube circular end face to obtain new direction vector, as the direction of parallel light tube optical axis.In view of directional light
Pipe optical axis is by the center of circle, thus may determine that position of the parallel light tube optical axis under laser tracker coordinate system, as shown in Figure 4.
Finally, converting by coordinate, position of the parallel light tube optical axis under satellite remote sensing instrument coordinates system is obtained.
Step 3: the angular deviation of two optical axises is calculated, and is modified, comprising the following steps: is existed according to two optical axises
Angular relationship under satellite remote sensing instrument coordinates system calculates the angular deviation of two different surface beelines, as shown in figure 5, and big according to deviation
The optical axis of small and direction adjustment parallel light tube is directed toward, and is repeated the measurement process of step 2, is iterated, until angular deviation is full
Sufficient imaging requirements.
Step 4: calculate the range deviation of two optical axises, and be modified, comprising the following steps: calculate two optical axises with
The intersection point of satellite imagery plane, the distance of two intersection points are the range deviation between instrument optical axis and parallel light tube optical axis, such as Fig. 5
It is shown, parallel light tube is translated according to calculated result, the measurement process of step 2 is repeated, iterates, until range deviation is full
Sufficient imaging requirements.
The present invention is in test guaranteeing remote sensing instrument and parallel light tube optical axis with higher precision and faster speed
Precisely align, meet imaging test requirement.The present invention is tracked using satellite remote sensing instrument coordinates system as measuring basis using laser
Instrument measures position of the optical axis under the frame of reference, calculates the angular deviation between optical axis and range deviation, is finally adjusted with four-dimensional
Mechanism is modified.Measurement range of the present invention is big, and precision is high, time-consuming short, it is easy to accomplish, be suitable for satellite remote sensing instrument ground at
As test optical axis alignment.
Specific embodiments of the present invention are described above.It is to be appreciated that the invention is not limited to above-mentioned
Particular implementation, those skilled in the art can make various deformations or amendments within the scope of the claims, this not shadow
Ring substantive content of the invention.
Claims (5)
1. a kind of satellite remote sensing instrument ground imaging test optical axis alignment methods, which comprises the following steps:
Step 1: establishing satellite remote sensing instrument coordinates system and as measuring basis, utilizes the four of laser tracker measurement hood
A vertex determines the position of satellite imagery optical axis, and calculates the conversion of satellite remote sensing instrument coordinates system and laser tracker coordinate system
Relationship；Step 2: using any three points on the side of laser tracker measurement parallel light tube circular end face, parallel light tube is calculated
Position of the optical axis under laser tracker coordinate system, and converted by coordinate, parallel light tube optical axis is obtained in satellite remote sensing instrument
Position under coordinate system；Step 3: the angular deviation of two optical axises is calculated in satellite remote sensing instrument coordinates system, and adjusts directional light
Pipe is directed toward, and is repeated step 2 measurement process, is iterated, until angular deviation meets imaging requirements；Step 4: distant in satellite
Feel instrument coordinates system and calculate the range deviation of two optical axises, and translate parallel light tube, repeats the measurement process of step 2, repeatedly
Iteration, until optical axis distance deviation meets imaging requirements.
2. satellite remote sensing instrument according to claim 1 ground imaging test optical axis alignment methods, which is characterized in that described
Step 1 measures four vertex of satellite remote sensing instrument hood by laser tracker, constructs two not phases according to four points
The vector of friendship, two phasor differences multiply, and obtain the direction of satellite imagery optical axis；Four measurement points are averaging, hood is obtained
Centre coordinate, it is contemplated that satellite imagery optical axis passes through hood center, therefore can determine the position of satellite imagery optical axis；Finally,
According to coordinate components of four vertex under satellite remote sensing instrument coordinates system and laser tracker coordinate system, satellite remote sensing instrument is calculated
The transformational relation of device coordinate system and laser tracker coordinate system.
3. satellite remote sensing instrument according to claim 1 ground imaging test optical axis alignment methods, which is characterized in that described
Step 2 measures any three points on the side of the circular end face of parallel light tube by laser tracker, is constructed according to three measurement points
Two disjoint vectors out, two phasor differences multiply, and obtain the direction of parallel light tube optical axis；Then, according to three measurement points
Coordinate value can find out the coordinate in the center of circle, it is contemplated that parallel light tube optical axis can determine that parallel light tube optical axis is swashing by the center of circle
Position under optical tracker system coordinate system；It is converted by coordinate, obtains position of the optical axis under satellite remote sensing instrument coordinates system.
4. satellite remote sensing instrument according to claim 1 ground imaging test optical axis alignment methods, which is characterized in that described
Step 3 calculates the angular deviation between optical axis in the positional relationship of satellite remote sensing instrument coordinates system according to two optical axises, and adjusts flat
The optical axis of row light pipe is directed toward, and is repeated the measurement process of step 2, is iterated, until angular deviation meets imaging requirements.
5. satellite remote sensing instrument ground imaging test optical axis alignment methods according to claim 1, which is characterized in that described
Step 4 calculates the intersection point of two optical axises and satellite imagery plane, and the alternate position spike of two intersection points is the range deviation of optical axis, root
Parallel light tube is translated according to calculated result, the measurement process of step 2 is repeated, iterates, until range deviation meets imaging and wants
It asks.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611083771.7A CN106526576B (en) | 2016-11-30 | 2016-11-30 | Satellite remote sensing instrument ground imaging test optical axis alignment methods |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611083771.7A CN106526576B (en) | 2016-11-30 | 2016-11-30 | Satellite remote sensing instrument ground imaging test optical axis alignment methods |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106526576A CN106526576A (en) | 2017-03-22 |
| CN106526576B true CN106526576B (en) | 2019-02-15 |
Family
ID=58353734
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611083771.7A Active CN106526576B (en) | 2016-11-30 | 2016-11-30 | Satellite remote sensing instrument ground imaging test optical axis alignment methods |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106526576B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107329191B (en) * | 2017-05-17 | 2020-04-21 | 上海卫星工程研究所 | Imaging test system and method for image navigation and registration of static meteorological satellite |
| CN108614587A (en) * | 2018-06-14 | 2018-10-02 | 上海卫星工程研究所 | Satellite remote sensing instrument optical axis is directed toward in-orbit method of adjustment and system |
| CN109975830B (en) * | 2019-02-21 | 2021-09-03 | 上海卫星工程研究所 | In-orbit thermal deformation suppression system for GEO satellite optical remote sensing instrument |
| CN111045457B (en) * | 2019-12-25 | 2023-08-22 | 长沙天仪空间科技研究院有限公司 | Optical axis pointing adjustment method based on satellite-borne remote sensing instrument |
| CN111553083B (en) * | 2020-04-29 | 2022-10-11 | 中国人民解放军63653部队 | Method, system and medium for optimizing and calculating parameter adjustment quantity of common intersection point multi-hole optical axis |
| CN112729777A (en) * | 2020-12-16 | 2021-04-30 | 中国科学院上海光学精密机械研究所 | High-precision reproduction device of digital optical axis |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103358018A (en) * | 2012-03-28 | 2013-10-23 | 东丽工程株式会社 | Laser axis calibrating method and laser processing device utilizing the same |
| CN103777301A (en) * | 2014-01-01 | 2014-05-07 | 西安应用光学研究所 | Support fine-tuning device applied to pre lens optical axis alignment |
| CN103926058A (en) * | 2014-03-27 | 2014-07-16 | 中国科学院长春光学精密机械与物理研究所 | Method for measuring optical axis in aspheric surface detection by means of self-aligning plane mirror |
| CN104713577A (en) * | 2015-04-09 | 2015-06-17 | 中国北方车辆研究所 | Laser receiving optical axis and visible light optical axis parallelism adjustment system and adjustment method |
| CN104972232A (en) * | 2015-06-26 | 2015-10-14 | 吉林大学 | Alignment assembly and method for aligning rotating shaft of rotating table type laser direct writing device to direct writing optical axis |
| CN105444700A (en) * | 2015-12-25 | 2016-03-30 | 中国科学院光电研究院 | Multi-wavelength multi-optical axis parallelism detection device and detection method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8659689B2 (en) * | 2011-05-17 | 2014-02-25 | Rpx Corporation | Fast measurement of alignment data of a camera system |
| WO2013008129A1 (en) * | 2011-07-14 | 2013-01-17 | Koninklijke Philips Electronics N.V. | System and method for remote measurement of optical focus |
-
2016
- 2016-11-30 CN CN201611083771.7A patent/CN106526576B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103358018A (en) * | 2012-03-28 | 2013-10-23 | 东丽工程株式会社 | Laser axis calibrating method and laser processing device utilizing the same |
| CN103777301A (en) * | 2014-01-01 | 2014-05-07 | 西安应用光学研究所 | Support fine-tuning device applied to pre lens optical axis alignment |
| CN103926058A (en) * | 2014-03-27 | 2014-07-16 | 中国科学院长春光学精密机械与物理研究所 | Method for measuring optical axis in aspheric surface detection by means of self-aligning plane mirror |
| CN104713577A (en) * | 2015-04-09 | 2015-06-17 | 中国北方车辆研究所 | Laser receiving optical axis and visible light optical axis parallelism adjustment system and adjustment method |
| CN104972232A (en) * | 2015-06-26 | 2015-10-14 | 吉林大学 | Alignment assembly and method for aligning rotating shaft of rotating table type laser direct writing device to direct writing optical axis |
| CN105444700A (en) * | 2015-12-25 | 2016-03-30 | 中国科学院光电研究院 | Multi-wavelength multi-optical axis parallelism detection device and detection method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106526576A (en) | 2017-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106526576B (en) | Satellite remote sensing instrument ground imaging test optical axis alignment methods | |
| CN106871787B (en) | Large space line scanning imagery method for three-dimensional measurement | |
| CN105424058B (en) | Digital camera projection centre position method for precisely marking based on photogrammetric technology | |
| CN101858755B (en) | Method for calibrating star sensor | |
| CN102914262B (en) | Non-cooperative target abutting measurement method based on additional sighting distance | |
| CN109373897B (en) | Measuring method based on laser virtual scale | |
| CN104200086A (en) | Wide-baseline visible light camera pose estimation method | |
| CN105823420B (en) | A kind of pyramid sub-assembly light echo center of energy coordinate precise deriving method | |
| Hui et al. | A novel line scan camera calibration technique with an auxiliary frame camera | |
| CN105675263B (en) | The caliberating device of position error and its demarcation and compensation method in plane sub-aperture stitching system | |
| CN110501026B (en) | Camera internal orientation element calibration device and method based on array star points | |
| CN106500843B (en) | A kind of imaging spectrometer optimum image plane calibration method and device | |
| CN104406770B (en) | The distortion measurement device and distortion correction method of wave aberration measurement module | |
| CN109491384B (en) | Method and device for acquiring road marking data | |
| CN105387996B (en) | More optical axis ground star observation systematic optical axis uniformity calibration methods | |
| CN103697811B (en) | A kind of camera is combined the method obtaining contour of object three-dimensional coordinate with structure light source | |
| Liu et al. | Accurate mapping method for UAV photogrammetry without ground control points in the map projection frame | |
| CN111044077B (en) | Calibration method between star sensor measurement coordinate system and star sensor cube mirror coordinate system | |
| CN110211175B (en) | Method for calibrating space pose of collimated laser beam | |
| Yuan et al. | A precise calibration method for line scan cameras | |
| CN109798874A (en) | A kind of high-speed rail bridge vertically moves degree of disturbing measurement method | |
| CN109596053B (en) | A method of measurement high-speed rail bridge vertically moves degree of disturbing | |
| CN203882072U (en) | Spatial infrared camera with visible light landmark navigation channel | |
| CN103822580A (en) | Multi-point real-time measurement system and method of deformation and attitude of overlong frame | |
| CN110428471B (en) | Accurate self-positioning method for optical free-form surface sub-aperture deflection measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |