CN110926375B - Quick phase extraction method based on diamond vector normalization - Google Patents
Quick phase extraction method based on diamond vector normalization Download PDFInfo
- Publication number
- CN110926375B CN110926375B CN201911356316.3A CN201911356316A CN110926375B CN 110926375 B CN110926375 B CN 110926375B CN 201911356316 A CN201911356316 A CN 201911356316A CN 110926375 B CN110926375 B CN 110926375B
- Authority
- CN
- China
- Prior art keywords
- phase
- diamond
- interferograms
- vector
- phase extraction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000605 extraction Methods 0.000 title claims abstract description 32
- 239000013598 vector Substances 0.000 title claims abstract description 28
- 229910003460 diamond Inorganic materials 0.000 title claims abstract description 27
- 239000010432 diamond Substances 0.000 title claims abstract description 27
- 238000010606 normalization Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims abstract description 18
- 230000010363 phase shift Effects 0.000 claims abstract description 17
- 238000001914 filtration Methods 0.000 claims abstract description 6
- 230000003287 optical effect Effects 0.000 claims abstract description 4
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000010008 shearing Methods 0.000 claims description 2
- 238000004422 calculation algorithm Methods 0.000 abstract description 22
- 238000005259 measurement Methods 0.000 abstract description 14
- 238000001514 detection method Methods 0.000 abstract description 6
- 230000007547 defect Effects 0.000 abstract description 3
- 238000004088 simulation Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000005094 computer simulation Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000005305 interferometry Methods 0.000 description 3
- 230000001788 irregular Effects 0.000 description 3
- 238000000513 principal component analysis Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012994 industrial processing Methods 0.000 description 1
- 238000012067 mathematical method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/254—Projection of a pattern, viewing through a pattern, e.g. moiré
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/97—Determining parameters from multiple pictures
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Instruments For Measurement Of Length By Optical Means (AREA)
Abstract
The invention relates to the field of optical detection, in particular to a rapid phase extraction method based on diamond vector normalization. The method comprises the following steps: s1, collecting two interference patterns of the appearance of a measured object; s2, filtering out direct current components from the two interference patterns; s3, constructing a diamond vector for the two interference patterns; s4, normalizing the diamond vectors; and S5, solving phase information. The method can directly extract phase information from the interference pattern by constructing the diamond vector and normalizing the diamond vector without knowing a phase shift value. Only two interferograms need to be collected, and the defect that phase information can be accurately extracted only by collecting a plurality of interferograms in the traditional phase extraction algorithm is overcome. The method adopts a non-iterative mode, can quickly extract phase information, and is suitable for dynamic morphology measurement.
Description
Technical Field
The invention relates to the field of optical detection, in particular to a rapid phase extraction method based on diamond vector normalization.
Background
With the continuous progress and development of science and technology, the precision requirement of the industry on instruments is higher and higher, and in the industrial processing process, processing errors inevitably occur. The detection of the good and bad processing of the instrument device needs to quickly and accurately restore the three-dimensional appearance of the measured object. Therefore, the rapid detection of the microscopic three-dimensional morphology is very important. The improvement of the detection speed can be divided into two aspects. On one hand, the measurement system is improved from an experimental device, and on the other hand, a key algorithm in the three-dimensional shape recovery is improved. Current measurement systems can be broadly divided into contact measurement and non-contact measurement. The non-contact measurement has the advantages of high speed and no damage, and is widely applied to three-dimensional detection of microscopic morphology. Non-contact measurements include structured light triangulation, fringe projection, stereographic projection, phase-shifting interferometry, and the like. Among the non-contact measurements, the most widely used is phase-shifting interferometry.
Therefore, the rapid and accurate recovery of the shape of the measured object in the phase-shifting interferometry system is a research hotspot of researchers. Phase extraction is a key technology for recovering a microscopic three-dimensional shape, and the phase extraction is to extract phase information from an interference pattern so as to obtain height information of a measured object. The traditional phase extraction algorithm needs to collect at least five interferograms to accurately extract phase information from the interferograms. The more interferograms that are acquired, the higher the relative accuracy. However, it takes time to acquire the interferograms, so that five interferograms are required, which is very unfavorable for real-time dynamic topography measurement.
In recent years, researchers have proposed a large number of phase extraction algorithms in order to improve the measurement speed and measurement accuracy. We can classify the algorithms into two categories according to their mathematical methods. Iterative algorithms and non-iterative algorithms. The iterative algorithm requires multiple iterations to obtain high accuracy phase information extraction, which requires a large amount of computation time. Not conducive to real-time dynamic measurement. Therefore, researchers have proposed many non-iterative algorithms for phase extraction, including three-step schmitt quadrature (GS3), Principal Component Analysis (PCA), Differential Normalization (DN), differential normalization and diamond vector normalization (DN & DDVN). The algorithms can obtain phase extraction with higher precision by adopting non-iterative algorithms, but the algorithms need to acquire at least three interferograms, and still take more time compared with the phase extraction algorithm which only needs two interferograms.
The iterative algorithm is long in time consumption, three interferograms need to be acquired by the three-step phase extraction algorithm, and the two-step non-iterative algorithm is a good solution in order to quickly extract the phase.
Disclosure of Invention
The invention provides a rapid phase extraction method based on rhombus vector normalization, and aims to provide an operational method which adopts a non-iterative mode, only needs to acquire two interferograms and can rapidly extract a phase.
The invention provides a rapid phase extraction method based on diamond vector normalization, which comprises the following steps:
s1, collecting two interference patterns of the appearance of a measured object:
in the case where the phase shift value is randomly unknown, the two interferograms are represented as:
wherein a (x, y) represents the background light intensity and b (x, y) represents the modulation amplitude; delta1Representing the phase shift value, δ, of the first graph2The phase shift value of the second interference pattern is shown, and phi (x, y) represents the phase information of the measured object; in the following analysis, we omit (x, y).
S2, filtering out direct current components for the two interference patterns:
after filtering out the dc component, equation (1) is simplified to:
s3, constructing a diamond vector for the two interference patterns:
will I1And I2Adding and subtracting respectively to construct a diamond vector, as shown in formula
Wherein S represents the sum of the light intensities of the two interferograms, and D represents the difference between the light intensities of the two interferograms.
S4, normalizing the diamond vectors:
under normal conditionsExcept that atIn order to eliminate the inconsistency between the S and D amplitudes, equation (3) is normalized to obtain:
wherein S is*Representing the sum of the intensities of the two normalized interferograms, D*Representing the difference between the intensities of the normalized two interferograms.
S5, solving phase information:
wherein phi represents the phase distribution of the object to be measured,delta is a constant independent of the pixel point, and the value of delta does not affect the phase distribution and can be ignored.
As a further improvement of the present invention, the S4 further includes:
s41, if the condition that the number of interference fringes is greater than 1 is satisfied in formula (4), the following approximation exists:
at this time S*And D*Are approximately equal to each other, thereby obtaining
as a further improvement of the present invention, if the number of interference fringes in formula (4) is less than or equal to 1, S is*And D*The amplitudes of (a) cannot be approximately equal,thus S*Is not equal to D*Amplitude of (b)k≠bk', wherein, the calculation formula of the phase distribution at this time is:whereinAnd solving r by utilizing ellipse fitting so as to obtain the phase distribution of the measured object.
The general expression of an ellipse is
a*x2+b*x*y+c*y2+d*x+f*y+g=0 (10)
Reducing equation (9) to obtain an expression similar to equation (10), let D*=x,S*Y, the parameters from which a general elliptic formula can be derived areThe parameter b can be calculated by ellipse fittingkAnd bk' to solve for r,
as a further improvement of the present invention, in step S1, the two interferograms are acquired as follows:
the light source adopts a collimated parallel LED light source, a beam of light is divided into two beams of light with a certain shearing amount and the same direction by using a uniaxial optical flat, random phase shifting is carried out by using an 1/4 wave plate and an analyzer, and two phase-shifting interferograms are collected by using a CCD industrial camera.
As a further improvement of the invention, the method also comprises the following steps: s6, phase extraction is carried out on the phase distribution under the condition that the number of interference fringes is larger than 1. In the phase extraction, when the number of interference fringes is larger than 1, the extracted phase distribution is discontinuous. Therefore, phase unwrapping is required to recover the continuous phase distribution. The phase unwrapping adopts the current mature unwrapping technology, and a phase unwrapping algorithm based on the non-continuity path reliability sequencing is proposed by Herraez in 2002. The algorithm firstly calculates the reliability value of the wrapping phase, a boundary is constructed, and then the unwrapping path is formulated by using the reliability of adjacent wires.
The invention has the beneficial effects that: the method can directly extract phase information from the interference pattern by constructing the diamond vector and normalizing the diamond vector without knowing a phase shift value. Only two interferograms need to be collected, and the defect that phase information can be accurately extracted only by collecting a plurality of interferograms in the traditional phase extraction algorithm is overcome. The method adopts a non-iterative mode, can quickly extract phase information, and is suitable for dynamic morphology measurement.
Drawings
FIG. 1 is a flow chart of a fast phase extraction method based on diamond vector normalization according to the present invention;
FIG. 2 is a simulation diagram according to a first embodiment of the present invention;
FIG. 3 is a simulation diagram of a second embodiment of the present invention;
FIG. 4 is a simulation diagram of a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments.
The invention provides a rapid phase extraction method based on diamond vector normalization. The method only needs two interferograms, as shown in fig. 1, and mainly comprises the following steps:
step 1: the direct current component is filtered out. In the case where the phase shift value is randomly unknown, the two interferograms can be represented as:
a (x, y) represents the background light intensity and b (x, y) represents the modulation amplitude. Delta1Representing the phase shift value, δ, of the first graph2The phase shift value of the second interferogram is shown and phi (x, y) represents the phase information of the measured object. In the following explanation, we omit (x, y) for convenience of explanation.
After filtering out the dc component, equation (1) can be simplified to:
step 2: and constructing a diamond vector.
Will I1And I2Respectively adding and subtracting to construct a diamond vector as shown in formula (3)
And step 3: normalized diamond vector.
By normalizing equation (3), we can get:
if the number of interference fringes is greater than 1:
it is thus possible to obtain:
and 4, step 4: and solving the phase information.
Wherein,delta is a constant which is irrelevant to the pixel points, does not influence the phase distribution of the measured object and can be ignored, so that the phase distribution of the measured object can be accurately obtained by using the formula (7).
And 5: and (5) unwrapping the phase.
Phase extraction phase unwrapping the phase distribution when the number of interference fringes is greater than 1. In the phase extraction, when the number of interference fringes is larger than 1, the extracted phase distribution is discontinuous. And (5) performing phase unwrapping to recover continuous phase distribution.
In order to verify the effectiveness of the method, a computer is used to perform simulation on various conditions. In the following simulations, we assume that the background light intensity has been filtered out.
The first embodiment is as follows:
as shown in fig. 2, assuming the fringe shape is circular, two random interferograms are generated in computer simulation, where the modulation amplitude: bm(x,y)=1.2exp(-0.1(x2+y2) Where m ═ 1,2, object phase: phi (x, y) being 5 pi (x)2+y2) The amount of phase shift δ of the first diagram10rad, amount of phase shift δ of second graph2=1rad。
The initial phase of 400 × 400 pixels is generated by numerical simulation, as shown in fig. 2(a), fig. 2(b) and 2(c) are two random interferograms, fig. 2(d) is the phase extracted by the method provided by the invention, and fig. 2(e) is the object surface phase information obtained after the phase unwrapping operation.
The phase extraction time for example 1 was: 0.05 s.
Example two:
as shown in fig. 3, the interference fringes are assumed to be simple vertical fringes. Two random interferograms were generated in computer simulation, where the modulation amplitude: bm(x,y)=1.2exp(-0.1(x2+y2) Where m ═ 1,2, object phase: phi is 5 pi (3x +4y), the phase shift amount delta of the first graph10rad, amount of phase shift δ of second graph2=1rad。
The initial phase of 400 × 400 pixels is generated by numerical simulation, as shown in fig. 3(a), fig. 3(b) and 3(c) are two random interferograms, fig. 3(d) is the phase extracted by the method provided by the invention, and fig. 3(e) is the object surface phase information obtained after the phase unwrapping operation.
The phase extraction time for example 2 was: 0.046 s.
Example three:
as shown in fig. 4, the interference fringes are assumed to be irregular fringes. Two random interferograms were generated in computer simulation, where the modulation amplitude: bm(x,y)=1.2exp(-0.1(x2+y2) Where m ═ 1,2, object phase: phi ═ 5 pi (5 x)2+4y3) The amount of phase shift δ of the first diagram10rad, amount of phase shift δ of second graph2=1rad。
The initial phase of 400 × 400 pixels is generated by numerical simulation, as shown in fig. 4(a), fig. 4(b) and 4(c) are two random interferograms, fig. 4(d) is the phase extracted by the method provided by the invention, and fig. 4(e) is the object surface phase information obtained after the phase unwrapping operation.
The phase extraction time for example 3 was: 0.052 s.
Embodiments 1,2 and 3 illustrate that the method can rapidly and accurately extract phase information under circular interference fringes, strip interference fringes and irregular interference fringes, and has strong applicability.
The invention only needs two interferograms, overcomes the defect that the traditional phase extraction algorithm needs a plurality of interferograms, and can quickly and accurately extract phase information; phase information is directly extracted from the interference pattern by a non-iterative method, the running speed of the algorithm is increased, and quick measurement can be realized; the algorithm can quickly and accurately extract phase information under circular interference fringes, vertical interference fringes and irregular interference fringes.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (4)
1. A quick phase extraction method based on diamond vector normalization is characterized by comprising the following steps:
s1, collecting two interference patterns of the appearance of a measured object:
in the case where the phase shift value is randomly unknown, two interferograms are represented as:
wherein a (x, y) represents the background light intensity and b (x, y) represents the modulation amplitude; delta1Representing the phase shift value, delta, of the first interferogram2The phase shift value of the second interference pattern is shown, and phi (x, y) represents the phase information distribution of the measured object;
s2, filtering out direct current components for the two interference patterns:
after filtering out the dc component, equation (1) is simplified to:
s3, constructing a diamond vector for the two interference patterns:
will I1And I2Adding and subtracting respectively to construct a diamond vector, as shown in formula (3)
Wherein S represents the sum of the light intensities of the two interferograms, and D represents the difference between the light intensities of the two interferograms;
s4, normalizing the diamond vectors:
normalizing equation (3) yields:
wherein S is*Representing the sum of the intensities of the two normalized interferograms, D*Representing the difference between the light intensities of the two normalized interferograms;
s5, solving phase information:
wherein phi represents the phase distribution of the object to be measured,Δ is a constant independent of the pixel point;
if the number of interference fringes is less than or equal to 1 in the formula (4), S*And D*The amplitudes of (a) cannot be approximately equal,thus S*Is not equal to D*Amplitude of (b)k≠bk', wherein,the calculation formula of the phase distribution at this time is:whereinSolving r by utilizing ellipse fitting so as to obtain the phase distribution of the measured object; because of the fact thatEquation (8) can be written as
The general expression of an ellipse is
a*x2+b*x*y+c*y2+d*x+f*y+g=0 (10)
2. the method for fast phase extraction based on diamond vector normalization according to claim 1, wherein the S4 further comprises:
s41, if the condition that the number of interference fringes is greater than 1 is satisfied in formula (4), the following approximation exists:
at this time S*And D*Are approximately equal to each other, thereby obtaining
3. the method for fast phase extraction based on diamond vector normalization according to claim 1, wherein in step S1, the two interferograms are collected as follows:
the light source adopts a collimated parallel light source, a beam of light is divided into two beams of light with a certain shearing amount and the same direction by using a uniaxial optical flat, random phase shifting is carried out by using an 1/4 wave plate and an analyzer, and two phase-shifting interferograms are collected by using a camera.
4. The method for fast phase extraction based on diamond vector normalization according to claim 1, further comprising the steps of:
s6, phase extraction is carried out on the phase distribution under the condition that the number of interference fringes is larger than 1.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911356316.3A CN110926375B (en) | 2019-12-25 | 2019-12-25 | Quick phase extraction method based on diamond vector normalization |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911356316.3A CN110926375B (en) | 2019-12-25 | 2019-12-25 | Quick phase extraction method based on diamond vector normalization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110926375A CN110926375A (en) | 2020-03-27 |
CN110926375B true CN110926375B (en) | 2021-11-23 |
Family
ID=69860930
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911356316.3A Active CN110926375B (en) | 2019-12-25 | 2019-12-25 | Quick phase extraction method based on diamond vector normalization |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110926375B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101666630A (en) * | 2009-10-30 | 2010-03-10 | 哈尔滨工业大学深圳研究生院 | Method and device for detecting precision wafer based on parallel optical flat splitting polarized beam and phase-shifting interferometry |
CN107490340A (en) * | 2017-07-18 | 2017-12-19 | 哈尔滨工业大学深圳研究生院 | A kind of fast phase extracting method of the random phase-shift interference of three width |
CN108195408A (en) * | 2017-12-13 | 2018-06-22 | 哈尔滨工业大学深圳研究生院 | Based on two step phase extraction methods, system and the medium for tilting Phase-shifting Errors correction |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107796301A (en) * | 2017-09-20 | 2018-03-13 | 哈尔滨工业大学深圳研究生院 | The phase extraction method being fitted based on Schimidt orthogonalization and least square ellipse |
-
2019
- 2019-12-25 CN CN201911356316.3A patent/CN110926375B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101666630A (en) * | 2009-10-30 | 2010-03-10 | 哈尔滨工业大学深圳研究生院 | Method and device for detecting precision wafer based on parallel optical flat splitting polarized beam and phase-shifting interferometry |
CN107490340A (en) * | 2017-07-18 | 2017-12-19 | 哈尔滨工业大学深圳研究生院 | A kind of fast phase extracting method of the random phase-shift interference of three width |
CN108195408A (en) * | 2017-12-13 | 2018-06-22 | 哈尔滨工业大学深圳研究生院 | Based on two step phase extraction methods, system and the medium for tilting Phase-shifting Errors correction |
Non-Patent Citations (4)
Title |
---|
A Rapid Spatial Carrier-Frequency Phase-Shifting Method Based on the Orthogonality of Diamond Diagonal Vectors;Xiang Qiu,Liyun Zhong and Bingbo Li et al;《IEEE Photonics Journal》;20170630;全文 * |
Chunshu Luo,Liyun Zhong and Peng Sun et al.Two-step demodulation algorithm based on the orthogonality of diamond diagonal vectors.《Applied Physics B》.2015,第388页左栏第1段-第389页左栏第2段. * |
Three-step random phase retrieval approach based on difference map normalization and diamond diagonal vector normalization;Yu Zhang,Xiaobo Tian,and Rongguang Liang;《Optics EXPRESS》;20181031;全文 * |
Two-step demodulation algorithm based on the orthogonality of diamond diagonal vectors;Chunshu Luo,Liyun Zhong and Peng Sun et al;《Applied Physics B》;20150325;第388页左栏第1段-第389页左栏第2段 * |
Also Published As
Publication number | Publication date |
---|---|
CN110926375A (en) | 2020-03-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109253708B (en) | Stripe projection time phase unwrapping method based on deep learning | |
CN103940371A (en) | High-precision three-dimensional shape measurement method for jump object | |
CN107490340B (en) | A kind of fast phase extracting method of the random phase-shift interference of three width | |
Qiao et al. | A single-shot phase retrieval method for phase measuring deflectometry based on deep learning | |
CN103514604B (en) | Method for extracting skeleton line of electronic speckle interference fringe image | |
CN107796301A (en) | The phase extraction method being fitted based on Schimidt orthogonalization and least square ellipse | |
CN101788275A (en) | Method for acquiring 3-D surface topography by utilizing wavelength as phase shift | |
CN109506592A (en) | Object dimensional surface shape measurement method and device based on striped light stream | |
CN107917676A (en) | A kind of interferometric method based on stripe pattern spectrum analysis | |
Šperka et al. | Experimental study of real roughness attenuation in concentrated contacts | |
CN106767531B (en) | A kind of method for three-dimensional measurement and device of object moving in two dimensions | |
CN104155011B (en) | A kind of phase extraction method of two dimension interferogram | |
CN105043301A (en) | Grating strip phase solving method used for three-dimensional measurement | |
Zhong et al. | Optical 3D shape measurement profilometry based on 2D S-Transform filtering method | |
CN110686652A (en) | Depth measurement method based on combination of depth learning and structured light | |
Shao et al. | Engineering surface topography analysis using an extended discrete modal decomposition | |
CN116007504A (en) | Crack detection module, device and computer equipment based on image technology | |
CN111815697A (en) | Dynamic three-dimensional measurement method for thermal deformation | |
CN110926375B (en) | Quick phase extraction method based on diamond vector normalization | |
CN105588518B (en) | Three-dimensional appearance acquisition methods based on double angle multi-frequency fringe projections and device | |
CN104614083B (en) | A kind of method of recovering phase shifting interference PHASE DISTRIBUTION and obtaining phase-shift phase between two width figure | |
CN113554608A (en) | Detection system for effectively improving MPO surface restoration precision | |
CN111023995B (en) | Three-dimensional measurement method based on random two-frame phase shift fringe pattern | |
CN112212806A (en) | Three-dimensional phase unfolding method based on phase information guidance | |
CN112381731A (en) | Single-frame stripe image phase analysis method and system based on image denoising |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |