CN109903211A - A kind of watermarking images hidden method and method of detecting watermarks based on raster grating - Google Patents
A kind of watermarking images hidden method and method of detecting watermarks based on raster grating Download PDFInfo
- Publication number
- CN109903211A CN109903211A CN201910079065.2A CN201910079065A CN109903211A CN 109903211 A CN109903211 A CN 109903211A CN 201910079065 A CN201910079065 A CN 201910079065A CN 109903211 A CN109903211 A CN 109903211A
- Authority
- CN
- China
- Prior art keywords
- image
- watermarking images
- packaging
- unit
- unit area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Image Processing (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The present invention relates to a kind of watermarking images hidden method based on raster grating, use for reference the principle of lenticular lenses, the passability of light is set all to generate the raster grating strategy of variation in two directions, so that the hiding of watermarking images is more preferable, other than it can hide binary watermarking, Gray-level Watermarking can also be hidden, even color watermark, can hide multiple watermarking images in a Packaging image, under the premise of not changing packaging external appearance, printing technology, with antiforge function and special bandwagon effect；Also relate to method of detecting watermarks, use image capture apparatus instead and detected, based on known to image capture apparatus by the grid position information of specific rule arrangement, can rapidly extracting go out hiding watermarking images.
Description
Technical field
The present invention relates to a kind of watermarking images hidden method and method of detecting watermarks based on raster grating, belongs to watermark skill
Art field.
Background technique
Traditional watermark hidden method utilizes the characteristic of grating, and watermarking images can be hidden in Packaging image；When detection
By choosing the lenticular lenses of specific line width, the level angle of lenticular lenses is adjusted, so that it may quickly show hiding watermark figure
Picture.But traditional lenticular lenses, as shown in Figure 1, only generating variation, the application of watermark to the passability of light in one direction
There is limitation.
Summary of the invention
Technical problem to be solved by the invention is to provide a kind of watermarking images hidden method based on raster grating, in quotient
The hidden addition watermarking images in product packaging area have antiforge function under the premise of not changing packaging external appearance, printing technology,
And special bandwagon effect.
In order to solve the above-mentioned technical problem the present invention uses following technical scheme: the present invention devises a kind of based on grid light
The watermarking images hidden method of grid, for realizing M1*M2 length and width size watermarking images, in (M1*N1) * (M2*N2) length and width size
Hiding in Packaging image, N1, N2 are the integer more than or equal to 2, which is characterized in that watermarking images hidden method includes such as
Lower step:
Step A. carries out rectangular mesh division with its length and wide direction, by p*p size unit block for watermarking images, obtains
A unit watermark block of (M1/p) * (M2/p) is obtained, subsequently into step B；
Step B. carries out rectangle with long and wide direction, by (p*N2) the size unit region (p*N1) * for Packaging image
Grid dividing obtains (M1/p) * (M2/p) a unit area, unit watermark block P on watermarking imagesI, jWith unit on Packaging image
Region QI, jIt corresponds to each other, 1≤i≤(M2/p), i are integer, and 1≤j≤(M1/p), j are integer, PI, jIt indicates on watermarking images
The unit watermark block of i-th row, jth column, QI, jIndicate the unit area of the i-th row on Packaging image, jth column；Subsequently into step C；
Step C. is directed to each unit area on Packaging image respectively, by preset rules or random choosing in unit area
The region for selecting a p*p size, as raster grating to be processed, while obtain the distribution of each unit area on Packaging image,
And in each unit area raster grating to be processed distribution, store to the image that watermark obtains on the Packaging image and catch
It obtains on device, subsequently into step D；
Step D. is directed to each unit watermark block on watermarking images respectively, judges that the average gray value of unit watermark block is
It is no to be less than default gray threshold, be, with the unit watermark block, in unit area on Packaging image corresponding to it wait locate
Reason raster grating is replaced；Otherwise it is directed on Packaging image corresponding to the unit watermark block in unit area, removes net to be processed
Region other than lattice grating, the region for randomly choosing a p*p size carry out noise addition；
After completing the above-mentioned operation for each unit watermark block on watermarking images, i.e. realization watermarking images are in Packaging image
In hide.
As a preferred technical solution of the present invention: the value of the p is 1 pixel to 10 pixels.
As a preferred technical solution of the present invention: the default gray threshold in the step D is 0.95.
The present invention also technical problems to be solved are to provide a kind of for the watermarking images hidden method based on raster grating
Method of detecting watermarks do not change appearance so that being packaged in, printing technology in the addition watermarking images that commodity packaging region is hidden
Under the premise of, there is antiforge function and special bandwagon effect.
In order to solve the above-mentioned technical problem the present invention uses following technical scheme: the technical problem to be solved by the present invention is to
A kind of method of detecting watermarks for the watermarking images hidden method based on raster grating is provided, for for the Packaging image
Packaging image surface, and image capture apparatus work are directed toward in image capture apparatus working end by the image capture apparatus that watermark obtains
Straight line and Packaging image perpendicular where making end optical axis keep image capture apparatus posture and control image capture apparatus
Move back and forth along straight line where its working end optical axis, image capture apparatus is directed to institute's captured image, according to each on Packaging image
The distribution of raster grating to be processed, obtains each unit area in real time in the distribution of a unit area and each unit area
In raster grating pattern to be processed, and by each unit area Packaging image distribution, by captured each grid to be processed
Grating pattern is spliced in real time, when the size and p*p size raster grating to be processed of captured raster grating pattern to be processed
Size at integer ratio relationship when, then the image that image capture apparatus exports in real time, as watermarking images.
As a preferred technical solution of the present invention: described image acquisition equipment includes and is not limited to mobile phone, plate electricity
Brain.
A kind of watermarking images hidden method and method of detecting watermarks based on raster grating of the present invention, using the above skill
Art scheme compared with prior art, has following technical effect that
A kind of watermarking images hidden method based on raster grating of the present invention, uses for reference the principle of lenticular lenses, at two
The passability of light is set all to generate variation raster grating strategy on direction, so that the hiding of watermarking images is more preferable, in addition to can be hidden
It hides outside binary watermarking, Gray-level Watermarking or even color watermark can also be hidden, multiple watermarks can be hidden in a Packaging image
Image has antiforge function and special bandwagon effect under the premise of not changing packaging external appearance, printing technology；Simultaneously also
It is related to method of detecting watermarks, uses image capture apparatus instead and detected, it is known by specific rule arrangement based on image capture apparatus
Grid position information, can rapidly extracting go out hiding watermarking images.
Detailed description of the invention
Fig. 1 be traditional raster piece in a certain direction on so that the passability of light is changed schematic diagram；
Fig. 2 be based on this patent design, Packaging image size be 2*2 times of watermarking images size when raster grating arrangement；
Fig. 3 be based on this patent design, Packaging image size be 3*3 times of watermarking images size when raster grating arrangement；
Fig. 4 is the watermarking images that size is 1180*440 in embodiment；
Fig. 5 is the Packaging image that size is 3540*1320 in embodiment；
Fig. 6 is in embodiment by the Packaging image after watermark hiding when p=4 pixel；
Fig. 7 is the watermarking images that image capture apparatus is extracted from the Packaging image after printing in embodiment.
Specific embodiment
Specific embodiments of the present invention will be described in further detail with reference to the accompanying drawings of the specification.
The present invention devises a kind of watermarking images hidden method based on raster grating, for realizing M1*M2 length and width size
Watermarking images, hiding in (M1*N1) * (M2*N2) length and width size Packaging image, N1, N2 are whole more than or equal to 2
It counts, in watermarking images hidden method practical application, specifically comprises the following steps:
Step A. carries out rectangular mesh division with its length and wide direction, by p*p size unit block for watermarking images, obtains
A unit watermark block of (M1/p) * (M2/p) is obtained, subsequently into step B；In practical application, the value of p is 1 pixel to 10 pictures
Element, the value of p and the resolution ratio of image are related, and general piecemeal is smaller, i.e., p is smaller, then the concealment of watermark is higher, but robustness
It is lower；Piecemeal is bigger, i.e., p is bigger, then the concealment of watermark reduces, but robustness increases.Such as the resolution ratio when Packaging image
When for 1200dpi, in practical application, p=4 can achieve the balance of concealment and robustness.
Step B. carries out rectangle with long and wide direction, by (p*N2) the size unit region (p*N1) * for Packaging image
Grid dividing obtains (M1/p) * (M2/p) a unit area, unit watermark block P on watermarking imagesI, jWith unit on Packaging image
Region QI, jIt corresponds to each other, 1≤i≤(M2/p), i are integer, and 1≤j≤(M1/p), j are integer, PI, jIt indicates on watermarking images
The unit watermark block of i-th row, jth column, QI, jIndicate the unit area of the i-th row on Packaging image, jth column；Subsequently into step C.
Among the above, it is assumed that Packaging image size is 2*2 times or 3*3 times of watermarking images size, then can design corresponding
Raster grating arrangement method it is as shown in Figures 2 and 3, be as shown in Figure 2 Packaging image be 60*60, watermarking images 30*30,
Watermark piecemeal, obtained raster grating arrangement schematic diagram are carried out according to p=6；As shown in Fig. 3 Packaging image is 72*72, water
Watermark image is 24*24, carries out watermark piecemeal, obtained raster grating arrangement schematic diagram according to p=4；The side of raster grating arrangement
Method can there are many kinds of, Fig. 2 and Fig. 3 only show a certain special raster grating arrangement situation.
Step C. is directed to each unit area on Packaging image respectively, by preset rules or random choosing in unit area
The region for selecting a p*p size, as raster grating to be processed, in each region, one and only one p*p size wait locate
Raster grating is managed, while obtaining on Packaging image grid to be processed in the distribution of each unit area and each unit area
The distribution of grating is stored to the image capture apparatus that watermark obtains on the Packaging image, subsequently into step D.
Step D. is directed to each unit watermark block on watermarking images respectively, judges that the average gray value of unit watermark block is
It is no to be less than default gray threshold, be, with the unit watermark block, in unit area on Packaging image corresponding to it wait locate
Reason raster grating is replaced；Otherwise it is directed on Packaging image corresponding to the unit watermark block in unit area, removes net to be processed
Region other than lattice grating, the region for randomly choosing a p*p size carry out noise addition.Here in practical application, for pre-
If gray threshold is set as 0.95.
In above-mentioned steps D, if the average gray value of unit watermark block is less than default gray threshold after specific piecemeal, i.e.,
The unit watermark block contains available gray-scale information, then the unit watermark block is replaced corresponding raster grating position (i.e. Fig. 2 or figure
Black raster grating position in 3) Packaging image；If the average gray value of unit watermark block is not less than default gray scale after piecemeal
When threshold value, i.e., the unit watermark block does not have effective grayscale information, then in corresponding raster grating position outer periphery (p*N1) * (p*
N2 another grid position (i.e. Fig. 2 or Fig. 3 in white grid position) is randomly choosed in region), is replaced with random noise
Packaging image in this position.By taking Fig. 2 as an example, if the average gray value of the first block unit watermark block is less than 0.95,
Abscissa is 1 in Fig. 2, the black raster grating position that ordinate is 1, and unit watermark block is substituted Packaging image, and abscissa
It is 2 for 1 ordinate, abscissa is that 2 ordinates are 1 and abscissa be 2 ordinates is 2, the packaging at these three white grids
Image remains unchanged；And if abscissa is in Fig. 2 when the average gray value of the first block unit watermark block is not less than 0.95
Packaging image remains unchanged at the black raster grating position that 1 ordinate is 1, and be 1 ordinate in abscissa is 2, abscissa
It for 2 ordinates is 1 and abscissa be 2 ordinates is 2, random selection one white grid in these three white grids, with making an uproar
Sound replaces Packaging image；The processing of other piecemeal watermarking images is sequentially carried out by this principle.
After completing the above-mentioned operation for each unit watermark block on watermarking images, i.e. realization watermarking images are in Packaging image
In hide.
Corresponding with the above-mentioned designed watermarking images hidden method based on raster grating, the present invention also further devises
To this method of detecting watermarks, for the image capture apparatus that watermark obtains on the Packaging image, by image capture apparatus
Packaging image surface, and straight line and Packaging image perpendicular where the optical axis of image capture apparatus working end are directed toward in working end,
It keeps image capture apparatus posture and controls image capture apparatus moving back and forth along straight line where the optical axis of its working end, image is caught
Device is obtained for institute's captured image, according in the distribution of unit area each on Packaging image and each unit area to
The distribution for handling raster grating obtains raster grating pattern to be processed in each unit area in real time, and presses each unit area
In the distribution of Packaging image, captured each raster grating pattern to be processed is spliced in real time, when captured net to be processed
When the size of lattice grating pattern and the size of p*p size raster grating to be processed are at integer ratio relationship, then image capture apparatus
The image exported in real time, as watermarking images；In practical application, described image acquisition equipment includes and is not limited to mobile phone, plate
Computer etc..
The advantage that the present invention designs is without anchor point, due to not having anchor point, catches in the image of such as mobile phone
When obtaining device scanning, need constantly to adjust the horizontal position of mobile phone, when mobile phone is in suitable position, the watermark figure of extraction
As the most clear；In practical application, watermarking images can be binary map, grayscale image or cromogram；It is added using different watermarks
Parameter can add several watermarking images in a width Packaging image.The parameter that can be used for adjusting includes: Packaging image and water
Watermark image size N1 and N2, the size p of watermarking images piecemeal, raster grating arrangement is regular, if watermarking images are two-value
Image, and Packaging image is gray scale or color image, then also includes insertion layer position of the watermarking images in Packaging image, print
Brush mode can be Plate making printing, be also possible to digital printing, as long as can satisfy the printing precision of Packaging image.
By above-mentioned designed watermarking images hidden method and method of detecting watermarks based on raster grating, applied to actually working as
In, based on Fig. 4, Fig. 5 watermarking images being respectively shown in and Packaging image and p=4 pixel, i.e. N1=3, N2=3, specifically hold
Row includes the following steps:
Step A. carries out rectangular mesh with its length and wide direction, by 4*4 pixel size units chunk for watermarking images and draws
Point, 295*110=32450 unit watermark block is obtained, subsequently into step B.
Step B. carries out rectangular mesh division with long and wide direction, by 12*12 size unit region for Packaging image,
Obtain 295*110=32450 unit area, unit watermark block P on watermarking imagesI, jWith unit area Q on Packaging imageI, jThat
This is corresponding, and 1≤i≤(M2/4), i are integer, and 1≤j≤(M1/4), j are integer, PI, jIndicate the i-th row, jth on watermarking images
The unit watermark block of column, QI, jIndicate the unit area of the i-th row on Packaging image, jth column；Subsequently into step C.
Step C. is directed to each unit area on Packaging image respectively, by preset rules or random choosing in unit area
The region for selecting a 4*4 size, as raster grating to be processed, while obtain the distribution of each unit area on Packaging image,
And in each unit area raster grating to be processed distribution, store to the image that watermark obtains on the Packaging image and catch
It obtains on device, subsequently into step D.
Step D. is directed to each unit watermark block on watermarking images respectively, judges that the average gray value of unit watermark block is
It is no less than 0.95, be then with the unit watermark block, for the grid light to be processed in unit area on Packaging image corresponding to it
Grid are replaced；Otherwise in unit area on Packaging image corresponding to the unit watermark block, except raster grating to be processed with
Outer region, the region for randomly choosing a 4*4 size carry out noise addition.
After completing the above-mentioned operation for each unit watermark block on watermarking images, i.e. realization watermarking images are in Packaging image
In hide, generate the Packaging image as shown in FIG. 6 for concealing watermarking images, then according to normal printing technology carry out
Production.
It is hidden by the watermarking images based on raster grating are directed to designed by the present invention to the Packaging image for pressing above-mentioned addition watermark
The method of detecting watermarks of hiding method extracts watermarking images, as shown in Figure 7.
A kind of watermarking images hidden method based on raster grating, uses for reference the original of lenticular lenses designed by above-mentioned technical proposal
Reason makes the passability of light all generate variation raster grating strategy in two directions and removes so that the hiding of watermarking images is more preferable
It can hide outside binary watermarking, Gray-level Watermarking or even color watermark can also be hidden, can be hidden in a Packaging image
Multiple watermarking images, under the premise of not changing packaging external appearance, printing technology, with antiforge function and special displaying effect
Fruit；Method of detecting watermarks is also related to, image capture apparatus is used instead and is detected, it is known by specific based on image capture apparatus
The grid position information of rule arrangement, can rapidly extracting go out hiding watermarking images.
Embodiments of the present invention are explained in detail above in conjunction with attached drawing, but the present invention is not limited to above-mentioned implementations
Mode within the knowledge of a person skilled in the art can also be without departing from the purpose of the present invention
It makes a variety of changes.
Claims (5)
1. a kind of watermarking images hidden method based on raster grating, for realizing M1*M2 length and width size watermarking images, in (M1*
N1) hiding in * (M2*N2) length and width size Packaging image, N1, N2 are the integer more than or equal to 2, which is characterized in that water
Watermark image hidden method includes the following steps:
Step A. carries out rectangular mesh division with its length and wide direction, by p*p size unit block for watermarking images, obtains
(M1/p) a unit watermark block of * (M2/p), subsequently into step B；
Step B. carries out rectangular mesh with long and wide direction, by (p*N2) the size unit region (p*N1) * for Packaging image
It divides, obtains (M1/p) * (M2/p) a unit area, unit watermark block P on watermarking imagesI, jWith unit area on Packaging image
QI, jIt corresponds to each other, 1≤i≤(M2/p), i are integer, and 1≤j≤(M1/p), j are integer, PI, jIt indicates i-th on watermarking images
The unit watermark block of row, jth column, QI, jIndicate the unit area of the i-th row on Packaging image, jth column；Subsequently into step C；
Step C. is directed to each unit area on Packaging image respectively, by preset rules or random selection one in unit area
The region of a p*p size, as raster grating to be processed, while obtain on Packaging image the distribution of each unit area and
The distribution of raster grating to be processed in each unit area is stored to the image capture dress that watermark obtains on the Packaging image
It sets, subsequently into step D；
Step D. is directed to each unit watermark block on watermarking images respectively, judges whether the average gray value of unit watermark block is small
It is then with the unit watermark block, for the net to be processed in unit area on Packaging image corresponding to it in default gray threshold
Lattice grating is replaced；Otherwise it is directed on Packaging image corresponding to the unit watermark block in unit area, removes grid light to be processed
Region other than grid, the region for randomly choosing a p*p size carry out noise addition；
After completing the above-mentioned operation for each unit watermark block on watermarking images, i.e. realization watermarking images are in Packaging image
It hides.
2. a kind of watermarking images hidden method based on raster grating according to claim 1, it is characterised in that: the p's
Value is 1 pixel to 10 pixels.
3. a kind of watermarking images hidden method based on raster grating according to claim 1, it is characterised in that: the step
Default gray threshold in D is 0.95.
4. a kind of method of detecting watermarks for a kind of watermarking images hidden method based on raster grating described in claim 1,
It is characterized by:
For the image capture apparatus that watermark obtains on the Packaging image, packaging figure is directed toward in image capture apparatus working end
Image surface, and straight line and Packaging image perpendicular where the optical axis of image capture apparatus working end, keep image capture apparatus
Posture simultaneously controls image capture apparatus and moves back and forth along straight line where the optical axis of its working end, and image capture apparatus is for being captured
Image, according to raster grating to be processed in the distribution of unit area each on Packaging image and each unit area point
Cloth, obtains raster grating pattern to be processed in each unit area in real time, and by each unit area Packaging image distribution,
Captured each raster grating pattern to be processed is spliced in real time, when captured raster grating pattern to be processed size with
When the size of p*p size raster grating to be processed is at integer ratio relationship, then the image that image capture apparatus exports in real time, as
Watermarking images.
5. a kind of method of detecting watermarks of the watermarking images hidden method based on raster grating according to claim 4, special
Sign is: described image acquisition equipment includes and is not limited to mobile phone, tablet computer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079065.2A CN109903211B (en) | 2019-01-28 | 2019-01-28 | Watermark image hiding method and watermark detection method based on grid grating |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079065.2A CN109903211B (en) | 2019-01-28 | 2019-01-28 | Watermark image hiding method and watermark detection method based on grid grating |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109903211A true CN109903211A (en) | 2019-06-18 |
| CN109903211B CN109903211B (en) | 2020-07-07 |
Family
ID=66944265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910079065.2A Active CN109903211B (en) | 2019-01-28 | 2019-01-28 | Watermark image hiding method and watermark detection method based on grid grating |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109903211B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016099441A1 (en) * | 2014-12-15 | 2016-06-23 | Hewlett-Packard Development Company, L.P. | Grid-based watermark |
| CN105992072A (en) * | 2015-07-24 | 2016-10-05 | 乐视云计算有限公司 | Watermark processing method, watermark extracting method and corresponding devices |
| CN107563966A (en) * | 2017-08-01 | 2018-01-09 | 北京诺君安信息技术股份有限公司 | A kind of Quick Response Code and image interfusion method and Quick Response Code |
-
2019
- 2019-01-28 CN CN201910079065.2A patent/CN109903211B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016099441A1 (en) * | 2014-12-15 | 2016-06-23 | Hewlett-Packard Development Company, L.P. | Grid-based watermark |
| CN105992072A (en) * | 2015-07-24 | 2016-10-05 | 乐视云计算有限公司 | Watermark processing method, watermark extracting method and corresponding devices |
| CN107563966A (en) * | 2017-08-01 | 2018-01-09 | 北京诺君安信息技术股份有限公司 | A kind of Quick Response Code and image interfusion method and Quick Response Code |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109903211B (en) | 2020-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108352083B (en) | 2D image processing for stretching into 3D objects | |
| CN1954339B (en) | Methods and systems for converting images from low dynamic range to high dynamic range | |
| TWI459324B (en) | Modifying color and panchromatic channel cfa image | |
| US20120075432A1 (en) | Image capture using three-dimensional reconstruction | |
| KR102234606B1 (en) | Data transmission using optical codes | |
| Khanna et al. | Scanner identification using feature-based processing and analysis | |
| US9961231B2 (en) | Image processing method that attempts decoding of additional information using a plurality of decoding methods, and apparatus therefor | |
| CN106313918A (en) | Image processing apparatus and image processing method | |
| US20080247649A1 (en) | Methods For Silhouette Extraction | |
| CN107154050A (en) | A kind of automatic obtaining method of the stone material geometric parameter based on machine vision | |
| CN111028165B (en) | High-dynamic image recovery method for resisting camera shake based on RAW data | |
| CN109461186A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN112184591A (en) | Image restoration method based on deep learning image Moire elimination | |
| WO2019198570A1 (en) | Video generation device, video generation method, program, and data structure | |
| CN103996023A (en) | Light field face recognition method based on depth belief network | |
| KR20180123990A (en) | Device for capturing imprints | |
| CN101312494B (en) | Method for computing camera response curve and synthesizing image with large dynamic range and apparatus therefor | |
| CN105338214A (en) | Image processing method and image processing device | |
| Hong et al. | Near-infrared image guided reflection removal | |
| CN105787995A (en) | Method for processing plane figure image | |
| JP3833993B2 (en) | Method and apparatus for binarizing color document image | |
| CN109493293A (en) | A kind of image processing method and device, display equipment | |
| CN109191398A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN106327416A (en) | Screen dot watermark method based on printed product | |
| CN109903211A (en) | A kind of watermarking images hidden method and method of detecting watermarks based on raster grating |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |