CN104539954A - Cascading method for speeding up high efficiency video coding (HEVC) - Google Patents
Cascading method for speeding up high efficiency video coding (HEVC) Download PDFInfo
- Publication number
- CN104539954A CN104539954A CN201410719598.XA CN201410719598A CN104539954A CN 104539954 A CN104539954 A CN 104539954A CN 201410719598 A CN201410719598 A CN 201410719598A CN 104539954 A CN104539954 A CN 104539954A
- Authority
- CN
- China
- Prior art keywords
- hevc
- pattern
- patterns
- avc
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a cascading method for speeding up high efficiency video coding (HEVC). The cascading method comprises the steps of precoding a current frame and a HEVC reestablished frame by H.264/AVC, and picking out a video macroblock partition result from a precoding result; then mapping the macroblock partition result of the H.264 to a possible mode set of the HEVC through a mode mapping; and finally, searching the best mode of the HEVC in the set by rate distortion optimization. Compared with prior art, the innovative cascading method for speeding up HEVC can greatly simplify the mode searching process of HEVC, and has good application prospect.
Description
Technical field
The present invention relates to a kind of method that HEVC pattern selects field fast, specifically a kind of Cascade H .264 and HEVC encoder accelerate the method for HEVC coding.
Background technology
HEVC is the abbreviation of efficient video coding standard, it is the video encoding standard of new generation after H.264/AVC, the integration and cooperation Video coding group (JCT-VC be made up of the MPEG of VCEG and ISO/IEC of ITU-T, Joint Collaborative Team on Video Coding) formulate, issue at the beginning of 2013.HEVC have employed block-based hybrid encoding frame, and it mainly includes infra-frame prediction, inter prediction, conversion and quantification, entropy code, inverse quantization and the technology such as inverse transformation and loop filtering.Compared with traditional coding framework, HEVC have employed the new technologies such as quadtree coding block division flexibly, bulk prediction and conversion, polytype prediction block and transform block, adaptive motion parameter coding and adaptive loop filter.These new coding techniquess improve the coding efficiency of HEVC effectively, but have also been introduced great amount of calculation, are not suitable for actual application.
In the mode selection processes of HEVC, the combination of the model method of standard be exhaustive all possible coding unit, predicting unit and converter unit, and calculate minimum rate distortion to select optimum coding mode.This method consumes a large amount of calculating, and in the end those prove it is not in optimum pattern, so in order to advance the key point of HEVC development and practical application, improving its mode selecting method and being necessary under the prerequisite of performance keeping HEVC Video coding.In general the improvement of model selection be utilize coding unit, the Time and place redundancy that exists between predicting unit and change of scale realizes.The existence of this redundancy has crypticity, needs constantly to go to excavate, and the Optimal improvements of mode selecting method should possess important realistic meaning for the actual of HEVC.
Summary of the invention
For the deficiencies in the prior art, the invention provides a kind of Cascading Methods accelerating HEVC coding rate, adopt the framework of brand-new encoder in order to solve the quick select permeability of HEVC pattern, H.264/AVC macroblock partitions result and possible CU (coding unit) model selection of HEVC are assembled altogether by the method for mode map, the fast mode decision problem for HEVC provides a kind of brand-new thinking.
For achieving the above object, the present invention is by the following technical solutions: the framework mode that the present invention devises a kind of new encoder is used for accelerating the coding rate of HEVC, that is: first use and H.264/AVC precoding is carried out to the reconstruction frames of present frame and HEVC, from pre-encoding results, extract the macroblock partitions result of video; Then by mode map, macroblock partitions result is H.264 mapped as the possible set of patterns of HEVC; The optimal mode of last utilization rate aberration optimizing search HEVC in this set.
The Cascading Methods of acceleration HEVC coding rate of the present invention, the method includes the steps of:
Step 1, carries out precoding to present frame, obtains optimum macroblock partitions;
First H.264 encoder is utilized to carry out to incoming frame the optimum macroblock partitions result that precoding obtains this frame.In precoding process, the framework of encoder adopts hybrid encoding frame H.264/AVC, and input parameter is the reconstruction frames of present frame and HEVC, and the reconstruction frames of HEVC will by the reference frame as present frame for estimation and macroblock partitions.
H.264/AVC optimum macroblock partitions is mapped as HEVC set of patterns by step 2.
The optimum by the method mapped the result of the optimum macroblock partitions H.264/AVC obtained being mapped as HEVC may set of patterns.For the CU of different size, take different mode map strategies to select most suitable CU set of patterns;
B.64 × 64 layers
For the CU of 64 × 64, only use the predictive mode of SKIP and 2N × 2N, because experiment proves only to use these two kinds of patterns very micro-for the performance impact of encoder, but the very big complexity decreasing encoder.
C.32x32 layer
For 32 × 32 layers, CU is divided into five kinds of different types according to the type of the MB of four in this CU, for the CU of every type, all devises different mapping relations to ensure possible the set of patterns optimum mapped.The pattern of five kinds of CU is as follows with the mapping of its correspondence:
A), when to comprise 3 or 4 patterns in current C U be MB (macro block) of Inter16 × 16, Inter2N × 2N pattern of current C U is only detected.
B), when the pattern of two MB in the left side is Inter16 × 16 in current C U, Inter2N × 2N and Inter2N × N pattern of current C U is only detected.
C), when the pattern of two MB in the right is Inter16 × 16 in current C U, Inter2N × 2N and InterN × 2N pattern of current C U is only detected.
When the pattern of four MB d) in current C U is Intra16 × 16, only detect Intra2N × 2N pattern of current C U.
E) for other situations, all patterns all will be detected to judge the optimal predictive mode of current C U.
D.16 × 16 and 8 × 8 layers
For the CU of 16 × 16 and 8 × 8, the present invention takes different mapping relations to obtain optimal PU collection.Wherein for 16 × 16 and 8 × 8 CU, take following mapping relations respectively:
A) for 16 × 16 CU, SKIP mode map is H.264/AVC the SKIP/Merge pattern of HEVC; 16 × 16 mode map are 2N × 2N and SKIP/Merge pattern; H.264/AVC 16 × 8 and 8 × 16 respectively SKIP/Merge, 2N × 2N of corresponding HEVC and left and right/rectangle and the asymmetric partition modes up and down of correspondence; Will detect all patterns except Intra and N × N pattern for 8 × 8, HEVC, for the Intra pattern in H.264/AVC, HEVC will detect all patterns.
B) for 8 × 8 CU, SKIP mode map is H.264/AVC the SKIP/Merge pattern of HEVC; 16 × 16 mode map are 2N × 2N and SKIP/Merge pattern; H.264/AVC 16 × 8 and 8 × 16 respectively SKIP/Merge, 2N × 2N of corresponding HEVC and left and right/rectangle and the asymmetric partition modes up and down of correspondence; Will detect all patterns except Intra pattern for 8 × 8, HEVC, for the Intra pattern in H.264/AVC, HEVC will detect all patterns.
Step 3. uses HEVC encoder to carry out the PU set of patterns of the different size CU of Ergodic Maps, and utilance aberration optimizing obtains best CU and PU pattern.
Compared with prior art, the present invention has following beneficial effect:
The present invention uses and H.264/AVC carries out precoding to obtain the macroblock partitions result of present frame; By the method for mode map, division result is H.264/AVC mapped as the CU set of patterns of HEVC; Finally utilize HEVC rate-distortion optimization from set of patterns, select optimum CU and PU (predicting unit) pattern.The present invention reduces the set of patterns of the needs search of HEVC by the method for mode map, accelerate the coding rate of HEVC, make use of ripe H.264/AVC encoder simultaneously, have a good application prospect.
Accompanying drawing explanation
By reading the detailed description done non-limiting example with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:
Fig. 1 is four kinds of different CU (32 × 32) type schematic diagrames;
Fig. 2 is that use is for accelerating the cascade of HEVC coding rate encoder block diagram H.264/AVC;
Fig. 3 is the illustration in the invention process process.
Embodiment
Below in conjunction with specific embodiment, the present invention is described in detail.Following examples will contribute to those skilled in the art and understand the present invention further, but not limit the present invention in any form.It should be pointed out that to those skilled in the art, without departing from the inventive concept of the premise, some distortion and improvement can also be made.These all belong to protection scope of the present invention.
The application of HEVC coding rate is being accelerated to describe herein in conjunction with the present invention, specifically say the framework of the cascaded encoder that the present invention builds, the mode map H.264/AVC and between HEVC is applied in the cataloged procedure of HEVC, concrete block diagram is as shown in Figure 1: first introduce the step utilizing and H.264/AVC carry out precoding, then the mode map method of different CU size will be introduced in detail on this basis, the system of selection of last HEVC optimization model.
Step 1, carries out precoding to present frame, obtains optimum macroblock partitions;
HEVC and coding framework are H.264/AVC hybrid encoding frame, and after development for many years, H.264/AVC obtained significant progress, have done a lot of outstanding work in codec optimization.So first we utilize H.264 encoder to carry out to incoming frame the optimum macroblock partitions result that precoding obtains this frame in the present invention.In precoding process, the framework of encoder adopts hybrid encoding frame H.264/AVC, and input parameter is the reconstruction frames of present frame and HEVC, and the reconstruction frames of HEVC will by the reference frame as present frame.
H.264/AVC optimum macroblock partitions is mapped as HEVC set of patterns by step 2.;
HEVC, in order to improve code efficiency, adopts the code tree unit (CTU) based on adative quadtree structure, instead of H.264 based on the coding unit of macro block.In HEVC, the size of CTU is 64 × 64, and iteratively can carry out four points adaptively, until SCU (smallest coding unit), the size of SCU is 8 × 8.And in H.264/AVC, the size of macro block (MB) can be 16 × 16,8 × 8,4 × 4.In H.264/AVC, inter prediction encoding only supports 7 kinds of macroblock partition patterns: 16 × 16,16 × 8,8 × 16,8 × 8,8 × 4,4 × 8 and 4 × 4, and HEVC not only supports the Fractionation regimen of these symmetries, be called 2N × 2N, 2N × N and N × 2N, but also support asymmetrical Fractionation regimen, be called: 2N × nU, 2N × nD, nL × 2N and nR × 2N.Compare the coding unit H.264 fixing macroblock size, HEVC is more flexible to the division of coded image, thus provides better video image quality, and this otherness also directly results in the high complexity H.264 arriving HEVC transcoding.
In the present invention, by the method mapped, the result of the optimum macroblock partitions H.264/AVC obtained is mapped as the possible optimization model collection of HEVC, for the CU of different layers, selects different mapping methods to obtain optimum result;
A.64 × 64 layers
For the CU of 64 × 64, we only use the predictive mode of SKIP and 2N × 2N, because experiment proves only to use these two kinds of patterns very micro-for the performance impact of encoder, but the very big complexity decreasing encoder.
B.32x32 layer
For 32 × 32 layers, CU to be divided into five kinds of different types according to the type of the MB of four in this CU by us, and for the CU of every type, we can have different mapping relations with in order to be effective optimum.The pattern of five kinds of CU is as follows with the mapping of its correspondence:
A), when to comprise 3 or 4 patterns in current C U be the MB of Inter16 × 16, we only detect Inter2N × 2N pattern of current C U.
B), when in current C U, the pattern of two MB in the left side is Inter16 × 16, we only detect Inter2N × 2N and Inter2N × N pattern of current C U.
C), when in current C U, the pattern of two MB in the right is Inter16 × 16, we only detect Inter2N × 2N and InterN × 2N pattern of current C U.
When the pattern of four MB d) in current C U is Intra16 × 16, we only detect Intra2N × 2N pattern of current C U.
E) for other situations, all patterns all will be detected to judge the optimal predictive mode of current C U.
C.16 × 16 and 8 × 8 layers
For the CU of 16 × 16 and 8 × 8, the present invention takes different mapping relations to obtain optimal PU collection.Concrete mapped mode is as shown in table one and table two:
Table one: the mapping relations table (16 × 16) between MB and CU
Table two: the mapping relations table (8 × 8) between MB and CU
Step 3. is after the optimum possibility set of patterns obtaining HEVC, and use HEVC encoder to carry out the PU set of patterns of the different size CU of Ergodic Maps, calculate the rate distortion costs of different mode, utilance aberration optimizing determines best CU and PU pattern.
Following table three is the present invention's operation results in X265.X265 is exsertile one of the encoder of increasing income of current HEVC, and x265 supports HEVC standard completely and carried out deep optimization in many aspects.Select x264 to carry out the precoding of present frame as H.264/AVC encoder, X264 is the classic H.264/AVC encoder of increasing income of current performance simultaneously.
Use the mode map method process of cascaded encoder of the present invention cycle tests collection, experimental result shows method of the present invention can map out optimum possible set of patterns, efficiency also has good lifting, accelerates the coding rate of HEVC.Table three gives the performance of method of the present invention for different cycle tests and the change of time.
Table three: based on the experimental result of X265 and X264
When the inventive method is used for HEVC coding, effectively can utilize macroblock partitions result H.264/AVC, and macroblock partitions result is mapped as the possible set of patterns of the CU model selection that can be used for HEVC, reduce calculative CU and PU pattern, reach and accelerate HEVC coding object.
The above is only the preferred embodiment of the present invention, and protection scope of the present invention is not only confined to above-described embodiment, and all technical schemes belonged under thinking of the present invention all belong to protection category of the present invention.It should be pointed out that for those skilled in the art, some improvements and modifications without departing from the principles of the present invention, these improvements and modifications also all should be considered as protection scope of the present invention.
Claims (4)
1. accelerate Cascading Methods for HEVC coding rate, it is characterized in that described method comprises the steps:
Step 1, carries out precoding to incoming frame, obtains optimum macroblock partitions result;
First H.264 encoder is utilized to carry out to incoming frame the optimum macroblock partitions result that precoding obtains this frame, in precoding process, the framework of encoder adopts hybrid encoding frame H.264/AVC, input parameter is the reconstruction frames of present frame and HEVC, and the reconstruction frames of HEVC will by the reference frame as present frame;
Step 2, is mapped as HEVC set of patterns by optimum macroblock partitions H.264/AVC;
The optimum by the method mapped the result of the optimum macroblock partitions H.264/AVC obtained being mapped as HEVC may set of patterns; For the CU of different size, different mapped modes is taked to obtain the set of patterns of HEVC respectively respectively:
A.64 × 64 layers
For the CU of 64 × 64, only use the predictive mode of SKIP and 2N × 2N;
B.32x32 layer
For 32 × 32 layers, CU is divided into five kinds of different types according to the type of the MB of four in this CU, for the CU of every type, designs different mapping relations to ensure that the set mapping out meets most the feature of this CU;
C.16 × 16 and 8 × 8 layers
For the CU of 16 × 16 and 8 × 8, take different mapping relations respectively to obtain optimum PU set of patterns;
Step 3, use HEVC encoder to carry out the PU set of patterns of the different size CU of Ergodic Maps, utilance aberration optimizing obtains best CU and PU pattern.
2. a kind of Cascading Methods accelerating HEVC coding according to claim 1, is characterized in that in the B described in step 2: the pattern of five kinds of CU is as follows with the mapping of its correspondence:
A), when to comprise 3 or 4 patterns in current C U be the MB of Inter16 × 16, Inter2N × 2N pattern of current C U is only detected;
B), when the pattern of two MB in the left side is Inter16 × 16 in current C U, Inter2N × 2N and Inter2N × N pattern of current C U is only detected;
C), when the pattern of two MB in the right is Inter16 × 16 in current C U, Inter2N × 2N and InterN × 2N pattern of current C U is only detected;
When the pattern of four MB d) in current C U is Intra16 × 16, only detect Intra2N × 2N pattern of current C U;
E) for other situations, all patterns all will be detected to judge the optimal predictive mode of current C U.
3. a kind of Cascading Methods accelerating HEVC coding according to claim 1 and 2, is characterized in that in C described in step 2:
For the CU of 16 × 16 and 8 × 8, take different mapping relations to obtain optimal PU collection, concrete mapped mode is:
A) for 16 × 16 CU, SKIP mode map is H.264/AVC the SKIP/Merge pattern of HEVC; 16 × 16 mode map are 2N × 2N and SKIP/Merge pattern; H.264/AVC 16 × 8 and 8 × 16 respectively SKIP/Merge, 2N × 2N of corresponding HEVC and left and right/rectangle and the asymmetric partition modes up and down of correspondence; Will detect all patterns except Intra and N × N pattern for 8 × 8, HEVC, for the Intra pattern in H.264/AVC, HEVC will detect all patterns;
B) for 8 × 8 CU, SKIP mode map is H.264/AVC the SKIP/Merge pattern of HEVC; 16 × 16 mode map are 2N × 2N and SKIP/Merge pattern; H.264/AVC 16 × 8 and 8 × 16 respectively SKIP/Merge, 2N × 2N of corresponding HEVC and left and right/rectangle and the asymmetric partition modes up and down of correspondence; Will detect all patterns except Intra pattern for 8 × 8, HEVC, for the Intra pattern in H.264/AVC, HEVC will detect all patterns.
4. a kind of Cascading Methods accelerating HEVC coding according to any one of claim 1-3, when it is characterized in that described method is encoded for HEVC, effectively can utilize macroblock partitions result H.264/AVC, and macroblock partitions result is mapped as the possible set of patterns of the CU model selection that can be used for HEVC, reduce calculative CU and PU pattern, reach and accelerate HEVC coding object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410719598.XA CN104539954B (en) | 2014-12-01 | 2014-12-01 | A kind of Cascading Methods of acceleration HEVC coding rates |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410719598.XA CN104539954B (en) | 2014-12-01 | 2014-12-01 | A kind of Cascading Methods of acceleration HEVC coding rates |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104539954A true CN104539954A (en) | 2015-04-22 |
| CN104539954B CN104539954B (en) | 2017-12-15 |
Family
ID=52855408
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410719598.XA Active CN104539954B (en) | 2014-12-01 | 2014-12-01 | A kind of Cascading Methods of acceleration HEVC coding rates |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104539954B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105872564A (en) * | 2016-05-27 | 2016-08-17 | 武汉拓宝科技股份有限公司 | Intra-frame prediction mode determination method and system for transcoding from H.264/AVC to H.265/HEVC |
| CN107690069A (en) * | 2017-08-28 | 2018-02-13 | 中国科学院深圳先进技术研究院 | A kind of cascade method for video coding of data-driven |
| CN108012154A (en) * | 2016-10-28 | 2018-05-08 | 北京金山云网络技术有限公司 | A kind of method for video coding and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248893A (en) * | 2013-05-10 | 2013-08-14 | 四川大学 | Method for quick inter-frame transcoding from H. 264/AVC standard to HEVC standard and transcoder thereof |
| CN103442228A (en) * | 2013-08-19 | 2013-12-11 | 四川大学 | Quick frame inner transcoding method from H.264/AVC standard to HEVC standard and transcoder thereof |
| CN103475880A (en) * | 2013-09-11 | 2013-12-25 | 浙江大学 | Method for low-complexity video transcoding from H.264 to HEVC based on statistic analysis |
| CN103491334A (en) * | 2013-09-11 | 2014-01-01 | 浙江大学 | Video transcode method from H264 to HEVC based on region feature analysis |
| CN103796023A (en) * | 2014-03-05 | 2014-05-14 | 武汉拓宝电子系统有限公司 | H.265/HEVC transcoding method and transcoder based on H.264/AVC macro block structure and texture |
-
2014
- 2014-12-01 CN CN201410719598.XA patent/CN104539954B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248893A (en) * | 2013-05-10 | 2013-08-14 | 四川大学 | Method for quick inter-frame transcoding from H. 264/AVC standard to HEVC standard and transcoder thereof |
| CN103442228A (en) * | 2013-08-19 | 2013-12-11 | 四川大学 | Quick frame inner transcoding method from H.264/AVC standard to HEVC standard and transcoder thereof |
| CN103475880A (en) * | 2013-09-11 | 2013-12-25 | 浙江大学 | Method for low-complexity video transcoding from H.264 to HEVC based on statistic analysis |
| CN103491334A (en) * | 2013-09-11 | 2014-01-01 | 浙江大学 | Video transcode method from H264 to HEVC based on region feature analysis |
| CN103796023A (en) * | 2014-03-05 | 2014-05-14 | 武汉拓宝电子系统有限公司 | H.265/HEVC transcoding method and transcoder based on H.264/AVC macro block structure and texture |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105872564A (en) * | 2016-05-27 | 2016-08-17 | 武汉拓宝科技股份有限公司 | Intra-frame prediction mode determination method and system for transcoding from H.264/AVC to H.265/HEVC |
| CN105872564B (en) * | 2016-05-27 | 2019-02-19 | 武汉拓宝科技股份有限公司 | H.264/AVC the intra prediction mode determining method and system of H.265/HEVC transcoding are arrived |
| CN108012154A (en) * | 2016-10-28 | 2018-05-08 | 北京金山云网络技术有限公司 | A kind of method for video coding and device |
| CN107690069A (en) * | 2017-08-28 | 2018-02-13 | 中国科学院深圳先进技术研究院 | A kind of cascade method for video coding of data-driven |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104539954B (en) | 2017-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Tang et al. | Adaptive CU split decision with pooling-variable CNN for VVC intra encoding | |
| CN103763570B (en) | Rapid HEVC intra-frame prediction method based on SATD | |
| CN103561263B (en) | Based on motion vector constraint and the motion prediction compensation method of weighted motion vector | |
| CN103096067B (en) | The method for producing reconstructed blocks | |
| CN102648631B (en) | For the method and apparatus of coding/decoding high-definition picture | |
| CN105959699B (en) | A kind of quick inter-frame prediction method based on estimation and time-space domain correlation | |
| CN110087087A (en) | VVC interframe encode unit prediction mode shifts to an earlier date decision and block divides and shifts to an earlier date terminating method | |
| CN104796693A (en) | Rapid HEVC CU deep partition coding method | |
| CN103491334B (en) | Video transcode method from H264 to HEVC based on region feature analysis | |
| CN103533355B (en) | A kind of HEVC fast encoding method | |
| CN103997645B (en) | Quick HEVC intra-frame coding unit and pattern decision method | |
| CN103813178B (en) | Rapid high efficiency video coding (HEVC) method based on depth and space-time relevancy of coding units | |
| CN103051892B (en) | Embedded loop filter method and embedded loop filter | |
| CN104038764A (en) | H.264-to-H.265 video transcoding method and transcoder | |
| CN105681808A (en) | Rapid decision-making method for SCC interframe coding unit mode | |
| CN110351552B (en) | Fast coding method in video coding | |
| CN104539970A (en) | 3D-HEVC interframe coding merge mode fast decision making method | |
| CN104954787B (en) | HEVC inter-frame forecast mode selection methods and device | |
| CN110351557A (en) | A kind of quick interframe prediction encoding method in Video coding | |
| CN110365975A (en) | A kind of AVS2 video encoding and decoding standard prioritization scheme | |
| CN103888763A (en) | Intra-frame coding method based on HEVC | |
| CN104581152A (en) | HEVC intra-frame prediction mode decision accelerating method | |
| CN104883566A (en) | Rapid algorithm suitable for intra-frame prediction block size division of HEVC standard | |
| CN104539954A (en) | Cascading method for speeding up high efficiency video coding (HEVC) | |
| CN109302616A (en) | A kind of HEVC Inter Prediction High-speed Algorithm based on RC prediction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |