CN102148985B - Video decoder - Google Patents
Video decoder Download PDFInfo
- Publication number
- CN102148985B CN102148985B CN 201010114293 CN201010114293A CN102148985B CN 102148985 B CN102148985 B CN 102148985B CN 201010114293 CN201010114293 CN 201010114293 CN 201010114293 A CN201010114293 A CN 201010114293A CN 102148985 B CN102148985 B CN 102148985B
- Authority
- CN
- China
- Prior art keywords
- video signal
- error
- data
- signal data
- visual information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a video decoder, which comprises an error checking unit and a decoding unit, wherein the error checking unit checks an error state in video data and generates error information; then the decoding unit selectively executes an error concealing program and a decoding program on the video signal according to the error information. The video decoder can execute error checking, error concealing and video decoding program on the video data.
Description
Technical field
The present invention relates to a kind of visual information decoding apparatus, particularly relate to and a kind ofly have the error checking unit so that the visual information decoding apparatus of the auxiliary decoding video signal data of an error message to be provided.
Background technology
Existing visual information decoding apparatus is that error checking, error concealing and video decoding program with video signal data is implemented in single circuit function unit.Yet, because existing visual information decoding apparatus is with same circuit function unit, video signal data sequentially to be carried out error checking, error concealing and translator, therefore can't processes simultaneously many images (PICTURE) and cause decoding efficiency low.
In addition; if the single circuit functional unit in existing visual information decoding apparatus makes a mistake in the process of execution error inspection, error concealing and video decoding program; often can affect in the lump the decoding effect to follow-up video signal data, what is more, cause the deadlock of visual information decoding apparatus.On the other hand, the required functional item that possesses of the single circuit functional unit of existing code translator is more, therefore, also has been subject to the limitation of suitable program on the elasticity that complexity and the circuit function of circuit design are changed.
In view of this, can process error checking to the part image data if can propose a kind of modular visual information decoding apparatus, simultaneously the image data of other part is processed the program of error concealing and video decoding, can be improved the efficient of image decoding, and have the elasticity in design concurrently.
Summary of the invention
A purpose of the present invention is to propose a kind of modular visual information decoding apparatus, in order to video signal data execution error inspection, error concealing and video decoding program.
Propose a kind of visual information decoding apparatus in one embodiment of the invention, in order to decoding one video signal data, this device comprises:
One error checking unit produces an error message in order to the error condition according to this video signal data, and wherein this error message is associated with the macro zone block numbering that makes a mistake; And
One decoding unit, its electrical couplings is in the error checking unit, in order to optionally video signal data is carried out an error concealing program and a translator according to error message, wherein this error concealing program according to wherein coded format and this error message of a coding stratum of this video signal data, is replaced misdata in this video signal data with an alternate data.
Description of drawings
Fig. 1 shows existing image data and forms stratum.
Fig. 2 shows the visual information decoding apparatus that one embodiment of the invention proposes.
The reference numeral explanation
Visual information decoding apparatus 10
Embodiment
Fig. 1 shows existing image data and forms stratum, and wherein the form of this image data is the MPEG4 compression standard.As shown in the figure, MPEG4 has defined several layers of different video coding stratum, wherein includes: video signal object sequence (VISUAL OBJECT SEQUENCE is referred to as VOS), but include the video signal object of all complete video pictures.Next be video signal object (VISUALOBJECT is referred to as VO), representative one of them object in a picture.As for be a video signal object layer (VISUAL OBJECT LAYER under the video signal object, referred to as VOL), in order to determine whether the video signal object is carried out extending (SCALABLE) coding mode or not extending (NON-SCALABLE) coding mode.The above video signal object sequence, video signal object, and the coded data that comprises in the video signal object layer are all images data that are applied in video signal data in the coding stratum of MPEG4.A video signal object plane (VISUAL OBJECTPLANE under the video signal object layer, referred to as VOP), it is the sample of video signal object on a time point, include mobile (MOTION), shape (SHAPE), and the information of image texture (TEXTURE).The coded data that comprises in the video signal object plane is to be applied to video signal data single view data wherein in the coding stratum of MPEG4.It is a video signal grouping (VIDEO PACKET) under the video signal object plane, it comprises an integer macro zone block (MACROBLOCK, be called for short MB), and the coded data that comprises of video signal grouping is applied to a plurality of macro zone blocks in single view data in the coding stratum of MPEG4.Can comprise four luma blocks (LUMINANCE BLOCK) and two the chroma blocks (CHROMINANCE BLOCK) that do not show in Fig. 1 in each macro zone block.
MPEG4 is for fear of the error of transmission of video signal data, the instrument of four kinds of anti-wrong formulas (ERROR-RESILIENCE) coding also is provided, be respectively: sync mark again (RESYNCHRONIZATION MARKER), Data Segmentation (DATA PARTITION), reversible variable length code (REVERSE VARIABLE LENGTH CODING, be called for short RVLC), and header extending codes (HEADER EXTENDED CODE is called for short HEC).Wherein, then sync mark is to make when making a mistake between decoding end and coding side, still can recover synchronous; Data Segmentation be data placement with different attribute in diverse location, the influence degree when making a mistake with minimizing; Reversible variable length code is by adding some specific prefixes (PREFIX) and suffix (SUFFIX), makes the data can reverse decoding and realize reducing wrong purpose; The header extending codes separately has the header of a backup available in order to indicate the video signal grouping.
Fig. 2 shows the visual information decoding apparatus 10 that one embodiment of the invention proposes.Visual information decoding apparatus 10 comprises error checking unit 101 and decoding unit 102, in order to decoding one video signal data.When visual information decoding apparatus 10 receives this video signal data, error checking unit 101 is according to the error condition of this video signal data and produce an error message.Wherein, error checking unit 101 error condition that video signal data is common is classified; For example, the video coding stratum according to the video signal compression standard is categorized as error condition: the coded data mistake of all images data, the coded data mistake of single image data in video signal data, or the coded data mistake of macro zone block etc.In addition, error checking unit 101 also can comprise the anti-miscoding instrument of distinguishing whether this video signal data adopts the video signal compression standard to provide, to determine whether to provide more error message.In an embodiment of the present invention, error checking unit 101 can provide error message in various degree according to user's setting and error condition; For example, the user can set error message and be to provide error message take single image as unit, or the error message take single macro zone block as unit etc.
Electrical couplings is 101 decoding unit 102 in the error checking unit, after receiving above-mentioned error message, just optionally this video signal data is carried out an error concealing program and a translator according to this error message.For example, decoding unit 102 distinguishes according to the specific fields in error message whether the video signal data of reception can execution error concealing program and translator.When decoding unit 102 judgement can execution error concealing program and translator, the error concealing program is according to wherein coded format and the error message of a coding stratum of this video signal data, with the misdata in an alternate data displacement video signal data.
The error concealing program can distinguish that the coded format of the stratum of encoding is intraframe coding (INTRA-CODING) or is inter prediction encoding (INTER PREDICTION CODING), to determine to utilize the misdata in different alternate data displacement video signal datas; Wherein, coding stratum comprises the coding stratum of all images data, the coding stratum of single image data, or the coding stratum of single macro zone block data etc., for example the coding stratum of MPEG4 compression standard shown in Figure 1.Afterwards, decoding unit 102 just can adopt existing this video signal data of interpretation method decoding to produce an image.
Below, will describe with the embodiment that the present invention is applied to the MPEG4 compression standard.When visual information decoding apparatus 10 receives a video signal data that meets the MPEG4 compression standard, at first, error checking unit 101 produces an error message according to the error condition of this video signal data.
Below table 1 shows error checking unit 101 recognizable error conditions, the error message content that records, and next action of error checking unit 101.In addition, error checking unit 101 can distinguish more whether video signal data has Data Segmentation form and reversible variable length code form that the MPEG4 compression standard provides in other embodiment of the present invention, in order to more multiword section to be provided in error message, make decoding unit 102 carry out error concealing according to more coded data in those fields reservation video signal datas.
Wherein, error condition can be divided into the coded data mistake (as the situation a in table 1, b) of all images data in video signal data, the coded data mistake (as the situation c in table 1) of single image data, or the coded data mistake of macro zone block (as the situation d in table 1, e, f, g) etc.For example, the situation a of table 1, when losing video signal object sequence header, lose video signal object header or losing video signal object layer header, the coding that affects all images data in video signal data is set.Again for example, the situation d of table 1 when having the VLC code that is not present in the VLC table in some macro zone block, is only that the coding that affects those macro zone blocks is set.
Table 1
VOP_WIDTH shown in above table 1 and VOP_HEIGHT, the width that represents respectively a video signal object plane and height; Quantization parameter (QP) is a numerical value that is applied to the quantification image data; INTRA_DC_VLC_THR, it is the pattern that is applied to switch variable length code; VOP_FCODE_FORWARD and VOP_FCODE_BACKWARD are to be applied to the decoding moving vector.Symbol in table 1 all is common in the MPEG4 compression standard, is also prior art, and for those skilled in the art can understand, so this paper seldom explains at this, and table 1 is explanation part embodiment of the present invention, is not to limit the present invention.
After error checking unit 101 transmission error messages are to decoding unit 102, carry out again next action of corresponding this error condition according to table 1.For example, distinguishing error condition when error checking unit 101 is that video signal packet headers information and video signal object plane in situation g is inconsistent, after producing error message, next video signal object plane header or video signal packet headers are just sought to distinguish whether it has error condition in error checking unit 101.
According to the error condition of distinguishing, error message comprises following field at least:
Whether one significance bit can carry out decoding in order to represent video signal data;
One video signal object plane number value is in order to represent the numbering of video signal object plane;
One error macros block number value is in order to the macro zone block numbering that represents that first makes a mistake;
One correct macro zone block number value is positioned at first macro zone block that makes a mistake first correct macro zone block numbering afterwards in order to expression; And
One error message stop value finishes in order to represent error message.
Wherein, error checking unit 101 is by checking whether the coded data in video signal data has error condition as shown in table 1, can record simultaneously above-mentioned video signal object plane number value, error macros block number value, and the information such as correct macro zone block number value.If the numerical value of significance bit is that 1 this video signal data of expression can be according to video signal object plane number value, error macros block number value, and correct macro zone block number value execution error concealing program; If being 0 this video signal data of expression, the numerical value of significance bit has gross error, for example in table 1, the video signal object sequence header of situation a, video signal object header, video signal object layer header are lost, or the video signal object layer header content false of situation b, therefore will can not hide this section video signal data execution error that above four kinds of headers are contained, and decoding unit 102 also can this section of decoding video signal data.
In addition, if error checking unit 101 distinguishes that video signal data has Data Segmentation form and reversible variable length code form that the MPEG4 compression standard provides, error message more comprises following field:
One fragment (SLICE) value of abandoning abandons a fragment in order to expression.
In the MPEG4 compression standard, an image includes several fragments, and each fragment has several macro zone blocks.If the numerical value of the fragment value of abandoning is 1, represent error checking unit 101 in the program of distinguishing error condition, judge that the coded data of all macro zone blocks in a fragment makes a mistake, therefore will not adopt the coded data in this fragment in the error concealing program; If the numerical value of the fragment value of abandoning is 0, represent that the part coded data of the macro zone block that this fragment comprises can be for being applied to the error concealing program.
Electrical couplings is 101 decoding unit 102 in the error checking unit, optionally this video signal data is carried out an error concealing program and a translator according to this error message.Wherein, the significance bit field of error message is in order to determine whether be necessary this section video signal data execution error concealing program and translator.When decoding unit 102 judgement can execution error concealing program and translator, the error concealing program is according to wherein coded format and the error message of a coding stratum of video signal data, with the misdata in an alternate data displacement video signal data.For example, decoding unit 102 can be by the header of this coding of decoding stratum to distinguish its coded format.In one embodiment of the invention, decoding unit 102 can to the coding stratum of video signal object plane, distinguish that its coded format is intraframe coding (INTRA-CODING) or inter prediction encoding (INTER PREDICTION CODING).
Below further illustrate decoding unit 102 in the embodiment of the present invention with four kinds of embodiment of alternate data displacement misdata.
The first, the coded format of the coding stratum that makes a mistake when video signal data is that when adopting intraframe coding (INTRA-CODING), decoding unit 102 need not with reference to other view data, can produce alternate data with the displacement misdata.For example, when the present invention is applied to meet the image data of MPEG4 compression standard, if video signal data makes a mistake coding stratum is the video signal object plane, and its coded format is video signal object plane (INTRA VOP) in frame, this decoding unit 102 is with reference to the video signal object plane number value in error message, error macros block number value and correct macro zone block number value, use the misdata of following information displacement macro zone block, it comprises:
(1) MB_TYPE is set to MODE_INTRA;
(2) numerical value with AC_PRED_FLAG is made as 0;
(3) numerical value with encoded block pattern (CODE BLACK PATTERN is called for short CBP) is made as 0; And
(4) numerical value with DC coefficient is made as 0.
Wherein, MB_TYPE is in order to represent the type of macro zone block.MB_TYPE is set to MODE_INTRA and represents this macro zone block is set as intra-frame encoding mode.AC_PRED_FLAG represents whether macro zone block predicts ac coefficient, and the numerical value of AC_PRED_FLAG is made as the prediction that ac coefficient in macro zone block (AC COEFFICIENT) do not made in 0 expression.Encoded block pattern (CBP) is in order to represent whether corresponding four luma blocks of macro zone block and two chroma blocks have DC coefficient and ac coefficient.The numerical value of encoded block pattern is made as 0 block corresponding to this numerical value of expression there is no DC coefficient and ac coefficient.
The second, the coded format of the coding stratum that makes a mistake when video signal data is when adopting inter prediction encoding (INTER PREDICTION CODING), and decoding unit 102 produces alternate data with the displacement misdata with reference to other view data.For example, when the present invention is applied to meet the image data of MPEG4 compression standard, if video signal data makes a mistake coding stratum is the video signal object plane, and its coded format is inter prediction video signal object plane (INTER PREDICTION VOP), decoding unit 102 is with reference to the video signal object plane number value in error message, error macros block number value and correct macro zone block number value, use the misdata of following information displacement macro zone block, it comprises:
(1) numerical value with NOT_CODED is made as 1.
Wherein, NOT_CODED represents whether macro zone block has coding.When the numerical value of NOT_CODED is made as 1, represent this macro zone block take motion vector value (MOTION VECTOR) as 0 with reference to other view data, and without the data of DC coefficient.
The 3rd, when video signal data adopts anti-miscoding and makes error message comprise more multiword section (for example aforementioned fragment value of abandoning), and when the coded format of the coding stratum that makes a mistake is intraframe coding, decoding unit 102 keeps the coded data of part, and need not with reference to other view data, can produce alternate data with the displacement misdata.for example, when the present invention is applied to meet the image data of MPEG4 compression standard, if having Data Segmentation form and reversible variable length code form and make error message comprise fragment, video signal data abandons value field, and the coding stratum that makes a mistake is the video signal object plane, its coded format is video signal object plane in frame simultaneously, this decoding unit 102 is with reference to the video signal object plane number value in error message, error macros block number value, correct macro zone block number value, and fragment value of abandoning, use the misdata of following information displacement macro zone block, it comprises:
(1) numerical value with AC_PRED_FLAG is made as 0;
(2) numerical value with the encoded block pattern is made as 0; And
(3) do not make a mistake before the DC_MARKER symbol that is applied to separate coded data, keep DC coefficient and MCBPC information, wherein MCBPC information is in order to represent macro zone block type and chroma encoded block pattern.
The 4th, when video signal data adopts anti-miscoding and makes error message comprise more multiword section, and when the coded format of the coding stratum that makes a mistake was inter prediction encoding, decoding unit 102 kept the coded data of part, and produced alternate data with the displacement misdata with reference to other view data.for example, when the present invention is applied to meet the image data of MPEG4 compression standard, if having Data Segmentation form and reversible variable length code form and make error message comprise fragment, video signal data abandons value field, and the coding stratum that makes a mistake is the video signal object plane, its coded format is inter prediction video signal object plane simultaneously, decoding unit 102 is with reference to the video signal object plane number value in error message, error macros block number value, correct macro zone block number value, and fragment value of abandoning, use the misdata of following information displacement macro zone block, it comprises:
(1) numerical value with NOT_CODED is made as 1;
(2) numerical value with the encoded block pattern is made as 0; And
(3) do not make a mistake before the MOTION_MARKER symbol that is applied to separate coded data, keep MCBPC information, NOT_CODED and motion vector.
As shown in the above, error condition in visual information decoding apparatus 10 application error inspection units 101 inspection video signal datas proposed by the invention also produces an error message, and then decoding unit 102 is carried out corresponding error concealing program according to this error message to video signal data.Visual information decoding apparatus 10 of the present invention can check the video signal data execution error of part, and simultaneously the video signal data execution error of another part hidden and the video decoding program.In addition, the user also can be flexibly revises audit program in error checking unit 101 for different video signal compression standards, for example, distinguishes the error condition of other kind or the error message with more information is provided.In like manner, the user also can flexibly revise in response to different video signal compression standards the error concealing program in decoding unit 102, for example replaces misdata etc. with other alternate data.
The above is only preferred embodiment of the present invention, is not the scope that limits claim of the present invention; All other do not break away from the equivalence of completing under disclosed spirit and changes or modify, and all should be included in the scope of claim of the present invention.
Claims (9)
1. visual information decoding apparatus, in order to decoding one video signal data, this device comprises:
One error checking unit produces an error message in order to the error condition according to this video signal data, and wherein this error message is associated with the macro zone block numbering that makes a mistake; And
One decoding unit, its electrical couplings is in this error checking unit, in order to optionally this video signal data is carried out an error concealing program and a translator according to this error message, wherein this error concealing program according to wherein coded format and this error message of a coding stratum of this video signal data, is replaced misdata in this video signal data with an alternate data.
2. visual information decoding apparatus as claimed in claim 1, wherein when this error condition be lose video signal object sequence header, lose video signal object header, lose video signal object layer header, video signal object layer header image width or be not highly 4 multiple, or lose video signal object plane header, this decoding unit is not carried out this error concealing program and this translator.
3. visual information decoding apparatus as claimed in claim 1, wherein when this error condition have the variable-length code (VLC) that is not present in the variable length code table, have surpass 64 discrete cosine transform coefficients, to lose sync mark again or video signal packet headers information and video signal object plane inconsistent, this decoding unit is carried out this error concealing program and this translator.
4. visual information decoding apparatus as claimed in claim 1, wherein this error message comprises:
Whether one significance bit can carry out decoding in order to represent this video signal data;
One video signal object plane number value is in order to represent the numbering of a video signal object plane;
One error macros block number value is in order to the macro zone block numbering that represents that first makes a mistake;
One correct macro zone block number value is positioned at first correct macro zone block numbering after this first macro zone block of making a mistake in order to expression; And
One error message stop value finishes in order to represent this error message.
5. visual information decoding apparatus as claimed in claim 4, this error message also comprises:
One fragment value of abandoning abandons a fragment in order to expression.
6. visual information decoding apparatus as claimed in claim 1, when this coded format of this coding stratum that makes a mistake when this video signal data adopts intraframe coding, this decoding unit need not with reference to other view data, can produce this alternate data to replace this misdata.
7. visual information decoding apparatus as claimed in claim 1, when this coded format of this coding stratum that makes a mistake when this video signal data adopted inter prediction encoding, this decoding unit produced this alternate data to replace this misdata with reference to other view data.
8. visual information decoding apparatus as claimed in claim 1, when this video signal data adopts anti-miscoding and this coded format of this coding stratum that makes a mistake when being intraframe coding, this decoding unit keeps the coded data of this video signal data part, and need not with reference to other view data, can produce this alternate data to replace this misdata.
9. visual information decoding apparatus as claimed in claim 1, when this video signal data adopts anti-miscoding and this coded format of this coding stratum that makes a mistake when being inter prediction encoding, this decoding unit keeps the coded data of this video signal data part, and produces this alternate data to replace this misdata with reference to other view data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010114293 CN102148985B (en) | 2010-02-05 | 2010-02-05 | Video decoder |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010114293 CN102148985B (en) | 2010-02-05 | 2010-02-05 | Video decoder |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102148985A CN102148985A (en) | 2011-08-10 |
| CN102148985B true CN102148985B (en) | 2013-06-12 |
Family
ID=44422945
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010114293 Expired - Fee Related CN102148985B (en) | 2010-02-05 | 2010-02-05 | Video decoder |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102148985B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1573929A (en) * | 2003-06-05 | 2005-02-02 | 日本电气株式会社 | Audio decoder and audio decoding method |
| CN1581972A (en) * | 2004-05-20 | 2005-02-16 | 复旦大学 | Error-corcealed video decoding method |
| CN101288315A (en) * | 2005-07-25 | 2008-10-15 | 汤姆森特许公司 | Method and apparatus for the concealment of missing video frames |
| CN101399995A (en) * | 2007-09-25 | 2009-04-01 | 株式会社东芝 | Video decoding apparatus and video decoding method |
| CN101409847A (en) * | 2007-09-25 | 2009-04-15 | 株式会社东芝 | Video decoding apparatus and video decoding method |
-
2010
- 2010-02-05 CN CN 201010114293 patent/CN102148985B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1573929A (en) * | 2003-06-05 | 2005-02-02 | 日本电气株式会社 | Audio decoder and audio decoding method |
| CN1581972A (en) * | 2004-05-20 | 2005-02-16 | 复旦大学 | Error-corcealed video decoding method |
| CN101288315A (en) * | 2005-07-25 | 2008-10-15 | 汤姆森特许公司 | Method and apparatus for the concealment of missing video frames |
| CN101399995A (en) * | 2007-09-25 | 2009-04-01 | 株式会社东芝 | Video decoding apparatus and video decoding method |
| CN101409847A (en) * | 2007-09-25 | 2009-04-15 | 株式会社东芝 | Video decoding apparatus and video decoding method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102148985A (en) | 2011-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10750205B2 (en) | Selective use of start code emulation prevention | |
| CN106559669B (en) | Prognostic chart picture decoding method and device | |
| CN102918836B (en) | Frame for asymmetric stereo video encapsulates | |
| TWI437886B (en) | Parameter set and picture header in video coding | |
| CN102065290B (en) | Video decoding apparatus, method of storing motion vector information and memory distribution method | |
| TWI636687B (en) | Video data stream concept | |
| CN103430542B (en) | After random access memory, the video coding technique of picture is depended in decoding | |
| JP5280003B2 (en) | Slice layer in video codec | |
| CN101175213B (en) | Video source coding method and device, method and device for decoding video source | |
| CN104854870B (en) | Low latency buffer model in video coding | |
| CN107409229A (en) | Indicate the syntactic structure of the end of coding region | |
| US20070014346A1 (en) | Coding dependency indication in scalable video coding | |
| CN101375594B (en) | Processing multiview video | |
| CN1965321A (en) | Slice layer in video codec | |
| US20180077421A1 (en) | Loss Detection for Encoded Video Transmission | |
| TW200423739A (en) | Picture coding method | |
| JP2009284518A (en) | Video coding method | |
| CN103460698A (en) | Combined reference picture list construction and mapping | |
| CN103119938A (en) | Picture coding and decoding | |
| KR19990066827A (en) | Fault-tolerant mode video codec method and device | |
| CN103843341A (en) | Decoders and methods thereof for managing pictures in video decoding process | |
| TW241350B (en) | ||
| CN100407791C (en) | Image encoding method, image decoding method, image encoding device, image decoding device, program, computer dato signal and image transmission system | |
| CN104350751A (en) | Extension data handling | |
| CN104937942A (en) | Encoder and encoder and methods for coding of a video sequence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130612 Termination date: 20170205 |