CN101629965B - Multi-grid processing method in particle image velocimetry (PIV) - Google Patents

Multi-grid processing method in particle image velocimetry (PIV) Download PDF

Info

Publication number
CN101629965B
CN101629965B CN2009101094293A CN200910109429A CN101629965B CN 101629965 B CN101629965 B CN 101629965B CN 2009101094293 A CN2009101094293 A CN 2009101094293A CN 200910109429 A CN200910109429 A CN 200910109429A CN 101629965 B CN101629965 B CN 101629965B
Authority
CN
China
Prior art keywords
grid
under
image
equations
calculation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2009101094293A
Other languages
Chinese (zh)
Other versions
CN101629965A (en
Inventor
卢宗庆
廖庆敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Graduate School Tsinghua University
Original Assignee
Shenzhen Graduate School Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Graduate School Tsinghua University filed Critical Shenzhen Graduate School Tsinghua University
Priority to CN2009101094293A priority Critical patent/CN101629965B/en
Publication of CN101629965A publication Critical patent/CN101629965A/en
Application granted granted Critical
Publication of CN101629965B publication Critical patent/CN101629965B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses a multi-grid processing method in particle image velocimitry (PIV). The method comprises the following steps: setting a first network of the image, obtaining an equations set under the first network (corresponding to a high-resolution image) corresponding to an equations set to be solved; iteratively solving the equations set and obtaining an equation error according to a practical solution; setting a second network with a size thicker than the first network of the image; mapping a solving scale of the equations set under the first network to a solving scale of the equations set under the second network; iteratively solving a high-frequency calculation error under the second network; mapping the scale of the high-frequency calculation error under the second network to obtain a low-frequency calculation error under the first network; and updating the practical solution with the low-frequency calculation error under the first network. The method can greatly accelerate the PIV processing process and can not lower the processing reliability and the processing precision.

Description

The multi-grid processing method that is used for particle image velocimetry
Technical field
The present invention relates to Flame Image Process, particularly relate to a kind of multi-grid processing method that is used for particle image velocimetry.
Background technology
The forms of motion of nature image varies, fluid motion is a kind of typical non-rigid motion, fluid motion image calculation and analysis are that particle image velocimetry (Particle ImageVelocimitry is called for short PIV) is a kind of novel contactless measuring technique.Usually PIV drops into trace particle in fluid, under the irradiation of laser sheet optical, taking particle picture with video camera with fluid motion with sheet light vertical direction, again image is carried out Treatment Analysis and calculate, finally obtain a kind of measuring method of two-dimension speed field on the square section, flow field.As a kind of whole flow field, contactless, no disturbance, high-precision flow visual method, complicate when being applicable to turbulent flow, nonstationary flow etc. the measurement in flow field of PIV.Nowadays, PIV has been a cross-synthesis technology interdisciplinary, its combine laser technology, video image processing technology, computer technology, fluid mechanics and modern age optical technology newest fruits, be widely used in many fields such as experimental fluid mechanics, biomedicine, industry manufacturing.PIV makes as a whole continuous function with whole motion vector field and estimates, its resolution can reach each pixel in the image, for microcosmic, accurately carry out topography's motion calculation and analysis provide may, overcome some inherent shortcomings in traditional correlation technique simultaneously.All there are important science and economic worth in the PIV system in fields such as experimental fluid mechanics, aerodynamics, manufacturing industry, medical science, industry, aircraft manufacturing, water conservancy and hydropower, meteorology.
Many graphical analysis problems need solve the oval partial differential equation that has boundary value problem, and finally by find the solution that linearity or Nonlinear System of Equations realize as: based on image non-linear diffusion, initiatively profile calculating, the image recovery etc. of variational method.Though optical flow computation has all obtained bigger leap at aspects such as computational accuracy, reliabilities, its numerical method and means do not have important breakthrough.
Many grid ideas are set forth in the sixties in last century, are applied to after the seventies in the actual science calculating.Nowadays many grid computings have been widely used in science such as physics, mechanics, electromagnetic field calculates, widely used many grid methods during engineering mathematics and finite element numerical are calculated.Grid is the basis of numerical solution of partial differential equations, and the quality of grid system directly influences precision of calculation results.The research of many grid methods has been experienced from the structuring to the destructuring, the process from single grid to hybrid grid, and the new grid generation technique at different situations constantly appears.
Summary of the invention
Fundamental purpose of the present invention is exactly at the deficiencies in the prior art, and a kind of multi-grid processing method is provided, and can effectively accelerate the image processing process of particle image velocimetry.
For achieving the above object, the present invention is by the following technical solutions:
A kind of multi-grid processing method that is used for particle image velocimetry, described particle image velocimetry comprises finds the solution system of linear equations AU=F to realize the step to the optimal approximation of sports ground, U finds the solution for waiting, A is a matrix of coefficients, it comprises the motion vector field parameter at least, F is a vector, in the image processing process of particle image velocimetry, for graphical analysis, the definition of grid adopts each pixel of original image to represent refined net, based on the value computing on such discrete grid block point, the multiple dimensioned strategy that approaches is step by step adopted in the image motion field, each dimensional variation all can carry out once upgrading based on the compensation of current estimated result, the variation of graphical rule is regarded as said method comprising the steps of the variation of different size grid:
A, first grid of image is set, obtains the system of equations A of system of equations AU=F correspondence under the first grid h hU h=F h
B, iterative system of equations A hU h=F h, separate according to gained is actual
Figure GDA0000035645440000021
Obtain error in equation R h = F h - A h U ‾ h ,
C, the size of images second grid H thicker than first grid is set, will be to system of equations A under the first grid h he h=R hThe yardstick of finding the solution be mapped as under the second grid H system of equations A He H=R HFind the solution;
D, the iterative high frequency error of calculation e under the second grid H H
E, to the high frequency error of calculation e under the second grid H HCarry out the yardstick mapping, obtain the low frequency error of calculation e under the first grid h h
F, with the low frequency error of calculation e under the first grid h hUpgrade actual separating:
Figure GDA0000035645440000023
Preferably, also comprise:
After upgrading actual separating, iterative A under the first grid h of image again hU h=F h, eliminate
Figure GDA0000035645440000024
The high frequency error of calculation.
Preferably, the processing of described steps A to step F repeatedly carried out in circulation, and wherein the yardstick of second grid of image increases progressively one by one.
Beneficial technical effects of the present invention is:
The graphical analysis problem need solve the oval partial differential equation that has boundary value problem, and finally realize by finding the solution linearity or Nonlinear System of Equations, as: based on image non-linear diffusion, initiatively profile calculating, the image recovery etc. of variational method, the high frequency error of linear equation is easy to eliminate on the large scale grid, even opposite to the very difficult elimination of a large amount of iteration low frequency aberrations, but this low frequency aberration only needs just can obviously eliminate through small number of iterations on the small scale grid.Therefore, in the image processing process of particle image velocimetry, adopt many grid methods, carry out the processing of finding the solution of dependent linear equation group by the iteration of different grids, can effectively accelerate the convergence process of system of linear equations iteration, accelerate image processing speed greatly, can not reduce the reliability and the precision of processing simultaneously.
The method that adopts grid multiple dimensioned (might scale factor less than 2) to approach step by step can reduce the influence that the equation model error is brought, and improves computational accuracy.Each dimensional variation all can carry out once upgrading based on the compensation of current estimated result.Regard the variation of graphical rule the variation of different size grid as, multiple dimensioned in essence approaching calculated a kind of special case that can be regarded as multi-grid algorithm.
Description of drawings
Fig. 1 is the structured flowchart of particle image velocimetry disposal system;
Fig. 2 is for dividing the interior smooth synoptic diagram of discontinuous field, border continuously with level set function;
The process flow diagram of Fig. 3 for utilizing many grids to quicken to handle among a kind of embodiment;
Fig. 4 a and Fig. 4 b are respectively the synoptic diagram of V-type and the many networks of W type;
Fig. 5 is a kind of synoptic diagram of many networks of preferred embodiment.
Feature of the present invention and advantage will be elaborated in conjunction with the accompanying drawings by embodiment.
Embodiment
At first introduce a kind of particle image velocimetry method of the multi-grid processing method that can use the embodiment of the invention.
A complete particle image velocimetry disposal system key component as shown in Figure 1, mainly comprise data acquisition module, image pretreatment module, motion vector field (optical flow field) computing module and follow-up data analysis module, the follow-up data analysis module comprises curl computing module and divergence computing module.Motion vector field computing module wherein is the nucleus module of whole PIV system.
When calculating 2 dimension motion vector field, divergence and curl fields, adopted calculating thought, with the form calculating kinematical vector of whole function based on the light stream equation of motion.Can keep simultaneously the partial structurtes information of vector field, divergence and curl field again in order to restrain noise, also combine the thought of level set.
2 dimension motion vector fields are meant in size is N * M pixel coverage (as the PAL-system of knowing usually: 768 * 576 or 640 * 480 pixels) can describe the displacement vector of this pixel current time under each location of pixels (in N * M), this vector is a floating number two-dimensional vector, is expressed as: v=[v x, v y], v wherein x, v yBe x axle and axial two speed components of y.Describe for unified, represent vector with the capitalization runic, the small letter light face type is represented scalar.Velocity field v is actual to be coordinate position variable x=[x, y] function.The fluid motion image calculation has gone out outside the acquisition transient motion vector field v, also need calculate divergence field ξ and the curl field η of v, shown in the formula of (1) (2).
ξ = div ( V ) = ∂ v x ∂ x + ∂ v y ∂ y - - - ( 1 )
η = curl ( V ) = ∂ v x ∂ y - ∂ v y ∂ x - - - ( 2 )
Because actual fluid motion may have the phenomenon that many vector currents have a common boundary, be the moving boundaries and the problem of doing more physical exercises, in order to solve the moving boundaries and the problem of doing more physical exercises,, the strategy and the thought of level set is integrated in original optical flow computation framework simultaneously in order to improve the precision of fluid motion feature description.
As shown in Figure 2, motion vector, divergence and curl might be discontinuous in a certain regional Ω, Ω can be divided into two sub regions Ω for this reason 1, Ω 2, Ω 1Sports ground, divergence field and curl field corresponding in the zone are: [v 1, ξ 1, η 1]; Ω 2Sports ground, divergence field and curl field corresponding in the zone are: [v 2, ξ 2, η 2].Suppose at regional Ω 1Interior [v 1, ξ 1, η 1] smooth and continuous, at regional Ω 2Interior [v 2, ξ 2, η 2] smooth and continuous, but at Ω 1, Ω 2Intersection sports ground, divergence field and curl field and discontinuous.[v in order to guarantee to calculate 1, ξ 1, η 1] and [v 2, ξ 2, η 2] continuity, do not destroy simultaneously Ω again 1With Ω 2Between structural information and be convenient to calculate, make up level set function φ and indicator function H, φ is for being defined in the image magnitude range the (continuous function of N * M).H(x)=1,x≥0and?H(x)=0,x<O。
φ divides Ω with level set function 1, Ω 2, the zone of φ 〉=0 belongs to Ω 1, and the zone of φ<0 belongs to Ω 2Owing to adopted the thought of level set, therefore calculated [v 1, ξ 1, η 1] and [v 2, ξ 2, η 2] time will constantly calculate simultaneously and upgrade φ.
In order to estimate [v 1, ξ 1, η 1] and [v 2, ξ 2, η 2], construct following energy function.
E=E 1+λE 2 (3)
Wherein E is the global energy functional, E 1, E 2Be respectively data constraint energy and smooth bound energy with following formula (4), (5) form.
E 1 = ∫ Ω | I ( X + V 1 , t ) - I ( X , t ) | 2 H ( φ ) + | I ( X + V 2 , t ) - I ( X , t ) | 2 H ( - φ ) dx
+ ∫ Ω | div ( V 1 ) - ξ 1 | 2 H ( φ ) + | div ( V 2 ) - ξ 2 | 2 H ( - φ ) dx - - - ( 4 )
+ ∫ Ω | curl ( V 1 ) - η 1 | 2 H ( φ ) + | curl ( V 2 ) - η 2 | 2 H ( - φ ) dx
E 2 = α ∫ Ω | ▿ V 1 | 2 H ( φ ) + | ▿ V 2 | 2 H ( - φ ) dx
+ α ∫ Ω | ▿ ξ 1 | 2 H ( φ ) + | ▿ ξ 2 | 2 H ( - φ ) dx
(5)
+ α ∫ Ω | ▿ η 1 | 2 H ( φ ) + | ▿ η 2 | 2 H ( - φ ) dx
+ β ∫ Ω | ▿ H ( φ ) | 2 dx
Here (X t) represents the particle picture sequence to I.The final optical flow field of estimating can be described as:
V = V 1 φ ( X ) ≥ 0 V 2 else
Realize the optimal approximation of optical flow field by minimizing of global energy functional.
Minimizing of energy functional (3) can realize by finding the solution system of linear equations (6).
AU=F (6)
U=[V wherein 1, V 2, ξ 1, ξ 2, η 1, η 2, φ], A is 9 * 9 matrix of coefficients, F is the odd item of 9 * 1 vector representation linear equation.
The acquisition of system of linear equations (6) and calculating can realize by classical Variational Calculation method, not elaborate here.
For above-mentioned PIV method, can adopt many grids acceleration strategy to combine with it, particularly, promptly handle system of linear equations (6) by many grid methods, quicken PIV and calculate.
A central task of many grid computings is to find the solution various partial differential equation and system of linear equations from practical problems.Because many graphical analysis problems need solve the oval partial differential equation that has boundary value problem, and finally realize by finding the solution linearity or Nonlinear System of Equations, as: based on image non-linear diffusion, initiatively profile calculating, the image recovery etc. of variational method, the high frequency error of linear equation is easy to eliminate on the large scale grid, even opposite to the very difficult elimination of a large amount of iteration low frequency aberrations, but this low frequency aberration only needs just can obviously eliminate through small number of iterations on the small scale grid.Therefore many grid. policies are exactly to come the accelerating convergence process by the iterative computation of different grids.For graphical analysis, the definition of grid is fairly simple, and each pixel of original image is represented a grid, and promptly the thinnest grid calculates that the value computing all be based on such discrete grid block point finishes.
Please refer to Fig. 3, the multi-grid processing method of a kind of embodiment specifically comprises the steps:
At size of mesh opening is h x* n yThe first grid h under, formula (6) AU=F can be written as formula (7):
A hU h=F h (7)
A h, U hBeing illustrated respectively in size of mesh opening is h x* n yEquation coefficient matrix under (image resolution ratios that different size of mesh opening are corresponding different) is conciliate.
Suppose that equation (7) is through n 1Obtain after the inferior iteration separate for
Figure GDA0000035645440000061
, and make U hBe desirable truly separating, then the error of calculation of motion vector is:
e h = U h - U ‾ h - - - ( 8 )
Because the high frequency error of result of calculation just can be eliminated substantially through small number of iterations, so e hThe low frequency energy that mainly comprises the error of calculation here.If can know e hThen can be right Compensate and reach the purpose that reduces the error of calculation.Though directly obtain e hAnd be not easy, but can through type (9) and formula (10) find the solution indirectly.
By known
Figure GDA0000035645440000064
Can calculate the error R of equation (7) h, formula (9) is arranged.
R h = F h - A h U ‾ h
(9)
Because A hBe linear therefore having:
A he h=R h (10)
The e here hIt mainly is the low frequency error of calculation under grid h.According to the analysis of front, only know to be difficult to obtain low frequency aberration e from equation (10) hThe ingenious part of many grid computings just is e hUnder original grid h, do not calculate, but on thicker grid, calculate.
For being of a size of H than coarse grid H x* H y, and H is arranged x>h x, H y>h y, on coarse grid, (10) can be written as:
A He H=R H (11)
A wherein H, R HBe A h, R hThrough the new equation coefficient that obtains after the yardstick mapping, mapping relations are as follows:
A H=P h→H(A h),R H=P h→H(R h)
P H → HBe mapping function, e HReflection be high frequency error of calculation grid H under, the while is again the low frequency error of calculation under the refined net h.Because e HAnd e hNot on a yardstick, therefore also need e HBe mapped as e h, as follows:
e h=P H→h(e H)
High frequency error of calculation e under grid H HOnly need just can obtain, by mapping P by iteration seldom H → h(e H) finally can obtain e h, e has been arranged hJust can upgrade by (12)
Figure GDA0000035645440000067
U ‾ new h = e h + U ‾ h - - - ( 12 )
Because the mapping between the yardstick also can bring certain high frequency error, therefore can also under grid h, carry out n more at last 2Inferior iteration is eliminated
Figure GDA0000035645440000069
High frequency error.
Many networks can be combined with multiple dimensioned thought in the image calculation and be applied to PIV and calculate.The strategy that adopts multiple dimensioned (might scale factor less than 2) to approach step by step can reduce the influence that the equation model error is brought, and improves computational accuracy.Each dimensional variation all can carry out once upgrading based on the compensation of current estimated result.Regard the variation of graphical rule the variation of different size grid as, multiple dimensioned in essence approaching calculated a kind of special case that can be regarded as multi-grid algorithm.
Therefore, also can adopt the grid of more sizes according to the actual computation needs.Multi-grid algorithm is divided three classes in practice usually: the many grid computings of V-type, the many grid computings of W type and the many grid computings of perfect form, Fig. 4 a and Fig. 4 b have provided the synoptic diagram of V-type and the many grid computings of W type.
Preferably, employing many networks as shown in Figure 5.Round dot among Fig. 5 is represented the grid (size of mesh opening increases successively from bottom to up) of different scale, and the rising arrow represents from the small scale grid that to the transition of large scale grid arrow is then opposite downwards.Each just upgrades equation coefficient A and F in the formula (7) after finishing the many grid computings of V-type, carries out repeatedly circular treatment.The speed of convergence of system of linear equations iteration can be effectively accelerated by many grid computings, computation's reliability and precision can be do not reduced simultaneously.
Above content be in conjunction with concrete preferred implementation to further describing that the present invention did, can not assert that concrete enforcement of the present invention is confined to these explanations.For the general technical staff of the technical field of the invention, without departing from the inventive concept of the premise, can also make some simple deduction or replace, all should be considered as belonging to protection scope of the present invention.

Claims (3)

1. multi-grid processing method that is used for particle image velocimetry, described particle image velocimetry comprises finds the solution system of linear equations AU=F to realize the step to the optimal approximation of sports ground, U finds the solution for waiting, A is a matrix of coefficients, it comprises the motion vector field parameter at least, F is a vector, it is characterized in that, in the image processing process of particle image velocimetry, for graphical analysis, the definition of grid adopts each pixel of original image to represent refined net, based on the value computing on such discrete grid block point, the multiple dimensioned strategy that approaches is step by step adopted in the image motion field, each dimensional variation all can carry out once upgrading based on the compensation of current estimated result, the variation of graphical rule regarded as said method comprising the steps of the variation of different size grid:
A, first grid of image is set, obtains the system of equations A of system of equations AU=F correspondence under the first grid h hU h=F h
B, iterative system of equations A hU h=F h, separate according to gained is actual
Figure FDA0000035645430000011
Obtain error in equation R h = F h - A h U ‾ h ;
C, the size of images second grid H thicker than first grid is set, will be to system of equations A under the first grid h he h=R hThe yardstick of finding the solution be mapped as under the second grid H system of equations A He H=R HFind the solution;
D, the iterative high frequency error of calculation e under the second grid H H
E, to the high frequency error of calculation e under the second grid H HCarry out the yardstick mapping, obtain the low frequency error of calculation e under the first grid h h
F, with the low frequency error of calculation e under the first grid h hUpgrade actual separating:
Figure FDA0000035645430000013
2. multi-grid processing method as claimed in claim 1 is characterized in that, also comprises:
After upgrading actual separating, iterative A under the first grid h of image again hU h=F h, eliminate
Figure FDA0000035645430000014
The high frequency error of calculation.
3. multi-grid processing method as claimed in claim 1 or 2 is characterized in that, the processing of described steps A to step F repeatedly carried out in circulation, and wherein the yardstick of second grid of image increases progressively one by one.
CN2009101094293A 2009-08-18 2009-08-18 Multi-grid processing method in particle image velocimetry (PIV) Expired - Fee Related CN101629965B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009101094293A CN101629965B (en) 2009-08-18 2009-08-18 Multi-grid processing method in particle image velocimetry (PIV)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009101094293A CN101629965B (en) 2009-08-18 2009-08-18 Multi-grid processing method in particle image velocimetry (PIV)

Publications (2)

Publication Number Publication Date
CN101629965A CN101629965A (en) 2010-01-20
CN101629965B true CN101629965B (en) 2011-05-11

Family

ID=41575143

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009101094293A Expired - Fee Related CN101629965B (en) 2009-08-18 2009-08-18 Multi-grid processing method in particle image velocimetry (PIV)

Country Status (1)

Country Link
CN (1) CN101629965B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104915928B (en) * 2014-03-12 2018-02-06 北京航空航天大学 A kind of velocity field bad vector identification decomposed based on Proper Orthogonal and modification method
CN105095555B (en) * 2014-07-15 2018-11-02 北京航空航天大学 It is a kind of based on particle image velocimetry method and device of the velocity field without scattered smoothing processing
CN105929193B (en) * 2016-04-15 2019-01-04 北京航空航天大学 A kind of velocity field rapid correction method and device based on hydrodynamics continuity equation
CN106771343B (en) * 2016-12-20 2019-02-26 北京尚水信息技术股份有限公司 The stereoscopic three-dimensional flow relocity calculation method of Particle Image Velocity
CN107102165B (en) * 2017-04-14 2020-03-20 重庆大学 Surface flow field measuring method based on particle image velocimetry

Also Published As

Publication number Publication date
CN101629965A (en) 2010-01-20

Similar Documents

Publication Publication Date Title
CN101629966B (en) Particle image velocimetry (PIV) processing method
CN101629965B (en) Multi-grid processing method in particle image velocimetry (PIV)
Sadlo et al. Efficient visualization of Lagrangian coherent structures by filtered AMR ridge extraction
CN108010103A (en) The quick fine generation method of river with complicated landform
CN106202746B (en) Simulate the Yeh- multi-level finite element modeling method of Water in Porous Medium stream Darcy velocity
CN105550691B (en) Adaptive mountain valley ridge line extracting method and system based on scale space
CN103700101B (en) Non-rigid brain image registration method
Li et al. Fourier neural operator approach to large eddy simulation of three-dimensional turbulence
CN102930511B (en) Method for analyzing velocity vector of flow field of heart based on gray scale ultrasound image
Wu et al. Solving high-dimensional pdes with latent spectral models
CN113111608B (en) Novel local turbulence pulsation generation method
CN114331842B (en) DEM super-resolution reconstruction method combining topographic features
Ahrens et al. Verifying scientific simulations via comparative and quantitative visualization
CN103473790A (en) Online target tracking method based on increment bilateral two-dimensional principal component analysis (Bi-2DPCA) learning and sparse representation
CN103514600A (en) Method for fast robustness tracking of infrared target based on sparse representation
CN116562414A (en) Land water reserve change prediction method based on multisource hydrographic meteorological data
Kim et al. On gravity–capillary lumps. Part 2. Two-dimensional Benjamin equation
CN103136762A (en) Dynamic image target tracking method
Ouyang et al. A circulant-matrix-based hybrid optical flow method for PIV measurement with large displacement
CN101609553A (en) Non-rigid image registration algorithm based on implicit shape representation and edge information fusion
Zhao et al. Intelligent recognition of spacecraft components from photorealistic images based on Unreal Engine 4
CN112581626B (en) Complex curved surface measurement system based on non-parametric and multi-attention force mechanism
Xia et al. A hierarchical autoencoder and temporal convolutional neural network reduced-order model for the turbulent wake of a three-dimensional bluff body
Maceas et al. A methodology for improving both performance and measurement errors in PIV
Raiola et al. Adaptive ensemble PTV

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110511

Termination date: 20150818

EXPY Termination of patent right or utility model