CN100569176C - A kind ofly utilize virtual the looking-eye movement reflex method of target of looking - Google Patents
A kind ofly utilize virtual the looking-eye movement reflex method of target of looking Download PDFInfo
- Publication number
- CN100569176C CN100569176C CNB2008100942229A CN200810094222A CN100569176C CN 100569176 C CN100569176 C CN 100569176C CN B2008100942229 A CNB2008100942229 A CN B2008100942229A CN 200810094222 A CN200810094222 A CN 200810094222A CN 100569176 C CN100569176 C CN 100569176C
- Authority
- CN
- China
- Prior art keywords
- looking
- virtual
- target
- image
- target image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
A kind ofly utilize virtual the looking-eye movement reflex method of target of looking, may further comprise the steps: 1. show the virtual target image of looking that is used for visual stimulus by the virtual target optical presentation system of looking; 2. absorb detected personnel by the described virtual ocular movement image that the target image causes of looking by the ocular movement image capturing system; 3. by image processing module described ocular movement image is handled, formed the time dependent curve of pupil position, of the present inventionly utilize virtual the looking-eye movement reflex method of target of looking, it is more convenient that vestibule is detected.
Description
Technical field
The present invention relates to a kind of eye movement inspection method, particularly relate to a kind of virtual looking-eye movement reflex method of target of looking of utilizing.
Background technology
Look-the eye movement reflex is the important means that department of neurology, ophthalmology, otology etc. are estimated eye movement and related neural regulatory function.
At present, the method that eye movement detects mainly is that the method by dot matrix LEDs form or directly projection excites eye movement, these methods have following shortcoming: 1. need to dispose huge periphery and look target equipment, such as between the test of the about 1 meter cylinder of radius, illuminator, motor etc., by cooperatively interacting of these auxiliary facilities, the visual stimulus image of eye movement, aptitude test vestibular function are brought out in generation.But no matter utilize dot matrix LEDs form or direct projection, owing to must be equipped with and wait equipment between above-mentioned test, and can not further dwindle between test, otherwise will influence testing result, like this, it is bulky to cause utilizing the periphery of the device of existing method to look target equipment, it is big not only to take up room, and need the professional to carry out special mounting, need take certain space during outfit and carry out certain capital construction installation, also can't carry after the installation, can not at will move, incompatibility is outdoor and need ambulant test site, not only gives to promote the use of and has brought very big inconvenience, and be unfavorable for carrying out the detection of vestibular function whenever and wherever possible; 2. use the huge periphery of existing method to look target equipment in use, its each parts certainly lead to mechanical wear, influence its service life; 3. the checkout facility of using existing method mostly is external import, and not only inconvenient maintenance but also price are very expensive; 4. the checkout facility of using existing method in use, its mechanical part such as motor etc. can produce noise, can detected personnel be exerted an influence to a certain extent, influence accuracy of detection.
Summary of the invention
For this reason, technical problem to be solved by this invention is to provide a kind of and makes detection utilize virtual the looking-eye movement reflex method of target of looking more easily.
For solving the problems of the technologies described above, provided by the present inventionly utilize virtual the looking-eye movement reflex method of target of looking, may further comprise the steps:
1. show the virtual target image of looking that is used for visual stimulus by the virtual target optical presentation system of looking;
2. absorb detected personnel by the described virtual ocular movement image that the target image causes of looking by the ocular movement image capturing system;
3. by image processing module described ocular movement image is handled, formed the time dependent curve of pupil position.
The described virtual target image of looking is looked stimulus signal that the target generation module sends and is stimulated and produce by virtual.
Also comprise after 3. in described step and to use the image information analysis module,, determine the step of vestibular function state by comparative analysis with time dependent curve of described pupil position and predetermined threshold value.
1. also comprise the step of regulating interpupillary distance in described step before.
1. also comprise the step of adjusting described ocular movement image capturing system angle and position before in described step.
The described virtual operational mode of target image of looking is for the apparent motion single speed flashes, the apparent motion sine flashes with apparent motion and alternately one of flashes; Described virtual look the target image be shaped as point-like or striated.
The virtual travel frequency scope of looking the target image of described point-like is 0.1Hz-0.5Hz; The virtual translational speed scope of looking the target image of described point-like is 20 °/s-40 °/s; The virtual figure frequency range of looking the target image of described striated is 0.01Hz-0.05Hz; Described striated is virtual, and to look peak speed scope that the target image changes by sinusoidal model be 40 °/s-60 °/s.
Described virtual angle of visual field scope of looking the target image is 45 degree-70 degree.
Compared with prior art, technical scheme of the present invention has the following advantages: 1. the present invention utilizes virtual the looking-eye movement reflex method of target of looking, adopt the virtual target optical presentation system of looking to produce the visual stimulus of realizing bringing out eye movement, described visual stimulus is a virtual image that utilizes transmission-type virtual image technology to produce, this virtual image looks like and is positioned at detected personnel's dead ahead, and at pseudo range is that 1 meter presents, and the collection of the demonstration of visual stimulus target and electrooculogram picture can be integrated in the video eyeshield, do not need traditional periphery to look target equipment; Being provided with all of various stimulus modelities, stimulus parameter can realize by software, need not special installation, debugging, makes detection more convenient; 2. realize the checkout facility that the inventive method is required, owing to cancelled huge ancillary equipment, the demonstration of visual stimulus target and the collection of electrooculogram picture can be integrated in the video eyeshield, reduced a large amount of mechanical parts, greatly reduce mechanical wear, guaranteed the service life of integral device; 3. realize the checkout facility that method of the present invention is required, the demonstration of visual stimulus target and the collection of electrooculogram picture are integrated in the video eyeshield, in testing process, can not produce mechanicalness noise, guaranteed the accuracy that detects to a certain extent.4. the method that adopts of the present invention, selecting the angle of visual field is 60 ° the virtual target image of looking, and making virtual looking under the prerequisite that the target image do not deform, guarantees accuracy of detection.
Description of drawings
For the easier quilt of content of the present invention is clearly understood, below according to a particular embodiment of the invention and in conjunction with the accompanying drawings, the present invention is further detailed explanation, wherein
Fig. 1 is that the present invention utilizes the virtual functional-block diagram of looking the looking of target-eye movement reflex method;
Fig. 2 is that the present invention utilizes the virtual virtual target optical presentation system direct viewing type optical system sketch map of looking of looking the looking of target-eye movement reflex method;
Fig. 3 is that the present invention utilizes the virtual virtual target optical presentation system screen distance sketch map of looking of looking the looking of target-eye movement reflex method;
Fig. 4 is that the present invention utilizes and measures pupil in the virtual image processing module of looking the looking of target-eye movement reflex method at the difference sketch map of position constantly.
Reference numeral is expressed as among the figure: 11-liquid crystal micro display, and the 12-eyepiece optical system, the 27-eyeball, the 28-virtual image, 29-video camera form, 30-follows the tracks of window, 31-pupil movement image
The specific embodiment
Present embodiment utilize virtual the looking-eye movement reflex method of target of looking, as shown in Figure 1, may further comprise the steps:
1. show the virtual target image of looking that is used for visual stimulus by the virtual target optical presentation system of looking: the described virtual target optical presentation system of looking is designed to comprise miniature image source unit and projecting optical unit, in the present embodiment, described miniature image source unit is used to show the described virtual liquid crystal micro display 11 of looking the target image, and described projecting optical unit adopts the eyepiece optical system of being made up of a plurality of lens 12.The described virtual target image of looking is looked stimulus signal that the target generation module sends and is stimulated and produce by virtual.The described virtual target generation module of looking produces stimulus signal, and by stimulation signal generator described stimulus signal is sent to described liquid crystal micro display 11, shows the described virtual target image of looking by described liquid crystal micro display 11.In the present embodiment, the described virtual target image of looking is a virtual image that utilizes transmission-type virtual image technology to produce, and the described virtual image is that 1 meter presents by described eyepiece optical system 12 at detected personnel's dead ahead, pseudo range.Detected personnel just can bring out the eye movement reflection of particular form by following the tracks of or watching the described virtual target image of looking attentively.
As shown in Figure 2, the described virtual target optical presentation system of looking adopts the virtual optics technology will be used to show that the described virtual described liquid crystal micro display 11 of looking the target image is placed within the eyepiece focus, generate a virtual image, the size of its image distance and picture is not subjected to the restriction of instrument size, utilizes object distance variation or eyepiece focal length to change and can make virtual image image distance satisfy pre-provisioning request.
The object lens imaging relations can be calculated by Gauss formula:
1/L′-1/L＝1/f′
The described virtual following design of adopting of target optical presentation system of looking:
Relative aperture: (1/3.4);
The angle of visual field: 2 ω=54 ° (47 ° * 34 °);
Focal length: f '=15mm;
Emergent pupil: Φ
p=4.5mm;
Emergent pupil distance: L
p=25mm.
Optical system of the present invention is a direct viewing type, and the design relative aperture that is adopted is big, and emergent pupil is long, and the angle of visual field is bigger than normal, and the structure more complicated needs careful aberration correction.Again as shown in Figure 2, in detected personnel's eyeball 27 the place aheads, and pseudo range is that 1m place far away forms a virtual image 28 to described liquid crystal micro display 11, is the described virtual target image of looking by described eyepiece optical system 12.
In the present embodiment, the described virtual described liquid crystal micro display 11 of looking the employing of target optical presentation system is 0.61 " high-resolution OLED colour liquid crystal display device, pixel number are 800 * 600, employing transmission-type virtual image, observing the angle of visual field is 60 °.
The present invention has following two kinds by the described virtual described virtual target image of looking of looking the generation of target optical presentation system:
(1) (range of error: the luminous point that moves of different frequency or random model ± 5%), Move Mode is sine or square wave with 0.1Hz, 0.2Hz, 0.4Hz, 0.5Hz.The luminous point sizableness that produces is at the 1.0m place, the garden shape speck of Φ=5mm.
(2) be 60 °/s by 20 °/s, 30 °/s, 40 °/s constant speed mode or by peak speed, frequency is the black and white clause that the sinusoidal model of 0.05Hz rolls, range of error: ± 5%.
As shown in Figure 3, the angle of visual field of looking the virtual demonstration of target in the present embodiment is 60 °, is example with the black and white clause, is 60 °/s if require rolling speed, just wants any a pair of black and white clause to move on to the other end from one of the visual field in 1 second.Press the standard of normal video image, be exactly every and move 60 °/50=1.2 °, in other words 1/50 of every approximate moving screen.Display screen is a plane, if consider the situation (as shown in phantom in FIG.) on the face of cylinder, the distance on the screen of identical angle of circumference correspondence can accurately be calculated.Distance D 1 on the screen of same θ angle correspondence is different with D2.
D2=Rtan θ, D1+D2=Rtan (2 θ), if, θ=15 °, R=1m, then
D2＝R·tanθ＝0.268(m)
D1＝R·tan(2θ)-D2＝0.309(m)
By that analogy, can accurately calculate the virtual distance of target image lines on screen of looking.Equally, the width of lines also can be revised according to the angle that departs from screen center.
2. absorb detected personnel by the described virtual ocular movement image that the target image causes of looking by the ocular movement image capturing system.Described ocular movement image capturing system is a biocular systems, can satisfy the monocular requirement and also can satisfy the binocular requirement, absorbs two eyes respectively by the described virtual ocular movement image that the target image causes of looking with two miniature thermal cameras.
In the present embodiment, described miniature thermal camera adopts the black and white cmos camera, its photosensitive area: 4.9mm * 3.7mm, work illumination: 0Lux, standard: field frequency 25Hz, line frequency 15625Hz, image resolution ratio: 〉=300TVL.And also further adopt the veiling glare of infrared illumination system elimination in the present embodiment from described liquid crystal micro display 11 screens, on described miniature thermal camera, add simultaneously and joins infrared fileter, to arrive better filter effect.
The design of the biocular systems of described ocular movement image capturing system can be with reference to following standard:
Parallelism of optical axis: vertical direction＜15 '
Horizontal direction: convergence＜20 '
Horizontal direction: disperse＜60 '
Visual amplification is poor:＜2%
Left and right sides optical system is relatively as inclination:＜30 '
Left and right sides transmissivity of optical system is poor :≤15%.
3. by image processing module described ocular movement image is handled, form the time dependent curve of pupil position: the ocular movement image by the detected personnel of described ocular movement image capturing system picked-up is sent to described image processing module, utilize the pupil part difference of eyeball other parts contrast (gray scale) relatively, described image processing module is separated pupil movement image 31, form the pupillomotor video signal of representative, and automatically described pupil movement image 31 is carried out Tracking Recognition, as shown in Figure 4, in video camera form 29, be provided with and follow the tracks of window 30, show the described pupil movement image 31 that Tracking Recognition goes out in the described tracking window 30.Principle according to television measurement, TV measurement calculates pupil different pupillomotor two-dimensional coordinates constantly in CMOS target surface coordinate system, i.e. pupil movement image 31 different positions (Δ Xt, Δ Yt) constantly in video camera target surface coordinate system.Then, according to pupil position data (Δ Xt by the time sequence measuring, Δ Yt), point-by-point mapping one-tenth (X-t) and (Y-t) aircraft pursuit course respectively in the target surface coordinate system, therefrom can analyze the kinestate of pupil, each need draw 2 curves every eye, is respectively pupil horizontal level curve and pupil upright position curve over time over time.
In the method for the present invention, described step described virtual in 1. can be looked target optical presentation system and the described step described ocular movement image capturing system in 2. and be integrated in the video eyeshield, make very convenient to carry.And method of the present invention also can increase a command reception system such as earphone, is used for detected personnel and receives instruction.
Among the present invention, the described virtual operational mode of target image of looking is for the apparent motion single speed flashes, the apparent motion sine flashes with apparent motion and alternately one of flashes; Described virtual look the target image be shaped as point-like or striated.The virtual travel frequency scope of looking the target image of described point-like is 0.1Hz-0.5Hz, can be 0.1Hz, 0.15Hz, 0.35Hz or 0.5Hz equivalence, range of error is ± and 5%; The virtual translational speed scope of looking the target image of described point-like is 20 °/s-40 °/s, can be 20 °/s, 26 °/s or 40 °/s equivalence.The virtual figure frequency range of looking the target image of described striated is 0.01Hz-0.05Hz, can be 0.01Hz, 0.024Hz, 0.05Hz equivalence, range of error is ± and 5%; Described striated is virtual, and to look peak speed scope that the target image changes by sinusoidal model be 40 °/s-60 °/s, can be 40 °/s, 52 °/s or 60 °/s equivalence.Above-mentioned virtual frequency and velocity interval of looking the target image is most preferred range, can't detect people's eye movement if the numerical value of frequency and speed is too small, and human eye can't resolution image if the numerical value of frequency and speed is excessive, and what see will be straight line.In a word, the numerical value of above-mentioned virtual frequency of looking the target image and speed be excessive or too small all can't be normally, exactly the scrutineer vestibular function.
In other embodiments, 3. also comprise the image information analysis module in described step after, by comparative analysis with time dependent curve of described pupil position and predetermined threshold value, determine the step of vestibular function state: according to the pupil position variation of change curve in time that different stimulated produced, certain threshold values is set, each relevant composition to slow phase, snap shot and other form eye movement of nystagmus is discerned, by the various parameters of method computational analysiss such as difference based on slow phase velocity etc., final analysis, the detected personnel's of evaluation vestibular function state.
Among other embodiment, also comprise the step of regulating interpupillary distance before 1., can adopt the interpupillary distance governor motion to adjust described virtual interpupillary distance of looking eyepiece optical system 12 described in the target optical presentation system in described step.Among other embodiment, also comprise the step of adjusting in the described ocular movement image capturing system two miniature thermal camera angles and position before 1. in described step, to obtain the ocular movement image more accurately.
In other embodiments, the described virtual described virtual angle of visual field of looking the target image of looking the demonstration of target optical presentation system can be 45 ° or 70 °, and described virtual angle of visual field scope of looking the target image is 45 °-70 °.If the angle of visual field can not guarantee the accuracy that detects less than 45 °, adopt the angle of visual field that the described virtual target image of looking is deformed greater than 70 °, influence accuracy of detection equally.Therefore, the present invention selects the angle of visual field of 45 ° of-70 ° of scopes, and optimum is that the angle of visual field is 60 °, can reach the good detection precision.
Obviously, the foregoing description only is the example that provides for clearly illustrating, they are not to be limitation of the present invention.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here need not also can't give exhaustive to all embodiments.And conspicuous variation of being extended out thus or change must fall into protection scope of the present invention.
Claims (5)
1, a kind ofly utilize virtual the looking-eye movement reflex method of target of looking, it is characterized in that, may further comprise the steps:
1. show the virtual target image of looking that is used for visual stimulus by the virtual target optical presentation system of looking, the described virtual operational mode of target image of looking is for the apparent motion single speed flashes, the apparent motion sine flashes with apparent motion and alternately one of flashes; Described virtual look the target image be shaped as point-like or striated; The virtual travel frequency scope of looking the target image of described point-like is 0.1Hz-0.5Hz; The virtual translational speed scope of looking the target image of described point-like is 20 °/s-40 °/s; The virtual figure frequency range of looking the target image of described striated is 0.01Hz-0.05Hz; Described striated is virtual, and to look peak speed scope that the target image changes by sinusoidal model be 40 °/s-60 °/s;
2. absorb detected personnel by the described virtual ocular movement image that the target image causes of looking by the ocular movement image capturing system;
3. by image processing module described ocular movement image is handled, formed the time dependent curve of pupil position.
2, according to claim 1ly utilize virtual the looking-eye movement reflex method of target of looking, it is characterized in that: the described virtual target image of looking is looked stimulus signal that the target generation module sends and is stimulated and produce by virtual.
3, according to claim 1ly utilize virtual the looking-eye movement reflex method of target of looking, it is characterized in that: also comprise the step of regulating interpupillary distance before 1. in described step.
4, according to claim 1ly utilize virtual the looking-eye movement reflex method of target of looking, it is characterized in that: also comprise the step of adjusting described ocular movement image capturing system angle and position before 1. in described step.
5, according to claim 1 and 2ly utilize virtual the looking-eye movement reflex method of target of looking, it is characterized in that: described virtual angle of visual field scope of looking the target image is 45 degree-70 degree.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2008100942229A CN100569176C (en) | 2008-04-23 | 2008-04-23 | A kind ofly utilize virtual the looking-eye movement reflex method of target of looking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2008100942229A CN100569176C (en) | 2008-04-23 | 2008-04-23 | A kind ofly utilize virtual the looking-eye movement reflex method of target of looking |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101273880A CN101273880A (en) | 2008-10-01 |
| CN100569176C true CN100569176C (en) | 2009-12-16 |
Family
ID=39994052
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2008100942229A Expired - Fee Related CN100569176C (en) | 2008-04-23 | 2008-04-23 | A kind ofly utilize virtual the looking-eye movement reflex method of target of looking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100569176C (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102824160B (en) * | 2011-06-17 | 2015-01-21 | 北京爱生科贸有限公司 | Eyeball movement monitoring method and equipment thereof |
| CN107072523A (en) * | 2014-08-22 | 2017-08-18 | 华柏恩视觉诊断公司 | For monitoring dynamic system, the method and apparatus to check visual field of eye |
| PT3247256T (en) * | 2015-01-20 | 2022-02-02 | Green C Tech Ltd | Method and system for automatic eyesight diagnosis |
| FR3041230B1 (en) * | 2015-09-18 | 2022-04-15 | Suricog | METHOD FOR DETERMINING ANATOMICAL PARAMETERS |
| CN106214118A (en) * | 2016-01-28 | 2016-12-14 | 北京爱生科贸有限公司 | A kind of ocular movement based on virtual reality monitoring system |
| US10485420B2 (en) * | 2017-02-17 | 2019-11-26 | Analog Devices Global Unlimited Company | Eye gaze tracking |
| CN110215185B (en) * | 2019-06-05 | 2022-01-11 | 北京清华长庚医院 | Eyeball protrusion measuring equipment |
| CN110769243A (en) * | 2019-10-22 | 2020-02-07 | 天津大学 | Binocular eye movement acquisition system under stimulation of high-definition naked eye 3D (three-dimensional) video |
| CN113633257B (en) * | 2021-07-29 | 2023-12-05 | 佛山市第一人民医院（中山大学附属佛山医院） | Vestibular function checking method, system, equipment and medium based on virtual reality |
| CN115670373B (en) * | 2022-10-27 | 2023-06-16 | 北京中科睿医信息科技有限公司 | Eye movement detection method, device, equipment and medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4702575A (en) * | 1981-05-11 | 1987-10-27 | The United States Of America As Represented By The Secretary Of The Navy | Helmet mounted eye tracker using a position sensing detector |
-
2008
- 2008-04-23 CN CNB2008100942229A patent/CN100569176C/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4702575A (en) * | 1981-05-11 | 1987-10-27 | The United States Of America As Represented By The Secretary Of The Navy | Helmet mounted eye tracker using a position sensing detector |
Non-Patent Citations (2)
| Title |
|---|
| 动态视力检查与前庭功能评定. 贾宏博，郭世俊.中华耳科学杂志，第4卷第4期. 2006 |
| 动态视力检查与前庭功能评定. 贾宏博，郭世俊.中华耳科学杂志，第4卷第4期. 2006 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101273880A (en) | 2008-10-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100569176C (en) | A kind ofly utilize virtual the looking-eye movement reflex method of target of looking | |
| CN100579446C (en) | Portable atria function detecting equipment | |
| CN103595912B (en) | The imaging method and device of local scale | |
| US6890077B2 (en) | Method and apparatus for high resolution video image display | |
| CN103776419B (en) | A kind of binocular distance measurement method improving measurement range | |
| KR100949743B1 (en) | Apparatus and method for wearable eye tracking having goggle typed | |
| CN103533340B (en) | The bore hole 3D player method of mobile terminal and mobile terminal | |
| CN104154898B (en) | A kind of initiative range measurement method and system | |
| US11116395B1 (en) | Compact retinal scanning device for tracking movement of the eye's pupil and applications thereof | |
| WO2013175701A1 (en) | Video analysis device, video analysis method, and point-of-gaze display system | |
| CN106214118A (en) | A kind of ocular movement based on virtual reality monitoring system | |
| CN1687956A (en) | Self-aid man face image acquiring system based on ultrasonic distance measurement | |
| US20090059364A1 (en) | Systems and methods for electronic and virtual ocular devices | |
| RU2013153220A (en) | REDUCTION OF ALIGNMENT DISTANCE UNDER CONTROL OF THE IMAGE PROCESSOR FOR OPHTHALMIC SYSTEMS | |
| WO2015192506A1 (en) | 3d glasses and 3d display system | |
| CN107991775B (en) | Head-mounted visual equipment capable of tracking human eyes and human eye tracking method | |
| JP2020526735A (en) | Pupil distance measurement method, wearable eye device and storage medium | |
| CN102313525B (en) | Laser beam parallelism regulating system and regulating method thereof | |
| WO2015085692A1 (en) | Open head-mounted display device and display method thereof | |
| KR20140014870A (en) | Gaze tracking apparatus and method | |
| TW201705041A (en) | Gaze analysis method and apparatus | |
| KR101739768B1 (en) | Gaze tracking system at a distance using stereo camera and narrow angle camera | |
| KR101526557B1 (en) | Apparatus and method for gaze tracking based on multiple camera | |
| CN109194851A (en) | A kind of ultrashort burnt Vision imaging system of miniaturization | |
| CN205679856U (en) | There is gesture and control the head-mounted display of function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20091216 Termination date: 20100423 |