CN104767972A - Visual defect help system and method - Google Patents
Visual defect help system and method Download PDFInfo
- Publication number
- CN104767972A CN104767972A CN201510155633.4A CN201510155633A CN104767972A CN 104767972 A CN104767972 A CN 104767972A CN 201510155633 A CN201510155633 A CN 201510155633A CN 104767972 A CN104767972 A CN 104767972A
- Authority
- CN
- China
- Prior art keywords
- defects
- user
- vision
- real
- real scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000007547 defect Effects 0.000 title claims abstract description 81
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000000007 visual effect Effects 0.000 title abstract 9
- 230000002452 interceptive effect Effects 0.000 claims abstract description 12
- 230000004438 eyesight Effects 0.000 claims description 87
- 230000008878 coupling Effects 0.000 claims description 9
- 238000010168 coupling process Methods 0.000 claims description 9
- 238000005859 coupling reaction Methods 0.000 claims description 9
- 230000015572 biosynthetic process Effects 0.000 claims description 7
- 238000003786 synthesis reaction Methods 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000010365 information processing Effects 0.000 abstract 3
- 230000007613 environmental effect Effects 0.000 abstract 1
- 201000009310 astigmatism Diseases 0.000 description 10
- 208000001491 myopia Diseases 0.000 description 10
- 230000004379 myopia Effects 0.000 description 10
- 208000029257 vision disease Diseases 0.000 description 10
- 230000004393 visual impairment Effects 0.000 description 10
- 206010047571 Visual impairment Diseases 0.000 description 9
- 210000000695 crystalline len Anatomy 0.000 description 6
- 239000011521 glass Substances 0.000 description 6
- 238000003709 image segmentation Methods 0.000 description 4
- 210000001525 retina Anatomy 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 4
- 230000002950 deficient Effects 0.000 description 3
- 230000036040 emmetropia Effects 0.000 description 3
- 206010020675 Hypermetropia Diseases 0.000 description 2
- 230000004305 hyperopia Effects 0.000 description 2
- 201000006318 hyperopia Diseases 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 210000001328 optic nerve Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
Landscapes
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
- Eyeglasses (AREA)
- Image Processing (AREA)
Abstract
The invention provides a visual defect help system. The visual defect help system is characterized in that the system comprises an interactive device (1), an information processing device (2) and an application device (3); the interactive device (1) and the information processing device (2) are both arranged in a body, and the information processing device can form a normal real scene capable of being seen by a user by matching the real scene which is subjected to image processing and the visual defect parameters of the user. The invention further provides a corresponding visual defect help method. The visual defect help system and method have the advantages that the user with visual defects can be effectively helped to see objects normally, the universality is achieved, and the system can be used by people with different visual defects; the whole life cycle is realized, and the system can be used by the same user in different periods of time; meanwhile, various visual defects are compatible, environmental protection and sanitation are achieved, and lenses of various models do not need to be produced any more.
Description
Technical field
The present invention relates to technical field of virtual reality, more particularly, relate to a kind of defects of vision help system and method.
Background technology
The eyes of people are equivalent to a frame camera.Crystalline lens is equivalent to the camera lens of camera, and retina is equivalent to the film in camera.The real image that the light sent from object forms a handstand on the retina through crystalline lens (being equivalent to convex lens), reduces.This stimulation is passed to brain by optic nerve by distribution photosensory cell on the retina, and people will see object.And visual impairment (i.e. the defects of vision) to be exactly the adjustment depending merely on self eye can not make picture become on the retina.Visual impairment comprises myopia, long sight, astigmatism, stravismus etc.
At present, the visual impairment solving people adopts usually wears glasses to correct defects of vision, and makes to see object.The most original glasses originate from lens (magnifying glass), and the appearance of its manufacture, application and optical lens is closely related.But existing glasses function ratio is more fixing, as spectacles usually can only myopia correction, be not suitable for the crowd simultaneously with myopia and astigmatism defect.Meanwhile, different visual impairments must select specific glasses, to carry out vision correction, does not possess versatility, when visual impairment changes, as the number of degrees change etc. of myopia, obtains constantly the eyeglass of the adaptive various model number of degrees, causes the wasting of resources.
Summary of the invention
The technical problem to be solved in the present invention is, for the deficiency of the glasses of existing solution visual impairment, provides a kind of defects of vision help system and method.
The technical scheme that the present invention solves the problem there is provided a kind of defects of vision help system, it is characterized in that, described system comprises interactive device, information processor and application apparatus;
Described interactive device comprises:
For Real-time Collection user eyes see the camera of the real scene of part; And
For to described camera institute Real-time Collection to described real scene carry out the image processing apparatus of image procossing, wherein, described image processing apparatus and described camera are electrically connected;
Described application apparatus comprises:
For obtaining the detecting unit of the actual eyesight information of described user; And
Described actual eyesight information analysis for obtaining according to described detecting unit goes out the defects of vision parameter of described user and feeds back to the analytic unit of described information processor, and wherein, described detecting unit and described analytic unit are electrically connected;
Described information processor comprises:
For carrying out communicating with described image processing apparatus and receiving the first receiver module of the described real scene through image procossing;
For carrying out communicating with described analytic unit and accepting the second receiver module of the described defects of vision parameter of the described user that described analytic unit is analyzed out; And
For according to the band-wise processing unit synthesizing the normal outdoor scene that described user sees through the described real scene of image procossing and the described defects of vision parameter matching of described user, wherein, described first receiver module and described image processing apparatus communicate to connect, are electrically connected with described band-wise processing unit; Described second receiver module and described band-wise processing unit are electrically connected, communicate to connect with described analytic unit.
In defects of vision help system of the present invention, described system also comprises the body mated with the eye of described user.
In defects of vision help system of the present invention, described interactive device and described information processor are all arranged in described body.
In defects of vision help system of the present invention, described application apparatus is independent of described body.
In defects of vision help system of the present invention, described system also comprises the display unit for the described normal outdoor scene of described band-wise processing units match synthesis being carried out showing.
In defects of vision help system of the present invention, described display unit is arranged at the surface of described body, and the eye interval of described user is connected.
Present invention also offers a kind of defects of vision helping method, it is characterized in that, said method comprising the steps of:
The eyes of S1, Real-time Collection user see the real scene of part;
S2, to institute's Real-time Collection to described real scene carry out image procossing;
S3, obtain the actual eyesight information of described user;
S4, go out the defects of vision parameter of described user according to the actual eyesight information analysis of described user;
S5, according to through the described real scene of image procossing and the described defects of vision parameter of described user, coupling synthesizes the normal outdoor scene that described user sees.
In defects of vision helping method of the present invention, described method comprises further:
The described normal outdoor scene that the described user of coupling synthesis sees is shown.
In defects of vision helping method of the present invention, also comprised before described step S5: the described defects of vision parameter receiving described real scene through image procossing and described user respectively.
The beneficial effect implementing defects of vision help system of the present invention and method has: effectively help have the user of the defects of vision normally to see object, it has versatility, and different visual impairment persons all can use; It has life cycle management, and same user all can use at different times; Meanwhile, all compatible to various visual impairment, environmentally-friendly sanitary, no longer needs the eyeglass producing various model.
Accompanying drawing explanation
Fig. 1 is the structural representation of the defects of vision help system of one embodiment of the invention.
Fig. 2 is the structural representation of the defects of vision help system of another embodiment of the present invention.
Fig. 3 is the flow chart of the defects of vision helping method of the embodiment of the present invention.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
As shown in Figure 1, be the structural representation of defects of vision help system of one embodiment of the invention.Described system comprises interactive device 1, information processor 2, application apparatus 3 and body 4, and interactive device 1, information processor 2 and application apparatus 3 are all arranged in body 4, wherein:
Body 4 mates with the eye of user, and its shape can be similar to mirror holder, but is not limited thereto;
Interactive device 1 comprises camera 11 and image processing apparatus 12, wherein, camera 11 for Real-time Collection user eyes see the real scene of part; Image processing apparatus 12 carries out image procossing for the real scene collected camera 11, and the operation of image procossing comprises to be undertaken, for digitlization, making to be converted into digital picture by scene; Image processing apparatus 12 and camera 11 are electrically connected;
Information processor 2 comprises the first receiver module 21, band-wise processing unit 22 and the second receiver module 23, and wherein, the first receiver module 21 is for carrying out communicating and the real scene received through image procossing with image processing apparatus 12; First receiver module 21 communicates to connect with image processing apparatus 12, is electrically connected with band-wise processing module 22; Second receiver module 23 is electrically connected with band-wise processing unit 22;
Application apparatus 3 comprises detecting unit 31 and analytic unit 32, and wherein, detecting unit 31 is for obtaining the actual eyesight information of user; Analytic unit 32 goes out the defects of vision parameter of user for the actual eyesight information analysis obtained according to detecting unit 31 and feeds back to information processor 2, defects of vision parameter comprises the information such as myopia, long sight, astigmatism, stravismus, and it obtains by eyesight information when actual eyesight information and people's emmetropia being analyzed; Detecting unit 31 and analytic unit 32 are electrically connected; Analytic unit 32 and the second receiver module 23 communicate to connect;
Second receiver module 23 is for carrying out communicating with analytic unit 32 and accepting the defects of vision parameter of the user that analytic unit 32 is analyzed out;
The defects of vision parameter of the real scene through image procossing of band-wise processing unit 22 received by the first receiver module 21 and the user received by the second receiver module 22, coupling synthesizes the normal outdoor scene that user sees, defects of vision parameter as user comprises myopia degree information or hyperopia degree information, then correspondingly digitized image is zoomed in or out, thus reach the normal outdoor scene that user sees.
If when defects of vision parameter comprises astigmatism degree information, correspondingly, the operation of band-wise processing unit 22 comprises: to digitlization Image Segmentation Using, form multiple subgraph, subgraph after the segmentation that orientation again residing for astigmatism degree is corresponding amplifies, further multiple subgraph is synthesized, form whole image, with the normal outdoor scene making the user with astigmatism defect can see simultaneously;
If when defects of vision parameter comprises stravismus information, correspondingly, the operation of band-wise processing unit 22 comprises: to digitlization Image Segmentation Using, form multiple image, subgraph after the segmentation that orientation again residing for stravismus information is corresponding carries out translation and image enhaucament, further multiple subgraph is synthesized, form whole image, with the normal outdoor scene making the user with stravismus defect see.
Described system also comprises display unit 5, normal outdoor scene for band-wise processing unit 22 being mated synthesis shows, user can see, display unit 5 is arranged on the surface of body 4, and the eye interval of user is connected, transparence can be made into, the eyeglass of its size and common spectacles in the same size.
Can find out, the defects of vision help system of the present embodiment reaches and helps have the user of the defects of vision normally to see object, and make defective human eye obtain normal vision, and this system configuration is simple, lightweight, person easy to use wears.
As shown in Figure 2, be the structural representation of defects of vision help system of another embodiment of the present invention.In the present embodiment, be with the difference of a upper embodiment: interactive device 1 and information processor 2 are all arranged in body 4, application apparatus 3 is separately as an equipment, independent of body 4, further mitigate the weight that user is worn on eye, identical with a upper embodiment of other guide, for saving space, does not repeat them here.
As shown in Figure 3, be the flow chart of defects of vision helping method of the embodiment of the present invention.Said method comprising the steps of:
The eyes of S301, Real-time Collection user see the real scene of part;
In this step, the eyes of user see that the real scene of part is 180 degree, comprise the scene of dead ahead, right and left.
S302, to institute's Real-time Collection to real scene carry out image procossing;
In this step, the operation of image procossing comprises and is carried out, for digitlization, making to be converted into digital picture by real scene.
The actual eyesight information of S303, acquisition user;
S304, go out the defects of vision parameter of user according to actual eyesight information analysis;
In this step, defects of vision parameter comprises the information such as myopia, long sight, astigmatism, stravismus, eyesight information when actual eyesight information and people's emmetropia is analyzed, obtain defects of vision parameter, as user be myopia time, gather the myopia degree information of eyes respectively, wherein, eyesight information during people's emmetropia is according to standard medically.
S305, according to through the real scene of image procossing and the defects of vision parameter of user, coupling synthesizes the normal outdoor scene that user sees.
In this step, real scene through image procossing is digitized image, according to the defects of vision parameter of user, digitized image is operated accordingly, to synthesize the normal outdoor scene that user sees, defects of vision parameter as user comprises myopia degree information or hyperopia degree information, then correspondingly zoom in or out digitized image, thus reaches the normal outdoor scene that user sees.
If when defects of vision parameter comprises astigmatism degree information, correspondingly, to digitlization Image Segmentation Using, form multiple subgraph, subgraph after the segmentation that orientation again residing for astigmatism degree is corresponding amplifies, further multiple subgraph is synthesized, form whole image, with the normal outdoor scene making the user with astigmatism defect can see simultaneously.
If when defects of vision parameter comprises stravismus information, correspondingly, to digitlization Image Segmentation Using, form multiple image, subgraph after the segmentation that orientation again residing for stravismus information is corresponding carries out translation and image enhaucament, further multiple subgraph is synthesized, form whole image, with the normal outdoor scene making the user with stravismus defect see.
Before this step, the defects of vision parameter of real scene and the user received respectively through image procossing is also comprised.
Further, described method also comprises: the normal outdoor scene that the user of coupling synthesis sees shown.
The defects of vision helping method of the present embodiment, by the eyes of Real-time Collection user see the scene of part and the defects of vision parameter of user self, carry out coupling synthesis, the normal outdoor scene that the human eye obtaining defective user can be seen, effectively help have the user of the defects of vision normally to see object, correct defects of vision, make defective human eye obtain normal vision, and the method is simple.
To sum up, defects of vision help system of the present invention and method, help have the user of the defects of vision normally to see object effectively; Have versatility, different visual impairment persons all can use; It has life cycle management, and same user all can use at different times; Meanwhile, all compatible to various visual impairment, environmentally-friendly sanitary, no longer needs the eyeglass producing various model.
The above; be only the present invention's preferably embodiment, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; the change that can expect easily or replacement, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claim.
Claims (9)
1. a defects of vision help system, is characterized in that, described system comprises interactive device (1), information processor (2) and application apparatus (3);
Described interactive device (1) comprising:
For Real-time Collection user eyes see the camera (11) of the real scene of part; And
For to described camera (11) institute Real-time Collection to described real scene carry out the image processing apparatus (12) of image procossing, wherein, described image processing apparatus (12) and described camera (11) are electrically connected;
Described application apparatus (3) comprising:
For obtaining the detecting unit (31) of the actual eyesight information of described user; And
Described actual eyesight information analysis for obtaining according to described detecting unit (31) goes out the defects of vision parameter of described user and feeds back to the analytic unit (32) of described information processor (2), wherein, described detecting unit (31) and described analytic unit (32) are electrically connected;
Described information processor (2) comprising:
For carrying out communicating with described image processing apparatus (12) and receiving the first receiver module (21) through the described real scene of image procossing;
For carrying out communicating with described analytic unit (32) and accepting the second receiver module (23) that described analytic unit (32) analyzes the described defects of vision parameter of described user out; And
For according to the band-wise processing unit (22) synthesizing the normal outdoor scene that described user sees through the described real scene of image procossing and the described defects of vision parameter matching of described user, wherein, described first receiver module (21) and described image processing apparatus (12) communicate to connect, are electrically connected with described band-wise processing unit (22); Described second receiver module (23) and described band-wise processing unit (22) are electrically connected, and described analytic unit (32) communicate to connect.
2. according to the defects of vision help system described in claim 1, it is characterized in that, described system also comprises the body (4) mated with the eye of described user.
3. according to the defects of vision help system described in claim 2, it is characterized in that, described interactive device (1) and described information processor 2 are all arranged in described body (4).
4. according to the defects of vision help system described in claim 3, it is characterized in that, described application apparatus (3) is independent of described body (4).
5. according to the defects of vision help system described in claim 1, it is characterized in that, described system also comprises the display unit (5) for the described normal outdoor scene of described band-wise processing unit (22) coupling synthesis being carried out showing.
6. according to the defects of vision help system described in claim 5, it is characterized in that, described display unit (5) is arranged at the surface of described body (4), and the eye interval of described user is connected.
7. a defects of vision helping method, is characterized in that, said method comprising the steps of:
The eyes of S1, Real-time Collection user see the real scene of part;
S2, to institute's Real-time Collection to described real scene carry out image procossing;
S3, obtain the actual eyesight information of described user;
S4, go out the defects of vision parameter of described user according to the actual eyesight information analysis of described user;
S5, according to through the described real scene of image procossing and the described defects of vision parameter of described user, coupling synthesizes the normal outdoor scene that described user sees.
8. according to the defects of vision helping method described in claim 7, it is characterized in that, described method comprises further:
The described normal outdoor scene that the described user of coupling synthesis sees is shown.
9. according to the defects of vision helping method described in claim 5, it is characterized in that, also comprised before described step S5: the described defects of vision parameter receiving described real scene through image procossing and described user respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510155633.4A CN104767972B (en) | 2015-04-02 | 2015-04-02 | A kind of defects of vision help system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510155633.4A CN104767972B (en) | 2015-04-02 | 2015-04-02 | A kind of defects of vision help system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104767972A true CN104767972A (en) | 2015-07-08 |
| CN104767972B CN104767972B (en) | 2018-06-15 |
Family
ID=53649543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510155633.4A Expired - Fee Related CN104767972B (en) | 2015-04-02 | 2015-04-02 | A kind of defects of vision help system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104767972B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105832503A (en) * | 2016-03-17 | 2016-08-10 | 广东小天才科技有限公司 | Picture output method and device for strabismus correction |
| CN106127171A (en) * | 2016-06-28 | 2016-11-16 | 广东欧珀移动通信有限公司 | Display packing, device and the terminal of a kind of augmented reality content |
| CN110007482A (en) * | 2019-04-12 | 2019-07-12 | 上海交通大学医学院附属第九人民医院 | A kind of measuring and calculating platform and its application method for calculating multifocal spectacles focal position |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007214964A (en) * | 2006-02-10 | 2007-08-23 | Konica Minolta Photo Imaging Inc | Video display device |
| CN201315627Y (en) * | 2008-12-30 | 2009-09-23 | 蒋清晓 | Multifunctional portable-type electronic typoscope |
| CN101833543A (en) * | 2010-05-07 | 2010-09-15 | 李响 | Naked-eye three-dimensional display method for characters |
| JP2012160096A (en) * | 2011-02-02 | 2012-08-23 | Brother Ind Ltd | Information processing device, information processing program, and information processing system |
| WO2014203440A1 (en) * | 2013-06-19 | 2014-12-24 | パナソニックＩｐマネジメント株式会社 | Image display device and image display method |
-
2015
- 2015-04-02 CN CN201510155633.4A patent/CN104767972B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007214964A (en) * | 2006-02-10 | 2007-08-23 | Konica Minolta Photo Imaging Inc | Video display device |
| CN201315627Y (en) * | 2008-12-30 | 2009-09-23 | 蒋清晓 | Multifunctional portable-type electronic typoscope |
| CN101833543A (en) * | 2010-05-07 | 2010-09-15 | 李响 | Naked-eye three-dimensional display method for characters |
| JP2012160096A (en) * | 2011-02-02 | 2012-08-23 | Brother Ind Ltd | Information processing device, information processing program, and information processing system |
| WO2014203440A1 (en) * | 2013-06-19 | 2014-12-24 | パナソニックＩｐマネジメント株式会社 | Image display device and image display method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105832503A (en) * | 2016-03-17 | 2016-08-10 | 广东小天才科技有限公司 | Picture output method and device for strabismus correction |
| CN106127171A (en) * | 2016-06-28 | 2016-11-16 | 广东欧珀移动通信有限公司 | Display packing, device and the terminal of a kind of augmented reality content |
| CN110007482A (en) * | 2019-04-12 | 2019-07-12 | 上海交通大学医学院附属第九人民医院 | A kind of measuring and calculating platform and its application method for calculating multifocal spectacles focal position |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104767972B (en) | 2018-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016054860A1 (en) | Head wearing type vision auxiliary system for patient with vision disorder | |
| CN204101815U (en) | A kind of virtual glasses repaid based on optics and pattern distortion complementation | |
| CA2781064C (en) | Image magnification on a head mounted display | |
| CN109820524B (en) | Wearable system for acquiring and classifying eye movement characteristics of autism based on FPGA (field programmable Gate array) | |
| US12062430B2 (en) | Surgery visualization theatre | |
| WO2016086742A1 (en) | Microlens array based near-eye display (ned) | |
| CN104090371B (en) | A kind of 3D glasses and 3D display systems | |
| CN104570347B (en) | Head-mounted display device and imaging method thereof | |
| CN109001906A (en) | Wearable display | |
| CN201768134U (en) | Head-worn type visual enhance system | |
| CN104345454B (en) | Head-mounted vision auxiliary system and imaging method thereof | |
| EP1158338A3 (en) | Method for simulating an ocular optical system and apparatus therefor | |
| CN108064447A (en) | Method for displaying image, intelligent glasses and storage medium | |
| CN113391449B (en) | Intelligent vision expanding visual aid and intelligent vision expanding visual aid method | |
| KR20170140277A (en) | Glasses structure that enables image enhancement | |
| CN104767972A (en) | Visual defect help system and method | |
| WO2016086438A1 (en) | Head-mounted multimedia terminal auxiliary viewing system for visually impaired person | |
| CN206002773U (en) | A kind of display device and the headset equipment using this display device | |
| AU2020411416B2 (en) | See-through eyeglasses used for vision enhancement | |
| CN102798981B (en) | Biomimetic 3D (three dimensional) stereoimaging system | |
| CN105738981A (en) | Lens and camera lens comprising the same and head-worn display | |
| TW201805689A (en) | Add-on near eye display device characterized in that sharpened images are outputted onto the transparent display so that they are superposed on scenes viewed with naked eyes of the user | |
| CN206258625U (en) | A kind of head-mounted display apparatus | |
| CN203882018U (en) | 3D glasses and 3D display system | |
| CN204479842U (en) | A kind of head mounted display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180615 |