CN103323113A - Multispectral imager based on light fieldd imaging technique - Google Patents
Multispectral imager based on light fieldd imaging technique Download PDFInfo
- Publication number
- CN103323113A CN103323113A CN2013102070682A CN201310207068A CN103323113A CN 103323113 A CN103323113 A CN 103323113A CN 2013102070682 A CN2013102070682 A CN 2013102070682A CN 201310207068 A CN201310207068 A CN 201310207068A CN 103323113 A CN103323113 A CN 103323113A
- Authority
- CN
- China
- Prior art keywords
- image
- microlens array
- ultraviolet
- visible light
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The invention relates to a multispectral imager based on the light field imaging technique. The multispectral imager based on the light field imaging technique solves the problem that an existing multispectral imager cannot achieve simultaneous focus imaging of targets with different distances away from the multispectral imager within the field range and cannot recover an image out of focus. The multispectral imager based on the light field imaging technique comprises a visual camera lens, a visual microlens array, a visual image detector, a near-infrared camera lens, a near-infrared microlens array, a near-infrared image detector, an ultraviolet camera lens, an ultraviolet microlens array, an ultraviolet array image detector, an image acquisition and control device, and an image processing and display device. According to the multispectral imager based on the light field imaging technique, due to the fact that the microlens arrays are additionally arranged at the front ends of the image detectors in all wave bands, four-dimensional light field image information instead of traditional two-dimensional image information is recorded and saved, no hardware focusing auxiliary device is needed, refocusing of different targets within the field range can be achieved through reconstruction of a two-dimensional image of an image processing module, and the multi-target and multiband image analyzing performance of the multispectral imager is further improved.
Description
Technical field
The present invention relates to a kind of imaging device, particularly a kind of multi-spectral imager based on the optical field imaging technology.
Background technology
Existing multi-spectral imager mainly comprises optical lens, detector, and image acquisition and control device, and image is processed and display device.It multiplex in to large field range a plurality of targets reconnoitre and monitor.If want to realize that a plurality of monitoring objectives to different distance in the large field range carry out the multi light spectrum hands analysis, need by adjusting optical system parameter or detector target position, aim at respectively each monitoring objective and carry out successively machinery focusing shooting.Multi-spectral imager be the light field information projection of all directions that monitoring objective is sent to the detector target surface, realize two-dimensional imaging to photographic subjects through opto-electronic conversion.Because the integration that this projection imaging mode is all directions light superposes, in the process of projection, only kept the overall intensity signal of each light, and therefore the directional information of having lost light can't utilize the single image that collects to reconstruct other as plane picture.In such cases, in case detector is not adjusted to effectively the focal plane, will cause image blur and lost analysis or enjoying value.Be exactly for moving target in addition, then may because out of focus and cause taking unsuccessfully, can't recover.
Summary of the invention
The present invention will solve the technical matters that existing multi-spectral imager can't be focused simultaneously imaging and can't recover image out of focus different distance target in the field range, provide a kind of optical field imaging technology of utilizing that multi-spectral imaging is carried out in whole visual field, based on the multi-spectral imager of optical field imaging technology.
In order to solve the problems of the technologies described above, technical scheme of the present invention is specific as follows:
Based on the multi-spectral imager of optical field imaging technology, it comprises:
Visible light lens, visible light microlens array and visible images detector with the optical axis aligning;
Near-infrared camera lenses, near infrared microlens array and near-infrared image detector with the optical axis aligning;
Ultraviolet lens, ultraviolet microlens array and ultraviolet image detector with the optical axis aligning;
Described visible light, near infrared and ultraviolet microlens array receive respectively the light from described visible light, near infrared and ultraviolet lens, by birefringence, with the light beam of the different directions difference according to space angle, project respectively in described visible light, near infrared and the ultraviolet image detector pixel, generate respectively the corresponding light field picture with field orientation and positional information;
Image acquisition and control device, it realizes the synchronous triggering of described visible light, near infrared and ultraviolet image detector opto-electronic conversion frame frequency by the output synchronizing signal, and each band image data is gathered, stores or transmits;
Image is processed and display device, and it carries out two-dimension image rebuild, image processing according to the light field image with field orientation and positional information that collects and shows.
In technique scheme, according to predetermined areas imaging, the visible light microlens array is fixed in visible light lens image planes or near position, and visible images detector target surface is fixed in visible light microlens array focal plane position; Each lenticule clear aperature d in the visible light microlens array is identical, and focal distance f is equal, and its aperture F number equates with visible light lens aperture F number.
In technique scheme, according to predetermined areas imaging, the near infrared microlens array is fixed in near-infrared camera lenses image planes or near position, and near-infrared image detector target surface is fixed near infrared microlens array focal plane position; Each lenticule clear aperature d in the near infrared microlens array is identical, and focal distance f is equal, and its aperture F number equates with near-infrared camera lenses aperture F number.
In technique scheme, according to predetermined areas imaging, the ultraviolet microlens array is fixed in ultraviolet lens image planes or near position, and ultraviolet image detector target surface is fixed in ultraviolet microlens array focal plane position; Each lenticule clear aperature d in the ultraviolet microlens array is identical, and focal distance f is equal, and its aperture F number equates with ultraviolet lens aperture F number.
In technique scheme, described camera lens, microlens array, image detector can also extend to its all band.
The beneficial effect of the multi-spectral imager based on the optical field imaging technology provided by the invention is:
1, multi-spectral imager provided by the invention is on the basis of traditional multi-spectral imager, has added microlens array in each band image detector front end.Birefringence by microlens array, with the light beam of the different directions difference according to space angle, project respectively in the image detector pixel of the different-waveband that the different lenticules of microlens array cover, replace 2 traditional dimension image informations to record preservation 4 dimension light field image informations.Need not any hardware focusing servicing unit and complicated focus algorithm, can realize the different again focusings that detect target in the multi-spectral imager field range by the two-dimension image rebuild of image processing module, further improve multi-spectral imager multiple goal multi-band image analytical performance.
2, multi-spectral imager provided by the invention is to utilize the optical field imaging technology, and the imaging of multiband light field is carried out in whole visual field, by the ray tracing of light field image being realized the two-dimension image rebuild on different focus plane, the covert increase optical system depth of field.And can realize the blur-free imaging of different target under a plurality of wave bands in effective field depth by single shot.
Description of drawings
Below in conjunction with the drawings and specific embodiments the present invention is described in further detail.
Fig. 1 is multi-spectral imager schematic diagram of the present invention.
Fig. 2 is multi-spectral imager structured flowchart of the present invention.
Fig. 3 is the optical field imaging light path principle figure of a wave band of multi-spectral imager of the present invention.
Fig. 4 is the structured flowchart of the embodiment of the invention 1 multi-spectral imager.
Reference numeral among Fig. 1 is expressed as:
The 1-visible light lens, 2-visible light microlens array, 3-visible images detector, 4-near-infrared camera lenses, 5-near infrared microlens array, 6-near-infrared image detector, the 7-ultraviolet lens, 8-ultraviolet microlens array, 9-ultraviolet image detector, 10-image acquisition and control device, the 11-image is processed and display device.
Embodiment
Below in conjunction with accompanying drawing the present invention is done to describe in detail.
Referring to accompanying drawing 1 and accompanying drawing 3: the multi-spectral imager based on the optical field imaging technology provided by the invention comprises visible light lens 1, visible light microlens array 2 and the visible images detector 3 of aiming at optical axis, near-infrared camera lenses 4, near infrared microlens array 5 and near-infrared image detector 6 with the optical axis aligning, ultraviolet lens 7, ultraviolet microlens array 8 and ultraviolet image detector 9 with the optical axis aligning, image acquisition and control device 10, image is processed and display device 11.
According to predetermined areas imaging, visible light microlens array 2 is fixed in visible light lens 1 image planes or near position, and visible images detector 3 target surfaces are fixed in visible light microlens array 2 focal plane position; Each lenticule clear aperature d in the visible light microlens array 2 is identical, and focal distance f is equal, and its aperture F number equates with visible light lens 1 aperture F number.Near infrared microlens array 5 is fixed in near-infrared camera lenses 4 image planes or near position, and near-infrared image detector 6 target surfaces are fixed near infrared microlens array 5 focal plane position; Each lenticule clear aperature d in the near infrared microlens array 5 is identical, and focal distance f is equal, and its aperture F number equates with near-infrared camera lenses 4 aperture F numbers.Ultraviolet microlens array 8 is fixed in ultraviolet lens 7 image planes or near position, and ultraviolet image detector 9 target surfaces are fixed in ultraviolet microlens array 8 focal plane position; Each lenticule clear aperature d in the ultraviolet microlens array 8 is identical, and focal distance f is equal, and its aperture F number equates with ultraviolet lens 7 aperture F numbers.
Fig. 3 is the optical field imaging light path principle figure of one of them wave band of multi-spectral imager of the present invention.D among the figure is the clear aperature of object lens, and v is object distance, and u is image distance, and F is objective focal length, and d is the lenticule clear aperature, and f is the lenticule focal length, and A is target to be imaged, A ' for through after the optical system on detector imaging.Its light path principle is, target A is imaged on the microlens array through object lens, be divided into a series of subimage arrays by microlens array, every number of sub images is again through its corresponding lenticular disperse function, difference according to incident angle of light scatters on some each detector cells, and then forms the light field image A that a width of cloth has light field information at the detector target surface '.
Referring to accompanying drawing 2: visible light microlens array, near infrared microlens array and ultraviolet microlens array receive respectively the light from visible light lens, near-infrared camera lenses and ultraviolet lens, microlens array is by birefringence, with the light beam of the different directions difference according to space angle, project respectively in the pixel of visible images detector, near-infrared image detector and ultraviolet image detector that the different lenticules of corresponding microlens array cover, generate respectively the corresponding light field picture with field orientation and positional information.Image acquisition and control device are by the output synchronizing signal, after the synchronous triggering of the opto-electronic conversion frame frequency of realization visible images detector, near-infrared image detector and ultraviolet image detector, by corresponding image capture module, each band image data is gathered, stores or transmits.Image is processed and display device, and it carries out two-dimension image rebuild, image processing according to the light field image with field orientation and positional information that collects and shows.
Embodiment 1
Shown in 4, the embodiment of the invention provides a kind of multi-spectral imager based on the optical field imaging technology by reference to the accompanying drawings.Described multi-spectral imager comprises: visible light lens, visible light microlens array, visible images detector, near-infrared camera lenses, near infrared microlens array, near-infrared image detector, ultraviolet lens, ultraviolet microlens array, ultraviolet image detector, image acquisition and Control card and image are processed and display device.Design parameter is as follows:
Visible light lens is the iris setting tight shot that can see through wavelength coverage 400nm-700nm, and focal length is 60mm, and the F number is 20.Ultraviolet lens is the iris setting tight shot that can see through wavelength coverage 300nm-400nm, and focal length is 60mm, and the F number is 20.Near-infrared camera lenses is the iris setting tight shot that can see through wavelength coverage 700nm-1000nm, and focal length is 60mm, and the F number is 20.
Visible light microlens array, ultraviolet microlens array, near infrared microlens array are the lens arra of K9 material, and the microlens array number average is 270x206, and focal length is 500 μ m.Because the image detector target surface should place microlens array focal plane place, therefore with before image detector is connected, should remove image detector leading portion frisket window glass.
The visible images detector is black and white visible light industrial camera, and effectively pixel resolution is 1620x1236, and pixel dimension is 4.4 μ m, carries out data communication by CameraLink data-interface and image acquisition and Control card.The ultraviolet image detector is the ultraviolet industrial camera, and effectively pixel resolution is 1620x1236, and pixel dimension is 4.4 μ m, carries out data communication by CameraLink data-interface and image acquisition and Control card.The near-infrared image detector is the near infrared industrial camera of Denmark JAI company, and effectively pixel resolution is 1620x1236, and pixel dimension is 4.4 μ m, carries out data communication by CameraLink data-interface and image acquisition and Control card.
Image acquisition and Control card mainly are comprised of 1 fpga chip and some attached chips, in order to the output that realizes three band image data acquisitions, external trigger synchronizing signal and the conversion of image data format.And the view data after will changing by standard gigabit network interface is according to the ICP/IP protocol transmission of packing.
It is the remote computer with PCI-Express that image is processed with display device.Computing machine utilizes the process software with multispectral coordinative composition of equipments, and each the band image data that collects are carried out light field image 2-d reconstruction, preservation, demonstration and other analyzing and processing.
Obviously, above-described embodiment only is for example clearly is described, and is not the restriction to embodiment.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here need not also can't give all embodiments exhaustive.And the apparent variation of being extended out thus or change still are among the protection domain of the invention.
Claims (5)
1. based on the multi-spectral imager of optical field imaging technology, it is characterized in that, it comprises:
Visible light lens, visible light microlens array and visible images detector with the optical axis aligning;
Near-infrared camera lenses, near infrared microlens array and near-infrared image detector with the optical axis aligning;
Ultraviolet lens, ultraviolet microlens array and ultraviolet image detector with the optical axis aligning;
Described visible light, near infrared and ultraviolet microlens array receive respectively the light from described visible light, near infrared and ultraviolet lens, by birefringence, with the light beam of the different directions difference according to space angle, project respectively in described visible light, near infrared and the ultraviolet image detector pixel, generate respectively the corresponding light field picture with field orientation and positional information;
Image acquisition and control device, it realizes the synchronous triggering of described visible light, near infrared and ultraviolet image detector opto-electronic conversion frame frequency by the output synchronizing signal, and each band image data is gathered, stores or transmits;
Image is processed and display device, and it carries out two-dimension image rebuild, image processing according to the light field image with field orientation and positional information that collects and shows.
2. multi-spectral imager according to claim 1, it is characterized in that, according to predetermined areas imaging, the visible light microlens array is fixed in visible light lens image planes or near position, and visible images detector target surface is fixed in visible light microlens array focal plane position; Each lenticule clear aperature d in the visible light microlens array is identical, and focal distance f is equal, and its aperture F number equates with visible light lens aperture F number.
3. multi-spectral imager according to claim 2, it is characterized in that, according to predetermined areas imaging, the near infrared microlens array is fixed in near-infrared camera lenses image planes or near position, and near-infrared image detector target surface is fixed near infrared microlens array focal plane position; Each lenticule clear aperature d in the near infrared microlens array is identical, and focal distance f is equal, and its aperture F number equates with near-infrared camera lenses aperture F number.
4. multi-spectral imager according to claim 3 is characterized in that, according to predetermined areas imaging, the ultraviolet microlens array is fixed in ultraviolet lens image planes or near position, and ultraviolet image detector target surface is fixed in ultraviolet microlens array focal plane position; Each lenticule clear aperature d in the ultraviolet microlens array is identical, and focal distance f is equal, and its aperture F number equates with ultraviolet lens aperture F number.
5. multi-spectral imager according to claim 4 is characterized in that, described camera lens, microlens array, image detector can also extend to its all band.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310207068.2A CN103323113B (en) | 2013-05-30 | 2013-05-30 | Multispectral imager based on light fieldd imaging technique |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310207068.2A CN103323113B (en) | 2013-05-30 | 2013-05-30 | Multispectral imager based on light fieldd imaging technique |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103323113A true CN103323113A (en) | 2013-09-25 |
CN103323113B CN103323113B (en) | 2015-04-22 |
Family
ID=49192006
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310207068.2A Expired - Fee Related CN103323113B (en) | 2013-05-30 | 2013-05-30 | Multispectral imager based on light fieldd imaging technique |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103323113B (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104359557A (en) * | 2014-12-09 | 2015-02-18 | 上海新跃仪表厂 | Dual spectral imaging equipment for space exploration |
CN104516085A (en) * | 2013-09-30 | 2015-04-15 | 香港纺织及成衣研发中心有限公司 | Quick focusing method and device for multispectral imaging |
CN104539832A (en) * | 2014-12-31 | 2015-04-22 | 上海理工大学 | Hybrid light field imaging system |
CN105182436A (en) * | 2015-09-07 | 2015-12-23 | 南京华图信息技术有限公司 | Device and method for cooperatively detecting moving target by using all-optical-waveband map |
CN105572689A (en) * | 2016-03-21 | 2016-05-11 | 同济大学 | Narrow-band multispectral camera array imaging apparatus |
CN105959597A (en) * | 2016-04-25 | 2016-09-21 | 北京理工大学 | TV-type infrared imaging chip based on quantum dot light-emitting detector |
CN106153190A (en) * | 2016-06-16 | 2016-11-23 | 电子科技大学 | For obtaining spectral module and the bimodulus multiplex optical device of spectrum |
CN106500842A (en) * | 2016-11-08 | 2017-03-15 | 北京华夏视科图像技术有限公司 | Multispectral camera and multispectral acquisition system |
CN106768325A (en) * | 2016-11-21 | 2017-05-31 | 清华大学 | Multispectral light-field video acquisition device |
CN107347133A (en) * | 2017-08-25 | 2017-11-14 | 合肥芯福传感器技术有限公司 | A kind of dual sensor camera |
CN111866316A (en) * | 2019-04-26 | 2020-10-30 | 曹毓 | Multifunctional imaging equipment |
CN112954223A (en) * | 2021-03-26 | 2021-06-11 | 维沃移动通信(深圳)有限公司 | Focusing method and device, electronic equipment, readable storage medium and chip |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004191244A (en) * | 2002-12-12 | 2004-07-08 | Minolta Co Ltd | Spectrograph and correction method |
WO2008022474A1 (en) * | 2006-08-25 | 2008-02-28 | Abb Research Ltd | Camera-based flame detector |
CN101320138A (en) * | 2008-05-16 | 2008-12-10 | 中国科学院西安光学精密机械研究所 | Method and apparatus for simultaneously acquiring stereo and multi-spectral images |
CN201278057Y (en) * | 2008-05-23 | 2009-07-22 | 中国科学院西安光学精密机械研究所 | Imaging device for simultaneously acquiring stereo and multispectral images |
-
2013
- 2013-05-30 CN CN201310207068.2A patent/CN103323113B/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004191244A (en) * | 2002-12-12 | 2004-07-08 | Minolta Co Ltd | Spectrograph and correction method |
WO2008022474A1 (en) * | 2006-08-25 | 2008-02-28 | Abb Research Ltd | Camera-based flame detector |
CN101320138A (en) * | 2008-05-16 | 2008-12-10 | 中国科学院西安光学精密机械研究所 | Method and apparatus for simultaneously acquiring stereo and multi-spectral images |
CN201278057Y (en) * | 2008-05-23 | 2009-07-22 | 中国科学院西安光学精密机械研究所 | Imaging device for simultaneously acquiring stereo and multispectral images |
Non-Patent Citations (1)
Title |
---|
项建胜等: "一种红外多光谱成像光学系统设计", 《红外技术》 * |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104516085A (en) * | 2013-09-30 | 2015-04-15 | 香港纺织及成衣研发中心有限公司 | Quick focusing method and device for multispectral imaging |
CN104359557A (en) * | 2014-12-09 | 2015-02-18 | 上海新跃仪表厂 | Dual spectral imaging equipment for space exploration |
CN104359557B (en) * | 2014-12-09 | 2016-07-06 | 上海新跃仪表厂 | A kind of double; two spectrum imaging devices for deep space probing |
CN104539832B (en) * | 2014-12-31 | 2017-06-23 | 上海理工大学 | Hybrid optical field imaging system |
CN104539832A (en) * | 2014-12-31 | 2015-04-22 | 上海理工大学 | Hybrid light field imaging system |
CN105182436A (en) * | 2015-09-07 | 2015-12-23 | 南京华图信息技术有限公司 | Device and method for cooperatively detecting moving target by using all-optical-waveband map |
CN105572689B (en) * | 2016-03-21 | 2017-12-12 | 上海同繁勘测工程科技有限公司 | A kind of narrow-band multispectral camera array imaging device |
CN105572689A (en) * | 2016-03-21 | 2016-05-11 | 同济大学 | Narrow-band multispectral camera array imaging apparatus |
CN105959597A (en) * | 2016-04-25 | 2016-09-21 | 北京理工大学 | TV-type infrared imaging chip based on quantum dot light-emitting detector |
CN106153190A (en) * | 2016-06-16 | 2016-11-23 | 电子科技大学 | For obtaining spectral module and the bimodulus multiplex optical device of spectrum |
CN106500842A (en) * | 2016-11-08 | 2017-03-15 | 北京华夏视科图像技术有限公司 | Multispectral camera and multispectral acquisition system |
CN106768325A (en) * | 2016-11-21 | 2017-05-31 | 清华大学 | Multispectral light-field video acquisition device |
CN107347133A (en) * | 2017-08-25 | 2017-11-14 | 合肥芯福传感器技术有限公司 | A kind of dual sensor camera |
CN111866316A (en) * | 2019-04-26 | 2020-10-30 | 曹毓 | Multifunctional imaging equipment |
CN111866316B (en) * | 2019-04-26 | 2021-11-12 | 曹毓 | Multifunctional imaging equipment |
CN112954223A (en) * | 2021-03-26 | 2021-06-11 | 维沃移动通信(深圳)有限公司 | Focusing method and device, electronic equipment, readable storage medium and chip |
CN112954223B (en) * | 2021-03-26 | 2022-10-21 | 维沃移动通信(深圳)有限公司 | Focusing method and device, electronic equipment, readable storage medium and chip |
Also Published As
Publication number | Publication date |
---|---|
CN103323113B (en) | 2015-04-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103323113B (en) | Multispectral imager based on light fieldd imaging technique | |
US8027041B1 (en) | Compact snapshot multispectral imaging system | |
CN106840398B (en) | A kind of multispectral light-field imaging method | |
CN107271039A (en) | Compact miniature fast illuminated spectral imaging detecting device and detection method | |
CN103472592B (en) | A kind of fast high-throughout polarization imaging method of illuminated and polarization imager | |
Horstmeyer et al. | Flexible multimodal camera using a light field architecture | |
US8908054B1 (en) | Optics apparatus for hands-free focus | |
CN103037180A (en) | Image sensor and image pickup apparatus | |
CN106802184B (en) | The fast compact noise immunity type optical field imaging full-polarization spectrum detection device of illuminated and method | |
EP3842843A1 (en) | Imaging device and image sensing method | |
EP3013047A1 (en) | Multiple pixel pitch for super resolution | |
US20140125810A1 (en) | Low-profile lens array camera | |
CN103091258A (en) | Multispectral imager based on liquid zooming technology | |
KR102283423B1 (en) | Image pick-up apparatus, portable terminal including the same and image pick-up method using the apparatus | |
JP2019054463A5 (en) | ||
CN102918355A (en) | Three-dimensional image pickup apparatus, light-transparent unit, image processing apparatus, and program | |
CN1702452B (en) | Digital micromirror multi-target imaging spectrometer device | |
WO2013114895A1 (en) | Imaging device | |
CN110691176A (en) | Filter assembly, camera module, image capturing device and electronic device | |
JP2018513964A (en) | Snapshot type polarization hyperspectral camera and imaging method | |
CN106949967B (en) | The fast compact channel modulation type optical field imaging full-polarization spectrum detection device of illuminated and method | |
CN104954645A (en) | Image pickup element, image pickup apparatus, and image processing method | |
CN103558160A (en) | Method and system for improving resolution ratio of spectral imaging space | |
CN101221350B (en) | Image surface partitioning multi-optical channel common image surface imaging device | |
EP3657786A1 (en) | Light field reconstruction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150422 Termination date: 20170530 |