CN103323113A - Multispectral imager based on light fieldd imaging technique - Google Patents

Multispectral imager based on light fieldd imaging technique Download PDF

Info

Publication number
CN103323113A
CN103323113A CN2013102070682A CN201310207068A CN103323113A CN 103323113 A CN103323113 A CN 103323113A CN 2013102070682 A CN2013102070682 A CN 2013102070682A CN 201310207068 A CN201310207068 A CN 201310207068A CN 103323113 A CN103323113 A CN 103323113A
Authority
CN
China
Prior art keywords
image
microlens array
ultraviolet
visible light
infrared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013102070682A
Other languages
Chinese (zh)
Other versions
CN103323113B (en
Inventor
张艳超
孙强
赵建
韩希珍
毕国玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changchun Institute of Optics Fine Mechanics and Physics of CAS
Original Assignee
Changchun Institute of Optics Fine Mechanics and Physics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changchun Institute of Optics Fine Mechanics and Physics of CAS filed Critical Changchun Institute of Optics Fine Mechanics and Physics of CAS
Priority to CN201310207068.2A priority Critical patent/CN103323113B/en
Publication of CN103323113A publication Critical patent/CN103323113A/en
Application granted granted Critical
Publication of CN103323113B publication Critical patent/CN103323113B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

The invention relates to a multispectral imager based on the light field imaging technique. The multispectral imager based on the light field imaging technique solves the problem that an existing multispectral imager cannot achieve simultaneous focus imaging of targets with different distances away from the multispectral imager within the field range and cannot recover an image out of focus. The multispectral imager based on the light field imaging technique comprises a visual camera lens, a visual microlens array, a visual image detector, a near-infrared camera lens, a near-infrared microlens array, a near-infrared image detector, an ultraviolet camera lens, an ultraviolet microlens array, an ultraviolet array image detector, an image acquisition and control device, and an image processing and display device. According to the multispectral imager based on the light field imaging technique, due to the fact that the microlens arrays are additionally arranged at the front ends of the image detectors in all wave bands, four-dimensional light field image information instead of traditional two-dimensional image information is recorded and saved, no hardware focusing auxiliary device is needed, refocusing of different targets within the field range can be achieved through reconstruction of a two-dimensional image of an image processing module, and the multi-target and multiband image analyzing performance of the multispectral imager is further improved.

Description

Multi-spectral imager based on the optical field imaging technology
Technical field
The present invention relates to a kind of imaging device, particularly a kind of multi-spectral imager based on the optical field imaging technology.
Background technology
Existing multi-spectral imager mainly comprises optical lens, detector, and image acquisition and control device, and image is processed and display device.It multiplex in to large field range a plurality of targets reconnoitre and monitor.If want to realize that a plurality of monitoring objectives to different distance in the large field range carry out the multi light spectrum hands analysis, need by adjusting optical system parameter or detector target position, aim at respectively each monitoring objective and carry out successively machinery focusing shooting.Multi-spectral imager be the light field information projection of all directions that monitoring objective is sent to the detector target surface, realize two-dimensional imaging to photographic subjects through opto-electronic conversion.Because the integration that this projection imaging mode is all directions light superposes, in the process of projection, only kept the overall intensity signal of each light, and therefore the directional information of having lost light can't utilize the single image that collects to reconstruct other as plane picture.In such cases, in case detector is not adjusted to effectively the focal plane, will cause image blur and lost analysis or enjoying value.Be exactly for moving target in addition, then may because out of focus and cause taking unsuccessfully, can't recover.
Summary of the invention
The present invention will solve the technical matters that existing multi-spectral imager can't be focused simultaneously imaging and can't recover image out of focus different distance target in the field range, provide a kind of optical field imaging technology of utilizing that multi-spectral imaging is carried out in whole visual field, based on the multi-spectral imager of optical field imaging technology.
In order to solve the problems of the technologies described above, technical scheme of the present invention is specific as follows:
Based on the multi-spectral imager of optical field imaging technology, it comprises:
Visible light lens, visible light microlens array and visible images detector with the optical axis aligning;
Near-infrared camera lenses, near infrared microlens array and near-infrared image detector with the optical axis aligning;
Ultraviolet lens, ultraviolet microlens array and ultraviolet image detector with the optical axis aligning;
Described visible light, near infrared and ultraviolet microlens array receive respectively the light from described visible light, near infrared and ultraviolet lens, by birefringence, with the light beam of the different directions difference according to space angle, project respectively in described visible light, near infrared and the ultraviolet image detector pixel, generate respectively the corresponding light field picture with field orientation and positional information;
Image acquisition and control device, it realizes the synchronous triggering of described visible light, near infrared and ultraviolet image detector opto-electronic conversion frame frequency by the output synchronizing signal, and each band image data is gathered, stores or transmits;
Image is processed and display device, and it carries out two-dimension image rebuild, image processing according to the light field image with field orientation and positional information that collects and shows.
In technique scheme, according to predetermined areas imaging, the visible light microlens array is fixed in visible light lens image planes or near position, and visible images detector target surface is fixed in visible light microlens array focal plane position; Each lenticule clear aperature d in the visible light microlens array is identical, and focal distance f is equal, and its aperture F number equates with visible light lens aperture F number.
In technique scheme, according to predetermined areas imaging, the near infrared microlens array is fixed in near-infrared camera lenses image planes or near position, and near-infrared image detector target surface is fixed near infrared microlens array focal plane position; Each lenticule clear aperature d in the near infrared microlens array is identical, and focal distance f is equal, and its aperture F number equates with near-infrared camera lenses aperture F number.
In technique scheme, according to predetermined areas imaging, the ultraviolet microlens array is fixed in ultraviolet lens image planes or near position, and ultraviolet image detector target surface is fixed in ultraviolet microlens array focal plane position; Each lenticule clear aperature d in the ultraviolet microlens array is identical, and focal distance f is equal, and its aperture F number equates with ultraviolet lens aperture F number.
In technique scheme, described camera lens, microlens array, image detector can also extend to its all band.
The beneficial effect of the multi-spectral imager based on the optical field imaging technology provided by the invention is:
1, multi-spectral imager provided by the invention is on the basis of traditional multi-spectral imager, has added microlens array in each band image detector front end.Birefringence by microlens array, with the light beam of the different directions difference according to space angle, project respectively in the image detector pixel of the different-waveband that the different lenticules of microlens array cover, replace 2 traditional dimension image informations to record preservation 4 dimension light field image informations.Need not any hardware focusing servicing unit and complicated focus algorithm, can realize the different again focusings that detect target in the multi-spectral imager field range by the two-dimension image rebuild of image processing module, further improve multi-spectral imager multiple goal multi-band image analytical performance.
2, multi-spectral imager provided by the invention is to utilize the optical field imaging technology, and the imaging of multiband light field is carried out in whole visual field, by the ray tracing of light field image being realized the two-dimension image rebuild on different focus plane, the covert increase optical system depth of field.And can realize the blur-free imaging of different target under a plurality of wave bands in effective field depth by single shot.
Description of drawings
Below in conjunction with the drawings and specific embodiments the present invention is described in further detail.
Fig. 1 is multi-spectral imager schematic diagram of the present invention.
Fig. 2 is multi-spectral imager structured flowchart of the present invention.
Fig. 3 is the optical field imaging light path principle figure of a wave band of multi-spectral imager of the present invention.
Fig. 4 is the structured flowchart of the embodiment of the invention 1 multi-spectral imager.
Reference numeral among Fig. 1 is expressed as:
The 1-visible light lens, 2-visible light microlens array, 3-visible images detector, 4-near-infrared camera lenses, 5-near infrared microlens array, 6-near-infrared image detector, the 7-ultraviolet lens, 8-ultraviolet microlens array, 9-ultraviolet image detector, 10-image acquisition and control device, the 11-image is processed and display device.
Embodiment
Below in conjunction with accompanying drawing the present invention is done to describe in detail.
Referring to accompanying drawing 1 and accompanying drawing 3: the multi-spectral imager based on the optical field imaging technology provided by the invention comprises visible light lens 1, visible light microlens array 2 and the visible images detector 3 of aiming at optical axis, near-infrared camera lenses 4, near infrared microlens array 5 and near-infrared image detector 6 with the optical axis aligning, ultraviolet lens 7, ultraviolet microlens array 8 and ultraviolet image detector 9 with the optical axis aligning, image acquisition and control device 10, image is processed and display device 11.
According to predetermined areas imaging, visible light microlens array 2 is fixed in visible light lens 1 image planes or near position, and visible images detector 3 target surfaces are fixed in visible light microlens array 2 focal plane position; Each lenticule clear aperature d in the visible light microlens array 2 is identical, and focal distance f is equal, and its aperture F number equates with visible light lens 1 aperture F number.Near infrared microlens array 5 is fixed in near-infrared camera lenses 4 image planes or near position, and near-infrared image detector 6 target surfaces are fixed near infrared microlens array 5 focal plane position; Each lenticule clear aperature d in the near infrared microlens array 5 is identical, and focal distance f is equal, and its aperture F number equates with near-infrared camera lenses 4 aperture F numbers.Ultraviolet microlens array 8 is fixed in ultraviolet lens 7 image planes or near position, and ultraviolet image detector 9 target surfaces are fixed in ultraviolet microlens array 8 focal plane position; Each lenticule clear aperature d in the ultraviolet microlens array 8 is identical, and focal distance f is equal, and its aperture F number equates with ultraviolet lens 7 aperture F numbers.
Fig. 3 is the optical field imaging light path principle figure of one of them wave band of multi-spectral imager of the present invention.D among the figure is the clear aperature of object lens, and v is object distance, and u is image distance, and F is objective focal length, and d is the lenticule clear aperature, and f is the lenticule focal length, and A is target to be imaged, A ' for through after the optical system on detector imaging.Its light path principle is, target A is imaged on the microlens array through object lens, be divided into a series of subimage arrays by microlens array, every number of sub images is again through its corresponding lenticular disperse function, difference according to incident angle of light scatters on some each detector cells, and then forms the light field image A that a width of cloth has light field information at the detector target surface '.
Referring to accompanying drawing 2: visible light microlens array, near infrared microlens array and ultraviolet microlens array receive respectively the light from visible light lens, near-infrared camera lenses and ultraviolet lens, microlens array is by birefringence, with the light beam of the different directions difference according to space angle, project respectively in the pixel of visible images detector, near-infrared image detector and ultraviolet image detector that the different lenticules of corresponding microlens array cover, generate respectively the corresponding light field picture with field orientation and positional information.Image acquisition and control device are by the output synchronizing signal, after the synchronous triggering of the opto-electronic conversion frame frequency of realization visible images detector, near-infrared image detector and ultraviolet image detector, by corresponding image capture module, each band image data is gathered, stores or transmits.Image is processed and display device, and it carries out two-dimension image rebuild, image processing according to the light field image with field orientation and positional information that collects and shows.
Embodiment 1
Shown in 4, the embodiment of the invention provides a kind of multi-spectral imager based on the optical field imaging technology by reference to the accompanying drawings.Described multi-spectral imager comprises: visible light lens, visible light microlens array, visible images detector, near-infrared camera lenses, near infrared microlens array, near-infrared image detector, ultraviolet lens, ultraviolet microlens array, ultraviolet image detector, image acquisition and Control card and image are processed and display device.Design parameter is as follows:
Visible light lens is the iris setting tight shot that can see through wavelength coverage 400nm-700nm, and focal length is 60mm, and the F number is 20.Ultraviolet lens is the iris setting tight shot that can see through wavelength coverage 300nm-400nm, and focal length is 60mm, and the F number is 20.Near-infrared camera lenses is the iris setting tight shot that can see through wavelength coverage 700nm-1000nm, and focal length is 60mm, and the F number is 20.
Visible light microlens array, ultraviolet microlens array, near infrared microlens array are the lens arra of K9 material, and the microlens array number average is 270x206, and focal length is 500 μ m.Because the image detector target surface should place microlens array focal plane place, therefore with before image detector is connected, should remove image detector leading portion frisket window glass.
The visible images detector is black and white visible light industrial camera, and effectively pixel resolution is 1620x1236, and pixel dimension is 4.4 μ m, carries out data communication by CameraLink data-interface and image acquisition and Control card.The ultraviolet image detector is the ultraviolet industrial camera, and effectively pixel resolution is 1620x1236, and pixel dimension is 4.4 μ m, carries out data communication by CameraLink data-interface and image acquisition and Control card.The near-infrared image detector is the near infrared industrial camera of Denmark JAI company, and effectively pixel resolution is 1620x1236, and pixel dimension is 4.4 μ m, carries out data communication by CameraLink data-interface and image acquisition and Control card.
Image acquisition and Control card mainly are comprised of 1 fpga chip and some attached chips, in order to the output that realizes three band image data acquisitions, external trigger synchronizing signal and the conversion of image data format.And the view data after will changing by standard gigabit network interface is according to the ICP/IP protocol transmission of packing.
It is the remote computer with PCI-Express that image is processed with display device.Computing machine utilizes the process software with multispectral coordinative composition of equipments, and each the band image data that collects are carried out light field image 2-d reconstruction, preservation, demonstration and other analyzing and processing.
Obviously, above-described embodiment only is for example clearly is described, and is not the restriction to embodiment.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here need not also can't give all embodiments exhaustive.And the apparent variation of being extended out thus or change still are among the protection domain of the invention.

Claims (5)

1. based on the multi-spectral imager of optical field imaging technology, it is characterized in that, it comprises:
Visible light lens, visible light microlens array and visible images detector with the optical axis aligning;
Near-infrared camera lenses, near infrared microlens array and near-infrared image detector with the optical axis aligning;
Ultraviolet lens, ultraviolet microlens array and ultraviolet image detector with the optical axis aligning;
Described visible light, near infrared and ultraviolet microlens array receive respectively the light from described visible light, near infrared and ultraviolet lens, by birefringence, with the light beam of the different directions difference according to space angle, project respectively in described visible light, near infrared and the ultraviolet image detector pixel, generate respectively the corresponding light field picture with field orientation and positional information;
Image acquisition and control device, it realizes the synchronous triggering of described visible light, near infrared and ultraviolet image detector opto-electronic conversion frame frequency by the output synchronizing signal, and each band image data is gathered, stores or transmits;
Image is processed and display device, and it carries out two-dimension image rebuild, image processing according to the light field image with field orientation and positional information that collects and shows.
2. multi-spectral imager according to claim 1, it is characterized in that, according to predetermined areas imaging, the visible light microlens array is fixed in visible light lens image planes or near position, and visible images detector target surface is fixed in visible light microlens array focal plane position; Each lenticule clear aperature d in the visible light microlens array is identical, and focal distance f is equal, and its aperture F number equates with visible light lens aperture F number.
3. multi-spectral imager according to claim 2, it is characterized in that, according to predetermined areas imaging, the near infrared microlens array is fixed in near-infrared camera lenses image planes or near position, and near-infrared image detector target surface is fixed near infrared microlens array focal plane position; Each lenticule clear aperature d in the near infrared microlens array is identical, and focal distance f is equal, and its aperture F number equates with near-infrared camera lenses aperture F number.
4. multi-spectral imager according to claim 3 is characterized in that, according to predetermined areas imaging, the ultraviolet microlens array is fixed in ultraviolet lens image planes or near position, and ultraviolet image detector target surface is fixed in ultraviolet microlens array focal plane position; Each lenticule clear aperature d in the ultraviolet microlens array is identical, and focal distance f is equal, and its aperture F number equates with ultraviolet lens aperture F number.
5. multi-spectral imager according to claim 4 is characterized in that, described camera lens, microlens array, image detector can also extend to its all band.
CN201310207068.2A 2013-05-30 2013-05-30 Multispectral imager based on light fieldd imaging technique Expired - Fee Related CN103323113B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310207068.2A CN103323113B (en) 2013-05-30 2013-05-30 Multispectral imager based on light fieldd imaging technique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310207068.2A CN103323113B (en) 2013-05-30 2013-05-30 Multispectral imager based on light fieldd imaging technique

Publications (2)

Publication Number Publication Date
CN103323113A true CN103323113A (en) 2013-09-25
CN103323113B CN103323113B (en) 2015-04-22

Family

ID=49192006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310207068.2A Expired - Fee Related CN103323113B (en) 2013-05-30 2013-05-30 Multispectral imager based on light fieldd imaging technique

Country Status (1)

Country Link
CN (1) CN103323113B (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104359557A (en) * 2014-12-09 2015-02-18 上海新跃仪表厂 Dual spectral imaging equipment for space exploration
CN104516085A (en) * 2013-09-30 2015-04-15 香港纺织及成衣研发中心有限公司 Quick focusing method and device for multispectral imaging
CN104539832A (en) * 2014-12-31 2015-04-22 上海理工大学 Hybrid light field imaging system
CN105182436A (en) * 2015-09-07 2015-12-23 南京华图信息技术有限公司 Device and method for cooperatively detecting moving target by using all-optical-waveband map
CN105572689A (en) * 2016-03-21 2016-05-11 同济大学 Narrow-band multispectral camera array imaging apparatus
CN105959597A (en) * 2016-04-25 2016-09-21 北京理工大学 TV-type infrared imaging chip based on quantum dot light-emitting detector
CN106153190A (en) * 2016-06-16 2016-11-23 电子科技大学 For obtaining spectral module and the bimodulus multiplex optical device of spectrum
CN106500842A (en) * 2016-11-08 2017-03-15 北京华夏视科图像技术有限公司 Multispectral camera and multispectral acquisition system
CN106768325A (en) * 2016-11-21 2017-05-31 清华大学 Multispectral light-field video acquisition device
CN107347133A (en) * 2017-08-25 2017-11-14 合肥芯福传感器技术有限公司 A kind of dual sensor camera
CN111866316A (en) * 2019-04-26 2020-10-30 曹毓 Multifunctional imaging equipment
CN112954223A (en) * 2021-03-26 2021-06-11 维沃移动通信(深圳)有限公司 Focusing method and device, electronic equipment, readable storage medium and chip

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004191244A (en) * 2002-12-12 2004-07-08 Minolta Co Ltd Spectrograph and correction method
WO2008022474A1 (en) * 2006-08-25 2008-02-28 Abb Research Ltd Camera-based flame detector
CN101320138A (en) * 2008-05-16 2008-12-10 中国科学院西安光学精密机械研究所 Method and apparatus for simultaneously acquiring stereo and multi-spectral images
CN201278057Y (en) * 2008-05-23 2009-07-22 中国科学院西安光学精密机械研究所 Imaging device for simultaneously acquiring stereo and multispectral images

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004191244A (en) * 2002-12-12 2004-07-08 Minolta Co Ltd Spectrograph and correction method
WO2008022474A1 (en) * 2006-08-25 2008-02-28 Abb Research Ltd Camera-based flame detector
CN101320138A (en) * 2008-05-16 2008-12-10 中国科学院西安光学精密机械研究所 Method and apparatus for simultaneously acquiring stereo and multi-spectral images
CN201278057Y (en) * 2008-05-23 2009-07-22 中国科学院西安光学精密机械研究所 Imaging device for simultaneously acquiring stereo and multispectral images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
项建胜等: "一种红外多光谱成像光学系统设计", 《红外技术》 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104516085A (en) * 2013-09-30 2015-04-15 香港纺织及成衣研发中心有限公司 Quick focusing method and device for multispectral imaging
CN104359557A (en) * 2014-12-09 2015-02-18 上海新跃仪表厂 Dual spectral imaging equipment for space exploration
CN104359557B (en) * 2014-12-09 2016-07-06 上海新跃仪表厂 A kind of double; two spectrum imaging devices for deep space probing
CN104539832B (en) * 2014-12-31 2017-06-23 上海理工大学 Hybrid optical field imaging system
CN104539832A (en) * 2014-12-31 2015-04-22 上海理工大学 Hybrid light field imaging system
CN105182436A (en) * 2015-09-07 2015-12-23 南京华图信息技术有限公司 Device and method for cooperatively detecting moving target by using all-optical-waveband map
CN105572689B (en) * 2016-03-21 2017-12-12 上海同繁勘测工程科技有限公司 A kind of narrow-band multispectral camera array imaging device
CN105572689A (en) * 2016-03-21 2016-05-11 同济大学 Narrow-band multispectral camera array imaging apparatus
CN105959597A (en) * 2016-04-25 2016-09-21 北京理工大学 TV-type infrared imaging chip based on quantum dot light-emitting detector
CN106153190A (en) * 2016-06-16 2016-11-23 电子科技大学 For obtaining spectral module and the bimodulus multiplex optical device of spectrum
CN106500842A (en) * 2016-11-08 2017-03-15 北京华夏视科图像技术有限公司 Multispectral camera and multispectral acquisition system
CN106768325A (en) * 2016-11-21 2017-05-31 清华大学 Multispectral light-field video acquisition device
CN107347133A (en) * 2017-08-25 2017-11-14 合肥芯福传感器技术有限公司 A kind of dual sensor camera
CN111866316A (en) * 2019-04-26 2020-10-30 曹毓 Multifunctional imaging equipment
CN111866316B (en) * 2019-04-26 2021-11-12 曹毓 Multifunctional imaging equipment
CN112954223A (en) * 2021-03-26 2021-06-11 维沃移动通信(深圳)有限公司 Focusing method and device, electronic equipment, readable storage medium and chip
CN112954223B (en) * 2021-03-26 2022-10-21 维沃移动通信(深圳)有限公司 Focusing method and device, electronic equipment, readable storage medium and chip

Also Published As

Publication number Publication date
CN103323113B (en) 2015-04-22

Similar Documents

Publication Publication Date Title
CN103323113B (en) Multispectral imager based on light fieldd imaging technique
US8027041B1 (en) Compact snapshot multispectral imaging system
CN106840398B (en) A kind of multispectral light-field imaging method
CN107271039A (en) Compact miniature fast illuminated spectral imaging detecting device and detection method
CN103472592B (en) A kind of fast high-throughout polarization imaging method of illuminated and polarization imager
Horstmeyer et al. Flexible multimodal camera using a light field architecture
US8908054B1 (en) Optics apparatus for hands-free focus
CN103037180A (en) Image sensor and image pickup apparatus
CN106802184B (en) The fast compact noise immunity type optical field imaging full-polarization spectrum detection device of illuminated and method
EP3842843A1 (en) Imaging device and image sensing method
EP3013047A1 (en) Multiple pixel pitch for super resolution
US20140125810A1 (en) Low-profile lens array camera
CN103091258A (en) Multispectral imager based on liquid zooming technology
KR102283423B1 (en) Image pick-up apparatus, portable terminal including the same and image pick-up method using the apparatus
JP2019054463A5 (en)
CN102918355A (en) Three-dimensional image pickup apparatus, light-transparent unit, image processing apparatus, and program
CN1702452B (en) Digital micromirror multi-target imaging spectrometer device
WO2013114895A1 (en) Imaging device
CN110691176A (en) Filter assembly, camera module, image capturing device and electronic device
JP2018513964A (en) Snapshot type polarization hyperspectral camera and imaging method
CN106949967B (en) The fast compact channel modulation type optical field imaging full-polarization spectrum detection device of illuminated and method
CN104954645A (en) Image pickup element, image pickup apparatus, and image processing method
CN103558160A (en) Method and system for improving resolution ratio of spectral imaging space
CN101221350B (en) Image surface partitioning multi-optical channel common image surface imaging device
EP3657786A1 (en) Light field reconstruction

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150422

Termination date: 20170530