CN103323113B - Multispectral imager based on light fieldd imaging technique - Google Patents
Multispectral imager based on light fieldd imaging technique Download PDFInfo
- Publication number
- CN103323113B CN103323113B CN201310207068.2A CN201310207068A CN103323113B CN 103323113 B CN103323113 B CN 103323113B CN 201310207068 A CN201310207068 A CN 201310207068A CN 103323113 B CN103323113 B CN 103323113B
- Authority
- CN
- China
- Prior art keywords
- image
- microlens array
- ultraviolet
- infrared
- detector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The invention relates to a multispectral imager based on the light field imaging technique. The multispectral imager based on the light field imaging technique solves the problem that an existing multispectral imager cannot achieve simultaneous focus imaging of targets with different distances away from the multispectral imager within the field range and cannot recover an image out of focus. The multispectral imager based on the light field imaging technique comprises a visual camera lens, a visual microlens array, a visual image detector, a near-infrared camera lens, a near-infrared microlens array, a near-infrared image detector, an ultraviolet camera lens, an ultraviolet microlens array, an ultraviolet array image detector, an image acquisition and control device, and an image processing and display device. According to the multispectral imager based on the light field imaging technique, due to the fact that the microlens arrays are additionally arranged at the front ends of the image detectors in all wave bands, four-dimensional light field image information instead of traditional two-dimensional image information is recorded and saved, no hardware focusing auxiliary device is needed, refocusing of different targets within the field range can be achieved through reconstruction of a two-dimensional image of an image processing module, and the multi-target and multiband image analyzing performance of the multispectral imager is further improved.
Description
Technical field
The present invention relates to a kind of imaging device, particularly a kind of multi-spectral imager based on optical field imaging technology.
Background technology
Existing multi-spectral imager mainly comprises optical lens, detector, image acquisition and control device, and image procossing and display device.It is used for reconnoitring target multiple within the scope of Large visual angle and monitoring.Realize carrying out multi light spectrum hands analysis to multiple monitoring objectives of different distance within the scope of Large visual angle if want, need by adjustment optical system parameter or detector target position, aim at each monitoring objective respectively and carry out machinery focusing shooting successively.Multi-spectral imager is that the field information of all directions sent by monitoring objective projects on detector target surface, realizes the two-dimensional imaging to photographic subjects through opto-electronic conversion.Due to the integration superposition that this projection imaging mode is all directions light, in the process of projection, only remain the overall intensity signal of each light, and lost the directional information of light, the single image collected therefore cannot be utilized to reconstruct other as plane picture.In such cases, once effective focal plane do not adjusted to by detector, will image blur be caused and lose analysis or enjoying value.Be exactly for moving target in addition, then may cause taking unsuccessfully because of out of focus, cannot recover.
Summary of the invention
The present invention will solve existing multi-spectral imager cannot to focus imaging and the technical matters that cannot recover image out of focus to different distance target in field range simultaneously, a kind of optical field imaging technology that utilizes is provided to carry out multi-spectral imaging, based on the multi-spectral imager of optical field imaging technology to whole visual field.
In order to solve the problems of the technologies described above, technical scheme of the present invention is specific as follows:
Based on the multi-spectral imager of optical field imaging technology, it comprises:
With the visible light lens of optical axis alignment, visible ray microlens array and visible images detector;
With the near-infrared camera lenses of optical axis alignment, near infrared microlens array and near-infrared image detector;
With the ultraviolet lens of optical axis alignment, ultraviolet microlens array and ultraviolet image detector;
Described visible ray, near infrared and ultraviolet microlens array receive the light from described visible ray, near infrared and ultraviolet lens respectively, pass through birefringence, by the difference of the light beam of different directions according to space angle, project in described visible ray, near infrared and ultraviolet image detector pixel respectively, generate the corresponding light field picture with field orientation and positional information respectively;
Image acquisition and control device, it, by exporting synchronizing signal, realizes the synchronous triggering of described visible ray, near infrared and ultraviolet image detector opto-electronic conversion frame frequency, gathers each band image data, store or transmit;
Image procossing and display device, it carries out two-dimension image rebuild, image procossing and display according to the light field image with field orientation and positional information collected.
In technique scheme, according to predetermined areas imaging, visible ray microlens array is fixed on visible light lens image planes or neighbouring position, and visible images detector target surface is fixed on visible ray microlens array focal plane position; Each lenticule clear aperature d in visible ray microlens array is identical, and focal distance f is equal, and its aperture F number is equal with visible light lens aperture F number.
In technique scheme, according to predetermined areas imaging, near infrared microlens array is fixed on near-infrared camera lenses image planes or neighbouring position, and near-infrared image detector target surface is fixed near infrared microlens array focal plane position; Each lenticule clear aperature d near infrared microlens array is identical, and focal distance f is equal, and its aperture F number is equal with near-infrared camera lenses aperture F number.
In technique scheme, according to predetermined areas imaging, ultraviolet microlens array is fixed on ultraviolet lens image planes or neighbouring position, and ultraviolet image detector target surface is fixed on ultraviolet microlens array focal plane position; Each lenticule clear aperature d in ultraviolet microlens array is identical, and focal distance f is equal, and its aperture F number is equal with ultraviolet lens aperture F number.
In technique scheme, described camera lens, microlens array, image detector can also extend to its all band.
The beneficial effect of the multi-spectral imager based on optical field imaging technology provided by the invention is:
1, multi-spectral imager provided by the invention is on the basis of traditional multi-spectral imager, with the addition of microlens array in each band image detector front end.By the birefringence of microlens array, by the difference of the light beam of different directions according to space angle, in the image detector pixel of the different-waveband that the different lenticules projecting microlens array respectively cover, replace 2 traditional dimension image informations to carry out record 4 dimension light field image information and preserve.The focus algorithm of servicing unit and the complexity of focusing without the need to any hardware, namely the two-dimension image rebuild by image processing module realizes the different focusing again detecting target in multi-spectral imager field range, further increases multi-spectral imager multiple goal multi-band image analytical performance.
2, multi-spectral imager provided by the invention utilizes optical field imaging technology, carries out multiband optical field imaging to whole visual field, by realizing the two-dimension image rebuild of different focus plane to the ray tracing of light field image, and the covert increase optical system depth of field.And the blur-free imaging of different target under multiple wave band in effective field depth can be realized by single shot.
Accompanying drawing explanation
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
Fig. 1 is multi-spectral imager schematic diagram of the present invention.
Fig. 2 is multi-spectral imager structured flowchart of the present invention.
Fig. 3 is the optical field imaging light path principle figure of a multi-spectral imager of the present invention wave band.
Fig. 4 is the structured flowchart of the embodiment of the present invention 1 multi-spectral imager.
Reference numeral in Fig. 1 is expressed as:
1-visible light lens, 2-visible ray microlens array, 3-visible images detector, 4-near-infrared camera lenses, 5-near infrared microlens array, 6-near-infrared image detector, 7-ultraviolet lens, 8-ultraviolet microlens array, 9-ultraviolet image detector, 10-image acquisition and control device, 11-image procossing and display device.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in detail.
See accompanying drawing 1 and accompanying drawing 3: the multi-spectral imager based on optical field imaging technology provided by the invention comprises the visible light lens 1 of same optical axis alignment, visible ray microlens array 2 and visible images detector 3, with the near-infrared camera lenses 4 of optical axis alignment, near infrared microlens array 5 and near-infrared image detector 6, with the ultraviolet lens 7 of optical axis alignment, ultraviolet microlens array 8 and ultraviolet image detector 9, image acquisition and control device 10, image procossing and display device 11.
According to predetermined areas imaging, visible ray microlens array 2 is fixed on visible light lens 1 image planes or neighbouring position, and visible images detector 3 target surface is fixed on visible ray microlens array 2 focal plane position; Each lenticule clear aperature d in visible ray microlens array 2 is identical, and focal distance f is equal, and its aperture F number is equal with visible light lens 1 aperture F number.Near infrared microlens array 5 is fixed on near-infrared camera lenses 4 image planes or neighbouring position, and near-infrared image detector 6 target surface is fixed near infrared microlens array 5 focal plane position; Each lenticule clear aperature d near infrared microlens array 5 is identical, and focal distance f is equal, and its aperture F number is equal with near-infrared camera lenses 4 aperture F number.Ultraviolet microlens array 8 is fixed on ultraviolet lens 7 image planes or neighbouring position, and ultraviolet image detector 9 target surface is fixed on ultraviolet microlens array 8 focal plane position; Each lenticule clear aperature d in ultraviolet microlens array 8 is identical, and focal distance f is equal, and its aperture F number is equal with ultraviolet lens 7 aperture F number.
Fig. 3 is the optical field imaging light path principle figure of one of them wave band of multi-spectral imager of the present invention.D in figure is the clear aperature of object lens, and v is object distance, and u is image distance, and F is objective focal length, and d is lenticule clear aperature, and f is lenticule focal length, and A is target to be imaged, and A ' is imaging on the detector after optical system.Its light path principle is, target A is imaged on microlens array through object lens, a series of subimage array is divided into by microlens array, each subimage is again through its corresponding lenticular disperse function, scatter on some each detector cells according to the difference of incident angle of light, and then on detector target surface, form the light field image A ' that a width has field information.
See accompanying drawing 2: visible ray microlens array, near infrared microlens array and ultraviolet microlens array receive the light from visible light lens, near-infrared camera lenses and ultraviolet lens respectively, microlens array passes through birefringence, by the difference of the light beam of different directions according to space angle, in the pixel of the visible images detector that the different lenticules projecting corresponding microlens array respectively cover, near-infrared image detector and ultraviolet image detector, generate the corresponding light field picture with field orientation and positional information respectively.Image acquisition and control device are by exporting synchronizing signal, after realizing the synchronous triggering of the opto-electronic conversion frame frequency of visible images detector, near-infrared image detector and ultraviolet image detector, by corresponding image capture module, each band image data are gathered, store or transmitted.Image procossing and display device, it carries out two-dimension image rebuild, image procossing and display according to the light field image with field orientation and positional information collected.
Embodiment 1
By reference to the accompanying drawings shown in 4, embodiments provide a kind of multi-spectral imager based on optical field imaging technology.Described multi-spectral imager comprises: visible light lens, visible ray microlens array, visible images detector, near-infrared camera lenses, near infrared microlens array, near-infrared image detector, ultraviolet lens, ultraviolet microlens array, ultraviolet image detector, image acquisition and Control card and image procossing and display device.Design parameter is as follows:
Visible light lens is the iris setting tight shot that can pass through wavelength coverage 400nm-700nm, and focal length is 60mm, F number is 20.Ultraviolet lens is the iris setting tight shot that can pass through wavelength coverage 300nm-400nm, and focal length is 60mm, F number is 20.Near-infrared camera lenses is the iris setting tight shot that can pass through wavelength coverage 700nm-1000nm, and focal length is 60mm, F number is 20.
Visible ray microlens array, ultraviolet microlens array, near infrared microlens array are the lens arra of K9 material, and microlens array number is 270x206, and focal length is 500 μm.Because image detector target surface should be placed in microlens array focal plane place, therefore before being connected with image detector, image detector leading portion frisket window glass should be removed.
Visible images detector is black and white visible ray industrial camera, and effective pixel resolution is 1620x1236, and pixel dimension is 4.4 μm, carries out data communication by CameraLink data-interface and image acquisition and Control card.Ultraviolet image detector is ultraviolet industrial camera, and effective pixel resolution is 1620x1236, and pixel dimension is 4.4 μm, carries out data communication by CameraLink data-interface and image acquisition and Control card.Near-infrared image detector is the near infrared industrial camera of JAI company of Denmark, and effective pixel resolution is 1620x1236, and pixel dimension is 4.4 μm, carries out data communication by CameraLink data-interface and image acquisition and Control card.
Image acquisition and Control card, primarily of 1 fpga chip and some attached chips composition, in order to realize the collection of three band image data, the output of external trigger synchronizing signal and the conversion of image data format.And by standard gigabit network interface, the view data after conversion is carried out packing transmission according to ICP/IP protocol.
Image procossing and display device are the remote computer with PCI-Express.Computing machine utilizes the process software with multispectral coordinative composition of equipments, carries out light field image 2-d reconstruction, preservation, display and other analyzing and processing to each band image data collected.
Obviously, above-described embodiment is only for clearly example being described, and the restriction not to embodiment.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here exhaustive without the need to also giving all embodiments.And thus the apparent change of extending out or variation be still among the protection domain of the invention.
Claims (4)
1. based on the multi-spectral imager of optical field imaging technology, it is characterized in that, it comprises:
With the visible light lens of optical axis alignment, visible ray microlens array and visible images detector;
With the near-infrared camera lenses of optical axis alignment, near infrared microlens array and near-infrared image detector;
With the ultraviolet lens of optical axis alignment, ultraviolet microlens array and ultraviolet image detector;
Described visible ray, near infrared and ultraviolet microlens array receive the light from described visible ray, near infrared and ultraviolet lens respectively, pass through birefringence, by the difference of the light beam of different directions according to space angle, project in described visible ray, near infrared and ultraviolet image detector pixel respectively, generate the corresponding light field picture with field orientation and positional information respectively;
Image acquisition and control device, it, by exporting synchronizing signal, realizes the synchronous triggering of described visible ray, near infrared and ultraviolet image detector opto-electronic conversion frame frequency, gathers each band image data, store or transmit;
Image procossing and display device, it carries out two-dimension image rebuild, image procossing and display according to the light field image with field orientation and positional information collected.
2. multi-spectral imager according to claim 1, it is characterized in that, according to predetermined areas imaging, visible ray microlens array is fixed on visible light lens image planes or neighbouring position, and visible images detector target surface is fixed on visible ray microlens array focal plane position; Each lenticule clear aperature d in visible ray microlens array is identical, and focal distance f is equal, and its aperture F number is equal with visible light lens aperture F number.
3. multi-spectral imager according to claim 2, it is characterized in that, according to predetermined areas imaging, near infrared microlens array is fixed on near-infrared camera lenses image planes or neighbouring position, and near-infrared image detector target surface is fixed near infrared microlens array focal plane position; Each lenticule clear aperature d near infrared microlens array is identical, and focal distance f is equal, and its aperture F number is equal with near-infrared camera lenses aperture F number.
4. multi-spectral imager according to claim 3, is characterized in that, according to predetermined areas imaging, ultraviolet microlens array is fixed on ultraviolet lens image planes or neighbouring position, and ultraviolet image detector target surface is fixed on ultraviolet microlens array focal plane position; Each lenticule clear aperature d in ultraviolet microlens array is identical, and focal distance f is equal, and its aperture F number is equal with ultraviolet lens aperture F number.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310207068.2A CN103323113B (en) | 2013-05-30 | 2013-05-30 | Multispectral imager based on light fieldd imaging technique |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310207068.2A CN103323113B (en) | 2013-05-30 | 2013-05-30 | Multispectral imager based on light fieldd imaging technique |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103323113A CN103323113A (en) | 2013-09-25 |
| CN103323113B true CN103323113B (en) | 2015-04-22 |
Family
ID=49192006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310207068.2A Expired - Fee Related CN103323113B (en) | 2013-05-30 | 2013-05-30 | Multispectral imager based on light fieldd imaging technique |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103323113B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104516085B (en) * | 2013-09-30 | 2017-04-26 | 香港纺织及成衣研发中心有限公司 | Quick focusing method and device for multispectral imaging |
| CN104359557B (en) * | 2014-12-09 | 2016-07-06 | 上海新跃仪表厂 | A kind of double; two spectrum imaging devices for deep space probing |
| CN104539832B (en) * | 2014-12-31 | 2017-06-23 | 上海理工大学 | Hybrid optical field imaging system |
| CN105182436B (en) * | 2015-09-07 | 2017-07-28 | 南京华图信息技术有限公司 | A kind of apparatus and method of full optical region collection of illustrative plates collaboration detection moving-target |
| CN105572689B (en) * | 2016-03-21 | 2017-12-12 | 上海同繁勘测工程科技有限公司 | A kind of narrow-band multispectral camera array imaging device |
| CN105959597A (en) * | 2016-04-25 | 2016-09-21 | 北京理工大学 | TV-type infrared imaging chip based on quantum dot light-emitting detector |
| CN106153190A (en) * | 2016-06-16 | 2016-11-23 | 电子科技大学 | For obtaining spectral module and the bimodulus multiplex optical device of spectrum |
| CN106500842A (en) * | 2016-11-08 | 2017-03-15 | 北京华夏视科图像技术有限公司 | Multispectral camera and multispectral acquisition system |
| CN106768325A (en) * | 2016-11-21 | 2017-05-31 | 清华大学 | Multispectral light-field video acquisition device |
| CN107347133A (en) * | 2017-08-25 | 2017-11-14 | 合肥芯福传感器技术有限公司 | A kind of dual sensor camera |
| CN111866316B (en) * | 2019-04-26 | 2021-11-12 | 曹毓 | Multifunctional imaging equipment |
| CN112954223B (en) * | 2021-03-26 | 2022-10-21 | 维沃移动通信（深圳）有限公司 | Focusing method and device, electronic equipment, readable storage medium and chip |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101320138A (en) * | 2008-05-16 | 2008-12-10 | 中国科学院西安光学精密机械研究所 | Method and apparatus for simultaneously acquiring stereo and multi-spectral images |
| CN201278057Y (en) * | 2008-05-23 | 2009-07-22 | 中国科学院西安光学精密机械研究所 | Imaging device for simultaneously acquiring stereo and multispectral images |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004191244A (en) * | 2002-12-12 | 2004-07-08 | Minolta Co Ltd | Spectrograph and correction method |
| EP2054668B1 (en) * | 2006-08-25 | 2010-06-23 | Abb Research Ltd. | Camera-based flame detector |
-
2013
- 2013-05-30 CN CN201310207068.2A patent/CN103323113B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101320138A (en) * | 2008-05-16 | 2008-12-10 | 中国科学院西安光学精密机械研究所 | Method and apparatus for simultaneously acquiring stereo and multi-spectral images |
| CN201278057Y (en) * | 2008-05-23 | 2009-07-22 | 中国科学院西安光学精密机械研究所 | Imaging device for simultaneously acquiring stereo and multispectral images |
Non-Patent Citations (1)
| Title |
|---|
| 一种红外多光谱成像光学系统设计;项建胜等;《红外技术》;20091231;第31卷(第2期);第683-686页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103323113A (en) | 2013-09-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103323113B (en) | Multispectral imager based on light fieldd imaging technique | |
| US8027041B1 (en) | Compact snapshot multispectral imaging system | |
| CN107271039A (en) | Compact miniature fast illuminated spectral imaging detecting device and detection method | |
| CN103472592B (en) | A kind of fast high-throughout polarization imaging method of illuminated and polarization imager | |
| Horstmeyer et al. | Flexible multimodal camera using a light field architecture | |
| JP6536877B2 (en) | Imaging device and imaging system | |
| CN106872037B (en) | Fast illuminated compact optical field imaging full-polarization spectrum detection device and method | |
| CN106802184B (en) | The fast compact noise immunity type optical field imaging full-polarization spectrum detection device of illuminated and method | |
| US20140009757A1 (en) | Optical Systems And Methods Employing A Polarimetric Optical Filter | |
| EP3842843A1 (en) | Imaging device and image sensing method | |
| CN105258796A (en) | Co-optical-path miniature multispectral imaging system | |
| US20190197714A1 (en) | Plenoptic Imaging Apparatus, Method, and Applications | |
| CN103091258A (en) | Multispectral imager based on liquid zooming technology | |
| CN1702452B (en) | Digital micromirror multi-target imaging spectrometer device | |
| CN203163728U (en) | Multi-spectral light field camera | |
| CN113540138A (en) | Multispectral image sensor and imaging module thereof | |
| CN107436194A (en) | A kind of high light flux real time spectrum imaging device | |
| JP6511158B2 (en) | Snapshot type polarization hyperspectral camera and imaging method | |
| US11930256B2 (en) | Imaging device, imaging optical system, and imaging method | |
| CN102918355A (en) | Three-dimensional image pickup apparatus, light-transparent unit, image processing apparatus, and program | |
| KR20160074223A (en) | Image pick-up apparatus, portable terminal including the same and image pick-up method using the apparatus | |
| JP2018513964A5 (en) | Snapshot polarization hyperspectral camera and imaging method | |
| CN106949967B (en) | The fast compact channel modulation type optical field imaging full-polarization spectrum detection device of illuminated and method | |
| CN104954645A (en) | Image pickup element, image pickup apparatus, and image processing method | |
| US20140022393A1 (en) | Dual band imager |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150422 Termination date: 20170530 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |