CN103234527B - Multispectral light-field camera - Google Patents
Multispectral light-field camera Download PDFInfo
- Publication number
- CN103234527B CN103234527B CN201310118562.1A CN201310118562A CN103234527B CN 103234527 B CN103234527 B CN 103234527B CN 201310118562 A CN201310118562 A CN 201310118562A CN 103234527 B CN103234527 B CN 103234527B
- Authority
- CN
- China
- Prior art keywords
- lens
- detector
- microlens array
- imaging
- waveband
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The invention provides a multispectral light-field camera. Along a light path direction, the camera comprises a light filter array, a main imaging lens, a micro lens array, combined sub-lenses, a detector and a signal processing system, which are sequentially arranged. An imaging method comprises the steps that: the light filter array is arranged on a pupil plane of the main imaging lens, and information of various target spectral bands is introduced with a pore size division method; with the micro lens array positioned on an image plane of the main imaging lens, the multispectral information is spatially separated; the combined sub-lenses are introduced, such that micro lens focal plane is secondarily transferred to a detector photosensitive surface; and the signal processing system calculates the data obtained by the detector, and spectral images of different wavebands are extracted and obtained. With the camera provided by the invention, multispectral information of each pixel in a full field of view can be obtained, dynamic multispectral imaging can be realized, and system structure is stable.
Description
Technical field
The present invention relates to spectral imaging technology field, particularly a kind of multispectral light-field camera.
Background technology
Multi-optical spectrum imaging technology develops from early 1970s, and along with earth observation, space exploration, military affairs, civil demand and developing.After California Inst Tech USA jet propulsion laboratory proposes the concept of imaging spectrometer, contemporary multispectral romote sensing technology obtains and develops rapidly.2000, refined and the Zhao Baochang in the pure people, Xiangli etc. proposes space-time hybrid modulation polarization interference imaging spe ctroscopy, propose the steady-state polarizing interferometric imaging spectrometer based on Savart polariscope and stable state Large visual angle polarization interference imaging spectrometer correlation technique, and carried out theoretical research, and experimental provision is to the development work of model machine, except knowing the two-dimensional space information of target, one dimension spectral information, the polarization information of target can also be obtained.
Gershun proposed the concept of light field in 1936, be defined as optical radiation in space each position to the propagation of all directions; 20th century six the seventies, the scholars such as Okoshi, Dudnikov have carried out continuous improvement to IP technology, and the effect of microlens array in imaging is also highlighted; Nineteen ninety-five, Berthon places colored filter at pupil plane, and places microlens array on focal plane, have successfully been obtained coloured image; 1996, it is theoretical that the people such as Marc Levoy, Pat Hanrahan introduces four-dimensional light field; 2005, the people such as Ng, Levoy proposed a Typical Representative-plenoptic camera of light field camera; Afterwards, the people such as Ren Ng, Marc Levoy proposes new idea, directly places various optical filter at camera pupil plane, after making single exposure, can realize the modulation of spectrum, polarization state and light intensity simultaneously.
But the method for existing multispectral camera many employings timesharing detection, utilize rotating filtering sheet, adjustable liquid crystal display modulator or acousto-optic modulator, the image information of multiple spectral coverage is gathered in turn within a period of time, the shortcoming of this method is that instrument needs extraneous intervention to regulate inner moving component to change its operating spectrum band in the course of the work, its time delay causes cannot real-time detection, also dynamic video detection cannot be carried out to moving target, and the complicated in mechanical structure of instrument, reliability and stability are lower.
Summary of the invention
The object of the present invention is to provide a kind of multispectral light-field camera can carrying out real-time multi-spectral detection and multispectral video detection to the detection of a target.
The technical solution realizing the object of the invention is: a kind of multispectral light-field camera, comprise arrange in turn along optical path direction filter arrays, imaging main lens, microlens array, combination secondary lens, detector and signal processing system, wherein combine secondary lens and comprise the first lens and the second lens that arrange in turn along optical path direction, combine secondary lens by the back focal plane secondary transferring of microlens array on the target surface of detector; Described filter arrays is positioned at the aperture diaphragm place of imaging main lens, microlens array is positioned in the image planes of imaging main lens, the back focal plane of microlens array overlaps with the front focal plane of the first lens, and detector is positioned on the back focal plane of the second lens, and signal processing system is connected with detector; All optical elements are coaxially contour relative to substrate, namely relative to optical table or instrument base coaxially contour.Described filter arrays 1 is made up of the optical filter of the coplanar different-waveband of M × N sheet, and the size of all optical filters is all identical, and M, N are positive integer.
Based on the formation method of described multispectral light-field camera, comprise the following steps:
Step one: from the incident light of target each point through filter arrays, form the light beam carrying different-waveband information and also pass imaging main lens, imaging on the microlens array at imaging main lens image planes place, form the picture point of carrying different-waveband information, each picture point is spatially separated microlens array back focal plane;
Step 2: each point light of microlens array back focal plane injects the first lens, the second lens are entered with the form of directional light through after the first lens, and obtain the target image carrying different-waveband information on the detector target surface at the second lens back focal plane place, and the target image carrying different-waveband information is converted into electric signal entering signal disposal system;
Step 3: the electric signal received is converted to the different-waveband spectroscopic data of target each point by signal processing system, calculates the different-waveband spectroscopic data obtained, extracts and obtains different-waveband spectrum picture, thus obtain multispectral video.
The present invention compared with prior art, its remarkable advantage:
(1) the multispectral information of complete each pixel within sweep of the eye can be obtained;
(2) spectrum picture of multiple wave band can be obtained simultaneously, realize dynamic multispectral imaging;
(3) inner movement-less part, system architecture is firm.
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Accompanying drawing explanation
Fig. 1 is the light channel structure schematic diagram of multispectral light-field camera of the present invention.
Fig. 2 is that the spectrum of multispectral light-field camera of the present invention extracts schematic diagram.
Embodiment
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Composition graphs 1, multispectral light-field camera of the present invention, comprise arrange in turn along optical path direction filter arrays 1, imaging main lens 2, microlens array 3, combine secondary lens 4, detector 5 and signal processing system 6, wherein combine secondary lens 4 and comprise the first lens 41 and the second lens 42 arranged in turn along optical path direction, combine secondary lens 4 by the back focal plane secondary transferring of microlens array 3 on the target surface of detector 5; Described filter arrays 1 is positioned at the aperture diaphragm place of imaging main lens 2, microlens array 3 is positioned in the image planes of imaging main lens 2, the back focal plane of microlens array 3 overlaps with the front focal plane of the first lens 41, detector 5 is positioned on the back focal plane of the second lens 42, and signal processing system 6 is connected with detector 5; All optical elements are coaxially contour relative to substrate, namely relative to optical table or instrument base coaxially contour.
Multispectral light-field camera of the present invention, described filter arrays 1 is made up of the optical filter of the coplanar different-waveband of M × N sheet, and the size of all optical filters is all identical, and M, N are positive integer.
The formation method of multispectral light-field camera of the present invention, comprises the following steps:
Step one: from the incident light of target each point through filter arrays 1, form the light beam carrying different-waveband information and also pass imaging main lens 2, imaging on the microlens array 3 at imaging main lens 2 image planes place, form the picture point of carrying different-waveband information, each picture point is spatially separated microlens array 3 back focal plane;
Step 2: each point light of microlens array 3 back focal plane injects the first lens 41, the second lens 42 are entered with the form of directional light through after the first lens 41, and obtain the target image carrying different-waveband information on detector 5 target surface at the second lens 42 back focal plane place, and the target image carrying different-waveband information is converted into electric signal entering signal disposal system 6;
Step 3: the electric signal received is converted to the different-waveband spectroscopic data of target each point by signal processing system 6, the different-waveband spectroscopic data obtained is calculated, extraction obtains different-waveband spectrum picture, thus obtain multispectral video, detailed process is: the incident light of target each point incides on imaging main lens 2 after filter arrays 1, on a lenticule of microlens array 3, picture point is formed through imaging main lens 2, be imaged on the target surface of detector 5 through the secondary lens 4 of combination again, form a pixel cell; The pupil plane of imaging main lens 2 passes through the secondary lens 4 of combination to microlens array 3 imaging, be imaged on the target surface of detector 5, the image that detector 5 receives is target picture and the superposing of microlens array 3 imaging, using any one lenticule in microlens array 3 on the target surface of detector 5 imaging as a unit, then each unit inside can be divided into again M × N number of subelement, the corresponding wave band of each subelement, forms the spectrum picture of this wave band with original relative position relation by the subelement of correspondence position in each unit.
Embodiment 1
For 2 × 2 filter arrays 1, the present invention is described in further detail.
Composition graphs 1, multispectral light-field camera of the present invention, comprise arrange in turn along optical path direction filter arrays 1, imaging main lens 2, microlens array 3, combine secondary lens 4, detector 5 and signal processing system 6, wherein combine secondary lens 4 and comprise the first lens 41 and the second lens 42 arranged in turn along optical path direction, combine secondary lens 4 by the back focal plane secondary transferring of microlens array 3 on the target surface of detector 5; Described filter arrays 1 is made up of the optical filter of 2 × 2 coplanar different-wavebands, the size of all optical filters is all identical, from upper left, the optical filter LC that the optical filter LB that the optical filter LA of to be wave band clockwise be successively 400 ~ 450nm, wave band are 450 ~ 500nm, wave band are 500 ~ 550nm, wave band are the optical filter of the optical filter LD of 550 ~ 600nm; Described filter arrays 1 is positioned at the aperture diaphragm place of imaging main lens 2, microlens array 3 is positioned in the image planes of imaging main lens 2, the back focal plane of microlens array 3 overlaps with the front focal plane of the first lens 41, detector 5 is positioned on the back focal plane of the second lens 42, and signal processing system 6 is connected with detector 5; All optical elements are coaxially contour relative to substrate, namely relative to optical table or instrument base coaxially contour.
The course of work of described multispectral light-field camera is: from the incident light of target each point through filter arrays 1, form the light beam carrying different-waveband information and also pass imaging main lens 2, imaging on the microlens array 3 at imaging main lens 2 image planes place, form the picture point of carrying different-waveband information, each picture point is spatially separated microlens array 3 back focal plane; The each point light of microlens array 3 back focal plane injects the first lens 41, the second lens 42 are entered with the form of directional light through after the first lens 41, and obtain the target image carrying different-waveband information on detector 5 target surface at the second lens 42 back focal plane place, and the target image carrying different-waveband information is converted into electric signal entering signal disposal system 6; The electric signal received is converted to the different-waveband spectroscopic data of target each point by signal processing system 6, calculates the different-waveband spectroscopic data obtained, and extracts and obtains different-waveband spectrum picture, thus obtain multispectral video.
Composition graphs 2, the image procossing that this multispectral light-field camera receives detector 5 is as follows, with N=2, M=2 is example: the image that detector 5 receives is target picture and the superposing of microlens array imaging, if using any one lenticule in microlens array 3 on the target surface of detector 5 imaging as a unit, figure as left in Fig. 2 shows first module, second unit, Unit the 3rd, 4th unit four unit, each unit inside is divided into A again separately, B, C, D tetra-subelements: A subelement correspondence 400 ~ 450nm wave band, B subelement correspondence 450 ~ 500nm wave band, C subelement correspondence 500 ~ 550nm wave band, D subelement correspondence 550 ~ 600nm wave band.Therefore, following rearranging is carried out by the order of sub-unit, four complete spectrum pictures can be obtained: the subelement A that will be in first quartile in each unit forms the spectrogram of 450 ~ 500nm wave band with the subelement B of the spectrogram of original relative position relation composition 400 ~ 450nm wave band, the second quadrant, the subelement C of third quadrant forms the spectrogram of 500 ~ 550nm wave band, and the subelement D of fourth quadrant forms the spectrogram of 550 ~ 600nm wave band.
Claims (2)
1. the formation method of a multispectral light-field camera, it is characterized in that, this multispectral light-field camera comprises the filter arrays (1) arranged in turn along optical path direction, imaging main lens (2), microlens array (3), combine secondary lens (4), detector (5) and signal processing system (6), wherein filter arrays (1) is made up of the optical filter of the coplanar different-waveband of M × N sheet, the size of all optical filters is all identical, M, N is positive integer, combine secondary lens (4) and comprise the first lens (41) and the second lens (42) that arrange in turn along optical path direction, combine secondary lens (4) by the back focal plane secondary transferring of microlens array (3) on the target surface of detector (5), described filter arrays (1) is positioned at the aperture diaphragm place of imaging main lens (2), microlens array (3) is positioned in the image planes of imaging main lens (2), the back focal plane of microlens array (3) overlaps with the front focal plane of the first lens (41), detector (5) is positioned on the back focal plane of the second lens (42), and signal processing system (6) is connected with detector (5), all optical elements are coaxially contour relative to substrate, namely relative to optical table or instrument base coaxially contour, formation method comprises the following steps:
Step one: from the incident light of target each point through filter arrays (1), form the light beam carrying different-waveband information and also pass imaging main lens (2), the upper imaging of microlens array (3) at imaging main lens (2) image planes place, form the picture point of carrying different-waveband information, each picture point is spatially separated microlens array (3) back focal plane;
Step 2: each point light of microlens array (3) back focal plane injects the first lens (41), the second lens (42) are entered with the form of directional light through after the first lens (41), and obtain the target image carrying different-waveband information on detector (5) target surface at the second lens (42) back focal plane place, and the target image carrying different-waveband information is converted into electric signal entering signal disposal system (6);
Step 3: the electric signal received is converted to the different-waveband spectroscopic data of target each point by signal processing system (6), calculates the different-waveband spectroscopic data obtained, extracts and obtains different-waveband spectrum picture, thus obtain multispectral video.
2. the formation method of multispectral light-field camera according to claim 1, it is characterized in that, described in step 3, the different-waveband spectroscopic data obtained is calculated, extracting the detailed process obtaining different-waveband spectrum picture is: the incident light of target each point incides on imaging main lens (2) after filter arrays (1), on a lenticule of microlens array (3), picture point is formed through imaging main lens (2), be imaged on the target surface of detector (5) through the secondary lens of combination (4) again, form a pixel cell, the pupil plane of imaging main lens (2) passes through the secondary lens of combination (4) to microlens array (3) imaging, be imaged on the target surface of detector (5), the image that detector (5) receives is target picture and the superposing of microlens array (3) imaging, using any one lenticule in microlens array (3) on the target surface of detector 5 imaging as a unit, then each unit inside can be divided into again M × N number of subelement, the corresponding wave band of each subelement, the subelement of correspondence position in each unit is formed the spectrum picture of this wave band with original relative position relation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310118562.1A CN103234527B (en) | 2013-04-07 | 2013-04-07 | Multispectral light-field camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310118562.1A CN103234527B (en) | 2013-04-07 | 2013-04-07 | Multispectral light-field camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103234527A CN103234527A (en) | 2013-08-07 |
| CN103234527B true CN103234527B (en) | 2015-06-24 |
Family
ID=48882579
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310118562.1A Expired - Fee Related CN103234527B (en) | 2013-04-07 | 2013-04-07 | Multispectral light-field camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103234527B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103091258B (en) * | 2013-01-29 | 2015-08-19 | 中国科学院光电研究院 | A kind of multi-spectral imager based on liquid zoom technology |
| US9992477B2 (en) | 2015-09-24 | 2018-06-05 | Ouster, Inc. | Optical system for collecting distance information within a field |
| MY190572A (en) * | 2016-01-29 | 2022-04-27 | Ouster Inc | Systems and methods for calibrating an optical distance sensor |
| CN106019621B (en) * | 2016-06-27 | 2019-01-15 | 湖北久之洋红外系统股份有限公司 | A kind of high-resolution infrared imaging optical system and imaging method |
| CN107024829B (en) * | 2017-05-17 | 2019-08-02 | 中国科学院光电研究院 | Multispectral camera image planes Method of Adjustment |
| CN107147829B (en) * | 2017-05-25 | 2019-07-23 | 青岛理工大学 | A kind of underwater optics imaging device with axial multisensor |
| CN109357762B (en) * | 2018-08-06 | 2021-05-11 | 北京理工大学 | Snapshot type local high-resolution spectral imager |
| WO2020250774A1 (en) | 2019-06-11 | 2020-12-17 | 富士フイルム株式会社 | Imaging device |
| CN112532832B (en) * | 2020-11-23 | 2022-04-12 | Oppo（重庆）智能科技有限公司 | Imaging device and electronic equipment |
| CN112924029A (en) * | 2021-01-26 | 2021-06-08 | 中国科学院空天信息创新研究院 | Multispectral camera manufacturing method and multispectral camera system |
| CN114322944B (en) * | 2021-12-24 | 2023-09-12 | 中国科学院长春光学精密机械与物理研究所 | Coaxial foldback type navigation and spectrum integrated optical system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6031619A (en) * | 1997-07-01 | 2000-02-29 | Optomed Optomedical Systems Gmbh | Imaging spectrometer |
| CN102944305A (en) * | 2012-11-12 | 2013-02-27 | 北京航空航天大学 | Spectral imaging method and spectrum imaging instrument of snapshot-type high throughput |
| CN203163728U (en) * | 2013-04-07 | 2013-08-28 | 南京理工大学 | Multi-spectral light field camera |
-
2013
- 2013-04-07 CN CN201310118562.1A patent/CN103234527B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6031619A (en) * | 1997-07-01 | 2000-02-29 | Optomed Optomedical Systems Gmbh | Imaging spectrometer |
| CN102944305A (en) * | 2012-11-12 | 2013-02-27 | 北京航空航天大学 | Spectral imaging method and spectrum imaging instrument of snapshot-type high throughput |
| CN203163728U (en) * | 2013-04-07 | 2013-08-28 | 南京理工大学 | Multi-spectral light field camera |
Non-Patent Citations (3)
| Title |
|---|
| Evaluation of Multispectral Plenoptic Camera;Lingfei Meng etc.;《SPIE》;20130204;第8660卷;正文小节1.2、小节2第1段、小节3第1段以及附图1-2 * |
| Optimization of Spectrally Coded Mask for Multi-modal Plenoptic Camera;Kathrin Berkner and Sapna Shroff;《Optical Society of America》;20111231;第1-3页 * |
| Using Focused Plenoptic Cameras for Rich Image Capture;Todor Georgiev etc.;《IEEE》;20110228;第50-61页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103234527A (en) | 2013-08-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103234527B (en) | Multispectral light-field camera | |
| CN203163728U (en) | Multi-spectral light field camera | |
| CN103472592B (en) | A kind of fast high-throughout polarization imaging method of illuminated and polarization imager | |
| CN104457708B (en) | A kind of compact multispectral camera | |
| CN107271039A (en) | Compact miniature fast illuminated spectral imaging detecting device and detection method | |
| CN106872037B (en) | Fast illuminated compact optical field imaging full-polarization spectrum detection device and method | |
| CN109443537B (en) | Spectral imager based on multiple image surfaces | |
| US8908054B1 (en) | Optics apparatus for hands-free focus | |
| CN102081296B (en) | Device and method for quickly positioning compound-eye vision imitated moving target and synchronously acquiring panoramagram | |
| CN105258796A (en) | Co-optical-path miniature multispectral imaging system | |
| CN106802184B (en) | The fast compact noise immunity type optical field imaging full-polarization spectrum detection device of illuminated and method | |
| CN110595625B (en) | Cross-shaped five-aperture view field partially-overlapped bionic thermal imaging system | |
| CN107192454A (en) | A kind of THz optical spectrum imagers based on three-dimensional phase grating and aperture segmentation technology | |
| BR102013027425A2 (en) | Multispectral Focal Image Array | |
| CN103605210A (en) | Virtual type integrated imaging 3D display device | |
| US11781913B2 (en) | Polarimetric imaging camera | |
| CN206281570U (en) | Hyperspectral imager based on step optical filter | |
| CN109164463B (en) | Multi-aperture view field partially-overlapped polarization thermal imaging method and device | |
| CN102680101A (en) | High-light-spectrum full-polarization detection device for interference light field imaging | |
| CN103019021A (en) | 3D (three-dimensional) light field camera and method for processing images shot by same | |
| CN104007556A (en) | Low crosstalk integrated imaging three-dimensional display method based on microlens array group | |
| CN105547477A (en) | Polarization interference imaging spectrum system and imaging method thereof | |
| CN107436194A (en) | A kind of high light flux real time spectrum imaging device | |
| CN110595624B (en) | Cross-shaped four-aperture view field partially-overlapped heat-generation-simulating imaging system | |
| CN106949967A (en) | The fast compact channel modulation type optical field imaging full-polarization spectrum detection device of illuminated and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150624 Termination date: 20210407 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |