CN203163728U - Multi-spectral light field camera - Google Patents

Multi-spectral light field camera Download PDF

Info

Publication number
CN203163728U
CN203163728U CN 201320169173 CN201320169173U CN203163728U CN 203163728 U CN203163728 U CN 203163728U CN 201320169173 CN201320169173 CN 201320169173 CN 201320169173 U CN201320169173 U CN 201320169173U CN 203163728 U CN203163728 U CN 203163728U
Authority
CN
China
Prior art keywords
lens
detector
imaging
light field
spectral
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 201320169173
Other languages
Chinese (zh)
Inventor
李建欣
徐婷婷
孟鑫
孙宇声
张磊
沈燕
高金铭
周伟
马骏
郭仁慧
沈华
朱日宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Science and Technology
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN 201320169173 priority Critical patent/CN203163728U/en
Application granted granted Critical
Publication of CN203163728U publication Critical patent/CN203163728U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Spectrometry And Color Measurement (AREA)

Abstract

The utility model provides a multi-spectral light field camera. The multi-spectral light field camera comprises an optical filter array, an imaging main lens, a micro-lens array, a combinational auxiliary lens, a detector and a signal processing system, which are sequentially arranged along the direction of a light path; and an imaging method comprises the following steps of firstly placing the optical filter array on a pupil plane of the imaging main lens, and adopting an aperture segmentation method to introduce the information of each spectral section of a target; utilizing the micro-lens array on an image surface of the main imaging main lens to separate the multi-spectral information in space; introducing the combinational auxiliary lens to secondarily transfer a focal plane of the micro-lens to a photosensitive surface of the detector; and finally calculating the data obtained by the detector through the signal processing system, and extracting different waveband optical images. By adopting the multi-spectral light field camera, the multi-spectral information of each pixel in the total view field range can be obtained simultaneously, the dynamic multi-spectral imaging can be realized, and the system structure is firm.

Description

Multispectral light field camera
Technical field
The utility model relates to the light spectrum image-forming technical field, particularly a kind of multispectral light field camera.
Background technology
Multi-optical spectrum imaging technology is since early 1970s development, and develops along with earth observation, space exploration, military affairs, civil demand.After the California Inst Tech USA jet propulsion laboratory proposed the concept of imaging spectrometer, contemporary multispectral romote sensing technology had obtained development rapidly.2000, open the pure people, the Xiangli is refined and Zhao Baochang etc. has proposed space-time hybrid modulation polarization interference imaging spectral technology, stable state polarization interference imaging spectrometer and the big visual field of stable state polarization interference imaging spectrometer correlation technique based on the Savart polariscope have been proposed, and carried out theoretical research, and experimental provision is to the development work of model machine, except the two-dimensional space information that can know target, one dimension spectral information, can also obtain the polarization information of target.
Gershun proposed the concept of light field in 1936, with its be defined as optical radiation in the space each position to the propagation of all directions; 20th century six the seventies, scholars such as Okoshi, Dudnikov have carried out continuous improvement to the IP technology, the effect of microlens array aspect imaging also highlighted; Nineteen ninety-five, Berthon places colored filter at pupil plane, and places microlens array at focal plane, has successfully obtained coloured image; 1996, people such as Marc Levoy, Pat Hanrahan introduced four-dimensional light field theory; 2005, Ng, people such as Levoy proposed a typical case representative-plenoptic camera of light field camera; Afterwards, people such as Ren Ng, Marc Levoy have proposed new idea, directly place various optical filters at the camera pupil plane, make and can realize the modulation of spectrum, polarization state and light intensity simultaneously behind the single exposure.
Yet the method that existing multispectral camera adopts timesharing to survey more, utilize the rotating filtering sheet, regulate liquid crystal modulator or acousto-optic modulator, in a period of time, gather the image information of a plurality of spectral coverages in turn, the shortcoming of this method is that instrument needs extraneous the intervention to regulate inner moving component to change its work spectral coverage in the course of the work, its time delay causes can't real-time detection, also can't carry out dynamic video to moving target surveys, and the complicated in mechanical structure of instrument, reliability and stability are lower.
The utility model content
The purpose of this utility model is to provide a kind of multispectral light field camera that can carry out real-time multispectral sensing and multispectral video detection to the detection of a target.
The technical solution that realizes the utility model purpose is: a kind of multispectral light field camera, comprise the secondary lens of filter arrays, imaging main lens, microlens array, combination, detector and the signal processing system that arrange in turn along optical path direction, wherein make up secondary lens and comprise first lens and second lens that arrange in turn along optical path direction, make up secondary lens with the back focal plane secondary transferring of microlens array to the target surface of detector; Described filter arrays is positioned at the aperture diaphragm place of imaging main lens, microlens array is positioned on the image planes of imaging main lens, the back focal plane of microlens array overlaps with the front focal plane of first lens, and detector is positioned on the back focal plane of second lens, and signal processing system links to each other with detector; All optical elements are coaxial contour with respect to substrate, and are namely coaxial contour with respect to optical table or instrument base.Described filter arrays 1 is made of the optical filter of M * coplanar different-waveband of N sheet, and the size of all optical filters is all identical, and M, N are positive integer.
The utility model compared with prior art, its remarkable advantage:
(1) can obtain the complete multispectral information of each pixel within sweep of the eye;
(2) can obtain the spectrum picture of a plurality of wave bands simultaneously, realize dynamic multispectral imaging;
(3) inner movement-less part, system architecture is firm.
Below in conjunction with accompanying drawing the utility model is described in further detail.
Description of drawings
Fig. 1 is the light channel structure synoptic diagram of the multispectral light field camera of the utility model.
Fig. 2 is that the spectrum of the multispectral light field camera of the utility model extracts synoptic diagram.
Embodiment
Further specify the utility model below in conjunction with the drawings and specific embodiments.
In conjunction with Fig. 1, the multispectral light field camera of the utility model, comprise the filter arrays 1, imaging main lens 2, microlens array 3, combination secondary lens 4, detector 5 and the signal processing system 6 that arrange in turn along optical path direction, wherein make up secondary lens 4 and comprise first lens 41 and second lens 42 that arrange in turn along optical path direction, make up secondary lens 4 with the back focal plane secondary transferring of microlens array 3 to the target surface of detector 5; Described filter arrays 1 is positioned at the aperture diaphragm place of imaging main lens 2, microlens array 3 is positioned on the image planes of imaging main lens 2, the back focal plane of microlens array 3 overlaps with the front focal plane of first lens 41, detector 5 is positioned on the back focal plane of second lens 42, and signal processing system 6 links to each other with detector 5; All optical elements are coaxial contour with respect to substrate, and are namely coaxial contour with respect to optical table or instrument base.
The multispectral light field camera of the utility model, described filter arrays 1 is made of the optical filter of M * coplanar different-waveband of N sheet, and the size of all optical filters is all identical, and M, N are positive integer.
The formation method of the multispectral light field camera of the utility model may further comprise the steps:
Step 1: from the incident light of target each point through filter arrays 1, formation is carried the light beam of different-waveband information and is passed imaging main lens 2, imaging on the microlens array 3 at imaging main lens 2 image planes places, the picture point of different-waveband information is carried in formation, and each picture point is separated in the space of microlens array 3 back focal planes;
Step 2: the each point light of microlens array 3 back focal planes is injected first lens 41, pass first lens, 41 back forms with directional light and enter second lens 42, and obtain carrying the target image of different-waveband information at detector 5 target surfaces at second lens, 42 back focal plane places, and the target image that will carry different-waveband information is converted into electric signal entering signal disposal system 6;
Step 3: signal processing system 6 is converted to the electric signal of receiving the different-waveband spectroscopic data of target each point, the different-waveband spectroscopic data that obtains is calculated, extraction obtains the different-waveband spectrum picture, thereby obtain multispectral video, detailed process is: the incident light of target each point is through inciding behind the filter arrays 1 on the imaging main lens 2, form picture point through imaging main lens 2 at a lenticule of microlens array 3, be imaged on the target surface of detector 5 through the secondary lens 4 of combination again, form a pixel cell; The pupil plane of imaging main lens 2 is to the secondary lens 4 of microlens array 3 imagings process combination, be imaged on the target surface of detector 5, the image that detector 5 receives is the stack of target picture and microlens array 3 imagings, any one lenticule in the microlens array 3 on the target surface of detector 5 imaging as a unit, then each inside, unit can be divided into M * N subelement again, the corresponding wave band of each subelement is formed the subelement of correspondence position in each unit the spectrum picture of this wave band with original relative position relation.
Embodiment 1
Be example with 2 * 2 filter arrays 1, the utility model done describing in further detail.
In conjunction with Fig. 1, the multispectral light field camera of the utility model, comprise the filter arrays 1, imaging main lens 2, microlens array 3, combination secondary lens 4, detector 5 and the signal processing system 6 that arrange in turn along optical path direction, wherein make up secondary lens 4 and comprise first lens 41 and second lens 42 that arrange in turn along optical path direction, make up secondary lens 4 with the back focal plane secondary transferring of microlens array 3 to the target surface of detector 5; Described filter arrays 1 is made of the optical filter of 2 * 2 coplanar different-wavebands, the size of all optical filters is all identical, from upper left, along the optical filter of the optical filter LD that clockwise direction is wave band is the optical filter LA of 400~450nm, optical filter LB that wave band is 450~500nm, wave band is 500~550nm optical filter LC successively, wave band is 550~600nm; Described filter arrays 1 is positioned at the aperture diaphragm place of imaging main lens 2, microlens array 3 is positioned on the image planes of imaging main lens 2, the back focal plane of microlens array 3 overlaps with the front focal plane of first lens 41, detector 5 is positioned on the back focal plane of second lens 42, and signal processing system 6 links to each other with detector 5; All optical elements are coaxial contour with respect to substrate, and are namely coaxial contour with respect to optical table or instrument base.
The course of work of described multispectral light field camera is: from the incident light of target each point through filter arrays 1, formation is carried the light beam of different-waveband information and is passed imaging main lens 2, imaging on the microlens array 3 at imaging main lens 2 image planes places, the picture point of different-waveband information is carried in formation, and each picture point is separated in the space of microlens array 3 back focal planes; The each point light of microlens array 3 back focal planes is injected first lens 41, pass first lens, 41 back forms with directional light and enter second lens 42, and obtain carrying the target image of different-waveband information at detector 5 target surfaces at second lens, 42 back focal plane places, and the target image that will carry different-waveband information is converted into electric signal entering signal disposal system 6; Signal processing system 6 is converted to the different-waveband spectroscopic data of target each point with the electric signal of receiving, the different-waveband spectroscopic data that obtains is calculated, and extracts and obtains the different-waveband spectrum picture, thereby obtain multispectral video.In conjunction with Fig. 2, this multispectral light field camera is handled as follows to the image that detector 5 receives, with N=2, M=2 is example: the image that detector 5 receives is the stack of target picture and microlens array imaging, if any one lenticule in the microlens array 3 on the target surface of detector 5 imaging as a unit, shown first module as the left figure of Fig. 2, Unit second, Unit the 3rd, four unit, Unit the 4th, each inside, unit is divided into A again separately, B, C, four subelements of D: A subelement correspondence 400~450nm wave band, B subelement correspondence 450~500nm wave band, C subelement correspondence 500~550nm wave band, D subelement correspondence 550~600nm wave band.Therefore, carry out following rearranging by the order to subelement, can obtain four complete spectrum pictures: the subelement A that is in first quartile in each unit is formed the spectrogram of 450~500nm wave band with the spectrogram of original relative position relation composition 400~450nm wave band, the subelement B of second quadrant, the subelement C of third quadrant forms the spectrogram of 500~550nm wave band, and the subelement D of fourth quadrant forms the spectrogram of 550~600nm wave band.

Claims (2)

1. multispectral light field camera, it is characterized in that, comprise the filter arrays (1), imaging main lens (2), the microlens array (3) that arrange in turn along optical path direction, make up secondary lens (4), detector (5) and signal processing system (6), wherein make up secondary lens (4) and comprise first lens (41) and second lens (42) that arrange in turn along optical path direction, make up secondary lens (4) with the back focal plane secondary transferring of microlens array (3) to the target surface of detector (5); Described filter arrays (1) is positioned at the aperture diaphragm place of imaging main lens (2), microlens array (3) is positioned on the image planes of imaging main lens (2), the back focal plane of microlens array (3) overlaps with the front focal plane of first lens (41), detector (5) is positioned on the back focal plane of second lens (42), and signal processing system (6) links to each other with detector (5); All optical elements are coaxial contour with respect to substrate, and are namely coaxial contour with respect to optical table or instrument base.
2. multispectral light field camera according to claim 1 is characterized in that, described filter arrays (1) is made of the optical filter of M * coplanar different-waveband of N sheet, and the size of all optical filters is all identical, and M, N are positive integer.
CN 201320169173 2013-04-07 2013-04-07 Multi-spectral light field camera Expired - Fee Related CN203163728U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201320169173 CN203163728U (en) 2013-04-07 2013-04-07 Multi-spectral light field camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201320169173 CN203163728U (en) 2013-04-07 2013-04-07 Multi-spectral light field camera

Publications (1)

Publication Number Publication Date
CN203163728U true CN203163728U (en) 2013-08-28

Family

ID=49024906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201320169173 Expired - Fee Related CN203163728U (en) 2013-04-07 2013-04-07 Multi-spectral light field camera

Country Status (1)

Country Link
CN (1) CN203163728U (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103234527A (en) * 2013-04-07 2013-08-07 南京理工大学 Multispectral light-field camera
CN104154996A (en) * 2014-07-10 2014-11-19 中国科学院西安光学精密机械研究所 Portable snapshot type array multispectral imager
CN105974573A (en) * 2016-06-02 2016-09-28 苏州大学 Light field spectrum microscopic imaging method and system based on microlens array
US9900562B2 (en) 2014-06-25 2018-02-20 Ramot At Tel-Aviv University Ltd. System and method for light-field imaging
WO2018185740A1 (en) * 2017-04-06 2018-10-11 Yoav Berlatzky Wavefront sensor and method of using it
CN111866316A (en) * 2019-04-26 2020-10-30 曹毓 Multifunctional imaging equipment

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103234527A (en) * 2013-04-07 2013-08-07 南京理工大学 Multispectral light-field camera
CN103234527B (en) * 2013-04-07 2015-06-24 南京理工大学 Multispectral light-field camera
US9900562B2 (en) 2014-06-25 2018-02-20 Ramot At Tel-Aviv University Ltd. System and method for light-field imaging
CN104154996A (en) * 2014-07-10 2014-11-19 中国科学院西安光学精密机械研究所 Portable snapshot type array multispectral imager
CN105974573A (en) * 2016-06-02 2016-09-28 苏州大学 Light field spectrum microscopic imaging method and system based on microlens array
CN105974573B (en) * 2016-06-02 2018-06-12 苏州大学 Light field spectrum microscopic imaging method and system based on microlens array
WO2018185740A1 (en) * 2017-04-06 2018-10-11 Yoav Berlatzky Wavefront sensor and method of using it
US11293806B2 (en) 2017-04-06 2022-04-05 Pxe Computational Imagimg Ltd Wavefront sensor and method of using it
CN111866316A (en) * 2019-04-26 2020-10-30 曹毓 Multifunctional imaging equipment

Similar Documents

Publication Publication Date Title
CN103234527B (en) Multispectral light-field camera
CN203163728U (en) Multi-spectral light field camera
CN103472592B (en) A kind of fast high-throughout polarization imaging method of illuminated and polarization imager
CN103323113B (en) Multispectral imager based on light fieldd imaging technique
CN102081296B (en) Device and method for quickly positioning compound-eye vision imitated moving target and synchronously acquiring panoramagram
US8908054B1 (en) Optics apparatus for hands-free focus
EP3513550B1 (en) Flat digital image sensor
US11781913B2 (en) Polarimetric imaging camera
CN101960861A (en) Sensor with multi-perspective image capture
CN105258796A (en) Co-optical-path miniature multispectral imaging system
BR102013027425A2 (en) Multispectral Focal Image Array
CN110595625B (en) Cross-shaped five-aperture view field partially-overlapped bionic thermal imaging system
CN109164463B (en) Multi-aperture view field partially-overlapped polarization thermal imaging method and device
CN106872037A (en) Fast illuminated compact optical field imaging full-polarization spectrum detection device and method
CN112924028B (en) Light field polarization imaging detection system for sea surface oil spill
CN103091258A (en) Multispectral imager based on liquid zooming technology
CN107436194A (en) A kind of high light flux real time spectrum imaging device
CN216748162U (en) Multispectral large-view-field curved fly-eye lens system
CN211425662U (en) Infrared long-wave multispectral imaging device based on microlens filtering array
US10580807B2 (en) Color pixel and range pixel combination unit
CN106949967A (en) The fast compact channel modulation type optical field imaging full-polarization spectrum detection device of illuminated and method
CN110595624B (en) Cross-shaped four-aperture view field partially-overlapped heat-generation-simulating imaging system
CN205679317U (en) A kind of digital zoom type optical spectrum imagers based on microlens array sensor
CN209673224U (en) REAL TIME INFRARED THERMAL IMAGE based on Wollaston prism polarizes double separate imaging optical systems
CN102540273B (en) Double-band detector and oversampling detecting method using double-band detector

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130828

Termination date: 20140407