CN108632506A - A kind of microlens array imaging system - Google Patents
A kind of microlens array imaging system Download PDFInfo
- Publication number
- CN108632506A CN108632506A CN201810233547.4A CN201810233547A CN108632506A CN 108632506 A CN108632506 A CN 108632506A CN 201810233547 A CN201810233547 A CN 201810233547A CN 108632506 A CN108632506 A CN 108632506A
- Authority
- CN
- China
- Prior art keywords
- lenticule
- microlens array
- imaging system
- photosensitive
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
Abstract
The present invention relates to a kind of microlens array imaging systems, including：Microlens array comprising a plurality of lenticules being arranged in proximity to each other；Opaque processes structure every light, is arranged between each two adjacent lenticule and constitutes plane or the trellis of curved surface with a plurality of lenticules；Photosensitive pixel array comprising a plurality of photosensitive elements under each lenticule are set；And imaging results processor, the electric signal of photosensitive pixel array output is received, and the electric signal is converted into image information, to be decoded to described image information and working process.The present invention overcomes the relatively low problem of each lenticule resolution ratio, the whole resolution of the camera with acquisition light field function is improved, it is ensured that each lenticule independent imaging is avoided and interfered with each other between imaging results, it is ensured that the correctness of data.
Description
Technical field
The present invention relates to a kind of imaging system more particularly to a kind of microlens array imaging systems.
Background technology
Camera on the market is mostly single main lens at present, and three-dimensional real world is transformed into two-dimensional image, is led
Bulk information loss is caused.And to restore three-dimensional information from two-dimensional image information, it carries out three-dimensional reconstruction and compares mostly
Difficulty, therefore, there is an urgent need to can acquire the camera of light field to solve the problems, such as this.
The current camera with acquisition light field function is mainly camera array and light-field camera on the market, wherein camera battle array
Row are the problem is that volume is big, and it will take a lot of manpower and time for the relative position adjustment between each camera；And light
Camera is then integral structure, uses microlens structure, to record the angle information of light, but the imaging of light-field camera
Data volume is big, and image processing time is longer, and real-time is poor, and main lens cannot be extractd, and causes camera overall volume larger, no
Suitable for small aircrafts such as flapping-wing aircrafts.
Invention content
In order to solve the above-mentioned problems of the prior art, the present invention is intended to provide a kind of microlens array imaging system,
To reduce the volume and data computational processing of the camera with acquisition light field function, and real-time is improved, expands application surface.
A kind of microlens array imaging system of the present invention comprising：
Microlens array comprising a plurality of lenticules being arranged in proximity to each other；
It is opaque to process structure every light, be arranged between each two adjacent lenticule and with it is a plurality of described
Lenticule constitutes plane or the trellis of curved surface；
Photosensitive pixel array comprising a plurality of photosensitive elements under each lenticule are set；And
Imaging results processor, receives the electric signal of the photosensitive pixel array output, and the electric signal is converted into
Image information, to be decoded to described image information and working process.
In above-mentioned microlens array imaging system, each lenticule is hexagonal, and the trellis is bee
The trellis of nido.
In above-mentioned microlens array imaging system, each photosensitive element is arranged in its corresponding lenticule
Focal plane on or its neighbouring corresponding lenticule focal plane.
In above-mentioned microlens array imaging system, the upper surface and/or lower surface of each lenticule, and/or
Being sticked on the surface of each photosensitive element has different filtering films.
In above-mentioned microlens array imaging system, the imaging results processor includes：Data preliminary treatment module
And three-dimensional reconstruction module, target identification module and the motion detection block being connect respectively with the data preliminary treatment module.
Include microlens array, light-sensitive image as a result of above-mentioned technical solution, in agent structure of the invention
Pixel array and imaging results processor have the advantages that compared with prior art：The present invention by using
Microlens array overcomes the relatively low problem of each lenticule resolution ratio and is carried by the processing of the data between different lenticules
The whole resolution of the camera with acquisition light field function is risen；Structure is processed every light using being added in microlens array, really
Each lenticule independent imaging has been protected, has avoided and interferes with each other between imaging results, it is ensured that the correctness of data；By using
Imaging results processor can realize the functions such as three-dimensional reconstruction, target identification, motion detection.In addition, advantages of the present invention is also wrapped
It includes：Small, data processing calculation amount is small, and real-time is high, wide application.
Description of the drawings
Fig. 1 is a kind of structural schematic diagram of microlens array imaging system of the present invention；
Fig. 2 is microlens array and the structural representation that structure is processed every light in a kind of microlens array imaging system of the present invention
Figure；
Fig. 3 is the structural schematic diagram of imaging results processor in a kind of microlens array imaging system of the present invention；
Fig. 4 is the decoded schematic diagram of lenticule in the present invention.
Specific implementation mode
Below in conjunction with the accompanying drawings, presently preferred embodiments of the present invention is provided, and is described in detail.
As shown in Figs. 1-3, of the invention, i.e., a kind of microlens array imaging system, including：It is microlens array 1, opaque
Structure 2, photosensitive pixel array 3 and imaging results processor 4 are processed every light, specifically：
Microlens array 1 includes a plurality of lenticules 10 being arranged in proximity to each other, and each lenticule 10 is hexagonal；
It is arranged between each two adjacent lenticule 10 every light processing structure 2, i.e. the periphery of each lenticule 10 has
Have and process structure 2 every light, to collectively form plane or the honey comb like trellis of curved surface with a plurality of lenticules 10；
Photosensitive pixel array 3 is used to receive the light of the transmission of microlens array 1, and forms the unified output of electric signal and be extremely imaged
Results processor 4, photosensitive pixel array 3 include：Be arranged under each lenticule 10 a plurality of photosensitive elements (such as CMOS member
Part), each photosensitive element be arranged on the focal plane of its corresponding lenticule 10 or focal plane near；
Imaging results processor 4 is used to the electric signal that photosensitive pixel array 3 exports being converted into image information, and to image
Information carries out operation processings, the imaging results processors 4 such as subsequent decoding, processing：Data preliminary treatment module 41 and
Three-dimensional reconstruction module 42, target identification module 43 and the motion detection block 44 being connect respectively with data preliminary treatment module 41；
Wherein, being sticked on the upper surface and/or lower surface of each lenticule 10, and/or the surface of each photosensitive element has
Different filtering film (not shown), responds so as to the spectrum to different frequency range.
In the present invention, it can be effectively utilized by the above-mentioned arrangement mode of each lenticule 10 in microlens array 1
Space can promote imaging effect by increasing the number of lenticule 10.
In the present invention, optically isolated by that can be carried out between lenticule 10 every light processing structure 2, to avoid difference
Light interferes with each other between lenticule 10, it is ensured that the photosensitive element under each lenticule 10 was not penetrated by contiguous microlens 10
Shadow is rung, if photosensitive pixel array 3 is also thus divided into stem portion, each section corresponds to a lenticule 10, to make it
As independent imaging arrangement, and then ensure the validity of imaging results data.It in the present embodiment, can every light processing structure 2
To be lighttight miniature isolation wall construction, can not also be allowed through each by reflecting, pulling open the modes such as distance between lenticule
The light of lenticule influences the photosensitive element under other contiguous microlens.
In the present invention, different filtering can be arranged on each lenticule 10 or each photosensitive element according to demand
Film, just as color camera, pixel is staggered in RGB three, is achieved in the blockette response of camera, makes its work(
It can fining, promotion camera sensitivity and the ability for adapting to different scenes.In addition, will be directed under the same position of space, to not
With the information consolidation processing that the photosensitive element of spectral response generates, more effective information can be obtained.
In the present invention, since 1 imaging of microlens array is different from traditional camera imaging result, each lenticule
10 pairs of spaces carry out sparse sampling, and the light to carry out multiple and different angles to environment acquires (as shown in Figure 1), and not photosensitive
Element is different to the frequency range of the spectrum of response, therefore, to the electric signal that photosensitive array of elements 3 exports can not directly carry out observation and
Processing, but the imaging results between different lenticules 10 is needed to be combined, that is, by imaging results processor 4 to electricity
After signal is pre-processed, can just subsequent operation, for example, carry out three-dimensional reconstruction according to demand, target identification, movement inspection
The operations such as survey.Specifically：
First, electric signal photosensitive pixel array 3 exported by data preliminary treatment module 41 by digital-to-analogue conversion at
Digital signal is (it is of course also possible to convert the electrical signal to pulse signal or analog signal, in order to be carried out in bionical neuron
Subsequent arithmetic processing), so that the signal that all photosensitive elements transmit is become array of digital images, that is, on the one hand to utilize lenticule battle array
The characteristic of row, that is, each lenticule carries out sparse sampling to space, and the light to carry out multiple and different angles to environment acquires,
The spatial position of target point is actively calculated, all combining image informations are on the other hand transformed into one at different visual angles image
As image (from figure 1 it appears that each 10 times photosensitive elements of lenticule correspond to different location in space, therefore can will feel
The collected pixel of optical element same position is taken out, and a secondary whole picture is combined into), and adjust the bright of image by calculation process
Secretly, white balance, noise etc., this part are equivalent to ISP (the Image Signal Processing) image having in general camera
Signal processing module；
Then, three-dimensional reconstruction module 42,43 and of target identification module will be transmitted separately to by pretreated image information
Motion detection block 44 meets user demand to carry out subsequent image processing；For example, using three-dimensional reconstruction module 42 according to figure
As the three-dimensional data (steric information) of information calculating subject and environment, and exports and be based on being fixed on compound eye coordinate system (right angle
Coordinate or polar coordinates) three-dimensional data；The property of testee, such as Face datection, face are detected using target identification module 43
Identification, the object detection title of object (desk, chair, cup etc. specific), object identification (whose cup, which type of cup,
Where produce etc.)；Itself opposite movement velocity, the movement speed of detected material with environment is detected using motion detection block 44
The movement velocity etc. of complex object in degree, the visual field.
Fig. 4 shows imaging contexts of the microlens array 1 to spatial point, wherein a target point in space corresponds to more
A difference lenticule is imaged respectively, can be utilized this property, be carried out the calculating of the reduction and target range depth of light intensity, to
Basis is done for subsequent processing module.
In conclusion the present invention acquires environmental information by honey comb like microlens array, and utilizes every light processing device,
It will carry out optically isolated between lenticule, avoid interfering, improve imaging data validity, meanwhile, it will be micro- by processing structure every light
Photosensitive pixel array under lens array is divided into different zones, and makes the difference in each region using different filtering films
Position corresponds to the light of different angle, can to utilize imaging results processor by the correlation between microlens location
Obtain the depth information of object；In addition, due to present invention employs the form that multiple lenticules splice, effectively improves to have and adopt
The whole resolution for collecting the camera of light field function, improves final imaging effect.
Above-described, only presently preferred embodiments of the present invention is not limited to the scope of the present invention, of the invention is upper
Stating embodiment can also make a variety of changes.It is simple made by every claims applied according to the present invention and description
Single, equivalent changes and modifications, fall within the claims of patent of the present invention.The not detailed description of the present invention is normal
Advise technology contents.
Claims (5)
1. a kind of microlens array imaging system, which is characterized in that the system comprises：
Microlens array comprising a plurality of lenticules being arranged in proximity to each other；
It is opaque to process structure every light, be arranged between each two adjacent lenticule and with it is a plurality of described micro-
Mirror constitutes plane or the trellis of curved surface；
Photosensitive pixel array comprising a plurality of photosensitive elements under each lenticule are set；And
Imaging results processor, receives the electric signal of the photosensitive pixel array output, and the electric signal is converted into image
Information, to be decoded to described image information and working process.
2. microlens array imaging system according to claim 1, which is characterized in that each lenticule is in six sides
Shape, the trellis are honey comb like trellis.
3. microlens array imaging system according to claim 1, which is characterized in that each photosensitive element setting exists
On the focal plane of its corresponding lenticule or focal plane of its neighbouring corresponding lenticule.
4. microlens array imaging system according to claim 1, which is characterized in that the upper surface of each lenticule
And/or it is sticked on lower surface, and/or the surface of each photosensitive element and has different filtering films.
5. microlens array imaging system according to claim 1, which is characterized in that the system also includes the imagings
Results processor includes：Data preliminary treatment module and the Three-dimensional Gravity modeling being connect respectively with the data preliminary treatment module
Block, target identification module and motion detection block.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810233547.4A CN108632506A (en) | 2018-03-21 | 2018-03-21 | A kind of microlens array imaging system |
| PCT/CN2019/078872 WO2019179462A1 (en) | 2018-03-21 | 2019-03-20 | Microlens array imaging system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810233547.4A CN108632506A (en) | 2018-03-21 | 2018-03-21 | A kind of microlens array imaging system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108632506A true CN108632506A (en) | 2018-10-09 |
Family
ID=63696122
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810233547.4A Pending CN108632506A (en) | 2018-03-21 | 2018-03-21 | A kind of microlens array imaging system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108632506A (en) |
| WO (1) | WO2019179462A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109348114A (en) * | 2018-11-26 | 2019-02-15 | Oppo广东移动通信有限公司 | Imaging device and electronic equipment |
| WO2019179462A1 (en) * | 2018-03-21 | 2019-09-26 | 中国科学院上海微系统与信息技术研究所 | Microlens array imaging system |
| CN111164611A (en) * | 2019-06-05 | 2020-05-15 | 深圳市汇顶科技股份有限公司 | Under-screen biological feature recognition device and electronic equipment |
| WO2024027151A1 (en) * | 2022-08-05 | 2024-02-08 | 上海禾赛科技有限公司 | Detection module, detector and laser radar |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111523440B (en) * | 2020-04-21 | 2023-10-27 | 上海思立微电子科技有限公司 | Under-screen optical fingerprint identification device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350358A (en) * | 2007-07-17 | 2009-01-21 | 台湾积体电路制造股份有限公司 | Semiconductor device and image sensing device |
| CN102621599A (en) * | 2012-03-26 | 2012-08-01 | 天津大学 | Inner-side curved-surface fly's-eye lens capable of enlarging field angle |
| US20130155183A1 (en) * | 2011-12-14 | 2013-06-20 | Electronics And Telecommunications Research Institute | Multi image supply system and multi image input device thereof |
| CN104050662A (en) * | 2014-05-30 | 2014-09-17 | 清华大学深圳研究生院 | Method for directly obtaining depth image through light field camera one-time imaging |
| CN105635530A (en) * | 2014-11-03 | 2016-06-01 | 北京蚁视科技有限公司 | Light field imaging system |
| CN105900238A (en) * | 2013-05-21 | 2016-08-24 | 伊莎贝尔·莉娜·布拉斯科怀持 | Monolithic integration of plenoptic lenses on photosensor substrates |
| CN107071253A (en) * | 2017-05-27 | 2017-08-18 | 深圳奥比中光科技有限公司 | The light-field camera of compact conformation |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108632506A (en) * | 2018-03-21 | 2018-10-09 | 中国科学院上海微系统与信息技术研究所 | A kind of microlens array imaging system |
-
2018
- 2018-03-21 CN CN201810233547.4A patent/CN108632506A/en active Pending
-
2019
- 2019-03-20 WO PCT/CN2019/078872 patent/WO2019179462A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350358A (en) * | 2007-07-17 | 2009-01-21 | 台湾积体电路制造股份有限公司 | Semiconductor device and image sensing device |
| US20130155183A1 (en) * | 2011-12-14 | 2013-06-20 | Electronics And Telecommunications Research Institute | Multi image supply system and multi image input device thereof |
| CN102621599A (en) * | 2012-03-26 | 2012-08-01 | 天津大学 | Inner-side curved-surface fly's-eye lens capable of enlarging field angle |
| CN105900238A (en) * | 2013-05-21 | 2016-08-24 | 伊莎贝尔·莉娜·布拉斯科怀持 | Monolithic integration of plenoptic lenses on photosensor substrates |
| CN104050662A (en) * | 2014-05-30 | 2014-09-17 | 清华大学深圳研究生院 | Method for directly obtaining depth image through light field camera one-time imaging |
| CN105635530A (en) * | 2014-11-03 | 2016-06-01 | 北京蚁视科技有限公司 | Light field imaging system |
| CN107071253A (en) * | 2017-05-27 | 2017-08-18 | 深圳奥比中光科技有限公司 | The light-field camera of compact conformation |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019179462A1 (en) * | 2018-03-21 | 2019-09-26 | 中国科学院上海微系统与信息技术研究所 | Microlens array imaging system |
| CN109348114A (en) * | 2018-11-26 | 2019-02-15 | Oppo广东移动通信有限公司 | Imaging device and electronic equipment |
| CN111164611A (en) * | 2019-06-05 | 2020-05-15 | 深圳市汇顶科技股份有限公司 | Under-screen biological feature recognition device and electronic equipment |
| CN111164611B (en) * | 2019-06-05 | 2024-04-09 | 深圳市汇顶科技股份有限公司 | Under-screen biological characteristic recognition device and electronic equipment |
| WO2024027151A1 (en) * | 2022-08-05 | 2024-02-08 | 上海禾赛科技有限公司 | Detection module, detector and laser radar |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019179462A1 (en) | 2019-09-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108632506A (en) | A kind of microlens array imaging system | |
| US10021340B2 (en) | Method and an apparatus for generating data representative of a light field | |
| JP4563513B2 (en) | Image processing apparatus and pseudo-stereoscopic image generation apparatus | |
| CN106454287A (en) | Combined camera shooting system, mobile terminal and image processing method | |
| US11100669B1 (en) | Multimodal three-dimensional object detection | |
| CN106572340A (en) | Camera shooting system, mobile terminal and image processing method | |
| US8908054B1 (en) | Optics apparatus for hands-free focus | |
| WO2018028152A1 (en) | Image acquisition device and virtual reality device | |
| CN102647941A (en) | Method and system for carrying out photoplethysmography | |
| WO2018161883A1 (en) | Virtual ray tracing method and dynamic light field refocusing display system | |
| CN105357515A (en) | Color and depth imaging method and device based on structured light and light-field imaging | |
| CN105635533B (en) | A kind of fast illuminated EO-1 hyperion camera with high dynamic response range | |
| CN106170086B (en) | Method and device thereof, the system of drawing three-dimensional image | |
| CN111060008B (en) | 3D intelligent vision equipment | |
| CN103390290A (en) | Information processing device and information processing method | |
| Martel et al. | Real-time depth from focus on a programmable focal plane processor | |
| CN108280807A (en) | Monocular depth image collecting device and system and its image processing method | |
| US20220103797A1 (en) | Integrated Spatial Phase Imaging | |
| AU2020408599A1 (en) | Light field reconstruction method and system using depth sampling | |
| CN111970424B (en) | Light field camera unblocking system and method based on micro-lens array synthetic aperture | |
| US10909704B2 (en) | Apparatus and a method for generating data representing a pixel beam | |
| WO2022262760A1 (en) | Micro-optical device-based end-to-end photoelectric detection system and method | |
| US20230245396A1 (en) | System and method for three-dimensional scene reconstruction and understanding in extended reality (xr) applications | |
| AU2021100634A4 (en) | Image target recognition system based on rgb depth-of-field camera and hyperspectral camera | |
| CN116097298A (en) | Infrared and non-infrared channel mixer for depth map construction using structured light |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181009 |