CN104793335A - Imaging device and method based on difference compound eye lens - Google Patents
Imaging device and method based on difference compound eye lens Download PDFInfo
- Publication number
- CN104793335A CN104793335A CN201510087544.0A CN201510087544A CN104793335A CN 104793335 A CN104793335 A CN 104793335A CN 201510087544 A CN201510087544 A CN 201510087544A CN 104793335 A CN104793335 A CN 104793335A
- Authority
- CN
- China
- Prior art keywords
- fly
- eye lens
- image
- information
- processing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0012—Optical design, e.g. procedures, algorithms, optimisation routines
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Abstract
The invention discloses an imaging device and method based on a difference compound eye lens. On the basis of the structure of the compound eye lens and an imaging principle, images are formed on a photoelectric sensor through the compound eye lens and the combination between a propagation function feature extraction technology and a difference image processing technology, image region segmentation, propagation function processing and information difference processing are conducted on the images, and finally, image fusion is conducted, so that output of the needed image and needed information is achieved.
Description
Technical field
The invention belongs to optical technical field, relate to a kind of fly's-eye lens method for making and device, particularly controllable fly's-eye lens method for making and a device, the lens arra be mainly used in the fields such as optical imagery, photoelectronic imaging, Photoelectric Detection, species analysis, Laser Processing, illumination optical, shadow casting technique, optical microphotograph, optical control, optical communication, artificial intelligence, robot, mobile terminal makes and application of installation.
Background technology
Imaging is extensively present in the fields such as mobile terminal, robot, electro-optical system, Photoelectric Detection, species analysis, illumination optical, shadow casting technique, optical microphotograph, optical control, optical communication, artificial intelligence, Internet of Things, environment sensing, guidance navigation, historical relic's protection; such as; the importance of image acquisition is more highlighted in field of mobile terminals; smart mobile phone is provided with the hardware and software configuration that image acquisition and processing parts have become a kind of extensive existence, is developed rapidly.Compound eye is for simple eye, and the compound eye of occurring in nature is the principal visual organ of insect, and usually occupy outstanding position at the head of insect, compound eye is made up of most ommatidium.Lens based on the exploitation of compound eye principle of work become fly's-eye lens, and be combined to form by a series of lenslet, in itself, fly's-eye lens is micro lens arrays, so the lens arra related in some optical systems also belongs to fly's-eye lens.
A kind of formation method of fly's-eye lens is there is in first technology, see US granted patent (United States Patent), patent name: Compound lens imaging device, the patent No. is US8760558B2, and date of patent is on June 24th, 2014, and patent applicant is company of reason Ricoh of Japan, i.e. Ricoh Company, Ltd., Tokyo (JP), invention people is six people such as Nobuhiro Morita.Although this has certain advantage in first technology, but it is not enough still to there is essence: 1) this method comprises the fly's-eye lens towards object space and the fly's-eye lens towards image space, there are two groups of fly's-eye lenses, and these two groups of fly's-eye lenses want coaxial, therefore complex manufacturing technology, photoconductive structure complexity, system are difficult to realize; 2) in building process, require that the lens unit opening diameter in fly's-eye lens is consistent, and require that the back focal length of each lens unit is consistent, limit fly's-eye lens and select, design and optimize, add the enforcement difficulty of system, the dirigibility that influential system builds simultaneously; 3) process and what obtain is all image focal plane information in this method, and physically based deformation amount is illumination, affect the effect of acquisition and processing image, obtains amount of image information limited, affect the integrated of method and function expansion dirigibility.
Summary of the invention
The present invention is directed to the technical matters existed in prior art and propose a kind of imaging device based on otherness fly's-eye lens and formation method thereof, concrete scheme is as follows:
A kind of imaging device based on otherness fly's-eye lens, the fly's-eye lens comprising image light source and set gradually along light beam of light source exit direction and for gathering the photoelectric sensor through described fly's-eye lens image information, described fly's-eye lens comprises multiple sub-lens unit, and in multiple sub-lens unit of comprising of described fly's-eye lens, there is multiple focal length value, it is characterized in that, also comprise:
Image acquisition and processing module: be connected with described photoelectric sensor, gathers for carrying out entirety to photosignal on photoelectric sensor and carries out sub-imaging region segmentation, finally obtaining the relation between picture characteristics and fly's-eye lens starting condition;
Transport function processing module: with described image acquisition and processing model calling, for carrying out transport function process and transport function feature extraction to the image information of every sub-imaging region;
Information gap processing module: with described image acquisition and processing model calling, for carrying out the process of image information difference to the image information of every sub-imaging region;
Image co-registration module: be connected with described information gap processing module respectively at described transport function processing module, for carrying out super-resolution image information processing and three-dimensional information extraction to the image information after described transport function processing module and the process of described information gap processing module, realizing the required image information paid close attention to and carrying out information output.
Based on bionics fly's-eye lens image-forming principle in such scheme, simultaneously in conjunction with propagator Feature Extraction Technology and differential image treatment technology, the image of object space is imaged in two-dimension photoelectric sensor plane through fly's-eye lens, in fly's-eye lens, the sub-lens unit of zones of different has different focal lengths, namely, for single sub-lens unit, its focal length value is fixed; But the focal length value between each sub-lens unit is different.Two-dimension photoelectric sensor presenting image is the object space pattern matrix that there is information gap, after imaging region segmentation, carries out transport function processing module and information gap processing module processes; Output information carries out super-resolution image information processing and three-dimensional information extraction by image co-registration module, realizes required concern image feature information imaging and information output.
As preferably, described fly's-eye lens is the one of glass fly's-eye lens, resin fly's-eye lens, plastics fly's-eye lens, composite structure fly's-eye lens.
As preferably, described photoelectric sensor is the one of charge-coupled image sensor, complementary metal oxide semiconductor (CMOS) photoelectric sensor.
As preferably, the opening diameter of each described sub-lens unit is unique.Namely do not require that the opening diameter of each sub-lens unit is consistent, equally also do not require that the focal length of each sub-lens unit is consistent, therefore, system constructing is flexible and low to mechanical requirements.
Based on a formation method for otherness fly's-eye lens, comprise the following steps:
(1) image light source is by image projection in fly's-eye lens, and image beam is incident to photoelectric sensor and is gathered by photoelectric sensor after fly's-eye lens; Wherein, each sub-lens of fly's-eye lens has different focal value, and carries out imaging to image beam in the zones of different of photoelectric sensor respectively;
(2) image acquisition and processing module carries out imaging region segmentation to the integral image collection of photoelectric sensor collection;
(3) transport function processing module carries out transport function process and transport function feature extraction to every sub-imaging region image information after region segmentation process; Information gap processing module carries out information gap process to every sub-imaging region image information after dividing processing;
(4) image co-registration module carries out super-resolution image information processing and three-dimensional information extraction to the image information after described transport function processing module and the process of described information gap processing module, realizes the required image information paid close attention to and carries out information output.
Above-mentioned formation method is based on bionics fly's-eye lens image-forming principle, simultaneously in conjunction with propagator Feature Extraction Technology and differential image treatment technology, the image of object space is imaged in photoelectric sensor plane through fly's-eye lens, in fly's-eye lens, each lens unit has different focal lengths, two-dimension photoelectric sensor presenting image is the object space pattern matrix that there is information gap, after imaging region segmentation, carry out transport function processing module and information gap processing module processes; Output information carries out super-resolution image information processing and three-dimensional information extraction by image co-registration module, realizes required imaging and information output.
As preferably, further comprising the steps of before (1) step: known standard picture is projected to fly's-eye lens by image light source outgoing wide field parallel entrance beam, image acquisition and processing module acquires photoelectric sensor image information, obtains the relation between known standard picture characteristic and fly's-eye lens starting condition and stores after process.
Before the imaging carrying out concrete image, relation between first bioassay standard figure and the starting condition of fly's-eye lens, then this corresponding relation is stored, in imaging after this, just can directly utilize this corresponding relation, from fly's-eye lens imaging contexts, release the information of thing.
A kind of imaging device based on otherness fly's-eye lens of the present invention and formation method thereof, based on fly's-eye lens structure and image-forming principle and combine propagator Feature Extraction Technology and differential image treatment technology by image through fly's-eye lens imaging on the photosensor, and through image region segmentation, transport function process, information gap process, and finally carry out image co-registration, realize required image and information output.
Accompanying drawing explanation
Fig. 1 is the structural representation of a kind of imaging device based on otherness fly's-eye lens of the embodiment of the present invention;
Fig. 2 is a kind of formation method process flow diagram based on otherness fly's-eye lens of the embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Be illustrated in figure 1 a kind of image device structure schematic diagram based on otherness fly's-eye lens of the embodiment of the present invention, specific embodiment is as follows: a kind of imaging device based on otherness fly's-eye lens, comprise image light source 1, the fly's-eye lens 2 arranged along image light source 1 outgoing beam direction, photoelectric sensor 3, photoelectric sensor 3 is connected with the information input terminal of image acquisition and processing module 4, the output terminal of image acquisition and processing module 4 is connected with the input end of transport function processing module 5 and information gap processing module 6, and transport function processing module 5 is all connected with image co-registration module 7 with the output terminal of information gap processing module 6.
Image acquisition and processing module 4 gathers for carrying out entirety to photosignal on photoelectric sensor 3 and carries out sub-imaging region segmentation, finally obtains the relation between picture characteristics and fly's-eye lens starting condition;
Transport function processing module 5 is for carrying out transport function process and transport function feature extraction to the image information of every sub-imaging region;
Information gap processing module 6 is for carrying out the process of image information difference to the image information of every sub-imaging region;
Image co-registration module 7, for carrying out super-resolution image information processing and three-dimensional information extraction to the image information after described transport function processing module 5 and the process of described information gap processing module 6, realizes the required image information paid close attention to and carries out information output.
Wherein, fly's-eye lens 2 comprises each sub-lens unit for glass fly's-eye lens, and diameter and the focal length of each sub-lens unit are different; Photoelectric sensor 3 is charge-coupled image sensor.
Be illustrated in figure 2 a kind of formation method schematic flow sheet based on otherness fly's-eye lens of the embodiment of the present invention, specific embodiment is as follows: a kind of formation method based on otherness fly's-eye lens, and concrete steps are as follows:
1) known standard picture is projected to fly's-eye lens by image light source outgoing wide field parallel entrance beam, image acquisition and processing module acquires photoelectric sensor image information, obtains the relation between known standard picture characteristic and fly's-eye lens starting condition and stores after process.
2) image light source is by image projection to be imaged in fly's-eye lens, and image beam is incident to photoelectric sensor and is gathered by photoelectric sensor after fly's-eye lens; Wherein, each sub-lens of fly's-eye lens has different focal value, and carries out imaging to image beam in the zones of different of photoelectric sensor respectively;
3) image acquisition and processing module carries out imaging region segmentation to the integral image collection of photoelectric sensor collection;
4) the 1st is utilized) step conclusion, transport function processing module carries out transport function process and transport function feature extraction to every sub-imaging region image information after region segmentation process; Information gap processing module carries out information gap process to every sub-imaging region image information after dividing processing;
5) image co-registration module carries out super-resolution image information processing and three-dimensional information extraction to the image information after described transport function processing module and the process of described information gap processing module, realizes the required image information paid close attention to and carries out information output.
Above-described embodiment has been described in detail technical scheme of the present invention and beneficial effect; be understood that and the foregoing is only most preferred embodiment of the present invention; be not limited to the present invention; all make in spirit of the present invention any amendment, supplement and equivalent to replace, all should be included within protection scope of the present invention.
Claims (6)
1. the imaging device based on otherness fly's-eye lens, the fly's-eye lens comprising image light source and set gradually along light beam of light source exit direction and for gathering the photoelectric sensor through described fly's-eye lens image information, described fly's-eye lens comprises multiple sub-lens unit, and in multiple sub-lens unit of comprising of described fly's-eye lens, there is multiple focal length value, it is characterized in that, also comprise:
Image acquisition and processing module: be connected with described photoelectric sensor, gathers for carrying out entirety to photosignal on photoelectric sensor and carries out sub-imaging region segmentation, finally obtaining the relation between picture characteristics and fly's-eye lens starting condition;
Transport function processing module: with described image acquisition and processing model calling, for carrying out transport function process and transport function feature extraction to the image information of every sub-imaging region;
Information gap processing module: with described image acquisition and processing model calling, for carrying out the process of image information difference to the image information of every sub-imaging region;
Image co-registration module: be connected with described information gap processing module respectively at described transport function processing module, for carrying out super-resolution image information processing and three-dimensional information extraction to the image information after described transport function processing module and the process of described information gap processing module, realizing the required image information paid close attention to and carrying out information output.
2. a kind of imaging device based on otherness fly's-eye lens according to claim 1, is characterized in that, described fly's-eye lens is the one of glass fly's-eye lens, resin fly's-eye lens, plastics fly's-eye lens, composite structure fly's-eye lens.
3. a kind of imaging device based on otherness fly's-eye lens according to claim 1, is characterized in that, described photoelectric sensor is the one of charge-coupled image sensor, complementary metal oxide semiconductor (CMOS) photoelectric sensor.
4. a kind of imaging device based on otherness fly's-eye lens according to claim 1, is characterized in that, the opening diameter of each described sub-lens unit is unique.
5., based on a formation method for otherness fly's-eye lens, comprise the following steps:
(1) image light source is by image projection in fly's-eye lens, and image beam is incident to photoelectric sensor and is gathered by photoelectric sensor after fly's-eye lens; Wherein, each sub-lens of fly's-eye lens has different focal value, and carries out imaging to image beam in the zones of different of photoelectric sensor respectively;
(2) image acquisition and processing module carries out imaging region segmentation to the integral image collection of photoelectric sensor collection;
(3) transport function processing module carries out transport function process and transport function feature extraction to every sub-imaging region image information after region segmentation process; Information gap processing module carries out information gap process to every sub-imaging region image information after dividing processing;
(4) image co-registration module carries out super-resolution image information processing and three-dimensional information extraction to the image information after described transport function processing module and the process of described information gap processing module, realizes the required image information paid close attention to and carries out information output.
6. a kind of formation method based on otherness fly's-eye lens according to claim 5, it is characterized in that, further comprising the steps of before (1) step: known standard picture is projected to fly's-eye lens by image light source outgoing wide field parallel entrance beam, image acquisition and processing module acquires photoelectric sensor image information, obtains the relation between known standard picture characteristic and fly's-eye lens starting condition and stores after process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510087544.0A CN104793335A (en) | 2015-02-16 | 2015-02-16 | Imaging device and method based on difference compound eye lens |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510087544.0A CN104793335A (en) | 2015-02-16 | 2015-02-16 | Imaging device and method based on difference compound eye lens |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104793335A true CN104793335A (en) | 2015-07-22 |
Family
ID=53558285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510087544.0A Pending CN104793335A (en) | 2015-02-16 | 2015-02-16 | Imaging device and method based on difference compound eye lens |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104793335A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108919092A (en) * | 2018-06-28 | 2018-11-30 | 芜湖威灵数码科技有限公司 | A kind of fault locator for testing industrial measurement and control instrument |
| CN113141493A (en) * | 2021-04-28 | 2021-07-20 | 合肥工业大学 | Overlapped compound eye |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5218470A (en) * | 1991-01-09 | 1993-06-08 | Fuji Photo Optical Co., Ltd. | Stereoviewer including holder portions for inclining stereoscopic photographs |
| CN101814191A (en) * | 2009-02-25 | 2010-08-25 | 中国科学院自动化研究所 | Three-dimensional image visualization method based on two-dimensional transfer function |
| CN102037717A (en) * | 2008-05-20 | 2011-04-27 | 派力肯成像公司 | Capturing and processing of images using monolithic camera array with hetergeneous imagers |
-
2015
- 2015-02-16 CN CN201510087544.0A patent/CN104793335A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5218470A (en) * | 1991-01-09 | 1993-06-08 | Fuji Photo Optical Co., Ltd. | Stereoviewer including holder portions for inclining stereoscopic photographs |
| CN102037717A (en) * | 2008-05-20 | 2011-04-27 | 派力肯成像公司 | Capturing and processing of images using monolithic camera array with hetergeneous imagers |
| CN101814191A (en) * | 2009-02-25 | 2010-08-25 | 中国科学院自动化研究所 | Three-dimensional image visualization method based on two-dimensional transfer function |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108919092A (en) * | 2018-06-28 | 2018-11-30 | 芜湖威灵数码科技有限公司 | A kind of fault locator for testing industrial measurement and control instrument |
| CN113141493A (en) * | 2021-04-28 | 2021-07-20 | 合肥工业大学 | Overlapped compound eye |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102833487B (en) | Visual computing-based optical field imaging device and method | |
| US8908054B1 (en) | Optics apparatus for hands-free focus | |
| CN104717482A (en) | Multi-spectral multi-depth-of-field array shooting method and shooting camera | |
| Zhang et al. | Sky light polarization detection with linear polarizer triplet in light field camera inspired by insect vision | |
| CN110365878A (en) | A kind of photographic device and method | |
| CN102866480A (en) | Large view field optical imaging system based on computing imaging technology | |
| CN105763815B (en) | A kind of picture pick-up device and its control method of adjust automatically shooting interval | |
| CN108200312A (en) | A kind of light-field camera | |
| US9380273B1 (en) | Multiple aperture video image enhancement system | |
| CN104793335A (en) | Imaging device and method based on difference compound eye lens | |
| CN105872328A (en) | Shooting system | |
| CN104614856A (en) | Imaging device based on fly-eye lens optical structure and imaging method thereof | |
| CN104601871A (en) | Image acquiring method based on fly-eye lens | |
| CN106019536A (en) | Device for extending depth of field of array image sensors | |
| CN103412461B (en) | 3D imaging system based on light splitting piece | |
| CN202615033U (en) | Visible-light infrared-ray confocal lens | |
| Cowan et al. | 360° snapshot imaging with a convex array of long-wave infrared cameras | |
| Tisse | Low-cost miniature wide-angle imaging for self-motion estimation | |
| CN211429404U (en) | Camera and underwater robot | |
| Sahin et al. | Light L16 computational camera | |
| RU2600308C1 (en) | Device of computer system for panoramic television surveillance | |
| Xue et al. | A compact visible bionic compound eyes system based on micro-surface fiber faceplate | |
| CN109698897B (en) | All-in-one optical system of dynamic zoom lens | |
| CN202615032U (en) | High resolution dual-waveband optical zoom lens | |
| CN102914803B (en) | A kind of formation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150722 |