CN101076085A - Method and apparatus for image capturing and electronic apparatus using the same - Google Patents
Method and apparatus for image capturing and electronic apparatus using the same Download PDFInfo
- Publication number
- CN101076085A CN101076085A CNA2007101075005A CN200710107500A CN101076085A CN 101076085 A CN101076085 A CN 101076085A CN A2007101075005 A CNA2007101075005 A CN A2007101075005A CN 200710107500 A CN200710107500 A CN 200710107500A CN 101076085 A CN101076085 A CN 101076085A
- Authority
- CN
- China
- Prior art keywords
- image
- eye image
- simple eye
- capture apparatus
- imaging len
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 21
- 238000003384 imaging method Methods 0.000 claims abstract description 146
- 230000015556 catabolic process Effects 0.000 claims abstract description 22
- 238000006731 degradation reaction Methods 0.000 claims abstract description 22
- 230000003287 optical effect Effects 0.000 claims abstract description 18
- 238000012546 transfer Methods 0.000 claims abstract description 10
- 210000000162 simple eye Anatomy 0.000 claims description 121
- 150000001875 compounds Chemical class 0.000 claims description 43
- 238000004364 calculation method Methods 0.000 claims description 26
- 238000012937 correction Methods 0.000 claims description 25
- 230000015572 biosynthetic process Effects 0.000 claims description 7
- 238000009434 installation Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 6
- 230000007850 degeneration Effects 0.000 claims description 3
- 230000001915 proofreading effect Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 2
- 230000001747 exhibiting effect Effects 0.000 abstract 1
- 241000219739 Lens Species 0.000 description 95
- 210000000695 crystalline len Anatomy 0.000 description 95
- 238000010586 diagram Methods 0.000 description 24
- 230000004907 flux Effects 0.000 description 21
- 230000006870 function Effects 0.000 description 9
- 238000012634 optical imaging Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 239000011347 resin Substances 0.000 description 8
- 229920005989 resin Polymers 0.000 description 8
- 238000000465 moulding Methods 0.000 description 7
- 230000004075 alteration Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 239000011521 glass Substances 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 239000002184 metal Substances 0.000 description 5
- 210000001747 pupil Anatomy 0.000 description 4
- 238000001914 filtration Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 239000004925 Acrylic resin Substances 0.000 description 2
- 229920000178 Acrylic resin Polymers 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
- Lenses (AREA)
- Image Processing (AREA)
- Automatic Focus Adjustment (AREA)
Abstract
An image capturing apparatus includes an imaging lens, an image pickup device, and a correcting circuit. The imaging lens is configureured to focus light from an object to form an image. The image pickup device is configureured to pick up the image formed by the imaging lens. The correcting circuit is configureured to execute computations for correcting image degradation of the image caused by the imaging lens. The imaging lens is also a single lens having a finite gain of optical transfer function and exhibiting a minute difference in the gain between different angles of view of the imaging lens.
Description
Technical field
The electronic installation that the present invention relates to a kind of image-capturing method and device and use this method and apparatus relates more particularly to effectively to reproduce the image-capturing method and the device of quality image and the electronic installation that uses this device.
Background technology
Image capture apparatus comprises digital camera, rig camera, vehicle-mounted vidicon etc.Some image capture apparatus are used in the image read-out or pattern recognition device of carrying out iris or face's discriminating.In addition, some image capture apparatus also are used in such as in computer or the cellular electronic installation.
Some image capture apparatus have optical imaging system and image capture device.Optical imaging system comprise focusing from the light of object to form the imaging len of image.Image capture device such as CCD (charge coupled device) or CMOS (complementary metal oxide semiconductors (CMOS)) transducer absorbs the image that imaging len forms.
For this image capture apparatus, how reproducing high-quality effectively similarly is challenging task.Usually, image capture apparatus is attempted to improve the image quality in images of reproduction by the optical property that strengthens optical imaging system.
Yet this high optical property is difficult to realize in having the optical imaging system of simple structure.For example, for the optical imaging system that uses single lens,, also be difficult to obtain high relatively optical property even the surface of single lens is aspheric surfaces.
Some image capture apparatus are also attempted to improve the image quality in images of reproduction by OTF (optical transfer function) data of using optical imaging system.
The image capture apparatus of use OTF data comprises the non-spherical element in the optical imaging system.This non-spherical element applies phase modulated to the light by imaging len.Thereby non-spherical element is modulated OTF, so that suppress OTF according to the visual angle of imaging len or the variation of object distance.
Then image capture apparatus is by image and the image combine digital filtering to absorb of image-pickup device picked-up through phase modulated.In addition, image capture apparatus recovers initial OTF to reproduce image.Thereby, can under the situation of the degeneration that the variation that suppresses visual angle or object distance causes, absorb the image that reproduces.
Yet non-spherical element has special surface configuration, thereby can increase manufacturing cost unfavourably.In addition, image capture apparatus may need long relatively light path so that non-spherical element is placed on the light path of imaging len system.Therefore, the image capture apparatus of this use non-spherical element is reducing cost, miniaturization, and perhaps slimming aspect is not so favourable.
In addition, image capture apparatus adopts the compound eye optical system, such as microlens array, obtains more slim image capture apparatus.The compound eye optical system comprises a plurality of imaging lens.Each imaging len focuses on to form compound eye image simple eye image.
Image capture apparatus is by image capture device picked-up compound eye image.Then image capture apparatus is from constituting the single image of simple eye image reconstruction of compound eye image.
For example, image capture apparatus adopts the microlens array that comprises a plurality of imaging lens.Each imaging len forms simple eye image.Image capture apparatus is by utilizing the single image of parallax reconstruct between the simple eye image.
Therefore, use microlens array, image capture apparatus is attempted to reduce back focal length and is obtained slim optical imaging system.In addition, use a plurality of simple eye images, image capture apparatus attempts to proofread and correct because the degeneration of the resolution that the pixel of relatively small amount causes on each simple eye image.
Yet this image capture apparatus can not be proofreaied and correct effectively because the optical imagery that optical imaging system causes is degenerated.
Summary of the invention
At least one embodiment of the present invention provides a kind of image capture apparatus to comprise imaging len, image capture device, and correcting circuit.Imaging len disposes and focuses on from the light of object to form image.The image capture cell configuration is absorbed the image that imaging len forms.Correcting circuit disposes the calculating of the image degradation of carrying out the image that the correcting imaging lens cause.Imaging len is single lens, and these single lens have the gain of limited optical transfer function and show the fine difference in the gain between the different visual angles of imaging len.
In addition, the present invention at least one embodiment provide a kind of image capture apparatus, comprises lens arra, reconfigurable circuit and reconstructed image correcting circuit.Lens arra comprises a plurality of imaging lens by arrayed.This lens arra disposes and forms compound eye image, and this compound eye image comprises the simple eye image of object.Simple eye image is formed by each imaging len.Reconfigurable circuit disposes the calculating of carrying out from the single image of compound eye image reconstruct of lens arra formation.Reconstructed image correcting circuit, configuration are carried out the calculating that is used to proofread and correct by the image degradation of the single image of reconfigurable circuit reconstruct.
From the detailed description of following exemplary embodiment, accompanying drawing and related right will embody its its feature of the present invention and advantage in requiring fully.
Description of drawings
By the following detailed description of reference in conjunction with the accompanying drawings the time, will be familiar with and understand the present invention and a lot of attendant advantages thereof better, wherein:
Fig. 1 is the schematic diagram of example explanation according to the image capture apparatus structure of exemplary embodiment of the present invention;
Fig. 2 A is the schematic diagram of example explanation light path of observed imaging len when the convex surface of imaging lens is faced imaging surface;
Fig. 2 B is the schematic diagram of the light path of observed this imaging len when the convex surface of the imaging len of Fig. 2 A is faced body surface;
Fig. 2 C is the curve chart of MTF (modulation transfer function) value of the luminous flux of example key diagram 2A;
Fig. 2 D is the curve chart of mtf value of the luminous flux of example key diagram 2B;
Fig. 3 A is the schematic diagram of example explanation according to the image capture apparatus structure of another exemplary embodiment of the present invention;
Fig. 3 B is that the lens arra system of Fig. 3 A example explanation and the part of image capture device are amplified diagram;
Fig. 3 C is the schematic diagram of example key diagram as the example of the compound eye image of pickup device picked-up;
Fig. 4 be the example explanation luminance deviation that depends on two parallax relevant parameters least square and the three-dimensional curve diagram of example of variation;
Fig. 5 is the schematic diagram of the reconstructing method of example explanation from compound eye image to single image;
Fig. 6 is the flow chart of sequence flow of the reconstruction processing of example explanation image degradation treatment for correcting and single image;
Fig. 7 is the flow chart of another sequence flow of the reconstruction processing of example explanation image degradation treatment for correcting and single image;
Fig. 8 is the curve chart of example of variation of the MTF of the example explanation object distance that depends on imaging len;
Fig. 9 is the schematic diagram of the pel array example of example explanation colourful CCD video camera.
The purpose of accompanying drawing is an explanation exemplary embodiment of the present invention, limits the scope of the invention and should not be regarded as.Unless otherwise indicated, should not be considered as that accompanying drawing is drawn to scale.
Embodiment
Term used herein only is in order to describe specific embodiment rather than intention restriction the present invention.As employed here, unless context specifies that singulative is intended that and comprises plural form equally.Should be understood that further that when using in this manual, word " comprises " and refers to the feature that existence is stated, integer, step, operation, element and/or assembly, but do not get rid of one or more further feature, integer, step, operation, element, assembly, and/or the existence of their combination or increase.
In describing accompanying drawing in the exemplary embodiment of example explanation, for purpose clearly adopts particular term.Yet intention is not the announcement of present specification to be limited to the particular term of such selection, and should be understood that each particular element comprises all technical equivalents of working in a similar manner.
With reference now to diagram, describe exemplary embodiment of the present invention, wherein identical Reference numeral refers to same or corresponding components in several diagrams.
Fig. 1 is the schematic diagram of example explanation according to the structure of the image capture apparatus 100 of exemplary embodiment of the present invention.
As shown in Figure 1, image capture apparatus 100 for example can comprise imaging len 2, image capture device 3, correcting circuit 4, memory 5, and image display 6.
In Fig. 1, imaging len 2 can be the plane-convex lens with spherical convex surface.Image capture device 3 can be CCD or cmos camera.Image display 6 can be a LCD for example.
As shown in Figure 1, place imaging len 2 and make its plane, and its convex surface is in the face of image capture device 3 in the face of object 1.
Imaging len 2 focuses on light from object 1 to form the image of object 1 on the image capture surface of image capture device 3.Image-pickup device 3 absorbs the image of objects 1, and the view data of picked-up is sent to correcting circuit 4.
The OTF data of memory 5 storage imaging lens 2, and OTF (x, y).The OTF data obtain in the following way.At first, the wave aberration by ray trace analog computation imaging len 2.Then, determine the pupil function of imaging len 2 from wave aberration.Further, carry out auto-correlation for pupil function and calculate, thereby generate the OTF data.
Correcting circuit 4 reads the OTF data and uses the OTF data that the view data of picked-up is carried out correction calculation from memory 5.The view data that correcting circuit 4 is also exported through overcorrect arrives image display 6.Image display 6 is based on the image 6a through the view data display reproduction of overcorrect.
Below, with reference to figure 2A to 2D describe imaging len towards influence for the image that focuses on.The imaging len L of Fig. 2 A and 2B is configured to plane-convex lens.
Fig. 2 A is the schematic diagram of example explanation light path of observed imaging len when the convex surface of imaging lens L is faced the image that focuses on.Fig. 2 B is the schematic diagram of the light path of observed this imaging len when facing body surface OS as the convex surface of the imaging len L that carries out traditionally.
In Fig. 2 A and 2B, three luminous flux F1, F2 and F3 can have the mutual different incidence angle with respect to imaging len L.
The luminous flux F1 of Fig. 2 A, F2 and F3 are than the luminous flux F1 of Fig. 2 B, and F2 and F3 show relatively low focus characteristics and lower ray density.Therefore, the luminous flux F1 of Fig. 2 A, F2 shows relative little mutual difference with F3 in the scope of imaging surface IS.
On the other hand, the luminous flux F1 of Fig. 2 B, F2 and F3 are than the luminous flux F1 of Fig. 2 A, and F2 shows relative higher focus characteristics with F3.Therefore, the luminous flux F1 of Fig. 2 B, F2 shows relative big mutual difference with F3 in the scope of imaging surface IS.
By the MTF (modulation transfer function) with reference to the gain of the OTF of indication imaging len L can understand well imaging len L towards and the image that focuses between this relation.
Fig. 2 C be example explanation when as shown in Fig. 2 A place imaging len L the time luminous flux F1 that obtains, the curve chart of the mtf value of F2 and F3.
On the other hand, Fig. 2 D be example explanation when as shown in Fig. 2 B place imaging len L the time luminous flux F1 that obtains, the curve chart of the mtf value of F2 and F3.
Difference clearly on the MTF between the image formation state that Fig. 2 A and Fig. 2 B relatively are provided of Fig. 2 C and Fig. 2 D.
In Fig. 2 C, line 2-1 representative is for the mtf value of the imaging len L of sagittal plane and the tangential plane luminous flux F1 on the two.Difference between two observed planes on the MTF is too little so that can not distinguish on figure.
Line 2-2 represents sagittal plane and the tangential plane mtf value for the imaging len L of luminous flux F2 on the two.Difference between two observed planes on the MTF is too little so that can not distinguish on figure in Fig. 2 C.
For luminous flux F3, line 2-3 and 2-4 represent the mtf value of sagittal plane and the tangential plane imaging len L on the two respectively.Shown in Fig. 2 A, compare with F2 with luminous flux F1, luminous flux F3 has the relatively big incidence angle relevant with imaging len L.Difference between observed sagittal plane and the tangential plane on the MTF can be distinguished on figure in Fig. 2 C.
Thereby in the image formation state of Fig. 2 A, imaging len L shows lower focusing performance, and this causes the low mtf value of finite sum usually.Yet imaging len L shows luminous flux F1, F2, and MTF goes up little difference between the F3, this difference by incidence angle causes.
Therefore, when the convex surface that makes imaging len formed image in the face of image, no matter the incidence angle size, the mtf value of imaging len L was normally limited and lower.Mtf value also can not be subjected to the very big influence of the incidence angle difference of light.
In the image formation state of Fig. 2 B, show such as the luminous flux of F1 that MTF goes up insignificant difference between sagittal plane and the tangential plane with little incidence angle.Thereby, obtained preferable MTF characteristic.
On the other hand, the such angle of incidence of light shown in F2 and F3 is big more, and then mtf value is more little.
In Fig. 2 D, line 2-6 and 2-7 represent respectively imaging len L for luminous flux F2 radially and tangential MTF curve.In Fig. 2 D, line 2-8 and 2-9 represent respectively imaging len L for luminous flux F3 radially and tangential MTF curve.
But, can proofread and correct in the following manner because the image degradation that the factor relevant with OTF causes when the OTF of the lens combination data time spent.
When the image that forms on the imaging surface was degenerated owing to the factor relevant with lens combination, the light intensity of image was represented by following equation 1:
I(x，y)＝FFT
-1[FFT{S(x，y)}×OTF(x，y)] ...1
The position coordinates on " x " and " y " representative image picked-up plane wherein, the light intensity of the image of " I (x, y) " representative image pickup device picked-up, " S (x, y) " represents the light intensity of object, and " OTF (x, y) " represents the OTF of imaging len.In addition, FFT represents Fourier transform operator, FFT
-1Represent the inverse Fourier transform operator.
More particularly, the lip-deep light intensity of image capture of light intensity " I (x, y) " representative such as the imageing sensor of CCD or cmos sensor.
Can obtain in advance in the following manner in the equation 1 OTF (x, y).At first, determine the wave aberration of imaging len by the ray trace simulation.Calculate the pupil function of imaging len based on wave aberration.Further, carry out auto-correlation for pupil function and calculate, thereby generate the OTF data.Therefore, can obtain the OTF data in advance according to the imaging len that uses in the image capture apparatus 100.
If the both sides to equation 1 are used FFT simultaneously, then equation 1 is transformed to:
FFT{I(x，y)}＝[FFT{S(x，y)}×?OTF(x，y)] ...1a
Further, above-mentioned equation 1a is transformed to:
FFT{S(x，y)}＝FFT{I(x，y)}/OTF(x，y) ...1b
In this regard, (x, y) during the light intensity of the image that reproduces of representative, (x y) demonstrates that (then the image of Zai Xianing reproduces object more accurately for x, y) more definite correspondence for S to R as R.
When (x in the time of y), can pass through the right sided application FFT to above-mentioned equation 1b for imaging len obtains OTF in advance
-1Determine R (x, y).Therefore, can by following equation 2 represent R (x, y):
R(x，y)＝FFT
-1[FFT{I(x，y)}/OTF(x，y)+α] ...2
Wherein " α " representative is used to prevent the arithmetic error of removing such as quilt zero and suppresses the constant that noise amplifies.In this regard, OTF (x, y) accurate more, then R (x, y) closer reflect S (x, y).Thereby, the image that can obtain accurately to reproduce.
Therefore, when obtaining the OTF data for imaging len in advance, image capture apparatus 100 can be carried out the image that correction calculation provide preferable reproduction by using equation 2.
For the correction calculation of using equation 2, when the convex surface of imaging len shown in Fig. 2 B is faced body surface OS, even use the correction calculation of equation 2 can not obtain the image of preferable reproduction.
In this case, the OTF of imaging len may change significantly according to the incidence angle of light.Therefore, even only based on the OTF value, for example the OTF value of luminous flux F1 is proofreaied and correct the image of picked-up, can not realize the integral body of the image of picked-up is proofreaied and correct fully.Therefore, can not obtain the image of preferable reproduction.
In order to proofread and correct fully, can use different OTF values according to angle of light.Yet, during widely different between the incidence angle on the OTF, be preferably for correction calculation, use OTF value according to the relative majority amount of angle of light.This correction calculation may need the much longer processing time.Therefore, above-mentioned correcting mode is not so favourable.
In addition, when the minimum unit that will proofread and correct was the pixel of image capture device, the OTF data of precision below pixel were unavailable.Therefore, the difference between the incidence angle on the OTF is big more, and the error in the image of reproduction is big more.
On the other hand, when the convex surface of imaging len shown in Fig. 2 A was faced imaging surface IS, the difference between the different incidence angles on OTF can be less.In addition, the OTF of imaging len is for different angle of light basically identicals.
Thereby in the image formation state of Fig. 2 A, image capture apparatus 100 can obtain the limited and lower OTF value of imaging len L, and it can not be subjected to the very big influence of angle of light.
Therefore, can use and carry out above-mentioned correction calculation for the average OTF value of the OTF value of any one incidence angle or any two incidence angles and come correcting image to degenerate.Alternatively, can use different OTF values corresponding to incidence angle.
Use can reduce the processing time of correction calculation for the OTF value of an incidence angle.In addition, even when using different OTF values corresponding to incidence angle to increase correction accuracy, can carry out correction calculation based on the OTF data of relative lesser amt, thereby reduce the processing time.
Therefore, image capture apparatus 100 can reproduce the image with better quality by using the simple single lens such as plane-convex lens as imaging len.
In the image formation state of Fig. 2 A, incidence angle is less relatively for the influence of OTF, shown in Fig. 2 C.Even less influence represents to place obliquely imaging len, tilt also can not influence OTF significantly.
Therefore, place the influence that imaging len L can suppress the heeling error of the imaging len L that do not expect effectively shown in Fig. 2 A, this heeling error may take place when being installed to imaging len L on the image capture apparatus 100.
When imaging lens L showed higher focusing performance shown in Fig. 2 B, imaging surface IS may amplify the scope of focus in skew slight on the direction of optical axis, thereby causes image degradation.
Simultaneously, when imaging lens L showed lower focusing performance shown in Fig. 2 A, imaging surface IS can obviously not amplify the scope of focus in skew slight on the direction of optical axis.Therefore, can suppress because the last error of distance between imaging len and the imaging surface IS and the influence of not expecting that may cause.
In the superincumbent description, the frequency filtering of use FFT is interpreted as the method for the image of correcting reproducing in image capture apparatus.
Yet,, can adopt the calculating of deconvoluting of using point spread function (PSF) as bearing calibration.The calculating of deconvoluting of use PSF can be similar to top frequency filtering and go the calibrating optical image degradation.
Than Fourier transform, using deconvoluting of PSF to calculate can be relatively simply to calculate, and therefore can reduce the manufacturing cost of the particular procedure circuit that is used for this calculating.
As mentioned above, image capture apparatus 100 uses the single lens with last fine difference of OTF between limited OTF gain and the angle of incidence of light as imaging len.Because the OTF value of single lens is limited, lower, and no matter the size of angle of light basically identical all, therefore, the correction calculation that can make things convenient for optical imagery to degenerate, thereby minimizing processing time.
In the foregoing description of this exemplary embodiment, the single lens that are used in the image capture apparatus 100 have the shape of plane-convex surface.Its convex surface is spherical and image that face focusing.
Alternatively, single lens also can be the concave-convex lenss that convex surface is faced the image of focusing.As long as have zero or negative multiplying power and have positive multiplying power for image-side for object side, single lens also can be GRIN (graded index) lens, perhaps, and such as the diffraction lens of hololens or Fresnel lens.
The single lens that use in the image capture apparatus 100 also can be non-spherical lenses.Especially, the convex surface of above-mentioned plane-convex lens or concave-convex lens can be an aspheric surface shape.
In the case, can regulate low-dimensional aspheric constants (low-dimensionaspheric constant), so that reduce the dependence of OTF for angle of light such as the constant of the cone.The adjusting of aspheric constants can reduce the difference on the OTF between the incidence angle, thus the low OTF level of compensate for slower.
The bearing calibration of the image of above-mentioned reproduction is applicable to from infrared ray to ultraviolet whole electromagnetic wave scope.Therefore, be applicable to thermal camera according to the image capture apparatus 100 of this exemplary embodiment such as rig camera and vehicle-mounted vidicon.
The image capture apparatus 100 of another exemplary embodiment according to the present invention then, is described to Fig. 3 C with reference to figure 3A.
Fig. 3 A example has illustrated the schematic diagram according to the image capture apparatus 100 of another exemplary embodiment of the present invention.Image capture apparatus 100 can comprise lens arra system 8, image capture device 9, correcting circuit 10, memory 11, reconfigurable circuit 12 and image display 13.Image capture apparatus 100 for example is reproduced as object 7 the image 13a that reproduces on image display 13.
Correcting circuit 10 and memory 11 can dispose reconstructed image correcting circuit unit 30.Reconstructed image correcting circuit unit 30 and reconfigurable circuit 12 also are configured for the part of the control part of whole control image capture apparatus 100.
Fig. 3 B is that the lens arra system 8 of Fig. 3 A example explanation and the part of image capture device 9 are amplified diagram.
Especially, according to this exemplary embodiment, lens arra 8a can adopt a plurality of plane-convex lens of equivalent equivalence on the optics as imaging len.Lens arra 8a can also have the overall structure of wherein having arranged a plurality of plane-convex lens two-dimensionally.
The plane of each plane-convex lens is in the face of object side, and their convex surface is in the face of image-side.Each plane-convex lens is made by the resin such as transparent resin.Thereby each plane-convex lens can be according to resin molding method by glass or metal mold moulding.Glass or metal mold also can pass through reflow method, use the engraving method of regional tone mask, and perhaps mechanical production method forms.
Alternatively, each plane-convex lens of lens arra 8a can be replaced resin and made by glass.
Provide shading sheet array 8b to suppress to be blended in owing to light flash of light or the false picture that causes on the imaging surface by adjacent imaging len.
Shading sheet array 8b is made by transparent resin and the composite material such as the opaque material of black rubber.Therefore, be similar to lens arra 8a, shading sheet array 8b can be according to resin molding method by glass or metal mold moulding.Glass or metal mold also can form by engraving method or mechanical production method.
Alternatively, shading sheet array 8b can be by replacing resin such as the stainless metal that is painted with black and making.
According to this exemplary embodiment, the part corresponding to each imaging len among the lens arra 8a among the shading sheet array 8b can be the anti-dazzling screen of tubulose.Alternatively, counterpart can be the anti-dazzling screen of taper or the anti-dazzling screen of pin hole shape.
Alternatively, lens arra 8a and shading sheet array 8b moulding dividually, and then assemble later in moulding.
In this case, each convex surface in the face of image-side of lens arra 8a can be incorporated in each opening of shading sheet array 8b, thereby makes things convenient for the alignment between lens arra 8a and the shading sheet array 8b.
According to this exemplary embodiment, the image capture device 9 of Fig. 3 A or the example explanation of 3B institute is for wherein having arranged the imageing sensor of photodiode two-dimensionally, such as ccd image sensor or cmos image sensor.The placement of image capture device 9 makes each focus of plane-convex lens of lens arra 8a be located substantially on the image capture surface.
Fig. 3 C is the schematic diagram of example key diagram as the example of the compound eye image CI of pickup device 9 picked-ups.For simplicity, suppose that lens arra 8a has 25 imaging len (not shown)s.25 imaging lens are arranged with 5 * 5 square matrix.The shade that separates the matrix line indication shading sheet array 8b of the simple eye image SI among Fig. 3 C.
Shown in Fig. 3 C, imaging len forms each simple eye image of object 7 on imaging surface.Thereby, as the array of 25 simple eye image SI and obtain compound eye image CI.
Suppose image capture device 9 pixel 9a add up to 500 * 500, and the imaging len array of lens arra 8a is 5 * 5.So, the pixel quantity of each imaging len is 100 * 100.In addition, suppose 10 * 10 pixels of each imaging len covering of shade of shading sheet array 8b.So, the quantity of the pixel 9a of each simple eye image SI is 90 * 90.
Then, the image capture device 9 compound eye image CIs of picked-up shown in Fig. 3 C generate the compound eye image data.The compound eye image data are sent to correcting circuit 10.
Calculate in advance lens arra 8a imaging data the OTF data and be stored in the memory 11.Because imaging len is equivalent equivalence optically, only an OTF value is just enough for following correction calculation.
Correcting circuit 10 reads the OTF data and the compound eye image that sends from image capture device 9 is carried out correction calculation from memory 11.According to this exemplary embodiment, correcting circuit 10 is carried out correction calculation respectively for each the simple eye image that constitutes compound eye image.At this moment, use equation 2 to carry out correction calculation.
Thereby correcting circuit 10 is carried out correction calculation based on the OTF data of imaging len respectively to each the simple eye image SI that constitutes compound eye image CI.Thereby, can obtain the compound eye image data that constitute by data through the simple eye image SI of overcorrect.
Then, reconfigurable circuit 12 is carried out the processing of the single image of reconstruct based on the compound eye image data.
The image of the object 7 that the imaging len that as mentioned above, to constitute the simple eye image SI of compound eye image CI be lens arra 8a forms.Each imaging len has the different position relation with respect to object 7.This different position relation produces the parallax between the simple eye image.Thereby, obtained according to parallax and the simple eye image of skew mutually.
By the way, " parallax " in this specification refers to reference to the image shift amount between simple eye image and each other simple eye image.The image shift amount is represented by length.
Iff the image that uses a simple eye image as picked-up, image capture apparatus 100 can not reproduce the details less than the object 7 of a pixel of simple eye image.
On the other hand, if use a plurality of simple eye images, image capture apparatus 100 can use the parallax between aforesaid a plurality of simple eye image to reproduce the details of object 7.In other words, by from comprising the single image of compound eye image reconstruct, image capture apparatus 100 can provide the image of the reproduction with the resolution that increases for each simple eye image.
The detection of the parallax between the simple eye image can and be carried out based on the least square of the luminance deviation between the simple eye image, this least square and by equation 3 definition.
E
m＝∑∑{I
B(x，y)-I
m(x-p
x，y-p
y)}
2 ...3
I wherein
B(x, y) light intensity of the simple eye image of reference from the simple eye image that constitutes compound eye image, selected of representative.
As mentioned above, the parallax between the simple eye image refers to reference to the parallax between simple eye image and each other simple eye image.Therefore, with reference to the reference of simple eye image conduct for the parallax of other simple eye images.
Subscript " m " is represented the digital code of each simple eye image, and scope is the quantity to the lens that constitute lens arra 8a.In other words, the upper limit of " m " equals the sum of simple eye image.
As item I at equation 3
m(x-p
x, y-p
y) in satisfy p
x=p
y=0 o'clock, I
m(x y) represents the light intensity of m simple eye image, p
xAnd p
yRepresentative is used for determining the parameter of parallax in the x and y direction respectively.
Two summation representatives in the equation 3 the pixel of m simple eye image x and y direction and.Two summations are carried out in 1 to Y scope from 1 to X with " y " at " x ".In this regard, " X " represents the pixel quantity of m simple eye image in " x " direction, and " Y " represents the pixel quantity of m simple eye image in " y " direction.
For all pixels that constitute given simple eye image, calculate the luminance deviation between this simple eye image and the simple eye image of reference.Then, determine the least square and the E of luminance deviation
m
In addition, each parameter p at every turn
xAnd p
yIncrease progressively a pixel, just use equation 3 to calculate the least square and the E of luminance deviation
mCan least square and E will be produced
mThe parameter p of minimum value
xAnd p
yValue be considered as respectively simple eye image with respect to reference to simple eye image at the parallax P of x and y direction
xAnd P
y
Suppose when the first simple eye image (m=1) that select to constitute compound eye image as a reference during simple eye image, calculate the parallax of the first simple eye image self.In this case, the first simple eye image is with identical with reference to simple eye image.
Therefore, when in equation 3, satisfying p
x=p
y=0 o'clock, two simple eye images were overlapping fully.Thereby the least square of luminance deviation and E
mIn equation 3, become 0.
p
xAnd p
yAbsolute value big more, the overlapping region between two simple eye images is few more, and least square and E
mBig more.Therefore, the parallax P between the identical simple eye image
xAnd P
yBe zero.
Then, suppose for m simple eye image and in equation 3, satisfy p
x=3, p
y=2.In the case, m simple eye image is with respect to being offset 3 pixels with reference to simple eye image in the x direction, in 2 pixels of y direction skew.
Therefore, m simple eye image is with respect to bearing 3 pixels with reference to simple eye image in the skew of x direction, in negative 2 pixels of y direction skew.Thereby, can proofread and correct m simple eye image so that the simple eye image of accurately overlapping reference.Then, the least square of luminance deviation and E
mGet minimum value.
Fig. 4 is that parallax parameter p is depended in the example explanation
xAnd p
yThe least square and the E of luminance deviation
mThe three-dimensional curve diagram of example of variation.In this curve chart, the x axle is represented p
x, the y axle is represented p
y, the z axle is represented E
m
As mentioned above, produce least square and E
mThe parameter p of minimum value
xAnd p
yValue can be considered as simple eye image respectively in the x and y direction with respect to reference to the parallax P of simple eye image
xAnd P
y
Parallax P
xAnd P
yEach integral multiple as Pixel Dimensions defines.Yet, as expectation parallax P
xOr P
yDuring less than the size of a pixel of image capture device 9, reconfigurable circuit 12 amplifies m simple eye images so that parallax P
xOr P
yIntegral multiple for Pixel Dimensions.
Can be based on three following factors estimating disparity P roughly in advance
xAnd P
y: constitute the light amplification multiplying power of each imaging len of lens arra 8a, the lenticular spacing of lens arra 8a, and the Pixel Dimensions of image capture device 9.
Therefore, can be identified for the magnification ratio of interpolation calculation, thereby the parallax of each estimation has the length of Pixel Dimensions integral multiple.
When forming the lenticular spacing of lens arra 8a with higher relatively precision, can be based on the distance calculation parallax P between each imaging len of object 7 and lens arra 8a
xAnd P
y
According to a kind of parallax detection method, at first, detect the parallax P of a pair of simple eye image
xAnd P
yThen, use the triangulation principle to calculate this to each imaging len in the imaging len and the object distance between the object.Based on the object distance and the lenticular spacing that calculate, can several parallaxes of where determining another simple eye image.In this case, detect the computing of parallax and only carry out once, this can reduce computing time.
Alternatively, can use another kind of known parallax detection method, replace above-mentioned use luminance deviation least square and the parallax detection method.
Fig. 5 is the schematic diagram of the reconstructing method of example explanation from compound eye image to single image.
According to reconstructing method shown in Figure 5, at first, obtain pixel brightness data from the simple eye image 14a that constitutes compound eye image 14.Based on the position of simple eye image 14a and the parallax of detection, the pixel brightness data that obtains is positioned the given position of the reproduced image 130 in the Virtual Space.
For all pixels of each simple eye image 14a, repeat the position fixing process of above-mentioned pixel brightness data, thereby generate the image 130 that reproduces.
Here, suppose in the compound eye image 14 uppermost row of selecting among Fig. 5 the simple eye as a reference image of simple eye image 14a on the left side.Be arranged in the parallax P of the simple eye image on its right side so
xBecome-1 ,-2 ,-3 etc. successively.
The brightness data of the left side of each simple eye image and uppermost pixel is positioned in the image 130 of reproduction successively.At this moment, in the right of Fig. 5, promptly the positive direction of parallax is successively with parallax value offset pixels brightness data.
When simple eye image 14a has with respect to the parallax P with reference to simple eye image
xAnd P
yThe time, the negative value with each parallax is offset simple eye image 14a at x and y direction as described above.Thereby simple eye image is with the most overlapping with reference to simple eye image.The essentially identical part of overlapping pixel directing object 7 between two images.
Yet the simple eye image of skew and the simple eye image of reference are to be formed by the imaging len with the diverse location among the lens arra 8a.Therefore, overlapping pixel is not represented identical part between two images, but essentially identical part.
Therefore, image capture apparatus 100 uses image data of absorbing in the reference pixel of simple eye image and the image data of absorbing in the pixel of the simple eye image that is offset.Thereby image capture apparatus 100 can reproduce the details less than the object 7 of a pixel of simple eye image.
Thereby image capture apparatus 100 is from comprising the single image of compound eye image reconstruct of parallax.Thus, image capture apparatus 100 can provide the image of the reproduction of object 7, and this object 7 has the resolution for the increase of simple eye image.
The shade of the parallax of relatively large quantity or shadow shield array 8b may produce the pixel that has lost brightness data.In this case, reconfigurable circuit 12 inserts the brightness data that pixel is lost by the brightness data of reference neighbor.
As mentioned above, when parallax during, the image of amplifying and reconfiguration, make parallax amount become to equal the integral multiple of Pixel Dimensions less than a pixel.At this moment, increased the quantity of the pixel of the image that constitutes reconstruct by interpolation calculation.Then, the given position of the reconstructed image that pixel brightness data is positioned to amplify.
Fig. 6 is the flow chart of the sequence flow of example reconstruction processing that aforesaid image degradation treatment for correcting and single image are described.
At step S1, image capture device 9 picked-up compound eye images.
At step S2, correcting circuit 10 reads the OTF data of lens combination.As mentioned above, the OTF data are precalculated and be stored in the memory 11 by ray trace simulation.
At step S3, correcting circuit 10 is carried out and is calculated with based on the image degradation in each simple eye image of the OTF adjustment of data.Thus, obtained by the compound eye image that simple eye image constituted through overcorrect.
At step S4, reconfigurable circuit 12 selections are used for the simple eye image of reference of the parallax of definite each simple eye image.
At step S5, reconfigurable circuit 12 is determined with reference to the parallax between other the simple eye image of simple eye images and each.
At step S6, reconfigurable circuit 12 is carried out to calculate and is used parallax from the single image of compound eye image reconstruct.
At step S7, export single image.
Fig. 7 is the flow chart of another sequence flow of the reconstruction processing of image degradation treatment for correcting and Fig. 6.
At step S1a, image capture device 9 picked-up compound eye images.
At step S2a, reconfigurable circuit 12 selections are used for the simple eye image of reference of the parallax of definite each simple eye image.
At step S3a, reconfigurable circuit 12 is determined with reference to the parallax between other the simple eye image of simple eye images and each.
At step S4a, reconfigurable circuit 12 is carried out to calculate and is used parallax from the single image of compound eye image reconstruct.
At step S5a, correcting circuit 10 reads the OTF data of lens combination from memory 11.
At step S6a, correcting circuit 10 is carried out and is calculated with based on the image degradation in the single image of the OTF adjustment of data.
At step S7a, export single image.
In the sequence flow of Fig. 7, only carry out once based on the computing of OTF adjustment of data image degradation.Therefore, the sequence flow than Fig. 6 can reduce computing time.
Yet,,, may increase error in the correction to the single image application OTF data of reconstruct than the sequence flow of Fig. 6 because the OTF data are relevant with each simple eye image in essence.
Below, for the imaging len of the lens arra 8a that constitutes this exemplary embodiment, check that preferred structure obtains between the visual angle difference lower on the MTF.
According to this exemplary embodiment, each imaging len can be plane-convex lens, and their convex surface is set to towards image-side.Each imaging len can be made by acrylic resin.
For the parameter of each imaging len, " b " represents back focus, and " r " represents crooked radius, and " t " represents lens thickness, and " D " represents lens diameter.
In order to find out the scope of the OTF gain that in angular field of view, can obtain the finite sum unanimity, in the curve chart of MTF, change three parameters " b " randomly, " t " and " D " with respect to the expectation of object.Thereby when above-mentioned parameter satisfied following condition, each imaging len showed relatively low difference on the MTF between the visual angle:
1.7≤|b/r|≤2.4；
0.0≤| t/r|≤1.7; With
1.0≤|D/r|≤3.8。
When the above-mentioned scope of parameter drift-out, MTF may drop to 0 or reduce consistency.On the other hand, when parameter satisfied above-mentioned scope, the lens diameter of imaging len became short and its F number becomes less.Thereby, the bright relatively imaging len that can obtain to have the dark depth of field.
Here, each imaging len of supposing the lens arra 8a of pie graph 3 all is to be made by acrylic resin.In addition, with the bending radius " r " of convex surface, lens diameter " D " and lens thickness " t " all are set to 0.4mm.Back focus is set to 0.8mm.
Under this structure, parameter b/r, t/r and D/r equal 2.0,1.0 and 1.0 respectively, and this satisfies above-mentioned condition.
Fig. 2 C example has illustrated the MTF of the imaging len with above-mentioned structure.The curve chart indication of Fig. 2 C, imaging len can not be subjected to the appreciable impact with respect to the position error of the error of the angle of light of imaging len or imaging len.
Fig. 8 example has illustrated the example of variation of the MTF of the object distance that depends on imaging len.When object distance changed from 10mm to ∞, MTF was constant substantially, can not differentiate on the figure in Fig. 8 thereby the variation on the MTF is too little.
Thereby the OTF gain of imaging len can not be subjected to the appreciable impact of the variation of object distance.An one possible cause is because lens diameter is less relatively.Less lens diameter reduces light intensity, thereby produces darker image relatively usually.
Yet for above-mentioned imaging len, the F number on the imaging surface IS approximately is 2.0, and this is an enough little numerical value.Therefore, although lens diameter is less, imaging len has enough brightness.
The focusing length of lens combination is short more, and the focusedimage of object is just more little, thereby reduces the resolution of the image of picked-up.In this case, image capture apparatus 100 can adopt the lens arra that comprises by a plurality of imaging lens of arrayed.
Use lens arra, the simple eye image of image capture apparatus 100 picked-ups is to form compound eye image.Image capture apparatus 100 is from constituting the single image of simple eye image reconstruction of compound eye image.Thus, image capture apparatus 100 can provide the image with enough resolution.
As mentioned above, lens thickness " t " and back focus " b " are respectively 0.4mm and 0.8mm.Therefore, the distance from the surface of lens arra 8a to imaging surface IS is 1.2mm.Thereby, even consider the image capture device, image display, reconfigurable circuit, and the thickness of reconstructed image correcting unit also can be made image capture apparatus 100 so that have several millimeters thickness with thin size.
Therefore, the electronic installation of the built-in device that image capture apparatus 100 is suitable for preferably providing thin, such as cell phone, laptop computer and comprise the mobile data terminal of PDA (personal digital assistant).
As mentioned above, can use diffraction lens such as hololens and Fresnel Lenses as imaging len.Yet, when using diffraction lens to catch coloured image, need to consider the influence of aberration for lens.
After this, the image capture apparatus 100 that is used to catch coloured image of another exemplary embodiment according to the present invention is described.
In another exemplary embodiment, except adopting colourful CCD video camera 50, has essentially identical structure with Fig. 1 according to the image capture apparatus 100 of this exemplary embodiment as the image capture device 3.
Colourful CCD video camera 50 comprises that a plurality of pixels absorb the image of focusing.Pixel is divided into three kinds: redness, green, blue picked-up pixel.Corresponding chromatic filter is positioned on three kinds of pixels.
Fig. 9 is the schematic diagram of the pel array example of example explanation colourful CCD video camera 50.
As shown in Figure 9, colourful CCD video camera 50 comprises the redness picked-up pixel 15a that is used to absorb red brightness data, is used to absorb the green picked-up pixel 15b of green brightness data, and the blueness picked-up pixel 15c that is used to absorb blue brightness data.
Redness, green and blue chromatic filter is placed on each pixel 15a respectively, on 15b and the 15c, corresponding to the color of the brightness data that will obtain.On the surface of color video camera 50, sequentially place one group of three pixel 15a, 15b and 15c are to absorb the brightness data of various colors.
On the image that redness picked-up pixel 15a obtains, can carry out correction calculation based on the OTF data of red wavelength and come image degradation in the correcting image.Thereby can obtain the image of the red color of proofreading and correct based on the OTF data.
Similarly, on the image that green picked-up pixel 15b obtains, can carry out correction calculation based on the OTF data of green wavelength and come image degradation in the correcting image.In addition, on the image that blueness picked-up pixel 15c obtains, can carry out correction calculation based on the OTF data of blue wavelength and come image degradation in the correcting image.
For the coloured image of colour TV camera 50 picked-ups, image capture apparatus 100 can show the brightness data of each coloured image on the pixel of image display 6.Can be with the pixel of the mode similar by arrayed image display 6 to the pixel of colour TV camera 50.
Alternatively, the brightness data of comprehensive each color in the position that image capture apparatus 100 is can be between a plurality of images identical.Then, image capture apparatus 100 can show on the respective pixel of image display 6 through comprehensive data.
When chromatic filter was arranged in the mode that is different from Fig. 9, image capture apparatus 100 can be carried out correction calculation respectively for the brightness data of each coloured image.Then, image capture apparatus 100 can be comprehensively through the brightness data of overcorrect image with output reconstruct.
Can use traditional general purpose digital computer of programming according to the instruction of this specification to implement embodiments of the invention easily, this technical staff for computer realm is conspicuous.Can prepare the appropriate software coding based on the instruction of this specification by the programmer, this technical staff for software field is conspicuous.Can also be by preparing application-specific IC or by embodiments of the invention are implemented in the suitable network interconnection of conventional component circuits, this is conspicuous for those skilled in the art.
Under the inspiration of above-mentioned instruction, can carry out multiple other modification and modification.Therefore be appreciated that within the scope of the appended claims that the announcement of present specification can realize to be different from the special mode of describing here.
The application advocates that the application number of submitting in Japan Patent office on May 15th, 2006 is the priority of the Japanese patent application of JP2006-135699, its whole content at this with reference to introducing.
Claims (18)
1. image capture apparatus comprises:
Imaging len is used to focus on light from object to form image;
Image-pickup device is used to absorb the image that is formed by imaging len; And
Correcting circuit is used to carry out the calculating of the image degradation of the image that correction causes by imaging len;
Wherein, imaging len is the single lens that have the gain of limited optical transfer function and show the fine difference in the gain between the different visual angles of imaging len.
2. image capture apparatus according to claim 1, wherein, single lens have the surface in the face of the positive multiplying power of image, and have in the face of any one surface in the surface of the surface of 0 multiplying power of object or positive multiplying power.
3. image capture apparatus according to claim 1 and 2, wherein, imaging len only comprises lens.
4. according to each described image capture apparatus of claim 1 to 3,
Wherein correcting circuit is for carrying out the calculating that correcting image is degenerated respectively from the light of the setted wavelength of object.
5. image capture apparatus comprises:
Lens arra comprises a plurality of imaging lens by arrayed, and this lens arra forms the compound eye image of the simple eye image that comprises object, and simple eye image is formed by each imaging len;
Reconfigurable circuit is used to carry out the calculating from the single image of compound eye image reconstruct that is formed by lens arra; And
The reconstructed image correcting circuit is used to carry out the calculating of correction by the image degradation of the single image of reconfigurable circuit reconstruct.
6. image capture apparatus according to claim 5, wherein, in the calculating of carrying out the single image of reconstruct, reconfigurable circuit is based on the least square of the luminance deviation between the simple eye image and the relative position between definite simple eye image.
7. according to claim 5 or 6 described image capture apparatus, wherein,
The correction calculation that the reconstructed image correcting circuit is degenerated for each simple eye image difference carries out image, and
Reconfigurable circuit is carried out the reconstruction calculations of single image based on the simple eye image of proofreading and correct through the reconstructed image correcting circuit.
8. according to claim 5 or 6 described image capture apparatus, wherein, the reconstructed image correcting circuit is to the correction calculation of the single image carries out image degeneration of process reconfigurable circuit reconstruct.
9. according to each described image capture apparatus of claim 5 to 8, comprise that further light-blocking member suppresses the crosstalking of light between the imaging len.
10. according to each described image capture apparatus of claim 1 to 9, wherein, imaging len is the plane-convex lens that has in the face of the convex surface of image.
11. according to each described image capture apparatus of claim 1 to 9, wherein, imaging len is the concave-convex lens that has in the face of the convex surface of image.
12. according to claim 10 or 11 described image capture apparatus, wherein, the convex surface of facing the imaging len of image is to form with the form of any one shape in spherical or the non-sphere.
13. according to each described image capture apparatus of claim 10 to 12, wherein,
Imaging len satisfies following condition:
1.7≤|b/r|≤2.4；
0.0≤| t/r|≤1.7; With
1.0≤|D/r|≤3.8，
Wherein, for imaging len, " b " represents back focus, and " r " represents crooked radius, and " t " represents lens thickness, and " D " represents lens diameter.
14. an electronic installation comprises according to each described image capture apparatus of claim 1 to 13.
15. a method of using each described image capture apparatus of claim 1 to 4 to catch image comprises the following steps:
Focusing from the light of object to form image;
Image after picked-up focuses on; And
Carry out the calculating of the image degradation of proofreading and correct the image after focusing on.
16. a method of using each described image capture apparatus of claim 5 to 13 to catch image comprises the following steps:
Formation comprises the compound eye image of the simple eye image of object;
Execution is used for from the calculating of the single image of compound eye image reconstruct;
Execution is used to proofread and correct the calculating of the image degradation of single image.
17. a method of using each described image capture apparatus of claim 5 to 13 to catch image comprises the following steps:
Form compound eye image, this compound eye image comprises the simple eye image of the object that is focused on by a plurality of imaging lens;
Absorb simple eye image;
Read the optical transfer function data of at least one imaging len in a plurality of imaging lens;
Image degradation based on the simple eye image of the optical transfer function adjustment of data;
From simple eye image, select with reference to simple eye image;
Detect with reference to the parallax between simple eye image and each other simple eye image;
Based on the single image of parallax reconstruct; And
Export single image.
18. a method of using image capture apparatus to catch image comprises the following steps:
Form compound eye image, this compound eye image comprises the simple eye image of the object that is focused on by a plurality of imaging lens;
Absorb simple eye image;
Read the optical transfer function data of at least one imaging len in a plurality of imaging lens;
Image degradation based on the simple eye image of the optical transfer function adjustment of data;
From simple eye image, select with reference to simple eye image;
Detect with reference to the parallax between simple eye image and each other simple eye image;
Based on the single image of parallax reconstruct; And
Export single image.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2006-135699 | 2006-05-15 | ||
| JP2006135699 | 2006-05-15 | ||
| JP2006135699A JP2007304525A (en) | 2006-05-15 | 2006-05-15 | Image input device, electronic equipment, and image input method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101076085A true CN101076085A (en) | 2007-11-21 |
| CN101076085B CN101076085B (en) | 2011-02-09 |
Family
ID=38371188
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101075005A Expired - Fee Related CN101076085B (en) | 2006-05-15 | 2007-05-15 | Method and apparatus for image capturing and electronic apparatus using the same |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US20070285553A1 (en) |
| EP (1) | EP1858252B1 (en) |
| JP (1) | JP2007304525A (en) |
| KR (1) | KR100914011B1 (en) |
| CN (1) | CN101076085B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102222364A (en) * | 2011-08-13 | 2011-10-19 | 南昌航空大学 | Infrared multichannel artificial compound eyes-based method for reconstructing three-dimensional surface topography |
| CN102547080A (en) * | 2010-12-31 | 2012-07-04 | 联想(北京)有限公司 | Image pick-up module and information processing equipment comprising same |
| CN103918249A (en) * | 2011-08-30 | 2014-07-09 | 富士胶片株式会社 | Imaging device and imaging method |
| CN104935790A (en) * | 2014-03-20 | 2015-09-23 | 株式会社东芝 | Imaging system |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4864632B2 (en) | 2006-10-12 | 2012-02-01 | 株式会社リコー | Image input device, image input method, personal authentication device, and electronic device |
| JP4953292B2 (en) * | 2006-10-12 | 2012-06-13 | 株式会社リコー | Image input device, personal authentication device, and electronic device |
| US8199246B2 (en) * | 2007-05-30 | 2012-06-12 | Fujifilm Corporation | Image capturing apparatus, image capturing method, and computer readable media |
| DE102007031230B3 (en) * | 2007-07-04 | 2008-10-30 | Bundesdruckerei Gmbh | Document capture system and document capture process |
| US8204282B2 (en) | 2007-09-14 | 2012-06-19 | Ricoh Company, Ltd. | Image input device and personal authentication device |
| JP5124835B2 (en) * | 2008-02-05 | 2013-01-23 | 富士フイルム株式会社 | Image processing apparatus, image processing method, and program |
| JP5076240B2 (en) * | 2008-02-05 | 2012-11-21 | 富士フイルム株式会社 | Imaging apparatus, imaging method, and program |
| JP5293950B2 (en) * | 2008-03-04 | 2013-09-18 | 株式会社リコー | Personal authentication device and electronic device |
| US8379321B2 (en) * | 2009-03-05 | 2013-02-19 | Raytheon Canada Limited | Method and apparatus for accurate imaging with an extended depth of field |
| JP4782899B2 (en) | 2009-07-22 | 2011-09-28 | パナソニック株式会社 | Parallax detection device, distance measuring device, and parallax detection method |
| JP4937325B2 (en) * | 2009-09-30 | 2012-05-23 | 住友大阪セメント株式会社 | Optical waveguide device |
| JP2011215707A (en) * | 2010-03-31 | 2011-10-27 | Canon Inc | Image processing apparatus, imaging apparatus, image processing method, and program |
| JP5633218B2 (en) * | 2010-07-13 | 2014-12-03 | 富士通株式会社 | Image processing apparatus and image processing program |
| JP5942984B2 (en) * | 2011-03-30 | 2016-06-29 | 株式会社ニコン | Image processing apparatus, imaging apparatus, and image processing program |
| JP5361976B2 (en) * | 2011-08-25 | 2013-12-04 | キヤノン株式会社 | Image processing program, image processing method, image processing apparatus, and imaging apparatus |
| JP5863512B2 (en) * | 2012-02-29 | 2016-02-16 | 日本板硝子株式会社 | Lens array unit, erecting equal-magnification lens array, optical scanning unit, image reading device, and image writing device |
| EP2971165A4 (en) | 2013-03-15 | 2016-11-23 | Moderna Therapeutics Inc | Removal of dna fragments in mrna production process |
| WO2014152027A1 (en) | 2013-03-15 | 2014-09-25 | Moderna Therapeutics, Inc. | Manufacturing methods for production of rna transcripts |
| WO2014181643A1 (en) * | 2013-05-08 | 2014-11-13 | コニカミノルタ株式会社 | Compound-eye imaging system and imaging device |
| US20160194368A1 (en) * | 2013-09-03 | 2016-07-07 | Moderna Therapeutics, Inc. | Circular polynucleotides |
| JP6290651B2 (en) * | 2014-02-27 | 2018-03-07 | 株式会社キーエンス | Image measuring instrument |
| JP6278741B2 (en) * | 2014-02-27 | 2018-02-14 | 株式会社キーエンス | Image measuring instrument |
| JP6545997B2 (en) * | 2015-04-24 | 2019-07-17 | 日立オートモティブシステムズ株式会社 | Image processing device |
| CN109328319B (en) * | 2016-06-13 | 2021-03-26 | 卡普索影像公司 | Lens alignment method and apparatus for capsule camera |
| CN109379532B (en) * | 2018-10-08 | 2020-10-16 | 长春理工大学 | Computational imaging system and method |
| JP7296239B2 (en) * | 2019-04-10 | 2023-06-22 | オムロン株式会社 | Optical measurement device, optical measurement method, and optical measurement program |
Family Cites Families (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH053568A (en) * | 1991-06-25 | 1993-01-08 | Canon Inc | Video camera apparatus |
| JP3549413B2 (en) * | 1997-12-04 | 2004-08-04 | 富士写真フイルム株式会社 | Image processing method and image processing apparatus |
| JP2000004351A (en) | 1998-06-16 | 2000-01-07 | Fuji Photo Film Co Ltd | Image processor |
| US6628329B1 (en) * | 1998-08-26 | 2003-09-30 | Eastman Kodak Company | Correction of position dependent blur in a digital image |
| JP3397754B2 (en) * | 1999-06-30 | 2003-04-21 | キヤノン株式会社 | Imaging device |
| JP3821614B2 (en) * | 1999-08-20 | 2006-09-13 | 独立行政法人科学技術振興機構 | Image input device |
| JP2001103358A (en) * | 1999-09-30 | 2001-04-13 | Mitsubishi Electric Corp | Chromatic aberration correction device |
| US6507443B2 (en) * | 1999-12-02 | 2003-01-14 | Kabushiki Kaisha Toshiba | Lens, lens device, camera module and electrical equipment |
| US20010008418A1 (en) * | 2000-01-13 | 2001-07-19 | Minolta Co., Ltd. | Image processing apparatus and method |
| US6859564B2 (en) * | 2001-02-15 | 2005-02-22 | James N. Caron | Signal processing using the self-deconvolving data reconstruction algorithm |
| JP2003005031A (en) * | 2001-06-18 | 2003-01-08 | Milestone Kk | Lens for image pick-up |
| JP3699921B2 (en) * | 2001-11-02 | 2005-09-28 | 独立行政法人科学技術振興機構 | Image reconstruction method and image reconstruction apparatus |
| JP2004048644A (en) * | 2002-05-21 | 2004-02-12 | Sony Corp | Information processor, information processing system and interlocutor display method |
| JP2004032172A (en) * | 2002-06-24 | 2004-01-29 | Canon Inc | Fly-eye imaging device and equipment comprising the same |
| CN1332231C (en) * | 2002-07-01 | 2007-08-15 | 罗姆股份有限公司 | Image sensor module |
| JP4171786B2 (en) * | 2002-10-25 | 2008-10-29 | コニカミノルタホールディングス株式会社 | Image input device |
| KR20050107741A (en) * | 2003-01-16 | 2005-11-15 | 디-블러 테크놀로지즈 리미티드 | Camera with image enhancement functions |
| JP4235539B2 (en) * | 2003-12-01 | 2009-03-11 | 独立行政法人科学技術振興機構 | Image composition apparatus and image composition method |
| WO2005054927A2 (en) * | 2003-12-01 | 2005-06-16 | Cdm Optics, Inc. | System and method for optimizing optical and digital system designs |
| BE1016102A3 (en) * | 2004-06-25 | 2006-03-07 | Ribesse Jacques Max Stanislas | Method and device for reducing gas production, especially the reduction ore. |
| US7728844B2 (en) * | 2004-07-09 | 2010-06-01 | Nokia Corporation | Restoration of color components in an image model |
| JP4367264B2 (en) * | 2004-07-12 | 2009-11-18 | セイコーエプソン株式会社 | Image processing apparatus, image processing method, and image processing program |
| EP1801754B8 (en) * | 2004-10-14 | 2011-09-14 | Lightron Co. Ltd. | Degradation information restoring method and device |
| US7215493B2 (en) * | 2005-01-27 | 2007-05-08 | Psc Scanning, Inc. | Imaging system with a lens having increased light collection efficiency and a deblurring equalizer |
| US7683950B2 (en) * | 2005-04-26 | 2010-03-23 | Eastman Kodak Company | Method and apparatus for correcting a channel dependent color aberration in a digital image |
-
2006
- 2006-05-15 JP JP2006135699A patent/JP2007304525A/en active Pending
-
2007
- 2007-05-11 KR KR1020070045985A patent/KR100914011B1/en active IP Right Grant
- 2007-05-14 US US11/798,472 patent/US20070285553A1/en not_active Abandoned
- 2007-05-15 EP EP07251991.1A patent/EP1858252B1/en not_active Expired - Fee Related
- 2007-05-15 CN CN2007101075005A patent/CN101076085B/en not_active Expired - Fee Related
-
2011
- 2011-04-27 US US13/094,849 patent/US20120140097A1/en not_active Abandoned
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102547080A (en) * | 2010-12-31 | 2012-07-04 | 联想(北京)有限公司 | Image pick-up module and information processing equipment comprising same |
| CN102222364A (en) * | 2011-08-13 | 2011-10-19 | 南昌航空大学 | Infrared multichannel artificial compound eyes-based method for reconstructing three-dimensional surface topography |
| CN102222364B (en) * | 2011-08-13 | 2012-09-19 | 南昌航空大学 | Infrared multichannel artificial compound eyes-based method for reconstructing three-dimensional surface topography |
| CN103918249A (en) * | 2011-08-30 | 2014-07-09 | 富士胶片株式会社 | Imaging device and imaging method |
| CN103918249B (en) * | 2011-08-30 | 2017-06-23 | 富士胶片株式会社 | Imaging device and imaging method |
| CN104935790A (en) * | 2014-03-20 | 2015-09-23 | 株式会社东芝 | Imaging system |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1858252A3 (en) | 2007-12-26 |
| KR20070110784A (en) | 2007-11-20 |
| CN101076085B (en) | 2011-02-09 |
| KR100914011B1 (en) | 2009-08-28 |
| US20120140097A1 (en) | 2012-06-07 |
| EP1858252B1 (en) | 2018-09-19 |
| JP2007304525A (en) | 2007-11-22 |
| EP1858252A2 (en) | 2007-11-21 |
| US20070285553A1 (en) | 2007-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101076085A (en) | Method and apparatus for image capturing and electronic apparatus using the same | |
| CN1217533C (en) | Signal processing equipment and method and image sensing equipment | |
| CN100346189C (en) | Image pickup lens | |
| CN1369724A (en) | Photographical lens system | |
| CN1866054A (en) | Wafer scale lens and optical system having the same | |
| CN1245825C (en) | Picture element defect tester for solid imaging device | |
| CN1722852A (en) | High-quality gradient correction linear interpolation for demosaic processing of color image | |
| CN1797060A (en) | Zoom lens and image pickup apparatus | |
| CN1447144A (en) | Image trapping lens, image trapper, and image trapping unit | |
| CN1871847A (en) | Signal processing system, signal processing method, and signal processing program | |
| CN1260593C (en) | Variable multiple lens system and projector having same | |
| CN1933551A (en) | Image pickup lens with four lenses, image pickup unit and portable terminal | |
| CN1515950A (en) | Photographic lens, photographic unit and portable terminal | |
| CN1894606A (en) | Collective element and solid-state imaging device | |
| CN1297138C (en) | Solid camera device | |
| CN1662071A (en) | Image data processing in color spaces | |
| CN1878246A (en) | Image processing apparatus and image capture apparatus | |
| CN1941851A (en) | Image taking apparatus and program | |
| CN1171108C (en) | Lens for taking picture | |
| CN1851519A (en) | Image pickup lens, image pickup apparatus and mobile terminal | |
| CN1643936A (en) | Image processing device, image processing method, and image processing device manufacturing method | |
| CN1744675A (en) | Image input device | |
| CN1250995C (en) | Zoom lens and photography device | |
| CN1766695A (en) | Optical system using diffraction optical element | |
| CN101052910A (en) | Low height imaging system and associated methods |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110209 Termination date: 20190515 |