CN106375653A - Image acquisition control method and device - Google Patents

Abstract

The invention discloses an image acquisition control method and device. The method comprises the following steps: according to the field depth range of a light-field camera and the depth distribution of a scene, determining at least one depth distribution sub-area of the scene, wherein each depth distribution sub-area among the at least one depth distribution sub-area is located outside the field depth range; adjusting the focal length of a first sub-lens, so that the average dispersion circle of imaging of an object in the depth distribution sub-area in a first imaging area is reduced, wherein the first sub-lens is a sub-lens influencing depth distribution sub-area image acquisition in a sub-lens array of the light-field camera, and the first imaging area is an imaging area corresponding to the first sub-lens in an imaging surface; and performing image acquisition on the scene through the adjusted light-field camera. By means of the image acquisition control method and device disclosed by the invention, the overall imaging quality of the scene is improved.

Description

Image acquisition control method and device

Technical field

The application is related to a kind of field of terminal technology, more particularly to a kind of image acquisition control method and device.

Background technology

The depth of field (depth of field, abbreviation dof) typically refers to the object distance that pick-up lenss are capable of blur-free imaging to scene Scope that is to say, that in the depth direction relative to pick-up lenss focusing object plane before and after certain depth scope can blur-free imaging. By adjusting the parameters such as aperture size, the focal distance distance of physics focal length length, camera lens and object of pick-up lenss, can be one Determine in scope, the depth of field of pick-up lenss to be adjusted, for example, field depth etc. can be reduced by tuning up aperture.

Obtain larger field depth, particularly shoot in large aperture and will have larger field depth under situation, to shooting The requirement of camera lens is very high, and equipment manufacturing cost is expensive, generally can gather different focus by way of pick-up lenss optically detecting respectively Multiple images of object plane, further according to the image to obtain a larger field depth for the Digital Signal Processing of multiple images collecting.

Content of the invention

Brief overview with regard to the application has been given below, so as to provide with regard to the application some in terms of basic Understand.It should be appreciated that this general introduction is not the exhaustive general introduction with regard to the application.It is not intended to determine the pass of the application Key or pith, are not intended limitation scope of the present application.Its purpose only provides some concepts in simplified form, In this, as the preamble in greater detail discussed after a while.

The embodiment of the present application provides a kind of image acquisition control method and device.

In a first aspect, the embodiment of the present application provides a kind of image acquisition control method, comprising:

Field depth according to light-field camera and the depth profile of scene, determine at least one depth profile of described scene Area, in described at least one depth profile sub-district, each depth profile sub-district is located at outside described field depth；

Adjust the focal length of the first sub-lens, become on the first imaging region with reducing the object in described depth profile sub-district The average blur circle of picture, wherein, described first sub-lens be described light-field camera lenslet arrays in affect described depth and divide The sub-lens of cloth sub-district image acquisition, described first imaging region is imaging area corresponding with described first sub-lens in imaging surface Domain；

Described light-field camera after adjusted carries out image acquisition to described scene.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described first sub-lens After Focussing, the object in described depth profile sub-district is in described first imaging region corresponding with described first sub-lens The average blur circle of upper imaging allows blur circle less than or equal to one.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described at least one depth is divided At least one of cloth sub-district and described field depth depth consecutive variations.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described at least one depth is divided At least one of cloth sub-district and the discontinuous change of described field depth depth.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described adjustment first is thoroughly The focal length of mirror, comprising: the phase contrast that incident illumination passes through the different piece of described first sub-lens is changed by outfield, to adjust State the focal length of the first sub-lens.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described first son of adjustment is thoroughly The focal length of mirror, comprising: according to the depth profile of the described depth profile sub-district, focal length of the main lenss of described light-field camera, described Between the first distance between main lenss and described lenslet arrays and described lenslet arrays and described imaging surface second Distance, determines the expectation focal length of described first sub-lens；Jiao according at least to the first sub-lens described in described expectation Focussing Away from being become on described first imaging region corresponding with described first sub-lens with reducing the object in described depth profile sub-district The average blur circle of picture.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, according at least to described expectation The focal length of the first sub-lens described in Focussing, comprising: determine that incident illumination is each passed through according at least to described expectation focal length described The phase contrast being formed after first sub-lens different piece；According to the mapping relations between phase contrast and outfield, determine and described phase The corresponding outfield of potential difference；The phase contrast that incident illumination passes through the different piece of described first sub-lens is changed by described outfield, with Adjust the focal length of described first sub-lens.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described first sub-lens are First liquid crystal sub-lens；Determine that incident illumination is each passed through after described first sub-lens different piece according at least to described expectation focal length The phase contrast being formed, comprising: according to the ripple of described expectation focal length, the radius of described first liquid crystal sub-lens and described incident illumination Long, determine the phase contrast that described incident illumination is formed after being each passed through the different piece of described first liquid crystal sub-lens.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, adjusts arbitrary described first The focal length of sub-lens, comprising: determine described first sub-lens allows Focussing scope；Allow that focal length is adjusted according at least to described Whole scope adjusts the focal length of described first sub-lens, to reduce the object in described depth profile sub-district with the described first son thoroughly The average blur circle of imaging on corresponding described first imaging region of mirror.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, optionally it is determined that described first son is thoroughly Mirror allow Focussing scope, comprising: according to the main lenss of the depth profile of described depth profile sub-district, described light-field camera Focal length, the first distance between described main lenss and described lenslet arrays and described lenslet arrays and described imaging Second distance between face, determines the expectation focal length of described first sub-lens；Described first son is determined according to described expectation focal length Lens allow Focussing scope.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, allows according at least to described Focussing scope adjusts the focal length of described first sub-lens, comprising: allow that Focussing scope determines incident illumination according to described Formed after being each passed through described first sub-lens different piece allows phase range；According to reflecting between phase contrast and outfield Penetrate relation, determine with described allow in phase range one allow the corresponding outfield of phase contrast；By described outfield change into Penetrate the phase contrast that light passes through the different piece of described first sub-lens, to adjust the focal length of described first sub-lens.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described first sub-lens are First liquid crystal sub-lens；Allow that Focussing scope determines that incident illumination is each passed through described first sub-lens difference portion according to described Formed after point allows phase range, comprising: according to the described maximum allowable focal length allowed in the range of Focussing, described the The radius of one liquid crystal sub-lens and the wavelength of described incident illumination, determine that described incident illumination is each passed through described first liquid crystal respectively The first phase being formed after the different piece of sub-lens is poor；According to the described minimum allowed in the range of Focussing allow focal length, The radius of described first liquid crystal sub-lens and the wavelength of described incident illumination, determine that described incident illumination is each passed through described respectively The second phase being formed after the different piece of one liquid crystal sub-lens is poor；According to described first phase poor and described second phase difference really Phase range is allowed described in fixed.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, alternatively, described adjustment at least 1 the Before the focal length of one sub-lens, in the lenslet arrays also comprising determining that described light-field camera, affect described depth profile sub-district The sub-lens of image acquisition are described first sub-lens.

Any one the image acquisition control method providing in conjunction with the embodiment of the present application, optionally it is determined that described light-field camera Lenslet arrays in affect described depth profile sub-district image acquisition sub-lens be described first sub-lens, comprising: according to Part corresponding with described depth profile sub-district in the preview image of described scene that described light-field camera obtains, determines impact institute The sub-lens stating depth profile sub-district image acquisition are described first sub-lens.

Second aspect, the embodiment of the present application additionally provides a kind of image acquisition control device, comprising:

One depth profile sub-district determining module, for the depth profile of the field depth according to light-field camera and scene, really At least one depth profile sub-district of fixed described scene, in described at least one depth profile sub-district, each depth profile sub-district is located at institute State outside field depth；

One Focussing module is for adjusting the focal length of the first sub-lens, right in described depth profile sub-district to reduce As the average blur circle of imaging on the first imaging region, wherein, described first sub-lens are the sub-lens of described light-field camera The sub-lens of described depth profile sub-district image acquisition are affected, described first imaging region is with described the in imaging surface in array The corresponding imaging region of one sub-lens；

One image capture module, carries out image acquisition for the described light-field camera after adjusted to described scene.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described first sub-lens After Focussing, the object in described depth profile sub-district is in described first imaging region corresponding with described first sub-lens The average blur circle of upper imaging allows blur circle less than or equal to one.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described at least one depth is divided At least one of cloth sub-district and described field depth depth consecutive variations.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described at least one depth is divided At least one of cloth sub-district and the discontinuous change of described field depth depth.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described Focussing module Including: one first Focussing submodule, for the different piece that incident illumination passes through described first sub-lens is changed by outfield Phase contrast, to adjust the focal length of described first sub-lens.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described Focussing module Including: an expectation focal length determination sub-module, for the master according to the depth profile of described depth profile sub-district, described light-field camera Between the focal length of lens, described main lenss and described lenslet arrays first distance and described lenslet arrays with described Second distance between imaging surface, determines the expectation focal length of described first sub-lens；One second Focussing submodule, for extremely The focal length of few the first sub-lens according to described expectation Focussing, with reduce the object in described depth profile sub-district with The average blur circle of imaging on corresponding described first imaging region of described first sub-lens.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described second Focussing Submodule includes: a phase contrast determining unit, for determining that incident illumination is each passed through described the according at least to described expectation focal length The phase contrast being formed after one sub-lens different piece；One outfield determining unit, for according to the mapping between phase contrast and outfield Relation, determines outfield corresponding with described phase contrast；One Focussing unit, passes through for changing incident illumination by described outfield The phase contrast of the different piece of described first sub-lens, to adjust the focal length of described first sub-lens.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described first sub-lens are First liquid crystal sub-lens；Described phase contrast determining unit includes: a phase contrast determination subelement, for burnt according to described expectation Away from the wavelength of the, radius of described first liquid crystal sub-lens and described incident illumination, determine that described incident illumination is each passed through described The phase contrast being formed after the different piece of one liquid crystal sub-lens.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described Focussing module Including: one allows Focussing range determination submodule, allows Focussing scope for determine described first sub-lens；One 3rd Focussing submodule, for according at least to described allow Focussing scope adjust described first sub-lens focal length, It is imaged on described first imaging region corresponding with described first sub-lens with reducing the object in described depth profile sub-district Average blur circle.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described allows Focussing Range determination submodule includes: an expectation focal length determining unit, for according to the depth profile of described depth profile sub-district, described The first distance between the focal length of the main lenss of light-field camera, described main lenss and described lenslet arrays and described son are thoroughly Second distance between lens array and described imaging surface, determines the expectation focal length of described first sub-lens；One allows Focussing Scope determining unit, allows Focussing scope for determine described first sub-lens according to described expectation focal length.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described 3rd Focussing Submodule includes: one allows phase range unit, for allowing that Focussing scope determines that incident illumination is worn respectively according to described Formed after crossing described first sub-lens different piece allows phase range；One outfield determining unit, for according to phase contrast Mapping relations and outfield between, determine with described allow in phase range one allow the corresponding outfield of phase contrast；One is burnt Away from adjustment unit, for the phase contrast that incident illumination passes through the different piece of described first sub-lens is changed by described outfield, with Adjust the focal length of described first sub-lens.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described first sub-lens are First liquid crystal sub-lens；Described allow that phase range unit includes: a first phase difference determination subelement, for according to described Allow the ripple of the maximum allowable focal length, the radius of described first liquid crystal sub-lens and described incident illumination in the range of Focussing Long, determine that the first phase that described incident illumination is formed after being each passed through the different piece of described first liquid crystal sub-lens is poor respectively； One second phase difference determination subelement, for according to the described minimum allowed in the range of Focussing allow focal length, described first The radius of liquid crystal sub-lens and the wavelength of described incident illumination, determine that described incident illumination is each passed through described first liquid crystal respectively The second phase being formed after the different piece of lens is poor；One allows phase range determination subelement, for according to described first Phase range is allowed described in phase contrast and the difference determination of described second phase.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described device also includes: one Sub-lens determining module, affects described depth profile sub-district image acquisition for determining in the lenslet arrays of described light-field camera Sub-lens be described first sub-lens.

Any one the image acquisition control device providing in conjunction with the embodiment of the present application, alternatively, described sub-lens determine mould Block includes: a sub-lens determination sub-module, in the preview image of the described scene being obtained according to described light-field camera with institute State the corresponding part of depth profile sub-district, determine that the sub-lens affecting described depth profile sub-district image acquisition are described first son Lens.

The third aspect, the embodiment of the present application additionally provides another kind of image acquisition control device, comprising:

One processor, a communication interface, a memorizer and a communication bus；Described processor, described communication interface with And described memorizer completes mutual communication by described communication bus；

Described memorizer is used for depositing at least one instruction；Described instruction makes below described computing device operate:

Field depth according to light-field camera and the depth profile of scene, determine at least one depth profile of described scene Area, in described at least one depth profile sub-district, each depth profile sub-district is located at outside described field depth；

Adjust the focal length of the first sub-lens, become on the first imaging region with reducing the object in described depth profile sub-district The average blur circle of picture, wherein, described first sub-lens be described light-field camera lenslet arrays in affect described depth and divide The sub-lens of cloth sub-district image acquisition, described first imaging region is imaging area corresponding with described first sub-lens in imaging surface Domain；

Described light-field camera after adjusted carries out image acquisition to described scene.

The embodiment of the present application can be located at institute according to the depth profile of the field depth of light-field camera and scene in described scene State the region outside field depth and determine at least one depth profile sub-district, for each depth profile sub-district, can make full use of The characteristic of sub-lens focus adjustable, affects the sub-lens (i.e. the first sub-lens) of this depth profile sub-district image acquisition by adjustment Mode so that object in this depth profile sub-district imaging region corresponding with described sub-lens in described light-field camera The size of the average blur circle of (i.e. first imaging region) upper imaging has reduced, and it is right in this depth profile sub-district thus to improve The image quality of elephant；And Focussing control can not be carried out to the sub-lens of impact field depth image acquisition, to avoid to scape The image quality of the object in deep scope produces impact.So, the light-field camera after corresponding sub-lens Focussing carries out figure As collection, by way of an optically detecting, not only do not affect the image quality that scene is located at the object of field depth, also may be used Improve the image quality of the object at least one depth profile sub-district outside scene is located at described field depth, to a certain extent Be equivalent to and increased the obtainable relatively high imaging quality of optically detecting of light-field camera on the basis of original field depth Depth bounds, improves the overall image quality of scene.Further, since the embodiment of the present application makes full use of the material of the first sub-lens Matter characteristic realizes Focussing, and need not move or tilt the first sub-lens in light-field camera, and this is conducive to simplified system machine Tool structure, can meet but be not limited to the integrated application demand of the equipment such as light, thin, portable.

By the detailed description of the alternative embodiment to the application below in conjunction with accompanying drawing, the these and other of the application Advantage will be apparent from.

Brief description

The application can be by reference to being better understood below in association with the description given by accompanying drawing, wherein in institute Have and employ same or analogous reference in accompanying drawing to represent same or like part.Described accompanying drawing is together with following Describe the part comprising in this manual and being formed this specification together in detail, and be used for being further illustrated this The alternative embodiment of application and the principle and advantage explaining the application.In the accompanying drawings:

A kind of image acquisition control method flow chart that Fig. 1 provides for the embodiment of the present application；

The alternative construction example of the liquid crystal lens that Fig. 2 a provides for the embodiment of the present application；

The optional light path example of the liquid crystal lens that Fig. 2 b provides for the embodiment of the present application；

The alternative construction example of first planar lens (silicon stake lens) that Fig. 3 a provides for the embodiment of the present application；

The optional light path example of the equivalent focusing of first planar lens that Fig. 3 b provides for the embodiment of the present application；

The depth profile sub-district that Fig. 4 a provides for the embodiment of the present application is with the example of field depth depth profile relation deep Degree continuous distribution；

The depth profile sub-district that Fig. 4 b provides for the embodiment of the present application is with the example of field depth depth profile relation deep Spend discontinuous distribution；

The depth profile sub-district that Fig. 4 c provides for the embodiment of the present application is with the example of field depth depth profile relation deep Degree continuous distribution and the discontinuous distribution of depth；

The light-field camera topology example that Fig. 5 provides for the embodiment of the present application；

The logic diagram of the first image acquisition control device that Fig. 6 provides for the embodiment of the present application；

The optional logic diagram of the Focussing module that Fig. 7 provides for the embodiment of the present application；

The logic diagram of the second image acquisition control device that Fig. 8 provides for the embodiment of the present application；

The logic diagram of the third image acquisition control device that Fig. 9 provides for the embodiment of the present application.

It will be appreciated by those skilled in the art that element in accompanying drawing be used for the purpose of simple and clear for the sake of and illustrate, And be not necessarily drawn to scale.For example, in accompanying drawing, the size of some elements may be exaggerated with respect to other elements, with Just it is favorably improved the understanding to the embodiment of the present application.

Specific embodiment

Hereinafter in connection with accompanying drawing, the one exemplary embodiment of the application is described in detail.Rise for clarity and conciseness See, do not describe all features of actual embodiment in the description.It should be understood, however, that developing any this reality A lot of decisions specific to embodiment must be made, to realize the objectives of developer, example during embodiment As met those restrictive conditions related to system and business, and these restrictive conditions may with embodiment not Change together.Additionally, it also should be appreciated that although development is likely to be extremely complex and time-consuming, but to having benefited from For those skilled in the art of present disclosure, this development is only routine task.

Here in addition it is also necessary to explanation be a bit, in order to avoid having obscured the application because of unnecessary details, in accompanying drawing and Merely depict in explanation with according to the closely related apparatus structure of the scheme of the application and/or process step, and eliminate right The expression of little with the application relation, part known to persons of ordinary skill in the art and process and description.

(in some accompanying drawings, identical label represents identical element) and embodiment below in conjunction with the accompanying drawings, the tool to the application Body embodiment is described in further detail.Following examples are used for the application is described, but are not limited to scope of the present application.

It will be understood by those skilled in the art that the term such as " first ", " second " in the application be only used for distinguishing asynchronous Suddenly, equipment or module etc., neither represents any particular technology implication, does not also indicate that the inevitable logical order between them.

A kind of flow chart of image acquisition control method that Fig. 1 provides for the embodiment of the present application.The embodiment of the present application provides The executive agent of image acquisition control method can be a certain image acquisition control device.The setting of described image acquisition control device The standby form of expression is unrestricted, and such as described image acquisition control device can be a certain independent part；Or, described image is adopted Collection control device can be integrated in an imaging device as a certain functional module, and described imaging device may include but be not limited to light field Camera or include the mobile phone of light-field camera, panel computer etc., the embodiment of the present application is not intended to limit to this.Concrete as shown in figure 1, A kind of image acquisition control method that the embodiment of the present application provides includes:

S101: the field depth according to light-field camera and the depth profile of scene, determine at least one depth of described scene Distribution sub-district, in described at least one depth profile sub-district, each depth profile sub-district is located at outside described field depth.

S102: the focal length of adjustment the first sub-lens, to reduce the object in described depth profile sub-district in the first imaging area The average blur circle of imaging on domain, wherein, described first sub-lens be described light-field camera lenslet arrays in impact described The sub-lens of depth profile sub-district image acquisition, described first imaging region is corresponding with described first sub-lens in imaging surface Imaging region.

S103: the described light-field camera after adjusted carries out image acquisition to described scene.

When object is through being imaged as the imaging device such as light-field camera, it is ideally object plane and image planes are point and point one One is corresponding, but in actual application, due to the impact of the factors such as light wave property, aberration, the imaging of the point on object Bundle generally can not converge at a bit, but circular, ellipse or other similar rounds of a diffusion are formed on image plane Projection, referred to as blur circle (circle of confusion), alternatively referred to as circle of diffusion, dispersion ring, circle of confusion, the circle of confusion, scattering Disk etc..If the size of blur circle is less, the imaging of the generally corresponding object of this blur circle is comparatively clear, visually can quilt It is considered as the focus imaging of this point；Accordingly, if the size of blur circle exceedes certain permissible range, this blur circle is corresponding The imaging Relative Fuzzy of object.

Light-field camera includes main lenss, lenslet arrays and the imageing sensor setting gradually along depth direction.The application In embodiment, in described lenslet arrays, at least one sub-lens is the lens of focus adjustable, by the tune of the antithetical phrase focal length of lens Whole, incident ray can be changed and be imaged more on imaging region corresponding with this sub-lens after main lenss and this sub-lens successively Dissipate circle, thus change the definition that object is imaged on this imaging region.

The features such as lens of described focus adjustable have light, thin, is easy to be integrated in all kinds of mobile devices, and it is right to be especially suitable for Thickness, weight etc. require higher Wearable device (as near-eye display device etc.) to be with a wide range of applications.This lens Phase place through the light in lens can be changed by changing the characteristic of the material in lens, be achieved in adjusting this lens etc. Effect focal length (focal length).

Alternatively, the lens of described focus adjustable can be liquid crystal lens, by acting on the electric field on liquid crystal lens or magnetic The outer field actions such as field, can change the spatial distribution of liquid crystal molecule in liquid crystal lens, thus change incident ray after liquid crystal lens Light path, be equivalent to the adjustment of the focal length of lens.A kind of structure of optional liquid crystal lens is as shown in Figure 2 a and 2 b, comprising: on Under be arranged in parallel Liang Ge basic unit (substrates) 201, include a liquid crystal layer 205, often between 202, Liang Ge basic unit 201,202 Individual basic unit is respectively equipped with a key-course 203,204 near the side of liquid crystal layer 205, by key-course 203,204 apply electric field and/ Or magnetic field, the electric field of applying and/or magnetic field form the stable energy (anchoring of non-uniform Distribution in liquid crystal layer 205 Energy), these energy can make the distribution of the polarised direction of the liquid crystal molecule of lens different piece change, and so, puts down The outgoing after lens different piece of row incident ray is formed different phase contrasts, is equivalent to equivalent Jiao that have adjusted lens Away from.In actual application, non-homogeneous outfield can be applied by key-course, be formed with the different piece in liquid crystal layer non-homogeneous The stable energy of distribution；Or, can by key-course apply uniform external field (as uniform electric field and/or magnetic field etc.), then by but It is not limited to the stable energy that following at least one mode forms non-uniform Distribution in liquid crystal layer: key-course has non-uniform thickness The alignment layer (alignment layer) of distribution or the polarization layer of non-uniform thickness distribution；Alternatively, described non-uniform thickness The alignment layer of distribution may include the material with light sensation characteristic, and the illumination of non-uniform Distribution can allow the different piece of alignment layer connect Receive the stable energy intensity of non-uniform Distribution；Or, alternatively, described alignment layer can also be by polishing (half-tone) Treatment technology uses different materials in different regions, after applying outfield on alignment layer, can form differentiation distribution Stable energy；Etc..The non-uniform Distribution mode of the stable energy being formed in lens is for example: stable energy is along lens centre portion Position is radioactive to increase step by step to edge or reduces.

Alternatively, the lens of described focus adjustable can be first plane (metasurface) optics.Described unit planar light Learning device is a kind of plane, ultra thin optical device, and its target is to break wave surface moulding (wavefront shaping) to biography Broadcast the dependence of effect, allow phase place (phase), amplitude (amplitude) and/or polarization (polarization) characteristic of light wave to exist Very short distance produces mutation.Described unit planar optical device is typically made up of a series of miniature, anisotropy scattering objects, its scattering The optic response of body spatially forms diversity, and for example, described unit planar optical device can be but be not limited to silicon stake (silicon stump) lens, as shown in Figure 3 a, the lens plane of described silicon stake lens includes multiple pixels of honeycomb arrangement Point, each pixel is one nanometer of platform stake, and each nanometer of important actor includes pedestal (as sio₂Pedestal) and be formed on pedestal Amorphous crystal silicon (elliptical amorphous silicon post), the cross section of amorphous crystal silicon is generally elliptical. Each silicon stake is considered as optical waveguide structure, for the incident light wave of same angle, the difference of the elliptic cross-section in silicon stake Diameter and towards bringing different effective refractive indexes, generally, as shown in Figure 3 b, the direction of silicon stake and the angle of incident light wave Angle is bigger, for incident light wave refraction be phase place change bigger；For identical incident light wave, different refraction Index it is meant that different focal distance, for example: apart from the light source of silicon stake lens 600um, through the difference of a diameter of 400um After the silicon stake of direction, convergent point apart from silicon stake lens plane scope (focusing distance) can 50um～ 500um.In practical application, single silicon stake or whole silicon stake lens plane can change incident light wave by modes such as rotations Phase place, and the anglec of rotation and corresponding relation of the change of phase place is understood in advance, therefore pass through to control silicon stake or silicon stake lens The anglec of rotation, can accordingly change the phase contrast of emergent light and incident illumination, and then be equivalent to the adjustment of the silicon stake focal length of lens.

It should be noted that the concrete structure of the lens of described focus adjustable can be selected according to actual needs or design, should Part is prior art, and above lens arrangement is only the alternative construction of sub-lens in light-field camera, should not be construed as to the application The restriction of embodiment technical scheme essence is that is to say, that those skilled in the art are on the basis of technical scheme, optional With the other lenses of focus adjustable as the sub-lens in lenslet arrays, the embodiment of the present application is not intended to limit to this.

The embodiment of the present application is the depth of field model being solved using the adjustable characteristic of the focal length of lens in light field image gatherer process Enclose the problem of extension, the specific structure of the adjustable lens of focusing is not intended to limit.

After the operations such as the adjustment of light-field camera aperture, focusing complete, the field depth of this light-field camera is generally also therewith Determine, this field depth is the certain object distance range on depth direction relative to light-field camera main lenss.By the one of light-field camera Secondary optically detecting, the blur circle size of the object imaging being located in field depth in scene is less, generally can blur-free imaging, and position The blur circle size of the object imaging outside field depth is larger, and imaging is typically more fuzzy.

According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens to formed by main lenss As (as real image or the virtual image) reimaging on the corresponding imaging region of this sub-lens, the pixel of diverse location on imaging region Can be with the field information of the object of different depth in storage scenarios, at least local corresponding to certain object in scene is saturating through a certain son The blur circle of certain pixel imaging in imageing sensor for the mirror is:

$c=\frac{|v_n-v|f}{v_{n}n}\mathrm{...}\left(1\right)$

In above formula: c represents the equivalent diameter of blur circle；F represents the focal length of this sub-lens；V represents at least office of this object Portion's distance through imaging after main lenss and this sub-lens and this sub-lens center successively, this distance is equivalent to this sub-lens Image distance；v_nRepresent the distance between lenslet arrays plane and image sensor plane；N represents f-number (f-number).Cause This, the focal length of adjustment sub-lens, incident ray can be changed and become on imaging region corresponding with this sub-lens through this sub-lens Picture average blur circle, such as the average blur circle after corresponding sub-lens Focussing is less than to should sub-lens Focussing The average blur circle of front focal length, as the condition of convergence of sub-lens Focussing, can improve the image quality of respective regions.

It can be seen that, the embodiment of the present application can be according to the depth profile of the field depth of light-field camera and scene, in described scene Region outside described field depth determines at least one depth profile sub-district, for each depth profile sub-district, can fill Point using sub-lens focus adjustable characteristic, affect the sub-lens (i.e. first of this depth profile sub-district image acquisition by adjustment Sub-lens) mode so that object in this depth profile sub-district one-tenth corresponding with described sub-lens in described light-field camera Size as the average blur circle of region (i.e. first imaging region) upper imaging has reduced, and thus improves this depth profile sub-district The image quality of interior object；And Focussing control can not be carried out to the sub-lens of impact field depth image acquisition, to keep away Exempt from the image quality on the object in field depth and produce impact.So, the light-field camera after corresponding sub-lens Focussing Carry out image acquisition, by way of an optically detecting, not only do not affect the imaging matter that scene is located at the object of field depth Amount, also can improve scene be located at described field depth outside at least one depth profile sub-district in object image quality, one Determine to be equivalent in degree and increased the obtainable higher one-tenth of optically detecting of light-field camera on the basis of original field depth As the depth bounds of quality, improve the overall image quality of scene.

Alternatively, after the Focussing of described first sub-lens, object in described depth profile sub-district with described On corresponding described first imaging region of first sub-lens, the average blur circle of imaging allows blur circle less than or equal to one.If Blur circle allows blur circle (permissible circle of confusion) less than or equal to a certain, can be considered that object closes Burnt imaging；Accordingly, if blur circle allows blur circle more than this, can be considered the imaging out of focus of this object.Described allow blur circle Size relevant with factors such as object distance, enlargement ratios, can predefine and allow blur circle size, for example described allow that blur circle is big Little for 1/30mm etc..The program is equivalent in sub-lens Focussing control process, will be flat after sub-lens Focussing All blur circle allow the condition of convergence that blur circle controls as this sub-lens Focussing less than or equal to one that is to say, that In sub-lens Focussing control process, if after sub-lens Focussing corresponding imaging region average blur circle be less than or Allow blur circle equal to described, then the Focussing that can complete this sub-lens controls.It can be seen that, sub-lens are carried out using the program Focussing control, be equivalent to so that at least one depth sub-district outside the field depth of scene be adjusted to can blur-free imaging model Enclose, be equivalent to a certain extent and increased the original field depth of light-field camera, improve the general image acquisition quality of scene, In some cases, or even be conducive to scene is carried out the deep image acquisition of panorama, diversified practical application need are more preferably met Ask.

The determination mode of described depth profile sub-district and quantity can determine, implementation is very flexible according to actual needs. For example, can determine that in described scene, at least part of depth areas in addition to field depth are institute according to the input information of user State at least one depth profile sub-district；Again for example, can in conjunction with light-field camera the preview image to described scene analysis result, determination In described scene, at least part of depth areas in addition to field depth are described at least one depth profile sub-district；Again for example, may be used In conjunction with light-field camera with regard to the presupposed information of depth profile sub-district, determine at least part of in addition to field depth in described scene Depth areas are described at least one depth profile sub-district；Etc..It is appreciated that the described at least part of depth areas determined are whole Body can as depth profile sub-district described in, or, the described at least part of depth areas determined also can be entered by certain condition Row divides to obtain multiple described depth profile sub-districts, etc..The embodiment of the present application is not intended to limit to above-mentioned specific implementation, Diversified practical application request can more preferably be met.

The depth bounds that described depth profile sub-district includes and quantity can be in the depth outside the field depth of described scene Flexibly determine on direction, to meet diversified application demand.

Alternatively, at least one of described at least one depth profile sub-district and described field depth depth consecutive variations, That is, a border of at least one of described at least one depth profile sub-district depth profile sub-district in the depth direction and One border of field depth is adjacent, as shown in Fig. 4 a or Fig. 4 b.The program is conducive to improving scene positioned at field depth The image quality of the object of periphery, is equivalent to and original field depth is continuously extended in the depth direction.Some In application scenarios, carry out microshot scene for example with large aperture, be conducive to obtaining scene larger depth even using the program The blur-free imaging of continuous scope, in the case of scene depth narrow distribution, or even the panorama depth image acquisition of achievable large aperture.

Alternatively, at least one of described at least one depth profile sub-district and the discontinuous change of described field depth depth, That is, each border of at least one of described at least one depth profile sub-district depth profile sub-district in the depth direction and Each border of field depth is all non-conterminous, as shown in Fig. 4 b or Fig. 4 c.The program is conducive to improving scene positioned at depth of field model The image quality of at least part of object outside enclosing, is equivalent to and adjusts in the depth direction on the basis of original field depth again The preferable depth sub-district of whole some image quality.In some application scenarios, for example multiple objects are distributed on the scene along depth direction The different depth position (as face etc.) of scape, wherein a certain object is located in field depth, and other objects are located at field depth Outside, be conducive to improving the image quality of multiple objects of different depth position in scene using the program.

In the technical scheme that the embodiment of the present application provides, incident illumination can be changed by outfield and pass through described first sub-lens The phase contrast of different piece, to adjust the focal length of described first sub-lens.Wherein, described outfield can be according to the spy of the material of lens Property determine, as described outfield may include but be not limited to electric field, magnetic field, light field etc..When outer field action is on the first sub-lens, can Cause the change of the material characteristic of the first sub-lens, such as cause liquid crystal molecule polarised direction changes in distribution, the silicon of liquid crystal sub-lens Silicon stake direction change of stake lens etc. is so that incident illumination forms certain phase place through after the different piece of the first sub-lens Difference, due to there is certain corresponding relation between phase place and focal length, the change of phase place is equivalent to the adjustment of focal length.It can be seen that, the party Case need not move or tilt the first sub-lens in light-field camera, but the material characteristic making full use of the first sub-lens realizes Jiao Away from adjustment, it is thus advantageous to simplified system frame for movement, can meet but be not limited to the integrated application need of the equipment such as light, thin, portable Ask.

Alternatively, adjust the focal length of described first sub-lens, comprising: according to the depth profile of described depth profile sub-district, Between the focal length of the main lenss of described light-field camera, described main lenss and described lenslet arrays first distance and described Second distance between lenslet arrays and described imaging surface, determines the expectation focal length of described first sub-lens；According at least to institute State the focal length of the first sub-lens described in expectation Focussing, to reduce the object in described depth profile sub-district with described first The average blur circle of imaging on corresponding described first imaging region of sub-lens.

The imaging formula of main lenss is as follows:

$\frac{1}{u}+\frac{1}{v}=\frac{1}{f}\mathrm{...}\left(2\right)$

In above formula (2): u represents the object distance of main lenss；V represents the image distance of main lenss；F represents main lenss focal length.

The imaging formula of the first sub-lens:

$\frac{1}{u}+\frac{1}{v}=\frac{1}{f}\mathrm{...}\left(3\right)$

In above formula (3): u represents the object distance of the first sub-lens；V represents the image distance of the first sub-lens；F represents the first sub-lens Focal length.

Include object through the process that light-field camera carries out image acquisition through the Polaroid of main lenss and object through main saturating The secondary imaging through the first sub-lens re-imaging for the mirror imaging, therefore, the object distance of the image distance of main lenss and the first sub-lens Between meet below equation:

V+u=l₁...........................................................(4)

In above formula (4): v represents the image distance of main lenss；U represents the object distance of the first sub-lens；l₁Represent that main lenss are saturating with son The distance between lens array (i.e. the first distance), namely the distance between main lenss and the first sub-lens.

When object is located at the first imaging region through main lenss and the first sub-lens imaging successively, imaging clear Clear degree is high, and that is, the average blur circle of imaging is little, therefore, can by the distance between the first sub-lens and the first imaging region really It is set to the image distance of described first sub-lens:

V=l₂.............................................................(5)

In above formula (5): v represents the image distance of the first sub-lens；l₂Represent between lenslet arrays and imageing sensor away from From (i.e. second distance), namely the distance between the first sub-lens and the first imaging region.

In conjunction with formula (2), (3), (4) and (5), the focal length f of the first sub-lens can be calculated, this focal length is the first son The expectation focal length of lens.In actual application, the phase that light passes through the first sub-lens different piece can be changed by outer field action Position is so that with the equivalent focal length corresponding to the phase contrast of the first sub-lens different piece as close possible to even equal to described expectation Focal length, thus reduces average blur circle on described first imaging region for the object, improves described first imaging region and is gathered The definition of the image arriving.

Wherein, the focal length according at least to the first sub-lens described in described expectation Focussing mays include: according at least to described Expect that focal length determines the phase contrast that incident illumination is formed after being each passed through described first sub-lens different piece；According to phase contrast with outward Mapping relations between, determine outfield corresponding with described phase contrast；Incident illumination is changed by described outfield and passes through described the The phase contrast of the different piece of one sub-lens, to adjust the focal length of described first sub-lens.The program is simply easily realized, and improves The control efficiency of the first sub-lens Focussing.

Might as well illustrate to determine phase contrast as a example with the first sub-lens as liquid crystal lens (the hereinafter referred to as first liquid crystal sub-lens) Optional implementation.Alternatively, described determine that incident illumination is each passed through described first son thoroughly according at least to described expectation focal length The phase contrast being formed after mirror different piece, comprising: according to described expectation focal length, the radius of described first liquid crystal sub-lens and institute State the wavelength of incident illumination, determine the phase place that described incident illumination is formed after being each passed through the different piece of described first liquid crystal sub-lens Difference.Described phase contrast is determined using the program, scheme is simply easily realized.Alternatively, meet between focal length and phase contrast right as follows Should be related to:

$f=\frac{{\mathrm{\πr}}^2}{\mathrm{\δ}\mathrm{\φ}\mathrm{\λ}}\mathrm{...}\left(6\right)$

In above formula (6): f represents the expectation focal length of the first liquid crystal sub-lens；R represents the radius of the first liquid crystal sub-lens；δ φ represents that light passes through the phase contrast of the first liquid crystal sub-lens different piece, and such as light is each passed through the central part of the first liquid crystal sub-lens Divide the phase contrast with marginal portion；λ represents the wavelength of light.

After determining the expectation corresponding phase contrast of focal length, due to there is certain corresponding relation between phase contrast and outfield, Can be according to the outfield needed for the determination of this corresponding relation.Specifically, for the structure of the first sub-lens, phase contrast and electric field are (such as The voltage swing of uniform electric field, or, distribution of inhomogeneous field etc.) between mapping relations can obtain in advance, according to this Mapping relations, it may be determined that place and the electric field corresponding to the expectation corresponding phase contrast of focal length, pass through the electric field action the of determination afterwards One sub-lens come to change the first sub-lens material characteristic (as change the first sub-lens in liquid crystal molecule distribution, silicon stake lens Direction of interior silicon stake etc.) so that light passes through the phase contrast of the first sub-lens different piece as close possible to even equal to institute really Fixed phase contrast, and then make the equivalent focal length of the first sub-lens after adjustment as close possible to even equal to described expectation Jiao Away from.

Alternatively, adjust the focal length of described first sub-lens, comprising: determine described first sub-lens allows Focussing Scope；According at least to the described focal length allowing that Focussing scope adjusts described first sub-lens, to reduce described depth profile The average blur circle that object in sub-district is imaged on described first imaging region corresponding with described first sub-lens.Using this Scheme carries out the Focussing of described first sub-lens, the focal length after described first sub-lens adjustment fall into described in allow that focal length is adjusted Whole scope.Wherein, described allow that Focussing scope can be according to can bring accordingly average blur circle to subtract after focal length of lens adjustment Flexibly determine under little requirement, the embodiment of the present application is not intended to limit to this.The program is simply easily realized, and improves the first sub-lens The control efficiency of Focussing.

Described allow Focussing scope can according to can bring after described first sub-lens Focussing accordingly average more Dissipate predetermined under the requirement that circle reduces, the method for determination may include but be not limited to push away using laboratory facilities, analog simulation, formula The mode such as lead determines.Optionally it is determined that described first sub-lens allow Focussing scope, comprising: divided according to described depth Between the depth profile of cloth sub-district, the focal length of the main lenss of described light-field camera, described main lenss and described lenslet arrays Second distance between first distance and described lenslet arrays and described imaging surface, determines the phase of described first sub-lens Hope focal length；Allow Focussing scope according to what described expectation focal length determined described first sub-lens.Described expectation focal length is really The method of determining refers to record above, and after determining described expectation focal length, the material that can take the first sub-lens into consideration is special Property limit, focus adjustment precision limit, to object image quality require etc. factor it would be desirable to focal length is in certain range of allowable error Interior angular range allows Focussing scope as described.Allow Focussing scope using described in program determination more Rationally, allow that Focussing scope carries out the Focussing of the first sub-lens based on this, efficiency high and be easier to realize.

Alternatively, described according at least to described allow Focussing scope adjust described first sub-lens focal length can wrap Include: allow that Focussing scope determines that incident illumination is each passed through the appearance being formed after described first sub-lens different piece according to described Permitted phase range；According to the mapping relations between phase contrast and outfield, determine and the described appearance allowed in phase range Permitted the corresponding outfield of phase contrast；The phase place that incident illumination passes through the different piece of described first sub-lens is changed by described outfield Difference, to adjust the focal length of described first sub-lens.The described focal length allowed in the range of Focussing is the focal length allowing to adjust, when Focal length after described first sub-lens adjustment fall into described in when allowing in the range of Focussing, corresponding with described first sub-lens The average blur circle of the image that described first imaging region is collected has reduced, and each focal length corresponds to a phase contrast, because This allows to allow phase range corresponding to Focussing scope described in can determine that, determines that this allows appointing in phase range Outfield corresponding to one phase contrast, as the voltage input of described first sub-lens Focussing, thus to described first sub-lens Realize required Focussing, improve convenience and the motility that Focussing controls.

Might as well illustrate to determine described appearance as a example with the first sub-lens as liquid crystal lens (the hereinafter referred to as first liquid crystal sub-lens) Permitted the optional implementation of phase range.Alternatively, allow that Focussing scope determines that incident illumination is each passed through according to described Formed after described first sub-lens different piece allows phase range, comprising: allowed in the range of Focussing according to described Maximum allowable focal length, the radius of described first liquid crystal sub-lens and described incident illumination wavelength, determine described incidence respectively The first phase that light is formed after being each passed through the different piece of described first liquid crystal sub-lens is poor；Allow Focussing according to described In the range of minimum allow the wavelength of focal length, the radius of described first liquid crystal sub-lens and described incident illumination, determine institute respectively State the second phase being formed after incident illumination is each passed through the different piece of described first liquid crystal sub-lens poor；According to described first phase Phase range is allowed described in potential difference and the difference determination of described second phase.Can be obtained using the program and allow phase place described in maximum Difference scope, is conducive to improving control efficiency and the motility of Focussing.

Alternatively, before the focal length of described adjustment at least one first sub-lens, methods described also comprises determining that described light field The sub-lens affecting described depth profile sub-district image acquisition in the lenslet arrays of camera are described first sub-lens.Using this Scheme can determine the sub-lens conduct affecting described depth profile sub-district image acquisition in the lenslet arrays of light-field camera Described first sub-lens, afterwards by carrying out Focussing to described first sub-lens so that in described depth profile sub-district Object in the image sensor on the first imaging region corresponding with described first sub-lens the average blur circle of imaging subtracted Little, thus improve the image quality of described depth profile sub-district.The image affecting certain object in described depth profile sub-district is adopted The sub-lens (i.e. described first sub-lens) of collection may be one or more, and each first sub-lens that determine can be carried out respectively Focussing, and by the object in described depth profile sub-district in corresponding first sub-lens corresponding to imaging area on average Blur circle has reduced the condition of convergence controlling as sub-lens Focussing, thus improves the overall image quality of this object.

Still optionally further, affect described depth profile sub-district image in the lenslet arrays determining described light-field camera to adopt Collection sub-lens be described first sub-lens, comprising: according to described light-field camera obtain described scene preview image in The corresponding part of described depth profile sub-district, determines that the sub-lens affecting described depth profile sub-district image acquisition are described first Sub-lens.A kind of optional implementation, in described light-field camera, as shown in figure 5, can be by Focussing so that described son The each sub-lens that lens arra includes keep identical focal length, and by the adjustment of depth direction so that imageing sensor with described The distance of lenslet arrays is equal to the focal length of sub-lens；So, based on this light-field camera gather a certain visual angle of scene image (such as Described preview image) spatial resolution and described lenslet arrays sub-lens be distributed correspondings, described in each sub-lens is corresponding The a certain imaging region of imageing sensor, each imaging region includes the multiple pixel of array distribution, by this imaging region record The light information of the different directions to certain portion from described scene for this sub-lens, that is, in this light-field camera, described preview graph There is corresponding relation between the pixel distribution of picture and the sub-lens distribution of described lenslet arrays, therefore, can be according to described light Part corresponding with described depth profile sub-district in the preview image of described scene that field camera obtains, determines and affects described depth The sub-lens of distribution sub-district image acquisition, the sub-lens of determination are described first sub-lens.Impact institute is determined using the program State the sub-lens of depth profile sub-district image acquisition, method is simply easily realized.

It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step Sequence number size is not meant to the priority of execution sequence, and the execution sequence of each step should be determined with its function and internal logic, and Any restriction should not be constituted to the implementation process of the application specific embodiment.

The logic diagram of the first image acquisition control device that Fig. 6 provides for the embodiment of the present application.As shown in fig. 6, this The first image acquisition control device that application embodiment provides includes: a depth profile sub-district determining module 61, a focal length are adjusted Mould preparation block 62 and an image capture module 63.

Depth profile sub-district determining module 61 is used for, according to the field depth of light-field camera and the depth profile of scene, determining At least one depth profile sub-district of described scene, in described at least one depth profile sub-district, each depth profile sub-district is positioned at described Outside field depth.

Focussing module 62 is used for the focal length of adjustment the first sub-lens, to reduce the object in described depth profile sub-district The average blur circle of imaging on the first imaging region, wherein, described first sub-lens are the sub-lens battle array of described light-field camera The sub-lens of described depth profile sub-district image acquisition are affected, described first imaging region is with described first in imaging surface in row The corresponding imaging region of sub-lens.

Image capture module 63 be used for adjusted after described light-field camera image acquisition is carried out to described scene.

The embodiment of the present application can be located at institute according to the depth profile of the field depth of light-field camera and scene in described scene State the region outside field depth and determine at least one depth profile sub-district, for each depth profile sub-district, can make full use of The characteristic of sub-lens focus adjustable, affects the sub-lens (i.e. the first sub-lens) of this depth profile sub-district image acquisition by adjustment Mode so that object in this depth profile sub-district imaging region corresponding with described sub-lens in described light-field camera The size of the average blur circle of (i.e. first imaging region) upper imaging has reduced, and it is right in this depth profile sub-district thus to improve The image quality of elephant；And Focussing control can not be carried out to the sub-lens of impact field depth image acquisition, to avoid to scape The image quality of the object in deep scope produces impact.So, the light-field camera after corresponding sub-lens Focussing carries out figure As collection, by way of an optically detecting, not only do not affect the image quality that scene is located at the object of field depth, also may be used Improve the image quality of the object at least one depth profile sub-district outside scene is located at described field depth, to a certain extent Be equivalent to and increased the obtainable relatively high imaging quality of optically detecting of light-field camera on the basis of original field depth Depth bounds, improves the overall image quality of scene.Further, since the embodiment of the present application makes full use of the material of the first sub-lens Matter characteristic realizes Focussing, and need not move or tilt the first sub-lens in light-field camera, and this is conducive to simplified system machine Tool structure, can meet but be not limited to the integrated application demand of the equipment such as light, thin, portable.

Alternatively, after the Focussing of described first sub-lens, object in described depth profile sub-district with described On corresponding described first imaging region of first sub-lens, the average blur circle of imaging allows blur circle less than or equal to one.Using The Focussing that the program carries out sub-lens controls, and is equivalent at least one depth sub-district tune outside the field depth making scene Whole for can blur-free imaging scope, be equivalent to a certain extent and increased the original field depth of light-field camera, improve scene General image acquisition quality, in some cases, or even be conducive to scene is carried out the deep image acquisition of panorama, more preferably meet Diversified practical application request.

Alternatively, at least one of described at least one depth profile sub-district and described field depth depth consecutive variations.Adopt Be conducive to obtaining the blur-free imaging of scene larger depth successive range with the program, in the case of scene depth narrow distribution, Even can achieve the panorama depth image acquisition of large aperture.

Alternatively, at least one of described at least one depth profile sub-district and the discontinuous change of described field depth depth. Be conducive to improving the image quality of multiple objects of different depth position in scene using the program.

Alternatively, as shown in fig. 7, described Focussing module 62 includes: one first Focussing submodule 621.First Focussing submodule 621 is used for changing, by outfield, the phase contrast that incident illumination passes through the different piece of described first sub-lens, To adjust the focal length of described first sub-lens.The program need not move in light-field camera or tilt the first sub-lens, but fills Point realize Focussing using the material characteristic of the first sub-lens, be thus advantageous to simplified system frame for movement, can meet but not It is limited to the integrated application demand of the equipment such as light, thin, portable.

Alternatively, described Focussing module 62 includes: an expectation focal length determination sub-module 622 and one second Focussing Submodule 623.Expect focal length determination sub-module 622 for according to the depth profile of described depth profile sub-district, described light field phase The first distance between the focal length of the main lenss of machine, described main lenss and described lenslet arrays and described lenslet arrays Second distance and described imaging surface between, determines the expectation focal length of described first sub-lens；Second Focussing submodule 623 For the focal length according at least to the first sub-lens described in described expectation Focussing, right in described depth profile sub-district to reduce Average blur circle as imaging on described first imaging region corresponding with described first sub-lens.In actual application, Light can be changed by outer field action and pass through the phase place of the first sub-lens different piece so that phase with the first sub-lens different piece Equivalent focal length corresponding to potential difference, as close possible to even equal to described expectation focal length, thus reduces object in the described first imaging Average blur circle on region, improves the definition of the image that described first imaging region is collected.

Alternatively, described second Focussing submodule 623 includes: a phase contrast determining unit 6231, an outfield determine Unit 6232 and a Focussing unit 6233.Phase contrast determining unit 6231 be used for according at least to described expectation focal length determine into Penetrate the phase contrast being formed after light is each passed through described first sub-lens different piece；Outfield determining unit 6232 is used for according to phase place Mapping relations between difference and outfield, determine outfield corresponding with described phase contrast；Focussing unit 6233 is used for by institute State outfield and change the phase contrast that incident illumination passes through the different piece of described first sub-lens, to adjust Jiao of described first sub-lens Away from.The program is simply easily realized, and improves the control efficiency of the first sub-lens Focussing.

Alternatively, described first sub-lens are the first liquid crystal sub-lens；Described phase contrast determining unit 6231 includes: a phase Potential difference determination subelement 62311.Phase contrast determination subelement 62311 is used for according to described expectation focal length, described first liquid crystal The radius of lens and the wavelength of described incident illumination, determine that described incident illumination is each passed through the difference of described first liquid crystal sub-lens The phase contrast partly being formed afterwards.Described phase contrast is determined using the program, scheme is simply easily realized.

Alternatively, described Focussing module 62 includes: one allows Focussing range determination submodule 624 and the 3rd Focussing submodule 625.Allow that Focussing range determination submodule 624 allows Jiao for determine described first sub-lens Away from adjusting range；3rd Focussing submodule 625 is used for allowing Focussing scope adjustment described first according at least to described The focal length of sub-lens, with reduce the object in described depth profile sub-district with corresponding described the first one-tenth of described first sub-lens Average blur circle as imaging on region.Described allow that Focussing scope can be corresponding according to bringing after focal length of lens adjustment Flexibly determine under the requirement that average blur circle reduces, the embodiment of the present application is not intended to limit to this.The program is simply easily realized, and improves The control efficiency of the first sub-lens Focussing.

Alternatively, described allow that Focussing range determination submodule 624 includes: expectation focal length determining unit 6241 He One allows Focussing scope determining unit 6242.Expect focal length determining unit 6241 for according to described depth profile sub-district Between depth profile, the focal length of the main lenss of described light-field camera, described main lenss and described lenslet arrays first distance, And the second distance between described lenslet arrays and described imaging surface, determine the expectation focal length of described first sub-lens；Hold Permitted Focussing scope determining unit 6242 be used for according to described expectation focal length determine described first sub-lens allow focal length adjust Whole scope.The program improves the accuracy that described expectation focal length determines.

Alternatively, described 3rd Focussing submodule 625 includes: one allows phase range unit 6251, an outfield Determining unit 6252 and a Focussing unit 6253.Allow phase range unit 6251 for allowing that focal length is adjusted according to described Whole scope determine incident illumination be each passed through described first sub-lens different piece after formed allow phase range；Outfield determines Unit 6252 is used for according to the mapping relations between phase contrast and outfield, determine with described allow in phase range one allow The corresponding outfield of phase contrast；Focussing unit 6253 is used for changing incident illumination through described first sub-lens by described outfield Different piece phase contrast, to adjust the focal length of described first sub-lens.Allow that focal length is adjusted using described in program determination Whole scope is relatively reasonable, allows that Focussing scope carries out the Focussing of the first sub-lens based on this, efficiency high and be easier to reality Existing.

Alternatively, described first sub-lens are the first liquid crystal sub-lens；Described allow that phase range unit 6251 includes: One first phase difference determination subelement 62511, a second phase difference determination subelement 62512 and allow that phase range determines Subelement 62513.First phase difference determination subelement 62511 be used for according to described allow in the range of Focussing maximum allowable The wavelength of focal length, the radius of described first liquid crystal sub-lens and described incident illumination, determines that described incident illumination is each passed through respectively The first phase being formed after the different piece of described first liquid crystal sub-lens is poor；Second phase difference determination subelement 62512 is used for Focal length, the radius of described first liquid crystal sub-lens and described incidence are allowed according to the described minimum allowed in the range of Focussing The wavelength of light, determines the second phase that described incident illumination is formed after being each passed through the different piece of described first liquid crystal sub-lens respectively Potential difference；Allow phase range determination subelement 62513 for being determined according to described first phase poor and described second phase difference Described allow phase range.Can be obtained using the program and allow phase range described in maximum, be conducive to improving focal length tune Whole control efficiency and motility.

Alternatively, as shown in figure 8, described device also includes: a sub-lens determining module 64.Sub-lens determining module 64 is used The sub-lens affecting described depth profile sub-district image acquisition in the lenslet arrays determining described light-field camera are described the One sub-lens.Can determine in the lenslet arrays of light-field camera that the described depth profile sub-district image of impact is adopted using the program The sub-lens of collection as described first sub-lens, afterwards by Focussing being carried out to described first sub-lens so that described depth Object in degree distribution sub-district in the image sensor on the first imaging region corresponding with described first sub-lens imaging flat All blur circles have reduced, and thus improve the image quality of described depth profile sub-district.

Alternatively, described sub-lens determining module 64 includes: a sub-lens determination sub-module 641.Sub-lens determine submodule Block 641 is used for portion corresponding with described depth profile sub-district in the preview image of described scene obtaining according to described light-field camera Point, determine that the sub-lens affecting described depth profile sub-district image acquisition are described first sub-lens.Shadow is determined using the program Ring the sub-lens of described depth profile sub-district image acquisition, method is simply easily realized.

The structural representation of the third image acquisition control device that Fig. 9 provides for the embodiment of the present application, the application is concrete Embodiment does not limit to the specific implementation of image acquisition control device 900.As shown in figure 9, image acquisition controls dress Put 900 may include that

Processor (processor) 910, communication interface (communications interface) 920, memorizer (memory) 930 and communication bus 940.Wherein:

Processor 910, communication interface 920 and memorizer 930 complete mutual communication by communication bus 940.

Communication interface 920, for communicating with such as deformable imageing sensor etc..

Processor 910, for configuration processor 932, specifically can execute the correlation step in any of the above-described embodiment of the method.

For example, program 932 can include program code, and described program code includes computer-managed instruction.

Processor 910 is probably a central processing unit (central processing unit, abbreviation cpu), or Specific integrated circuit (application specific integrated circuit, abbreviation asic), or be arranged to Implement one or more integrated circuits of the embodiment of the present application.

Memorizer 930, is used for depositing program 932.Memorizer 930 may comprise random access memory (random Access memory, abbreviation ram) it is also possible to also include nonvolatile memory (non-volatile memory), such as extremely A few disk memory.

For example, in a kind of optional implementation, processor 910 can perform following steps by configuration processor 932: root According to the field depth of light-field camera and the depth profile of scene, determine at least one depth profile sub-district of described scene, described extremely In a few depth profile sub-district, each depth profile sub-district is located at outside described field depth；Adjust the focal length of the first sub-lens, To reduce the average blur circle that the object in described depth profile sub-district is imaged on the first imaging region, wherein, described first Sub-lens be described light-field camera lenslet arrays in affect the sub-lens of described depth profile sub-district image acquisition, described One imaging region is imaging region corresponding with described first sub-lens in imaging surface；Described light-field camera after adjusted is to institute State scene and carry out image acquisition.In other optional implementations, processor 910 be can also carry out by configuration processor 932 State the step that other any embodiment refer to, will not be described here.

In program 932 each step implement the corresponding steps that may refer in above-described embodiment, module, submodule, In unit, corresponding description, will not be described here.Those skilled in the art can be understood that, for the convenience of description With succinct, the equipment of foregoing description and the specific work process of module, may be referred to the corresponding process in preceding method embodiment Description, will not be described here.

In the application the various embodiments described above, the sequence number of embodiment and/or sequencing are merely convenient of description, do not represent reality Apply the quality of example.Description to each embodiment all emphasizes particularly on different fields, and does not have the part describing in detail, may refer to it in certain embodiment The associated description of his embodiment.Implementation principle about device, equipment or system embodiment or the associated description of process, can be found in The record of correlation method embodiment, will not be described here.

Those of ordinary skill in the art are it is to be appreciated that combine the list of each example of the embodiments described herein description Unit and method and step, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These functions are actually To be executed with hardware or software mode, the application-specific depending on technical scheme and design constraint.Professional and technical personnel Each specific application can be used different methods to realize described function, but this realization is it is not considered that exceed Scope of the present application.

If described function realized using in the form of SFU software functional unit and as independent production marketing or use when, permissible It is stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the application is substantially in other words Partly being embodied in the form of software product of part that prior art is contributed or this technical scheme, this meter Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual People's computer, server, or network equipment etc.) execution each embodiment methods described of the application all or part of step. And aforesaid storage medium includes: u disk, portable hard drive, read only memory (read-only memory, abbreviation rom), deposit at random Access to memory (random access memory, abbreviation ram), magnetic disc or CD etc. are various can be with Jie of store program codes Matter.

It is clear that each part (system, subsystem, module, submodule in the embodiments such as the device of the application, method, system Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or weight Combination nova should be regarded as the equivalents of the application.Meanwhile, in the description to the application specific embodiment above, for a kind of real The mode of applying describes and/or the feature that illustrates can be made in one or more other embodiments in same or similar mode With, combined with the feature in other embodiment, or substitute the feature in other embodiment.

It should be emphasized that term "comprises/comprising" refers to the presence of feature, key element, step or assembly herein when using, but simultaneously It is not excluded for the presence of one or more further features, key element, step or assembly or additional.

Finally it is noted that embodiment of above is merely to illustrate the application, and the not restriction to the application, relevant The those of ordinary skill of technical field, in the case of without departing from spirit and scope, can also make a variety of changes And modification, therefore all equivalent technical solutions fall within the category of the application, and the scope of patent protection of the application should will by right Ask restriction.

Claims (10)

1. a kind of image acquisition control method is it is characterised in that include:

Field depth according to light-field camera and the depth profile of scene, determine at least one depth profile sub-district of described scene, In described at least one depth profile sub-district, each depth profile sub-district is located at outside described field depth；

Adjust the focal length of the first sub-lens, to reduce what the object in described depth profile sub-district was imaged on the first imaging region Average blur circle, wherein, described first sub-lens be described light-field camera lenslet arrays in affect described depth profile The sub-lens of area's image acquisition, described first imaging region is imaging region corresponding with described first sub-lens in imaging surface；

Described light-field camera after adjusted carries out image acquisition to described scene.

2. method according to claim 1 is it is characterised in that after the Focussing of described first sub-lens, described depth The average blur circle that object in degree distribution sub-district is imaged on described first imaging region corresponding with described first sub-lens Allow blur circle less than or equal to one.

3. method according to claim 1 and 2 is it is characterised in that at least one of described at least one depth profile sub-district With described field depth depth consecutive variations.

4. method according to claim 1 and 2 is it is characterised in that at least one of described at least one depth profile sub-district The discontinuous change with described field depth depth.

5. according to the arbitrary described method of claim 1-4 it is characterised in that the focal length of described adjustment first sub-lens, comprising:

The phase contrast that incident illumination passes through the different piece of described first sub-lens is changed by outfield, to adjust described first son thoroughly The focal length of mirror.

6. a kind of image collecting device is it is characterised in that include:

One depth profile sub-district determining module, for the depth profile of the field depth according to light-field camera and scene, determines institute State at least one depth profile sub-district of scene, in described at least one depth profile sub-district, each depth profile sub-district is located at described scape Outside deep scope；

One Focussing module, for adjusting the focal length of the first sub-lens, is existed with reducing the object in described depth profile sub-district The average blur circle of imaging on first imaging region, wherein, described first sub-lens are the lenslet arrays of described light-field camera The middle sub-lens affecting described depth profile sub-district image acquisition, described first imaging region is sub with described first in imaging surface The corresponding imaging region of lens；

One image capture module, carries out image acquisition for the described light-field camera after adjusted to described scene.

7. device according to claim 6 is it is characterised in that after the Focussing of described first sub-lens, described depth The average blur circle that object in degree distribution sub-district is imaged on described first imaging region corresponding with described first sub-lens Allow blur circle less than or equal to one.

8. the device according to claim 6 or 7 is it is characterised in that at least one of described at least one depth profile sub-district With described field depth depth consecutive variations.

9. the device according to claim 6 or 7 is it is characterised in that at least one of described at least one depth profile sub-district The discontinuous change with described field depth depth.

10. a kind of image acquisition control device it is characterised in that

One processor, a communication interface, a memorizer and a communication bus；Described processor, described communication interface and institute State memorizer and mutual communication is completed by described communication bus；

Described memorizer is used for depositing at least one instruction；Described instruction makes below described computing device operate:

Field depth according to light-field camera and the depth profile of scene, determine at least one depth profile sub-district of described scene, In described at least one depth profile sub-district, each depth profile sub-district is located at outside described field depth；

Adjust the focal length of the first sub-lens, to reduce what the object in described depth profile sub-district was imaged on the first imaging region Average blur circle, wherein, described first sub-lens be described light-field camera lenslet arrays in affect described depth profile The sub-lens of area's image acquisition, described first imaging region is imaging region corresponding with described first sub-lens in imaging surface；

Described light-field camera after adjusted carries out image acquisition to described scene.