CN106303210B

CN106303210B - Image Acquisition control method and device

Info

Publication number: CN106303210B
Application number: CN201510546586.6A
Authority: CN
Inventors: 周梁; 杜琳
Original assignee: Beijing Zhigu Ruituo Technology Services Co Ltd
Current assignee: Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date: 2015-08-31
Filing date: 2015-08-31
Publication date: 2019-07-12
Anticipated expiration: 2035-08-31
Also published as: CN106303210A

Abstract

This application discloses a kind of Image Acquisition control method and devices, the described method includes: according to the depth distribution of the field depth of light-field camera and scene, determine an at least depth distribution sub-district for the scene, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district；The opposite plane parallel with the main lens of the light-field camera at least tilts the first imaging unit, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit, wherein, first imaging unit is in the imaging unit array of the light-field camera for carrying out the imaging unit of Image Acquisition to the depth distribution sub-district；The light-field camera after adjusted carries out Image Acquisition to the scene.The application improves the image quality of scene entirety.

Description

Image Acquisition control method and device

Technical field

This application involves a kind of field of terminal technology, more particularly to a kind of Image Acquisition control method and device.

Background technique

The depth of field (Depth of Field, abbreviation DoF) typically refers to the object distance that pick-up lens is capable of blur-free imaging to scene Range, that is to say, that in the depth direction can blur-free imaging with respect to the certain depth range before and after the focusing object plane of pick-up lens. The parameters such as aperture size, physics focal length length, the focal distance distance of camera lens and object by adjusting pick-up lens, can be one Determine to be adjusted the depth of field of pick-up lens in range, for example, field depth etc. can be reduced by tuning up aperture.

Larger field depth is obtained, especially there is larger field depth in the case where large aperture shoots situation, to camera shooting The requirement of camera lens is very high, and equipment manufacturing cost is expensive, usually can acquire respectively different focus by way of pick-up lens optically detecting Multiple images of object plane, further according to the Digital Signal Processing of multiple collected images to obtain the image of a larger field depth.

Summary of the invention

The brief overview about the application is given below, in order to provide the basic of some aspects about the application Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form, Taking this as a prelude to a more detailed description discussed later.

The embodiment of the present application provides a kind of Image Acquisition control method and device.

In a first aspect, the embodiment of the present application provides a kind of Image Acquisition control method, comprising:

According to the depth distribution of the field depth of light-field camera and scene, at least depth distribution of the scene is determined Area, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district；

The opposite plane parallel with the main lens of the light-field camera at least tilts the first imaging unit, to reduce the depth The average blur circle that object in degree distribution sub-district is imaged on first imaging unit, wherein first imaging unit To be used to carry out the depth distribution sub-district imaging unit of Image Acquisition in the imaging unit array of the light-field camera；

The light-field camera after adjusted carries out Image Acquisition to the scene.

Optionally described first is at least tilted in conjunction with any Image Acquisition control method provided by the embodiments of the present application After imaging unit, the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit is less than Or blur circle is allowed equal to one.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the field depth depth consecutive variations.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the discontinuous variation of field depth depth.

It is optionally, opposite with the light field phase in conjunction with any Image Acquisition control method provided by the embodiments of the present application The parallel plane of the main lens of machine at least tilts the first imaging unit, to reduce the object in the depth distribution sub-district described The average blur circle being imaged on first imaging unit, comprising: the opposite plane inclination parallel with main lens first imaging is single Member, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit.

It is optionally, opposite with the light field phase in conjunction with any Image Acquisition control method provided by the embodiments of the present application The parallel plane of the main lens of machine tilts first imaging unit, to reduce the object in the depth distribution sub-district described The average blur circle being imaged on first imaging unit, comprising: determine that inclined direction, the inclined direction are to increase the depth point Side of the object through the angle between the plane where the main lens imaging and first imaging unit in cloth sub-district To；The opposite plane parallel with the main lens tilts first imaging unit along the inclined direction, to reduce the depth The average blur circle that object in degree distribution sub-district is imaged on first imaging unit.

It is optionally, opposite with the light field phase in conjunction with any Image Acquisition control method provided by the embodiments of the present application The main lens parallel plane of machine tilts first imaging unit, to reduce the object in the depth distribution sub-district described the The average blur circle being imaged on one imaging unit, comprising: according to pair in the focal length of the first sub-lens, the depth distribution sub-district As through the angle and described between the plane and the plane parallel with the main lens where the main lens imaging Direction of the optical center of one sub-lens through plane vertically parallel with the main lens is passed through to the object in the depth distribution sub-district The distance of plane where the main lens imaging determines the expectation tilt angle of first imaging unit, wherein institute State sub-lens corresponding with first imaging unit in the lenslet arrays that the first sub-lens are the light-field camera；At least root First imaging unit is tilted according to the opposite plane parallel with the main lens of the expectation tilt angle, to reduce the depth The average blur circle that object in degree distribution sub-district is imaged on first imaging unit.

It is optionally, opposite with the light field phase in conjunction with any Image Acquisition control method provided by the embodiments of the present application The parallel plane of the main lens of machine tilts first imaging unit, to reduce the object in the depth distribution sub-district described The average blur circle being imaged on first imaging unit, comprising: determine that first imaging unit is opposite parallel with the main lens Plane allow angular range；The opposite plane parallel with the main lens of angular range is allowed to tilt institute according at least to described State the first imaging unit, with reduce that the object in the depth distribution sub-district is imaged on first imaging unit it is average more Dissipate circle.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first imaging is determined Unit allows angular range with respect to the plane parallel with the main lens, comprising: according to the focal length of the first sub-lens, the depth Object in degree distribution sub-district is through between the plane and the plane parallel with the main lens where the main lens imaging Angle and first sub-lens optical center through the direction of plane vertically parallel with the main lens to the depth point Distance of the object through the plane where the main lens imaging in cloth sub-district, determines the expectation of first imaging unit Tilt angle, wherein first sub-lens be the light-field camera lenslet arrays in first imaging unit pair The sub-lens answered；Angular range is allowed according to expectation tilt angle determination.

It is optionally, opposite with the light field phase in conjunction with any Image Acquisition control method provided by the embodiments of the present application The main lens parallel plane of machine at least tilts the first imaging unit, to reduce the object in the depth distribution sub-district described The average blur circle being imaged on one imaging unit, comprising: the opposite plane inclination parallel with the main lens first imaging Unit and the first sub-lens are averaged with reduce that the object in the depth distribution sub-district is imaged on first imaging unit Blur circle, wherein first sub-lens are corresponding with first imaging unit in the lenslet arrays of the light-field camera Sub-lens.

It is optionally, opposite with the main lens in conjunction with any Image Acquisition control method provided by the embodiments of the present application Parallel plane tilts first imaging unit and the first sub-lens, to reduce the object in the depth distribution sub-district described The average blur circle being imaged on first imaging unit, comprising: according to the focal length of first sub-lens, the depth distribution sub-district Interior object is through the angle, described between the plane and the plane parallel with the main lens where the main lens imaging Direction of the optical center of first sub-lens through plane vertically parallel with the main lens is to the object in the depth distribution sub-district The optical center of distance and first sub-lens through the plane where main lens imaging is along vertical described flat with main lens The direction of capable plane determines the first tilt angle and the institute of first imaging unit to the distance of first imaging unit State the second tilt angle of the first sub-lens；It is tilted according to the opposite plane parallel with the main lens of first tilt angle First imaging unit and according to the opposite plane inclination parallel with the main lens of second tilt angle described the One sub-lens, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first imaging is tilted Before unit, further includes: determine in the imaging unit array to inclined first imaging unit.

Optionally the imaging unit is determined in conjunction with any Image Acquisition control method provided by the embodiments of the present application To inclined first imaging unit in array, comprising: according to the preview image for the scene that the light-field camera obtains In part corresponding with the depth distribution sub-district, determine the first sub-lens for influencing the depth distribution sub-district Image Acquisition； According to the corresponding relationship between the imaging unit of sub-lens and the imaging unit array in the lenslet arrays, determine with Corresponding first imaging unit of first sub-lens.

Second aspect, the embodiment of the present application also provides a kind of Image Acquisition control devices, comprising:

One depth distribution sub-district determining module, for according to the field depth of light-field camera and the depth distribution of scene, really Determine an at least depth distribution sub-district for the scene, each depth distribution sub-district is located at institute in an at least depth distribution sub-district It states except field depth；

One tilt control module, at least tilted relative to the plane parallel with the main lens of the light-field camera first at As unit, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit, In, first imaging unit is in the imaging unit array of the light-field camera for carrying out figure to the depth distribution sub-district As the imaging unit of acquisition；

One image capture module carries out Image Acquisition to the scene for the light-field camera after adjusted.

Optionally described first is at least tilted in conjunction with any Image Acquisition control device provided by the embodiments of the present application After imaging unit, the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit is less than Or blur circle is allowed equal to one.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the field depth depth consecutive variations.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the discontinuous variation of field depth depth.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the tilt control module It include: one first inclination control submodule, for the opposite plane inclination parallel with the main lens of the light-field camera described the One imaging unit, to reduce the average disperse that the object in the depth distribution sub-district is imaged on first imaging unit Circle.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first inclination control Submodule includes: an inclined direction determination unit, for determining that inclined direction, the inclined direction are to increase the depth distribution Direction of the object through the angle between the plane where the main lens imaging and first imaging unit in sub-district； One first tilt control unit, for tilting first imaging unit according at least to the inclined direction, to reduce the depth The average blur circle that object in degree distribution sub-district is imaged on first imaging unit.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first inclination control Submodule includes: an expectation tilt angle determining unit, for according in the focal lengths of the first sub-lens, the depth distribution sub-district Object through angle, the Yi Jisuo between the plane and the plane parallel with the main lens where the main lens imaging The optical center of the first sub-lens is stated through the direction of plane vertically parallel with the main lens to pair in the depth distribution sub-district As the distance through the plane where the main lens imaging, the expectation tilt angle of first imaging unit is determined, In, first sub-lens are sub-lens corresponding with first imaging unit in the lenslet arrays of the light-field camera； One second tilt control unit, for being tilted according at least to the opposite plane parallel with the main lens of the expectation tilt angle First imaging unit is averaged with reduce that the object in the depth distribution sub-district is imaged on first imaging unit Blur circle.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first inclination control Submodule includes: to allow angular range determination unit, for determining that first imaging unit is opposite flat with the main lens Capable plane allows angular range；One third tilt control unit, for according at least to it is described allow angular range opposite with The parallel plane of the main lens tilts first imaging unit, to reduce the object in the depth distribution sub-district described The average blur circle being imaged on first imaging unit.

It is optionally, described to allow angular range in conjunction with any Image Acquisition control device provided by the embodiments of the present application Determination unit includes: that an expectation tilt angle determines subelement, for focal length, the depth distribution according to the first sub-lens Object in area through between the plane and the plane parallel with the main lens where the main lens imaging angle, with And the optical center of first sub-lens is through in the direction of plane vertically parallel with the main lens to the depth distribution sub-district Distance of the object through the plane where the main lens imaging, determine the expectation inclination angle of first imaging unit Degree, wherein first sub-lens are son corresponding with first imaging unit in the lenslet arrays of the light-field camera Lens；One allows angular range to determine subelement, for allowing angular range according to expectation tilt angle determination.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the tilt control module Include: one second inclination control submodule, tilts first imaging unit for the opposite plane parallel with the main lens With the first sub-lens, to reduce the average disperse that the object in the depth distribution sub-district is imaged on first imaging unit Circle, wherein first sub-lens are son corresponding with first imaging unit in the lenslet arrays of the light-field camera Lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second inclination control Submodule includes: a tilt angle determining unit, for according in the focal lengths of first sub-lens, the depth distribution sub-district Object through between the plane and the plane parallel with the main lens where the main lens imaging angle, described Direction of the optical center of one sub-lens through plane vertically parallel with the main lens is passed through to the object in the depth distribution sub-district The optical center of the distance of plane where main lens imaging and first sub-lens is along vertical described parallel with main lens Plane direction to the distance of first imaging unit, determine the first tilt angle of first imaging unit and described Second tilt angle of the first sub-lens；One the 4th tilt control unit, for opposite with institute according to first tilt angle It states the parallel plane of main lens and tilts first imaging unit and opposite saturating with the master according to second tilt angle The parallel plane of mirror tilts first sub-lens, single in first imaging to reduce the object in the depth distribution sub-district The average blur circle being imaged in member.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one Imaging unit determining module, for determining in the imaging unit array to inclined first imaging unit.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the imaging unit is determined Module includes: a sub-lens determination unit, in the preview image of the scene for being obtained according to the light-field camera with institute The corresponding part of depth distribution sub-district is stated, determines the first sub-lens for influencing the depth distribution sub-district Image Acquisition；One imaging Unit determination unit, between the imaging unit according to sub-lens and the imaging unit array in the lenslet arrays Corresponding relationship, determine corresponding with first sub-lens first imaging unit.

The third aspect, the embodiment of the present application also provides another Image Acquisition control devices, comprising:

One processor, a communication interface, a memory and a communication bus；The processor, the communication interface with And the memory completes mutual communication by the communication bus；

The memory is for storing at least one instruction；Described instruction makes the processor execute following operation:

The embodiment of the present application can be located at institute in the scene according to the field depth of light-field camera and the depth distribution of scene State region except field depth and determine an at least depth distribution sub-district, for each depth distribution sub-district, it is opposite with it is described The parallel plane of the main lens of light-field camera at least tilts in the imaging unit array of the light-field camera for the depth It is distributed the mode that sub-district carries out the imaging unit (i.e. described first imaging unit) of Image Acquisition, so that in the depth distribution sub-district The size of average blur circle that is imaged on first imaging unit of object reduced, thus improve depth distribution The image quality of object in area；And it can to the element (such as imaging unit and/or sub-lens) for influencing field depth Image Acquisition Without inclination control, had an impact to avoid the image quality to the object in field depth.In this way, through such as the first one-tenth described As the light-field camera after the organs inclines such as unit to scene carry out Image Acquisition, by way of an optically detecting, not only not The image quality that scene is located at the object of field depth is influenced, can also improve scene is located at except the field depth at least one The image quality of object in depth distribution sub-district is equivalent to increases light on the basis of original field depth to a certain extent The obtainable depth bounds compared with high imaging quality of field optically detecting of camera, improve the image quality of scene entirety.

By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application Advantage will be apparent from.

Detailed description of the invention

The application can be by reference to being better understood, wherein in institute below in association with description given by attached drawing Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings:

Fig. 1 is a kind of Image Acquisition control method flow chart provided by the embodiments of the present application；

Fig. 2 a is that the example of depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep It spends continuously distributed；

Fig. 2 b is that the example of depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep Spend discontinuous distribution；

Fig. 2 c is that the example of depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep Spend the continuously distributed and discontinuous distribution of depth；

Fig. 3 a is that part imaging unit provided by the embodiments of the present application tilts example；

Fig. 3 b is that part imaging unit provided by the embodiments of the present application and sub-lens tilt example；

Fig. 4 a is the example one that the elongated surfaces of three planes provided by the embodiments of the present application intersect；

Fig. 4 b is imaging unit inclined direction example provided by the embodiments of the present application；

Fig. 5 is light-field camera topology example provided by the embodiments of the present application；

Fig. 6 is the example two that the elongated surfaces of three planes provided by the embodiments of the present application intersect；

Fig. 7 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application；

Fig. 8 is the logic diagram of second of Image Acquisition control device provided by the embodiments of the present application；

Fig. 9 is the logic diagram of the third Image Acquisition control device provided by the embodiments of the present application.

It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear, And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with Just the understanding to the embodiment of the present application is helped to improve.

Specific embodiment

It is described in detail hereinafter in connection with exemplary embodiment of the attached drawing to the application.It rises for clarity and conciseness See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from For those skilled in the art of present disclosure, this development is only routine task.

Here, also it should be noted is that, in order to avoid having obscured the application because of unnecessary details, in attached drawing and It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.

(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.

It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.

Fig. 1 is a kind of flow chart of Image Acquisition control method provided by the embodiments of the present application.The embodiment of the present application provides The executing subject of Image Acquisition control method can be a certain Image Acquisition control device.Described image acquisition control device is set The standby form of expression is unrestricted, such as described image acquisition control device can be a certain independent component；Alternatively, described image is adopted Collection control device can be used as a certain functional module and be integrated in an imaging device, and the imaging device may include but be not limited to light field Camera includes the mobile phone of light-field camera, tablet computer etc., and the embodiment of the present application is not intended to limit this.It is specific as shown in Figure 1, A kind of Image Acquisition control method provided by the embodiments of the present application includes:

S101: according to the depth distribution of the field depth of light-field camera and scene, an at least depth for the scene is determined It is distributed sub-district, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district.

S102: the opposite plane parallel with the main lens of the light-field camera at least tilts the first imaging unit, to reduce The average blur circle that object in the depth distribution sub-district is imaged on first imaging unit, wherein the first one-tenth described Imaging as unit to be used to carry out the depth distribution sub-district Image Acquisition in the imaging unit array of the light-field camera Unit.

S103: the light-field camera after adjusted carries out Image Acquisition to the scene.

Object through such as light-field camera imaging device is imaged when, be ideally object plane and image planes be point with put one One is corresponding, but in actual application, due to the influence of the factors such as light wave property, aberration, the imaging of the point on object Beam generally can not converge at a bit, but the circular spread, ellipse or other similar rounds are formed on as plane Projection, referred to as blur circle (circle of confusion), alternatively referred to as figure of confusion, dispersion ring, circle of confusion, the circle of confusion, scattering Disk etc..If the size of blur circle is smaller, the imaging of the corresponding object of the usual blur circle is comparatively clear, visually can quilt It is considered as the focus imaging of the point；Correspondingly, the blur circle is corresponding if the size of blur circle is more than certain permissible range The imaging Relative Fuzzy of object.

In general, light-field camera includes the main lens set gradually along depth direction, lenslet arrays and imaging unit array, It is main when light-field camera is in the states of tilt operations such as imaging unit and/or the sub-lens for not carrying out that the embodiment of the present application refers to The plane where plane (i.e. main lens plane), lenslet arrays where lens and the plane phase where imaging unit array Mutually parallel and be respectively perpendicular to depth direction, each sub-lens are located at the same plane perpendicular to depth direction in lenslet arrays, The optical axis of each sub-lens is parallel with depth direction, each imaging unit in imaging unit array (but it is considered as an imaging sensor Or image sensing cell) include array distribution multiple pixels, each imaging unit also is located at perpendicular to the same flat of depth direction Face, and the normal of each imaging unit is parallel with depth direction.The plane parallel with main lens described in the embodiment of the present application include But be not limited to: plane, imaging unit where when plane, sub-lens where main lens are in not inclined original state are in Not when inclined original state where plane or be parallel to plane where main lens other are flat.When light-field camera aperture After the operations such as adjustment, focusing are completed, the field depth of the light-field camera generally also determines therewith, which is depth side Certain object distance range of opposite light-field camera main lens upwards.By an optically detecting of light-field camera, it is located at scape in scene In deep range object imaging blur circle size it is smaller, usually can blur-free imaging, and be located at field depth outside object imaging Blur circle size it is larger, imaging is typically more fuzzy.

The embodiment of the present application can be located at institute in the scene according to the field depth of light-field camera and the depth distribution of scene It states the region except field depth and determines an at least depth distribution sub-district, for each depth distribution sub-district, the relatively described light The main lens plane of field camera at least tilts in the imaging unit array of the light-field camera for the depth distribution sub-district The mode for carrying out the imaging unit (i.e. described first imaging unit) of Image Acquisition, so that the object in the depth distribution sub-district exists The size for the average blur circle being imaged on first imaging unit is reduced, and pair in the depth distribution sub-district is thus improved The image quality of elephant；And it can be without inclining to the element (such as imaging unit and/or sub-lens) for influencing field depth Image Acquisition Tiltedly control, has an impact to avoid the image quality to the object in field depth.In this way, passing through such as described first imaging unit Light-field camera after organs incline, which carries out Image Acquisition to scene, does not influence scene not only by way of an optically detecting Positioned at the image quality of the object of field depth, it can also improve at least depth distribution that scene is located at except the field depth The image quality of object in sub-district is equivalent to increases light-field camera one on the basis of original field depth to a certain extent The obtainable depth bounds compared with high imaging quality of secondary optically detecting, improve the image quality of scene entirety.

According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens to formed by main lens As (such as real image or the virtual image) reimaging on the corresponding imaging unit of the sub-lens, the pixel of different location on imaging unit The field information that can store the object of different depth in scene, at least part corresponding to certain object in scene are saturating through a certain son The blur circle that mirror is imaged in certain pixel of imaging unit corresponding with the sub-lens are as follows:

In above formula: the equivalent diameter of c expression blur circle；F indicates the focal length of the sub-lens；v_nIndicate at least office of the object Successively for imaging at a distance from the sub-lens center, which is equivalent to the sub-lens after main lens and the sub-lens in portion 's；V indicates the distance between sub-lens and imaging unit corresponding with the sub-lens, and before inclination, which is sub-lens battle array The distance between column plane and imaging unit array plane；N indicates f-number (f-number).

In the application scenarios for carrying out Image Acquisition based on light-field camera, each imaging unit in imaging unit array includes The pixel of multiple array distributions is not usually the actual Image Acquisition of all pixels point participation of imaging unit, but part Pixel participates in actual Image Acquisition.It, can be by least tilting described first in technical solution provided by the embodiments of the present application The mode of imaging unit, to change the blur circle that the object of the depth distribution sub-district is imaged in first imaging unit.

(1) a kind of optional implementation, can be by way of tilting first imaging unit, to change the depth The blur circle that the object of degree distribution sub-district is imaged in first imaging unit, it may be assumed that the opposite main lens with the light-field camera Parallel plane tilts first imaging unit, as shown in Figure 3a, to reduce the object in the depth distribution sub-district in institute State the average blur circle being imaged on the first imaging unit.

Physical record has each pixel of the object images information in the depth distribution sub-district in first imaging unit The mean value of the blur circle of point, can be considered the object in the depth distribution sub-district in the average blur circle of first imaging unit Size.Before and after first imaging unit inclination, first imaging unit participates in the picture of the object actual image acquisition Vegetarian refreshments and/or pixel quantity may be identical or different.Before first imaging unit being tilted, first imaging unit Middle physical record has the mean value of the blur circle of each pixel of the object images information, before first imaging unit inclination The size of the average blur circle of same object imaging；By physical record in first imaging unit after imaging unit inclination There is the mean value of the blur circle of each pixel of the object images information, as same object after first imaging unit inclination The size of the average blur circle of imaging.

From the point of view of the imaging formula of blur circle, the embodiment of the present application can be by way of tilting first imaging unit To change between first imaging unit and sub-lens corresponding with first imaging unit (i.e. described first sub-lens) Distance v, and then cause the change of corresponding blur circle, meanwhile, the average blur circle after first imaging unit inclination is small Average blur circle before first imaging unit inclination, as the condition of convergence of the first imaging unit inclination control, So that first imaging unit is corresponding with respect to can reach after adopting inclination by some way to the parallel plane of the main lens First imaging unit inclination relatively of average blur circle before corresponding average blur circle reduced.

As it can be seen that the embodiment of the present application is located at each depth point that the region except the field depth determines to the scene For cloth sub-district, the opposite plane inclination parallel with the main lens of the light-field camera is for carrying out the depth distribution sub-district The mode of first imaging unit of Image Acquisition, so that the object in the depth distribution sub-district is in first imaging unit The size of the average blur circle of upper imaging is reduced, and the image quality of the object in the depth distribution sub-district is thus improved；And It can be without inclination control, to avoid right to the element (such as imaging unit and/or sub-lens) for influencing field depth Image Acquisition The image quality of object in field depth has an impact.In this way, the light-field camera pair after first imaging unit inclination Scene carry out Image Acquisition, by way of an optically detecting, do not influence not only scene be located at field depth object at Image quality amount, can also improve the object in at least depth distribution sub-district that scene is located at except the field depth at image quality Amount, be equivalent on the basis of original field depth to a certain extent increase obtained by optically detecting of light-field camera compared with The depth bounds of high imaging quality improve the image quality of scene entirety.

(2) another optional implementation can pass through the sub-lens of inclination first imaging unit and light-field camera The mode of sub-lens corresponding with first imaging unit in array, to change the object of the depth distribution sub-district described The blur circle of first imaging unit imaging, it may be assumed that the opposite plane parallel with the main lens tilt first imaging unit and First sub-lens are imaged as shown in Figure 3b with reducing the object in the depth distribution sub-district on first imaging unit Average blur circle, wherein first sub-lens are single with first imaging in the lenslet arrays of the light-field camera The corresponding sub-lens of member.

Physical record has each pixel of the object images information in the depth distribution sub-district in first imaging unit The mean value of the blur circle of point, can be considered the object in the depth distribution sub-district in the average blur circle of first imaging unit Size.Before and after first imaging unit and first sub-lens inclination, first imaging unit participates in the object The pixel and/or pixel quantity of actual image acquisition may be identical or different.It can be by first imaging unit and described Before the inclination of first sub-lens, physical record has the blur circle of each pixel of the object images information in first imaging unit Mean value, as first imaging unit tilt before same object imaging average blur circle size；The imaging is single After the first and described first sub-lens inclination, physical record has each pixel of the object images information in first imaging unit Blur circle mean value, as first imaging unit and first sub-lens inclination after same object average disperse Round size.

Each sub-lens can be considered a thin lens in the lenslet arrays of light-field camera, and the Optical Formula of thin lens is such as Under:

In above formula: u indicates the object distance of sub-lens, i.e. main lens imaging of the object through light-field camera and the sub-lens Distance；The image distance of v expression sub-lens；The focal length of f expression sub-lens.

In conjunction with formula (1) and (2) it is found that the embodiment of the present application can be changed by way of tilting first sub-lens The object distance u of first sub-lens is to cause the image distance v of sub-lens_nCorresponding change occurs, and/or, pass through inclination described first The mode of sub-lens and/or first imaging unit changes distance v between the two, and then causes changing for corresponding blur circle Become, meanwhile, the average blur circle after first imaging unit and first sub-lens inclination is less than first imaging Average blur circle before unit and first sub-lens inclination, inclines as first imaging unit and first sub-lens The condition of convergence tiltedly controlled, so that first imaging unit and first sub-lens are put down with respect to parallel with the main lens After inclination by some way is adopted in face, averagely relatively described first imaging unit of blur circle and first son can reach accordingly Corresponding average blur circle is reduced before lens tilt.

As it can be seen that the embodiment of the present application is located at each depth point that the region except the field depth determines to the scene For cloth sub-district, the opposite plane inclination parallel with the main lens of the light-field camera is for carrying out the depth distribution sub-district The mode of first imaging unit of Image Acquisition and first sub-lens corresponding with first imaging unit, so that The size for the average blur circle that object in the depth distribution sub-district is imaged on first imaging unit is reduced, thus Improve the image quality of the object in the depth distribution sub-district；And it is (as single in being imaged to the element for influencing field depth Image Acquisition Member and/or sub-lens) it can be had an impact without inclination control to avoid the image quality to the object in field depth.This Sample, the light-field camera after first imaging unit and first sub-lens inclination carry out Image Acquisition to scene, pass through The mode of optically detecting does not influence the image quality that scene is located at the object of field depth not only, can also improve scene bit The image quality of the object in an at least depth distribution sub-district except the field depth, is equivalent to a certain extent in original Have and increase the obtainable depth bounds compared with high imaging quality of optically detecting of light-field camera on the basis of field depth, mentions The high image quality of scene entirety.

Optionally, first imaging unit is at least tilted (including described in inclination first imaging unit or inclination First imaging unit and first sub-lens etc.) after, the object in the depth distribution sub-district is single in first imaging The average blur circle being imaged in member is less than or equal to one and allows blur circle.If blur circle allows blur circle less than or equal to a certain (permissible circle of confusion) can be considered that the object focus is imaged；Correspondingly, if blur circle is greater than This allows blur circle, can be considered object imaging out of focus.The size for allowing blur circle and object distance, enlargement ratio etc. are because being known as It closes, can predefine and allow blur circle size, such as described to allow blur circle size be 1/30mm etc..The program is equivalent to (respective element includes first imaging unit to respective element or the respective element includes that first imaging is single First and described first sub-lens) during inclination control, the average blur circle after respective element inclination is less than or equal to One allows blur circle as the condition of convergence of the respective element inclination control, that is to say, that tilts and controls in the respective element During system, if the average blur circle that the respective element is located under certain heeling condition and the corresponding heeling condition is less than or waits Blur circle is allowed in described, then the inclination control of the achievable respective element.As it can be seen that carrying out the corresponding member using the program The inclination control of part, be equivalent to so that at least depth sub-district except the field depth of scene be adjusted to can blur-free imaging model It encloses, to a certain extent equivalent to increase the original field depth of light-field camera, improves the general image acquisition quality of scene, In some cases, or even be conducive to the Image Acquisition for carrying out panorama depth to scene, more preferably meet diversified practical application need It asks.

The method of determination and quantity of the depth distribution sub-district can determine according to actual needs, and implementation is very flexible. For example, at least partly depth areas in the scene in addition to field depth can be determined for institute according to the input information of user State an at least depth distribution sub-district；In another example in combination with light-field camera to the analysis of the preview image of the scene as a result, determining At least partly depth areas in the scene in addition to field depth is an at least depth distribution sub-district；For another example can Presupposed information in conjunction with light-field camera about depth distribution sub-district determines in the scene in addition to field depth at least partly Depth areas is an at least depth distribution sub-district；Etc..It is appreciated that at least partly depth areas determined is whole Body can be used as a depth distribution sub-district, alternatively, at least partly depth areas determined can also by certain condition into Row is divided to obtain multiple described depth distribution sub-districts, etc..The embodiment of the present application is not intended to limit above-mentioned specific implementation, Diversified practical application request can more preferably be met.

Optionally, described at least at least one of depth distribution sub-district and the field depth depth consecutive variations, That is a boundary of at least one depth distribution sub-district in an at least depth distribution sub-district in the depth direction and One boundary of field depth be it is adjacent, as shown in Fig. 2 a or Fig. 2 b.The program is conducive to raising scene and is located at field depth The image quality of the object on periphery is equivalent to and is continuously extended in the depth direction to original field depth.Certain In application scenarios, microshot scene is carried out for example, by using large aperture, scene larger depth is help to obtain using the program and is connected The blur-free imaging of continuous range, in the case of scene depth narrow distribution, or even can realize the panorama depth Image Acquisition of large aperture.

Optionally, described at least at least one of depth distribution sub-district and the discontinuous variation of field depth depth, That is, each boundary of at least one depth distribution sub-district in an at least depth distribution sub-district in the depth direction and Each boundary of field depth be all it is non-conterminous, as shown in Fig. 2 b or Fig. 2 c.The program is conducive to raising scene and is located at depth of field model The image quality of at least partly object except enclosing is equivalent to adjusting again in the depth direction on the basis of original field depth The whole preferable depth sub-district of some image quality.In certain application scenarios, such as multiple objects are on the scene along depth direction distribution The different depth position (such as face) of scape, wherein certain an object is located in field depth, and other objects are located at field depth Except, be conducive to improve the image quality of multiple objects of different depth position in scene using the program.

(1) in technical solution provided by the embodiments of the present application, can according to reduce accordingly averagely blur circle (even less than or Equal to allowing blur circle) the condition of convergence first imaging unit is tilted with respect to the plane parallel with the main lens Control, implementation are very flexible.

Optionally, the opposite plane parallel with the main lens of the light-field camera tilts first imaging unit, to subtract The average blur circle that object in the small depth distribution sub-district is imaged on first imaging unit, comprising: according to first Object in the focal length of sub-lens, the depth distribution sub-district through where main lens imaging plane and with the main lens The optical center of angle and first sub-lens between parallel plane is through the side of plane vertically parallel with the main lens To distance of the object through the plane where the main lens imaging in the depth distribution sub-district, described first is determined The expectation tilt angle of imaging unit, wherein first sub-lens be the light-field camera lenslet arrays in it is described The corresponding sub-lens of first imaging unit；Incline according at least to the expectation tilt angle with respect to the plane parallel with the main lens Oblique first imaging unit, with reduce the object in the depth distribution sub-district be imaged on first imaging unit it is flat Equal blur circle.

In light-field camera, after first imaging unit inclination, plane where first imaging unit with it is described Plane where first sub-lens is no longer parallel.With reference to husky nurse law (Scheimpflug principle), when the depth point Elongated surfaces of plane where the elongated surfaces of plane of the object through main lens imaging in cloth sub-district, first sub-lens, The elongated surfaces of plane where after the first imaging unit inclination, when three mutually gives line always, as shown in fig. 4 a, the depth The region that the object being distributed in sub-district can get blur-free imaging is maximum, and under the situation, object is through where main lens imaging Plane is equivalent to a focal plane (Plane of Focus), and the average blur circle that object is imaged in first imaging unit is most It is small.The tilt angle for meeting first imaging unit of above-mentioned law is expectation inclination angle described in the embodiment of the present application Degree.

In the embodiment of the present application, the depth bounds and quantity that depth distribution sub-district includes can be in the field depths of the scene Except depth direction on flexibly determine, to meet diversified application demand.For example, can be according to the overall depth of the scene Figure and the field depth edge pixel point, determine in the depth map be located at the field depth except and with the edge Each pixel of pixel connection, calculates the normal direction of the pixel of each connection, and the normal direction based on each pixel, right These pixels are grouped, and such as the angle according to normal direction relative depth direction is grouped, by normal direction and depth Angular separation is that 135 degree of -150 degree is one group, and/or, it is 45 degree of -60 degree etc. by normal direction and depth direction angle, thus The corresponding depth bounds of the pixel that each group respectively includes, respectively as each described depth distribution sub-district, etc., using this Scheme determines that the depth distribution sub-district is conducive to determine that object is through flat where main lens imaging in depth distribution sub-district Face, using the foundation as corresponding sub-lens inclination control.

Optionally, following formula calculating can be used in the expectation tilt angle of first imaging unit:

In above formula: θ indicates the expectation tilt angle of first imaging unit；The focal length of f the first sub-lens of expression,Table Show the object in the depth distribution sub-district through the plane and the plane parallel with the main lens where main lens imaging Angle, u between (such as the plane where the first sub-lens) indicate the optical center of first sub-lens along vertically flat with main lens Distance of the direction of capable plane to the object in the depth distribution sub-district through the plane where the main lens imaging. The opposite plane inclination parallel with the main lens first imaging of expectation tilt angle determined according at least to the program is single Member, so that first imaging unit is opposite with the plane-parallel tilt angle of the main lens, as close possible to even equal to The expectation tilt angle, and in the state that first imaging unit is in after inclination when progress Image Acquisition, it is described The average blur circle that object in depth distribution sub-district is imaged in first imaging unit is as small as possible.The program improves institute State the efficiency of the first imaging unit inclination control, and it is adjusted after light-field camera carry out Image Acquisition and can get scene more great achievement Image quality amount preferably or blur-free imaging depth bounds.Further, can be inclined according to the expectation tilt angle and the inclined direction Oblique first imaging unit, thus further increases the efficiency of the first imaging unit inclination control.

Optionally, the opposite main lens parallel plane with the light-field camera tilts first imaging unit, to reduce The average blur circle that object in the depth distribution sub-district is imaged on first imaging unit, comprising: determine described One imaging unit it is opposite with the main lens is plane-parallel allows angular range；Allow angular range opposite according at least to described The plane parallel with the main lens tilts first imaging unit, to reduce the object in the depth distribution sub-district in institute State the average blur circle being imaged on the first imaging unit.Using described in the opposite plane inclination parallel with the main lens of the program First imaging unit, first imaging unit after inclination and the angle between the plane parallel with the main lens fall into institute It states and allows angular range.Wherein, described to allow angular range corresponding according to that bring after first imaging unit inclination It is flexibly determined under the requirement that average blur circle reduces, the embodiment of the present application is not intended to limit this.The program improves described first The efficiency of imaging unit inclination control, and it is adjusted after light-field camera carry out Image Acquisition can get scene more big imaging quality Preferable or blur-free imaging depth bounds.

It is described allow angular range can according to first imaging unit tilt after can bring accordingly averagely blur circle subtract It is predefined under small requirement, determining method may include but be not limited to using the side such as laboratory facilities, analog simulation, derivation of equation Formula determines.Optionally, allow angular range of first imaging unit with respect to the plane parallel with the main lens, packet are determined Include: according to the object in the focal length of the first sub-lens, the depth distribution sub-district through where main lens imaging plane and The object in angle and the depth distribution sub-district between the plane parallel with the main lens through the main lens institute at Picture relatively described first sub-lens distance, determine the expectation tilt angle of first imaging unit, wherein described first Sub-lens are sub-lens corresponding with first imaging unit in the lenslet arrays of the light-field camera；According to the expectation Tilt angle allows angular range described in determining.The determination method of the expectation tilt angle can refer to record above, true After having determined the expectation tilt angle, in combination with consider the first imaging unit tilt adjustment precision limitation, to object at As the factors such as quality requirement, it would be desirable to tilt angle be used as in the angular range in certain range of allowable error described in allow angle Range.Allow angular range relatively reasonable using described in program determination, allows angular range to carry out described first based on this Imaging unit with respect to the plane parallel with the main lens inclination control, it is high-efficient and be easier to realize.

Optionally, the opposite plane parallel with the main lens of the light-field camera tilts first imaging unit, to subtract The average blur circle that object in the small depth distribution sub-district is imaged on first imaging unit, comprising: determine inclination Direction, the inclined direction are to increase object in the depth distribution sub-district through the main lens imaging and described first The direction of the angle between plane where imaging unit；The opposite plane parallel with the main lens is inclined along the inclined direction Oblique first imaging unit, with reduce the object in the depth distribution sub-district be imaged on first imaging unit it is flat Equal blur circle.With reference to husky nurse law, when extension of first part to be taken the photograph through plane where the main lens imaging of light-field camera The elongated surfaces in the face where after face, first sub-lens inclination where the elongated surfaces of plane, first imaging unit, three When mutually giving line always, the region that the object in the depth distribution sub-district can get blur-free imaging is maximum.As shown in Figure 4 b, Plane where before the inclination of one imaging unit, and formed by main lens of the object through light-field camera in the depth distribution sub-district As place face between angle be A₁, first imaging unit can be kept opposite along the direction for increasing the angle flat with main lens Capable plane (plane where before such as described first imaging unit inclination) inclination, it is flat where after the inclination of the first imaging unit Object in face, with the depth distribution sub-district is through the angle between the face where the main lens imaging of light-field camera A₂, A₂Greater than A₁, it is seen then that plane where it after first imaging unit is tilted towards the direction, with the depth distribution sub-district Interior object intersects same through the face where the main lens imaging of light-field camera and the plane three where the imaging surface The probability of one straight line significantly increases, and thus can reduce the object in the depth distribution sub-district in the first imaging unit institute At picture average blur circle, improve acquired image in corresponding object image quality.

Further, if the inclined direction and the expectation tilt angle inclined collectively as first imaging unit The foundation tiltedly controlled then can further improve the efficiency of the first imaging unit inclination control；Alternatively, if by the inclination side To with the foundation for allowing angular range collectively as the first imaging unit inclination control, then can further improve described The efficiency of first imaging unit inclination control.

Optionally, before inclination first imaging unit, further includes: determine in the imaging unit array to inclined First imaging unit.It can be determined in the imaging unit array of light-field camera for the depth distribution using the program Sub-district carries out the imaging unit of Image Acquisition, as to inclined first imaging unit, passes through the institute that will be determined later It states the opposite plane parallel with the main lens of the first imaging unit and carries out tilt adjustments, so that in the depth distribution sub-district The average blur circle that object is imaged on first imaging unit is reduced, thus improve the depth distribution sub-district at Image quality amount.The imaging unit that Image Acquisition is carried out to certain object in the depth distribution sub-district may be one or more, can To determining each imaging unit, the plane parallel with respect to the main lens is tilted respectively, and by depth distribution The average blur circle on the corresponding imaging unit of object after tilting in area is reduced as imaging unit inclination control Thus the condition of convergence improves the whole image quality of the object.

It is further alternative, it determines in the imaging unit array to inclined first imaging unit, comprising: according to Part corresponding with the depth distribution sub-district in the preview image for the scene that the light-field camera obtains, determining influences institute State the first sub-lens of depth distribution sub-district Image Acquisition；According to the sub-lens and the imaging unit in the lenslet arrays Corresponding relationship between the imaging unit of array determines first imaging unit corresponding with first sub-lens.It is a kind of Optional implementation, in the light-field camera, as shown in figure 5, the focal length phase for each sub-lens that the lenslet arrays include Together, the imaging unit array is equal to the focal length of the sub-lens at a distance from the lenslet arrays；Light-field camera at In the state of being in and do not tilt as unit and sub-lens, the image based on the light-field camera acquisition a certain visual angle of scene is (such as institute State preview image) spatial resolution it is corresponding with the distribution of the sub-lens of the lenslet arrays, each sub-lens correspond to it is described at As a certain imaging unit in cell array, each imaging unit includes the multiple pixels of array distribution, is remembered by the imaging unit The sub-lens are recorded to the light information of the different directions in certain portion from the scene, that is, in the light-field camera, the preview There are corresponding relationships, the lenslet arrays between the sub-lens distribution of the pixel distribution of image and the lenslet arrays There are corresponding relationships for imaging unit in sub-lens and the imaging unit array, therefore, can be obtained according to the light-field camera The scene preview image in part corresponding with the depth distribution sub-district, determining influences the depth distribution sub-district figure As the first sub-lens of acquisition, further according to the imaging unit of sub-lens and the imaging unit array in the lenslet arrays Between corresponding relationship, determine corresponding with first sub-lens first imaging unit.Using described in program determination To inclined first imaging unit in imaging unit array, method is simply easily realized.(2) provided by the embodiments of the present application It, can be according to the condition of convergence for reducing corresponding averagely blur circle (even less than or equal to allow blur circle), to institute in technical solution It states the first imaging unit and first sub-lens and carries out inclination control respectively with respect to the plane parallel with the main lens, realize Mode is very flexible.

Optionally, the opposite plane parallel with the main lens tilts first imaging unit and the first sub-lens, with Reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit, comprising: according to institute State the focal lengths of the first sub-lens, the object in the depth distribution sub-district through where main lens imaging plane and with it is described The optical center of angle, first sub-lens between the parallel plane of main lens is through plane vertically parallel with the main lens Distance and first son of the direction to the object in the depth distribution sub-district through the plane where main lens imaging The optical center of lens is at a distance from the direction to first imaging unit of the vertical plane parallel with main lens, described in determination Second tilt angle of the first tilt angle of the first imaging unit and first sub-lens；According to first tilt angle The opposite plane parallel with the main lens tilt first imaging unit and according to second tilt angle it is opposite with The parallel plane of the main lens tilts first sub-lens, to reduce the object in the depth distribution sub-district described the The average blur circle being imaged on one imaging unit.

In light-field camera, after first imaging unit and first sub-lens tilt respectively, first imaging Plane where unit may be no longer parallel with the plane where first sub-lens.With reference to husky nurse law, when the depth It is flat where after the elongated surfaces of the plane where main lens imaging, first sub-lens inclination to be distributed the object in sub-district The elongated surfaces of plane where after the elongated surfaces in face, first imaging unit inclination, when three mutually gives line always, such as Fig. 6 institute Show, the region that the object in the depth distribution sub-district can get blur-free imaging is maximum, under the situation, object through main lens institute at Be equivalent to a focal plane as the plane at place, object is minimum in the average blur circle that first imaging unit is imaged.It is full The tilt angle of first imaging unit of the above-mentioned law of foot is the first tilt angle described in the embodiment of the present application, is met The tilt angle of first sub-lens of above-mentioned law is the second tilt angle described in the embodiment of the present application.

It in practical applications, can be using the plane vertical with the average normal direction of the depth distribution sub-district as the depth Plane in degree distribution sub-district where object.When the object in the depth distribution sub-district is through flat where main lens imaging It is flat where after the elongated surfaces of plane, first imaging unit inclination where after the elongated surfaces in face, first sub-lens inclination The elongated surfaces in face, when three mutually gives line always, object is minimum in the average blur circle that first imaging unit is imaged.

After first imaging unit and first sub-lens inclination, the object of the depth distribution sub-district is hanked As optical path example as shown in fig. 6, according to Fig. 6 following relationship can be obtained:

V=v₁+v₂...........................................(6)

According to the angular relationship in optical path shown in formula (4) to (9) and Fig. 6, can obtain:

Wherein: α indicates the first inclination angle of first imaging unit；β indicates the second inclination of first sub-lens Angle；F indicates the focal length of the first sub-lens；Indicate the object in depth distribution sub-district through the plane where main lens imaging Angle between the plane (plane such as described first sub-lens inclination before where) parallel with the main lens；U indicates institute The optical center for stating the first sub-lens is (flat where before such as described first sub-lens inclination through plane vertically parallel with the main lens Face) direction to distance of the object through the plane where main lens imaging in the depth distribution sub-district；Described in v expression The plane parallel with main lens described in the optical center edge of first sub-lens is vertical (plane at the preceding place of such as the first sub-lens inclination, or Person, the plane where before first imaging unit inclination) direction to first imaging unit distance, such as described the The optical center of one sub-lens inclination front and back remains unchanged, the center of first imaging unit inclination front and back remains unchanged, then described The distance between the center of the optical center of first sub-lens and first imaging unit, the optical center edge of as described first sub-lens At a distance from the direction to first imaging unit of the vertical plane parallel with main lens.

The first inclination angle and the second inclination angle determined according to the program tilts first imaging unit and described respectively First sub-lens, and when carrying out Image Acquisition under the light-field camera is in the heeling condition, in the depth distribution sub-district The average blur circle that is imaged in first imaging unit of object it is as small as possible.The program improves first imaging unit With the efficiency of the common inclination control of the first sub-lens, and it is adjusted after light-field camera carry out Image Acquisition can get scene More big imaging quality preferably or blur-free imaging depth bounds.

Before tilting first imaging unit and first sub-lens, it may also include that in the lenslet arrays Middle determination is determined to inclined first sub-lens and in the imaging unit array to inclined first imaging unit.Its In, the method for determination to inclined first sub-lens and first imaging unit is very flexible, for example, light-field camera In, there are corresponding relationships, described between the sub-lens distribution of the pixel distribution of the preview image and the lenslet arrays There are corresponding relationships for imaging unit in the sub-lens of lenslet arrays and the imaging unit array, therefore, can be according to described Part corresponding with the depth distribution sub-district in the preview image for the scene that light-field camera obtains, determining influences the depth Degree distribution sub-district Image Acquisition the first sub-lens, further according in the lenslet arrays sub-lens and the imaging unit battle array Corresponding relationship between the imaging unit of column determines first imaging unit corresponding with first sub-lens.Using this Scheme determine in the lenslet arrays in inclined first sub-lens and the imaging unit array to inclined first Imaging unit, method are simply easily realized.

It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and Any restriction should not be constituted to the implementation process of the application specific embodiment.

Fig. 7 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application.As shown in fig. 7, this The first Image Acquisition control device that application embodiment provides includes: a depth distribution sub-district determining module 71, one inclination control Molding block 72 and an image capture module 73.

Depth distribution sub-district determining module 71 is used to be determined according to the field depth of light-field camera and the depth distribution of scene An at least depth distribution sub-district for the scene, each depth distribution sub-district is located at described in an at least depth distribution sub-district Except field depth.

Tilt control module 72 at least tilted relative to the plane parallel with the main lens of the light-field camera first at As unit, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit, In, first imaging unit is in the imaging unit array of the light-field camera for carrying out figure to the depth distribution sub-district As the imaging unit of acquisition.

Image capture module 73 carries out Image Acquisition to the scene for the light-field camera after adjusted.

The equipment form of expression of described image acquisition control device is unrestricted, such as described image acquisition control device can For a certain independent component；Alternatively, described image acquisition control device, which can be used as a certain functional module, is integrated in an imaging device In, the imaging device may include but be not limited to light-field camera or include the mobile phone of light-field camera, tablet computer etc., the application Embodiment is not intended to limit this.

Optionally, after at least tilting first imaging unit, the object in the depth distribution sub-district is described The average blur circle being imaged on one imaging unit is less than or equal to one and allows blur circle.It is described that blur circle is allowed to be used to characterize naked eyes The imaging of object point on object can be considered as to the size of the blur circle of focus imaging.The program is equivalent in the respective element (phase Answer element include first imaging unit or the respective element include first imaging unit and it is described first son thoroughly Mirror) during inclination control, using the average blur circle after respective element inclination be less than or equal to one allow blur circle as The condition of convergence of the respective element inclination control, that is to say, that during the respective element inclination control, if described The average blur circle that respective element is located under certain heeling condition and the corresponding heeling condition allows blur circle described in being less than or equal to, The then inclination control of the achievable respective element.As it can be seen that carrying out the inclination control of the respective element using the program, quite In make at least depth sub-district except the field depth of scene be adjusted to can blur-free imaging range, to a certain extent quite In increasing the original field depth of light-field camera, the general image acquisition quality of scene is improved, in some cases, even Be conducive to the Image Acquisition for carrying out panorama depth to scene, more preferably meet diversified practical application request.Optionally, it is described at least At least one of one depth distribution sub-district and the field depth depth consecutive variations.The program is conducive to raising scene and is located at scape The image quality of the object on deep range periphery is equivalent to and is continuously extended in the depth direction to original field depth. In certain application scenarios, microshot scene is carried out for example, by using large aperture, it is larger that scene is help to obtain using the program The blur-free imaging of depth successive range in the case of scene depth narrow distribution, or even can realize the full depth map of large aperture As acquisition.

Optionally, described at least at least one of depth distribution sub-district and the discontinuous variation of field depth depth. The program is conducive to improve the image quality for at least partly object that scene is located at except field depth, is equivalent to original scape Adjust the preferable depth sub-district of some image quality on the basis of deep range again in the depth direction.In certain application scenarios, Such as multiple objects are distributed in the different depth position (such as face) of scene along depth direction, wherein certain an object is located at the depth of field In range, and other objects are located at except field depth, using the program be conducive to improve scene in different depth position it is more The image quality of a object.

Optionally, as shown in figure 8, the tilt control module 72 includes: one first inclination control submodule 721.First It is single that inclination control submodule 721 is used for the opposite plane inclination parallel with the main lens of the light-field camera first imaging Member, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit.The program It can be single to first imaging according to the condition of convergence for reducing corresponding averagely blur circle (even less than or equal to allow blur circle) The opposite plane parallel with the main lens of member carries out inclination control, and implementation is very flexible.

Further alternative, the first inclination control submodule 721 includes: an inclined direction determination unit 7211 and one First tilt control unit 7212.Inclined direction determination unit 7211 is to increase for determining inclined direction, the inclined direction Object in the depth distribution sub-district is through between the plane where the main lens imaging and first imaging unit Angle direction；First tilt control unit 7212 is used for single according at least to inclined direction inclination first imaging Member, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit.

Optionally, the first inclination control submodule 721 includes: an expectation tilt angle determining unit 7213 and one Two tilt control units 7214.It is expected that tilt angle determining unit 7213 is for the focal length according to the first sub-lens, the depth Be distributed sub-district in object through between the plane and the plane parallel with the main lens where main lens imaging angle, And the optical center of first sub-lens is through the direction of plane vertically parallel with the main lens to the depth distribution sub-district Distance of the interior object through the plane where the main lens imaging, determines the expectation inclination angle of first imaging unit Degree, wherein first sub-lens are son corresponding with first imaging unit in the lenslet arrays of the light-field camera Lens；Second tilt control unit 7214 is used to put down according at least to the expectation tilt angle is opposite parallel with the main lens Face tilts first imaging unit, is imaged with reducing the object in the depth distribution sub-district on first imaging unit Average blur circle.The efficiency of the first imaging unit inclination control can be improved using the program, so that first imaging The inclination control of unit meets the condition of convergence of average blur circle as early as possible.

Optionally, the first inclination control submodule 721 includes: to allow angular range determination unit 7215 and one Three tilt control units 7216.Allow angular range determination unit 7215 for determine first imaging unit it is opposite with it is described The parallel plane of main lens allows angular range；Third tilt control unit 7216 is used to allow angle model according at least to described It encloses the opposite plane parallel with the main lens and tilts first imaging unit, to reduce pair in the depth distribution sub-district As the average blur circle being imaged on first imaging unit.The program improves the first imaging unit inclination control Efficiency, and it is adjusted after light-field camera carry out Image Acquisition can get scene more big imaging quality preferably or blur-free imaging depth Spend range.Further, first imaging unit can be tilted according to the expectation tilt angle and the inclined direction, thus into One step improves the efficiency of the first imaging unit inclination control.

Further alternative, described to allow angular range determination unit 7215 include: that an expectation tilt angle determines that son is single Member 72151 and one allows angular range to determine subelement 72152.It is expected that tilt angle determines subelement 72151 for according to the Object in the focal length of one sub-lens, the depth distribution sub-district is saturating through the plane where main lens imaging and with the master The optical center of angle and first sub-lens between the parallel plane of mirror is through plane vertically parallel with the main lens Distance of the direction to the object in the depth distribution sub-district through the plane where the main lens imaging determines described The expectation tilt angle of one imaging unit, wherein first sub-lens in the lenslet arrays of the light-field camera with institute State the corresponding sub-lens of the first imaging unit；Angular range is allowed to determine subelement 72152 for according to the expectation inclination angle Degree allows angular range described in determining.The program improves the efficiency of the first imaging unit inclination control, and it is adjusted after Light-field camera carry out Image Acquisition can get scene more big imaging quality preferably or blur-free imaging depth bounds.Further, Angular range and the inclined direction can be allowed to tilt first imaging unit according to described, thus further increase described the The efficiency of one imaging unit inclination control.

Optionally, the tilt control module 72 includes: one second inclination control submodule 722.Second inclination control Module 722 is used for the opposite plane parallel with the main lens and tilts first imaging unit and the first sub-lens, to reduce The average blur circle that object in the depth distribution sub-district is imaged on first imaging unit, wherein first son Lens are sub-lens corresponding with first imaging unit in the lenslet arrays of the light-field camera.The program can be according to subtracting The condition of convergence of small corresponding averagely blur circle (even less than or equal to allow blur circle), to first imaging unit and described First sub-lens carry out inclination control with respect to the plane parallel with the main lens respectively, and implementation is very flexible.

Further alternative, the second inclination control submodule 722 includes: a tilt angle determining unit 7221 and one 4th tilt control unit 7222.Tilt angle determining unit 7221 is for the focal length according to first sub-lens, the depth Object in degree distribution sub-district is through the folder between the plane and the plane parallel with the main lens where main lens imaging Angle, first sub-lens optical center through in the direction of plane vertically parallel with the main lens to the depth distribution sub-district Distance and first sub-lens of the object through the plane where main lens imaging optical center along it is vertical described with it is main The direction of the parallel plane of lens determines the first inclination angle of first imaging unit to the distance of first imaging unit Second tilt angle of degree and first sub-lens；4th tilt control unit 7222 is used for according to first tilt angle The opposite plane parallel with the main lens tilt first imaging unit and according to second tilt angle it is opposite with The parallel plane of the main lens tilts first sub-lens, to reduce the object in the depth distribution sub-district described the The average blur circle being imaged on one imaging unit.The program improves first imaging unit and first sub-lens are common The efficiency of inclination control, and it is adjusted after light-field camera carry out Image Acquisition to can get scene more big imaging quality preferably or clear The depth bounds of clear imaging.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described image acquisition control Device further include: an imaging unit determining module 74.Imaging unit determining module 74 is for determining in the imaging unit array To inclined first imaging unit.It can be determined in the imaging unit array of light-field camera for described using the program Depth distribution sub-district carries out the imaging unit of Image Acquisition, and as to inclined first imaging unit, passing through later will be true The opposite plane parallel with the main lens of first imaging unit made carries out tilt adjustments, so that the depth distribution The average blur circle that object in sub-district is imaged on first imaging unit is reduced, and the depth distribution is thus improved The image quality of sub-district.

Further alternative, the imaging unit determining module 74 includes: that a sub-lens determination unit 741 and an imaging are single First determination unit 742.In the preview image for the scene that sub-lens determination unit 741 is used to be obtained according to the light-field camera Part corresponding with the depth distribution sub-district determines the first sub-lens for influencing the depth distribution sub-district Image Acquisition；At As unit determination unit 742 is used for the imaging unit according to sub-lens and the imaging unit array in the lenslet arrays Between corresponding relationship, determine corresponding with first sub-lens first imaging unit.Using described in program determination In lenslet arrays in inclined first sub-lens and the imaging unit array to inclined first imaging unit, method It is simple easily to realize.

Fig. 9 is the structural schematic diagram of the third Image Acquisition control device provided by the embodiments of the present application, and the application is specific Embodiment does not limit the specific implementation of Image Acquisition control device 900.As shown in figure 9, Image Acquisition control dress Setting 900 may include:

Processor (Processor) 910,920, memory communication interface (Communications Interface) (Memory) 930 and communication bus 940.Wherein:

Processor 910, communication interface 920 and memory 930 complete mutual communication by communication bus 940.

Communication interface 920, for being communicated with such as deformable imaging sensor etc..

Processor 910 can specifically execute the correlation step in any of the above-described embodiment of the method for executing program 932.

For example, program 932 may include program code, said program code includes computer operation instruction.

Processor 910 may be a central processing unit (Central Processing Unit, abbreviation CPU), either Specific integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or be arranged to Implement one or more integrated circuits of the embodiment of the present application.

Memory 930, for storing program 932.Memory 930 may include random access memory (Random Access Memory, abbreviation RAM), it is also possible to it further include nonvolatile memory (Non-volatile memory), such as extremely A few magnetic disk storage.

For example, in an optional implementation manner, following steps can be performed by executing program 932 in processor 910: root According to the field depth of light-field camera and the depth distribution of scene, determine an at least depth distribution sub-district for the scene, it is described extremely Each depth distribution sub-district is located at except the field depth in a few depth distribution sub-district；The opposite master with the light-field camera The parallel plane of lens at least tilts the first imaging unit, to reduce the object in the depth distribution sub-district the first one-tenth described As the average blur circle being imaged on unit, wherein first imaging unit is in the imaging unit array of the light-field camera For carrying out the imaging unit of Image Acquisition to the depth distribution sub-district；The light-field camera after adjusted is to the scene Carry out Image Acquisition.

In other optional implementations, processor 910 can also carry out other above-mentioned any realities by executing program 932 The step of example refers to is applied, details are not described herein.

In program 932 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule, Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment Description, details are not described herein.

In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality Apply the superiority and inferiority of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to The record of correlation method embodiment, details are not described herein.

Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.

It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps. And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), deposits at random Various Jie that can store program code such as access to memory (Random Access Memory, abbreviation RAM), magnetic or disk Matter.

In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again Combination nova should be regarded as the equivalent scheme of the application.Meanwhile in the description above to the application specific embodiment, for a kind of reality The feature that the mode of applying is described and/or shown can be made in one or more other embodiments in a manner of same or similar With, be combined with the feature in other embodiment, or substitution other embodiment in feature.

It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when using herein, but simultaneously It is not excluded for the presence or additional of one or more other features, element, step or component.

Finally, it should be noted that embodiment of above is merely to illustrate the application, and it is not the limitation to the application, it is related The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be by right It is required that limiting.

Claims

1. a kind of Image Acquisition control method characterized by comprising

According to the depth distribution of the field depth of light-field camera and scene, an at least depth distribution sub-district for the scene is determined, Each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district；

The opposite plane parallel with the main lens of the light-field camera at least tilts the first imaging unit, to reduce the depth point The average blur circle that object in cloth sub-district is imaged on first imaging unit, wherein first imaging unit is institute It states in the imaging unit array of light-field camera for carrying out the imaging unit of Image Acquisition to the depth distribution sub-district；

2. the method according to claim 1, wherein after at least tilting first imaging unit, the depth The average blur circle that object in degree distribution sub-district is imaged on first imaging unit is less than or equal to one and allows blur circle.

3. method according to claim 1 or 2, which is characterized in that described at least at least one of depth distribution sub-district With the field depth depth consecutive variations.

4. method according to claim 1 or 2, which is characterized in that described at least at least one of depth distribution sub-district With the discontinuous variation of field depth depth.

5. the method according to claim 1, wherein the opposite plane parallel with the main lens of the light-field camera The first imaging unit is at least tilted, is imaged on first imaging unit with to reduce the object in the depth distribution sub-district Average blur circle, comprising:

The opposite plane parallel with main lens tilts first imaging unit, to reduce the object in the depth distribution sub-district The average blur circle being imaged on first imaging unit.

6. a kind of Image Acquisition control device characterized by comprising

One depth distribution sub-district determining module, for determining institute according to the field depth of light-field camera and the depth distribution of scene An at least depth distribution sub-district for scene is stated, each depth distribution sub-district is located at the scape in an at least depth distribution sub-district Except deep range；

It is single at least to tilt the first imaging for the opposite plane parallel with the main lens of the light-field camera for one tilt control module Member, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on first imaging unit, wherein institute It states in the imaging unit array that the first imaging unit is the light-field camera and is adopted for carrying out image to the depth distribution sub-district The imaging unit of collection；

7. device according to claim 6, which is characterized in that after at least tilting first imaging unit, the depth The average blur circle that object in degree distribution sub-district is imaged on first imaging unit is less than or equal to one and allows blur circle.

8. device according to claim 6 or 7, which is characterized in that described at least at least one of depth distribution sub-district With the field depth depth consecutive variations.

9. device according to claim 6 or 7, which is characterized in that described at least at least one of depth distribution sub-district With the discontinuous variation of field depth depth.

10. a kind of Image Acquisition control device, which is characterized in that

One processor, a communication interface, a memory and a communication bus；The processor, the communication interface and institute It states memory and completes mutual communication by the communication bus；