CN106303209B - Image Acquisition control method and device - Google Patents
Image Acquisition control method and device Download PDFInfo
- Publication number
- CN106303209B CN106303209B CN201510546054.2A CN201510546054A CN106303209B CN 106303209 B CN106303209 B CN 106303209B CN 201510546054 A CN201510546054 A CN 201510546054A CN 106303209 B CN106303209 B CN 106303209B
- Authority
- CN
- China
- Prior art keywords
- sub
- lens
- district
- depth distribution
- image acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Studio Devices (AREA)
- Exposure Control For Cameras (AREA)
Abstract
This application discloses a kind of Image Acquisition control method and devices, which comprises the partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;The imaging surface of opposite light-field camera tilts the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, wherein: first sub-lens be the light-field camera lenslet arrays in influence the sub-lens of the first depth distribution sub-district Image Acquisition, the first part is the part for being located at the first depth distribution sub-district in the scene, and first imaging region is imaging surface imaging region corresponding with first sub-lens;The light-field camera after adjusted carries out Image Acquisition to the scene.The application is advantageously implemented the customization Image Acquisition that the depth distribution sub-district compared with high imaging quality is needed in scene, can more preferably meet diversified Image Acquisition application demand.
Description
Technical field
This application involves a kind of field of terminal technology, more particularly to a kind of Image Acquisition control method and device.
Background technique
With the continuous development of image acquisition technology, the equipment for supporting Image Acquisition is continued to introduce new, and people are to acquisition
The individual demand of image is also more and more.
Different from traditional camera, light-field camera is usually that a son is placed between main lens and such as CCD imaging sensor
Lens array is remembered the field information of scene different directions by lenslet arrays on the focal plane of lenslet arrays
Record can recorde the four-dimensional field information such as space, visual angle of three-dimensional scenic by single exposure, support " first shooting back focusing ",
Image effect abundant can be generated by handling the image after shooting, such as number focusing, visual angle again can be met
A variety of imaging applications such as variation, depth image, three-dimensionalreconstruction.Currently, the research of the image acquisition technology based on light-field camera is drawn
Insider is played widely to pay close attention to further.
Summary of the invention
The brief overview about the application is given below, in order to provide the basic of some aspects about the application
Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application
Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form,
Taking this as a prelude to a more detailed description discussed later.
The embodiment of the present application provides a kind of Image Acquisition control method and device.
In a first aspect, the embodiment of the present application provides a kind of Image Acquisition control method, comprising:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, is imaged with reducing first part on the first imaging region
Average blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth
The sub-lens of sub-district Image Acquisition are distributed, the first part is the portion for being located at the first depth distribution sub-district in the scene
Point, first imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the office of the determining scene
Portion's depth distribution sub-district is the first depth distribution sub-district, comprising: the depth distribution sub-district for determining first part in the scene is
The first depth distribution sub-district.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first depth distribution
Sub-district is a subset of the field depth of the light-field camera.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, it is adjusted after the light
Camera carries out the scene before Image Acquisition, further includes: the relatively described imaging surface tilts the second sub-lens, to increase the
The average blur circle that two parts are imaged on the second imaging region, in which: second sub-lens are in the lenslet arrays
Influence the sub-lens of the second depth distribution sub-district Image Acquisition, the second depth distribution sub-district and first depth distribution
Area is different, and the second part is the part for being located at the second depth distribution sub-district in the scene, second imaging area
Domain is imaging surface imaging region corresponding with second sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, second depth distribution
Sub-district is other depth distribution sub-districts of the field depth in addition to the first depth distribution sub-district.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the first sub-lens phase
After imaging surface inclination, the average blur circle that the first part is imaged on first imaging region is less than or waits
Blur circle is allowed in one.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the opposite light-field camera
Imaging surface tilt the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, comprising: root
According to the distance between the focal length of first sub-lens, the optical center of first sub-lens and described imaging surface and described
A part determines described the through the angle where the main lens imaging of the light-field camera between plane and the imaging surface
The expectation tilt angle of one sub-lens;Thoroughly according at least to relatively described imaging surface inclination first son of the expectation tilt angle
Mirror, to reduce the average blur circle that the first part is imaged on first imaging region.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the opposite light-field camera
Imaging surface tilt the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, comprising: really
The relatively described imaging surface of optical axis of fixed first sub-lens allows angular range;Angular range phase is allowed according at least to described
First sub-lens are tilted to the imaging surface, with reduce the first part be imaged on first imaging region it is flat
Equal blur circle.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first son is determined thoroughly
The relatively described imaging surface of the optical axis of mirror allows angular range, comprising: according to the focal length of first sub-lens, first son
Formed by the main lens of the distance between the optical center of lens and the imaging surface and the first part through the light-field camera
As the angle between place plane and the imaging surface, the expectation tilt angle of first sub-lens is determined;According to the phase
Tilt angle is hoped to allow angular range described in determining.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the opposite light-field camera
Imaging surface tilt the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, comprising: phase
To the imaging surface along reducing the first part through plane where the main lens imaging of the light-field camera and described the
The direction of angle between plane where one sub-lens tilts first sub-lens, to reduce the first part described the
The average blur circle being imaged on one imaging region.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, relative to light-field camera at
Image planes tilt before the first sub-lens, further includes: determine in the lenslet arrays to inclined first sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the sub-lens battle array is determined
To inclined first sub-lens in column, comprising: determine in the lenslet arrays, with the light-field camera obtain described in
The corresponding sub-lens in corresponding with the first depth distribution sub-district part in the preview image of scene, for inclined described
One sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the second sub-lens phase
After imaging surface inclination, the average blur circle that the second part is imaged on second imaging region is greater than one and holds
Perhaps blur circle.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the relatively described imaging surface inclines
Oblique second sub-lens, the average blur circle being imaged with increasing second part on the second imaging region, comprising: the relatively described imaging
Face is along the increase second part through plane and the second sub-lens institute where the main lens imaging of the light-field camera
The direction of angle between plane tilts second sub-lens, to increase the second part in second imaging region
The average blur circle of upper imaging.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, relative to light-field camera at
Image planes tilt before the second sub-lens, further includes: determine in the lenslet arrays to inclined second sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the sub-lens battle array is determined
To inclined second sub-lens in column, comprising: determine in the lenslet arrays, with the light-field camera obtain described in
The corresponding sub-lens in corresponding with the second depth distribution sub-district part in the preview image of scene, for inclined described
Two sub-lens.
Second aspect, the embodiment of the present application also provides a kind of Image Acquisition control devices, comprising:
One first depth distribution sub-district determining module, for determining that the partial-depth of scene is distributed sub-district for the first depth point
Cloth sub-district;
One first sub-lens tilt control module, the imaging surface for opposite light-field camera tilts the first sub-lens, to subtract
The average blur circle that small first part is imaged on the first imaging region, in which: first sub-lens are the light-field camera
Lenslet arrays in influence the sub-lens of the first depth distribution sub-district Image Acquisition, the first part is the scene
In be located at the part of the first depth distribution sub-district, first imaging region is the imaging surface and first sub-lens
Corresponding imaging region;
One Image Acquisition control module carries out Image Acquisition to the scene for the light-field camera after adjusted.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first depth distribution
Sub-district determining module includes: that one first depth distribution sub-district determines submodule, for determining the depth of first part in the scene
Degree distribution sub-district is the first depth distribution sub-district.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first depth distribution
Sub-district is a subset of the field depth of the light-field camera.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one
Second sub-lens tilt control module tilts the second sub-lens for the relatively described imaging surface, to increase second part second
The average blur circle being imaged on imaging region, in which: second sub-lens are to influence the second depth in the lenslet arrays
The sub-lens of sub-district Image Acquisition are distributed, the second depth distribution sub-district is different from the first depth distribution sub-district, described
Second part is the part for being located at the second depth distribution sub-district in the scene, and second imaging region is the imaging
Face imaging region corresponding with second sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second depth distribution
Sub-district is other depth distribution sub-districts of the field depth in addition to the first depth distribution sub-district.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the first sub-lens phase
After imaging surface inclination, the average blur circle that the first part is imaged on first imaging region is less than or waits
Blur circle is allowed in one.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens incline
Oblique control module includes: that an expectation tilt angle determines submodule, for according to the focal lengths of first sub-lens, described first
The main lens institute of the distance between the optical center of sub-lens and the imaging surface and the first part through the light-field camera at
As the angle between place plane and the imaging surface, determine the expectation tilt angle of first sub-lens;One angle is inclined
Oblique control submodule, for tilting first sub-lens according at least to the relatively described imaging surface of the expectation tilt angle, with
Reduce the average blur circle that the first part is imaged on first imaging region.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens incline
Oblique control module includes: that angular range is allowed to determine submodule, and the optical axis for determining first sub-lens is relatively described
Imaging surface allows angular range;
One angular range inclination control submodule, for allowing the relatively described imaging surface of angular range to incline according at least to described
Oblique first sub-lens, to reduce the average blur circle that the first part is imaged on first imaging region.
It is optionally, described to allow angular range in conjunction with any Image Acquisition control device provided by the embodiments of the present application
Determine that submodule includes: an expectation tilt angle determining unit, for focal length, first son according to first sub-lens
Formed by the main lens of the distance between the optical center of lens and the imaging surface and the first part through the light-field camera
As the angle between place plane and the imaging surface, the expectation tilt angle of first sub-lens is determined;One allows angle
Range determination unit, for allowing angular range according to expectation tilt angle determination.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens incline
Oblique control module includes: one first sub-lens inclination control submodule, for the relatively described imaging surface described first along reduction
Angle where plane where the main lens imaging of light-field camera described in lease making and first sub-lens between plane
Direction tilts first sub-lens, to reduce the average disperse that the first part is imaged on first imaging region
Circle.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one
First sub-lens determining module, for determining in the lenslet arrays to inclined first sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens are true
Cover half block includes: that one first sub-lens determine submodule, for determining in the lenslet arrays, is obtained with the light-field camera
The scene preview image in the corresponding sub-lens in corresponding with the first depth distribution sub-district part, for inclined
First sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the second sub-lens phase
After imaging surface inclination, the average blur circle that the second part is imaged on second imaging region is greater than one and holds
Perhaps blur circle.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second sub-lens incline
Oblique control module includes: one second sub-lens inclination control submodule, for the relatively described imaging surface described second along increase
Angle where plane where the main lens imaging of light-field camera described in lease making and second sub-lens between plane
Direction tilts second sub-lens, to increase the average disperse that the second part is imaged on second imaging region
Circle.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one
Second sub-lens determining module, for determining in the lenslet arrays to inclined second sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second sub-lens are true
Cover half block includes: that one second sub-lens determine submodule, for determining in the lenslet arrays, is obtained with the light-field camera
The scene preview image in the corresponding sub-lens in corresponding with the second depth distribution sub-district part, for inclined
Second sub-lens.
The third aspect, the embodiment of the present application also provides another Image Acquisition control devices, comprising:
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface with
And the memory completes mutual communication by the communication bus;
The memory is for storing at least one instruction;Described instruction makes the processor execute following operation:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, is imaged with reducing first part on the first imaging region
Average blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth
The sub-lens of sub-district Image Acquisition are distributed, the first part is the portion for being located at the first depth distribution sub-district in the scene
Point, first imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
Technical solution provided by the embodiments of the present application can determine partial-depth distribution sub-district (i.e. " the first depth point of scene
Cloth sub-district "), pass through the side of the sub-lens (i.e. " the first sub-lens ") of the first depth distribution sub-district Image Acquisition described in obliquity effects
Formula, so that the part (i.e. " first part ") in the scene positioned at the first depth distribution sub-district is in the light-field camera
The size for the average blur circle being imaged on imaging region (i.e. " the first imaging region ") corresponding with first sub-lens is
Reduce, thus improves the image quality of the first part.Since the first depth distribution sub-district can according to actual needs really
It is fixed, and can be improved by way of corresponding first sub-lens of inclination light-field camera corresponding to the first depth distribution sub-district the
A part carries out the image quality of optically detecting, and therefore, technical solution provided by the embodiments of the present application is advantageously implemented in scene
The customization Image Acquisition of the depth distribution sub-district compared with high imaging quality is needed, diversified Image Acquisition application can be more preferably met
Demand.
By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application
Advantage will be apparent from.
Detailed description of the invention
The application can be by reference to being better understood, wherein in institute below in association with description given by attached drawing
Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following
It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated
The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings:
Fig. 1 is a kind of Image Acquisition control method flow chart provided by the embodiments of the present application;
Fig. 2 a is that part sub-lens provided by the embodiments of the present application tilt example one;
Fig. 2 b is that part sub-lens provided by the embodiments of the present application tilt example two;
Fig. 3 is that the example of each depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep
It spends continuously distributed;
Fig. 4 a is that the elongated surfaces of relevant three planes of husky nurse law provided by the embodiments of the present application intersect example one;
Fig. 4 b is that the elongated surfaces of relevant three planes of husky nurse law provided by the embodiments of the present application intersect example two;
Fig. 5 is the first sub-lens inclined direction example provided by the embodiments of the present application;
Fig. 6 is light-field camera topology example provided by the embodiments of the present application;
Fig. 7 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application;
Fig. 8 is the logic diagram of second of Image Acquisition control device provided by the embodiments of the present application;
Fig. 9 is the logic diagram of the third Image Acquisition control device provided by the embodiments of the present application;
Figure 10 is the logic diagram of the 4th kind of Image Acquisition control device provided by the embodiments of the present application.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear,
And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with
Just the understanding to the embodiment of the present application is helped to improve.
Specific embodiment
It is described in detail hereinafter in connection with exemplary embodiment of the attached drawing to the application.It rises for clarity and conciseness
See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality
Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example
Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not
It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from
For those skilled in the art of present disclosure, this development is only routine task.
Here, also it should be noted is that, in order to avoid having obscured the application because of unnecessary details, in attached drawing and
It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair
With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.
(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application
Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous
Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.
Fig. 1 is a kind of flow chart of Image Acquisition control method provided by the embodiments of the present application.The embodiment of the present application provides
The executing subject of Image Acquisition control method can be a certain Image Acquisition control device.Described image acquisition control device is set
The standby form of expression is unrestricted, such as described image acquisition control device can be a certain independent component;Alternatively, described image is adopted
Collection control device can be used as a certain functional module and be integrated in an imaging device, and the imaging device may include but be not limited to light field
Camera includes the mobile phone of light-field camera, tablet computer etc., and the embodiment of the present application is not intended to limit this.It is specific as shown in Figure 1,
A kind of Image Acquisition control method provided by the embodiments of the present application includes:
S101: the partial-depth distribution sub-district for determining scene is the first depth distribution sub-district.
S102: the imaging surface of opposite light-field camera tilts the first sub-lens, to reduce first part in the first imaging region
The average blur circle of upper imaging, in which: first sub-lens be the light-field camera lenslet arrays in influence described the
The sub-lens of one depth distribution sub-district Image Acquisition, the first part are to be located at the first depth distribution in the scene
The part in area, first imaging region are imaging surface imaging region corresponding with first sub-lens.
S103: the light-field camera after adjusted carries out Image Acquisition to the scene.
Object through such as light-field camera imaging device is imaged when, be ideally object plane and image planes be point with put one
One is corresponding, but in actual application, due to the influence of the factors such as light wave property, aberration, the imaging of the point on object
Beam generally can not converge at a bit, but the circular spread, ellipse or other similar rounds are formed on as plane
Projection, referred to as blur circle (circle of confusion), alternatively referred to as figure of confusion, dispersion ring, circle of confusion, the circle of confusion, scattering
Disk etc..If the size of blur circle is smaller, the imaging of the corresponding object of the usual blur circle is comparatively clear, visually can quilt
It is considered as the focus imaging of the point;Correspondingly, the blur circle is corresponding if the size of blur circle is more than certain permissible range
The imaging Relative Fuzzy of object.
In general, light-field camera includes the main lens, lenslet arrays and imaging sensor set gradually along depth direction.Light
When field camera is in the states of tilt operations such as the sub-lens for not carrying out that the embodiment of the present application refers to, the sub-lens battle array of light-field camera
Each sub-lens are usually located at the same plane perpendicular to depth direction in column, and the optical axis of each sub-lens is parallel with depth direction, figure
Plane as where sensor is the imaging surface of light-field camera, the imaging surface be parallel to the plane where lenslet arrays and this at
Image planes vertical depth direction.According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens to master
Lens imaging (such as real image or the virtual image) reimaging on the corresponding imaging region of the sub-lens, the different positions on imaging region
The pixel set can store the field information of the object of different depth in scene, corresponding in scene certain object it is at least local
The blur circle being imaged through a certain sub-lens in certain pixel of imaging sensor are as follows:
In above formula: the equivalent diameter of c expression blur circle;F indicates the focal length of the sub-lens;V indicates at least office of the object
Successively for imaging at a distance from the sub-lens center, which is equivalent to the sub-lens after main lens and the sub-lens in portion
Image distance;vnIndicate the distance between lenslet arrays plane and image sensor plane;N indicates f-number (f-number).
Based on light-field camera carry out Image Acquisition application scenarios in, usual imaging sensor it is corresponding with the sub-lens at
As region includes the pixel of multiple array distributions, not all pixels point of the imaging region participates in actual Image Acquisition,
But partial pixel point participates in actual Image Acquisition, physical record has each pixel of the object images information in imaging region
Blur circle mean value, can be considered the object in the size of the average blur circle of the imaging region.It, should before and after sub-lens inclination
Imaging region participates in the pixel of the object actual image acquisition and/or pixel quantity may be identical or different.It can be by the son
Physical record has the mean value of the blur circle of each pixel of the object images information in the imaging region before lens tilt, as this
The size of average blur circle before sub-lens inclination;Physical record in the imaging region after sub-lens inclination there is into the object
The mean value of the blur circle of each pixel of image information, the size as the average blur circle after sub-lens inclination.
Each sub-lens can be considered a thin lens in the lenslet arrays of light-field camera, and the Optical Formula of thin lens is such as
Under:
In above formula: u indicates the object distance of sub-lens, i.e. main lens imaging of the object through light-field camera and the sub-lens
Distance;The image distance of v expression sub-lens;The focal length of f expression sub-lens.
In conjunction with formula (1) and (2) it is found that the embodiment of the present application can change sub-lens by way of tilting sub-lens
Object distance u causes the change of corresponding blur circle to cause the image distance v of sub-lens that corresponding change occurs, meanwhile, sub-lens are inclined
The average blur circle that average blur circle after tiltedly is less than before sub-lens inclination makes as the condition of convergence of sub-lens inclination control
Sub-lens with respect to imaging surface adopt by some way inclination after can reach accordingly averagely blur circle with respect to sub-lens tilt before
Corresponding average blur circle is reduced.
As it can be seen that the embodiment of the present application can determine that the partial-depth distribution sub-district of scene (might as well be known as " the first depth distribution
Area "), pass through the sub-lens of the first depth distribution sub-district Image Acquisition described in obliquity effects (" the first sub-lens " might as well be known as)
Mode, optional example is as shown in Figure 2 a, so that the part in the scene positioned at the first depth distribution sub-district (might as well be known as
" first part ") imaging region corresponding with first sub-lens (might as well be known as " the first imaging area in the light-field camera
Domain ") on the size of average blur circle that is imaged reduced, thus improve the image quality of the first part.Due to described
First depth distribution sub-district can determine according to actual needs, and can be mentioned by way of corresponding first sub-lens of inclination light-field camera
Height carries out the image quality of optically detecting to the corresponding first part of the first depth distribution sub-district, and therefore, the application is implemented
The technical solution that example provides, which is advantageously implemented, needs the customization image of the depth distribution sub-district compared with high imaging quality to adopt in scene
Collection, can more preferably meet diversified Image Acquisition application demand.
In technical solution provided by the embodiments of the present application, the method for determination of the first depth distribution sub-district is very flexible,
Diversified practical application request can be met.For example, if more paid close attention to a certain depth distribution sub-district, it may be determined that scene is corresponding
Depth distribution sub-district be the first depth distribution sub-district, improve scene in a manner of by tilting corresponding first sub-lens
In be located at the first depth distribution sub-district in part image quality;Alternatively, if content to be taken the photograph to certain in scene (such as first
Part) more to pay close attention to, it may be determined that the depth distribution sub-district of first part is the first depth distribution sub-district in the scene, with
Improve the image quality of the first part by way of tilting corresponding first sub-lens;Etc..It is appreciated that the application
The part that embodiment refers to may include the part, etc. of complete an object or a certain complete object.
Optionally, the first depth distribution sub-district is a subset of the field depth of the light-field camera, that is to say, that
The corresponding depth bounds of the first depth distribution sub-district are located within the field depth.The depth of field (Depth of Field, letter
Claim DoF) typically refer to the object distance range that pick-up lens is capable of blur-free imaging to scene, that is to say, that it is opposite in the depth direction
Certain depth range before and after the focusing object plane of pick-up lens can blur-free imaging.When operations such as the adjustment of light-field camera aperture, focusings
After completion, the field depth of the light-field camera generally also determines therewith, which is opposite light field phase on depth direction
Certain object distance range of owner's lens.By an optically detecting of light-field camera, the part in field depth is located in scene
The blur circle size of imaging is smaller, usually can blur-free imaging, and be located at field depth outside part imaging blur circle size compared with
Greatly, imaging is typically more fuzzy.The program can determine that the subset that scene is located in light-field camera field depth is described first
Depth distribution sub-district further increases the first depth distribution sub-district corresponding first by way of tilting corresponding first sub-lens
Partial image quality.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, it is described it is adjusted after institute
Before light-field camera is stated to scene progress Image Acquisition, further includes: the relatively described imaging surface tilts the second sub-lens, to increase
The average blur circle that big second part is imaged on the second imaging region, in which: second sub-lens are the sub-lens battle array
The sub-lens of the second depth distribution sub-district Image Acquisition, the second depth distribution sub-district and first depth point are influenced in column
Cloth sub-district is different, and the second part is the part for being located at the second depth distribution sub-district in the scene, the second one-tenth described
As region is imaging surface imaging region corresponding with second sub-lens.It is desirable to light fields to adopt in certain application scenarios
The theme of the image collected is prominent, for this purpose, on the one hand can be by improving user's theme (such as the first part) of interest
Image quality, on the other hand, the image quality for the other parts (such as described second part) that can also be not concerned with by reduction user,
So that light-field camera is in the collected general image of scene, the image quality of the first part and the second part at
As a degree of comparison of the form of quality, more outstanding vision effect of the first part in general image is thereby resulted in
Fruit.
Optionally, the second depth distribution sub-district is the field depth in addition to the first depth distribution sub-district
Other depth distribution sub-districts.For example, as shown in figure 3, a certain subset in the field depth be the first depth distribution sub-district, its
He is partially the second depth distribution sub-district, can by the first sub-lens of obliquity effects the first depth distribution sub-district Image Acquisition come
The image quality (as reduced the average blur circle of first part's imaging to improve clarity) of first part is improved, meanwhile, pass through
Second sub-lens of obliquity effects the second depth distribution sub-district Image Acquisition reduce the image quality of second part (as reduced by the
The average blur circle of two parts imaging is to reduce clarity) so that the imaging theme of the first part is more prominent.This
Outside, certain application scenarios need to obtain the Image Acquisition of the shallow depth of field, and large aperture usually can be used to adopt to obtain the image of the shallow depth of field
Collection, however, large aperture is expensive, and in some cases, the depth distribution of the object (such as first part) of user's concern
Range is small, the field depth (i.e. the first depth distribution sub-district is less than field depth) even less than under the aperture adjustment limit, and is somebody's turn to do
Under situation, if the first sub-lens of inclination reduce the average blur circle that first part be imaged in the first imaging region, the is tilted
Two sub-lens increase the average blur circle that second part is imaged in the second imaging region, as shown in Figure 2 b, may make depth of field model
Concern part (the corresponding first part of such as the first depth distribution sub-district) in enclosing is relatively sharp and non-concerned department in field depth
The clarity of point (the corresponding second part of such as the second depth distribution sub-district) decreases, thereby increase in field depth this two
The comparison of part image quality is equivalent to and increases effective f-number, reduces original field depth, though light-field camera not more
It changes in the case of large aperture, also can get the Image Acquisition effect that first part's theme is more prominent, the depth of field is more shallow, be conducive to drop
Low cost more preferably meets diversified Image Acquisition application demand.
In technical solution provided by the embodiments of the present application, it can be treated and be inclined according to the condition of convergence for reducing corresponding averagely blur circle
The first oblique sub-lens carry out inclination control with respect to imaging surface, and implementation is very flexible.
Optionally, after the relatively described imaging surface inclination of first sub-lens, the first part is the first one-tenth described
Blur circle is allowed as the average blur circle being imaged on region is less than or equal to one.If blur circle is allowed more less than or equal to a certain
Circle (permissible circle of confusion) is dissipated, can be considered corresponding photographing section focus imaging;Correspondingly, if
Blur circle is greater than this and allows blur circle, can be considered corresponding photographing section imaging out of focus.The size for allowing blur circle and object distance,
The factors such as enlargement ratio are related, can predefine and allow blur circle size, such as described to allow blur circle size be 1/30mm etc.
Deng.The program is equivalent to during the first sub-lens inclination control, and the average blur circle after the inclination of the first sub-lens is less than
Or allow blur circle as the condition of convergence of the first sub-lens inclination control equal to one, that is to say, that tilt in the first sub-lens
In control process, if the average blur circle that the first sub-lens are located under a certain heeling condition and the corresponding heeling condition be less than or
Blur circle is allowed equal to described, then the inclination control of achievable first sub-lens, in this way, the light-field camera after adjusted obtains field
The Image Acquisition of scape can get the higher image quality of first part, is thus advantageously implemented in scene and needs compared with high imaging quality
Depth distribution sub-district customization Image Acquisition.
Optionally, the imaging surface of the opposite light-field camera tilts the first sub-lens, to reduce first part at the first one-tenth
As the average blur circle being imaged on region, comprising: according to the focal length of first sub-lens, first sub-lens optical center and
The distance between described imaging surface and the first part are through plane where the main lens imaging of light-field camera and described
Angle between imaging surface determines the expectation tilt angle of first sub-lens;According at least to the expectation tilt angle phase
First sub-lens are tilted to the imaging surface, with reduce the first part be imaged on first imaging region it is flat
Equal blur circle.
In light-field camera, after first sub-lens are with respect to imaging surface (plane where image sensing cell) inclination, institute
Plane and the imaging surface of light-field camera are no longer parallel where stating the first sub-lens.With reference to husky nurse law (Scheimpflug
Principle), saturating through the elongated surfaces of plane, first son where the main lens imaging of light-field camera when first part
Elongated surfaces, the elongated surfaces of the imaging surface of the light-field camera of plane where after mirror inclination, when three mutually gives line always, such as scheme
Shown in 4a, the region that the first part can get blur-free imaging is maximum, and under the situation, the first part is through light-field camera
Plane where main lens imaging is equivalent to a focal plane (Plane of Focus), the main lens institute through light-field camera
At the average blur circle that is imaged on the first imaging region of the imaging surface of picture it is minimum.Meet the first son of above-mentioned law thoroughly
The tilt angle of mirror can be expectation tilt angle described in the embodiment of the present application.
In the embodiment of the present application, depth distribution sub-district (such as the first depth distribution sub-district or the second depth distribution sub-district) includes
Depth bounds and quantity can flexibly be determined according to the depth information of the scene, to meet diversified application demand.For example,
Each pixel that connection can be determined according to the overall depth figure of the scene, calculates the normal direction of the pixel of each connection, and
Based on the normal direction of each pixel, these pixels are grouped, such as the angle according to normal direction relative depth direction
It is grouped, be 135 degree to 150 degree by normal direction and depth direction angle is one group, and/or, by normal direction and depth
Angular separation is 45 degree to 60 degree etc., the corresponding depth bounds of pixel that thus each group respectively includes, respectively as one
Depth distribution sub-district, etc. is conducive to determine that the depth distribution sub-district includes using the depth distribution sub-district that the program determines
Part is through the plane where main lens imaging, using one of the foundation as corresponding sub-lens inclination control.
When first part inclines through the elongated surfaces of plane, first sub-lens where the main lens imaging of light-field camera
Elongated surfaces, the elongated surfaces of the imaging surface of the light-field camera of plane where after tiltedly, when three mutually gives line always, described first
What part was imaged on imaging surface imaging region (i.e. the first imaging region) corresponding with first sub-lens is averaged more
It is minimum to dissipate circle, the angle of the relatively described imaging surface of the first sub-lens is expectation inclination angle described in the embodiment of the present application
Degree.
Optionally, as shown in Figure 4 b, following formula calculating can be used in the expectation tilt angle of first sub-lens:
In above formula: θ indicates the first sub-lens with respect to the tilt angle of imaging surface, i.e. the expectation inclination angle of the first sub-lens
Degree;F indicates the focal length of the first sub-lens;Indicate the main lens institute of imaging surface and first part through light-field camera of light-field camera
At the plane as place between angle;V indicates the distance between imaging plane and the first sub-lens optical center.According at least to this
The relatively described imaging surface of the expectation tilt angle that scheme determines tilts first sub-lens, so where first sub-lens
The tilt angle of the relatively described imaging surface of plane as close possible to the even equal to described expectation tilt angle, and first son thoroughly
Mirror be in inclination after in the state of carry out Image Acquisition when, what the first part was imaged on first imaging region is averaged
Blur circle is as small as possible.The program improves the efficiency of the first sub-lens inclination control.
Optionally, the imaging surface of the opposite light-field camera tilts the first sub-lens, to reduce first part at the first one-tenth
As the average blur circle being imaged on region, comprising: determine that the optical axis of the first sub-lens relatively described imaging surface allows to press from both sides
Angular region;The angular range imaging surface relatively is allowed to tilt first sub-lens according at least to described, to reduce described the
The average blur circle that a part is imaged on first imaging region.Using program imaging surface inclination relatively described the
One sub-lens, first sub-lens place plane after inclination and the angle between the imaging surface allow angle described in falling into
Range.Wherein, described to allow angular range be according under the requirement that can bring corresponding averagely blur circle reduction after lens tilt
It flexibly determines, the embodiment of the present application is not intended to limit this.The program improves the efficiency of the first sub-lens inclination control.
It is described allow angular range that can be tilted according to sub-lens after can bring under the requirement that blur circle reduces corresponding averagely
It predefines, determining method may include but be not limited to determine using modes such as laboratory facilities, analog simulation, the derivations of equation.It can
Choosing, determine the relatively described imaging surface of the optical axis of first sub-lens allows angular range, comprising: according to first son
Described in the distance between the focal length of lens, the optical center of first sub-lens and described imaging surface and first part warp
Angle where the main lens imaging of light-field camera between plane and the imaging surface, determines the phase of first sub-lens
Hope tilt angle;Angular range is allowed according to expectation tilt angle determination.The determination side of the expectation tilt angle
Method can refer to record above, after the expectation tilt angle has been determined, in combination with the first sub-lens tilt adjustment of consideration
Precision limits, to factors such as first part's image quality requirements, it would be desirable to angle of the tilt angle in certain range of allowable error
Degree range allows angular range described in being used as.Allow angular range relatively reasonable using described in program determination, is based on the appearance
Perhaps angular range carries out inclination control of first sub-lens with respect to imaging surface, high-efficient and be easier to realize.
Optionally, the imaging surface of the opposite light-field camera tilts the first sub-lens, to reduce first part at the first one-tenth
As the average blur circle being imaged on region, comprising: the relatively described imaging surface is along the reduction first part through the light-field camera
Main lens imaging where angle where plane and first sub-lens between plane direction inclination described first
Sub-lens, to reduce the average blur circle that the first part is imaged on first imaging region.With reference to husky nurse law, when
First part is flat where after the elongated surfaces of plane, first sub-lens inclination where the main lens imaging of light-field camera
The elongated surfaces of the imaging surface of the elongated surfaces in face, the light-field camera, when three mutually gives line always, the first part be can get
The region of blur-free imaging is maximum.As shown in figure 5, the plane where before the inclination of the first sub-lens, with first part through light-field camera
Main lens imaging where face between angle be A1, the first sub-lens phase can be made along the direction for reducing the angle
Imaging surface is tilted, the plane as where after the inclination of the first sub-lens, and formed by main lens of the first part through light-field camera
As place face between angle be A2, A2Less than A1, it is seen then that first sub-lens are flat where it after tilting towards the direction
Face and first part are through the face where the main lens imaging of light-field camera and the plane three where the imaging surface
Intersect collinear probability to significantly increase, thus can reduce first part the imaging surface the first imaging region institute at
Picture average blur circle, improve acquired image described in first part image quality.Further, if this inclined
Tilted direction and the expectation tilt angle then can further improve son collectively as the foundation of the first sub-lens inclination control
The efficiency of lens tilt control;Alternatively, if by the inclined direction and it is described allow angular range collectively as it is described first son
The foundation of lens tilt control, then can further improve the efficiency of sub-lens inclination control.
Optionally, before imaging surface the first sub-lens of inclination of opposite light-field camera, further includes: determine the sub-lens battle array
To inclined first sub-lens in column.It can be determined described in influence in the lenslet arrays of light-field camera using the program
The sub-lens of first depth distribution sub-district Image Acquisition, as described first sub-lens are sub by will determine first later
Lens carry out tilt adjustments with respect to imaging surface, so that the first part in the first depth distribution sub-district is in the imaging surface
The average blur circle being imaged on first imaging region is reduced, and the image quality of the first part is thus improved.Influence institute
The first sub-lens for stating the Image Acquisition of the first part in the first depth distribution sub-district may be one or more, can be to determination
Each of the first sub-lens the relatively described imaging surface is tilted respectively, and by the first part after tilting it is corresponding son thoroughly
The average blur circle of imaging is reduced the convergence item as corresponding sub-lens inclination control on the corresponding imaging region of mirror
Thus part improves the whole image quality of first part.
It is further alternative, it determines in the lenslet arrays to inclined first sub-lens, comprising: described in determining
In lenslet arrays, with the light-field camera obtain the scene preview image in the first depth distribution sub-district pair
The corresponding sub-lens in the part answered, for inclined first sub-lens.A kind of optional implementation, the light-field camera
In, as shown in fig. 6, the focal length for each sub-lens that the lenslet arrays include is identical, imaging surface is (such as described image sensor institute
Face) at a distance from the lenslet arrays be equal to the sub-lens focal length;It is a certain based on light-field camera acquisition scene
The spatial resolution of the image (such as described preview image) at visual angle is corresponding with the distribution of the sub-lens of the lenslet arrays, every height
Lens correspond to a certain imaging region of described image sensor, and each imaging region includes the multiple pixels of array distribution, by this
Imaging region records the sub-lens to the light information of the different directions in certain portion from the scene, that is, the light-field camera
In, there are corresponding relationships between the pixel distribution of the preview image and the distribution of the sub-lens of the lenslet arrays, therefore,
It can be according to part corresponding with the first depth distribution sub-district in the preview image for the scene that the light-field camera obtains
Corresponding sub-lens, to influence the first depth distribution sub-district Image Acquisition, to inclined first sub-lens.Using the program
Determine first sub-lens, method is simply easily realized.
In technical solution provided by the embodiments of the present application, it can be treated and be inclined according to the condition of convergence for increasing corresponding averagely blur circle
The second oblique sub-lens carry out inclination control with respect to imaging surface, and implementation is very flexible.
Optionally, after the relatively described imaging surface inclination of second sub-lens, the second part is the second one-tenth described
Blur circle is allowed as the average blur circle being imaged on region is greater than one.The size for allowing blur circle and object distance, enlargement ratio
Etc. factors it is related, can predefine and allow blur circle size, such as described to allow blur circle size be 1/30mm etc..The program
It is equivalent to during the second sub-lens inclination control, the average blur circle after the inclination of the second sub-lens is greater than one and allows disperse
The condition of convergence of the circle as the second sub-lens inclination control, that is to say, that during the second sub-lens inclination control, if the
The average blur circle that two sub-lens are located under a certain heeling condition and the corresponding heeling condition allows blur circle described in being greater than, then may be used
The inclination control of the second sub-lens is completed, in this way, the light-field camera after adjusted obtains the second of the Image Acquisition acquisition of scene
Part image quality decreases, and is thus conducive to present a contrast with the image quality of the first part, so that described first
Partial image subject is more prominent, help to obtain the shallow depth image of the first part.
Optionally, the imaging surface tilts the second sub-lens relatively, with increase second part on the second imaging region at
The average blur circle of picture, comprising: the relatively described imaging surface is along the increase main lens institute of the second part through the light-field camera
At the direction of the angle as where place plane and second sub-lens between plane tilt second sub-lens, to increase
The average blur circle that the big second part is imaged on second imaging region.With reference to husky nurse law, when second part passes through
The extension of plane where after the elongated surfaces of plane, second sub-lens inclination where the main lens imaging of light-field camera
Face, the light-field camera imaging surface elongated surfaces, when three mutually gives line always, the second part can get blur-free imaging
Region it is maximum, in order to reduce the image quality of the second part, make the second part seem more to obscure, can reduce
Above-mentioned three intersects at the probability of a straight line.Specifically, it is assumed that the plane where before the inclination of the second sub-lens, with second part
The angle between face where main lens imaging through light-field camera is B1, described the can be made along the direction for increasing the angle
Two sub-lens tilt (inclined direction can be opposite with sub-lens inclined direction as arrows in fig. 5) with respect to imaging surface, and such as second
Plane where before sub-lens inclination, with second part through the angle between the face where the main lens imaging of light-field camera
For B2, B2Greater than B1, it is seen then that plane where it is with second part through light field phase after second sub-lens are tilted towards the direction
Plane three where face and the imaging surface where the main lens imaging of machine, which intersects collinear probability, to reduce
, thus can increase second part in the average blur circle of the second imaging region imaging of the imaging surface, reduction is adopted
The image quality of second part described in the image of collection.
Optionally, before imaging surface the second sub-lens of inclination of opposite light-field camera, further includes:
It determines in the lenslet arrays to inclined second sub-lens.It can be in the son of light-field camera using the program
Determine to influence the sub-lens of the second depth distribution sub-district Image Acquisition in lens array, as described second sub-lens,
Tilt adjustments are carried out with respect to imaging surface by the second sub-lens that will be determined later, so that in the second depth distribution sub-district
The average blur circle that is imaged on the second imaging region of the imaging surface of second part increased, thus reduce described
The image quality of two parts.The second sub-lens for influencing the Image Acquisition of the second part in the second depth distribution sub-district can
Can be one or more, can to each of determining second sub-lens, the relatively described imaging surface is tilted respectively, and by described the
The average blur circle of imaging increased as phase on the corresponding imaging region of corresponding sub-lens of two parts after tilting
The condition of convergence of sub-lens inclination control is answered, the whole image quality of second part is thus reduced.
It is further alternative, it determines in the lenslet arrays to inclined second sub-lens, comprising: described in determining
In lenslet arrays, with the light-field camera obtain the scene preview image in the second depth distribution sub-district pair
The corresponding sub-lens in the part answered, for inclined second sub-lens.Second sub-lens are determined using the program, side
Method is simply easily realized.
It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step
Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and
Any restriction should not be constituted to the implementation process of the application specific embodiment.
Fig. 7 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application.As shown in fig. 7, this
The first Image Acquisition control device that application embodiment provides includes: one first depth distribution sub-district determining module 71,1 the
One sub-lens tilt control module 72 and an Image Acquisition control module 73.
First depth distribution sub-district determining module 71 is used to determine that the partial-depth distribution sub-district of scene to be the first depth point
Cloth sub-district.
The imaging surface that first sub-lens tilt control module 72 is used for opposite light-field camera tilts the first sub-lens, to reduce
The average blur circle that first part is imaged on the first imaging region, in which: first sub-lens are the light-field camera
The sub-lens of the first depth distribution sub-district Image Acquisition are influenced in lenslet arrays, the first part is in the scene
Positioned at the part of the first depth distribution sub-district, first imaging region is the imaging surface and first sub-lens pair
The imaging region answered.
Image Acquisition control module 73 carries out Image Acquisition to the scene for the light-field camera after adjusted.
Image Acquisition control device provided by the embodiments of the present application can determine the partial-depth distribution sub-district (i.e. " the of scene
One depth distribution sub-district "), by the sub-lens of the first depth distribution sub-district Image Acquisition described in obliquity effects, (i.e. " the first son is thoroughly
Mirror ") mode so that in the scene positioned at the first depth distribution sub-district part (i.e. " first part ") in the light
The average blur circle being imaged on imaging region (i.e. " the first imaging region ") corresponding with first sub-lens in the camera of field
Size is reduced, and the image quality of the first part is thus improved.Since the first depth distribution sub-district can be according to reality
Border it needs to be determined that, and can be improved by way of corresponding first sub-lens of inclination light-field camera to the first depth distribution sub-district
Corresponding first part carries out the image quality of optically detecting, and therefore, technical solution provided by the embodiments of the present application is conducive to reality
The customization Image Acquisition of the depth distribution sub-district compared with high imaging quality is needed in live scape, can more preferably meet diversified image
Acquisition applications demand.
The equipment form of expression of described image acquisition control device is unrestricted, such as described image acquisition control device can
For a certain independent component;Alternatively, described image acquisition control device, which can be used as a certain functional module, is integrated in an imaging device
In, the imaging device may include but be not limited to light-field camera or include the mobile phone of light-field camera, tablet computer etc., the application
Embodiment is not intended to limit this.
Optionally, as shown in figure 8, the first depth distribution sub-district determining module 71 includes: one first depth distribution
Area determines submodule 711.First depth distribution sub-district determines submodule 711 for determining the depth of first part in the scene
Distribution sub-district is the first depth distribution sub-district.If content (such as first part) to be taken the photograph to certain in scene is more paid close attention to,
The depth distribution sub-district that can determine first part in the scene is the first depth distribution sub-district, by tilting corresponding the
The mode of one sub-lens improves the image quality of the first part.
Optionally, the first depth distribution sub-district is a subset of the field depth of the light-field camera.The program can
It determines that the subset that scene is located in light-field camera field depth is the first depth distribution sub-district, passes through inclination corresponding first
The mode of sub-lens further increases the image quality of the corresponding first part of the first depth distribution sub-district.
Optionally, described image acquisition control device further include: one second sub-lens tilt control module 74.Second son is thoroughly
Mirror tilt control module 74 tilts the second sub-lens for the relatively described imaging surface, to increase second part in the second imaging region
The average blur circle of upper imaging, in which: second sub-lens are to influence the second depth distribution sub-district in the lenslet arrays
The sub-lens of Image Acquisition, the second depth distribution sub-district is different from the first depth distribution sub-district, the second part
For in the scene be located at the second depth distribution sub-district part, second imaging region be the imaging surface with it is described
The corresponding imaging region of second sub-lens.The theme of the image arrived in certain application scenarios it is desirable to optical field acquisition is prominent, is
On the other hand this, on the one hand can also be led to by improving the image quality of user's theme (such as described first part) of interest
The image quality for reducing the other parts (such as described second part) that user is not concerned with is crossed, so that light-field camera collects scene
General image in, the image quality of the image quality of the first part and the second part forms a degree of ratio
Compared with thereby resulting in more outstanding visual effect of the first part in general image.
Optionally, the second depth distribution sub-district is the field depth in addition to the first depth distribution sub-district
Other depth distribution sub-districts.The program may make concern part (such as the first depth distribution sub-district corresponding in field depth
A part) it is relatively sharp and do not paid close attention in field depth part (the corresponding second part of such as the second depth distribution sub-district) it is clear
Clear degree decreases, and thereby increases the comparison of this two parts image quality field depth Nei, be equivalent to increase effective f-number,
Original field depth is reduced, even if also can get first part's theme more in the case of light-field camera is changed without large aperture
For the Image Acquisition effect that protrusion, the depth of field are more shallow, cost is advantageously reduced, more preferably meets diversified Image Acquisition application need
It asks.
Optionally, after the relatively described imaging surface inclination of first sub-lens, the first part is the first one-tenth described
Blur circle is allowed as the average blur circle being imaged on region is less than or equal to one.During the first sub-lens inclination control, such as
The average blur circle that the first sub-lens of fruit are located under a certain heeling condition and the corresponding heeling condition is allowed described in being less than or equal to
Blur circle, the then inclination control of achievable first sub-lens, in this way, the light-field camera after adjusted obtains the Image Acquisition of scene
It can get the higher image quality of first part, be thus advantageously implemented depth distribution needed in scene compared with high imaging quality
The customization Image Acquisition in area.
Optionally, as shown in figure 9, the first sub-lens tilt control module 72 includes: that an expectation tilt angle determines
Submodule 721 and an angle tilt control submodule 722.It is expected that tilt angle determines submodule 721 for according to described first
The distance between the focal length of sub-lens, the optical center of first sub-lens and described imaging surface and the first part are through institute
Angle where stating the main lens imaging of light-field camera between plane and the imaging surface, determines first sub-lens
It is expected that tilt angle;Angle tilt control submodule 722 is used for according at least to the relatively described imaging surface of expectation tilt angle
First sub-lens are tilted, to reduce the average blur circle that the first part is imaged on first imaging region.It should
Scheme improves the efficiency of the first sub-lens inclination control.
Optionally, the first sub-lens tilt control module 72 includes: that angular range is allowed to determine 723 He of submodule
One angular range inclination control submodule 724.Angular range is allowed to determine submodule 723 for determining first sub-lens
The relatively described imaging surface of optical axis allows angular range;Angular range inclination control submodule 724 is used for according at least to the appearance
Perhaps the relatively described imaging surface of angular range tilts first sub-lens, to reduce the first part in first imaging area
The average blur circle being imaged on domain.The program improves the efficiency of the first sub-lens inclination control.
Optionally, described that angular range is allowed to determine that submodule 723 includes: 7231 He of an expectation tilt angle determining unit
One allows angular range determination unit 7232.It is expected that tilt angle determining unit 7231 is used for the coke according to first sub-lens
Away from the distance between, the optical center of first sub-lens and the imaging surface and the first part through the light-field camera
Main lens imaging where angle between plane and the imaging surface, determine the expectation inclination angle of first sub-lens
Degree;Allow angular range determination unit 7232 for allowing angular range according to expectation tilt angle determination.Using
The program determine it is described allow angular range relatively reasonable, allowing angular range to carry out based on this, the first sub-lens are opposite to be imaged
The inclination control in face, it is high-efficient and be easier to realize.
Optionally, the first sub-lens tilt control module 72 includes: one first sub-lens inclination control submodule
725.First sub-lens inclination control submodule 725 is for the relatively described imaging surface along the reduction first part through the light field
Described in the direction inclination of angle where plane where the main lens imaging of camera and first sub-lens between plane
First sub-lens, to reduce the average blur circle that the first part is imaged on first imaging region.The program can mention
The image quality of first part described in high acquired image.
Optionally, as shown in figure 8, described image acquisition control device further include: one first sub-lens determining module 75.The
One sub-lens determining module 75 is for determining in the lenslet arrays to inclined first sub-lens.It can using the program
Determine to influence the sub-lens of the first depth distribution sub-district Image Acquisition, as institute in the lenslet arrays of light-field camera
The first sub-lens are stated, tilt adjustments are carried out with respect to imaging surface by the first sub-lens that will be determined later, so that described first
The average blur circle that first part in depth distribution sub-district is imaged on the first imaging region of the imaging surface is reduced,
Thus the image quality of the first part is improved.
Optionally, the first sub-lens determining module 75 includes: that one first sub-lens determine submodule 751.First son
Lens determine preview of the submodule 751 for determining in the lenslet arrays, with the scene of light-field camera acquisition
The corresponding sub-lens in corresponding with the first depth distribution sub-district part in image, for inclined first sub-lens.
First sub-lens are determined using the program, method is simply easily realized.
Optionally, after the relatively described imaging surface inclination of second sub-lens, the second part is the second one-tenth described
Blur circle is allowed as the average blur circle being imaged on region is greater than one.During the second sub-lens inclination control, if second
The average blur circle that sub-lens are located under a certain heeling condition and the corresponding heeling condition allows blur circle described in being greater than, then can be complete
At the inclination control of the second sub-lens, in this way, second that the Image Acquisition that the light-field camera after adjusted obtains scene obtains
Point image quality decreases, and is thus conducive to present a contrast with the image quality of the first part, so that described first
The image subject divided is more prominent, help to obtain the shallow depth image of the first part.
Optionally, the second sub-lens tilt control module 74 includes: one second sub-lens inclination control submodule
741.Second sub-lens inclination control submodule 741 is for the relatively described imaging surface along the increase second part through the light field
Described in the direction inclination of angle where plane where the main lens imaging of camera and second sub-lens between plane
Second sub-lens, to increase the average blur circle that the second part is imaged on second imaging region.Second son
After lens are tilted towards the direction plane where it and second part through where the main lens imaging of light-field camera face,
And the plane three where the imaging surface is intersected collinear probability and is reduced, and thus can increase second part described
The average blur circle of second imaging region imaging of imaging surface reduces the imaging of second part described in acquired image
Quality.
Optionally, described image acquisition control device further include: one second sub-lens determining module 76.Second sub-lens are true
Cover half block 76 is for determining in the lenslet arrays to inclined second sub-lens.It can be in light-field camera using the program
Lenslet arrays in determine to influence the sub-lens of the second depth distribution sub-district Image Acquisition, as it is described second son thoroughly
Mirror carries out tilt adjustments with respect to imaging surface by the second sub-lens that will be determined later, so that second depth distribution is sub
The average blur circle that second part in area is imaged on the second imaging region of the imaging surface increased, and thus reduce institute
State the image quality of second part.
Optionally, the second sub-lens determining module 76 includes: that one second sub-lens determine submodule 761.Second son
Lens determine preview of the submodule 761 for determining in the lenslet arrays, with the scene of light-field camera acquisition
The corresponding sub-lens in corresponding with the second depth distribution sub-district part in image, for inclined second sub-lens.
Second sub-lens are determined using the program, method is simply easily realized.
Figure 10 is the structural schematic diagram of the 4th kind of Image Acquisition control device provided by the embodiments of the present application, and the application is specific
Embodiment does not limit the specific implementation of Image Acquisition control device 1000.As shown in Figure 10, Image Acquisition controls
Device 1000 may include:
Processor (Processor) 1010,1020, memory communication interface (Communications Interface)
(Memory) 1030 and communication bus 1040.Wherein:
Processor 1010, communication interface 1020 and memory 1030 complete mutual lead to by communication bus 1040
Letter.
Communication interface 1020, for being communicated with such as deformable imaging sensor etc..
Processor 1010 can specifically execute the related step in any of the above-described embodiment of the method for executing program 1032
Suddenly.
For example, program 1032 may include program code, said program code includes computer operation instruction.
Processor 1010 may be a central processing unit (Central Processing Unit, abbreviation CPU), or
It is specific integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or is configured
At the one or more integrated circuits for implementing the embodiment of the present application.
Memory 1030, for storing program 1032.Memory 1030 may include random access memory (Random
Access Memory, abbreviation RAM), it is also possible to it further include nonvolatile memory (Non-volatile memory), such as extremely
A few magnetic disk storage.
For example, in an optional implementation manner, following steps can be performed by executing program 1032 in processor 1010:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;It is saturating to the first son of imaging surface inclination of light-field camera
Mirror, the average blur circle being imaged with reducing first part on the first imaging region, in which: first sub-lens are the light
The sub-lens of the first depth distribution sub-district Image Acquisition are influenced in the lenslet arrays of field camera, the first part is institute
The part for being located at the first depth distribution sub-district in scene is stated, first imaging region is the imaging surface and described first
The corresponding imaging region of sub-lens;The light-field camera after adjusted carries out Image Acquisition to the scene.It is optional at other
Implementation in, processor 1010 by execute program 1032 can also carry out the step of other above-mentioned any embodiments refer to,
Details are not described herein.
In program 1032 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule,
Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description
With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment
Description, details are not described herein.
In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality
Apply the superiority and inferiority of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it
The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to
The record of correlation method embodiment, details are not described herein.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps.
And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), deposits at random
Various Jie that can store program code such as access to memory (Random Access Memory, abbreviation RAM), magnetic or disk
Matter.
In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule
Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again
Combination nova should be regarded as the equivalent scheme of the application.Meanwhile in the description above to the application specific embodiment, for a kind of reality
The feature that the mode of applying is described and/or shown can be made in one or more other embodiments in a manner of same or similar
With, be combined with the feature in other embodiment, or substitution other embodiment in feature.
It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when using herein, but simultaneously
It is not excluded for the presence or additional of one or more other features, element, step or component.
Finally, it should be noted that embodiment of above is merely to illustrate the application, and it is not the limitation to the application, it is related
The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope
And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be by right
It is required that limiting.
Claims (10)
1. a kind of Image Acquisition control method characterized by comprising
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, with reduce first part be imaged on the first imaging region it is flat
Equal blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth distribution
The sub-lens of sub-district Image Acquisition, the first part are the part for being located at the first depth distribution sub-district in the scene,
First imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
2. the method according to claim 1, wherein the partial-depth distribution sub-district of the determining scene is first
Depth distribution sub-district, comprising:
The depth distribution sub-district for determining first part in the scene is the first depth distribution sub-district.
3. method according to claim 1 or 2, which is characterized in that the first depth distribution sub-district is the light field phase
One subset of the field depth of machine.
4. the method according to claim 1, wherein the light-field camera after adjusted carries out the scene
Before Image Acquisition, further includes:
The relatively described imaging surface tilts the second sub-lens, the average disperse being imaged to increase second part on the second imaging region
Circle, in which: second sub-lens are the sub-lens that the second depth distribution sub-district Image Acquisition is influenced in the lenslet arrays,
The second depth distribution sub-district is different from the first depth distribution sub-district, the second part in the scene be located at institute
State the part of the second depth distribution sub-district, second imaging region be the imaging surface it is corresponding with second sub-lens at
As region.
5. according to the method described in claim 4, it is characterized in that, the second depth distribution sub-district is field depth except described
Other depth distribution sub-districts except first depth distribution sub-district.
6. a kind of Image Acquisition control device characterized by comprising
One first depth distribution sub-district determining module is the first depth distribution for determining that the partial-depth of scene is distributed sub-district
Area;
One first sub-lens tilt control module, the imaging surface for opposite light-field camera tilt the first sub-lens, to reduce the
The average blur circle that a part is imaged on the first imaging region, in which: first sub-lens are the son of the light-field camera
The sub-lens of the first depth distribution sub-district Image Acquisition are influenced in lens array, the first part is position in the scene
In the part of the first depth distribution sub-district, first imaging region is that the imaging surface is corresponding with first sub-lens
Imaging region;
One Image Acquisition control module carries out Image Acquisition to the scene for the light-field camera after adjusted.
7. device according to claim 6, which is characterized in that the first depth distribution sub-district determining module includes:
One first depth distribution sub-district determines submodule, for determining the depth distribution sub-district of first part in the scene for institute
State the first depth distribution sub-district.
8. device according to claim 6 or 7, which is characterized in that the first depth distribution sub-district is the light field phase
One subset of the field depth of machine.
9. device according to claim 6, which is characterized in that further include:
One second sub-lens tilt control module tilts the second sub-lens for the relatively described imaging surface, to increase second part
The average blur circle being imaged on the second imaging region, in which: second sub-lens are that the is influenced in the lenslet arrays
The sub-lens of two depth distribution sub-district Image Acquisition, the second depth distribution sub-district and the first depth distribution sub-district are not
Together, the second part is the part for being located at the second depth distribution sub-district in the scene, and second imaging region is
Imaging surface imaging region corresponding with second sub-lens.
10. a kind of Image Acquisition control device characterized by comprising
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface and institute
It states memory and completes mutual communication by the communication bus;
The memory is for storing at least one instruction;Described instruction makes the processor execute following operation:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, with reduce first part be imaged on the first imaging region it is flat
Equal blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth distribution
The sub-lens of sub-district Image Acquisition, the first part are the part for being located at the first depth distribution sub-district in the scene,
First imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510546054.2A CN106303209B (en) | 2015-08-31 | 2015-08-31 | Image Acquisition control method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510546054.2A CN106303209B (en) | 2015-08-31 | 2015-08-31 | Image Acquisition control method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106303209A CN106303209A (en) | 2017-01-04 |
CN106303209B true CN106303209B (en) | 2019-06-21 |
Family
ID=57650521
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510546054.2A Active CN106303209B (en) | 2015-08-31 | 2015-08-31 | Image Acquisition control method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106303209B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116067619B (en) * | 2023-03-07 | 2023-08-11 | 宁德时代新能源科技股份有限公司 | Battery winding detection device, winding device, detection method, device, and medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101426085A (en) * | 2004-10-01 | 2009-05-06 | 科兰·斯坦福青年大学托管委员会 | Imaging arrangements and methods therefor |
CN103703757A (en) * | 2013-08-01 | 2014-04-02 | 华为终端有限公司 | Photographing method and device |
CN104469147A (en) * | 2014-11-20 | 2015-03-25 | 北京智谷技术服务有限公司 | Light field collection control method and device and light field collection equipment |
CN104486537A (en) * | 2014-10-27 | 2015-04-01 | 北京智谷技术服务有限公司 | Light field acquisition control method and device |
CN104506762A (en) * | 2014-12-25 | 2015-04-08 | 北京智谷睿拓技术服务有限公司 | Optical field collecting control method and device and optical field collecting equipment |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2477294B (en) * | 2010-01-27 | 2015-05-06 | Au Optronics Corp | Autostereoscopic display apparatus |
-
2015
- 2015-08-31 CN CN201510546054.2A patent/CN106303209B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101426085A (en) * | 2004-10-01 | 2009-05-06 | 科兰·斯坦福青年大学托管委员会 | Imaging arrangements and methods therefor |
CN103703757A (en) * | 2013-08-01 | 2014-04-02 | 华为终端有限公司 | Photographing method and device |
CN104486537A (en) * | 2014-10-27 | 2015-04-01 | 北京智谷技术服务有限公司 | Light field acquisition control method and device |
CN104469147A (en) * | 2014-11-20 | 2015-03-25 | 北京智谷技术服务有限公司 | Light field collection control method and device and light field collection equipment |
CN104506762A (en) * | 2014-12-25 | 2015-04-08 | 北京智谷睿拓技术服务有限公司 | Optical field collecting control method and device and optical field collecting equipment |
Also Published As
Publication number | Publication date |
---|---|
CN106303209A (en) | 2017-01-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104410784B (en) | Optical field acquisition control method and device | |
CN104486537B (en) | Optical field acquisition control method and device | |
CN104506762B (en) | Optical field acquisition control method and device, optical field acquisition equipment | |
CN106375694B (en) | Light field display control method and device, light field show equipment | |
CN106254859B (en) | Light field display control method and device, light field display device | |
CN108769462A (en) | Free-viewing angle scene walkthrough method and device | |
CN106161922B (en) | Image Acquisition control method and device | |
CN104867125B (en) | Obtain the method and device of image | |
JP2018536211A (en) | Light field data representation | |
CN107490842A (en) | Camera module, imaging device and image processing method | |
CN106303208B (en) | Image Acquisition control method and device | |
JP2013145982A (en) | Imaging apparatus, image processing apparatus and method | |
CN106254804B (en) | Light field display control method and device, light field show equipment | |
CN106254753B (en) | Light field display control method and device, light field show equipment | |
CN106303209B (en) | Image Acquisition control method and device | |
CN106375648B (en) | Image Acquisition control method and device | |
US9196020B2 (en) | Systems and methods for digital correction of aberrations produced by tilted plane-parallel plates or optical wedges | |
CN106254750B (en) | Image Acquisition control method and device | |
US20150271470A1 (en) | Method of using a light-field camera to generate a full depth-of-field image, and light field camera implementing the method | |
CN106303210B (en) | Image Acquisition control method and device | |
JP2013232757A (en) | Imaging apparatus, image processing apparatus, image processing method, and program | |
CN106161921B (en) | Image Acquisition control method and device | |
US10440269B2 (en) | Image capture control methods and apparatuses | |
CN111382753A (en) | Light field semantic segmentation method and system, electronic terminal and storage medium | |
CN106375653B (en) | Image Acquisition control method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |