CN106303209B - Image Acquisition control method and device - Google Patents

Image Acquisition control method and device Download PDF

Info

Publication number
CN106303209B
CN106303209B CN201510546054.2A CN201510546054A CN106303209B CN 106303209 B CN106303209 B CN 106303209B CN 201510546054 A CN201510546054 A CN 201510546054A CN 106303209 B CN106303209 B CN 106303209B
Authority
CN
China
Prior art keywords
sub
lens
district
depth distribution
image acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510546054.2A
Other languages
Chinese (zh)
Other versions
CN106303209A (en
Inventor
周梁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhigu Ruituo Technology Services Co Ltd
Original Assignee
Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhigu Ruituo Technology Services Co Ltd filed Critical Beijing Zhigu Ruituo Technology Services Co Ltd
Priority to CN201510546054.2A priority Critical patent/CN106303209B/en
Publication of CN106303209A publication Critical patent/CN106303209A/en
Application granted granted Critical
Publication of CN106303209B publication Critical patent/CN106303209B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)
  • Exposure Control For Cameras (AREA)

Abstract

This application discloses a kind of Image Acquisition control method and devices, which comprises the partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;The imaging surface of opposite light-field camera tilts the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, wherein: first sub-lens be the light-field camera lenslet arrays in influence the sub-lens of the first depth distribution sub-district Image Acquisition, the first part is the part for being located at the first depth distribution sub-district in the scene, and first imaging region is imaging surface imaging region corresponding with first sub-lens;The light-field camera after adjusted carries out Image Acquisition to the scene.The application is advantageously implemented the customization Image Acquisition that the depth distribution sub-district compared with high imaging quality is needed in scene, can more preferably meet diversified Image Acquisition application demand.

Description

Image Acquisition control method and device
Technical field
This application involves a kind of field of terminal technology, more particularly to a kind of Image Acquisition control method and device.
Background technique
With the continuous development of image acquisition technology, the equipment for supporting Image Acquisition is continued to introduce new, and people are to acquisition The individual demand of image is also more and more.
Different from traditional camera, light-field camera is usually that a son is placed between main lens and such as CCD imaging sensor Lens array is remembered the field information of scene different directions by lenslet arrays on the focal plane of lenslet arrays Record can recorde the four-dimensional field information such as space, visual angle of three-dimensional scenic by single exposure, support " first shooting back focusing ", Image effect abundant can be generated by handling the image after shooting, such as number focusing, visual angle again can be met A variety of imaging applications such as variation, depth image, three-dimensionalreconstruction.Currently, the research of the image acquisition technology based on light-field camera is drawn Insider is played widely to pay close attention to further.
Summary of the invention
The brief overview about the application is given below, in order to provide the basic of some aspects about the application Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form, Taking this as a prelude to a more detailed description discussed later.
The embodiment of the present application provides a kind of Image Acquisition control method and device.
In a first aspect, the embodiment of the present application provides a kind of Image Acquisition control method, comprising:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, is imaged with reducing first part on the first imaging region Average blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth The sub-lens of sub-district Image Acquisition are distributed, the first part is the portion for being located at the first depth distribution sub-district in the scene Point, first imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the office of the determining scene Portion's depth distribution sub-district is the first depth distribution sub-district, comprising: the depth distribution sub-district for determining first part in the scene is The first depth distribution sub-district.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first depth distribution Sub-district is a subset of the field depth of the light-field camera.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, it is adjusted after the light Camera carries out the scene before Image Acquisition, further includes: the relatively described imaging surface tilts the second sub-lens, to increase the The average blur circle that two parts are imaged on the second imaging region, in which: second sub-lens are in the lenslet arrays Influence the sub-lens of the second depth distribution sub-district Image Acquisition, the second depth distribution sub-district and first depth distribution Area is different, and the second part is the part for being located at the second depth distribution sub-district in the scene, second imaging area Domain is imaging surface imaging region corresponding with second sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, second depth distribution Sub-district is other depth distribution sub-districts of the field depth in addition to the first depth distribution sub-district.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the first sub-lens phase After imaging surface inclination, the average blur circle that the first part is imaged on first imaging region is less than or waits Blur circle is allowed in one.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the opposite light-field camera Imaging surface tilt the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, comprising: root According to the distance between the focal length of first sub-lens, the optical center of first sub-lens and described imaging surface and described A part determines described the through the angle where the main lens imaging of the light-field camera between plane and the imaging surface The expectation tilt angle of one sub-lens;Thoroughly according at least to relatively described imaging surface inclination first son of the expectation tilt angle Mirror, to reduce the average blur circle that the first part is imaged on first imaging region.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the opposite light-field camera Imaging surface tilt the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, comprising: really The relatively described imaging surface of optical axis of fixed first sub-lens allows angular range;Angular range phase is allowed according at least to described First sub-lens are tilted to the imaging surface, with reduce the first part be imaged on first imaging region it is flat Equal blur circle.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first son is determined thoroughly The relatively described imaging surface of the optical axis of mirror allows angular range, comprising: according to the focal length of first sub-lens, first son Formed by the main lens of the distance between the optical center of lens and the imaging surface and the first part through the light-field camera As the angle between place plane and the imaging surface, the expectation tilt angle of first sub-lens is determined;According to the phase Tilt angle is hoped to allow angular range described in determining.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the opposite light-field camera Imaging surface tilt the first sub-lens, the average blur circle being imaged with reducing first part on the first imaging region, comprising: phase To the imaging surface along reducing the first part through plane where the main lens imaging of the light-field camera and described the The direction of angle between plane where one sub-lens tilts first sub-lens, to reduce the first part described the The average blur circle being imaged on one imaging region.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, relative to light-field camera at Image planes tilt before the first sub-lens, further includes: determine in the lenslet arrays to inclined first sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the sub-lens battle array is determined To inclined first sub-lens in column, comprising: determine in the lenslet arrays, with the light-field camera obtain described in The corresponding sub-lens in corresponding with the first depth distribution sub-district part in the preview image of scene, for inclined described One sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the second sub-lens phase After imaging surface inclination, the average blur circle that the second part is imaged on second imaging region is greater than one and holds Perhaps blur circle.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the relatively described imaging surface inclines Oblique second sub-lens, the average blur circle being imaged with increasing second part on the second imaging region, comprising: the relatively described imaging Face is along the increase second part through plane and the second sub-lens institute where the main lens imaging of the light-field camera The direction of angle between plane tilts second sub-lens, to increase the second part in second imaging region The average blur circle of upper imaging.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, relative to light-field camera at Image planes tilt before the second sub-lens, further includes: determine in the lenslet arrays to inclined second sub-lens.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the sub-lens battle array is determined To inclined second sub-lens in column, comprising: determine in the lenslet arrays, with the light-field camera obtain described in The corresponding sub-lens in corresponding with the second depth distribution sub-district part in the preview image of scene, for inclined described Two sub-lens.
Second aspect, the embodiment of the present application also provides a kind of Image Acquisition control devices, comprising:
One first depth distribution sub-district determining module, for determining that the partial-depth of scene is distributed sub-district for the first depth point Cloth sub-district;
One first sub-lens tilt control module, the imaging surface for opposite light-field camera tilts the first sub-lens, to subtract The average blur circle that small first part is imaged on the first imaging region, in which: first sub-lens are the light-field camera Lenslet arrays in influence the sub-lens of the first depth distribution sub-district Image Acquisition, the first part is the scene In be located at the part of the first depth distribution sub-district, first imaging region is the imaging surface and first sub-lens Corresponding imaging region;
One Image Acquisition control module carries out Image Acquisition to the scene for the light-field camera after adjusted.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first depth distribution Sub-district determining module includes: that one first depth distribution sub-district determines submodule, for determining the depth of first part in the scene Degree distribution sub-district is the first depth distribution sub-district.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first depth distribution Sub-district is a subset of the field depth of the light-field camera.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one Second sub-lens tilt control module tilts the second sub-lens for the relatively described imaging surface, to increase second part second The average blur circle being imaged on imaging region, in which: second sub-lens are to influence the second depth in the lenslet arrays The sub-lens of sub-district Image Acquisition are distributed, the second depth distribution sub-district is different from the first depth distribution sub-district, described Second part is the part for being located at the second depth distribution sub-district in the scene, and second imaging region is the imaging Face imaging region corresponding with second sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second depth distribution Sub-district is other depth distribution sub-districts of the field depth in addition to the first depth distribution sub-district.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the first sub-lens phase After imaging surface inclination, the average blur circle that the first part is imaged on first imaging region is less than or waits Blur circle is allowed in one.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens incline Oblique control module includes: that an expectation tilt angle determines submodule, for according to the focal lengths of first sub-lens, described first The main lens institute of the distance between the optical center of sub-lens and the imaging surface and the first part through the light-field camera at As the angle between place plane and the imaging surface, determine the expectation tilt angle of first sub-lens;One angle is inclined Oblique control submodule, for tilting first sub-lens according at least to the relatively described imaging surface of the expectation tilt angle, with Reduce the average blur circle that the first part is imaged on first imaging region.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens incline Oblique control module includes: that angular range is allowed to determine submodule, and the optical axis for determining first sub-lens is relatively described Imaging surface allows angular range;
One angular range inclination control submodule, for allowing the relatively described imaging surface of angular range to incline according at least to described Oblique first sub-lens, to reduce the average blur circle that the first part is imaged on first imaging region.
It is optionally, described to allow angular range in conjunction with any Image Acquisition control device provided by the embodiments of the present application Determine that submodule includes: an expectation tilt angle determining unit, for focal length, first son according to first sub-lens Formed by the main lens of the distance between the optical center of lens and the imaging surface and the first part through the light-field camera As the angle between place plane and the imaging surface, the expectation tilt angle of first sub-lens is determined;One allows angle Range determination unit, for allowing angular range according to expectation tilt angle determination.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens incline Oblique control module includes: one first sub-lens inclination control submodule, for the relatively described imaging surface described first along reduction Angle where plane where the main lens imaging of light-field camera described in lease making and first sub-lens between plane Direction tilts first sub-lens, to reduce the average disperse that the first part is imaged on first imaging region Circle.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one First sub-lens determining module, for determining in the lenslet arrays to inclined first sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens are true Cover half block includes: that one first sub-lens determine submodule, for determining in the lenslet arrays, is obtained with the light-field camera The scene preview image in the corresponding sub-lens in corresponding with the first depth distribution sub-district part, for inclined First sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the second sub-lens phase After imaging surface inclination, the average blur circle that the second part is imaged on second imaging region is greater than one and holds Perhaps blur circle.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second sub-lens incline Oblique control module includes: one second sub-lens inclination control submodule, for the relatively described imaging surface described second along increase Angle where plane where the main lens imaging of light-field camera described in lease making and second sub-lens between plane Direction tilts second sub-lens, to increase the average disperse that the second part is imaged on second imaging region Circle.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one Second sub-lens determining module, for determining in the lenslet arrays to inclined second sub-lens.
In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second sub-lens are true Cover half block includes: that one second sub-lens determine submodule, for determining in the lenslet arrays, is obtained with the light-field camera The scene preview image in the corresponding sub-lens in corresponding with the second depth distribution sub-district part, for inclined Second sub-lens.
The third aspect, the embodiment of the present application also provides another Image Acquisition control devices, comprising:
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface with And the memory completes mutual communication by the communication bus;
The memory is for storing at least one instruction;Described instruction makes the processor execute following operation:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, is imaged with reducing first part on the first imaging region Average blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth The sub-lens of sub-district Image Acquisition are distributed, the first part is the portion for being located at the first depth distribution sub-district in the scene Point, first imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
Technical solution provided by the embodiments of the present application can determine partial-depth distribution sub-district (i.e. " the first depth point of scene Cloth sub-district "), pass through the side of the sub-lens (i.e. " the first sub-lens ") of the first depth distribution sub-district Image Acquisition described in obliquity effects Formula, so that the part (i.e. " first part ") in the scene positioned at the first depth distribution sub-district is in the light-field camera The size for the average blur circle being imaged on imaging region (i.e. " the first imaging region ") corresponding with first sub-lens is Reduce, thus improves the image quality of the first part.Since the first depth distribution sub-district can according to actual needs really It is fixed, and can be improved by way of corresponding first sub-lens of inclination light-field camera corresponding to the first depth distribution sub-district the A part carries out the image quality of optically detecting, and therefore, technical solution provided by the embodiments of the present application is advantageously implemented in scene The customization Image Acquisition of the depth distribution sub-district compared with high imaging quality is needed, diversified Image Acquisition application can be more preferably met Demand.
By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application Advantage will be apparent from.
Detailed description of the invention
The application can be by reference to being better understood, wherein in institute below in association with description given by attached drawing Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings:
Fig. 1 is a kind of Image Acquisition control method flow chart provided by the embodiments of the present application;
Fig. 2 a is that part sub-lens provided by the embodiments of the present application tilt example one;
Fig. 2 b is that part sub-lens provided by the embodiments of the present application tilt example two;
Fig. 3 is that the example of each depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep It spends continuously distributed;
Fig. 4 a is that the elongated surfaces of relevant three planes of husky nurse law provided by the embodiments of the present application intersect example one;
Fig. 4 b is that the elongated surfaces of relevant three planes of husky nurse law provided by the embodiments of the present application intersect example two;
Fig. 5 is the first sub-lens inclined direction example provided by the embodiments of the present application;
Fig. 6 is light-field camera topology example provided by the embodiments of the present application;
Fig. 7 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application;
Fig. 8 is the logic diagram of second of Image Acquisition control device provided by the embodiments of the present application;
Fig. 9 is the logic diagram of the third Image Acquisition control device provided by the embodiments of the present application;
Figure 10 is the logic diagram of the 4th kind of Image Acquisition control device provided by the embodiments of the present application.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear, And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with Just the understanding to the embodiment of the present application is helped to improve.
Specific embodiment
It is described in detail hereinafter in connection with exemplary embodiment of the attached drawing to the application.It rises for clarity and conciseness See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from For those skilled in the art of present disclosure, this development is only routine task.
Here, also it should be noted is that, in order to avoid having obscured the application because of unnecessary details, in attached drawing and It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.
(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.
Fig. 1 is a kind of flow chart of Image Acquisition control method provided by the embodiments of the present application.The embodiment of the present application provides The executing subject of Image Acquisition control method can be a certain Image Acquisition control device.Described image acquisition control device is set The standby form of expression is unrestricted, such as described image acquisition control device can be a certain independent component;Alternatively, described image is adopted Collection control device can be used as a certain functional module and be integrated in an imaging device, and the imaging device may include but be not limited to light field Camera includes the mobile phone of light-field camera, tablet computer etc., and the embodiment of the present application is not intended to limit this.It is specific as shown in Figure 1, A kind of Image Acquisition control method provided by the embodiments of the present application includes:
S101: the partial-depth distribution sub-district for determining scene is the first depth distribution sub-district.
S102: the imaging surface of opposite light-field camera tilts the first sub-lens, to reduce first part in the first imaging region The average blur circle of upper imaging, in which: first sub-lens be the light-field camera lenslet arrays in influence described the The sub-lens of one depth distribution sub-district Image Acquisition, the first part are to be located at the first depth distribution in the scene The part in area, first imaging region are imaging surface imaging region corresponding with first sub-lens.
S103: the light-field camera after adjusted carries out Image Acquisition to the scene.
Object through such as light-field camera imaging device is imaged when, be ideally object plane and image planes be point with put one One is corresponding, but in actual application, due to the influence of the factors such as light wave property, aberration, the imaging of the point on object Beam generally can not converge at a bit, but the circular spread, ellipse or other similar rounds are formed on as plane Projection, referred to as blur circle (circle of confusion), alternatively referred to as figure of confusion, dispersion ring, circle of confusion, the circle of confusion, scattering Disk etc..If the size of blur circle is smaller, the imaging of the corresponding object of the usual blur circle is comparatively clear, visually can quilt It is considered as the focus imaging of the point;Correspondingly, the blur circle is corresponding if the size of blur circle is more than certain permissible range The imaging Relative Fuzzy of object.
In general, light-field camera includes the main lens, lenslet arrays and imaging sensor set gradually along depth direction.Light When field camera is in the states of tilt operations such as the sub-lens for not carrying out that the embodiment of the present application refers to, the sub-lens battle array of light-field camera Each sub-lens are usually located at the same plane perpendicular to depth direction in column, and the optical axis of each sub-lens is parallel with depth direction, figure Plane as where sensor is the imaging surface of light-field camera, the imaging surface be parallel to the plane where lenslet arrays and this at Image planes vertical depth direction.According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens to master Lens imaging (such as real image or the virtual image) reimaging on the corresponding imaging region of the sub-lens, the different positions on imaging region The pixel set can store the field information of the object of different depth in scene, corresponding in scene certain object it is at least local The blur circle being imaged through a certain sub-lens in certain pixel of imaging sensor are as follows:
In above formula: the equivalent diameter of c expression blur circle;F indicates the focal length of the sub-lens;V indicates at least office of the object Successively for imaging at a distance from the sub-lens center, which is equivalent to the sub-lens after main lens and the sub-lens in portion Image distance;vnIndicate the distance between lenslet arrays plane and image sensor plane;N indicates f-number (f-number).
Based on light-field camera carry out Image Acquisition application scenarios in, usual imaging sensor it is corresponding with the sub-lens at As region includes the pixel of multiple array distributions, not all pixels point of the imaging region participates in actual Image Acquisition, But partial pixel point participates in actual Image Acquisition, physical record has each pixel of the object images information in imaging region Blur circle mean value, can be considered the object in the size of the average blur circle of the imaging region.It, should before and after sub-lens inclination Imaging region participates in the pixel of the object actual image acquisition and/or pixel quantity may be identical or different.It can be by the son Physical record has the mean value of the blur circle of each pixel of the object images information in the imaging region before lens tilt, as this The size of average blur circle before sub-lens inclination;Physical record in the imaging region after sub-lens inclination there is into the object The mean value of the blur circle of each pixel of image information, the size as the average blur circle after sub-lens inclination.
Each sub-lens can be considered a thin lens in the lenslet arrays of light-field camera, and the Optical Formula of thin lens is such as Under:
In above formula: u indicates the object distance of sub-lens, i.e. main lens imaging of the object through light-field camera and the sub-lens Distance;The image distance of v expression sub-lens;The focal length of f expression sub-lens.
In conjunction with formula (1) and (2) it is found that the embodiment of the present application can change sub-lens by way of tilting sub-lens Object distance u causes the change of corresponding blur circle to cause the image distance v of sub-lens that corresponding change occurs, meanwhile, sub-lens are inclined The average blur circle that average blur circle after tiltedly is less than before sub-lens inclination makes as the condition of convergence of sub-lens inclination control Sub-lens with respect to imaging surface adopt by some way inclination after can reach accordingly averagely blur circle with respect to sub-lens tilt before Corresponding average blur circle is reduced.
As it can be seen that the embodiment of the present application can determine that the partial-depth distribution sub-district of scene (might as well be known as " the first depth distribution Area "), pass through the sub-lens of the first depth distribution sub-district Image Acquisition described in obliquity effects (" the first sub-lens " might as well be known as) Mode, optional example is as shown in Figure 2 a, so that the part in the scene positioned at the first depth distribution sub-district (might as well be known as " first part ") imaging region corresponding with first sub-lens (might as well be known as " the first imaging area in the light-field camera Domain ") on the size of average blur circle that is imaged reduced, thus improve the image quality of the first part.Due to described First depth distribution sub-district can determine according to actual needs, and can be mentioned by way of corresponding first sub-lens of inclination light-field camera Height carries out the image quality of optically detecting to the corresponding first part of the first depth distribution sub-district, and therefore, the application is implemented The technical solution that example provides, which is advantageously implemented, needs the customization image of the depth distribution sub-district compared with high imaging quality to adopt in scene Collection, can more preferably meet diversified Image Acquisition application demand.
In technical solution provided by the embodiments of the present application, the method for determination of the first depth distribution sub-district is very flexible, Diversified practical application request can be met.For example, if more paid close attention to a certain depth distribution sub-district, it may be determined that scene is corresponding Depth distribution sub-district be the first depth distribution sub-district, improve scene in a manner of by tilting corresponding first sub-lens In be located at the first depth distribution sub-district in part image quality;Alternatively, if content to be taken the photograph to certain in scene (such as first Part) more to pay close attention to, it may be determined that the depth distribution sub-district of first part is the first depth distribution sub-district in the scene, with Improve the image quality of the first part by way of tilting corresponding first sub-lens;Etc..It is appreciated that the application The part that embodiment refers to may include the part, etc. of complete an object or a certain complete object.
Optionally, the first depth distribution sub-district is a subset of the field depth of the light-field camera, that is to say, that The corresponding depth bounds of the first depth distribution sub-district are located within the field depth.The depth of field (Depth of Field, letter Claim DoF) typically refer to the object distance range that pick-up lens is capable of blur-free imaging to scene, that is to say, that it is opposite in the depth direction Certain depth range before and after the focusing object plane of pick-up lens can blur-free imaging.When operations such as the adjustment of light-field camera aperture, focusings After completion, the field depth of the light-field camera generally also determines therewith, which is opposite light field phase on depth direction Certain object distance range of owner's lens.By an optically detecting of light-field camera, the part in field depth is located in scene The blur circle size of imaging is smaller, usually can blur-free imaging, and be located at field depth outside part imaging blur circle size compared with Greatly, imaging is typically more fuzzy.The program can determine that the subset that scene is located in light-field camera field depth is described first Depth distribution sub-district further increases the first depth distribution sub-district corresponding first by way of tilting corresponding first sub-lens Partial image quality.
In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, it is described it is adjusted after institute Before light-field camera is stated to scene progress Image Acquisition, further includes: the relatively described imaging surface tilts the second sub-lens, to increase The average blur circle that big second part is imaged on the second imaging region, in which: second sub-lens are the sub-lens battle array The sub-lens of the second depth distribution sub-district Image Acquisition, the second depth distribution sub-district and first depth point are influenced in column Cloth sub-district is different, and the second part is the part for being located at the second depth distribution sub-district in the scene, the second one-tenth described As region is imaging surface imaging region corresponding with second sub-lens.It is desirable to light fields to adopt in certain application scenarios The theme of the image collected is prominent, for this purpose, on the one hand can be by improving user's theme (such as the first part) of interest Image quality, on the other hand, the image quality for the other parts (such as described second part) that can also be not concerned with by reduction user, So that light-field camera is in the collected general image of scene, the image quality of the first part and the second part at As a degree of comparison of the form of quality, more outstanding vision effect of the first part in general image is thereby resulted in Fruit.
Optionally, the second depth distribution sub-district is the field depth in addition to the first depth distribution sub-district Other depth distribution sub-districts.For example, as shown in figure 3, a certain subset in the field depth be the first depth distribution sub-district, its He is partially the second depth distribution sub-district, can by the first sub-lens of obliquity effects the first depth distribution sub-district Image Acquisition come The image quality (as reduced the average blur circle of first part's imaging to improve clarity) of first part is improved, meanwhile, pass through Second sub-lens of obliquity effects the second depth distribution sub-district Image Acquisition reduce the image quality of second part (as reduced by the The average blur circle of two parts imaging is to reduce clarity) so that the imaging theme of the first part is more prominent.This Outside, certain application scenarios need to obtain the Image Acquisition of the shallow depth of field, and large aperture usually can be used to adopt to obtain the image of the shallow depth of field Collection, however, large aperture is expensive, and in some cases, the depth distribution of the object (such as first part) of user's concern Range is small, the field depth (i.e. the first depth distribution sub-district is less than field depth) even less than under the aperture adjustment limit, and is somebody's turn to do Under situation, if the first sub-lens of inclination reduce the average blur circle that first part be imaged in the first imaging region, the is tilted Two sub-lens increase the average blur circle that second part is imaged in the second imaging region, as shown in Figure 2 b, may make depth of field model Concern part (the corresponding first part of such as the first depth distribution sub-district) in enclosing is relatively sharp and non-concerned department in field depth The clarity of point (the corresponding second part of such as the second depth distribution sub-district) decreases, thereby increase in field depth this two The comparison of part image quality is equivalent to and increases effective f-number, reduces original field depth, though light-field camera not more It changes in the case of large aperture, also can get the Image Acquisition effect that first part's theme is more prominent, the depth of field is more shallow, be conducive to drop Low cost more preferably meets diversified Image Acquisition application demand.
In technical solution provided by the embodiments of the present application, it can be treated and be inclined according to the condition of convergence for reducing corresponding averagely blur circle The first oblique sub-lens carry out inclination control with respect to imaging surface, and implementation is very flexible.
Optionally, after the relatively described imaging surface inclination of first sub-lens, the first part is the first one-tenth described Blur circle is allowed as the average blur circle being imaged on region is less than or equal to one.If blur circle is allowed more less than or equal to a certain Circle (permissible circle of confusion) is dissipated, can be considered corresponding photographing section focus imaging;Correspondingly, if Blur circle is greater than this and allows blur circle, can be considered corresponding photographing section imaging out of focus.The size for allowing blur circle and object distance, The factors such as enlargement ratio are related, can predefine and allow blur circle size, such as described to allow blur circle size be 1/30mm etc. Deng.The program is equivalent to during the first sub-lens inclination control, and the average blur circle after the inclination of the first sub-lens is less than Or allow blur circle as the condition of convergence of the first sub-lens inclination control equal to one, that is to say, that tilt in the first sub-lens In control process, if the average blur circle that the first sub-lens are located under a certain heeling condition and the corresponding heeling condition be less than or Blur circle is allowed equal to described, then the inclination control of achievable first sub-lens, in this way, the light-field camera after adjusted obtains field The Image Acquisition of scape can get the higher image quality of first part, is thus advantageously implemented in scene and needs compared with high imaging quality Depth distribution sub-district customization Image Acquisition.
Optionally, the imaging surface of the opposite light-field camera tilts the first sub-lens, to reduce first part at the first one-tenth As the average blur circle being imaged on region, comprising: according to the focal length of first sub-lens, first sub-lens optical center and The distance between described imaging surface and the first part are through plane where the main lens imaging of light-field camera and described Angle between imaging surface determines the expectation tilt angle of first sub-lens;According at least to the expectation tilt angle phase First sub-lens are tilted to the imaging surface, with reduce the first part be imaged on first imaging region it is flat Equal blur circle.
In light-field camera, after first sub-lens are with respect to imaging surface (plane where image sensing cell) inclination, institute Plane and the imaging surface of light-field camera are no longer parallel where stating the first sub-lens.With reference to husky nurse law (Scheimpflug Principle), saturating through the elongated surfaces of plane, first son where the main lens imaging of light-field camera when first part Elongated surfaces, the elongated surfaces of the imaging surface of the light-field camera of plane where after mirror inclination, when three mutually gives line always, such as scheme Shown in 4a, the region that the first part can get blur-free imaging is maximum, and under the situation, the first part is through light-field camera Plane where main lens imaging is equivalent to a focal plane (Plane of Focus), the main lens institute through light-field camera At the average blur circle that is imaged on the first imaging region of the imaging surface of picture it is minimum.Meet the first son of above-mentioned law thoroughly The tilt angle of mirror can be expectation tilt angle described in the embodiment of the present application.
In the embodiment of the present application, depth distribution sub-district (such as the first depth distribution sub-district or the second depth distribution sub-district) includes Depth bounds and quantity can flexibly be determined according to the depth information of the scene, to meet diversified application demand.For example, Each pixel that connection can be determined according to the overall depth figure of the scene, calculates the normal direction of the pixel of each connection, and Based on the normal direction of each pixel, these pixels are grouped, such as the angle according to normal direction relative depth direction It is grouped, be 135 degree to 150 degree by normal direction and depth direction angle is one group, and/or, by normal direction and depth Angular separation is 45 degree to 60 degree etc., the corresponding depth bounds of pixel that thus each group respectively includes, respectively as one Depth distribution sub-district, etc. is conducive to determine that the depth distribution sub-district includes using the depth distribution sub-district that the program determines Part is through the plane where main lens imaging, using one of the foundation as corresponding sub-lens inclination control.
When first part inclines through the elongated surfaces of plane, first sub-lens where the main lens imaging of light-field camera Elongated surfaces, the elongated surfaces of the imaging surface of the light-field camera of plane where after tiltedly, when three mutually gives line always, described first What part was imaged on imaging surface imaging region (i.e. the first imaging region) corresponding with first sub-lens is averaged more It is minimum to dissipate circle, the angle of the relatively described imaging surface of the first sub-lens is expectation inclination angle described in the embodiment of the present application Degree.
Optionally, as shown in Figure 4 b, following formula calculating can be used in the expectation tilt angle of first sub-lens:
In above formula: θ indicates the first sub-lens with respect to the tilt angle of imaging surface, i.e. the expectation inclination angle of the first sub-lens Degree;F indicates the focal length of the first sub-lens;Indicate the main lens institute of imaging surface and first part through light-field camera of light-field camera At the plane as place between angle;V indicates the distance between imaging plane and the first sub-lens optical center.According at least to this The relatively described imaging surface of the expectation tilt angle that scheme determines tilts first sub-lens, so where first sub-lens The tilt angle of the relatively described imaging surface of plane as close possible to the even equal to described expectation tilt angle, and first son thoroughly Mirror be in inclination after in the state of carry out Image Acquisition when, what the first part was imaged on first imaging region is averaged Blur circle is as small as possible.The program improves the efficiency of the first sub-lens inclination control.
Optionally, the imaging surface of the opposite light-field camera tilts the first sub-lens, to reduce first part at the first one-tenth As the average blur circle being imaged on region, comprising: determine that the optical axis of the first sub-lens relatively described imaging surface allows to press from both sides Angular region;The angular range imaging surface relatively is allowed to tilt first sub-lens according at least to described, to reduce described the The average blur circle that a part is imaged on first imaging region.Using program imaging surface inclination relatively described the One sub-lens, first sub-lens place plane after inclination and the angle between the imaging surface allow angle described in falling into Range.Wherein, described to allow angular range be according under the requirement that can bring corresponding averagely blur circle reduction after lens tilt It flexibly determines, the embodiment of the present application is not intended to limit this.The program improves the efficiency of the first sub-lens inclination control.
It is described allow angular range that can be tilted according to sub-lens after can bring under the requirement that blur circle reduces corresponding averagely It predefines, determining method may include but be not limited to determine using modes such as laboratory facilities, analog simulation, the derivations of equation.It can Choosing, determine the relatively described imaging surface of the optical axis of first sub-lens allows angular range, comprising: according to first son Described in the distance between the focal length of lens, the optical center of first sub-lens and described imaging surface and first part warp Angle where the main lens imaging of light-field camera between plane and the imaging surface, determines the phase of first sub-lens Hope tilt angle;Angular range is allowed according to expectation tilt angle determination.The determination side of the expectation tilt angle Method can refer to record above, after the expectation tilt angle has been determined, in combination with the first sub-lens tilt adjustment of consideration Precision limits, to factors such as first part's image quality requirements, it would be desirable to angle of the tilt angle in certain range of allowable error Degree range allows angular range described in being used as.Allow angular range relatively reasonable using described in program determination, is based on the appearance Perhaps angular range carries out inclination control of first sub-lens with respect to imaging surface, high-efficient and be easier to realize.
Optionally, the imaging surface of the opposite light-field camera tilts the first sub-lens, to reduce first part at the first one-tenth As the average blur circle being imaged on region, comprising: the relatively described imaging surface is along the reduction first part through the light-field camera Main lens imaging where angle where plane and first sub-lens between plane direction inclination described first Sub-lens, to reduce the average blur circle that the first part is imaged on first imaging region.With reference to husky nurse law, when First part is flat where after the elongated surfaces of plane, first sub-lens inclination where the main lens imaging of light-field camera The elongated surfaces of the imaging surface of the elongated surfaces in face, the light-field camera, when three mutually gives line always, the first part be can get The region of blur-free imaging is maximum.As shown in figure 5, the plane where before the inclination of the first sub-lens, with first part through light-field camera Main lens imaging where face between angle be A1, the first sub-lens phase can be made along the direction for reducing the angle Imaging surface is tilted, the plane as where after the inclination of the first sub-lens, and formed by main lens of the first part through light-field camera As place face between angle be A2, A2Less than A1, it is seen then that first sub-lens are flat where it after tilting towards the direction Face and first part are through the face where the main lens imaging of light-field camera and the plane three where the imaging surface Intersect collinear probability to significantly increase, thus can reduce first part the imaging surface the first imaging region institute at Picture average blur circle, improve acquired image described in first part image quality.Further, if this inclined Tilted direction and the expectation tilt angle then can further improve son collectively as the foundation of the first sub-lens inclination control The efficiency of lens tilt control;Alternatively, if by the inclined direction and it is described allow angular range collectively as it is described first son The foundation of lens tilt control, then can further improve the efficiency of sub-lens inclination control.
Optionally, before imaging surface the first sub-lens of inclination of opposite light-field camera, further includes: determine the sub-lens battle array To inclined first sub-lens in column.It can be determined described in influence in the lenslet arrays of light-field camera using the program The sub-lens of first depth distribution sub-district Image Acquisition, as described first sub-lens are sub by will determine first later Lens carry out tilt adjustments with respect to imaging surface, so that the first part in the first depth distribution sub-district is in the imaging surface The average blur circle being imaged on first imaging region is reduced, and the image quality of the first part is thus improved.Influence institute The first sub-lens for stating the Image Acquisition of the first part in the first depth distribution sub-district may be one or more, can be to determination Each of the first sub-lens the relatively described imaging surface is tilted respectively, and by the first part after tilting it is corresponding son thoroughly The average blur circle of imaging is reduced the convergence item as corresponding sub-lens inclination control on the corresponding imaging region of mirror Thus part improves the whole image quality of first part.
It is further alternative, it determines in the lenslet arrays to inclined first sub-lens, comprising: described in determining In lenslet arrays, with the light-field camera obtain the scene preview image in the first depth distribution sub-district pair The corresponding sub-lens in the part answered, for inclined first sub-lens.A kind of optional implementation, the light-field camera In, as shown in fig. 6, the focal length for each sub-lens that the lenslet arrays include is identical, imaging surface is (such as described image sensor institute Face) at a distance from the lenslet arrays be equal to the sub-lens focal length;It is a certain based on light-field camera acquisition scene The spatial resolution of the image (such as described preview image) at visual angle is corresponding with the distribution of the sub-lens of the lenslet arrays, every height Lens correspond to a certain imaging region of described image sensor, and each imaging region includes the multiple pixels of array distribution, by this Imaging region records the sub-lens to the light information of the different directions in certain portion from the scene, that is, the light-field camera In, there are corresponding relationships between the pixel distribution of the preview image and the distribution of the sub-lens of the lenslet arrays, therefore, It can be according to part corresponding with the first depth distribution sub-district in the preview image for the scene that the light-field camera obtains Corresponding sub-lens, to influence the first depth distribution sub-district Image Acquisition, to inclined first sub-lens.Using the program Determine first sub-lens, method is simply easily realized.
In technical solution provided by the embodiments of the present application, it can be treated and be inclined according to the condition of convergence for increasing corresponding averagely blur circle The second oblique sub-lens carry out inclination control with respect to imaging surface, and implementation is very flexible.
Optionally, after the relatively described imaging surface inclination of second sub-lens, the second part is the second one-tenth described Blur circle is allowed as the average blur circle being imaged on region is greater than one.The size for allowing blur circle and object distance, enlargement ratio Etc. factors it is related, can predefine and allow blur circle size, such as described to allow blur circle size be 1/30mm etc..The program It is equivalent to during the second sub-lens inclination control, the average blur circle after the inclination of the second sub-lens is greater than one and allows disperse The condition of convergence of the circle as the second sub-lens inclination control, that is to say, that during the second sub-lens inclination control, if the The average blur circle that two sub-lens are located under a certain heeling condition and the corresponding heeling condition allows blur circle described in being greater than, then may be used The inclination control of the second sub-lens is completed, in this way, the light-field camera after adjusted obtains the second of the Image Acquisition acquisition of scene Part image quality decreases, and is thus conducive to present a contrast with the image quality of the first part, so that described first Partial image subject is more prominent, help to obtain the shallow depth image of the first part.
Optionally, the imaging surface tilts the second sub-lens relatively, with increase second part on the second imaging region at The average blur circle of picture, comprising: the relatively described imaging surface is along the increase main lens institute of the second part through the light-field camera At the direction of the angle as where place plane and second sub-lens between plane tilt second sub-lens, to increase The average blur circle that the big second part is imaged on second imaging region.With reference to husky nurse law, when second part passes through The extension of plane where after the elongated surfaces of plane, second sub-lens inclination where the main lens imaging of light-field camera Face, the light-field camera imaging surface elongated surfaces, when three mutually gives line always, the second part can get blur-free imaging Region it is maximum, in order to reduce the image quality of the second part, make the second part seem more to obscure, can reduce Above-mentioned three intersects at the probability of a straight line.Specifically, it is assumed that the plane where before the inclination of the second sub-lens, with second part The angle between face where main lens imaging through light-field camera is B1, described the can be made along the direction for increasing the angle Two sub-lens tilt (inclined direction can be opposite with sub-lens inclined direction as arrows in fig. 5) with respect to imaging surface, and such as second Plane where before sub-lens inclination, with second part through the angle between the face where the main lens imaging of light-field camera For B2, B2Greater than B1, it is seen then that plane where it is with second part through light field phase after second sub-lens are tilted towards the direction Plane three where face and the imaging surface where the main lens imaging of machine, which intersects collinear probability, to reduce , thus can increase second part in the average blur circle of the second imaging region imaging of the imaging surface, reduction is adopted The image quality of second part described in the image of collection.
Optionally, before imaging surface the second sub-lens of inclination of opposite light-field camera, further includes:
It determines in the lenslet arrays to inclined second sub-lens.It can be in the son of light-field camera using the program Determine to influence the sub-lens of the second depth distribution sub-district Image Acquisition in lens array, as described second sub-lens, Tilt adjustments are carried out with respect to imaging surface by the second sub-lens that will be determined later, so that in the second depth distribution sub-district The average blur circle that is imaged on the second imaging region of the imaging surface of second part increased, thus reduce described The image quality of two parts.The second sub-lens for influencing the Image Acquisition of the second part in the second depth distribution sub-district can Can be one or more, can to each of determining second sub-lens, the relatively described imaging surface is tilted respectively, and by described the The average blur circle of imaging increased as phase on the corresponding imaging region of corresponding sub-lens of two parts after tilting The condition of convergence of sub-lens inclination control is answered, the whole image quality of second part is thus reduced.
It is further alternative, it determines in the lenslet arrays to inclined second sub-lens, comprising: described in determining In lenslet arrays, with the light-field camera obtain the scene preview image in the second depth distribution sub-district pair The corresponding sub-lens in the part answered, for inclined second sub-lens.Second sub-lens are determined using the program, side Method is simply easily realized.
It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and Any restriction should not be constituted to the implementation process of the application specific embodiment.
Fig. 7 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application.As shown in fig. 7, this The first Image Acquisition control device that application embodiment provides includes: one first depth distribution sub-district determining module 71,1 the One sub-lens tilt control module 72 and an Image Acquisition control module 73.
First depth distribution sub-district determining module 71 is used to determine that the partial-depth distribution sub-district of scene to be the first depth point Cloth sub-district.
The imaging surface that first sub-lens tilt control module 72 is used for opposite light-field camera tilts the first sub-lens, to reduce The average blur circle that first part is imaged on the first imaging region, in which: first sub-lens are the light-field camera The sub-lens of the first depth distribution sub-district Image Acquisition are influenced in lenslet arrays, the first part is in the scene Positioned at the part of the first depth distribution sub-district, first imaging region is the imaging surface and first sub-lens pair The imaging region answered.
Image Acquisition control module 73 carries out Image Acquisition to the scene for the light-field camera after adjusted.
Image Acquisition control device provided by the embodiments of the present application can determine the partial-depth distribution sub-district (i.e. " the of scene One depth distribution sub-district "), by the sub-lens of the first depth distribution sub-district Image Acquisition described in obliquity effects, (i.e. " the first son is thoroughly Mirror ") mode so that in the scene positioned at the first depth distribution sub-district part (i.e. " first part ") in the light The average blur circle being imaged on imaging region (i.e. " the first imaging region ") corresponding with first sub-lens in the camera of field Size is reduced, and the image quality of the first part is thus improved.Since the first depth distribution sub-district can be according to reality Border it needs to be determined that, and can be improved by way of corresponding first sub-lens of inclination light-field camera to the first depth distribution sub-district Corresponding first part carries out the image quality of optically detecting, and therefore, technical solution provided by the embodiments of the present application is conducive to reality The customization Image Acquisition of the depth distribution sub-district compared with high imaging quality is needed in live scape, can more preferably meet diversified image Acquisition applications demand.
The equipment form of expression of described image acquisition control device is unrestricted, such as described image acquisition control device can For a certain independent component;Alternatively, described image acquisition control device, which can be used as a certain functional module, is integrated in an imaging device In, the imaging device may include but be not limited to light-field camera or include the mobile phone of light-field camera, tablet computer etc., the application Embodiment is not intended to limit this.
Optionally, as shown in figure 8, the first depth distribution sub-district determining module 71 includes: one first depth distribution Area determines submodule 711.First depth distribution sub-district determines submodule 711 for determining the depth of first part in the scene Distribution sub-district is the first depth distribution sub-district.If content (such as first part) to be taken the photograph to certain in scene is more paid close attention to, The depth distribution sub-district that can determine first part in the scene is the first depth distribution sub-district, by tilting corresponding the The mode of one sub-lens improves the image quality of the first part.
Optionally, the first depth distribution sub-district is a subset of the field depth of the light-field camera.The program can It determines that the subset that scene is located in light-field camera field depth is the first depth distribution sub-district, passes through inclination corresponding first The mode of sub-lens further increases the image quality of the corresponding first part of the first depth distribution sub-district.
Optionally, described image acquisition control device further include: one second sub-lens tilt control module 74.Second son is thoroughly Mirror tilt control module 74 tilts the second sub-lens for the relatively described imaging surface, to increase second part in the second imaging region The average blur circle of upper imaging, in which: second sub-lens are to influence the second depth distribution sub-district in the lenslet arrays The sub-lens of Image Acquisition, the second depth distribution sub-district is different from the first depth distribution sub-district, the second part For in the scene be located at the second depth distribution sub-district part, second imaging region be the imaging surface with it is described The corresponding imaging region of second sub-lens.The theme of the image arrived in certain application scenarios it is desirable to optical field acquisition is prominent, is On the other hand this, on the one hand can also be led to by improving the image quality of user's theme (such as described first part) of interest The image quality for reducing the other parts (such as described second part) that user is not concerned with is crossed, so that light-field camera collects scene General image in, the image quality of the image quality of the first part and the second part forms a degree of ratio Compared with thereby resulting in more outstanding visual effect of the first part in general image.
Optionally, the second depth distribution sub-district is the field depth in addition to the first depth distribution sub-district Other depth distribution sub-districts.The program may make concern part (such as the first depth distribution sub-district corresponding in field depth A part) it is relatively sharp and do not paid close attention in field depth part (the corresponding second part of such as the second depth distribution sub-district) it is clear Clear degree decreases, and thereby increases the comparison of this two parts image quality field depth Nei, be equivalent to increase effective f-number, Original field depth is reduced, even if also can get first part's theme more in the case of light-field camera is changed without large aperture For the Image Acquisition effect that protrusion, the depth of field are more shallow, cost is advantageously reduced, more preferably meets diversified Image Acquisition application need It asks.
Optionally, after the relatively described imaging surface inclination of first sub-lens, the first part is the first one-tenth described Blur circle is allowed as the average blur circle being imaged on region is less than or equal to one.During the first sub-lens inclination control, such as The average blur circle that the first sub-lens of fruit are located under a certain heeling condition and the corresponding heeling condition is allowed described in being less than or equal to Blur circle, the then inclination control of achievable first sub-lens, in this way, the light-field camera after adjusted obtains the Image Acquisition of scene It can get the higher image quality of first part, be thus advantageously implemented depth distribution needed in scene compared with high imaging quality The customization Image Acquisition in area.
Optionally, as shown in figure 9, the first sub-lens tilt control module 72 includes: that an expectation tilt angle determines Submodule 721 and an angle tilt control submodule 722.It is expected that tilt angle determines submodule 721 for according to described first The distance between the focal length of sub-lens, the optical center of first sub-lens and described imaging surface and the first part are through institute Angle where stating the main lens imaging of light-field camera between plane and the imaging surface, determines first sub-lens It is expected that tilt angle;Angle tilt control submodule 722 is used for according at least to the relatively described imaging surface of expectation tilt angle First sub-lens are tilted, to reduce the average blur circle that the first part is imaged on first imaging region.It should Scheme improves the efficiency of the first sub-lens inclination control.
Optionally, the first sub-lens tilt control module 72 includes: that angular range is allowed to determine 723 He of submodule One angular range inclination control submodule 724.Angular range is allowed to determine submodule 723 for determining first sub-lens The relatively described imaging surface of optical axis allows angular range;Angular range inclination control submodule 724 is used for according at least to the appearance Perhaps the relatively described imaging surface of angular range tilts first sub-lens, to reduce the first part in first imaging area The average blur circle being imaged on domain.The program improves the efficiency of the first sub-lens inclination control.
Optionally, described that angular range is allowed to determine that submodule 723 includes: 7231 He of an expectation tilt angle determining unit One allows angular range determination unit 7232.It is expected that tilt angle determining unit 7231 is used for the coke according to first sub-lens Away from the distance between, the optical center of first sub-lens and the imaging surface and the first part through the light-field camera Main lens imaging where angle between plane and the imaging surface, determine the expectation inclination angle of first sub-lens Degree;Allow angular range determination unit 7232 for allowing angular range according to expectation tilt angle determination.Using The program determine it is described allow angular range relatively reasonable, allowing angular range to carry out based on this, the first sub-lens are opposite to be imaged The inclination control in face, it is high-efficient and be easier to realize.
Optionally, the first sub-lens tilt control module 72 includes: one first sub-lens inclination control submodule 725.First sub-lens inclination control submodule 725 is for the relatively described imaging surface along the reduction first part through the light field Described in the direction inclination of angle where plane where the main lens imaging of camera and first sub-lens between plane First sub-lens, to reduce the average blur circle that the first part is imaged on first imaging region.The program can mention The image quality of first part described in high acquired image.
Optionally, as shown in figure 8, described image acquisition control device further include: one first sub-lens determining module 75.The One sub-lens determining module 75 is for determining in the lenslet arrays to inclined first sub-lens.It can using the program Determine to influence the sub-lens of the first depth distribution sub-district Image Acquisition, as institute in the lenslet arrays of light-field camera The first sub-lens are stated, tilt adjustments are carried out with respect to imaging surface by the first sub-lens that will be determined later, so that described first The average blur circle that first part in depth distribution sub-district is imaged on the first imaging region of the imaging surface is reduced, Thus the image quality of the first part is improved.
Optionally, the first sub-lens determining module 75 includes: that one first sub-lens determine submodule 751.First son Lens determine preview of the submodule 751 for determining in the lenslet arrays, with the scene of light-field camera acquisition The corresponding sub-lens in corresponding with the first depth distribution sub-district part in image, for inclined first sub-lens. First sub-lens are determined using the program, method is simply easily realized.
Optionally, after the relatively described imaging surface inclination of second sub-lens, the second part is the second one-tenth described Blur circle is allowed as the average blur circle being imaged on region is greater than one.During the second sub-lens inclination control, if second The average blur circle that sub-lens are located under a certain heeling condition and the corresponding heeling condition allows blur circle described in being greater than, then can be complete At the inclination control of the second sub-lens, in this way, second that the Image Acquisition that the light-field camera after adjusted obtains scene obtains Point image quality decreases, and is thus conducive to present a contrast with the image quality of the first part, so that described first The image subject divided is more prominent, help to obtain the shallow depth image of the first part.
Optionally, the second sub-lens tilt control module 74 includes: one second sub-lens inclination control submodule 741.Second sub-lens inclination control submodule 741 is for the relatively described imaging surface along the increase second part through the light field Described in the direction inclination of angle where plane where the main lens imaging of camera and second sub-lens between plane Second sub-lens, to increase the average blur circle that the second part is imaged on second imaging region.Second son After lens are tilted towards the direction plane where it and second part through where the main lens imaging of light-field camera face, And the plane three where the imaging surface is intersected collinear probability and is reduced, and thus can increase second part described The average blur circle of second imaging region imaging of imaging surface reduces the imaging of second part described in acquired image Quality.
Optionally, described image acquisition control device further include: one second sub-lens determining module 76.Second sub-lens are true Cover half block 76 is for determining in the lenslet arrays to inclined second sub-lens.It can be in light-field camera using the program Lenslet arrays in determine to influence the sub-lens of the second depth distribution sub-district Image Acquisition, as it is described second son thoroughly Mirror carries out tilt adjustments with respect to imaging surface by the second sub-lens that will be determined later, so that second depth distribution is sub The average blur circle that second part in area is imaged on the second imaging region of the imaging surface increased, and thus reduce institute State the image quality of second part.
Optionally, the second sub-lens determining module 76 includes: that one second sub-lens determine submodule 761.Second son Lens determine preview of the submodule 761 for determining in the lenslet arrays, with the scene of light-field camera acquisition The corresponding sub-lens in corresponding with the second depth distribution sub-district part in image, for inclined second sub-lens. Second sub-lens are determined using the program, method is simply easily realized.
Figure 10 is the structural schematic diagram of the 4th kind of Image Acquisition control device provided by the embodiments of the present application, and the application is specific Embodiment does not limit the specific implementation of Image Acquisition control device 1000.As shown in Figure 10, Image Acquisition controls Device 1000 may include:
Processor (Processor) 1010,1020, memory communication interface (Communications Interface) (Memory) 1030 and communication bus 1040.Wherein:
Processor 1010, communication interface 1020 and memory 1030 complete mutual lead to by communication bus 1040 Letter.
Communication interface 1020, for being communicated with such as deformable imaging sensor etc..
Processor 1010 can specifically execute the related step in any of the above-described embodiment of the method for executing program 1032 Suddenly.
For example, program 1032 may include program code, said program code includes computer operation instruction.
Processor 1010 may be a central processing unit (Central Processing Unit, abbreviation CPU), or It is specific integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or is configured At the one or more integrated circuits for implementing the embodiment of the present application.
Memory 1030, for storing program 1032.Memory 1030 may include random access memory (Random Access Memory, abbreviation RAM), it is also possible to it further include nonvolatile memory (Non-volatile memory), such as extremely A few magnetic disk storage.
For example, in an optional implementation manner, following steps can be performed by executing program 1032 in processor 1010: The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;It is saturating to the first son of imaging surface inclination of light-field camera Mirror, the average blur circle being imaged with reducing first part on the first imaging region, in which: first sub-lens are the light The sub-lens of the first depth distribution sub-district Image Acquisition are influenced in the lenslet arrays of field camera, the first part is institute The part for being located at the first depth distribution sub-district in scene is stated, first imaging region is the imaging surface and described first The corresponding imaging region of sub-lens;The light-field camera after adjusted carries out Image Acquisition to the scene.It is optional at other Implementation in, processor 1010 by execute program 1032 can also carry out the step of other above-mentioned any embodiments refer to, Details are not described herein.
In program 1032 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule, Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment Description, details are not described herein.
In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality Apply the superiority and inferiority of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to The record of correlation method embodiment, details are not described herein.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps. And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), deposits at random Various Jie that can store program code such as access to memory (Random Access Memory, abbreviation RAM), magnetic or disk Matter.
In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again Combination nova should be regarded as the equivalent scheme of the application.Meanwhile in the description above to the application specific embodiment, for a kind of reality The feature that the mode of applying is described and/or shown can be made in one or more other embodiments in a manner of same or similar With, be combined with the feature in other embodiment, or substitution other embodiment in feature.
It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when using herein, but simultaneously It is not excluded for the presence or additional of one or more other features, element, step or component.
Finally, it should be noted that embodiment of above is merely to illustrate the application, and it is not the limitation to the application, it is related The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be by right It is required that limiting.

Claims (10)

1. a kind of Image Acquisition control method characterized by comprising
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, with reduce first part be imaged on the first imaging region it is flat Equal blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth distribution The sub-lens of sub-district Image Acquisition, the first part are the part for being located at the first depth distribution sub-district in the scene, First imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
2. the method according to claim 1, wherein the partial-depth distribution sub-district of the determining scene is first Depth distribution sub-district, comprising:
The depth distribution sub-district for determining first part in the scene is the first depth distribution sub-district.
3. method according to claim 1 or 2, which is characterized in that the first depth distribution sub-district is the light field phase One subset of the field depth of machine.
4. the method according to claim 1, wherein the light-field camera after adjusted carries out the scene Before Image Acquisition, further includes:
The relatively described imaging surface tilts the second sub-lens, the average disperse being imaged to increase second part on the second imaging region Circle, in which: second sub-lens are the sub-lens that the second depth distribution sub-district Image Acquisition is influenced in the lenslet arrays, The second depth distribution sub-district is different from the first depth distribution sub-district, the second part in the scene be located at institute State the part of the second depth distribution sub-district, second imaging region be the imaging surface it is corresponding with second sub-lens at As region.
5. according to the method described in claim 4, it is characterized in that, the second depth distribution sub-district is field depth except described Other depth distribution sub-districts except first depth distribution sub-district.
6. a kind of Image Acquisition control device characterized by comprising
One first depth distribution sub-district determining module is the first depth distribution for determining that the partial-depth of scene is distributed sub-district Area;
One first sub-lens tilt control module, the imaging surface for opposite light-field camera tilt the first sub-lens, to reduce the The average blur circle that a part is imaged on the first imaging region, in which: first sub-lens are the son of the light-field camera The sub-lens of the first depth distribution sub-district Image Acquisition are influenced in lens array, the first part is position in the scene In the part of the first depth distribution sub-district, first imaging region is that the imaging surface is corresponding with first sub-lens Imaging region;
One Image Acquisition control module carries out Image Acquisition to the scene for the light-field camera after adjusted.
7. device according to claim 6, which is characterized in that the first depth distribution sub-district determining module includes:
One first depth distribution sub-district determines submodule, for determining the depth distribution sub-district of first part in the scene for institute State the first depth distribution sub-district.
8. device according to claim 6 or 7, which is characterized in that the first depth distribution sub-district is the light field phase One subset of the field depth of machine.
9. device according to claim 6, which is characterized in that further include:
One second sub-lens tilt control module tilts the second sub-lens for the relatively described imaging surface, to increase second part The average blur circle being imaged on the second imaging region, in which: second sub-lens are that the is influenced in the lenslet arrays The sub-lens of two depth distribution sub-district Image Acquisition, the second depth distribution sub-district and the first depth distribution sub-district are not Together, the second part is the part for being located at the second depth distribution sub-district in the scene, and second imaging region is Imaging surface imaging region corresponding with second sub-lens.
10. a kind of Image Acquisition control device characterized by comprising
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface and institute It states memory and completes mutual communication by the communication bus;
The memory is for storing at least one instruction;Described instruction makes the processor execute following operation:
The partial-depth distribution sub-district for determining scene is the first depth distribution sub-district;
The imaging surface of opposite light-field camera tilts the first sub-lens, with reduce first part be imaged on the first imaging region it is flat Equal blur circle, in which: first sub-lens be the light-field camera lenslet arrays in influence first depth distribution The sub-lens of sub-district Image Acquisition, the first part are the part for being located at the first depth distribution sub-district in the scene, First imaging region is imaging surface imaging region corresponding with first sub-lens;
The light-field camera after adjusted carries out Image Acquisition to the scene.
CN201510546054.2A 2015-08-31 2015-08-31 Image Acquisition control method and device Active CN106303209B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510546054.2A CN106303209B (en) 2015-08-31 2015-08-31 Image Acquisition control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510546054.2A CN106303209B (en) 2015-08-31 2015-08-31 Image Acquisition control method and device

Publications (2)

Publication Number Publication Date
CN106303209A CN106303209A (en) 2017-01-04
CN106303209B true CN106303209B (en) 2019-06-21

Family

ID=57650521

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510546054.2A Active CN106303209B (en) 2015-08-31 2015-08-31 Image Acquisition control method and device

Country Status (1)

Country Link
CN (1) CN106303209B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116067619B (en) * 2023-03-07 2023-08-11 宁德时代新能源科技股份有限公司 Battery winding detection device, winding device, detection method, device, and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101426085A (en) * 2004-10-01 2009-05-06 科兰·斯坦福青年大学托管委员会 Imaging arrangements and methods therefor
CN103703757A (en) * 2013-08-01 2014-04-02 华为终端有限公司 Photographing method and device
CN104469147A (en) * 2014-11-20 2015-03-25 北京智谷技术服务有限公司 Light field collection control method and device and light field collection equipment
CN104486537A (en) * 2014-10-27 2015-04-01 北京智谷技术服务有限公司 Light field acquisition control method and device
CN104506762A (en) * 2014-12-25 2015-04-08 北京智谷睿拓技术服务有限公司 Optical field collecting control method and device and optical field collecting equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2477294B (en) * 2010-01-27 2015-05-06 Au Optronics Corp Autostereoscopic display apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101426085A (en) * 2004-10-01 2009-05-06 科兰·斯坦福青年大学托管委员会 Imaging arrangements and methods therefor
CN103703757A (en) * 2013-08-01 2014-04-02 华为终端有限公司 Photographing method and device
CN104486537A (en) * 2014-10-27 2015-04-01 北京智谷技术服务有限公司 Light field acquisition control method and device
CN104469147A (en) * 2014-11-20 2015-03-25 北京智谷技术服务有限公司 Light field collection control method and device and light field collection equipment
CN104506762A (en) * 2014-12-25 2015-04-08 北京智谷睿拓技术服务有限公司 Optical field collecting control method and device and optical field collecting equipment

Also Published As

Publication number Publication date
CN106303209A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
CN104410784B (en) Optical field acquisition control method and device
CN104486537B (en) Optical field acquisition control method and device
CN104506762B (en) Optical field acquisition control method and device, optical field acquisition equipment
CN106375694B (en) Light field display control method and device, light field show equipment
CN106254859B (en) Light field display control method and device, light field display device
CN108769462A (en) Free-viewing angle scene walkthrough method and device
CN106161922B (en) Image Acquisition control method and device
CN104867125B (en) Obtain the method and device of image
JP2018536211A (en) Light field data representation
CN107490842A (en) Camera module, imaging device and image processing method
CN106303208B (en) Image Acquisition control method and device
JP2013145982A (en) Imaging apparatus, image processing apparatus and method
CN106254804B (en) Light field display control method and device, light field show equipment
CN106254753B (en) Light field display control method and device, light field show equipment
CN106303209B (en) Image Acquisition control method and device
CN106375648B (en) Image Acquisition control method and device
US9196020B2 (en) Systems and methods for digital correction of aberrations produced by tilted plane-parallel plates or optical wedges
CN106254750B (en) Image Acquisition control method and device
US20150271470A1 (en) Method of using a light-field camera to generate a full depth-of-field image, and light field camera implementing the method
CN106303210B (en) Image Acquisition control method and device
JP2013232757A (en) Imaging apparatus, image processing apparatus, image processing method, and program
CN106161921B (en) Image Acquisition control method and device
US10440269B2 (en) Image capture control methods and apparatuses
CN111382753A (en) Light field semantic segmentation method and system, electronic terminal and storage medium
CN106375653B (en) Image Acquisition control method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant