CN104469147B

CN104469147B - Optical field acquisition control method and device, optical field acquisition equipment

Info

Publication number: CN104469147B
Application number: CN201410670629.7A
Authority: CN
Inventors: 杜琳
Original assignee: Beijing Zhigu Tech Co Ltd
Current assignee: Beijing Zhigu Tech Co Ltd
Priority date: 2014-11-20
Filing date: 2014-11-20
Publication date: 2018-09-04
Anticipated expiration: 2034-11-20
Also published as: CN104469147A

Abstract

The embodiment of the present application discloses a kind of optical field acquisition control method and device and a kind of optical field acquisition equipment, one of which optical field acquisition control method include：The pixel density distribution of the imaging sensor of radial adjustment light-field camera, so that the respective pixel of an at least imaging region is constant but pixel density changes in described image sensor after adjustment, an imaging region is region corresponding with a sub-lens of the lenslet arrays of the light-field camera in described image sensor；Described image sensor after adjusted carries out the optical field acquisition of scene to be taken the photograph.The embodiment of the present application can make full use of the existing pixel of imaging sensor to carry out depth direction optical field acquisition heterogeneous, meet the diversified practical application request of user.

Description

Optical field acquisition control method and device, optical field acquisition equipment

Technical field

This application involves optical field acquisition technical fields, more particularly to a kind of optical field acquisition control method and device and one Kind optical field acquisition equipment.

Background technology

Light-field camera is a kind of imaging technique recorded using lenslet arrays and reproduce three-dimensional scenic, is typically existed A lenslet arrays are placed between main lens and such as CCD imaging sensors, by lenslet arrays by three-dimensional scenic not Tongfang To field information recorded on the focal plane of lenslet arrays.

Different from the two dimensional image acquisition mode of traditional camera, light-field camera can record three-dimensional scenic by single exposure The four-dimensional field information such as space, visual angle, " first shooting back focusing " (need not focus when shooting) is supported, after to shooting Image carry out processing and can generate abundant image effect, such as number focusing, visual angle change, depth map again can be met A variety of imaging applications such as picture, three-dimensionalreconstruction, full focus image.

Invention content

The brief overview about the application is given below, in order to provide the basic of some aspects about the application Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form, In this, as the preamble in greater detail discussed later.

A kind of optical field acquisition control method of the application offer and device and a kind of image capture device.

On the one hand, the embodiment of the present application provides a kind of optical field acquisition control method, including：

The pixel density distribution of the imaging sensor of radial adjustment light-field camera, so that the described image sensor after adjustment In the respective pixel of an at least imaging region it is constant but pixel density changes, an imaging region is described image sensing Region corresponding with a sub-lens of the lenslet arrays of the light-field camera in device；

Described image sensor after adjusted carries out the optical field acquisition of scene to be taken the photograph.

On the other hand, the embodiment of the present application also provides a kind of optical field acquisition control devices, including：

One pixel density radially adjusts module, the pixel density point for the radial imaging sensor for adjusting light-field camera Cloth, so that the respective pixel of an at least imaging region is constant but pixel density becomes in described image sensor after adjustment Change, an imaging region is corresponding with a sub-lens of the lenslet arrays of the light-field camera in described image sensor Region；

One optical field acquisition module carries out the optical field acquisition of scene to be taken the photograph for the described image sensor after adjusted.Again On the one hand, the embodiment of the present application provides a kind of optical field acquisition equipment, including a light-field camera and provided by the embodiments of the present application Any optical field acquisition control device, the optical field acquisition control device are connect with the light-field camera.

Technical solution provided by the embodiments of the present application carries out radial adjustment, the figure by being distributed to image sensor pixel After carrying out radial pixel density adjustment as sensor, in an at least imaging region for imaging sensor in different Dispersive spot radius Pixel density distribution differentiation heterogeneous distribution is presented, be equivalent to the pixel distribution in an at least imaging region into Gone and readjusted, and it is adjusted after described image sensor carry out the optical field acquisition of scene to be taken the photograph so that in different depth The abundant degree of upper collected field information has differences, and the precision of focusing again of the corresponding light field image of different depth also occurs Corresponding non-uniform Distribution, the program are conducive to make full use of the existing pixel of imaging sensor that user or equipment are paid close attention to or felt The depth bounds of interest obtain higher heavy focusing precision, and to be based on collected light field image, to obtain the depth bounds more rich Thus rich heavy focus image information improves optical field acquisition efficiency, more preferably meets the diversified practical application request of user.

By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application Advantage will be apparent from.

Description of the drawings

The application can be by reference to being better understood, wherein in institute below in association with the description given by attached drawing Have and has used same or analogous reference numeral in attached drawing to indicate same or similar component.The attached drawing is together with following It includes in the present specification and to form the part of this specification together to be described in detail, and for this is further illustrated The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings：

Fig. 1 a are a kind of flow chart of optical field acquisition control method provided by the embodiments of the present application；

Fig. 1 b provide the structural schematic diagram of the adjustable imaging sensor of the first pixel density for the embodiment of the present application；

Fig. 1 c provide the structural schematic diagram of the adjustable imaging sensor of second of pixel density for the embodiment of the present application；

Fig. 1 d provide the structural schematic diagram of the adjustable imaging sensor of the third pixel density for the embodiment of the present application；

Fig. 1 e provide the structural schematic diagram of the 4th kind of adjustable imaging sensor of pixel density for the embodiment of the present application；

Fig. 1 f provide imaging sensor for the embodiment of the present application and carry out pixel density tune when uneven light field encourages situation Whole Sample Scenario；

Fig. 1 g provide the structural schematic diagram of the 5th kind of adjustable imaging sensor of pixel density for the embodiment of the present application；

Fig. 1 h provide the structural schematic diagram of the 6th kind of adjustable imaging sensor of pixel density for the embodiment of the present application；

Fig. 1 i provide the structural schematic diagram of the 7th kind of adjustable imaging sensor of pixel density for the embodiment of the present application；

Fig. 1 j provide the structural schematic diagram of the 8th kind of adjustable imaging sensor of pixel density for the embodiment of the present application；

Fig. 2 is a kind of optional light channel structure schematic diagram of light-field camera provided by the embodiments of the present application；

Fig. 3 a are the pixel density point of each imaging region of imaging sensor before a kind of adjustment provided by the embodiments of the present application The optional example of cloth；

Fig. 3 b are the pixel density point of each imaging region of imaging sensor after a kind of adjustment provided by the embodiments of the present application The optional example of cloth；

Fig. 4 is a kind of logic diagram of optical field acquisition control device provided by the embodiments of the present application；

Fig. 5 is the logic diagram of another optical field acquisition control device provided by the embodiments of the present application；

Fig. 6 is the logic diagram of another optical field acquisition control device provided by the embodiments of the present application；

Fig. 7 is a kind of logic diagram of optical field acquisition equipment provided by the embodiments of the present application.

It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear, And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with Just the understanding to the embodiment of the present application is helped to improve.

Specific implementation mode

The exemplary embodiment of the application is described in detail hereinafter in connection with attached drawing.It rises for clarity and conciseness See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from For those skilled in the art of present disclosure, this development is only routine task.

Herein, it is also necessary to explanation is a bit, in order to avoid having obscured the application because of unnecessary details, in attached drawing and It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.

(identical label indicates identical element in several attached drawings) and embodiment below in conjunction with the accompanying drawings, to the tool of the application Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.

It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous Suddenly, equipment or module etc. neither represent any particular technology meaning, also do not indicate that the inevitable logical order between them.

Present inventor has found during putting into practice the embodiment of the present application, is typically based on light-field camera and carries out field to be taken the photograph When the optical field acquisition of scape, the pixel of imaging sensor is uniformly distributed, and the scene collected based on the imaging sensor is different It is identical that the field information in each region of depth enriches degree (such as image spatial resolution and/or angular resolution).In certain fields Under scape, user or equipment are different to the degree of concern of the field information in different depth region, traditional different depth region it is equal Even optical field acquisition mode, may cause regional area to be unable to reach the desired optical field acquisition effect of user, and regional area is more than Optical field acquisition effect needed for user causes practical optical field acquisition and user demand that may mismatch, and how to make full use of figure As the existing pixel progress depth direction optical field acquisition heterogeneous of sensor, the embodiment of the present application provides a kind of Image Acquisition The technical solution of the embodiment of the present application is described in detail in the solution of control below in conjunction with the accompanying drawings.

Fig. 1 a are a kind of flow chart of optical field acquisition control method provided by the embodiments of the present application.The embodiment of the present application provides The executive agent of optical field acquisition control method can be a certain optical field acquisition control device, the optical field acquisition control device can be But be not limited to take pictures, image, photograph, in the application processes such as video monitoring by execute the optical field acquisition control method carry out it is static Or dynamic optical field acquisition control.The equipment form of expression of the optical field acquisition control device is unrestricted, such as the light field Acquisition control device can be a certain independent component, which matches hop communication with light-field camera；Alternatively, the optical field acquisition control Device can be used as a certain function module and be integrated in the image capture device that one includes light-field camera, described image collecting device Camera, video camera, mobile phone etc. are may include but be not limited to, the embodiment of the present application is not intended to limit this.

Specifically as shown in Figure 1a, a kind of optical field acquisition control method provided by the embodiments of the present application includes：

S101：The pixel density distribution of the imaging sensor of radial adjustment light-field camera, so that the described image after adjustment The respective pixel of an at least imaging region is constant in sensor but pixel density changes, and an imaging region is the figure As region corresponding with a sub-lens of the lenslet arrays of the light-field camera in sensor.

The light-field camera generally includes the main lens set gradually, lenslet arrays and imaging sensor, and the son is thoroughly Lens array includes the sub-lens of multiple array distributions.Imaging sensor includes multiple imaging regions, and each imaging region and son are saturating A sub-lens in lens array.Different directions light from scene difference object point to be taken the photograph converges to the sub-lens through main lens On at least one sub-lens of array, the light converged to main lens through at least one sub-lens detaches, separation Light carries out the record of the information such as light intensity, direction by the corresponding imaging region of imaging sensor, thus collects and waits for The image-forming information (i.e. field information) of the multiple view directions of scene is taken the photograph, collected field information can behave as mutually interspersed arrangement Several anaglyphs, light field image might as well be known as.

Imaging sensor in the embodiment of the present application light-field camera is the adjustable imaging sensor of pixel density, it may include but It is not limited to flexible image sensor, the flexible image sensor includes flexible substrate and formed in the flexible substrate Multiple images sensor pixel, wherein the flexible substrate can stretch, be bent when meeting certain condition etc., variations come Adjust the distribution of its pixel density.It is distributed this adjustable characteristic, the embodiment of the present application in conjunction with described image sensor pixel density The pixel density of radially described image sensor is distributed.

" radial direction " refers to the direction of the optical axis (optical axis of such as main lens) of vertical light-field camera, " the radial adjustment The pixel density of imaging sensor is distributed " refer in the plane in the vertically optical axis (optical axis of such as main lens) of the light-field camera The pixel density distribution of interior adjustment described image sensor, for example, in light-field camera, the vertical main lens of described image sensor Optical axis is arranged, and the radial pixel density distribution for adjusting described image sensor, is exactly the plane being distributed in image sensor pixel The pixel density distribution of interior adjustment imaging sensor.

During carrying out described image sensor pixel density adjustment, one or more imaging regions in imaging sensor Respective pixel remains unchanged, and is adjusted to respective pixel density distribution in wherein each imaging region, that is to say, that：From From the point of view of single imaging region, the pixel in the imaging region remains unchanged, but the pixel density distribution of the imaging region has occurred Change, as the pixel density in the imaging region is adjusted to Radial Rotation Error distribution by original being uniformly distributed；From image sensing Device on the whole, can part imaging region be all adjusted respectively, alternatively, also can each imaging region also adjusted respectively It is whole, it needs each Self-adjustment Strategy of each imaging region pixel density distribution in the imaging region being adjusted can be identical, also may be used With difference, to realize that the pixel density distribution for the corresponding imaging region of lenslet arrays difference sub-lens carries out flexibly Adjustment.

S102：Described image sensor after adjusted carries out the optical field acquisition of scene to be taken the photograph.

In the certain application scenarios for acquiring scene field information to be taken the photograph using light-field camera, user or equipment are to different depths The field information that the expectations such as the different object points of range and/or same depth obtain differentiation is spent, collected light is based on to realize The differentiation of field picture is focused precision again, and the precision of focusing again such as some depth bounds is relatively low, and some depth bounds is again right Pyrogene degree is higher etc..And each imaging region of imaging sensor includes multiple images sensor pixel, an imaging region corresponds to One sub-lens of lenslet arrays, the object point information of scene to be taken the photograph successively through main lens, lenslet arrays different sub-lens again It is separated to the mode of different imaging regions so that the field information of scene to be taken the photograph is by imaging region different images sensor pixel It is recorded.

It might as well be illustrated for a kind of optional structure in conjunction with light-field camera.As shown in Fig. 2, light-field camera includes： Including the main lens, lenslet arrays and imaging sensor set gradually；The lenslet arrays include multiple array distributions The focal length of sub-lens, each sub-lens is identical；Described image sensor is equal to the son at a distance from the lenslet arrays The focal length of lens.For example, it is assumed that the lenslet arrays include M × N number of sub-lens, the resolution ratio of described image sensor is A × B, then A × B pixel of described image sensor be divided into M × N number of imaging region (A be more than M, B be more than N), each imaging area Domain is corresponding with a sub-lens, the field information of the light for recording sub-lens separation, including the power of light, view directions Etc. information.Each imaging region includes X × Y pixel, respectively the object point of corresponding record scene different depth to be taken the photograph or same depth Spend different object points or field information that same object point different visual angles are detached through the sub-lens.

According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens to formed by main lens Real image or the virtual image are imaged on the corresponding imaging region of the sub-lens, thus on imaging region different location pixel The field information of different depth object in scene can be stored.Please refer to Fig.2, it is assumed that on imaging region pixel position to son The distance of lens axis is d, then the Dispersive spot radius being imaged in imaging sensor corresponding to the object of different depth in scene is：

In above formula, A is the radius of sub-lens, and f is the focal length of sub-lens, u_fFor sub-lens focal plane to sub-lens center Distance, u is the distance of real image or the virtual image to sub-lens center (real image is positive value, and the virtual image is negative value).

The imaging formula of main lens：

Wherein：U is the practical object of scene to be taken the photograph to the object distance of main lens, that is, based on light field image it is retrievable certain Plane (weight focal plane) arrives the distance of main lens where the heavy focus point of one weight focus image；F is the main focal length of lens, based on L Distance of the optical center of lens to sub-lens optical center.

The imaging formula of sub-lens：

Wherein, v be imaging sensor in imaging region corresponding with the sub-lens certain pixel to the sub-lens away from From.

According to formula (1), (2) and (3), can obtain：

As it can be seen that after the optical parameter of light-field camera determines, there are certain correspondence, different object distances between U and d The field information of the object point of (i.e. different depth) can be the son of d by Dispersive spot radius in the corresponding imaging region of a sub-lens Each pixel record in imaging region, that is to say, that if the pixel density in the sub- imaging region is bigger, the sub- imaging area The recordable field information in domain is also abundanter, and precision of focusing again is also bigger；Vice versa.

Treated based on light-field camera take the photograph scene and carry out optical field acquisition in the case of, usually indicate to clap with precision of focusing again Light field sampling frequency of the light field image taken the photograph in shooting depth direction.The image recording sensor of the light-field camera waits for It is abundanter to take the photograph light field Viewing-angle information (i.e. field orientation information) of the scene in certain region of shooting depth direction, then the light field obtained The angular resolution that image corresponds to the subgraph in the region is higher.If the angular resolution of light field image is higher, in the depth of field A secondary weight focus image can be obtained by being separated by a smaller distance on direction, that is to say, that precision of focusing again is higher.

As it can be seen that technical solution provided by the embodiments of the present application can make full use of the existing pixel of imaging sensor to carry out depth Direction optical field acquisition heterogeneous meets the diversified practical application request of user, specifically, the embodiment of the present application pass through it is right Image sensor pixel distribution carries out radial adjustment, and after described image sensor carries out radial pixel density adjustment, image passes Differentiation distribution heterogeneous, phase is presented in pixel density distribution in an at least imaging region for sensor in different Dispersive spot radius Readjusted when in the pixel distribution in an at least imaging region, and it is adjusted after described image sensor Carry out the optical field acquisition of scene to be taken the photograph so that the abundant degree of collected field information has differences on different depth, no Corresponding non-uniform Distribution also occurs for the precision of focusing again with the corresponding light field image of depth, and the program is conducive to make full use of figure As the existing pixel of sensor obtains higher heavy focusing precision to user or equipment concern or interested depth bounds, with base The more abundant heavy focus image information of the depth bounds is obtained in collected light field image, thus improves optical field acquisition effect Rate more preferably meets the diversified practical application request of user.

Optionally, the pixel density distribution of radial adjustment described image sensor, including：An at least imaging area described in determining The respective first imaging sub-district to be regulated in domain；The pixel of described image sensor is radially adjusted according to each first imaging sub-district Density Distribution, so that the respective sum of all pixels of an at least imaging region after adjustment is constant but each described first is imaged sub-district Interior pixel density distribution changes.The program is not only restricted to specifically scene to be taken the photograph, and can determine according to actual needs and wait adjusting First imaging sub-district of section, realization method are very flexible.For example, radially pixel density is distributed described image sensor before adjustment Uniformly, imaging sensor includes multiple small lattice in Fig. 3 a, and each small lattice represent an imaging region, an imaging region and sub-lens battle array A sub-lens in row correspond to, and the pixel distribution before adjusting in each imaging region is uniform.According to the needs of practical application, it may be determined that Each imaging region of described image sensor respective imaging sub-district to be regulated (might as well be known as " the first imaging sub-district "), in Fig. 3 b " radial direction " is indicated with four-headed arrow, the ring with certain radial width indicated with two annulus with different Dispersive spot radius Region indicates the first imaging sub-district to be regulated in each imaging region, the pixel density point of radially adjusted each imaging region Cloth so that the pixel in the front and back each imaging region of adjustment is constant, but adjusts the pixel density distribution in front and back each imaging region Changed, specifically, the pixel density of the first imaging sub-district after adjustment in each imaging region is different from corresponding imaging area The pixel density of the second imaging sub-district in domain, (no such as the imaging sub-district between two annulus with different Dispersive spot radius Harm is as the first imaging sub-district) pixel distribution, imaging sub-district (sub-district might as well be imaged as second) in opposite small circle ring Pixel distribution is more intensive, i.e., first imaging sub-district pixel density it is larger, this make with the two Dispersive spot radius (roundlet Dispersive spot radius d₁It indicates, the Dispersive spot radius d of great circle₂Indicate) two depth (d are corresponded to respectively₁Corresponding U₁, d₂It is corresponding U₂), it is adjusted after imaging sensor carry out scene to be taken the photograph in U₂To U₁Depth sub-range collect more abundant light field letter Breath, thus improves the focusing precision again for the depth sub-range that can be got based on light field image.It should be noted that Fig. 3 b are The optional example of the synchronous adjustment of pixel density distribution is carried out to each imaging region of imaging sensor, it is clear that can also be according to reality The needs of border application, only to the part imaging region of imaging sensor carry out pixel density distribution adjustment and part imaging region not Adjustment, in each imaging region of adjustment can the also at least two asynchronous adjustment of imaging region of each imaging region synchronous adjustment, with Meet the diversified practical application request of user.In addition, in other optional realization methods, according to actual needs, at one one-tenth As in region, the pixel density of the first imaging sub-district is also smaller than the pixel density of the second imaging sub-district, with this improve second at As again the optical field acquisition of sub-district enriches degree and precision of focusing.

Optionally, determine that an at least imaging region respectively to be regulated first is imaged sub-district, including：It is deep to obtain shooting Spend subrange；Each imaging sub-district of the shooting depth sub-range optical field acquisition is influenced in an at least imaging region described in determining, For each first imaging sub-district to be regulated.For example, concern that can be according to user or equipment in practical application or journey interested Degree determines a certain shooting depth sub-range, such as U₂To U₁Depth sub-range, determine blur circle corresponding with the depth sub-range Radius, such as d₁To d₂Dispersive spot radius range, in an at least imaging region with the Dispersive spot radius range pair determined The ring belt area answered is as the first imaging sub-district.The program is not only restricted to specifically scene to be taken the photograph, can be according to actual concern Or interested shooting depth bounds are it needs to be determined that first imaging sub-district to be regulated, more preferably to meet the practical application need of user It asks.

The acquisition modes of the shooting depth sub-range are very flexible, and the embodiment of the present application is not intended to limit this.

For example, shooting depth sub-range is obtained, including：Institute is determined according to the shooting depth permissible range of the light-field camera State shooting depth sub-range.It is relatively current after the completion of focusing during the optical field acquisition for carrying out scene to be taken the photograph based on light-field camera The shooting depth permissible range of focal plane can determine out according to geometric optical theory, at this point, can allow model from shooting depth It encloses and therefrom determines a shooting depth sub-range.Determine that a shooting depth sub-range can be user or equipment concern or interested Shooting depth sub-range, can determine that the shooting depth sub-range corresponds to Dispersive spot radius subrange under the situation, utilize imaging The existing pixel in region tunes up the pixel density that the Dispersive spot radius subrange corresponds to ring belt area, to improve the shooting depth The abundant degree of the optical field acquisition information of subrange, and then improve the focusing precision again of the shooting depth sub-range.Alternatively, determining Go out that a shooting depth sub-range can be user or equipment is not concerned with or uninterested shooting depth sub-range, it can under the situation Determine that the shooting depth sub-range corresponds to Dispersive spot radius subrange, using the existing pixel of imaging region by the Dispersive spot radius The pixel density that subrange corresponds to ring belt area is turned down so that more pixels in an imaging region are emerging for user or equipment sense The optical field acquisition of the shooting depth sub-range of interest, thus improves the focusing precision again in other regions.

In another example shooting depth sub-range is obtained, including：The shooting is determined according to the depth information of the scene to be taken the photograph Depth sub-range.The program also can determine a certain shooting depth sub-range of scene to be taken the photograph according to the depth information of scene to be taken the photograph It is paid close attention to for user equipment or the depth bounds that are not concerned with, and carry out the tune of described image sensor pixel density distribution accordingly It is whole, it is thus more preferable to meet the differentiation optical field acquisition demand in special scenes.

Optionally, the pixel density for radially adjusting described image sensor according to each first imaging sub-district is distributed, packet It includes：Determine the object pixel Density Distribution information of described image sensor radial direction, in the object pixel Density Distribution information, one The one first corresponding object pixel density of imaging sub-district of the imaging region is different from one second imaging sub-district, and described second It is other at least partly regions of the imaging region in addition to the first imaging sub-district to be imaged sub-district；According to the target picture The pixel density distribution of plain Density Distribution information adjustment described image sensor.The object pixel Density Distribution information illustrates A kind of expectation of user or equipment to differentiation optical field acquisition, for example, if optical field acquisition to centainly shooting depth sub-range Abundant degree demand is higher, then at least one imaging of the shooting depth sub-range is corresponded in object pixel Density Distribution information The pixel density of the first imaging sub-district in region is larger, conversely, then smaller.The program can determine object pixel according to actual needs Density Distribution information is carried out the adjustment of described image sensor pixel density based on the object pixel Density Distribution information, made The object pixel density is approached or even be same as far as possible to the actual pixels Density Distribution of described image sensor after must adjusting Thus distributed intelligence more preferably meets user or the diversified practical application request of equipment.

Optionally, in the object pixel Density Distribution information, at least two the first imaging sub-districts are corresponding Object pixel density is different.Described image sensor is carried out using the object pixel Density Distribution information that the program provides Pixel density adjusts, it can be achieved that being distributed the pixel density of at least two different imaging regions of imaging sensor into line asynchronous tune Whole, different imaging regions may correspond to the object point of different depth or the optical field acquisition of same depth difference object point, the program carry The asynchronous pixel density adjustment mode supplied improves the flexibility of optical field acquisition configuration.

Optionally, in the object pixel Density Distribution information, corresponding at least two the first imaging sub-districts are right respectively The object pixel density answered is identical.The object pixel Density Distribution information provided using the program is to described image sensor Pixel density adjustment is carried out, it can be achieved that being synchronized to the pixel density distribution of at least two different imaging regions of imaging sensor Adjustment, to improve the flexibility of realization method.

Optionally, the pixel density that described image sensor is adjusted according to the object pixel Density Distribution information is distributed, Including：The shape control information in controllable deforming material portion is determined according to the object pixel Density Distribution information；According to the shape Become control information control controllable deforming material portion to deform upon, accordingly be adjusted with the deformation by controllable deforming material portion The pixel density of whole described image sensor is distributed.The program adjusts the figure by controlling the deformation in controllable deforming material portion As the pixel distribution of sensor, scheme is simply easily realized.

Controllable deforming material portion is that can make it by certain the external action factor (such as outfield) of change effect thereon It deforms upon, when the outfield of effect thereon cancels or changes, the deformation in the controllable deforming material portion can restore.Optionally, Controllable deforming material portion is at least formed by one or more of controllable deforming material preparation：It is piezoelectric material, electroactive poly- Close object, photo-deformable material, magnetostriction materials.

Fig. 1 b provide a kind of structural schematic diagram of the adjustable imaging sensor of pixel density for the embodiment of the present application.Such as Fig. 1 b Shown, the adjustable imaging sensor of pixel density provided by the embodiments of the present application includes：Multiple images sensor pixel 11 and one Controllable deforming material portion 12, wherein imaging sensor carries out Image Acquisition, multiple images sensing by image sensor pixel 11 Device pixel 11 is in array distribution, and controllable deforming material portion 12 is connect with multiple images sensor pixel 11 respectively；Controllable deforming material Material portion 12 can deform upon under outer field action and accordingly adjust multiple images sensing by the deformation in controllable deforming material portion 12 The Density Distribution of device pixel 11.

In technical solution provided by the embodiments of the present application, controllable deforming material portion is by changing the controllable deforming material Certain outer field action factor in material portion can bring it about deformation, when certain outer field action factor cancels or changes, the controllable deforming The deformation in material portion can restore, and the outfield can be directed to the deformation behavior selection index system in controllable deforming material portion thereon Corresponding control outfield, such as the outfield includes but not limited to external electrical field, magnetic field, light field etc..Image sensor pixel It may include but be not limited to an at least photoelectric conversion unit.Can be used between each image sensor pixel and controllable deforming material portion but It is not limited to the modes such as bonding closely to be connected, in this way, when controllable deforming material portion deforms upon, will accordingly adjust each Thus spacing between image sensor pixel changes the Density Distribution of image sensor pixel, reaching can be according to actual needs Assign the effect that imaging sensor different zones are distributed with differentiation pixel density.

In practical application, different zones that can be by the outer field action of uneven distribution in controllable deforming material portion make It obtains controllable deforming material portion different piece region and different degrees of deformation occurs, thus adjust the whole of image sensor pixel Volume density is distributed.It optionally, can be by the outer field action in controllable deforming material portion and multiple described image sensor pictures The nonoverlapping region of element, the region that may make controllable deforming material portion Chong Die with described image sensor pixel in this way is not sent out Raw deformation, but change the density point of image sensor pixel by the deformation of the other parts in controllable deforming material portion Cloth, the program be conducive to avoid the deformation because of controllable deforming material portion described image sensor pixel caused by damage.

In practical application, suitable at least one controllable deforming material can be selected to prepare the controllable deforming as needed Material portion, so that controllable deforming material portion has the deformable and recoverable characteristic of deformation.Optionally, the controllable deforming Material portion is at least formed by one or more of controllable deforming material preparation：Piezoelectric material, electroactive polymer, photo-deformable Material, magnetostriction materials.

The piezoelectric material can generate mechanically deform because of electric field action.The controllable deforming prepared using the piezoelectric material Material portion hereinafter referred to as piezoelectric material.Using this physical characteristic of the piezoelectric material, the embodiment of the present application can according to but The object pixel Density Distribution information is not limited to determine for making piezoelectric material that the electric field needed for corresponding mechanical deformation occur Control information, according to the electric field controls information control action piezoelectric material electric field so that piezoelectric material hair Raw corresponding mechanical deformation accordingly adjusts the pixel density point of imaging sensor by the mechanical deformation of the piezoelectric material Thus cloth reaches the mesh for the pixel density distribution that described image sensor is adjusted according to the object pixel Density Distribution information 's.The piezoelectric material may include but be not limited at least one of：Piezoelectric ceramics, piezo-electric crystal.The program can make full use of The physical characteristic of piezoelectric material is distributed to adjust the pixel density of imaging sensor.

The electroactive polymer (Electroactive Polymers, abbreviation EAP) is that one kind can be in electric field action The lower polymer material for changing its shape or size.Using the electroactive polymer prepare controllable deforming material portion hereinafter referred to as For electroactive polymer portion.Using this physical characteristic of the electroactive polymer, the embodiment of the present application can according to but it is unlimited It is determined in the object pixel Density Distribution information for making electroactive polymer portion that the electric field controls needed for corresponding deformation occur Information, according to the electric field controls information control action layer of electroactive polymer electric field so that the electroactive polymer Corresponding deformation occurs for layer, and the pixel density point of imaging sensor is accordingly adjusted by the deformation of the layer of electroactive polymer Thus cloth reaches the mesh for the pixel density distribution that described image sensor is adjusted according to the object pixel Density Distribution information 's.The electroactive polymer may include but be not limited at least one of：Electron type electroactive polymer, ionic electroactive Polymer；The electron type electroactive polymer includes at least one of：Ferroelectric polymer (such as Kynoar), electricity Cause stretch grafted elastomeric, liquid crystal elastic body；The ionic electroactive polymer includes at least one of：ER fluid, Ion polymer-metal composite material etc..The program can make full use of the physical characteristic of electroactive polymer and be passed to adjust image The pixel density of sensor is distributed.

The photo-deformable material is a kind of high molecular material that can change its shape or size under light field effect.It adopts With the hereinafter referred to as photo-deformable material portion of controllable deforming material portion of the photo-deformable material preparation.Utilize the photo-deformable This physical characteristic of material, the embodiment of the present application can according to but be not limited to the object pixel Density Distribution information determine it is photic Shape-changing material portion occurs the light field needed for corresponding deformation and controls information, and information control action is controlled in the light according to the light field Cause the light field in shape-changing material portion so that corresponding deformation occurs for photo-deformable material portion.Pass through the photo-deformable material The deformation in portion accordingly adjusts the pixel density distribution of imaging sensor, thus reaches according to the object pixel Density Distribution information Adjust the purpose of the pixel density distribution of described image sensor.The photo-deformable material may include but be not limited to it is following at least One of：Photo-induced telescopic ferroelectric ceramics, photo-deformable polymer；The photo-induced telescopic ferroelectric ceramics includes but not limited to lead zirconate titanate Lanthanum (PLZT) ceramics, photo-deformable polymer includes but not limited to photo-deformable liquid crystal elastomer).The program can make full use of light The physical characteristic of shape-changing material is caused to adjust the pixel density distribution of imaging sensor.

The magnetostriction materials are one kind can change its magnetized state under magnetic fields, and then its size is made to occur The magnetic material of variation.Using the controllable deforming material portion hereinafter referred to as magnetostriction material of the magnetostriction material preparation Portion.Using this physical characteristic of the magnetostriction materials, the embodiment of the present application can according to but be not limited to the object pixel Density Distribution information determines that the magnetic field control information needed for corresponding deformation occurs for magnetostriction materials, is controlled and is believed according to the magnetic field Magnetic field of the breath control action in magnetostriction material portion so that corresponding deformation occurs for magnetostriction material portion.It is logical The deformation for crossing magnetostriction material portion accordingly adjusts the pixel density distribution of imaging sensor, thus reaches according to the mesh Mark the purpose of the pixel density distribution of pixel density distributed intelligence adjustment described image sensor.The magnetostriction material can wrap Rare earth ultra-magnetostriction material is included but is not limited to, such as with (Tb, Dy) Fe₂Compound is the alloy Tbo of matrix_0.3Dy_0.7Fe_1.95Material Material etc..The program can make full use of the physical characteristic of magnetostriction material to adjust the pixel density distribution of imaging sensor.

In technical solution provided by the embodiments of the present application, the specific knot of each image sensor pixel and controllable deforming material portion Structure and connection type can determine that practical ways are very flexible according to actual needs.

A kind of optional realization method, as shown in Figure 1 b, controllable deforming material portion 12 includes：One controllable deforming material Layer 121, multiple 11 array distributions of described image sensor pixel and the one side for being connected to the controllable deforming material layer 121.It can Choosing, it can be selected multiple described image sensor pixels being formed directly into the controllable deforming material according to actual process condition On layer 12, alternatively, multiple described image sensor pixels can be prepared respectively with the controllable deforming material layer 12 and the two can adopt With but be not limited to bonding mode closely connect.The program is simple in structure, easy realization.

Another optional realization method, as illustrated in figure 1 c, controllable deforming material portion 12 include multiple controllable deformings Material connects sub-portion 122, and multiple controllable deforming materials connect 122 array distribution of sub-portion, to be correspondingly connected with array distribution Multiple described image sensor pixels of multiple described image sensor pixels 11, i.e. array distribution pass through the multiple of array distribution The controllable deforming material connection sub-portion is connected as one.It optionally, can be according to actual process in image sensor pixel array The interval region of pixel form multiple controllable deforming materials connection sub-portions, multiple controllable deforming materials connect sub-portions It may be used with respective image sensor pixel but be not limited to the modes such as abutting, Nian Jie and connect.It is multiple described controllable by controlling The deformation of deformable material connection sub-portion can be adjusted the Density Distribution of image sensor pixel, simple in structure, easily realize.

Further, as shown in figs. 1 d and 1e, described image sensor may also include：Shape control portion 13, shape control Distribution of the portion 13 for adjustment effect to the outfield in controllable deforming material portion 12, to control the controllable deforming material Corresponding deformation occurs for portion 12, in this way, when controllable deforming material portion 12 deforms upon, will accordingly adjust each image sensing Thus spacing between device pixel 11 changes the Density Distribution of image sensor pixel 11, reach to assign according to actual needs The effect that imaging sensor different zones are distributed with differentiation pixel density.

Optionally, as shown in Figure 1 d, the shape control portion may include that light field control unit 131, light field control unit 131 are used for To the external optical field distribution in controllable deforming material portion 12 to control controllable deforming material portion 12 phase occurs for adjustment effect The deformation answered.Under the situation, controllable deforming material portion 12 may include at least photic made of photo-deformable material preparation Shape-changing material portion, as photo-deformable material portion may include at least photo-deformable obtained by the photo-deformable material preparation Material layer, alternatively, controllable deforming material portion may include it is at least multiple photic obtained by the photo-deformable material preparation Shape-changing material connects sub-portion.Light field control unit 131 acts on optical field distribution (Fig. 1 d in photo-deformable material portion by changing In indicate to act on the light field of controllable deforming material portion 12 varying strength distribution by arrow density), come encourage it is described can Different degrees of deformation occurs for the different zones in control deformable material portion 12, and passes through the deformation phase in controllable deforming material portion 12 The spacing between each image sensor pixel 11 is answered, thus changes the Density Distribution of image sensor pixel 11, reaching can basis Actual needs assigns the effect that imaging sensor different zones are distributed with differentiation pixel density.

Optionally, as shown in fig. le, the shape control portion may include that electric field controls portion 132, electric field controls portion 132 are used for The external electrical field in adjustment effect to controllable deforming material portion is distributed, and is occurred accordingly with controlling controllable deforming material portion Deformation.Under the situation, controllable deforming material portion 12 may include the piezoelectric material being at least prepared by piezoelectric material (such as Piezoelectric material layer or piezoelectric material connection sub-portion, etc.), alternatively, controllable deforming material portion 12 may include at least by electricity Electroactive polymer portion that living polymer is prepared (such as layer of electroactive polymer or electroactive polymer connect sub-portion, Etc.).As shown in fig. le, electric field controls portion and controllable deforming material can be connected by control line, electric field controls portion 132 is by changing Become the field distribution for acting on controllable deforming material portion, to encourage the different zones in controllable deforming material portion 12 to occur Different degrees of deformation.If it is zero electric field to act on 12 electric field of controllable deforming material portion, the controllable deforming material Portion does not deform upon and (might as well be known as zero electric field excitation)；If changing the electric field strong and weak for acting on controllable deforming material portion 12 It is distributed (field excitation of "+" positive electricity and the field excitation of "-" negative electricity as illustrated in the drawing) so that act on controllable deforming material portion 12 The electric field strength of different zones difference, as shown in Figure 1 f, in this way, the different zones in controllable deforming material portion can occur Different degrees of deformation, and accordingly adjusted between each image sensor pixel 11 by the deformation in controllable deforming material portion 12 Spacing, thus change imaging sensor whole pixel Density Distribution, imaging sensor can be assigned according to actual needs by reaching The effect that different zones are distributed with differentiation pixel density.

Controllable deforming portion described in the embodiment of the present application can be directly connected to shape control portion, can be also indirectly connected with.It is described Shape control portion can be used as a part for described image sensor, alternatively, the shape control portion also can be not as described image A part for sensor, described image sensor also can the modes such as reserved pin, interface connect with the shape control portion.Effect Outfield in controllable deforming material portion may include but be not limited to electric field, magnetic field, light field etc..For generating the hard of electric field Part, software configuration can for generating the hardware in magnetic field, software configuration and hardware, software configuration etc. for generating light field Realize that details are not described herein for the embodiment of the present application using the corresponding prior art according to actual needs.

Optionally, described image sensor may also include flexible substrate, and the flexible substrate may include but be not limited to flexibility Plastic supporting base can change the shape of flexible substrate as needed with certain flexibility.Image sensor pixel, controllable change Shape material portion can set the homonymy or not homonymy of flexible substrate.Such as：As shown in Figure 1 g, multiple described image sensor pixels 11 connect It is connected to the one side of flexible substrate 14, controllable deforming material portion (such as controllable deforming material layer 121) is connected to the another of flexible substrate 14 On one side.In another example：As shown in figure 1h, multiple described image sensor pixels 11 are connected to the one side of flexible substrate 14, controllable to become The corresponding image sensor pixel of shape material portion (such as controllable deforming material connect sub-portion 122) connection and with the image sensor Pixel 11 is located at the same face of the flexible substrate 14.The program not only can be by acting on the outfield in controllable deforming material portion It controls it and deforms upon the whole pixel Density Distribution for carrying out Indirect method imaging sensor, realize the picture degree density of imaging sensor It is adjustable, such as the imaging sensor of plane can be also bent because which employs the shapes that flexible substrate flexibly changes imaging sensor Thus certain angle meets the application demands such as variety of images acquisition, decoration to obtain the imaging sensor of curved surface.

Fig. 1 i provide the structural schematic diagram of the 7th kind of adjustable imaging sensor of pixel density for the embodiment of the present application.Such as figure In imaging sensor shown in 1i, controllable deforming material portion 12 includes：Flexible substrate 123 and multiple permeability magnetic material portions 124； Multiple images sensor pixel 11 is connect with flexible substrate 123 respectively, is at least partly connected on image sensor pixel 11 more A permeability magnetic material portion 124 acts on the magnetic field in permeability magnetic material portion 124 and makes flexible substrate 123 that corresponding deformation, simultaneously occur by changing The Density Distribution of multiple described image sensor pixels 11 is accordingly adjusted by the deformation.Such as：It can be in each image sensing A permeability magnetic material portion 124 is arranged in the side of device pixel, optionally, image sensor pixel 11 respectively with flexible substrate 123 and lead Magnetic material portion 124 is bonded.The permeability magnetic material portion may include permeability magnetic material prepare magnetic pole, the permeability magnetic material can with but it is unlimited In using soft magnetic material, silicon steel sheet, permalloy, ferrite, one in amorphous soft magnetic alloy, super-microcrystalline soft magnetic alloy etc. Kind is a variety of.The permeability magnetic material portion magnetic property prepared using soft magnetic material work is preferable, remanent magnetism very little after the revocation of magnetic field Convenient for adjusting next time.

Further, optionally, the shape control portion 13 described in the embodiment of the present application may also include：Magnetic field control unit 133, magnetic External magnetic field of the field control unit 133 for adjustment effect to controllable deforming material portion is distributed, to control the controllable deforming Corresponding deformation occurs for material portion.For example, when magnetic field of 133 control action of magnetic field control unit in permeability magnetic material portion 124 (is swashed Exciting field) when changing, apply the same of certain magnetic field strength distribution between neighboring image sensors pixel as shown in figure 1i Magnetic pole (NN or SS) repels magnetic field or different pole (NS or SN) attracts magnetic field, and repulsive force or attraction can be accordingly generated between magnetic pole Power, which, which is transmitted to flexible substrate 123, makes flexible substrate 123 that flexible equal deformation occur, and then respective image is caused to pass Spacing between sensor pixel changes, and realizes the purpose of adjustment image sensor pixel Density Distribution.The program combines soft Property substrate deformation behaviors and the magnetic field control principle such as scalable, realize that the pixel density distribution on imaging sensor is adjustable.

Fig. 1 j provide the structural schematic diagram of the 8th kind of adjustable imaging sensor of pixel density for the embodiment of the present application.Such as figure In imaging sensor shown in 1j, controllable deforming material portion 12 includes：Flexible substrate 123 and multiple permeability magnetic material portions 124； The one side in multiple permeability magnetic material portions 124 is connect with the flexible substrate 123 respectively, multiple permeability magnetic material portions 124 it is opposite Face is connected respectively multiple described image sensor pixels 11, and the magnetic field in the permeability magnetic material portion 124 is acted on by changing Make the flexible substrate 11 that corresponding deformation occur and multiple described image sensor pixels 11 are accordingly adjusted by the deformation Density Distribution.Optionally, permeability magnetic material portion 124 is Nian Jie with flexible substrate 123, image sensor pixel 11 and permeability magnetic material portion 124 bondings, when flexible substrate 123 occurs when acting on the magnetic field in permeability magnetic material portion 124 and changing, magneticaction transmits Make flexible substrate 123 that flexible equal deformation occur to flexible substrate 123, and then realizes adjustment image sensor pixel Density Distribution Purpose.Deformation behaviors and the magnetic field control principle such as scalable of program combination flexible substrate, are realized on imaging sensor Pixel density distribution is adjustable.

After pixel density distribution adjustment being carried out to described image sensor according to the object pixel Density Distribution information, into The optical field acquisition of scene to be taken the photograph described in row, during optical field acquisition, each image sensor pixel of described image sensor is equal Take part in Image Acquisition.Since the pixel density distribution of described image sensor has been believed according to the object pixel Density Distribution Breath is adjusted, and described image object pixel density information is that the depth information of scene to be taken the photograph according to determines, because This can get the scene on depth of field direction according to the information of scene to be taken the photograph described in the described image sensor acquisition after adjustment The field information of different zones enriches the light field image that degree has differences, and the relatively described object pixel of described image sensor is close Distributed intelligence is spent to need to carry out the part of more horn of plenty field information (including image spatial resolution and/or angular resolution), It has more pixels and participates in optical field acquisitions, the field information which collects is compared with horn of plenty, and described image sensor Other parts, have less pixel and participate in optical field acquisition, field information is less abundant, thus improves optical field acquisition on the whole Efficiency, can meet based on light field image improve a certain depth of field weight focus image clarity, and/or, certain certain field depth it is complete The practical application requests such as focus image acutance.

It will be understood by those skilled in the art that in any of the above-described method of the application specific implementation mode, each step Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and Any restriction should not be constituted to the implementation process of the application specific implementation mode.

Fig. 4 is a kind of logic diagram of optical field acquisition control device provided by the embodiments of the present application.As shown in figure 4, this Shen Please embodiment provide a kind of optical field acquisition control device include：One pixel density radially adjusts module 41 and an optical field acquisition mould Block 42.

Pixel density radially pixel density distribution of the adjustment module 41 for the radial imaging sensor for adjusting light-field camera, So that the respective pixel of an at least imaging region is constant but pixel density changes in described image sensor after adjustment, one The imaging region is region corresponding with a sub-lens of the lenslet arrays of the light-field camera in described image sensor.

Optical field acquisition module 42 carries out the optical field acquisition of scene to be taken the photograph for the described image sensor after adjusted.

The equipment form of expression of the optical field acquisition control device is unrestricted, such as the optical field acquisition control device can For a certain independent component, which matches hop communication with light-field camera；Alternatively, the optical field acquisition control device can be used as it is a certain Function module is integrated in the image capture device that one includes light-field camera, and the embodiment of the present application is not intended to limit this.

Optionally, as shown in figure 5, pixel density radial direction adjustment module 41 includes：One first imaging sub-district determines son Module 411 and a pixel density radially adjust submodule 412.First imaging sub-district determination sub-module 411 is used for described in determination extremely A few imaging region respectively to be regulated first is imaged sub-district.Radially adjustment submodule 412 is used for according to each described pixel density First imaging sub-district radially adjusts the pixel density distribution of described image sensor, so that at least imaging area after adjustment The respective sum of all pixels in domain is constant but each described first pixel density distribution being imaged in sub-district changes.The program is unrestricted In specific scene to be taken the photograph, it can determine that the first imaging sub-district to be regulated, realization method are very flexible according to actual needs.It is optional , the first imaging sub-district is the ring belt area with certain radial width in an imaging region, is changed with passing through Pixel density in the ring belt area is distributed to realize the differentiation optical field acquisition in depth bounds corresponding with the ring belt area.

Optionally, the first imaging sub-district determination sub-module 411 includes：One object pixel Density Distribution information determines single Member 4111 and a pixel density are distributed adjustment unit 4112.Object pixel Density Distribution information determination unit 4111 is for determining institute State the object pixel Density Distribution information of imaging sensor radial direction, in the object pixel Density Distribution information, an imaging The one described first of region is imaged the corresponding object pixel density of sub-district different from one second imaging sub-district, the second imaging sub-district It is other at least partly regions of the imaging region in addition to the first imaging sub-district.Pixel density is distributed adjustment unit 4112 are distributed for adjusting the pixel density of described image sensor according to the object pixel Density Distribution information.The program can Object pixel Density Distribution information is determined according to actual needs, and described image is carried out based on the object pixel Density Distribution information The adjustment of sensor pixel density so that the actual pixels Density Distribution of the described image sensor after adjustment is approached very as far as possible To the object pixel Density Distribution information is same as, thus more preferably meet user or the diversified practical application request of equipment.It can Choosing, in the object pixel Density Distribution information, at least two corresponding object pixels of the first imaging sub-district are close Degree is different, and the program can realize that the pixel density at least two different imaging regions of imaging sensor is distributed into line asynchronous tune It is whole, improve the flexibility of optical field acquisition configuration.Alternatively, it is optional, in the object pixel Density Distribution information, correspond at least Two corresponding object pixel density of the first imaging sub-district are identical, and the program can be realized to imaging sensor at least two The pixel density distribution of a difference imaging region synchronizes adjustment, to improve the flexibility of realization method.

Optionally, the pixel density distribution adjustment unit 4112 includes：One shape control information determination subelement 41121 With a shape control subelement 41122.Shape control information determination subelement 41121 is used for according to the object pixel density point Cloth information determines the shape control information in controllable deforming material portion；Shape control subelement 41122 is used for according to the deformation control Information processed controls controllable deforming material portion and deforms upon, and institute is accordingly adjusted with the deformation by controllable deforming material portion State the pixel density distribution of imaging sensor.Controllable deforming material portion is at least by one or more of controllable deforming material It is prepared：Piezoelectric material, electroactive polymer, photo-deformable material, magnetostriction materials.The program is by controlling controllable become The deformation in shape material portion adjusts the pixel distribution of described image sensor, and scheme simply easily realizes.

Optionally, the first imaging sub-district determination sub-module 411 includes：One shooting depth sub-range acquiring unit 4113 With one first imaging sub-district determination unit 4114.Depth sub-range acquiring unit 4113 is shot for obtaining the shooting sub- model of depth It encloses.First imaging sub-district determination unit 4114 in an at least imaging region described in determination for influencing the shooting depth sub-range Each imaging sub-district of optical field acquisition, for each first imaging sub-district to be regulated.The program is not only restricted to specifically field to be taken the photograph Scape, can be according to actual concern or interested shooting depth bounds it needs to be determined that be regulated first is imaged sub-district, with more preferably full The practical application request of sufficient user.

Optionally, the shooting depth sub-range acquiring unit 4113 includes：One first shooting depth sub-range obtains son Unit 41131, the first shooting depth sub-range obtain subelement 41131 for allowing according to the shooting depth of the light-field camera Range determines the shooting depth sub-range.It is very flexible that the program is not only restricted to specifically scene to be taken the photograph, realization method.

Optionally, the shooting depth sub-range acquiring unit 4113 includes：One second shooting depth sub-range obtains son Unit 41132, the second shooting depth sub-range obtain the depth information determination that subelement 41132 is used for the scene to be taken the photograph according to The shooting depth sub-range.The program determines the shooting depth sub-range in combination with special scenes, can more preferably meet in spy Determine the differentiation optical field acquisition demand in scene.

Fig. 6 is the structure diagram of another optical field acquisition control device provided by the embodiments of the present application, and the application is specifically real Example is applied not limit the specific implementation of optical field acquisition control device 600.As shown in fig. 6, optical field acquisition control device 600 may include：

Processor (Processor) 610, communication interface (Communications Interface) 620, memory (Memory) 630 and communication bus 640.Wherein：

Processor 610, communication interface 620 and memory 630 complete mutual communication by communication bus 640.

Communication interface 620, for the communications such as equipment, external light source such as with communication function.

Processor 610 can specifically execute any of the above-described optical field acquisition control method embodiment for executing program 632 In correlation step.

For example, program 632 may include program code, said program code includes computer-managed instruction.

Processor 610 may be a central processing unit (Central Processing Unit, abbreviation CPU), either Specific integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or be arranged to Implement one or more integrated circuits of the embodiment of the present application.

Memory 630, for storing program 632.Memory 630 may include random access memory (Random Access Memory, abbreviation RAM), it is also possible to further include nonvolatile memory (Non-volatile memory), such as extremely A few magnetic disk storage.

For example, in an optional implementation manner, processor 610 can perform following steps by executing program 632：Diameter It is distributed to the pixel density of the imaging sensor of adjustment light-field camera, so that at least one one-tenth in the described image sensor after adjustment As the respective pixel in region is constant but pixel density changes, an imaging region be in described image sensor with it is described The corresponding region of a sub-lens of the lenslet arrays of light-field camera；Described image sensor after adjusted carries out scene to be taken the photograph Optical field acquisition.

In other optional realization methods, processor 610 can also carry out other above-mentioned any realities by executing program 632 The step of example refers to is applied, details are not described herein.

In program 632 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule, Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment Description, details are not described herein.

Fig. 7 is a kind of logic diagram of optical field acquisition equipment provided by the embodiments of the present application.As shown in fig. 7, the application is real A kind of optical field acquisition equipment 70 for applying example offer includes that a light-field camera 71 and an optical field acquisition control device 72, the light field are adopted Collection control device 72 is connect with the optical field acquisition equipment 70.Structure, the operation principle of the optical field acquisition control device 72 are retouched The record that can be found in corresponding embodiment above is stated, details are not described herein.The light-field camera may include but be not limited to have and clap According to the equipment of the optical field acquisitions functions such as, photography, camera shooting, video monitoring, it may be, for example, but be not limited to following device type：Photograph Machine, mobile phone, camera, video camera, video recorder, etc..

Optionally, flexible image sensor described above can be used in described image sensor.Alternatively, described image senses Device may also include：The multiple images sensor pixel of array distribution；One controllable deforming material portion is passed with multiple described images respectively Sensor pixel connects；Controllable deforming material portion can deform upon under outer field action and accordingly be adjusted by the deformation The Density Distribution of multiple described image sensor pixels；The outfield is controlled by the imaging control apparatus.

Structure in relation to described image sensor can be found in the corresponding record of Fig. 1 b- Fig. 1 j, and the imaging control apparatus can The outfield is directly controlled to control the deformation in controllable deforming material portion, and then the radial picture for adjusting described image sensor Plain Density Distribution；Alternatively, the imaging control apparatus can be by controlling the shape control portion come indirect control outfield so that institute It states controllable deforming material portion and corresponding deformation occurs with the radial pixel density distribution for adjusting described image sensor；Etc..It is described The physical connection mode of image sensor pixel and the deformable material portion, can determine according to actual needs, as long as meeting in institute The pixel density distribution that can adjust described image sensor when deformable material portion deforms upon is stated, the embodiment of the present application is to this It is not intended to limit, specific implementation can be found in corresponding record above；The light channel structure of the light-field camera can be found in Fig. 2 and on The corresponding record of text, details are not described herein.

In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality Apply the quality of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to The record of correlation method embodiment, details are not described herein.

Those of ordinary skill in the art may realize that lists described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, depends on the specific application and design constraint of technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.

It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer read/write memory medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be expressed in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of step. And storage medium above-mentioned includes：USB flash disk, read-only memory (Read-Only Memory, abbreviation ROM), is deposited mobile hard disk at random Various Jie that can store program code such as access to memory (Random Access Memory, abbreviation RAM), magnetic disc or CD Matter.

In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again Combination nova should be regarded as the equivalent scheme of the application.Meanwhile above in the description of the application specific embodiment, for a kind of reality The feature that the mode of applying is described and/or shown can be made in a manner of same or similar in one or more other embodiments With, it is combined with the feature in other embodiment, or substitute the feature in other embodiment.

It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when being used herein, but simultaneously It is not excluded for the presence or additional of one or more other features, element, step or component.

Finally it should be noted that：Embodiment of above is merely to illustrate the application, and is not the limitation to the application, related The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be by right It is required that limiting.

Claims

1. a kind of optical field acquisition control method, which is characterized in that including：

The pixel density of the imaging sensor of radial adjustment light-field camera is distributed, so that in the described image sensor after adjustment extremely The respective pixel of a few imaging region is constant but pixel density changes, so that in an at least imaging region for imaging sensor Differentiation distribution heterogeneous is presented in pixel density distribution in different Dispersive spot radius, and an imaging region is described image Region corresponding with a sub-lens of the lenslet arrays of the light-field camera in sensor；

2. according to the method described in claim 1, it is characterized in that, the pixel density point of radial adjustment described image sensor Cloth, including：

Determine that an at least imaging region respectively to be regulated first is imaged sub-district；

The pixel density distribution that described image sensor is radially adjusted according to each first imaging sub-district, so that the institute after adjustment State the respective sum of all pixels of an at least imaging region it is constant but it is each it is described first imaging sub-district in pixel density distribution become Change.

3. according to the method described in claim 2, it is characterized in that, the first imaging sub-district is in an imaging region Ring belt area with certain radial width.

4. according to the method described in claim 2, an it is characterized in that, at least imaging region described in determining respectively to be regulated the One imaging sub-district, including：

Obtain shooting depth sub-range；

Each imaging sub-district that the shooting depth sub-range optical field acquisition is influenced in an at least imaging region described in determining, respectively to wait for The the first imaging sub-district adjusted.

5. according to the method described in claim 4, it is characterized in that, obtain shooting depth sub-range, including：

The shooting depth sub-range is determined according to the shooting depth permissible range of the light-field camera.

6. according to the method described in claim 4, it is characterized in that, obtain shooting depth sub-range, including：

The shooting depth sub-range is determined according to the depth information of the scene to be taken the photograph.

7. according to any methods of claim 2-6, which is characterized in that radially adjusted according to each first imaging sub-district The pixel density of described image sensor is distributed, including：

Determine the object pixel Density Distribution information of described image sensor radial direction, in the object pixel Density Distribution information, The one first corresponding object pixel density of imaging sub-district of one imaging region is different from one second imaging sub-district, and described the Two imaging sub-districts are other at least partly regions of the imaging region in addition to the first imaging sub-district；

The pixel density distribution of described image sensor is adjusted according to the object pixel Density Distribution information.

8. the method according to the description of claim 7 is characterized in that in the object pixel Density Distribution information, at least two Described first is imaged the corresponding object pixel density difference of sub-district.

9. the method according to the description of claim 7 is characterized in that in the object pixel Density Distribution information, correspond at least Two corresponding object pixel density of the first imaging sub-district are identical.

10. according to the method described in claim 9, it is characterized in that, adjusting institute according to the object pixel Density Distribution information The pixel density distribution of imaging sensor is stated, including：

The shape control information in controllable deforming material portion is determined according to the object pixel Density Distribution information；

Controllable deforming material portion is controlled according to the shape control information to deform upon, to pass through the controllable deforming material The deformation in portion accordingly adjusts the pixel density distribution of described image sensor.

11. according to the method described in claim 10, it is characterized in that, controllable deforming material portion at least by following a kind of or A variety of controllable deforming material preparations form：Piezoelectric material, electroactive polymer, photo-deformable material, magnetostriction materials.

12. a kind of optical field acquisition control device, feature are, including：

One pixel density radially adjusts module, the pixel density distribution of the imaging sensor for radial adjustment light-field camera, with Make that the respective pixel of an at least imaging region is constant in the described image sensor after adjustment but pixel density changes, so that Differentiation heterogeneous is presented in pixel density distribution in an at least imaging region for imaging sensor in different Dispersive spot radius Distribution, an imaging region are corresponding with a sub-lens of the lenslet arrays of the light-field camera in described image sensor Region；

One optical field acquisition module carries out the optical field acquisition of scene to be taken the photograph for the described image sensor after adjusted.

13. device according to claim 12, which is characterized in that radially adjustment module includes the pixel density：

One first imaging sub-district determination sub-module, for determine an at least imaging region respectively to be regulated first be imaged it is sub Area；

One pixel density radially adjusts submodule, for according to each first imaging sub-district radial direction adjustment described image sensor Pixel density distribution so that adjustment after the respective sum of all pixels of an at least imaging region it is constant but each the first one-tenth described As the pixel density distribution in sub-district changes.

14. device according to claim 13, which is characterized in that the first imaging sub-district is an imaging region In with certain radial width ring belt area.

15. device according to claim 13, which is characterized in that described first, which is imaged sub-district determination sub-module, includes：

One shooting depth sub-range acquiring unit, for obtaining shooting depth sub-range；

One first imaging sub-district determination unit, for influencing the shooting depth sub-range in an at least imaging region described in determination Each imaging sub-district of optical field acquisition, for each first imaging sub-district to be regulated.

16. device according to claim 15, which is characterized in that the shooting depth sub-range acquiring unit includes：

One first shooting depth sub-range obtains subelement, for being determined according to the shooting depth permissible range of the light-field camera The shooting depth sub-range.

17. device according to claim 15, which is characterized in that the shooting depth sub-range acquiring unit includes：

One second shooting depth sub-range obtains subelement, and the depth information for the scene to be taken the photograph according to determines the shooting Depth sub-range.

18. according to any devices of claim 13-17, which is characterized in that the first imaging sub-district determination sub-module Including：

One object pixel Density Distribution information determination unit, the object pixel density point for determining described image sensor radial direction Cloth information, in the object pixel Density Distribution information, the corresponding mesh of the first imaging sub-district of an imaging region Pixel density is marked different from one second imaging sub-district, the second imaging sub-district is the imaging region except described first is imaged sub-district Except other at least partly regions；

One pixel density is distributed adjustment unit, for adjusting described image sensor according to the object pixel Density Distribution information Pixel density distribution.

19. device according to claim 18, which is characterized in that in the object pixel Density Distribution information, at least two A described first is imaged the corresponding object pixel density difference of sub-district.

20. device according to claim 18, which is characterized in that in the object pixel Density Distribution information, correspond to extremely The corresponding object pixel density of few two the first imaging sub-districts is identical.

21. device according to claim 20, which is characterized in that the pixel density is distributed adjustment unit and includes：

One shape control information determination subelement, for determining controllable deforming material according to the object pixel Density Distribution information The shape control information in portion；

One shape control subelement is deformed upon for controlling controllable deforming material portion according to the shape control information, The pixel density distribution of described image sensor is accordingly adjusted with the deformation by controllable deforming material portion.

22. device according to claim 21, which is characterized in that controllable deforming material portion at least by following a kind of or A variety of controllable deforming material preparations form：Piezoelectric material, electroactive polymer, photo-deformable material, magnetostriction materials.

23. a kind of optical field acquisition equipment, which is characterized in that any described including a light-field camera and just like claim 12-22 Optical field acquisition control device, the optical field acquisition control device connect with the light-field camera.

24. optical field acquisition equipment according to claim 23, which is characterized in that described image sensor includes：

The multiple images sensor pixel of array distribution；

One controllable deforming material portion, connect with multiple described image sensor pixels respectively；Controllable deforming material portion is outside The Density Distribution of multiple described image sensor pixels can be deformed upon and accordingly adjusted by the deformation under field action；Institute Outfield is stated to be controlled by the optical field acquisition control device.