CN104469147A - Light field collection control method and device and light field collection equipment - Google Patents

Light field collection control method and device and light field collection equipment Download PDF

Info

Publication number
CN104469147A
CN104469147A CN201410670629.7A CN201410670629A CN104469147A CN 104469147 A CN104469147 A CN 104469147A CN 201410670629 A CN201410670629 A CN 201410670629A CN 104469147 A CN104469147 A CN 104469147A
Authority
CN
China
Prior art keywords
imageing sensor
picture element
density distribution
imaging
element density
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410670629.7A
Other languages
Chinese (zh)
Other versions
CN104469147B (en
Inventor
杜琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhigu Tech Co Ltd
Original Assignee
Beijing Zhigu Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhigu Tech Co Ltd filed Critical Beijing Zhigu Tech Co Ltd
Priority to CN201410670629.7A priority Critical patent/CN104469147B/en
Publication of CN104469147A publication Critical patent/CN104469147A/en
Application granted granted Critical
Publication of CN104469147B publication Critical patent/CN104469147B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the invention discloses a light field collection control method and device and light field collection equipment. The light field collection control method includes the steps that pixel density distribution of an image sensor of a light field camera is adjusted in the radial direction to enable pixels of at least one imaging area of the adjusted image sensor to be unchanged while the pixel density is changed, wherein the one imaging area is the area located in the image sensor and corresponds to a sub-lens of an sub-lens array of the light field camera; the adjusted image sensor performs light field collection of scenes to be shot. According to the method, existing pixels of the image sensor can be fully utilized to perform uneven light field collection in the depth direction, and diversified actual application requirements of users can be met.

Description

Optical field acquisition control method and device, optical field acquisition equipment
Technical field
The application relates to optical field acquisition technical field, particularly relates to a kind of optical field acquisition control method and device and a kind of optical field acquisition equipment.
Background technology
Light-field camera is a kind of imaging technique utilizing lenslet arrays to carry out recording and reconstruction three-dimensional scenic, its normally main lens and as imageing sensors such as CCD between place a lenslet arrays, by lenslet arrays by the field information of three-dimensional scenic different directions at the enterprising line item in the focal plane of lenslet arrays.
Different from the two dimensional image acquisition mode of traditional camera, light-field camera can record the four-dimensional field information such as space, visual angle of three-dimensional scenic by single exposure, support " first taking back focusing " (namely not needing focusing during shooting), namely can generate abundant image effect by processing the image after shooting, the multiple imaging applications such as such as numeral is heavily focused, visual angle change, depth image, three-dimensionalreconstruction, full focus image can be met.
Summary of the invention
Give the brief overview about the application hereinafter, so as to provide about the application some in basic comprehension.Should be appreciated that this general introduction is not summarize about the exhaustive of the application.It is not that intention determines key or the pith of the application, neither the scope of intended limitation the application.Its object is only provide some concept in simplified form, in this, as the preorder in greater detail discussed after a while.
The application provides a kind of optical field acquisition control method and device and a kind of image capture device.
On the one hand, the embodiment of the present application provides a kind of optical field acquisition control method, comprising:
The picture element density distribution of the imageing sensor of radial adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor;
Described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, the picture element density distribution of the described imageing sensor of radial adjustment, comprising: determine the first imaging subarea that described at least one imaging region is to be regulated separately; According to each described first imaging subarea radial direction adjustment described imageing sensor picture element density distribution, with make the described at least one imaging region sum of all pixels separately after adjustment constant but in each described first imaging subarea picture element density distribution change.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, the first imaging subarea described in is for having the ring belt area of certain radial width in imaging region described in.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, determine to comprise the first imaging subarea that described at least one imaging region is to be regulated separately: obtain shooting depth sub-range; Determining each imaging subarea affecting described shooting depth sub-range optical field acquisition in described at least one imaging region, is each described first imaging subarea to be regulated.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, obtain shooting depth sub-range, comprising: the shooting degree of depth permissible range according to described light-field camera determines described shooting depth sub-range.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, obtain shooting depth sub-range, comprising: determine described shooting depth sub-range according to the depth information of scene described to be taken the photograph.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, according to the picture element density distribution of the described imageing sensor of each described first imaging subarea radial direction adjustment, comprise: the object pixel density distribution information determining described imageing sensor radial direction, in described object pixel density distribution information, imaging region described in one one described in object pixel density corresponding to the first imaging subarea differ from one second imaging subarea, described second imaging subarea is described imaging region other at least part of regions except described first imaging subarea; The picture element density distribution of described imageing sensor is adjusted according to described object pixel density distribution information.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, in described object pixel density distribution information, the object pixel density difference that at least two described first imaging subareas are corresponding respectively.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, in described object pixel density distribution information, the object pixel density of corresponding at least two described first imaging subareas difference correspondences is identical.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, adjust the picture element density distribution of described imageing sensor according to described object pixel density distribution information, comprising: according to the shape control information in described object pixel density distribution information determination controllable deforming material portion; Control described controllable deforming material portion according to described shape control information and deformation occurs, distribute with the picture element density of the described imageing sensor of the corresponding adjustment of deformation by described controllable deforming material portion.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand, optionally, described controllable deforming material portion is at least prepared from by one or more controllable deforming materials following: piezoelectric, electroactive polymer, photo-deformable material, magnetostrictive material.
On the other hand, the embodiment of the present application additionally provides a kind of optical field acquisition control device, comprising:
The radial adjusting module of one picture element density, for the picture element density distribution of the imageing sensor of radial direction adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor;
One optical field acquisition module, carries out the optical field acquisition of scene to be taken the photograph for the described imageing sensor after adjustment.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, the radial adjusting module of described picture element density comprises: submodule is determined in one first imaging subarea, for determining the first imaging subarea that described at least one imaging region is to be regulated separately; One picture element density radial direction adjustment submodule, for according to each described first imaging subarea radial direction adjustment described imageing sensor picture element density distribution, with make the described at least one imaging region sum of all pixels separately after adjustment constant but in each described first imaging subarea picture element density distribution change.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, the first imaging subarea described in is for having the ring belt area of certain radial width in imaging region described in.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, described first imaging subarea determines that submodule comprises: a shooting depth sub-range acquiring unit, for obtaining shooting depth sub-range; One first imaging subarea determining unit, for determining each imaging subarea affecting described shooting depth sub-range optical field acquisition in described at least one imaging region, is each described first imaging subarea to be regulated.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, described shooting depth sub-range acquiring unit comprises: one first shooting depth sub-range obtains subelement, determines described shooting depth sub-range for the shooting degree of depth permissible range according to described light-field camera.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, described shooting depth sub-range acquiring unit comprises: one second shooting depth sub-range obtains subelement, and the depth information for scene to be taken the photograph described in basis determines described shooting depth sub-range.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, described first imaging subarea determines that submodule comprises: an object pixel density distribution information determination unit, for determining the object pixel density distribution information of described imageing sensor radial direction, in described object pixel density distribution information, imaging region described in one one described in object pixel density corresponding to the first imaging subarea differ from one second imaging subarea, described second imaging subarea is described imaging region other at least part of regions except described first imaging subarea; One picture element density distribution adjustment unit, for adjusting the picture element density distribution of described imageing sensor according to described object pixel density distribution information.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, in described object pixel density distribution information, the object pixel density difference that at least two described first imaging subareas are corresponding respectively.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, in described object pixel density distribution information, the object pixel density of corresponding at least two described first imaging subareas difference correspondences is identical.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, described picture element density distribution adjustment unit comprises: a shape control information determination subelement, for the shape control information according to described object pixel density distribution information determination controllable deforming material portion; , there is deformation for controlling described controllable deforming material portion according to described shape control information, distribute with the picture element density of the described imageing sensor of the corresponding adjustment of deformation by described controllable deforming material portion in one shape control subelement.
In conjunction with any one optional implementation that the embodiment of the present application provides on the other hand, optionally, described controllable deforming material portion is at least prepared from by one or more controllable deforming materials following: piezoelectric, electroactive polymer, photo-deformable material, magnetostrictive material.
Again on the one hand, the embodiment of the present application provides a kind of optical field acquisition equipment, and comprise any one optical field acquisition control device that a light-field camera and the embodiment of the present application provide, described optical field acquisition control device is connected with described light-field camera.
In conjunction with any one optional implementation that the embodiment of the present application provides on the one hand again, optionally, described imageing sensor comprises: multiple image sensor pixels of array distribution; One controllable deforming material portion, is connected with multiple described image sensor pixel respectively; Can deformation be there is and by the density distribution of the multiple described image sensor pixel of the corresponding adjustment of described deformation in described controllable deforming material portion under outer field action; Described outfield is controlled by described optical field acquisition control device.
The technical scheme that the embodiment of the present application provides is by carrying out radial direction adjustment to image sensor pixel distribution, after described imageing sensor carries out radial picture element density adjustment, picture element density distribution at least one imaging region of imageing sensor in different Dispersive spot radius presents differentiation heterogeneous distribution, be equivalent to readjust the pixel distribution in described at least one imaging region, and the described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph, the degree of enriching of the field information that different depth collects be there are differences, also there is corresponding non-uniform Distribution in the heavily focusing precision of the light field image that different depth is corresponding, the existing pixel that the program is conducive to making full use of imageing sensor pays close attention to user or equipment or interested depth bounds obtains higher heavily focusing precision, to obtain the heavy focus image information of this depth bounds more horn of plenty based on the light field image collected, improve optical field acquisition efficiency thus, better meet the diversified practical application request of user.
By below in conjunction with the detailed description of accompanying drawing to the embodiment of the application, these and other the advantage of the application will be more obvious.
Accompanying drawing explanation
The application can be better understood by reference to hereinafter given by reference to the accompanying drawings description, wherein employs same or analogous Reference numeral in all of the figs to represent identical or similar parts.Described accompanying drawing comprises in this manual together with detailed description below and forms the part of this specification, and is used for illustrating the embodiment of the application further and explaining the principle and advantage of the application.In the accompanying drawings:
The flow chart of a kind of optical field acquisition control method that Fig. 1 a provides for the embodiment of the present application;
The structural representation of the imageing sensor that Fig. 1 b provides the first picture element density adjustable for the embodiment of the present application;
The structural representation of the imageing sensor that Fig. 1 c provides the second picture element density adjustable for the embodiment of the present application;
The structural representation of the imageing sensor that Fig. 1 d provides the third picture element density adjustable for the embodiment of the present application;
Fig. 1 e provides the structural representation of the 4th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application;
Fig. 1 f provides imageing sensor to carry out the Sample Scenario of picture element density adjustment when uneven light field excitation situation for the embodiment of the present application;
Fig. 1 g provides the structural representation of the 5th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application;
Fig. 1 h provides the structural representation of the 6th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application;
Fig. 1 i provides the structural representation of the 7th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application;
Fig. 1 j provides the structural representation of the 8th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application;
The optional light channel structure schematic diagram of a kind of light-field camera that Fig. 2 provides for the embodiment of the present application;
Fig. 3 a for the embodiment of the present application provide a kind of adjustment before each imaging region of imageing sensor picture element density distribution alternate exemplary;
Fig. 3 b for the embodiment of the present application provide a kind of adjustment after each imaging region of imageing sensor picture element density distribution alternate exemplary;
The logic diagram of a kind of optical field acquisition control device that Fig. 4 provides for the embodiment of the present application;
The logic diagram of the another kind of optical field acquisition control device that Fig. 5 provides for the embodiment of the present application;
The logic diagram of another optical field acquisition control device that Fig. 6 provides for the embodiment of the present application;
The logic diagram of a kind of optical field acquisition equipment that Fig. 7 provides for the embodiment of the present application.
The element that it will be appreciated by those skilled in the art that in accompanying drawing be only used to simple and clear for the purpose of illustrate, and not necessarily to draw in proportion.Such as, in accompanying drawing, the size of some element may be exaggerated relative to other elements, to contribute to improving the understanding to the embodiment of the present application.
Embodiment
By reference to the accompanying drawings the one exemplary embodiment of the application will be described in detail hereinafter.For clarity and conciseness, all features of actual execution mode are not described in the description.But, should understand, must make a lot specific to the decision of execution mode in the process of any this practical embodiments of exploitation, to realize the objectives of developer, such as, meet those restrictive conditions relevant to system and business, and these restrictive conditions may change to some extent along with the difference of execution mode.In addition, although will also be appreciated that development is likely very complicated and time-consuming, concerning the those skilled in the art having benefited from present disclosure, this development is only routine task.
At this, also it should be noted is that, in order to avoid the application fuzzy because of unnecessary details, merely depict in the drawings and in the description with according to the closely-related apparatus structure of the scheme of the application and/or treatment step, and eliminate to the application's relation little, the expression of parts known to persons of ordinary skill in the art and process and description.
Below in conjunction with accompanying drawing (label identical in some accompanying drawings represents identical element) and embodiment, the embodiment of the application is described in further detail.Following examples for illustration of the application, but are not used for limiting the scope of the application.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the application are only for distinguishing different step, equipment or module etc., neither represent any particular technology implication, also do not represent the inevitable logical order between them.
Present inventor finds in the process putting into practice the embodiment of the present application; usually carry out in time taking the photograph the optical field acquisition of scene based on light-field camera; the pixel of imageing sensor is uniformly distributed, and it is identical that the field information in each region of this scene different depth collected based on this imageing sensor enriches degree (as image spatial resolution and/or angular resolution).In some scenarios, user or equipment are to the degree of concern difference of the field information in different depth region, the uniform light field acquisition mode in traditional different depth region, regional area may be caused cannot to reach the optical field acquisition effect of user's expectation, regional area has exceeded the optical field acquisition effect needed for user, actual optical field acquisition and user's request is caused not to mate, and the existing pixel how making full use of imageing sensor carries out depth direction optical field acquisition heterogeneous, the embodiment of the present application provides the solution that a kind of IMAQ controls, the technical scheme of the embodiment of the present application is described in detail below in conjunction with accompanying drawing.
The flow chart of a kind of optical field acquisition control method that Fig. 1 a provides for the embodiment of the present application.The executive agent of the optical field acquisition control method that the embodiment of the present application provides can be a certain optical field acquisition control device, described optical field acquisition control device can but be not limited to take pictures, make a video recording, photograph, in the application process such as video monitoring by performing this optical field acquisition control method and carry out static state or dynamic optical field acquisition controlling.The equipment form of expression of described optical field acquisition control device is unrestricted, and such as described optical field acquisition control device can be a certain independently parts, and these parts coordinate with light-field camera and communicate; Or, described optical field acquisition control device can be used as a certain functional module and is integrated in one and includes in the image capture device of light-field camera, described image capture device can include but not limited to camera, video camera, mobile phone etc., and the embodiment of the present application does not limit this.
Specifically as shown in Figure 1a, a kind of optical field acquisition control method that the embodiment of the present application provides comprises:
S101: the picture element density distribution of the imageing sensor of radial adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor.
Described light-field camera generally includes the main lens, lenslet arrays and the imageing sensor that set gradually, and described lenslet arrays comprises the sub-lens of multiple array distribution.Imageing sensor comprises multiple imaging region, the sub-lens in each imaging region and lenslet arrays.Different directions light from the different object point of scene to be taken the photograph converges at least one sub-lens of described lenslet arrays through main lens, through at least one sub-lens described, the light that main lens converges is separated, the light be separated carries out the record of the information such as light intensity, direction by the corresponding imaging region of imageing sensor, collect the image-forming information (i.e. field information) of the multiple view directions of scene to be taken the photograph thus, the field information collected can show as several anaglyphs of interspersed arrangement mutually, might as well be called light field image.
Imageing sensor in the embodiment of the present application light-field camera is the adjustable imageing sensor of picture element density, flexible image transducer can be included but not limited to, multiple image sensor pixels that described flexible image transducer comprises flexible substrate and formed in described flexible substrate, the changes such as wherein said flexible substrate can be stretched when meeting certain condition, bend adjust the distribution of its picture element density.In conjunction with this characteristic that described image sensor pixel density distribution is adjustable, the embodiment of the present application radially can adjust the picture element density distribution of described imageing sensor.
Described " radial direction " refers to the direction of the optical axis (optical axis as main lens) of vertical light-field camera, described " the picture element density distribution of radial adjustment imageing sensor " refers to the picture element density distribution at imageing sensor as described in adjustment in the plane of the optical axis (optical axis as main lens) of vertical described light-field camera, such as, in light-field camera, the optical axis of the vertical main lens of described imageing sensor is arranged, the picture element density distribution of the described imageing sensor of radial adjustment, adjusts the picture element density distribution of imageing sensor exactly in the plane of image sensor pixel distribution.
Carry out in the process of described image sensor pixel density adjustment, in imageing sensor, one or more imaging region pixel separately remains unchanged, and picture element density respective in wherein each imaging region distribution is adjusted, that is: from single imaging region, pixel in this imaging region remains unchanged, but the distribution of the picture element density of this imaging region there occurs change, distribute as the picture element density in this imaging region is adjusted to Radial Rotation Error by original being uniformly distributed; From imageing sensor on the whole, can adjust all respectively by part imaging region, or, but also each imaging region also adjusts respectively, need each Self-adjustment Strategy carrying out each imaging region picture element density distribution in the imaging region adjusted can be identical, also can difference to some extent, adjust flexibly with the picture element density distribution realized for imaging region corresponding to the different sub-lens of lenslet arrays.
S102: the described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph.
Gather in some application scenarios of scene light field information to be taken the photograph utilizing light-field camera, user or the different object points etc. of equipment to different depth scope and/or the same degree of depth expect the field information obtaining differentiation, to realize heavily focusing precision based on the differentiation of the light field image collected, heavily focusing precision as some depth bounds is lower, and the heavily focusing precision of some depth bounds is higher etc.And each imaging region of imageing sensor comprises multiple image sensor pixel, one sub-lens of the corresponding lenslet arrays of one imaging region, the object point information of scene to be taken the photograph is separated to the mode of different imaging regions successively again through the different sub-lens of main lens, lenslet arrays, make the field information of scene to be taken the photograph be imaged region different images sensor pixel institute record.
Might as well be that example is described in conjunction with the optional structure of the one of light-field camera.As shown in Figure 2, light-field camera comprises: comprise the main lens, lenslet arrays and the imageing sensor that set gradually; Described lenslet arrays comprises the sub-lens of multiple array distribution, and the focal length of each described sub-lens is identical; The distance of described imageing sensor and described lenslet arrays equals the focal length of described sub-lens.Such as, suppose that described lenslet arrays comprises M × N number of sub-lens, the resolution of described imageing sensor is A × B, then described imageing sensor A × B pixel is divided into that M × (A is greater than M to N number of imaging region, B is greater than N), each imaging region is corresponding with a sub-lens, for recording the field information of the light that this sub-lens is separated, comprises the information such as the power of light, view directions.Each imaging region comprises X × Y pixel, respectively the field information that is separated through this sub-lens of the object point of corresponding record scene to be taken the photograph different depth or the different object points of the same degree of depth or same object point different visual angles.
According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens and on the imaging region that this sub-lens is corresponding, carry out imaging to real image formed by main lens or the virtual image, and therefore on imaging region, the pixel of diverse location can the field information of different depth object in storage scenarios.Please refer to Fig. 2, suppose that on imaging region pixel position is d to the distance of sub-lens optical axis, then the object corresponding to different depth in scene at the Dispersive spot radius of imageing sensor imaging is:
d = Afu f u f - f ( 1 u f - 1 u ) . . . ( 1 )
In above formula, A is the radius of sub-lens, and f is the focal length of sub-lens, u ffor sub-lens focal plane is to the distance at sub-lens center, u is real image or the virtual image to the distance (real image on the occasion of, the virtual image is negative value) at sub-lens center.
The imaging formula of main lens:
1 F = 1 U + 1 V = 1 U + 1 L - u . . . ( 2 )
Wherein: U is the object distance of practical object to main lens of scene to be taken the photograph, namely based on the heavy focusing place plane (heavy focal plane) of the retrievable a certain heavy focus image of light field image to the distance of main lens; F is main lens focal length, and L is the distance of main lens photocentre to sub-lens photocentre.
The imaging formula of sub-lens:
1 f = 1 u f + 1 v . . . ( 3 )
Wherein, v is the distance of certain pixel to this sub-lens of imaging region corresponding with this sub-lens in imageing sensor.
According to formula (1), (2) and (3), can obtain:
1 U = 1 F + 1 1 1 f - 1 v ( 1 + d A ) - L . . . ( 4 )
Visible, after the optical parametric of light-field camera is determined, certain corresponding relation is there is between U and d, the field information of the object point of different object distances (i.e. different depth) is each pixel record in the sub-imaging region of d by Dispersive spot radius in an imaging region corresponding to a sub-lens, that is, if the picture element density in this sub-imaging region is larger, the recordable field information of this sub-imaging region is also abundanter, and precision of heavily focusing is also larger; Vice versa.
Treat based on light-field camera take the photograph scene carry out optical field acquisition when, usually represent that the light field image of taking and obtaining is in the light field sampling frequency of taking depth direction by precision of heavily focusing.The scene to be taken the photograph of the image recording sensor of described light-field camera is abundanter at the light field Viewing-angle information (i.e. field orientation information) in certain region of shooting depth direction, then the light field image obtained to should the angular resolution of subgraph in region higher.If the angular resolution of light field image is higher, then a less distance of being separated by depth of field direction can obtain a secondary heavy focus image, and precision of that is heavily focusing is higher.
Visible, the existing pixel that the technical scheme that the embodiment of the present application provides can make full use of imageing sensor carries out depth direction optical field acquisition heterogeneous, meet the diversified practical application request of user, specifically, the embodiment of the present application is by carrying out radial direction adjustment to image sensor pixel distribution, after described imageing sensor carries out radial picture element density adjustment, picture element density distribution at least one imaging region of imageing sensor in different Dispersive spot radius presents differentiation heterogeneous distribution, be equivalent to readjust the pixel distribution in described at least one imaging region, and the described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph, the degree of enriching of the field information that different depth collects be there are differences, also there is corresponding non-uniform Distribution in the heavily focusing precision of the light field image that different depth is corresponding, the existing pixel that the program is conducive to making full use of imageing sensor pays close attention to user or equipment or interested depth bounds obtains higher heavily focusing precision, to obtain the heavy focus image information of this depth bounds more horn of plenty based on the light field image collected, improve optical field acquisition efficiency thus, better meet the diversified practical application request of user.
Optionally, the picture element density distribution of the described imageing sensor of radial adjustment, comprising: determine the first imaging subarea that described at least one imaging region is to be regulated separately; According to each described first imaging subarea radial direction adjustment described imageing sensor picture element density distribution, with make the described at least one imaging region sum of all pixels separately after adjustment constant but in each described first imaging subarea picture element density distribution change.The program is not limited to concrete scene to be taken the photograph, and can determine the first imaging subarea to be regulated according to actual needs, implementation is very flexible.Such as, before adjustment, in described imageing sensor radial direction, picture element density is evenly distributed, and in Fig. 3 a, imageing sensor comprises multiple little lattice, and each little lattice represent an imaging region, one imaging region is corresponding with the sub-lens in lenslet arrays, and the pixel distribution before adjustment in each imaging region is even.According to the needs of practical application, the imaging subarea (might as well be called in " the first imaging subarea ") that each imaging region of described imageing sensor is to be regulated separately can be determined, represent " radial direction " with four-headed arrow in Fig. 3 b, with the ring belt area with certain radial width that two annulus with different Dispersive spot radius represent, represent the first imaging subarea to be regulated in each imaging region, radially adjust the picture element density distribution of each imaging region, make the pixel before and after adjusting in each imaging region all constant, but the picture element density distribution before and after adjustment in each imaging region there occurs change, specifically, the picture element density in the first imaging subarea after adjustment in each imaging region differs from the picture element density in the second imaging subarea in corresponding imaging region, as there is different Dispersive spot radius two annulus between the pixel distribution in imaging subarea (might as well as the first imaging subarea), the pixel distribution in imaging subarea in relative small circle ring (might as well as the second imaging subarea) is comparatively intensive, namely the picture element density in the first imaging subarea is larger, this makes and these two Dispersive spot radius (Dispersive spot radius d of roundlet 1represent, the Dispersive spot radius d of great circle 2represent) corresponding two the degree of depth (d of difference 1corresponding U 1, d 2corresponding U 2), the imageing sensor after adjustment carries out scene to be taken the photograph at U 2to U 1depth sub-range collect the field information of more horn of plenty, improve the heavily focusing precision of this depth sub-range that can get based on light field image thus.It should be noted that, Fig. 3 b is the alternate exemplary each imaging region of imageing sensor being carried out to the synchronous adjustment of picture element density distribution, obviously, also can according to the needs of practical application, only picture element density distribution adjustment is carried out to the part imaging region of imageing sensor and part imaging region does not adjust, to in each imaging region of adjustment can each imaging region synchronous adjustment also can at least two asynchronous adjustment of imaging region, to meet the diversified practical application request of user.In addition, in other optional implementations, according to actual needs, in an imaging region, the picture element density in the first imaging subarea also can be less than the picture element density in the second imaging subarea, and the optical field acquisition improving the second imaging subarea with this enriches degree and precision of heavily focusing.
Optionally, determine to comprise the first imaging subarea that described at least one imaging region is to be regulated separately: obtain shooting depth sub-range; Determining each imaging subarea affecting described shooting depth sub-range optical field acquisition in described at least one imaging region, is each described first imaging subarea to be regulated.Such as, in practical application, a certain shooting depth sub-range can be determined, as U according to the concern of user or equipment or interest level 2to U 1depth sub-range, determine the Dispersive spot radius scope corresponding with this depth sub-range, as d 1to d 2dispersive spot radius scope, to ring belt area corresponding with the Dispersive spot radius scope determined at least one imaging region as described first imaging subarea.The program is not limited to concrete scene to be taken the photograph, and can need to determine the first imaging subarea to be regulated, better to meet the practical application request of user according to actual concern or interested shooting depth bounds.
The obtain manner of described shooting depth sub-range is very flexible, and the embodiment of the present application does not limit this.
Such as, obtain shooting depth sub-range, comprising: the shooting degree of depth permissible range according to described light-field camera determines described shooting depth sub-range.Carry out in the optical field acquisition process of scene to be taken the photograph based on light-field camera, after having focused, the shooting degree of depth permissible range of relatively current focal plane can be determined according to geometric optical theory, now, can therefrom determine a shooting depth sub-range from shooting degree of depth permissible range.Determine that a shooting depth sub-range can be that user or equipment are paid close attention to or interested shooting depth sub-range, the corresponding Dispersive spot radius subrange of this shooting depth sub-range can be determined under this situation, the existing pixel of imaging region is utilized to be tuned up by the picture element density of corresponding for this Dispersive spot radius subrange ring belt area, enrich degree with what improve the optical field acquisition information of this shooting depth sub-range, and then improve the heavily focusing precision of this shooting depth sub-range.Or, determine that a shooting depth sub-range can be that user or equipment are not paid close attention to or uninterested shooting depth sub-range, the corresponding Dispersive spot radius subrange of this shooting depth sub-range can be determined under this situation, the existing pixel of imaging region is utilized to be turned down by the picture element density of corresponding for this Dispersive spot radius subrange ring belt area, make the more pixels in an imaging region for the optical field acquisition of user or the interested shooting depth sub-range of equipment, improve the heavily focusing precision in other regions thus.
Again such as, obtain shooting depth sub-range, comprising: determine described shooting depth sub-range according to the depth information of scene described to be taken the photograph.The program also can according to the depth information of scene to be taken the photograph, determine that a certain shooting depth sub-range of scene to be taken the photograph is the depth bounds that subscriber equipment is paid close attention to or do not paid close attention to, and carry out the adjustment of described image sensor pixel density distribution accordingly, better meet the differentiation optical field acquisition demand in special scenes thus.
Optionally, according to the picture element density distribution of the described imageing sensor of each described first imaging subarea radial direction adjustment, comprise: the object pixel density distribution information determining described imageing sensor radial direction, in described object pixel density distribution information, imaging region described in one one described in object pixel density corresponding to the first imaging subarea differ from one second imaging subarea, described second imaging subarea is described imaging region other at least part of regions except described first imaging subarea; The picture element density distribution of described imageing sensor is adjusted according to described object pixel density distribution information.Described object pixel density distribution information illustrates user or equipment is expected the one of differentiation optical field acquisition, such as, if it is higher to enrich degree demand to the optical field acquisition of certain shooting depth sub-range, then larger to the picture element density in the first imaging subarea of at least one imaging region should taking depth sub-range in object pixel density distribution information, otherwise, then less.The program can determine object pixel density distribution information according to actual needs, the adjustment of described image sensor pixel density is carried out based on described object pixel density distribution information, the actual pixels density distribution of the described imageing sensor after adjusting is approached as far as possible and is even same as described object pixel density distribution information, better meet user or the diversified practical application request of equipment thus.
Optionally, in described object pixel density distribution information, the object pixel density difference that at least two described first imaging subareas are corresponding respectively.The described object pixel density distribution information adopting the program to provide carries out picture element density adjustment to described imageing sensor, can realize carrying out asynchronous adjustment to the picture element density distribution of at least two different imaging regions of imageing sensor, the object point of the corresponding different depth of different imaging region possibility or the optical field acquisition of the different object point of the same degree of depth, the asynchronous picture element density adjustment mode that the program provides improves the flexibility of optical field acquisition configuration.
Optionally, in described object pixel density distribution information, the object pixel density of corresponding at least two described first imaging subareas difference correspondences is identical.The described object pixel density distribution information adopting the program to provide carries out picture element density adjustment to described imageing sensor, can realize carrying out synchronous adjustment, to improve the flexibility of implementation to the picture element density distribution of the different imaging region of imageing sensor at least two.
Optionally, adjust the picture element density distribution of described imageing sensor according to described object pixel density distribution information, comprising: according to the shape control information in described object pixel density distribution information determination controllable deforming material portion; Control described controllable deforming material portion according to described shape control information and deformation occurs, distribute with the picture element density of the described imageing sensor of the corresponding adjustment of deformation by described controllable deforming material portion.The program adjusts the pixel distribution of described imageing sensor by the deformation controlling controllable deforming material portion, and scheme is simple and easy to realize.
Described controllable deforming material portion is certain the external action factor (as outfield) acted on it by change can make it that deformation occurs, and when acting on the outfield on it and cancelling or change, the deformation in this controllable deforming material portion can recover.Optionally, described controllable deforming material portion is at least prepared from by one or more controllable deforming materials following: piezoelectric, electroactive polymer, photo-deformable material, magnetostrictive material.
The structural representation of the imageing sensor that Fig. 1 b provides a kind of picture element density adjustable for the embodiment of the present application.As shown in Figure 1 b, the imageing sensor that the picture element density that the embodiment of the present application provides is adjustable comprises: multiple image sensor pixel 11 and a controllable deforming material portion 12, wherein, imageing sensor carries out IMAQ by image sensor pixel 11, multiple image sensor pixel 11 is in array distribution, and controllable deforming material portion 12 is connected with multiple image sensor pixel 11 respectively; Can deformation be there is and the density distribution of the multiple image sensor pixel 11 of the corresponding adjustment of deformation by controllable deforming material portion 12 in controllable deforming material portion 12 under outer field action.
In the technical scheme that the embodiment of the present application provides, described controllable deforming material portion can make it that deformation occurs by certain the outer field action factor changed in this controllable deforming material portion, when certain outer field action factor is cancelled or changes, the deformation in this controllable deforming material portion can recover, described outfield can for the deformation behavior selection index system in described controllable deforming material portion corresponding control outfield thereon, and such as described outfield includes but not limited to external electrical field, magnetic field, light field etc.Image sensor pixel can include but not limited at least one photoelectric conversion unit.Can adopt between each image sensor pixel with controllable deforming material portion but be not limited to the mode such as bonding and carry out compact siro spinning technology, like this, when deformation occurs in described controllable deforming material portion, will spacing between each image sensor pixel of corresponding adjustment, change the density distribution of image sensor pixel thus, reach the effect can given imageing sensor zones of different according to actual needs and distribute with differentiation picture element density.
In practical application, by the zones of different of the outer field action of uneven distribution in described controllable deforming material portion, different piece region, described controllable deforming material portion generation distortion in various degree can be made, adjust the global density distribution of image sensor pixel thus.Optionally, can by described outer field action in described controllable deforming material portion and multiple nonoverlapping region of described image sensor pixel, the region overlapping with described image sensor pixel, described controllable deforming material portion can be made like this deformation not to occur, but the density distribution of image sensor pixel is changed by the deformation of other parts in described controllable deforming material portion, the program is conducive to the damage avoiding the deformation because of controllable deforming material portion to cause described image sensor pixel.
In practical application, suitable at least one controllable deforming material can be selected as required to prepare described controllable deforming material portion, there is deformability to make described controllable deforming material portion and be out of shape recoverable characteristic.Optionally, described controllable deforming material portion is at least prepared from by one or more controllable deforming materials following: piezoelectric, electroactive polymer, photo-deformable material, magnetostrictive material.
Described piezoelectric can produce mechanical deformation because of electric field action.The controllable deforming material portion adopting described piezoelectric to prepare is hereinafter referred to as piezoelectric material.Utilize this physical characteristic of described piezoelectric, the embodiment of the present application can according to but be not limited to the electric field controls information that described object pixel density distribution information determines making piezoelectric material to occur needed for corresponding mechanical deformation, according to the electric field of described electric field controls information control action at piezoelectric material, make described piezoelectric material that corresponding mechanical deformation occur, distributed by the picture element density of the corresponding adjustment imageing sensor of the mechanical deformation of described piezoelectric material, reach the object of the picture element density distribution adjusting described imageing sensor according to described object pixel density distribution information thus.Described piezoelectric can include but not limited to following one of at least: piezoelectric ceramic, piezoelectric crystal.The program can make full use of the physical characteristic of piezoelectric to adjust the picture element density distribution of imageing sensor.
Described electroactive polymer (Electroactive Polymers is called for short EAP) is the polymeric material that a class can change its shape or size under electric field action.The controllable deforming material portion adopting described electroactive polymer to prepare is hereinafter referred to as electroactive polymer portion.Utilize this physical characteristic of described electroactive polymer, the embodiment of the present application can according to but be not limited to the electric field controls information that described object pixel density distribution information determines making electroactive polymer portion to occur needed for corresponding deformation, according to the electric field of described electric field controls information control action at layer of electroactive polymer, make described layer of electroactive polymer that corresponding deformation occur, distributed by the picture element density of the corresponding adjustment imageing sensor of the deformation of described layer of electroactive polymer, reach the object of the picture element density distribution adjusting described imageing sensor according to described object pixel density distribution information thus.Described electroactive polymer can include but not limited to following one of at least: electron type electroactive polymer, ionic electroactive polymer; Described electron type electroactive polymer comprise following one of at least: ferroelectric polymer (as Kynoar etc.), electrostriction grafted elastomeric, liquid crystal elastic body; Described ionic electroactive polymer comprise following one of at least: electrorheological fluid, ion polymer-metal composite material etc.The program can make full use of the physical characteristic of electroactive polymer to adjust the picture element density distribution of imageing sensor.
Described photo-deformable material is the macromolecular material that a class can change its shape or size under light field effect.The controllable deforming material portion adopting described photo-deformable material to prepare is hereinafter referred to as photo-deformable material portion.Utilize this physical characteristic of described photo-deformable material, the embodiment of the present application can according to but be not limited to the light field control information that described object pixel density distribution information determination photo-deformable material portion occurs needed for corresponding deformation, according to the light field of described light field control information control action in described photo-deformable material portion, make described photo-deformable material portion that corresponding deformation occur.Distributed by the picture element density of the corresponding adjustment imageing sensor of deformation in described photo-deformable material portion, reach the object of the picture element density distribution adjusting described imageing sensor according to described object pixel density distribution information thus.Described photo-deformable material can include but not limited to following one of at least: photo-induced telescopic ferroelectric ceramic, photo-deformable polymer; Described photo-induced telescopic ferroelectric ceramic includes but not limited to lead lanthanum zirconate titanate (PLZT) pottery, and photo-deformable polymer includes but not limited to photo-deformable liquid crystal elastomer).The program can make full use of the physical characteristic of photo-deformable material to adjust the picture element density distribution of imageing sensor.
Described magnetostrictive material are that a class can change its magnetized state under magnetic fields, and then the magnetic material that its size is changed.The controllable deforming material portion adopting described magnetostriction material to prepare is hereinafter referred to as magnetostriction material portion.Utilize this physical characteristic of described magnetostrictive material, the embodiment of the present application can according to but the Magnetic control information be not limited to needed for described object pixel density distribution information determination magnetostrictive material generation corresponding deformation, according to the magnetic field of described Magnetic control information control action in described magnetostriction material portion, make described magnetostriction material portion that corresponding deformation occur.Distributed by the picture element density of the corresponding adjustment imageing sensor of deformation in described magnetostriction material portion, reach the object of the picture element density distribution adjusting described imageing sensor according to described object pixel density distribution information thus.Described magnetostriction material can include but not limited to rare earth ultra-magnetostriction material, as with (Tb, Dy) Fe 2compound is the alloy Tbo of matrix 0.3dy 0.7fe 1.95material etc.The program can make full use of the physical characteristic of magnetostriction material to adjust the picture element density distribution of imageing sensor.
In the technical scheme that the embodiment of the present application provides, concrete structure and the connected mode in each image sensor pixel and controllable deforming material portion can be determined according to actual needs, and practical ways is very flexible.
A kind of optional implementation, as shown in Figure 1 b, described controllable deforming material portion 12 comprises: a controllable deforming material layer 121, multiple described image sensor pixel 11 array distribution and be connected to the one side of described controllable deforming material layer 121.Optionally, multiple described image sensor pixel can be selected directly to be formed on described controllable deforming material layer 12 according to actual process condition, or multiple described image sensor pixel can be prepared respectively with described controllable deforming material layer 12 and the two can adopt but be not limited to bonding mode compact siro spinning technology.Program structure simply, easily realizes.
Another kind of optional implementation, as illustrated in figure 1 c, described controllable deforming material portion 12 comprises multiple controllable deforming material connexon portion 122, multiple described controllable deforming material connexon portions 122 array distribution, connect the multiple described image sensor pixel 11 of array distribution with correspondence, namely the multiple described image sensor pixel of array distribution is connected as one by the multiple described controllable deforming material connexon portion of array distribution.Optionally, can form multiple described controllable deforming material connexon portion according to actual process at the interval region of the pixel of image sensor pixel array, multiple described controllable deforming material connexon portion can adopt with respective image sensor pixel but the mode such as be not limited to abut, bonding connects.By controlling multiple described deformation in controllable deforming material connexon portion and the density distribution of adjustable image sensor pixel, structure is simple, easily realizes.
Further, as shown in figs. 1 d and 1e, described imageing sensor also can comprise: shape control portion 13, shape control portion 13 is for the distribution of regulating action to the described outfield in described controllable deforming material portion 12, corresponding deformation is there is to control described controllable deforming material portion 12, like this, when deformation occurs in described controllable deforming material portion 12, will spacing between each image sensor pixel 11 of corresponding adjustment, change the density distribution of image sensor pixel 11 thus, reach the effect can given imageing sensor zones of different according to actual needs and distribute with differentiation picture element density.
Optionally, as shown in Figure 1 d, described shape control portion can comprise light field control part 131, and light field control part 131, for the exterior light field distribution of regulating action to described controllable deforming material portion 12, to control described controllable deforming material portion 12, corresponding deformation occurs.Under this situation, described controllable deforming material portion 12 can comprise the photo-deformable material portion be at least prepared from by photo-deformable material, as as described in photo-deformable material portion can comprise at least by as described in photo-deformable material prepare and the photo-deformable material layer that obtains, or described controllable deforming material portion can comprise the multiple photo-deformable material connexon portions at least obtained by described photo-deformable material preparation.Light field control part 131 acts on the optical field distribution (being represented the light field acting on the varying strength distribution of described controllable deforming material portion 12 in Fig. 1 d by arrow density) in described photo-deformable material portion by changing, encourage the zones of different generation deformation in various degree in described controllable deforming material portion 12, and by the spacing between the corresponding each image sensor pixel 11 of the deformation in described controllable deforming material portion 12, change the density distribution of image sensor pixel 11 thus, reach the effect can given imageing sensor zones of different according to actual needs and distribute with differentiation picture element density.
Optionally, as shown in fig. le, described shape control portion can comprise electric field controls portion 132, and electric field controls portion 132 distributes for the external electrical field of regulating action to described controllable deforming material portion, to control described controllable deforming material portion, corresponding deformation occurs.Under this situation, described controllable deforming material portion 12 can comprise at least by piezoelectric prepare piezoelectric material (as piezoelectric material layer or piezoelectric connexon portion, etc.), or, described controllable deforming material portion 12 can comprise the electroactive polymer portion (as layer of electroactive polymer or electroactive polymer connexon portion, etc.) be at least prepared from by electroactive polymer.As shown in fig. le, electric field controls portion and controllable deforming material is connected by control line, electric field controls portion 132 acts on the Electric Field Distribution in described controllable deforming material portion by changing, encourage the zones of different generation deformation in various degree in described controllable deforming material portion 12.If acting on described controllable deforming material portion 12 electric field is zero electric field, then there is not deformation (might as well be called zero electric field excitation) in described controllable deforming material portion, if change the electric field strong and weak distribution (as illustrated in the drawing the excitation of "+" positive electric field and the excitation of "-" negative electric field) acting on described controllable deforming material portion 12, make the electric field strength difference to some extent acting on described controllable deforming material portion 12 zones of different, as shown in Figure 1 f, like this, deformation in various degree can be there is in the zones of different in described controllable deforming material portion, and by the spacing between each image sensor pixel 11 of the corresponding adjustment of deformation in described controllable deforming material portion 12, change the whole pixel density distribution of imageing sensor thus, reach the effect can given imageing sensor zones of different according to actual needs and distribute with differentiation picture element density.
The portion of controllable deforming described in the embodiment of the present application can directly be connected with shape control portion, also can indirectly connect.Described shape control portion can be used as a part for described imageing sensor, or described shape control portion also can not as a part for described imageing sensor, and described imageing sensor also can the mode such as reserved pin, interface be connected with described shape control portion.The outfield acted in described controllable deforming material portion can include but not limited to electric field, magnetic field, light field etc.For generation of hardware, the software configuration of electric field, for generation of the hardware in magnetic field, software configuration and hardware, software configuration etc. for generation of light field, can adopt corresponding existing techniques in realizing according to actual needs, the embodiment of the present application does not repeat them here.
Optionally, described imageing sensor also can comprise flexible substrate, and described flexible substrate can include but not limited to flexible plastic substrate, and it has certain flexibility, can change the shape of flexible substrate as required.Image sensor pixel, controllable deforming material portion can establish homonymy or the not homonymy of flexible substrate.Such as: as shown in Figure 1 g, multiple described image sensor pixels 11 are connected to the one side of flexible substrate 14, and controllable deforming material portion (as controllable deforming material layer 121) is connected to the another side of flexible substrate 14.Again such as: as shown in figure 1h, multiple described image sensor pixels 11 are connected to the one side of flexible substrate 14, controllable deforming material portion (as controllable deforming material connexon portion 122) connect corresponding image sensor pixel and with as described in image sensor pixel 11 be positioned at as described in the same face of flexible substrate 14.The program not only can be controlled it and whole pixel density distribution that deformation carrys out Indirect method imageing sensor occurs by the outfield acting on controllable deforming material portion, the picture degree density realizing imageing sensor is adjustable, the shape of imageing sensor also can be changed flexibly because which employs flexible substrate, as the imageing sensor of plane bent certain angle to obtain the imageing sensor of curved surface, meet the application demands such as variety of images collection, decoration thus.
Fig. 1 i provides the structural representation of the 7th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application.In imageing sensor as shown in figure 1i, described controllable deforming material portion 12 comprises: flexible substrate 123 and multiple permeability magnetic material portion 124; Multiple image sensor pixel 11 is connected with flexible substrate 123 respectively, at least part of image sensor pixel 11 is connected with multiple permeability magnetic material portion 124, by changing the magnetic field acting on permeability magnetic material portion 124 and make flexible substrate 123 that corresponding deformation occur and by the density distribution of the multiple described image sensor pixel 11 of the corresponding adjustment of described deformation.Such as: a permeability magnetic material portion 124 can be arranged in the side of each image sensor pixel, optionally, image sensor pixel 11 is bonding with flexible substrate 123 and permeability magnetic material portion 124 respectively.Described permeability magnetic material portion can comprise magnetic pole prepared by permeability magnetic material, and described permeability magnetic material can be, but not limited to use soft magnetic material, silicon steel sheet, permalloy, ferrite, one or more in amorphous soft magnetic alloy, super-microcrystalline soft magnetic alloy etc.The described permeability magnetic material portion magnetic property adopting soft magnetic material to do to prepare is better, and magnetic field is cancelled very little being convenient to of rear remanent magnetism and adjusted next time.
Further, optionally, shape control portion 13 described in the embodiment of the present application also can comprise: magnetic field control unit 133, and magnetic field control unit 133 distributes for the external magnetic field of regulating action to described controllable deforming material portion, to control described controllable deforming material portion, corresponding deformation occurs.Such as, when the magnetic field of magnetic field control unit 133 control action in permeability magnetic material portion 124 (i.e. excitation field) changes, the same magnetic pole (NN or SS) applying certain magnetic field strength distribution between neighboring image sensors pixel as shown in figure 1i repels magnetic field or different pole (NS or SN) attracts magnetic field, the corresponding generation repulsive force of meeting or attraction between magnetic pole, this magneticaction is delivered to flexible substrate 123 makes flexible substrate 123 that flexible grade for distortion occur, and then cause the spacing between respective image sensor pixel to change, realize the object of adjustment image sensor pixel density distribution.The program is in conjunction with deformation behavior and the Magnetic control principle such as scalable of flexible substrate, and the picture element density distribution realized on imageing sensor is adjustable.
Fig. 1 j provides the structural representation of the 8th kind of imageing sensor that picture element density is adjustable for the embodiment of the present application.In imageing sensor as shown in fig. ij, described controllable deforming material portion 12 comprises: flexible substrate 123 and multiple permeability magnetic material portion 124; The one side in multiple permeability magnetic material portion 124 is connected with described flexible substrate 123 respectively, the opposite face in multiple described permeability magnetic material portion 124 is connected respectively multiple described image sensor pixel 11, by changing the magnetic field acting on described permeability magnetic material portion 124 and make described flexible substrate 11 that corresponding deformation occur and by the density distribution of the multiple described image sensor pixel 11 of the corresponding adjustment of described deformation.Optionally, permeability magnetic material portion 124 is bonding with flexible substrate 123, image sensor pixel 11 is bonding with permeability magnetic material portion 124, when flexible substrate 123 occurs when acting on the magnetic field in permeability magnetic material portion 124 and changing, magneticaction is delivered to flexible substrate 123 makes flexible substrate 123 that flexible grade for distortion occur, and then realizes the object of adjustment image sensor pixel density distribution.The program is in conjunction with deformation behavior and the Magnetic control principle such as scalable of flexible substrate, and the picture element density distribution realized on imageing sensor is adjustable.
After picture element density distribution adjustment is carried out according to described object pixel density distribution information to described imageing sensor, the optical field acquisition of scene to be taken the photograph described in carrying out, in optical field acquisition process, each image sensor pixel of described imageing sensor all take part in IMAQ.Because the picture element density distribution of described imageing sensor adjusts according to described object pixel density distribution information, and the depth information that described image object picture element density information is scene to be taken the photograph described in basis is determined, therefore, the information of scene to be taken the photograph according to the described imageing sensor collection after adjustment, the field information that can obtain this scene zones of different on depth of field direction enriches the light field image that degree there are differences, described imageing sensor relatively described object pixel density distribution informational needs carries out the part of more horn of plenty field information (comprising image spatial resolution and/or angular resolution), have more pixel and participate in optical field acquisition, the field information that this part collects comparatively horn of plenty, and other parts of described imageing sensor, have less pixel and participate in optical field acquisition, field information does not enrich, improve optical field acquisition efficiency on the whole thus, can meet and improve the heavy focus image definition of a certain depth of field based on light field image, and/or, the practical application request such as the full focus image acutance of certain certain field depth.
It will be appreciated by those skilled in the art that, in the above-mentioned either method of the application's embodiment, the sequence number size of each step does not also mean that the priority of execution sequence, the execution sequence of each step should be determined with its function and internal logic, and should not form any restriction to the implementation process of the application's embodiment.
The logic diagram of a kind of optical field acquisition control device that Fig. 4 provides for the embodiment of the present application.As shown in Figure 4, a kind of optical field acquisition control device that the embodiment of the present application provides comprises: the radial adjusting module 41 of a picture element density and an optical field acquisition module 42.
The radial adjusting module 41 of picture element density is for the picture element density distribution of the imageing sensor of radial direction adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor.
Optical field acquisition module 42 carries out the optical field acquisition of scene to be taken the photograph for the described imageing sensor after adjustment.
The technical scheme that the embodiment of the present application provides is by carrying out radial direction adjustment to image sensor pixel distribution, after described imageing sensor carries out radial picture element density adjustment, picture element density distribution at least one imaging region of imageing sensor in different Dispersive spot radius presents differentiation heterogeneous distribution, be equivalent to readjust the pixel distribution in described at least one imaging region, and the described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph, the degree of enriching of the field information that different depth collects be there are differences, also there is corresponding non-uniform Distribution in the heavily focusing precision of the light field image that different depth is corresponding, the existing pixel that the program is conducive to making full use of imageing sensor pays close attention to user or equipment or interested depth bounds obtains higher heavily focusing precision, to obtain the heavy focus image information of this depth bounds more horn of plenty based on the light field image collected, improve optical field acquisition efficiency thus, better meet the diversified practical application request of user.
The equipment form of expression of described optical field acquisition control device is unrestricted, and such as described optical field acquisition control device can be a certain independently parts, and these parts coordinate with light-field camera and communicate; Or described optical field acquisition control device can be used as a certain functional module and is integrated in one and includes in the image capture device of light-field camera, and the embodiment of the present application does not limit this.
Optionally, as shown in Figure 5, the radial adjusting module 41 of described picture element density comprises: submodule 411 and picture element density radial direction adjustment submodule 412 are determined in one first imaging subarea.First imaging subarea determines that submodule 411 is for determining the first imaging subarea that described at least one imaging region is to be regulated separately.Picture element density radial direction adjustment submodule 412 for according to each described first imaging subarea radial direction adjustment described imageing sensor picture element density distribution, with make the described at least one imaging region sum of all pixels separately after adjustment constant but in each described first imaging subarea picture element density distribution change.The program is not limited to concrete scene to be taken the photograph, and can determine the first imaging subarea to be regulated according to actual needs, implementation is very flexible.Optionally, the first imaging subarea described in for having the ring belt area of certain radial width in imaging region described in, with the differentiation optical field acquisition realized in the depth bounds corresponding with this ring belt area that distributed by the picture element density changed in this ring belt area.
Optionally, described first imaging subarea determines that submodule 411 comprises: an object pixel density distribution information determination unit 4111 and picture element density distribution adjustment unit 4112.Object pixel density distribution information determination unit 4111 is for determining the object pixel density distribution information of described imageing sensor radial direction, in described object pixel density distribution information, imaging region described in one one described in object pixel density corresponding to the first imaging subarea differ from one second imaging subarea, described second imaging subarea is described imaging region other at least part of regions except described first imaging subarea.Picture element density distribution adjustment unit 4112 is for adjusting the picture element density distribution of described imageing sensor according to described object pixel density distribution information.The program can determine object pixel density distribution information according to actual needs, the adjustment of described image sensor pixel density is carried out based on described object pixel density distribution information, the actual pixels density distribution of the described imageing sensor after adjusting is approached as far as possible and is even same as described object pixel density distribution information, better meet user or the diversified practical application request of equipment thus.Optionally, in described object pixel density distribution information, the object pixel density difference that at least two described first imaging subareas are corresponding respectively, the program can realize carrying out asynchronous adjustment to the picture element density distribution of the different imaging region of imageing sensor at least two, improves the flexibility of optical field acquisition configuration.Or, optionally, in described object pixel density distribution information, the object pixel density of corresponding at least two described first imaging subareas difference correspondences is identical, the program can realize carrying out synchronous adjustment, to improve the flexibility of implementation to the picture element density distribution of the different imaging region of imageing sensor at least two.
Optionally, described picture element density distribution adjustment unit 4112 comprises: shape control information determination subelement 41121 and a shape control subelement 41122.Shape control information determination subelement 41121 is for the shape control information according to described object pixel density distribution information determination controllable deforming material portion; There is deformation for controlling described controllable deforming material portion according to described shape control information in shape control subelement 41122, distributes with the picture element density of the described imageing sensor of the corresponding adjustment of deformation by described controllable deforming material portion.Described controllable deforming material portion is at least prepared from by one or more controllable deforming materials following: piezoelectric, electroactive polymer, photo-deformable material, magnetostrictive material.The program adjusts the pixel distribution of described imageing sensor by the deformation controlling controllable deforming material portion, and scheme is simple and easy to realize.
Optionally, described first imaging subarea determines that submodule 411 comprises: shooting depth sub-range acquiring unit 4113 and an one first imaging subarea determining unit 4114.Shooting depth sub-range acquiring unit 4113 is for obtaining shooting depth sub-range.First imaging subarea determining unit 4114, for determining each imaging subarea affecting described shooting depth sub-range optical field acquisition in described at least one imaging region, is each described first imaging subarea to be regulated.The program is not limited to concrete scene to be taken the photograph, and can need to determine the first imaging subarea to be regulated, better to meet the practical application request of user according to actual concern or interested shooting depth bounds.
Optionally, described shooting depth sub-range acquiring unit 4113 comprises: one first shooting depth sub-range obtains subelement 41131, first shooting depth sub-range acquisition subelement 41131 and determines described shooting depth sub-range for the shooting degree of depth permissible range according to described light-field camera.The program is not limited to concrete scene to be taken the photograph, and implementation is very flexible.
Optionally, described shooting depth sub-range acquiring unit 4113 comprises: one second shooting depth sub-range obtains subelement 41132, second shooting depth sub-range acquisition subelement 41132 and determines described shooting depth sub-range for the depth information of scene to be taken the photograph described in basis.The program can determine described shooting depth sub-range in conjunction with special scenes, better can meet the differentiation optical field acquisition demand in special scenes.
The structured flowchart of another optical field acquisition control device that Fig. 6 provides for the embodiment of the present application, the application's specific embodiment does not limit the specific implementation of optical field acquisition control device 600.As shown in Figure 6, optical field acquisition control device 600 can comprise:
Processor (Processor) 610, communication interface (Communications Interface) 620, memory (Memory) 630 and communication bus 640.Wherein:
Processor 610, communication interface 620 and memory 630 complete mutual communication by communication bus 640.
Communication interface 620, for the communication such as equipment, external light source such as with communication function.
Processor 610, for executive program 632, specifically can perform the correlation step in above-mentioned arbitrary optical field acquisition control method embodiment.
Such as, program 632 can comprise program code, and described program code comprises computer-managed instruction.
Processor 610 may be a central processing unit (Central Processing Unit, be called for short CPU), or specific integrated circuit (Application Specific Integrated Circuit, be called for short ASIC), or be configured to the one or more integrated circuits implementing the embodiment of the present application.
Memory 630, for depositing program 632.Memory 630 may comprise random access memory (Random Access Memory is called for short RAM), still may comprise nonvolatile memory (Non-volatile memory), such as at least one magnetic disc store.
Such as, in the optional implementation of one, processor 610 can perform following steps by executive program 632: the picture element density distribution of the imageing sensor of radial adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor; Described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph.
In other optional implementations, processor 610 also can perform by executive program 632 step that other any embodiment above-mentioned mention, does not repeat them here.
In program 632, the specific implementation of each step see description corresponding in the corresponding steps in above-described embodiment, module, submodule, unit, can not repeat them here.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the equipment of foregoing description and the specific works process of module, can describe with reference to the corresponding process in preceding method embodiment, not repeat them here.
The logic diagram of a kind of optical field acquisition equipment that Fig. 7 provides for the embodiment of the present application.As shown in Figure 7, a kind of optical field acquisition equipment 70 that the embodiment of the present application provides comprises light-field camera 71 and an optical field acquisition control device 72, and described optical field acquisition control device 72 is connected with described optical field acquisition equipment 70.Structure, the operation principle of described optical field acquisition control device 72 describe and see the record of corresponding embodiment above, can not repeat them here.Described light-field camera can include but not limited to have take pictures, photograph, make a video recording, the equipment of the optical field acquisition function such as video monitoring, such as can be but be not limited to following device type: camera, mobile phone, camera, video camera, video tape recorder, etc.
The technical scheme that the embodiment of the present application provides is by carrying out radial direction adjustment to image sensor pixel distribution, after described imageing sensor carries out radial picture element density adjustment, picture element density distribution at least one imaging region of imageing sensor in different Dispersive spot radius presents differentiation heterogeneous distribution, be equivalent to readjust the pixel distribution in described at least one imaging region, and the described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph, the degree of enriching of the field information that different depth collects be there are differences, also there is corresponding non-uniform Distribution in the heavily focusing precision of the light field image that different depth is corresponding, the existing pixel that the program is conducive to making full use of imageing sensor pays close attention to user or equipment or interested depth bounds obtains higher heavily focusing precision, to obtain the heavy focus image information of this depth bounds more horn of plenty based on the light field image collected, improve optical field acquisition efficiency thus, better meet the diversified practical application request of user.
Optionally, described imageing sensor can adopt flexible image transducer mentioned above.Or described imageing sensor also can comprise: multiple image sensor pixels of array distribution; One controllable deforming material portion, is connected with multiple described image sensor pixel respectively; Can deformation be there is and by the density distribution of the multiple described image sensor pixel of the corresponding adjustment of described deformation in described controllable deforming material portion under outer field action; Described outfield is controlled by described imaging control apparatus.
About the structure of described imageing sensor can see the corresponding record of Fig. 1 b-Fig. 1 j, described imaging control apparatus directly can control described outfield to control the deformation in described controllable deforming material portion, and then the picture element density distribution of the described imageing sensor of radial adjustment; Or described imaging control apparatus controls outfield indirectly by controlling described shape control portion, generation corresponding deformation in described controllable deforming material portion is made to adjust the picture element density distribution of described imageing sensor with radial direction; Etc..The physical connection mode in described image sensor pixel and described deformable material portion, can determine according to actual needs, as long as the picture element density meeting the imageing sensor described in adjustable when deformation occurs in described deformable material portion distributes, the embodiment of the present application does not limit this, and specific implementation can see corresponding record above; The light channel structure of described light-field camera see Fig. 2 and corresponding record above, can not repeat them here.
In the application's the various embodiments described above, the sequence number of embodiment and/or sequencing are only convenient to describe, and do not represent the quality of embodiment.The description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.The enforcement principle of relative assembly, equipment or system embodiment or the associated description of process, see the record of correlation method embodiment, can not repeat them here.
Those of ordinary skill in the art can recognize, in conjunction with unit and the method step of each example of embodiment disclosed herein description, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can use distinct methods to realize described function to each specifically should being used for, but this realization should not think the scope exceeding the application.
If described function using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part of the part that the technical scheme of the application contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the application.And aforesaid storage medium comprises: USB flash disk, portable hard drive, read-only memory (Read-Only Memory, be called for short ROM), random access memory (Random Access Memory, be called for short RAM), magnetic disc or CD etc. various can be program code stored medium.
In the embodiment such as device, method, system of the application, obviously, each parts (system, subsystem, module, submodule, unit, subelement etc.) or each step reconfigure after can decomposing, combine and/or decomposing.These decompose and/or reconfigure the equivalents that should be considered as the application.Simultaneously, in the description above to the application's specific embodiment, the feature described for a kind of execution mode and/or illustrate can use in one or more other execution mode in same or similar mode, combined with the feature in other execution mode, or substitute the feature in other execution mode.
Should emphasize, term " comprises/comprises " existence referring to feature, key element, step or assembly when using herein, but does not get rid of the existence or additional of one or more further feature, key element, step or assembly.
It is last it is noted that above execution mode is only for illustration of the application; and the restriction not to the application; the those of ordinary skill of relevant technical field; when not departing from the spirit and scope of the application; can also make a variety of changes and modification; therefore all equivalent technical schemes also belong to the category of the application, and the scope of patent protection of the application should be defined by the claims.

Claims (10)

1. an optical field acquisition control method, is characterized in that, comprising:
The picture element density distribution of the imageing sensor of radial adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor;
Described imageing sensor after adjustment carries out the optical field acquisition of scene to be taken the photograph.
2. method according to claim 1, is characterized in that, the picture element density distribution of the described imageing sensor of radial adjustment, comprising:
Determine the first imaging subarea that described at least one imaging region is to be regulated separately;
According to each described first imaging subarea radial direction adjustment described imageing sensor picture element density distribution, with make the described at least one imaging region sum of all pixels separately after adjustment constant but in each described first imaging subarea picture element density distribution change.
3. method according to claim 2, is characterized in that, determines to comprise the first imaging subarea that described at least one imaging region is to be regulated separately:
Obtain shooting depth sub-range;
Determining each imaging subarea affecting described shooting depth sub-range optical field acquisition in described at least one imaging region, is each described first imaging subarea to be regulated.
4. according to the method in claim 2 or 3, it is characterized in that, according to the picture element density distribution of the described imageing sensor of each described first imaging subarea radial direction adjustment, comprising:
Determine the object pixel density distribution information of described imageing sensor radial direction, in described object pixel density distribution information, imaging region described in one one described in object pixel density corresponding to the first imaging subarea differ from one second imaging subarea, described second imaging subarea is described imaging region other at least part of regions except described first imaging subarea;
The picture element density distribution of described imageing sensor is adjusted according to described object pixel density distribution information.
5. method according to claim 4, is characterized in that, adjusts the picture element density distribution of described imageing sensor, comprising according to described object pixel density distribution information:
According to the shape control information in described object pixel density distribution information determination controllable deforming material portion;
Control described controllable deforming material portion according to described shape control information and deformation occurs, distribute with the picture element density of the described imageing sensor of the corresponding adjustment of deformation by described controllable deforming material portion.
6. an optical field acquisition control device, its feature is, comprising:
The radial adjusting module of one picture element density, for the picture element density distribution of the imageing sensor of radial direction adjustment light-field camera, to make at least one imaging region pixel separately in the described imageing sensor after adjustment constant but picture element density changes, imaging region described in is region corresponding with a sub-lens of the lenslet arrays of described light-field camera in described imageing sensor;
One optical field acquisition module, carries out the optical field acquisition of scene to be taken the photograph for the described imageing sensor after adjustment.
7. device according to claim 6, is characterized in that, the radial adjusting module of described picture element density comprises:
Submodule is determined in one first imaging subarea, for determining the first imaging subarea that described at least one imaging region is to be regulated separately;
One picture element density radial direction adjustment submodule, for according to each described first imaging subarea radial direction adjustment described imageing sensor picture element density distribution, with make the described at least one imaging region sum of all pixels separately after adjustment constant but in each described first imaging subarea picture element density distribution change.
8. device according to claim 7, is characterized in that, described first imaging subarea determines that submodule comprises:
One object pixel density distribution information determination unit, for determining the object pixel density distribution information of described imageing sensor radial direction, in described object pixel density distribution information, imaging region described in one one described in object pixel density corresponding to the first imaging subarea differ from one second imaging subarea, described second imaging subarea is described imaging region other at least part of regions except described first imaging subarea;
One picture element density distribution adjustment unit, for adjusting the picture element density distribution of described imageing sensor according to described object pixel density distribution information.
9. the device according to claim 7 or 8, is characterized in that, described picture element density distribution adjustment unit comprises:
One shape control information determination subelement, for the shape control information according to described object pixel density distribution information determination controllable deforming material portion;
, there is deformation for controlling described controllable deforming material portion according to described shape control information, distribute with the picture element density of the described imageing sensor of the corresponding adjustment of deformation by described controllable deforming material portion in one shape control subelement.
10. an optical field acquisition equipment, is characterized in that, comprises a light-field camera and just like the arbitrary described optical field acquisition control device of claim 6-9, described optical field acquisition control device is connected with described light-field camera.
CN201410670629.7A 2014-11-20 2014-11-20 Optical field acquisition control method and device, optical field acquisition equipment Active CN104469147B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410670629.7A CN104469147B (en) 2014-11-20 2014-11-20 Optical field acquisition control method and device, optical field acquisition equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410670629.7A CN104469147B (en) 2014-11-20 2014-11-20 Optical field acquisition control method and device, optical field acquisition equipment

Publications (2)

Publication Number Publication Date
CN104469147A true CN104469147A (en) 2015-03-25
CN104469147B CN104469147B (en) 2018-09-04

Family

ID=52914443

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410670629.7A Active CN104469147B (en) 2014-11-20 2014-11-20 Optical field acquisition control method and device, optical field acquisition equipment

Country Status (1)

Country Link
CN (1) CN104469147B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016041432A1 (en) * 2014-09-15 2016-03-24 Beijing Zhigu Tech Co., Ltd. Light field capture control methods and apparatuses, light field capture devices
WO2016169503A1 (en) * 2015-04-22 2016-10-27 Beijing Zhigu Rui Tuo Tech Co., Ltd. Image capture control methods and apparatuses
CN106161920A (en) * 2015-04-22 2016-11-23 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
CN106303209A (en) * 2015-08-31 2017-01-04 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
CN106303210A (en) * 2015-08-31 2017-01-04 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
CN106303208A (en) * 2015-08-31 2017-01-04 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
US20170264843A1 (en) * 2014-09-09 2017-09-14 Beijing Zhigu Tech Co., Ltd. Light field capture control methods and apparatuses, light field capture devices
CN107241612A (en) * 2017-07-06 2017-10-10 北京潘达互娱科技有限公司 Live network broadcast method and device
CN107483828A (en) * 2017-09-12 2017-12-15 北京小米移动软件有限公司 Zooming method, zoom lens control device and electronic equipment
CN107592455A (en) * 2017-09-12 2018-01-16 北京小米移动软件有限公司 Shallow Deep Canvas imaging method, device and electronic equipment
CN107682597A (en) * 2017-09-01 2018-02-09 北京小米移动软件有限公司 Imaging method, imaging device and electronic equipment
CN107707813A (en) * 2017-09-12 2018-02-16 北京小米移动软件有限公司 Super Deep Canvas imaging method, device and electronic equipment
CN109644264A (en) * 2016-08-25 2019-04-16 脸谱科技有限责任公司 Array detector for depth map
CN111526273A (en) * 2020-04-29 2020-08-11 维沃移动通信有限公司 Camera module, electronic equipment, shooting control method and shooting control device
WO2022174409A1 (en) * 2021-02-20 2022-08-25 京东方科技集团股份有限公司 Image acquisition device, image acquisition apparatus, image acquisition method and manufacturing method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040227703A1 (en) * 2003-05-13 2004-11-18 Mcnc Research And Development Institute Visual display with increased field of view
JP2006129411A (en) * 2004-11-01 2006-05-18 Hiroshi Arai Reconfigurable image sensor
KR100822864B1 (en) * 2006-11-09 2008-04-17 주식회사 후후 Radiation tolerant camera
CN104038690A (en) * 2013-03-05 2014-09-10 佳能株式会社 IMAGE PROCESSING APPARATUS, IMAGE CAPTURING APPARATUS, and IMAGE PROCESSING METHOD
CN104159025A (en) * 2014-08-06 2014-11-19 北京智谷睿拓技术服务有限公司 Image capturing controlling method and device, and image acquiring device
CN104159038A (en) * 2014-08-26 2014-11-19 北京智谷技术服务有限公司 Method and device of imaging control of image with shallow depth of field effect as well as imaging equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040227703A1 (en) * 2003-05-13 2004-11-18 Mcnc Research And Development Institute Visual display with increased field of view
JP2006129411A (en) * 2004-11-01 2006-05-18 Hiroshi Arai Reconfigurable image sensor
KR100822864B1 (en) * 2006-11-09 2008-04-17 주식회사 후후 Radiation tolerant camera
CN104038690A (en) * 2013-03-05 2014-09-10 佳能株式会社 IMAGE PROCESSING APPARATUS, IMAGE CAPTURING APPARATUS, and IMAGE PROCESSING METHOD
CN104159025A (en) * 2014-08-06 2014-11-19 北京智谷睿拓技术服务有限公司 Image capturing controlling method and device, and image acquiring device
CN104159038A (en) * 2014-08-26 2014-11-19 北京智谷技术服务有限公司 Method and device of imaging control of image with shallow depth of field effect as well as imaging equipment

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10356349B2 (en) * 2014-09-09 2019-07-16 Beijing Zhigu Tech Co., Ltd. Light field capture control methods and apparatuses, light field capture devices
US20170264843A1 (en) * 2014-09-09 2017-09-14 Beijing Zhigu Tech Co., Ltd. Light field capture control methods and apparatuses, light field capture devices
US10341594B2 (en) 2014-09-15 2019-07-02 Beijing Zhigu Tech Co., Ltd. Light field capture control methods and apparatuses, light field capture devices
WO2016041432A1 (en) * 2014-09-15 2016-03-24 Beijing Zhigu Tech Co., Ltd. Light field capture control methods and apparatuses, light field capture devices
WO2016169503A1 (en) * 2015-04-22 2016-10-27 Beijing Zhigu Rui Tuo Tech Co., Ltd. Image capture control methods and apparatuses
CN106161920A (en) * 2015-04-22 2016-11-23 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
US10440269B2 (en) 2015-04-22 2019-10-08 Beijing Zhigu Rui Tuo Tech Co., Ltd Image capture control methods and apparatuses
US10582110B2 (en) 2015-04-22 2020-03-03 Beijing Zhigu Rui Tuo Tech Co., Ltd Image incline and capture methods and apparatuses
CN106303209A (en) * 2015-08-31 2017-01-04 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
CN106303210B (en) * 2015-08-31 2019-07-12 北京智谷睿拓技术服务有限公司 Image Acquisition control method and device
CN106303208A (en) * 2015-08-31 2017-01-04 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
CN106303210A (en) * 2015-08-31 2017-01-04 北京智谷睿拓技术服务有限公司 Image acquisition control method and device
CN106303209B (en) * 2015-08-31 2019-06-21 北京智谷睿拓技术服务有限公司 Image Acquisition control method and device
CN106303208B (en) * 2015-08-31 2019-05-21 北京智谷睿拓技术服务有限公司 Image Acquisition control method and device
CN109644264B (en) * 2016-08-25 2022-06-21 脸谱科技有限责任公司 Array detector for depth mapping
CN109644264A (en) * 2016-08-25 2019-04-16 脸谱科技有限责任公司 Array detector for depth map
US11102467B2 (en) 2016-08-25 2021-08-24 Facebook Technologies, Llc Array detector for depth mapping
CN107241612A (en) * 2017-07-06 2017-10-10 北京潘达互娱科技有限公司 Live network broadcast method and device
CN107682597A (en) * 2017-09-01 2018-02-09 北京小米移动软件有限公司 Imaging method, imaging device and electronic equipment
CN107682597B (en) * 2017-09-01 2020-08-07 北京小米移动软件有限公司 Imaging method, imaging device and electronic equipment
CN107707813A (en) * 2017-09-12 2018-02-16 北京小米移动软件有限公司 Super Deep Canvas imaging method, device and electronic equipment
CN107592455B (en) * 2017-09-12 2020-03-17 北京小米移动软件有限公司 Shallow depth of field effect imaging method and device and electronic equipment
CN107707813B (en) * 2017-09-12 2020-03-17 北京小米移动软件有限公司 Super-depth-of-field effect imaging method and device and electronic equipment
CN107592455A (en) * 2017-09-12 2018-01-16 北京小米移动软件有限公司 Shallow Deep Canvas imaging method, device and electronic equipment
CN107483828A (en) * 2017-09-12 2017-12-15 北京小米移动软件有限公司 Zooming method, zoom lens control device and electronic equipment
CN111526273A (en) * 2020-04-29 2020-08-11 维沃移动通信有限公司 Camera module, electronic equipment, shooting control method and shooting control device
CN111526273B (en) * 2020-04-29 2022-06-10 维沃移动通信有限公司 Camera module, electronic equipment, shooting control method and shooting control device
WO2022174409A1 (en) * 2021-02-20 2022-08-25 京东方科技集团股份有限公司 Image acquisition device, image acquisition apparatus, image acquisition method and manufacturing method
CN115226417A (en) * 2021-02-20 2022-10-21 京东方科技集团股份有限公司 Image acquisition device, image acquisition apparatus, image acquisition method, and image production method
GB2618466A (en) * 2021-02-20 2023-11-08 Boe Technology Group Co Ltd Image acquisition device, image acquisition apparatus, image acquisition method and manufacturing method

Also Published As

Publication number Publication date
CN104469147B (en) 2018-09-04

Similar Documents

Publication Publication Date Title
CN104469147A (en) Light field collection control method and device and light field collection equipment
CN104243823A (en) Light field acquisition control method and device and light field acquisition device
CN104320596B (en) The acquisition methods and acquisition device of super-resolution image
CN105472233A (en) Light field acquisition control method and device and light field acquisition equipment
CN104159025A (en) Image capturing controlling method and device, and image acquiring device
CN104159038B (en) The image formation control method and device and imaging device of shallow Deep Canvas image
CN104363380A (en) Image acquisition control method and image acquisition control device
CN104506762A (en) Optical field collecting control method and device and optical field collecting equipment
CN104301605A (en) Imaging control method and device for digital zoom images and imaging equipment
CN105530423A (en) Super-resolution image acquisition method and acquisition device
CN104157660B (en) The adjustable imaging sensor of picture element density and its picture element density method of adjustment
CN104363381B (en) IMAQ control method and device
CN105450924A (en) Super-resolution image obtaining method and device
CN104537975A (en) Display control method and device and display equipment
CN104464620A (en) Image display control method and device and display device
CN105376474B (en) Image collecting device and its Atomatic focusing method
CN104410784A (en) Light field collecting control method and light field collecting control device
CN104486537A (en) Light field acquisition control method and device
CN105578045A (en) Terminal and shooting method of terminal
CN104486555A (en) Image acquisition control method and device
Gnanasambandam et al. Image classification in the dark using quanta image sensors
CN104144295A (en) Imaging control method and device and imaging equipment
US10495843B2 (en) Imaging apparatus with adjustable lens and method for operating the same
CN110166676B (en) Imaging device, imaging control method, electronic device and medium
KR20170024521A (en) Imaging apparatus and method for operating the same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant