CN106713707B - Lens array imaging method and device - Google Patents
Lens array imaging method and device Download PDFInfo
- Publication number
- CN106713707B CN106713707B CN201611035628.0A CN201611035628A CN106713707B CN 106713707 B CN106713707 B CN 106713707B CN 201611035628 A CN201611035628 A CN 201611035628A CN 106713707 B CN106713707 B CN 106713707B
- Authority
- CN
- China
- Prior art keywords
- image
- subgraph
- lens array
- circle
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
Abstract
The present invention discloses a kind of lens array imaging method and device, is related to technical field of image processing.The lens array imaging method specifically includes that S100 shoots the original image that a scene obtains to the lens array and carries out brightness homogenization processing, and the gray level image of the original image is obtained, it include the multiple and one-to-one subgraph of each sub-lens in the gray level image;S200 obtains the location information of each subgraph in the gray level image;Location information of the S300 according to each subgraph obtains the splicing distance values for meeting preset condition between the picture circle of two subgraphs of arbitrary neighborhood;Size of the S400 according to each subgraph extracts the picture circle of each subgraph;S500 splices picture circle and generates scene image according to the splicing distance values.Lens array imaging method and device of the invention is directly handled the true imaging result of lens array, and the scene image of generation improves the image quality of lens array closer to real scene.
Description
Technical field
The present invention relates to technical field of image processing more particularly to a kind of lens array imaging method and lens array at
As device.
Background technique
Lens array is a kind of include multiple sub-lens being arranged in array optical device, be widely used in light
In field camera, compound eye camera and wide-field micro- camera.Its sub-lens is in lens array with orderly, equally spaced side
Shape rectangular array form arrangement.Each sub-lens can be in itself image objects within the vision, each sub-lens
Image is referred to as subgraph.Therefore lens array is obtained in Polaroid as the figure (original being imaged after by lens array
Beginning image) in contain multiple subgraphs, and subgraph is corresponding to sub-lens in lens array as the arrangement form in figure
Arrangement form.The task of lens array imaging is the result of final output to including multiple subgraphs as figure is handled
It is the complete image being spliced to form by subgraph, therefore is properly positioned the key step that subgraph is lens array imaging in as figure
It is one of rapid.
Although by the available position as figure neutron image of optical simulation, due to the optical simulation in ecotopia
The limitation of error and actual processing precision between the true imaging in actual complex environment causes lens array adding
In work, assembling process generate device error, the position for the subgraph that optical simulation obtains often with actual imaging neutron image
There is certain deviation in position.As can be seen from the above description, due to the subgraph as figure when realizing imaging using lens array in the prior art
As position inaccurate has seriously affected image quality.
In addition, documents 1 (CN105704402A) disclose the imaging method and imaging device of a kind of microlens array,
Main technical schemes be using to single light source be imaged generate base map, then under the light conditions to actual scene carry out at
Picture carries out brightness registration by base map and as figure later, it is general to establish background for first pixel as in figure to obtain as figure
Rate model;And the background probability model according to first pixel, it is uniform that brightness is carried out to first pixel as in figure
Change processing.The phenomenon of the Luminance Distribution unevenness of above-mentioned elimination microlens array imaging.
Although however above-mentioned microlens array solves the brightness disproportionation problem of microlens array imaging,
The subgraph for not accounting for taking between each lenticule with microlens array there are certain spacing and each lenticule is deposited
It is overlapping, is causing the image being subsequently generated more fuzzy, picture quality is poor.
Summary of the invention
The present invention provides a kind of lens array imaging method and lens array imaging device, for solving in the prior art not
Consider that image taken by each sub-lens exists overlapping when lens array imaging, leads to the problem that image quality is bad.
The present invention provides a kind of lens array imaging method, and the lens array includes that multiple sons being arranged in array are saturating
Mirror, wherein the lens array imaging method the following steps are included:
S100 shoots the original image that a scene obtains to the lens array and carries out brightness homogenization processing, and obtains institute
The gray level image of original image is stated, includes the multiple and one-to-one subgraph of each sub-lens in the gray level image;
S200 obtains the location information of each subgraph in the gray level image;
Location information of the S300 according to each subgraph obtains and meets default item between the picture circle of two subgraphs of arbitrary neighborhood
The splicing distance values of part;
Size of the S400 according to each subgraph extracts the picture circle of each subgraph;
S500 splices described as circle generates scene image according to the splicing distance values.
Preferably, the step S100 is specifically included:
S110 controls the lens array and light source is imaged, and obtains referring to image;
S120 controls the lens array to the scene imaging, obtains the original image of the scene;
S130, referring to image, carries out brightness homogenization processing to the original image, it is uniform to obtain brightness according to described
Intermediate image;
S140 obtains the gray level image of the intermediate image.
Preferably, the step S200 is specifically included:
S210 obtains described referring to the reference subgraph for corresponding to each sub-lens in image;
S220 obtains the location information of the reference subgraph of corresponding each sub-lens;
Each location information referring to subgraph is converted to the position letter that each subgraph is corresponded in the gray level image by S230
Breath.
Preferably, the step S300 is specifically included:
S310 be arranged the subgraph as circular diameter initial value;
S320 calculates arbitrary neighborhood two as the position spacing between circle center;
S330 calculates arbitrary neighborhood two as the first row picture circle and the second row picture circle in circle row according to the position spacing
Between row splicing distance values and arbitrary neighborhood two splice as the column in circle column between first row picture circle and secondary series picture circle column
Distance values;
S340 splices distance values according to row splicing distance values and the column, obtains the picture of two subgraphs of arbitrary neighborhood
Meet the splicing distance values of preset condition between circle.
Preferably, the step S400 is specifically included:
S410 obtains the diameter of each subgraph;
Diameter of the S420 according to each subgraph extracts the picture circle of each subgraph.
Preferably, the step S500 is specifically included:
S510 judges that the scene is located at the close master of the lens array via formed image after a main lens
Lens side still deviates from the main lens side;
If S520 is located at the close main lens side of the lens array via formed image after the main lens,
Then the picture circle of each subgraph rotates 180 ° around its center;
If S530 via formed image after the main lens be located at the lens array away from the main lens side,
Then the picture circle of each subgraph is without rotation;
S540 obtains the splicing distance values as meeting the preset condition between circle of two subgraphs of arbitrary neighborhood, splicing
It is described to generate scene image as round.
Preferably, the step S220 is specifically included:
S221 establishes the corresponding plane coordinate system referring to image, calculates the reference image in the x-direction and the z-direction
Projection;
S222 primarily determines the X-coordinate value and Y-coordinate value referring to each subgraph central point in image;
S223 accurately calculates the X-coordinate value and Y-coordinate value referring to each subgraph central point in image.
Preferably, the step S330 is specifically included:
S331 calculates the row splicing spacing between the first row picture circle of arbitrary neighborhood and the second row picture circle;
The column that S332 is calculated between the first row picture circle of arbitrary neighborhood and secondary series picture circle splice spacing.
Preferably, the step S300 is between the step S330 and step S340 further include:
S350 is by the row average value of the row splicing distance computation row splicing spacing between acquired each adjacent rows, by institute
The column average value of column splicing distance computation column splicing spacing between each adjacent two column obtained;
Whether within a preset range S360 judges the row average value and the column average value respectively, if in the default model
S340 is then entered step in enclosing, if recalculating the initial diameter of the subgraph not in the preset range, until new
The row average value and column average value of acquisition are in the preset range.
The present invention also provides a kind of lens array imaging device, the lens array imaging device includes: main lens unit
And imaging sensor, the lens array between the main lens unit and described image sensor unit, the lens array
Column include multiple sub-lens being arranged in array, wherein the lens array imaging device further include:
Gray level image obtains module, equal for shooting the original image progress brightness that a scene obtains to the lens array
One change processing, and the gray level image of the original image is obtained, it include multiple a pair of with each sub-lens one in the gray level image
The subgraph answered;
Position information acquisition module, for obtaining the location information of each subgraph in the gray level image;
Splice distance values and obtain module, for the location information according to each subgraph, obtains two subgraphs of arbitrary neighborhood
Picture circle between meet the splicing distance values of preset condition;
As circle extraction module extracts the picture circle of each subgraph for the size according to each subgraph;
Scene image generation module, for splicing described as circle generates scene image according to the splicing distance values.
Preferably, the gray level image acquisition module includes:
It is obtained for light source to be imaged by the lens array referring to image referring to image acquisition unit;
Original image acquiring unit, for, to the scene imaging, obtaining the original of the scene by the lens array
Beginning image;
Brightness uniforms processing unit, for, referring to image, carrying out brightness homogenization to the original image according to described
Processing, obtains the uniform intermediate image of brightness;
Gray level image acquiring unit, for obtaining the gray level image of the intermediate image.
Preferably, the position information acquisition module includes:
It is described referring to the reference subgraph for corresponding to each sub-lens in image for obtaining referring to subgraph acquiring unit;
Location information acquiring unit, the location information of the reference subgraph for obtaining corresponding each sub-lens;
Converting unit corresponds to each subgraph for being converted to each location information referring to subgraph in the gray level image
Location information.
It is specifically included preferably, the splicing distance values obtain module:
Initial setting up unit, for be arranged the subgraph as circular diameter initial value;
Computing unit, for calculating arbitrary neighborhood two as the position spacing between circle center;
Initial splicing distance values acquiring unit, for calculating arbitrary neighborhood two as in circle row according to the position spacing
Row splicing distance values between the first row picture circle and the second row picture circle and arbitrary neighborhood two as in circle column first row picture circle with
Column between secondary series picture circle column splice distance values;
Imaging joint distance values acquiring unit is obtained for splicing distance values according to row splicing distance values and the column
Obtain the splicing distance values for meeting preset condition between the picture circle of two subgraphs of arbitrary neighborhood.
The present invention provides a kind of lens array imaging device again, comprising:
Main lens;
Imaging sensor, for converting optical signals into electric signal;
Lens array is set between the main lens and described image sensor;
Image processor and memory;Wherein,
Described image processor is separately connected described image sensor, the lens array and the memory, calls
The one section of program instruction stored in the memory is to execute lens array imaging method as elucidated before.This lens array
Imaging method at least includes the following steps:
S100 shoots the original image that a scene obtains to the lens array and carries out brightness homogenization processing, and obtains institute
The gray level image of original image is stated, includes the multiple and one-to-one subgraph of each sub-lens in the gray level image;
S200 obtains the location information of each subgraph in the gray level image;
Location information of the S300 according to each subgraph obtains and meets default item between the picture circle of two subgraphs of arbitrary neighborhood
The splicing distance values of part;
Size of the S400 according to each subgraph extracts the picture circle of each subgraph;
S500 splices described as circle generates scene image according to the splicing distance values.
To reach above-mentioned purpose, lens array imaging method proposed by the present invention and lens array imaging device, by right
Lens array is handled at original image, then calculates the splicing spacing between two subgraph picture of arbitrary neighborhood circle, according to
Subgraph size extracts and is spliced as round, scene image generated, due to being the true imaging result directly to lens array
It is handled, not to be influenced by there are the problems such as deviation, device fabrication assembly error between optical simulation and actual imaging, therefore
The scene image of generation improves the image quality of lens array closer to real scene.
Detailed description of the invention
Fig. 1 is the flow diagram of the lens array imaging method of better embodiment of the present invention.
Fig. 2 is the flow diagram of step S100 in Fig. 1.
Fig. 3 is the flow diagram of step S200 in Fig. 1.
Fig. 4 is the flow diagram of step S300 in Fig. 1.
Fig. 5 is the flow diagram of step S400 in Fig. 1.
Fig. 6 is the flow diagram of step S500 in Fig. 1.
Fig. 7 is the structural schematic diagram of the lens array imaging device of a better embodiment of the invention.
Fig. 8 is the structural schematic diagram of the lens array imaging device of another better embodiment of the present invention.
Specific embodiment
The present invention is described in detail with reference to the accompanying drawings and examples.It should be noted that if do not conflicted, this hair
Each feature in bright embodiment and embodiment can be combined with each other, within the scope of the present invention.
Referring to Figure 1, Fig. 1 is the flow diagram of the lens array imaging method of better embodiment of the present invention.Such as Fig. 1
Shown, the present invention provides a kind of lens array imaging method, and the lens array includes multiple sub-lens being arranged in array, this
In the preferred liquid crystal lens array of lens array, each sub-lens in liquid crystal lens array arrange in the way of array, each son
Lens are driven change liquid crystal molecule to be biased to form index distribution by voltage respectively.The lens array imaging method includes following
Step:
S100 shoots the original image that a scene obtains to the lens array and carries out brightness homogenization processing, and obtains institute
The gray level image of original image is stated, includes in the gray level image and the one-to-one subgraph of the sub-lens;Here original
Beginning image (also cry as scheme) be obtained after imaging sensor photoelectric conversion after directly being shot by lens array it is unprocessed
Image.Brightness homogenization processing is carried out to this original image later, eliminates each subgraph brightness disproportionation in original image
Phenomenon obtains the uniform initial scene image of brightness (or being intermediate image).
S200 obtains the location information of each subgraph in the gray level image;
Location information of the S300 according to each subgraph obtains and meets default item between the picture circle of two subgraphs of arbitrary neighborhood
The splicing distance values of part;
Size of the S400 according to each subgraph extracts the picture circle of each subgraph;
S500 splices described as circle generates scene image according to the splicing distance values.
Lens array imaging method proposed by the present invention, by being handled at original image lens array institute, then
The splicing spacing between two subgraph picture of arbitrary neighborhood circle is calculated, according to subgraph size, extracts and is spliced as round, generated
Scene image, due to being directly to handle the true imaging result of lens array, not by optical simulation and actual imaging it
Between the problems such as there are deviations, device fabrication assembly error influence, therefore the scene image generated is improved closer to real scene
The image quality of lens array.
Fig. 2 is referred to, Fig. 2 is the flow diagram of step S100 in Fig. 1.As shown in Fig. 2, in a specific embodiment
In, the step S100 is specifically included:
S110 controls the lens array and light source is imaged, and obtains referring to image (or making illumination model);Above-mentioned reference
When image is for correcting through lens array actual photographed scene image in each subgraph the problem of brightness disproportionation.It is specific at one
In embodiment, the method for obtaining reference image is as follows:
Single uniformly light-emitting light source is imaged in S111 control lens array, and the light image for obtaining an only light source (can
To be uniformly light-emitting plate), it is denoted as I0, light image I0Resolution ratio it is identical as the resolution ratio of lens array, it is assumed that lens array
Resolution ratio is n pixel of lateral a line, and m pixel of a vertical column, i.e. resolution ratio are n*m pixel, then light image I0Point
Resolution is also n*m pixel, be used to calculate the reference picture (or illumination model) of the lens array.Here it is possible in advance
Determine the focusing plane (i.e. in the position, lens array shape library) for obtaining the light image for clearly only having light source, luminescent screen
It is placed in the focusing plane position.
When passing through the lens array imaging, it should be noted and control the time for exposure in suitable range, under-exposed or exposure
Light excessively can all cause the illumination model being calculated to be distorted.
If the light image I got0It is not gray level image (i.e. black white image), for example RGB color image, then needs it
Switch to gray level image.
Light image I0Present in noise subsequent step can be interfered.In order to achieve the purpose that noise reduction, shooting
During light image, can under identical shooting condition (identical light source, identical object distance, identical time for exposure
Deng), same light source is repeated to shoot several images.In general, needs 5 or more quantity, the average values of these images are
For the light image I of a width low noise0, with the light image I of this width low noise0To obtain the illumination model of the lens array (with reference to figure
Picture).
S112 scans light image I0The gray value of interior all pixels finds out light image I0In maximum gradation value, be denoted as
maxGrayscale。
S113 calculates the illumination model Im of the lens array, and illumination model Im is the grayscale image that a maximum gradation value is 1
Picture, resolution ratio is identical as the resolution ratio of lens array, and the grey scale pixel value that the i-th row, jth arrange in illumination model Im is illumination pattern
As I0The grey scale pixel value of middle same position is divided by maximum gradation value maxGrayscale, it may be assumed that
After lens array sizing, illumination model is just fixed, so this step only needs to be formed in lens array
Shi Jinhang is primary, can be imaging device and carries out before factory, is also possible to user and carries out before actual photographed scene, mainly
Purpose is to obtain each sub-lens in lens array and the difference in optical property that aspect shows being imaged to light source.Only have from acquired
After the reference picture (illumination model) for extracting lens array in the image of single uniformly light-emitting light source, by reference picture (illumination
Model) it is stored in the memory of imaging device.In actual photographed scene image, lens array is read directly from memory
The related data of illumination model (reference picture) to carry out image procossing to original image.
Certainly the method for above-mentioned acquisition reference image is one kind of more scene, and those skilled in the art are to obtain brightness
Uniform image can also use other methods, such as with the brightness etc. of each sub-lens of optics sensor measurement, then according to brightness
Value obtains the optical characteristics of each sub-lens by calculating.
S120, to the scene imaging, obtains the original image of the scene by the lens array;Scene it is original
Image namely as figure, be the untreated figure obtained after imaging sensor photoelectric conversion after directly being shot by lens array
Picture.
S130, referring to image, carries out brightness homogenization processing to the original image, it is uniform to obtain brightness according to described
Intermediate image;Specifically by lens array, actual scene is shot, original image I is obtained1, resolution ratio is also
It is identical as the resolution ratio of lens array, original image I1In the phenomenon that there are brightness disproportionations in each subgraph, use lens array
Illumination model (reference picture) Im of column is to original image I1Make the uniform processing of brightness, the brightness disproportionation eliminated in each subgraph is existing
As obtaining the uniform intermediate image Iu of brightness.Wherein, the mode of the uniform processing of brightness is following (according to original image I1Whether be
Gray level image distinguishes):
If 1) original image I1For gray level image: the pixel grey scale of the i-th row, jth column in the uniform intermediate image Iu of brightness
Value is original image I1The grey scale pixel value of middle same position divided by same position in illumination model Im grey scale pixel value, it may be assumed that
It can be obtained the uniform intermediate image Iu of brightness by above formula.
If 2) original image I1For color image, need to carry out the uniform processing of brightness to tri- channels R, G, B respectively:
Take original image I1R component, pressIt calculates, obtains the R component of the uniform intermediate image Iu of brightness
IuR;
Take original image I1G component, pressIt calculates, obtains the G component Iu of the uniform intermediate image Iu of brightnessG;
Take original image I1B component, pressIt calculates, obtains the B component of the uniform intermediate image Iu of brightness
IuB;
Synthesize R component IuR, G component IuG, B component IuB, obtain the uniform intermediate image Iu of brightness.
S140 obtains the gray level image Ig of the intermediate image.According to original image I1It whether is that gray level image carries out area
Point:
If 1) original image I1For gray level image, then intermediate image Iu is also gray level image, Ig=Iu;
If 2) original image I1For colored (R, G, B) image, then intermediate image Iu is also colored (R, G, B) image.It can press
The gray level image Ig of Iu is calculated according to following lower two ways:
Method one, Ig=(IuR+IuG+IuB)/3, i.e., the R component Iu of intermediate image Iu uniform according to brightnessR, B component
IuBAnd G component IuGIt is weighted and averaged and obtains gray level image Ig;
Method two, empirically formula Ig=0.299*IuR+0.587*IuG+0.114*IuBObtain gray level image Ig.
Further, Fig. 3 is referred to, Fig. 3 is the flow diagram of step S200 in Fig. 1.As shown in figure 3, the step
S200 is specifically included:
S210 obtains described referring to the reference subgraph for corresponding to each sub-lens in image;It is each referring to subgraph and each sub saturating
Mirror corresponds.
S220 obtains the location information of the reference subgraph of corresponding each sub-lens;Here, the location information of reference subgraph,
It can be and obtain each center location information referring to subgraph, can also be and obtain each edge position information referring to subgraph.Compared with
Good mode is to obtain each center location information referring to subgraph, and orderly, equally spaced battle array is presented in the center of subgraph
Column arrangement form (be such as square or rectangle).Each center referring to subgraph is positioned, there can be more algorithm to obtain,
For example, by using K-means algorithm (K mean cluster algorithm), Blob parser, the mould of known position information can also be directly used
Plate obtains each center referring to subgraph.The method of locator image center location is detailed in a lens array imaging
Carefully it is described as follows:
S221 calculates above-mentioned reference image (because only including light source, also referred to as blank image) in the direction x (i.e. horizontal direction)
On projection, obtain a projection ordered series of numbers:
Xprof={ x1, x2, x3..., xn}
Its length n is equal to the horizontal width of blank image.
Specifically, to vertical pixel column each in blank image, to the gray scale of each of pixel column pixel
Value makees cumulative summation, value of the summation as respective items in projection ordered series of numbers.For example, calculating first row pixel grey scale in blank image
The summation of value calculates the summation of secondary series grey scale pixel value in blank image, as projection as the value of projection ordered series of numbers first item
The value of ordered series of numbers Section 2, and so on, until all pixel columns of blank image have been calculated.
S222 clusters projection ordered series of numbers Xprof using Kmeans method (i.e. K mean cluster algorithm), sub according to a preliminary estimate
The coordinate value Xappr of the horizontal axis x of image center location.
The class number K of Kmeans clustering be set as blank image neutron image columns c (that is: blank image
The subgraph number that middle a line subgraph is included), the K cluster centre { C clustered1, C2, C3..., CKIt is antithetical phrase
According to a preliminary estimate, the total c of subgraph is arranged the x coordinate value Xappr of image center location, therefore a shared c different x coordinate values, this
Secondary cluster K=c.
The detailed process of Kmeans means clustering algorithm is expressed as follows:
The convergence threshold T and K cluster centre { C of S2221 setting clustering algorithm1, C2, C3..., CKInitial value.If
Set the stop condition of clustering algorithm: maximum number of iterations reaches maxIter times or clustering algorithm has been restrained at threshold value T.
It is 1 that iteration count, which is arranged,.
The initial value of K cluster centre can be any one in example tri- kinds of modes of a, b, c described as follows there are many set-up mode
Kind is all feasible:
A, K mutually different numbers are arbitrarily chosen from 1~n;
B, in view of subgraph is consistent with the arrangement form of corresponding sub-lens, with orderly, at equal intervals in blank image
It is rectangular rectangular array form arrangement, the initial value of K cluster centre can be directly disposed as equally spaced ordered series of numbers:
If C, obtaining the position of subgraph from optical simulation, the x coordinate of these subgraphs can also be set as to K
The initial value of cluster centre.
S2222 is to projection ordered series of numbers Xprof={ x1, x2, x3..., xn, the cluster category label of each single item is calculated, is counted
Arrange the cluster category label sequence X of Xprofidx={ idx1, idx2, idx3..., idxn, it is specific as follows:
For ordered series of numbers Xprof={ x1, x2, x3..., xnIn each single item xi, calculate its subscript i to K cluster centres
Distance, and find out with it apart from that nearest cluster centre, the serial number of the cluster centre is exactly the corresponding cluster classification mark of xi
Number idxi.Such as (| C1- 1 | expression takes absolute value to C1-1).
For x1, the distance of subscript 1 to K cluster centre is successively | C1- 1 |, | C2- 1 |, | C3- 1 | ..., | CK-1
|, it is assumed that it is the smallest in this K distance value to be
Then the corresponding cluster category label idx1 of x1 is a1;
For x2, the distance of subscript 2 to K cluster centre is successively | C1- 2 |, | C2- 2 |, | C3- 2 | ..., | CK-2
|, it is assumed that it is the smallest in this K distance value to beThen the corresponding cluster category label idx2 of x2 is a2;
……
For xn, the distance of subscript n to K cluster centre is successively | C1- n |, | C2- n |, | C3- n | ..., | CK-n
|, it is assumed that it is the smallest in this K distance value to beThen the corresponding cluster category label idxn of xn is an;
S2223 calculates K new cluster centre { C ' one by one1, C '2, C '3..., C 'KValue, calculation is as follows:
It calculates new C ' j: finding out cluster category label sequence Xidx={ idx1, idx2, idx3..., idxnIn all values
For the item (clustering the item that category label is j) of j, these subscript is obtained, these are found in projection ordered series of numbers according to subscript
Middle corresponding Xprof={ x1, x2, x3..., xnItem, C ' j is calculated according to the following equation;
In above formula, idxi=j is indicated in cluster category label sequence Xidx={ idx1, idx2, idx3..., idxnIn institute
Having value is the subscript of the item of j.
Such as: new C ' 1 is calculated, then needs first to find out in cluster category label sequence xidx={ idx1, idx2,
idx3..., idxnIn all values be 1 item (i.e. cluster category label be 1 item), it is assumed that { idx1, idx2, idx3, idx4,
idx5It is the item that Xidx intermediate value is 1, these subscript is { 1,2,3,4,5 }, then in projection ordered series of numbers XprofIn corresponding item just
It is { x1, x2, x3, x4, x5 }, C ' 1 is calculated according to the following equation;
S2224 judges whether clustering algorithm restrains, and method is to compare one by one | C1-C′1|, | C2-C′2|, | C3-C′3| ...,
|CK-C′K| whether be less than convergence threshold T, if it exists some
|Cj-C′j|≥T
, jump to next step S2225;If all | Cj-C′j| be respectively less than T, then clustering algorithm has been restrained, and jumps out cluster
The process of algorithm;
S2225 updates the value of K cluster centre one by one:
{C1, C2, C3..., CK}={ C '1, C '2, C '3..., C 'K};
S2226 judges whether the number of iterations of clustering algorithm has reached maxIter times, if having not yet been reached, by iteration time
Number increases by 1, jumps to S2222;If having reached, the process of clustering algorithm is jumped out;So far, Kmeans clustering algorithm terminates.
The K cluster centre { C that S2227 obtains cluster1, C2, C3..., CKBy sorting from small to large, by the knot of sequence
Fruit is assigned to the x coordinate value Xappr of subgraph center.
C therein is the columns of original image neutron image.
S223 calculates projection of the blank image on the direction y (i.e. vertical direction), obtains a projection ordered series of numbers Yprof={ y1,
y2, y3..., ym, length m is equal to the vertical height of blank image.
Specifically, to the pixel column of each level in blank image, to the gray value of each of row pixel
Make cumulative summation, value of the summation as respective items in projection ordered series of numbers.For example, calculating the first row grey scale pixel value in blank image
Summation, as projection ordered series of numbers first item value, calculate blank image in the second row grey scale pixel value summation, as projection number
The value of column Section 2, and so on, until all pixel columns of blank image have been calculated.
S224 clusters projection ordered series of numbers Yprof using Kmeans method (K mean cluster), according to a preliminary estimate in subgraph
The y-coordinate value Yappr of heart position.
Kmeans cluster class number K be set as blank image neutron image line number r (that is: one in blank image
The subgraph number that column subgraph is included), the K cluster centre { C clustered1, C2, C3..., CKIt is to subgraph
The y-coordinate value Yappr of center according to a preliminary estimate (the total r row of subgraph, therefore a shared r different y-coordinate values, it is this time poly-
Class K=r).The detailed process of clustering algorithm and previously mentioned step use Kmeans method (K mean cluster) to projection ordered series of numbers
Xprof is clustered " it is similar, details are not described herein.
The K cluster centre { C that cluster is obtained1, C2, C3..., CKBy being ranked up from small to large, by the knot of sequence
Fruit is assigned to the y-coordinate value Yappr of subgraph center.
R therein is the line number of subgraph.
It should be noted that, although the class number of cluster is all marked with " K " in front the step of, and in cluster
The heart has been all made of same mark { C1, C2, C3..., CK, but this is a kind of notation sanctified by usage (K of Kmeans i.e. meaning
Taste K classification, mean mean mean value, the C of cluster centre means center (i.e. the initial of Centroid), in fact exists
Cluster class number K in abovementioned steps has different assignment respectively, and (K in step 3 is the column number of subgraph, step 5
In K be subgraph number of lines), { C in step 3) and step 5)1, C2, C3..., CKAlso there is different ordered series of numbers length
And value, respectively represent x coordinate value Xappr, the y-coordinate value Yappr of subgraph center according to a preliminary estimate.
S225 combination Xappr and Yappr, accurate x coordinate value Xaccu, the y-coordinate value for estimating subgraph center
Yaccu.This is because subgraph is consistent with the arrangement form of sub-lens, in blank image with it is orderly, equally spaced it is rectangular
The arrangement of rectangular array form, concrete mode are as follows:
S2251 calculates the Section 2 of Xappr to the average value xmean of item second from the bottom, calculates the Section 2 of Yappr to
The average value ymean of number Section 2, it may be assumed that
Wherein c is the columns of subgraph, and r is the line number of subgraph.
The reason of initial and end two of Xappr and Yappr are removed in calculating is: the first term and tail Xiang Jun of Xappr and Yappr
Represent the center of the outermost subgraph to make a circle of blank image, due to the outermost image of optical imagery often distort compared with
Greatly and outermost image is possible to the factors such as excalation, the outermost subgraph center to make a circle obtained according to a preliminary estimate
Often accuracy is lower, and getting rid of these data can be to avoid in the accurate estimation for introducing error into subgraph center.
For S2252 from the Section 2 of Xappr to item second from the bottom, each single item subtracts average value xmean, obtains a mean value
For 0 new ordered series of numbersIt is each from the Section 2 of Yappr to item second from the bottom
Xiang Jun subtracts average value ymean, obtains the new ordered series of numbers that a mean value is 0
That is:
Wherein the value range of i is { 2,3 ..., c-1 }
Wherein the value range of j is { 2,3 ..., r-1 }
S2253 is by XapprWith YapprMerge, using in Least Square Method following formula p0, p1, two coefficient p1 of coefficient and
P0 is the slope and intercept of a linear equation respectively, and slope therein is exactly two neighboring subgraph central point in lens array
Spacing:
S2254 utilizes p1, p0 and xmean obtained above and ymean, the accurate x coordinate for estimating subgraph center
Value Xaccu, y-coordinate value Yaccu, concrete mode are as follows:
In above-mentioned formula,
Wherein the value range of i is { 1,2,3 ..., c }
Wherein the value range of j is { 1,2,3 ..., r }
Each location information referring to subgraph is converted to the position letter that each subgraph is corresponded in the gray level image by S230
Breath.After getting the location information of each reference subgraph, each subgraph and each reference subgraph are according to one in gray level image Ig
One corresponding relationship can be obtained the location information of each subgraph in gray level image.
Fig. 4 is referred to, Fig. 4 is the flow diagram of step S300 in Fig. 1.As shown in figure 4, in a specific embodiment
In, the step S300 is specifically included:
S310 be arranged the subgraph as circular diameter initial value;
In gray level image Ig, an initial diameter b0, in the present invention, a width gray level image are selected for each subgraph
All subgraphs in Ig use same diameter, extract the picture circle of each subgraph, it may be assumed that
For each subgraph in gray level image Ig, using the center of subgraph as the center of circle, using b0 as diameter (b0≤
E, wherein e indicates the spacing of two neighboring subgraph center), a border circular areas is extracted (below by this circle
Domain is known as circle), this will be used for subsequent adapting to image splicing as circle.
As the initial diameter b0 of circle can be obtained from the result of optical simulation;Alternatively, it is also possible to rule of thumb select just
Beginning diameter b0, in general, 0.45*e≤b0≤0.85*e.
S320 calculates arbitrary neighborhood two as the position spacing between circle center;
It is two neighboring as round center spacing d0, spacing d0 and picture when stitching image according to determining as circular diameter b0
Circular diameter b0 meets lower relation of plane
S330 calculates arbitrary neighborhood two as the first row picture circle and the second row picture circle in circle row according to the position spacing
Between row splicing distance values and arbitrary neighborhood two splice as the column in circle column between first row picture circle and secondary series picture circle column
Distance values;Specifically, for being arranged as every two adjacent picture circle row, the every two adjacent picture circle in figure, according to following
Mode calculates its best splicing spacing, wherein can upset as circle row, as the computation sequence of circle column, but not influence final
As a result: assuming that then above-mentioned row splicing distance values and above-mentioned column splicing distance values press following step as the subgraph in figure has R row, C column
It is rapid to obtain:
S331 is round for the 1st row picture round (every a line picture circle includes C of current row as circle) with the 2nd row picture, according to following
Step calculates its best splicing spacing
(a) when the round upper and lower spacing with the center of the 2nd row picture circle of the 1st row picture is d0, every two phase up and down is calculated
The overlapping region of adjacent picture circle;
(b) it calculates in C all overlapping regions as round and the 2nd row C picture circle of the 1st row, grey scale pixel value
Standard deviation std (d0).This standard deviation std (d0) can be obtained using this following formula:
(c) change the round upper and lower spacing with the 2nd row as circle center position of the 1st row picture according to certain step-length s, for example, s
=1 represents spacing one pixel of change every time.Successively calculate the upper and lower spacing d' when two rows as circle center position:
When d'={ d0-s, d0-2s, d0-3s ..., d0-k*s, d0+2s, d0+s, d0+2s, d0+3s ..., d0+k*s },
In the overlapping region of all upper and lower adjacent picture circles, the standard deviation std (d') of grey scale pixel value, wherein k is integer, and
And make k*s < 0.4d0, generally can choose makes k*s < 0.2d0K value and s value.
(d) compare when the 1st row picture is round and the 2nd row is as the upper and lower spacing of circle center position is { d0, d0-s, d0-2s, d0-
3s ..., d0-k*s, d0+s, d0+2s, d0+3s ..., d0+k*s } when, corresponding all upper and lower adjacent overlapping regions as circle
The standard deviation std of interior grey scale pixel value, finding out makes the smallest distance values of standard deviation std, this is made standard deviation std the smallest
It is denoted as away from value
S332 is round for the 2nd row picture round with the 3rd row picture, calculates its best splicing spacingFor the 3rd row picture circle and the 4th
Row calculates its best splicing spacing as circle……;It is round for R-1 row picture with R row picture circle, calculate between its best splicing
Away from
S333 is for the 1st column as circle and the 2nd are arranged as circle (the R picture circle that each column picture circle includes current row), according to following
Step calculates its best splicing spacing
(A) when the left and right spacing for arranging the center for arranging picture circle with the 2nd as circle when the 1st is d0, every two or so phase is calculated
The overlapping region of adjacent picture circle;
(B) it calculates in round all overlapping regions round with R picture of the 2nd column of R picture that the 1st arranges, the mark of grey scale pixel value
Quasi- difference std (d0).This standard deviation can calculate as follows:
(C) change left and right spacing of the 1st column as circle with the 2nd column as circle center position according to certain step-length s, for example, s
=1 represents spacing one pixel of change every time.Successively calculate the left and right spacing when two column as circle center position:
When d "={ d0-s, d0-2s, d0-3s ..., d0-k*s, d0+2s, d0+s, d0+2s, d0+3s ..., d0+k*s },
In the overlapping region of all left and right adjacent picture circles, the standard deviation std (d ") of grey scale pixel value.Wherein, k is integer, and
And make k*s < 0.4d0, generally can choose makes k*s < 0.2d0K value and s value.
(D) compare when the 1st column are as round and the 2nd column are as the left and right spacing of circle center position is { d0, d0-s, d0-2s, d0-
3s ..., d0-k*s, d0+s, d0+2s, d0+3s ..., d0+k*s } when, corresponding all left and right adjacent overlapping regions as circle
The standard deviation std of interior grey scale pixel value, finding out makes the smallest distance values of standard deviation std, this is made standard deviation std the smallest
It is denoted as away from value
S334 arranges with the 3rd as circle the 2nd column as round, calculates its most preferably splicing spacingFor the 3rd column as circle and the 4th
Column calculate its best splicing spacing as circle……;C-1 is arranged as round with column c picture circle, is calculated between its best splicing
Away from
S350 in the ranks most preferably splices spacing for R-1 obtained in previous step S330(wherein i=1,2,
3 ..., R-1) and C-1 column between most preferably splice spacing(wherein j=1,2,3 ..., C-1) is calculated separately between row splicing
Away from average valueWith the average value of column splicing spacing.
S360 judges the size of above-mentioned average value (average value of average value and column splicing spacing including row splicing spacing)
Whether within a preset range;This preset range is according to actual needs setting.Preferably, preset range here are as follows: each average
Value is less than or equal to d0+ 0.75*k*s and be more than or equal to d0- 0.75*k*s enters step S340.
If average value is greater than d0+ 0.75*k*s is less than d0- 0.75*k*s then recalculates the initial diameter b0 of subgraph
Using the b0 being calculated in above formula as the initial diameter of subgraph, re-execute the steps S310, S320, S330 and
S350 and S360 is until R-1 in the ranks most preferably splice spacingBetween (wherein i=1,2,3 ..., R-1) and C-1 column
Best splicing spacing(wherein j=1,2,3 ..., C-1) respective average value is less than or equal to d0+ 0.75*k*s and
More than or equal to d0Until -0.75*k*s, into next step.
S340 splices distance values according to row splicing distance values and the column, obtains the picture of two subgraphs of arbitrary neighborhood
Meet the splicing distance values of preset condition between circle.Here preset condition according to properties of product by user according to actual needs Lai
Setting.Specifically, in the ranks most preferably splice spacing for R-1(wherein i=1,2,3 ..., R-1) and C-1 column
Between most preferably splice spacing(wherein j=1,2,3 ..., C-1) calculates these and in the ranks, between column most preferably splices spacing and put down
The absolute value of the difference of mean value, if being found out corresponding best there is 0.25*k*s (preset condition) is greater than in these absolute values
Splice spacing, and is modified as average value.
Fig. 5 is referred to, Fig. 5 is the flow diagram of step S400 in Fig. 1.As shown in figure 5, in a specific embodiment
In, the step S400 is specifically included:
S410 obtains the diameter of each subgraph;The diameter b for calculating subgraph uses following formula:
(wherein b rounds up)
In the uniform scene image Iu of brightness, using the center of subgraph as the center of circle, using integer b as diameter.
Diameter of the S420 according to each subgraph extracts the picture circle of each subgraph.
The method of the invention proposes a kind of in microlens array imaging locator image center location, this method only need
A true imaging of microlens array is wanted, it can be from the obtained center as obtaining subgraph in figure, operating method letter
Just, precision is high.And since this method directly analyzes the true imaging result of microlens array, not by optical simulation and reality
The influence for the problems such as there are deviations, device fabrication assembly error between the imaging of border, therefore confidence level is high.
Because each subgraph is just fixed as the center in figure after lens array sizing, institute only needs in this approach
Once-through operation is carried out when lens array is formed, the center of obtained subgraph is stored in memory, in practical bat
The center for reading subgraph when taking the photograph directly from memory carries out subsequent picture mosaic, without carrying out this operation again.
Fig. 6 is referred to, Fig. 6 is the flow diagram of step S500 in Fig. 1.As shown in fig. 6, above-mentioned steps S500 is specifically wrapped
Include following steps:
S510 judges that being located at side of the lens array towards the main lens via image formed by main lens still deviates from
The side of the main lens.
If image formed by S520 main lens is located at the front of lens array, (i.e. image formed by main lens is located at lens array
The side towards main lens is arranged, that is, between main lens and lens array), then the picture circle of each subgraph is needed around its center
180 ° of rotation.It (is real image because of main lens imaging, there are 180 ° that the image spliced, which is rotated 180 ° around its center,
Rotation).Image formed by aforementioned main lens is original image after passing through the lens array.
If image formed by S530 main lens is located at the rear of lens array, (i.e. image formed by main lens is located at lens array
Column deviate from the side of main lens), then the picture circle of each subgraph is without rotation.
S540 obtains the splicing distance values as meeting the preset condition between circle of two subgraphs of arbitrary neighborhood, splicing
It is described to generate scene image as round.
By judging the positional relationship of image and lens array formed by main lens, to guarantee the scene image generated not
It will appear situations such as reverse, further ensure the image quality of scene image.
The present invention also provides a kind of lens array imaging devices based on said lens array image-forming method.Fig. 7 is referred to,
Fig. 7 is the structural schematic diagram of the lens array imaging device of a better embodiment of the invention.As shown in fig. 7, the present invention is preferable
The lens array imaging device of embodiment, the lens array imaging device include: main lens unit and imaging sensor, if
Lens array between the main lens unit and described image sensor unit, the lens array include multiple in array
The sub-lens of arrangement, wherein the lens array imaging device further include:
Gray level image obtains module 100, bright for shooting the original image progress that a scene obtains to the lens array
Homogenization processing is spent, and obtains the gray level image of the original image, includes multiple and each sub-lens one in the gray level image
One corresponding subgraph;
Position information acquisition module 200, for obtaining the location information of each subgraph in the gray level image;
Splice distance values and obtain module 300, for the location information according to each subgraph, obtains two subgraphs of arbitrary neighborhood
Meet the splicing distance values of preset condition between the picture circle of picture;
As circle extraction module 400 extracts the picture circle of each subgraph for the size according to each subgraph;
Scene image generation module 500, for splicing described as circle generates scene image according to the splicing distance values.
Preferably, the gray level image acquisition module 100 includes:
It is obtained for light source to be imaged by the lens array referring to image referring to image acquisition unit;
Original image acquiring unit, for, to the scene imaging, obtaining the original of the scene by the lens array
Beginning image;
Brightness uniforms processing unit, for, referring to image, carrying out brightness homogenization to the original image according to described
Processing, obtains the uniform intermediate image of brightness;
Gray level image acquiring unit, for obtaining the gray level image of the intermediate image.
Preferably, the position information acquisition module 200 includes:
It is described referring to the reference subgraph for corresponding to each sub-lens in image for obtaining referring to subgraph acquiring unit;
Location information acquiring unit, the location information of the reference subgraph for obtaining corresponding each sub-lens;
Converting unit corresponds to each subgraph for being converted to each location information referring to subgraph in the gray level image
Location information.
It is specifically included preferably, the splicing distance values obtain module 300:
Initial setting up unit, for be arranged the subgraph as circular diameter initial value;
Computing unit, for calculating arbitrary neighborhood two as the position spacing between circle center;
Initial splicing distance values acquiring unit, for calculating arbitrary neighborhood two as in circle row according to the position spacing
Row splicing distance values between the first row picture circle and the second row picture circle and arbitrary neighborhood two as in circle column first row picture circle with
Column between secondary series picture circle column splice distance values;
Imaging joint distance values acquiring unit is obtained for splicing distance values according to row splicing distance values and the column
Obtain the splicing distance values for meeting preset condition between the picture circle of two subgraphs of arbitrary neighborhood.
Fig. 8 is referred to, Fig. 8 is the structural schematic diagram of the lens array imaging device of another better embodiment of the present invention.
As shown in figure 8, present invention another kind lens array imaging device, comprising:
Main lens 10 can be including multiple glass lens, be used for photographed scene image;Main lens can also be no zoom
The camera pick-up lens of function.
Imaging sensor 30, for converting optical signals into electric signal, more typically cmos sensor and CCD are sensed
Device;
Lens array 20 is set between the main lens 10 and described image sensor 30;
Image processor 40 and memory 50;Wherein,
Described image processor 40 is separately connected described image sensor 30, the lens array 20 and the memory
50, call the one section of program instruction stored in the memory 50 to execute lens array imaging method below:
S100 shoots the original image that a scene obtains to the lens array and carries out brightness homogenization processing, and obtains institute
The gray level image of original image is stated, includes the multiple and one-to-one subgraph of each sub-lens in the gray level image;
S200 obtains the location information of each subgraph in the gray level image;
Location information of the S300 according to each subgraph obtains and meets default item between the picture circle of two subgraphs of arbitrary neighborhood
The splicing distance values of part;
Size of the S400 according to each subgraph extracts the picture circle of each subgraph;
S500 splices described as circle generates scene image according to the splicing distance values.
In a specific embodiment, the step S100 is specifically included:
S110 controls the lens array and light source is imaged, and obtains referring to image;
S120 controls the lens array to the scene imaging, obtains the original image of the scene;
S130, referring to image, carries out brightness homogenization processing to the original image, it is uniform to obtain brightness according to described
Intermediate image;
S140 obtains the gray level image of the intermediate image.
In a specific embodiment, the step S200 is specifically included:
S210 obtains described referring to the reference subgraph for corresponding to each sub-lens in image;
S220 obtains the location information of the reference subgraph of corresponding each sub-lens;
Each location information referring to subgraph is converted to the position letter that each subgraph is corresponded in the gray level image by S230
Breath.
In a specific embodiment, the step S300 is specifically included:
S310 be arranged the subgraph as circular diameter initial value;
S320 calculates arbitrary neighborhood two as the position spacing between circle center;
S330 calculates arbitrary neighborhood two as the first row picture circle and the second row picture circle in circle row according to the position spacing
Between row splicing distance values and arbitrary neighborhood two splice as the column in circle column between first row picture circle and secondary series picture circle column
Distance values;
S340 splices distance values according to row splicing distance values and the column, obtains the picture of two subgraphs of arbitrary neighborhood
Meet the splicing distance values of preset condition between circle.
In a specific embodiment, the step S400 is specifically included:
S410 obtains the diameter of each subgraph;
Diameter of the S420 according to each subgraph extracts the picture circle of each subgraph.
Preferably, the step S500 is specifically included:
S510 judges that the scene is located at the close master of the lens array via formed image after a main lens
Lens side still deviates from the main lens side;
If S520 is located at the close main lens side of the lens array via formed image after the main lens,
Then the picture circle of each subgraph rotates 180 ° around its center;
If S530 via formed image after the main lens be located at the lens array away from the main lens side,
Then the picture circle of each subgraph is without rotation;
S540 obtains the splicing distance values as meeting the preset condition between circle of two subgraphs of arbitrary neighborhood, splicing
It is described to generate scene image as round.
In a specific embodiment, the step S220 is specifically included:
S221 establishes the corresponding plane coordinate system referring to image, calculates the reference image in the x-direction and the z-direction
Projection;
S222 primarily determines the X-coordinate value and Y-coordinate value referring to each subgraph central point in image;
S223 accurately calculates the X-coordinate value and Y-coordinate value referring to each subgraph central point in image.
In a specific embodiment, the step S330 is specifically included:
S331 calculates the row splicing spacing between the first row picture circle of arbitrary neighborhood and the second row picture circle;
The column that S332 is calculated between the first row picture circle of arbitrary neighborhood and secondary series picture circle splice spacing.
In a specific embodiment, the step S300 is between the step S330 and step S340 further include:
Row splicing spacing weighted calculation row between acquired each adjacent rows is spliced the row average value of spacing by S350,
By the column average value of the column splicing spacing weighted calculation column splicing spacing between acquired each adjacent two column;
Whether within a preset range S360 judges the row average value and the column average value respectively, if in the default model
S340 is then entered step in enclosing, if recalculating the initial diameter of the subgraph not in the preset range, until new
The row average value and column average value of acquisition are in the preset range.
Said lens array image-forming device of the present invention can be applied to capsule medical apparatus, Aerial photography is set
Standby, intelligent automobile, robot, intelligent wearable device, supervision equipment, medical microscope, minimally invasive medical equipment, AR/VR equipment with
And in the electronic equipments such as guided missile with camera.
Mode the above is only the implementation of the present invention is not intended to limit the scope of the invention, all to utilize this
Equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, it is relevant to be applied directly or indirectly in other
Technical field is included within the scope of the present invention.
Claims (11)
1. a kind of lens array imaging method, the lens array includes multiple sub-lens being arranged in array, which is characterized in that
The lens array imaging method the following steps are included:
S100 shoots the original image that a scene obtains to the lens array and carries out brightness homogenization processing, and obtains the original
The gray level image of beginning image includes multiple in the gray level image with the one-to-one subgraph of each sub-lens;
S200 obtains the location information of each subgraph in the gray level image;
Location information of the S300 according to each subgraph, obtain two subgraphs of arbitrary neighborhood picture justify between meet preset condition
Splice distance values;
Size of the S400 according to each subgraph extracts the picture circle of each subgraph;
S500 splices described as circle generates scene image according to the splicing distance values;
The step S300 is specifically included:
S310 be arranged the subgraph as circular diameter initial value;
S320 calculates arbitrary neighborhood two as the position spacing between circle center;
S330 calculates arbitrary neighborhood two as justifying in row between the first row picture circle and the second row picture circle according to the position spacing
Row splicing distance values and arbitrary neighborhood two splice spacing as the column in circle column between first row picture circle and secondary series picture circle column
Value;
S350, will be acquired by the row average value of the row splicing distance computation row splicing spacing between acquired each adjacent rows
It is each it is adjacent two column between column splicing distance computation column splicing spacing column average value;
Whether within a preset range S360 judges the row average value and the column average value respectively, if in the preset range
S340 is then entered step, if recalculating the initial diameter of the subgraph not in the preset range, until new obtain
Row average value and column average value in the preset range;
S340 splices distance values according to row splicing distance values and the column, obtains the picture circle of two subgraphs of arbitrary neighborhood
Between meet the splicing distance values of the preset condition.
2. lens array imaging method as described in claim 1, which is characterized in that the step S100 is specifically included:
S110 controls the lens array and light source is imaged, and obtains referring to image;
S120 controls the lens array to the scene imaging, obtains the original image of the scene;
S130, referring to image, carries out brightness homogenization processing to the original image, obtains the uniform centre of brightness according to described
Image;
S140 obtains the gray level image of the intermediate image.
3. lens array imaging method as claimed in claim 2, which is characterized in that the step S200 is specifically included:
S210 obtains described referring to the reference subgraph for corresponding to each sub-lens in image;
S220 obtains the location information of the reference subgraph of corresponding each sub-lens;
Each location information referring to subgraph is converted to the location information that each subgraph is corresponded in the gray level image by S230.
4. lens array imaging method as described in claim 1, which is characterized in that the step S400 is specifically included:
S410 obtains the diameter of each subgraph;
Diameter of the S420 according to each subgraph extracts the picture circle of each subgraph.
5. lens array imaging method as claimed in claim 4, which is characterized in that the step S500 is specifically included:
S510 judges that the scene is located at the close main lens of the lens array via formed image after a main lens
Side still deviates from the main lens side;
If S520 is located at the close main lens side of the lens array via formed image after the main lens, often
The picture circle of one subgraph rotates 180 ° around its center;
If S530 via formed image after the main lens be located at the lens array away from the main lens side, often
The picture circle of one subgraph is without rotation;
S540, which is obtained, meets the splicing distance values of the preset condition between the picture circle of two subgraphs of arbitrary neighborhood, described in splicing
As circle generates scene image.
6. lens array imaging method as claimed in claim 3, which is characterized in that the step S220 is specifically included:
S221 establishes the corresponding plane coordinate system referring to image, calculates the throwing referring to image in the x-direction and the z-direction
Shadow;
S222 primarily determines the X-coordinate value and Y-coordinate value referring to each subgraph central point in image;
S223 accurately calculates the X-coordinate value and Y-coordinate value referring to each subgraph central point in image.
7. lens array imaging method as described in claim 1, which is characterized in that the step S330 is specifically included:
S331 calculates the row splicing spacing between the first row picture circle of arbitrary neighborhood and the second row picture circle;
The column that S332 is calculated between the first row picture circle of arbitrary neighborhood and secondary series picture circle splice spacing.
8. a kind of lens array imaging device, the lens array imaging device includes: main lens unit and imaging sensor, if
Lens array between the main lens unit and described image sensor unit, the lens array include multiple in array
The sub-lens of arrangement, which is characterized in that the lens array imaging device further include:
Gray level image obtains module, carries out brightness homogenization for shooting the original image that a scene obtains to the lens array
Processing, and the gray level image of the original image is obtained, it include multiple one-to-one with each sub-lens in the gray level image
Subgraph;
Position information acquisition module, for obtaining the location information of each subgraph in the gray level image;
Splice distance values and obtain module, for the location information according to each subgraph, obtains the picture of two subgraphs of arbitrary neighborhood
Meet the splicing distance values of preset condition between circle;
As circle extraction module extracts the picture circle of each subgraph for the size according to each subgraph;
Scene image generation module, for splicing described as circle generates scene image according to the splicing distance values;
The splicing distance values obtain module and specifically include:
Initial setting up unit, for be arranged the subgraph as circular diameter initial value;
Computing unit, for calculating arbitrary neighborhood two as the position spacing between circle center;
Initial splicing distance values acquiring unit, for calculating arbitrary neighborhood two as first in circle row according to the position spacing
First row picture circle and second in two picture circle column of the round row splicing distance values and arbitrary neighborhood between the second row picture circle of row picture
Column splice distance values as the column between circle column;
Imaging joint distance values acquiring unit is appointed for splicing distance values according to row splicing distance values and the column
Anticipate two neighboring subgraph picture circle between meet the splicing distance values of preset condition.
9. lens array imaging device as claimed in claim 8, which is characterized in that the gray level image obtains module and includes:
It is obtained for light source to be imaged by the lens array referring to image referring to image acquisition unit;
Original image acquiring unit, for, to the scene imaging, obtaining the original graph of the scene by the lens array
Picture;
Brightness uniforms processing unit, for, referring to image, carrying out brightness homogenization processing to the original image according to described,
Obtain the uniform intermediate image of brightness;
Gray level image acquiring unit, for obtaining the gray level image of the intermediate image.
10. lens array imaging device as claimed in claim 9, which is characterized in that the position information acquisition module includes:
It is described referring to the reference subgraph for corresponding to each sub-lens in image for obtaining referring to subgraph acquiring unit;
Location information acquiring unit, the location information of the reference subgraph for obtaining corresponding each sub-lens;
Converting unit, for each location information referring to subgraph to be converted to the position for corresponding to each subgraph in the gray level image
Confidence breath.
11. a kind of lens array imaging device, which is characterized in that the lens array imaging device includes:
Main lens;
Imaging sensor, for converting optical signals into electric signal;
Lens array is set between the main lens and described image sensor;
Image processor and memory;Wherein,
Described image processor is separately connected described image sensor, the lens array and the memory, described in calling
The one section of program instruction stored in memory is to execute lens array imaging method as described in any one of claim 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611035628.0A CN106713707B (en) | 2016-11-18 | 2016-11-18 | Lens array imaging method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611035628.0A CN106713707B (en) | 2016-11-18 | 2016-11-18 | Lens array imaging method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106713707A CN106713707A (en) | 2017-05-24 |
CN106713707B true CN106713707B (en) | 2019-08-09 |
Family
ID=58941259
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201611035628.0A Active CN106713707B (en) | 2016-11-18 | 2016-11-18 | Lens array imaging method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106713707B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106791498B (en) * | 2016-11-18 | 2019-11-19 | 成都微晶景泰科技有限公司 | Image position method, lens array imaging method and device |
CN110119263B (en) * | 2019-05-09 | 2022-07-19 | 豪威触控与显示科技(深圳)有限公司 | Method and device for displaying image in display array |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102439979A (en) * | 2009-04-22 | 2012-05-02 | 雷特利克斯股份有限公司 | Digital imaging system, plenoptic optical device and image data processing method |
CN103021014A (en) * | 2012-11-29 | 2013-04-03 | 长春理工大学 | Method for increasing reconstruction resolution ratio of computer integrated image |
CN103327223A (en) * | 2012-03-21 | 2013-09-25 | 卡西欧计算机株式会社 | Image capturing apparatus |
US8654223B2 (en) * | 2010-06-15 | 2014-02-18 | Canon Kabushiki Kaisha | Image pickup apparatus |
CN104041006A (en) * | 2012-01-13 | 2014-09-10 | 佳能株式会社 | Image generation method, image generation apparatus, program, and storage medium |
JP2016004152A (en) * | 2014-06-17 | 2016-01-12 | コニカミノルタ株式会社 | Imaging device and imaging method |
CN105704402A (en) * | 2014-11-28 | 2016-06-22 | 深圳超多维光电子有限公司 | Imaging method and imaging device of microlens array |
CN105812625A (en) * | 2014-12-30 | 2016-07-27 | 深圳超多维光电子有限公司 | Micro lens array imaging device and imaging method |
CN106791498A (en) * | 2016-11-18 | 2017-05-31 | 成都微晶景泰科技有限公司 | Image position method, lens array imaging method and device |
-
2016
- 2016-11-18 CN CN201611035628.0A patent/CN106713707B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102439979A (en) * | 2009-04-22 | 2012-05-02 | 雷特利克斯股份有限公司 | Digital imaging system, plenoptic optical device and image data processing method |
US8654223B2 (en) * | 2010-06-15 | 2014-02-18 | Canon Kabushiki Kaisha | Image pickup apparatus |
CN104041006A (en) * | 2012-01-13 | 2014-09-10 | 佳能株式会社 | Image generation method, image generation apparatus, program, and storage medium |
CN103327223A (en) * | 2012-03-21 | 2013-09-25 | 卡西欧计算机株式会社 | Image capturing apparatus |
CN103021014A (en) * | 2012-11-29 | 2013-04-03 | 长春理工大学 | Method for increasing reconstruction resolution ratio of computer integrated image |
JP2016004152A (en) * | 2014-06-17 | 2016-01-12 | コニカミノルタ株式会社 | Imaging device and imaging method |
CN105704402A (en) * | 2014-11-28 | 2016-06-22 | 深圳超多维光电子有限公司 | Imaging method and imaging device of microlens array |
CN105812625A (en) * | 2014-12-30 | 2016-07-27 | 深圳超多维光电子有限公司 | Micro lens array imaging device and imaging method |
CN106791498A (en) * | 2016-11-18 | 2017-05-31 | 成都微晶景泰科技有限公司 | Image position method, lens array imaging method and device |
Also Published As
Publication number | Publication date |
---|---|
CN106713707A (en) | 2017-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11503275B2 (en) | Camera calibration system, target, and process | |
EP3516625B1 (en) | A device and method for obtaining distance information from views | |
CN105453546B (en) | Image processing apparatus, image processing system and image processing method | |
CN110619662B (en) | Monocular vision-based multi-pedestrian target space continuous positioning method and system | |
CN106600648A (en) | Stereo coding target for calibrating internal parameter and distortion coefficient of camera and calibration method thereof | |
CN106485757A (en) | A kind of Camera Calibration of Stereo Vision System platform based on filled circles scaling board and scaling method | |
US20070031063A1 (en) | Method and apparatus for generating a composite image from a set of images | |
CN106454116B (en) | Automatic full focusing imaging method and device | |
CN106791498B (en) | Image position method, lens array imaging method and device | |
JP7378219B2 (en) | Imaging device, image processing device, control method, and program | |
CN114636385B (en) | Three-dimensional imaging method and system based on light field camera and three-dimensional imaging measurement production line | |
CN110519585A (en) | A kind of imaging calibration method and device applied to image capture device | |
CN106713707B (en) | Lens array imaging method and device | |
CN108305233A (en) | A kind of light field image bearing calibration for microlens array error | |
CN105513074B (en) | A kind of scaling method of shuttlecock robot camera and vehicle body to world coordinate system | |
CN106791331B (en) | Image processing method, device and imaging system based on lens array imaging | |
CN110248095B (en) | Focusing device, focusing method and storage medium | |
US11659157B2 (en) | Systems for measuring naked-eye stereoscopic image, methods and apparatuses for processing image and display devices | |
US20140184861A1 (en) | Accurate plenoptic rendering with defocus blur | |
CN112184793A (en) | Depth data processing method and device and readable storage medium | |
US10783646B2 (en) | Method for detecting motion in a video sequence | |
CN108873302B (en) | Automatic correction and refocusing method of light field microscopic image | |
CN112866546B (en) | Focusing method and device, electronic equipment and computer readable storage medium | |
KR102295987B1 (en) | Calibration method and apparatus of stereo camera module, computer readable storage medium | |
TWI807935B (en) | Method for training depth identification model, method for identifying depth of images and related devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |