CN105450931A - Imaging method and device based on array cameras, and electronic equipment - Google Patents
Imaging method and device based on array cameras, and electronic equipment Download PDFInfo
- Publication number
- CN105450931A CN105450931A CN201511025250.1A CN201511025250A CN105450931A CN 105450931 A CN105450931 A CN 105450931A CN 201511025250 A CN201511025250 A CN 201511025250A CN 105450931 A CN105450931 A CN 105450931A
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- target
- phase machine
- gray
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Abstract
The invention discloses an imaging method and device based on array cameras, and electronic equipment. The method proposes the array cameras in a main-slave design mode, and the array cameras comprises one main camera and a plurality of slave cameras, wherein all slave cameras are designed to be large in aperture and overlapping field depth. In an imaging process, a slave image with the best imaging quality is selected from all salve camera images, and is fused with a main camera image, thereby obtaining a final image. Therefore, the method guarantees the incoming light amount from the slave cameras through the large-aperture design, solves a problem of imaging fuzziness caused by the small field depth of the large aperture through the overlapping field depth design of the slave cameras, can guarantee that at least one camera can achieve clear imaging, finally can obtain the slave image with high dark imaging quality and a clear main body, carries out the fusion of the main camera image, can effectively solve a problem that the dark imaging quality is poor, and further improves the imaging quality of the cameras.
Description
Technical field
The invention belongs to array camera technical field of imaging, particularly relate to a kind of formation method based on array camera, device and electronic equipment.
Background technology
Array camera refers to the camera combined according to setting means by multiple tiny lens/little camera, and it adopts multiple tiny lens to replace the shooting effect of a macro lens, and the compound eye of principle and array astronomical telescope and insect is similar.Owing to having, volume is little, the advantage such as afford a wide field of vision, and array camera has become the camera trend of the portable sets such as smart mobile phone.
At present, a kind of efficient implementation that array camera adopts is: each little camera adopts the design of little aperture, depth of field isomorphism, when taking, is embodied as picture by the image merging two or more little camera.This mode is owing to adopting little aperture, and the light-inletting quantity of each little camera is limited, thus half-light image quality can be caused poor.
Summary of the invention
In view of this, the object of the present invention is to provide a kind of formation method based on array camera, device and electronic equipment, be intended to this problem of half-light image quality difference that the existing formation method based on array camera of solution exists.
For this reason, the present invention's openly following technical scheme:
Based on a formation method for array camera, described array camera comprise principal phase machine and predetermined number from camera, adopt large aperture from camera described in each, and overlapping successively from the depth of field of camera described in each, described method comprises:
Obtain the master image of described principal phase machine shooting;
Obtain target from image; Described target from image for: described in each from camera shooting multiple images that picture quality is the highest from image;
To the image co-registration process that described master image and described target are preset from image, obtain target image.
Said method, preferably, described picture quality is weighed based on the ambiguity of image subject, then described acquisition target comprises from image:
Obtain image subject;
Calculate described image subject described in each from the ambiguity image;
From described each select from image image subject ambiguity minimum from image, obtain target from image.
Said method, preferably, the described image co-registration process preset from image described master image and described target, obtains target image, comprising:
Obtain described master image and described target respectively from gray level image corresponding to image, obtain principal phase machine gray-scale image and from phase machine gray-scale image;
Obtain the color information of described master image;
Merge described principal phase machine gray-scale image and described from phase machine gray-scale image, obtain target gray image;
Merge described target gray image and described color information, obtain target image.
Said method, preferably, described fusion described principal phase machine gray-scale image and described from phase machine gray-scale image, obtains target gray image, comprising:
Decompose described principal phase machine gray-scale image, obtain main Primary layer and main levels of detail;
Decompose described from phase machine gray-scale image, obtain from Primary layer with from levels of detail;
Merge described main Primary layer and from Primary layer, obtain merging Primary layer; Merge described main levels of detail and from levels of detail, obtain merging levels of detail;
Merge described fusion Primary layer and merge levels of detail, obtaining described target gray image.
Said method, preferably, also comprises following preprocessing process:
Obtain first with reference to from image and second with reference to from image; Described first with reference to from image, described second with reference to from image for: from multiple two width images that picture quality is the highest from image of camera shooting described in each;
Based on principle of stereoscopic vision, utilize described first with reference to from image and described second with reference to from image, computing reference focusing from;
By described with reference to focusing from centered by preset search territory in search for, obtain target focusing from; Described target focusing is from being focusing distance values that principal phase machine picture quality corresponding in described preset search territory is the highest;
Based on described target focusing from, to described principal phase machine carry out focusing control.
Based on an imaging device for array camera, described array camera comprise principal phase machine and predetermined number from camera, adopt large aperture from camera described in each, and overlapping successively from the depth of field of camera described in each, described device comprises:
First acquisition module, for obtaining the master image of described principal phase machine shooting;
Second acquisition module, for obtaining target from image; Described target from image for: described in each from camera shooting multiple images that picture quality is the highest from image;
Image co-registration module, for the image co-registration process preset from image described master image and described target, obtains target image.
Said apparatus, preferably, described picture quality is weighed based on the ambiguity of image subject, then described second acquisition module comprises:
First acquiring unit, for obtaining image subject;
First computing unit, for calculating described image subject described in each from the ambiguity image;
Choose unit, for from described each select from image image subject ambiguity minimum from image, obtain target from image.
Said apparatus, preferably, described image co-registration module comprises:
Second acquisition unit, for obtaining described master image and described target respectively from gray level image corresponding to image, obtains principal phase machine gray-scale image and from phase machine gray-scale image;
3rd acquiring unit, for obtaining the color information of described master image;
First integrated unit, for merging described principal phase machine gray-scale image and described from phase machine gray-scale image, obtains target gray image;
Second integrated unit, for merging described target gray image and described color information, obtains target image.
Said apparatus, preferably, described first integrated unit comprises:
First decomposes subelement, for decomposing described principal phase machine gray-scale image, obtains main Primary layer and main levels of detail;
Second decomposes subelement, described from phase machine gray-scale image for decomposing, and obtains from Primary layer with from levels of detail;
First fusant unit, for merging described main Primary layer and from Primary layer, obtaining merging Primary layer; Merge described main levels of detail and from levels of detail, obtain merging levels of detail;
Second fusant unit, for merging described fusion Primary layer and merging levels of detail, obtains described target gray image.
Said apparatus, preferably, also comprises focusing control module, and described focusing control module comprises:
4th acquiring unit, for obtain first with reference to from image and second with reference to from image; Described first with reference to from image, described second with reference to from image for: from multiple two width images that picture quality is the highest from image of camera shooting described in each;
Second computing unit, for based on principle of stereoscopic vision, utilize described first with reference to from image and described second with reference to from image, computing reference focusing from;
Search unit, for by described with reference to focusing from centered by preset search territory in search for, obtain target focusing from; Described target focusing is from being focusing distance values that principal phase machine picture quality corresponding in described preset search territory is the highest;
Focusing control unit, for based on described target focusing from, to described principal phase machine carry out focusing control.
A kind of electronic equipment, comprises as above based on the imaging device of array camera.
From above scheme, formation method based on array camera disclosed in the present application, propose a kind of array camera of MS master-slave design form, described MS master-slave array camera comprises a principal phase machine and multiple from camera, respectively adopts large aperture and the design of the overlapping depth of field from camera.In imaging process, from each pick out from camera image an image quality the highest from image, merge with main camera image, obtain final image.Visible, the application is by ensure that light-inletting quantity from camera to carrying out large aperture design from camera, by carrying out the overlapping design of the depth of field to from camera, solve the image blur problem easily caused because of the shallow depth of field feature of large aperture in the design of depth of field isomorphism, can guarantee that at least one can carry out blur-free imaging to imaged body from camera, finally can obtain a half-light image quality high, main body is clearly from image, main camera image is merged, thus, application the application effectively can solve this problem of half-light image quality difference, improve the image quality of camera further.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments of the invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the accompanying drawing provided.
The flow chart of a kind of formation method embodiment one based on array camera that Fig. 1 provides for the application;
The exemplary plot of the MS master-slave array camera embodiment one that Fig. 2 provides for the application;
The flow chart of a kind of formation method embodiment two based on array camera that Fig. 3 provides for the application;
The flow chart of a kind of formation method embodiment three based on array camera that Fig. 4 provides for the application;
The structural representation of a kind of imaging device embodiment four based on array camera that Fig. 5 provides for the application;
The structural representation of a kind of imaging device embodiment five based on array camera that Fig. 6 provides for the application;
The structural representation of a kind of imaging device embodiment six based on array camera that Fig. 7 provides for the application.
Embodiment
For the purpose of quoting and know, the technical term hereinafter used, to write a Chinese character in simplified form or summary of abridging is explained as follows:
The depth of field: DepthofField, can the object distance range of blur-free imaging, is jointly determined by the focal length of camera lens and aperture.
Depth of field isomorphism: in array camera, the depth of field of each camera is identical.
Primary layer: be that result after the edge-reservefiltering filtering of edge (keep) is done to original image, the information of the large scale result of reflection image, edge and local luminance.
Levels of detail: the small scale texture information being the result after former figure deducts Primary layer, response diagram picture, the brightness of local is 0.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Embodiment one
With reference to figure 1, the flow chart of a kind of formation method embodiment one based on array camera that Fig. 1 provides for the application, described array camera comprise principal phase machine and predetermined number from camera, large aperture is adopted from camera described in each, and it is overlapping successively from the depth of field of camera described in each, described method can be applicable in the electronic equipments such as smart mobile phone, panel computer, general camera, and as shown in Figure 1, described method can comprise the following steps:
S101: the master image obtaining the shooting of described principal phase machine.
S102: obtain target from image; Described target from image for: described in each from camera shooting multiple images that picture quality is the highest from image.
S103: the image co-registration process preset from image described master image and described target, obtains target image.
For solving the little aperture of prior art, this problem of half-light image quality difference that depth of field homogeneous arrays camera exists, the application proposes a kind of array camera of MS master-slave design form, and described MS master-slave array camera comprises a principal phase machine and multiple from camera.Wherein, adopt large aperture from camera described in each, promote the light-inletting quantity of array camera with this, and then improve the half-light image quality of array camera.
But, because large aperture exists shallow depth of field feature, camera imaging can be caused to present the shallow depth of field, can the object distance range of blur-free imaging narrower, very easily there is the problem that image objects is fuzzy, based on this, be different from the depth of field isomorphism design of prior art array camera, magazine each of the application's pair array carries out overlapping depth of field design from camera, and namely each has field depth overlapping successively from camera.
Such as, with reference to the MS master-slave array camera exemplary plot shown in figure 2, wherein, camera placed in the middle is principal phase machine, all the other cameras are from camera, in a clockwise direction, first is 10 ~ 30cm from the field depth of camera, second is 20 ~ 60cm from the field depth of camera, 3rd is 40cm ~ 120cm from the field depth of camera, 4th is beyond 80cm from the field depth of camera, thus, by depth of field value overlapping successively, each can maintain a wider total field depth from camera, and then can guarantee that at least one can carry out blur-free imaging to imaged body from camera, namely the object distance of captured object can drop at least one from the field depth of camera.
The depth of field and the aperture of described principal phase machine are not limit, and specifically can be determined according to the actual design demand of array camera by technical staff.
Carrying out utilizing described MS master-slave array camera taking in the process of imaging, adopting image that described principal phase machine take as master image, each multiple images from camera shooting then conduct from image for described master image provides reference role.
Because each adopts the overlapping depth of field to design from camera, therefore, when carrying out imaging to object, respectively from phase chance based on the different relations between its field depth from actual object distance, present the imaging features of different definition, and can ensure that at least one has the image of high definition from camera.Such as, suppose that the object distance of captured object is 50cm, then for the array camera of Fig. 2, this object distance drops on second and then says from camera compared to other from the field depth 20 ~ 60cm of camera, and second the highest from the imaging definition of camera.
Based on this, the application is according to the ambiguity of image subject, from each from camera, shooting is multiple from image, pick out the highest i.e. image subject ambiguity of an image quality minimum from image, merge described master image from image as described target, to realize highlighting main camera imaging, details strengthens and merges noise reduction etc., thus, the exportable half-light image quality of final described array camera is higher, and image subject is image comparatively clearly.
Wherein, image subject refers to the main manifestations of image or mainly gives prominence to object, be scenery the most concerned in image, be often referred to prospect comparatively placed in the middle on image frame, generally by the light of analysis image, color, motion, angle, scape not etc. information draw.
From above scheme, formation method based on array camera disclosed in the present application, propose a kind of array camera of MS master-slave design form, described MS master-slave array camera comprises a principal phase machine and multiple from camera, respectively adopts large aperture and the design of the overlapping depth of field from camera.In imaging process, from each pick out from camera image an image quality the highest from image, merge with main camera image, obtain final image.Visible, the application is by ensure that light-inletting quantity from camera to carrying out large aperture design from camera, by carrying out the overlapping design of the depth of field to from camera, solve the image blur problem easily caused because of the shallow depth of field feature of large aperture in the design of depth of field isomorphism, can guarantee that at least one can carry out blur-free imaging to imaged body from camera, finally can obtain a half-light image quality high, main body is clearly from image, main camera image is merged, thus, application the application effectively can solve this problem of half-light image quality difference, improve the image quality of camera further.
Embodiment two
With reference to the flow chart of a kind of formation method embodiment two based on array camera that figure 3, Fig. 3 provides for the application, in the present embodiment, described step S103 specifically can be realized by following steps:
S301: obtain described master image and described target respectively from gray level image corresponding to image, obtains principal phase machine gray-scale image and from phase machine gray-scale image;
S302: the color information obtaining described master image;
S303: merge described principal phase machine gray-scale image and described from phase machine gray-scale image, obtain target gray image;
S304: merge described target gray image and described color information, obtain target image.
The present embodiment is specifically set forth from the image co-registration process of image master image, target.
First the color information of described master image is extracted, and respectively from image, gray processing process is carried out to described master image and described target, obtain the principal phase machine gray-scale image that can reflect master image monochrome information, and can reflect target from image luminance information from phase machine gray-scale image.
Afterwards, utilize filtering (edgereservingfilter) method keeping edge, such as specifically use bilateral filtering (bilateralfilter) etc., by described principal phase machine gray-scale image, resolve into corresponding basic one-tenth and levels of detail respectively from phase machine gray-scale image, particularly, main Primary layer and main levels of detail can be obtained after decomposing described principal phase machine gray-scale image, can obtain from Primary layer with from levels of detail after phase machine gray-scale image described in decomposing.
Next, can based on corresponding weight allocation strategy, to described main Primary layer be weighted fusion from Primary layer, obtain merging Primary layer; To described main levels of detail be weighted fusion from levels of detail, obtain merging levels of detail.Particularly, such as, with texture-rich degree for foundation carries out weight allocation to main levels of detail with from levels of detail, and then main levels of detail and the Weighted Fusion from levels of detail can be realized, wherein, texture-rich degree can be weighed with the Gaussian Energy of local or Laplce's energy.
On this basis, merging described fusion Primary layer and merge levels of detail, described target gray image can be obtained, and continuing described target gray image and the master image color information extracted before to merge, the final array camera imaging for exporting can being obtained.
Embodiment three
With reference to the flow chart of a kind of formation method embodiment three based on array camera that figure 4, Fig. 4 provides for the application, in the present embodiment, described method also comprises following preprocessing process:
S401: obtain first with reference to from image and second with reference to from image; Described first with reference to from image, described second with reference to from image for: from multiple two width images that picture quality is the highest from image of camera shooting described in each;
S402: based on principle of stereoscopic vision, utilize described first with reference to from image and described second with reference to from image, computing reference focusing from;
S403: by described with reference to focusing from centered by preset search territory in search for, obtain target focusing from; Described target focusing is from being focusing distance values that principal phase machine picture quality corresponding in described preset search territory is the highest;
S404: based on described target focusing from, to described principal phase machine carry out focusing control.
The present embodiment specifically provides a kind of auto-focusing scheme of principal phase machine.
First, can according to the ambiguity of image subject, from each from camera shooting multiple from image, extract image quality the highest, namely the two width images that image subject ambiguity is minimum, afterwards based on principle of stereoscopic vision, utilize the two width images extracted, the object distance of computed image main body, on this basis, further according to imaging formula 1/f=1/u+1/v, calculate a pair defocus distance (apart) numerical value, wherein, f represents focal length, say for from camera, f is known, and u represents object distance, v represent focusing from.
Afterwards, using the described focusing distance values that calculates as with reference to focusing from, and by described with reference to focusing from centered by preset search territory in adopt preset step-length search for, finally obtain the focusing distance values that in described preset search territory, principal phase machine image quality is the highest, and using search for the focusing distance values that obtains as target focusing from, focusing control is carried out to described principal phase machine.
Wherein, the value of described preset search territory and described default step-length, can determine based on the focusing accuracy and runtime demand of reality.
Prior art utilizes principle of stereoscopic vision, by selecting two width images from each little aperture camera imaging of depth of field isomorphism, realize auto-focusing to control, compared to prior art, because the application carries out the two width images (large aperture, the depth of field overlapping from camera imaging) that adopt when auto-focusing controls, obviously there is the advantages such as half-light image quality is high, image subject definition is high, thus the auto-focusing control accuracy of the application is higher, improve the focusing performance of array camera further.
Embodiment four
With reference to figure 5, the structural representation of a kind of imaging device embodiment four based on array camera that Fig. 5 provides for the application, described array camera comprise principal phase machine and predetermined number from camera, large aperture is adopted from camera described in each, and it is overlapping successively from the depth of field of camera described in each, described device can be applicable in the electronic equipments such as smart mobile phone, panel computer, general camera, as shown in Figure 5, described device can comprise the first acquisition module 100, second acquisition module 200 and image co-registration module 300.
First acquisition module 100, for obtaining the master image of described principal phase machine shooting.
Second acquisition module 200, for obtaining target from image; Described target from image for: described in each from camera shooting multiple images that picture quality is the highest from image.
Wherein, described second acquisition module 200 comprises the first acquiring unit, the first computing unit and chooses unit.
First acquiring unit, for obtaining image subject;
First computing unit, for calculating described image subject described in each from the ambiguity image;
Choose unit, for from described each select from image image subject ambiguity minimum from image, obtain target from image.
Image co-registration module 300, for the image co-registration process preset from image described master image and described target, obtains target image.
For solving the little aperture of prior art, this problem of half-light image quality difference that depth of field homogeneous arrays camera exists, the application proposes a kind of array camera of MS master-slave design form, and described MS master-slave array camera comprises a principal phase machine and multiple from camera.Adopt large aperture from camera described in each, promote the light-inletting quantity of camera with this, and then improve the half-light image quality of camera.
But, because large aperture exists shallow depth of field feature, camera imaging can be caused to present the shallow depth of field, can the object distance range of blur-free imaging narrower, very easily there is the problem that image objects is fuzzy, based on this, be different from the depth of field isomorphism design of prior art array camera, magazine each of the application's pair array carries out overlapping depth of field design from camera, and namely each has field depth overlapping successively from camera.
Such as, with reference to the MS master-slave array camera exemplary plot shown in figure 2, wherein, camera placed in the middle is principal phase machine, all the other cameras are from camera, in a clockwise direction, first is 10 ~ 30cm from the field depth of camera, second is 20 ~ 60cm from the field depth of camera, 3rd is 40cm ~ 120cm from the field depth of camera, 4th is beyond 80cm from the field depth of camera, thus, by depth of field value overlapping successively, each can maintain a wider total field depth from camera, and then can guarantee that at least one can carry out blur-free imaging to imaged body from camera, namely the object distance of captured object can drop at least one from the field depth of camera.
The depth of field and the aperture of described principal phase machine are not limit, and specifically can be determined according to the actual design demand of array camera by technical staff.
Carrying out utilizing described MS master-slave array camera taking in the process of imaging, adopting image that described principal phase machine take as master image, each multiple images from camera shooting then conduct from image for described master image provides reference role.
Because each adopts the overlapping depth of field to design from camera, therefore, when carrying out imaging to object, respectively from phase chance based on the different relations between its field depth from actual object distance, present the imaging features of different definition, and can ensure that at least one has the image of high definition from camera.Such as, suppose that the object distance of captured object is 50cm, then for the array camera of Fig. 2, this object distance drops on second and then says from camera compared to other from the field depth 20 ~ 60cm of camera, and second the highest from the imaging definition of camera.
Based on this, the application is according to the ambiguity of image subject, from each from camera, shooting is multiple from image, pick out the highest i.e. image subject ambiguity of an image quality minimum from image, merge described master image from image as described target, to realize highlighting main camera imaging, details strengthens and merges noise reduction etc., thus, the exportable half-light image quality of final described array camera is higher, and image subject is image comparatively clearly.
Wherein, image subject refers to the main manifestations of image or mainly gives prominence to object, be scenery the most concerned in image, be often referred to prospect comparatively placed in the middle on image frame, generally by the light of analysis image, color, motion, angle, scape not etc. information draw.
From above scheme, imaging device based on array camera disclosed in the present application, propose a kind of array camera of MS master-slave design form, described MS master-slave array camera comprises a principal phase machine and multiple from camera, respectively adopts large aperture and the design of the overlapping depth of field from camera.In imaging process, from each pick out from camera image an image quality the highest from image, merge with main camera image, obtain final image.Visible, the application is by ensure that light-inletting quantity from camera to carrying out large aperture design from camera, by carrying out the overlapping design of the depth of field to from camera, solve the image blur problem easily caused because of the shallow depth of field feature of large aperture in the design of depth of field isomorphism, can guarantee that at least one can carry out blur-free imaging to imaged body from camera, finally can obtain a half-light image quality high, main body is clearly from image, main camera image is merged, thus, application the application effectively can solve this problem of half-light image quality difference, improve the image quality of camera further.
Embodiment five
With reference to the structural representation of a kind of imaging device embodiment five based on array camera that figure 6, Fig. 6 provides for the application, in the present embodiment, described image co-registration module 300 specifically can comprise:
Second acquisition unit 301, for obtaining described master image and described target respectively from gray level image corresponding to image, obtains principal phase machine gray-scale image and from phase machine gray-scale image;
3rd acquiring unit 302, for obtaining the color information of described master image;
First integrated unit 303, for merging described principal phase machine gray-scale image and described from phase machine gray-scale image, obtains target gray image;
Second integrated unit 304, for merging described target gray image and described color information, obtains target image.
Wherein, described first integrated unit 303 comprises the first decomposition subelement, second and decomposes subelement, the first fusant unit and the second fusant unit.
First decomposes subelement, for decomposing described principal phase machine gray-scale image, obtains main Primary layer and main levels of detail;
Second decomposes subelement, described from phase machine gray-scale image for decomposing, and obtains from Primary layer with from levels of detail;
First fusant unit, for merging described main Primary layer and from Primary layer, obtaining merging Primary layer; Merge described main levels of detail and from levels of detail, obtain merging levels of detail;
Second fusant unit, for merging described fusion Primary layer and merging levels of detail, obtains described target gray image.
The present embodiment is specifically set forth from the image co-registration process of image master image, target.
First the color information of described master image is extracted, and respectively from image, gray processing process is carried out to described master image and described target, obtain the principal phase machine gray-scale image that can reflect master image monochrome information, and can reflect target from image luminance information from phase machine gray-scale image.
Afterwards, utilize filtering (edgereservingfilter) method keeping edge, such as specifically use bilateral filtering (bilateralfilter) etc., by described principal phase machine gray-scale image, resolve into corresponding basic one-tenth and levels of detail respectively from phase machine gray-scale image, particularly, main Primary layer and main levels of detail can be obtained after decomposing described principal phase machine gray-scale image, can obtain from Primary layer with from levels of detail after phase machine gray-scale image described in decomposing.
Next, can based on corresponding weight allocation strategy, to described main Primary layer be weighted fusion from Primary layer, obtain merging Primary layer; To described main levels of detail be weighted fusion from levels of detail, obtain merging levels of detail.Particularly, such as, with the texture-rich degree of image for foundation carries out weight allocation to main levels of detail with from levels of detail, and then main levels of detail and the Weighted Fusion from levels of detail can be realized, wherein, texture-rich degree can be weighed with the Gaussian Energy of image local or Laplce's energy.
On this basis, merging described fusion Primary layer and merge levels of detail, described target gray image can be obtained, and continuing described target gray image and the master image color information extracted before to merge, the final array camera imaging for exporting can being obtained.
Embodiment six
With reference to figure 7, the structural representation of a kind of imaging device embodiment six based on array camera that Fig. 7 provides for the application, in the present embodiment, the described imaging device based on array camera can also comprise the focusing control module 400 be connected with described first acquisition module 100, and described focusing control module 400 comprises:
4th acquiring unit 401, for obtain first with reference to from image and second with reference to from image; Described first with reference to from image, described second with reference to from image for: from multiple two width images that picture quality is the highest from image of camera shooting described in each;
Second computing unit 402, for based on principle of stereoscopic vision, utilize described first with reference to from image and described second with reference to from image, computing reference focusing from;
Search unit 403, for by described with reference to focusing from centered by preset search territory in search for, obtain target focusing from; Described target focusing is from being focusing distance values that principal phase machine picture quality corresponding in described preset search territory is the highest;
Focusing control unit 404, for based on described target focusing from, to described principal phase machine carry out focusing control.
The present embodiment specifically provides a kind of auto-focusing scheme of principal phase machine.
First, can according to the ambiguity of image subject, from each from camera shooting multiple from image, extract image quality the highest, namely the two width images that image subject ambiguity is minimum, afterwards based on principle of stereoscopic vision, utilize the two width images extracted, the object distance of computed image main body, on this basis, further according to imaging formula 1/f=1/u+1/v, calculate a pair defocus distance (apart) numerical value, wherein, f represents focal length, say for from camera, f is known, and u represents object distance, v represent focusing from.
Afterwards, using the described focusing distance values that calculates as with reference to focusing from, and by described with reference to focusing from centered by preset search territory in adopt preset step-length search for, finally obtain the focusing distance values that in described preset search territory, principal phase machine image quality is the highest, and using search for the focusing distance values that obtains as target focusing from, focusing control is carried out to described principal phase machine.
Wherein, the value of described preset search territory and described default step-length, can determine based on the focusing accuracy and runtime demand of reality.
Prior art utilizes principle of stereoscopic vision, by selecting two width images from each little aperture camera imaging of depth of field isomorphism, realize auto-focusing to control, compared to prior art, because the application carries out the two width images (large aperture, the depth of field overlapping from camera imaging) that adopt when auto-focusing controls, obviously there is the advantages such as half-light image quality is high, image subject definition is high, thus the auto-focusing control accuracy of the application is higher, improve the focusing performance of array camera further.
Embodiment seven
The present embodiment provides a kind of electronic equipment, described electronic equipment can be the terminal equipments such as smart mobile phone, panel computer or general camera, described electronic equipment comprises an array camera, and an embodiment as any in embodiment four to embodiment six the imaging device based on array camera that provides, described array camera comprise principal phase machine and predetermined number from camera, large aperture is adopted from camera described in each, and overlapping successively from the depth of field of camera described in each.
Based on described array camera and described imaging device, described electronic equipment has that half-light image quality is high, image subject definition is high and the advantage such as auto-focusing performance is good.
It should be noted that, each embodiment in this specification all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.
For convenience of description, various module or unit is divided into describe respectively with function when describing above system or device.Certainly, the function of each unit can be realized in same or multiple software and/or hardware when implementing the application.
As seen through the above description of the embodiments, those skilled in the art can be well understood to the mode that the application can add required general hardware platform by software and realizes.Based on such understanding, the technical scheme of the application can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform the method described in some part of each embodiment of the application or embodiment.
Finally, also it should be noted that, in this article, the relational terms of such as first, second, third and fourth etc. and so on is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (11)
1., based on a formation method for array camera, it is characterized in that, described array camera comprise principal phase machine and predetermined number from camera, adopt large aperture from camera described in each, and overlapping successively from the depth of field of camera described in each, described method comprises:
Obtain the master image of described principal phase machine shooting;
Obtain target from image; Described target from image for: described in each from camera shooting multiple images that picture quality is the highest from image;
To the image co-registration process that described master image and described target are preset from image, obtain target image.
2. method according to claim 1, is characterized in that, described picture quality is weighed based on the ambiguity of image subject, then described acquisition target comprises from image:
Obtain image subject;
Calculate described image subject described in each from the ambiguity image;
From described each select from image image subject ambiguity minimum from image, obtain target from image.
3. method according to claim 1, is characterized in that, the described image co-registration process preset from image described master image and described target, obtains target image, comprising:
Obtain described master image and described target respectively from gray level image corresponding to image, obtain principal phase machine gray-scale image and from phase machine gray-scale image;
Obtain the color information of described master image;
Merge described principal phase machine gray-scale image and described from phase machine gray-scale image, obtain target gray image;
Merge described target gray image and described color information, obtain target image.
4. method according to claim 3, is characterized in that, described fusion described principal phase machine gray-scale image and described from phase machine gray-scale image, obtains target gray image, comprising:
Decompose described principal phase machine gray-scale image, obtain main Primary layer and main levels of detail;
Decompose described from phase machine gray-scale image, obtain from Primary layer with from levels of detail;
Merge described main Primary layer and from Primary layer, obtain merging Primary layer; Merge described main levels of detail and from levels of detail, obtain merging levels of detail;
Merge described fusion Primary layer and merge levels of detail, obtaining described target gray image.
5. the method according to claim 1-4 any one, is characterized in that, also comprises following preprocessing process:
Obtain first with reference to from image and second with reference to from image; Described first with reference to from image, described second with reference to from image for: from multiple two width images that picture quality is the highest from image of camera shooting described in each;
Based on principle of stereoscopic vision, utilize described first with reference to from image and described second with reference to from image, computing reference focusing from;
By described with reference to focusing from centered by preset search territory in search for, obtain target focusing from; Described target focusing is from being focusing distance values that principal phase machine picture quality corresponding in described preset search territory is the highest;
Based on described target focusing from, to described principal phase machine carry out focusing control.
6., based on an imaging device for array camera, it is characterized in that, described array camera comprise principal phase machine and predetermined number from camera, adopt large aperture from camera described in each, and overlapping successively from the depth of field of camera described in each, described device comprises:
First acquisition module, for obtaining the master image of described principal phase machine shooting;
Second acquisition module, for obtaining target from image; Described target from image for: described in each from camera shooting multiple images that picture quality is the highest from image;
Image co-registration module, for the image co-registration process preset from image described master image and described target, obtains target image.
7. device according to claim 6, is characterized in that, described picture quality is weighed based on the ambiguity of image subject, then described second acquisition module comprises:
First acquiring unit, for obtaining image subject;
First computing unit, for calculating described image subject described in each from the ambiguity image;
Choose unit, for from described each select from image image subject ambiguity minimum from image, obtain target from image.
8. device according to claim 6, is characterized in that, described image co-registration module comprises:
Second acquisition unit, for obtaining described master image and described target respectively from gray level image corresponding to image, obtains principal phase machine gray-scale image and from phase machine gray-scale image;
3rd acquiring unit, for obtaining the color information of described master image;
First integrated unit, for merging described principal phase machine gray-scale image and described from phase machine gray-scale image, obtains target gray image;
Second integrated unit, for merging described target gray image and described color information, obtains target image.
9. device according to claim 8, is characterized in that, described first integrated unit comprises:
First decomposes subelement, for decomposing described principal phase machine gray-scale image, obtains main Primary layer and main levels of detail;
Second decomposes subelement, described from phase machine gray-scale image for decomposing, and obtains from Primary layer with from levels of detail;
First fusant unit, for merging described main Primary layer and from Primary layer, obtaining merging Primary layer; Merge described main levels of detail and from levels of detail, obtain merging levels of detail;
Second fusant unit, for merging described fusion Primary layer and merging levels of detail, obtains described target gray image.
10. device according to claim 6, is characterized in that, also comprises focusing control module, and described focusing control module comprises:
4th acquiring unit, for obtain first with reference to from image and second with reference to from image; Described first with reference to from image, described second with reference to from image for: from multiple two width images that picture quality is the highest from image of camera shooting described in each;
Second computing unit, for based on principle of stereoscopic vision, utilize described first with reference to from image and described second with reference to from image, computing reference focusing from;
Search unit, for by described with reference to focusing from centered by preset search territory in search for, obtain target focusing from; Described target focusing is from being focusing distance values that principal phase machine picture quality corresponding in described preset search territory is the highest;
Focusing control unit, for based on described target focusing from, to described principal phase machine carry out focusing control.
11. 1 kinds of electronic equipments, is characterized in that, comprise the device as described in claim 6-10 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511025250.1A CN105450931B (en) | 2015-12-30 | 2015-12-30 | A kind of imaging method based on array camera, device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511025250.1A CN105450931B (en) | 2015-12-30 | 2015-12-30 | A kind of imaging method based on array camera, device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105450931A true CN105450931A (en) | 2016-03-30 |
| CN105450931B CN105450931B (en) | 2019-04-26 |
Family
ID=55560665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511025250.1A Active CN105450931B (en) | 2015-12-30 | 2015-12-30 | A kind of imaging method based on array camera, device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105450931B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108055452A (en) * | 2017-11-01 | 2018-05-18 | 广东欧珀移动通信有限公司 | Image processing method, device and equipment |
| CN109510941A (en) * | 2018-12-11 | 2019-03-22 | 努比亚技术有限公司 | A kind of shooting processing method, equipment and computer readable storage medium |
| CN109614909A (en) * | 2018-12-04 | 2019-04-12 | 北京中科虹霸科技有限公司 | A kind of iris capturing apparatus and method for of extension acquisition distance |
| WO2019085951A1 (en) * | 2017-11-01 | 2019-05-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, and device |
| CN111083438A (en) * | 2019-12-04 | 2020-04-28 | 广东康云科技有限公司 | Unmanned inspection method, system and device based on video fusion and storage medium |
| CN111127379A (en) * | 2019-12-25 | 2020-05-08 | 清华大学深圳国际研究生院 | Rendering method of light field camera 2.0 and electronic equipment |
| CN112532856A (en) * | 2019-09-17 | 2021-03-19 | 中兴通讯股份有限公司 | Shooting method, device and system |
| CN113096084A (en) * | 2021-03-31 | 2021-07-09 | 深圳百迈技术有限公司 | Visual detection method, equipment and system based on array camera imaging |
| CN115567783A (en) * | 2022-08-29 | 2023-01-03 | 荣耀终端有限公司 | Image processing method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101090442A (en) * | 2006-06-13 | 2007-12-19 | 三星电子株式会社 | Method and apparatus for taking images using mobile communication terminal with plurality of camera lenses |
| CN101154264A (en) * | 2006-09-27 | 2008-04-02 | 中国科学院自动化研究所 | Large field-depth iris image capturing system and method based on multiple cameras with fixed focus |
| CN101872473A (en) * | 2010-06-25 | 2010-10-27 | 清华大学 | Multiscale image natural color fusion method and device based on over-segmentation and optimization |
| CN102013019A (en) * | 2010-12-03 | 2011-04-13 | 深圳市乐州光电技术有限公司 | Information image recognition system and method |
| CN102547080A (en) * | 2010-12-31 | 2012-07-04 | 联想(北京)有限公司 | Image pick-up module and information processing equipment comprising same |
| WO2013141007A1 (en) * | 2012-03-21 | 2013-09-26 | 富士フイルム株式会社 | Image capture device |
| CN105046676A (en) * | 2015-08-27 | 2015-11-11 | 上海斐讯数据通信技术有限公司 | Image fusion method and equipment based on intelligent terminal |
| CN105049718A (en) * | 2015-07-06 | 2015-11-11 | 深圳市金立通信设备有限公司 | Image processing method and terminal |
-
2015
- 2015-12-30 CN CN201511025250.1A patent/CN105450931B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101090442A (en) * | 2006-06-13 | 2007-12-19 | 三星电子株式会社 | Method and apparatus for taking images using mobile communication terminal with plurality of camera lenses |
| CN101154264A (en) * | 2006-09-27 | 2008-04-02 | 中国科学院自动化研究所 | Large field-depth iris image capturing system and method based on multiple cameras with fixed focus |
| CN101872473A (en) * | 2010-06-25 | 2010-10-27 | 清华大学 | Multiscale image natural color fusion method and device based on over-segmentation and optimization |
| CN102013019A (en) * | 2010-12-03 | 2011-04-13 | 深圳市乐州光电技术有限公司 | Information image recognition system and method |
| CN102547080A (en) * | 2010-12-31 | 2012-07-04 | 联想(北京)有限公司 | Image pick-up module and information processing equipment comprising same |
| WO2013141007A1 (en) * | 2012-03-21 | 2013-09-26 | 富士フイルム株式会社 | Image capture device |
| CN105049718A (en) * | 2015-07-06 | 2015-11-11 | 深圳市金立通信设备有限公司 | Image processing method and terminal |
| CN105046676A (en) * | 2015-08-27 | 2015-11-11 | 上海斐讯数据通信技术有限公司 | Image fusion method and equipment based on intelligent terminal |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108055452B (en) * | 2017-11-01 | 2020-09-18 | Oppo广东移动通信有限公司 | Image processing method, device and equipment |
| WO2019085951A1 (en) * | 2017-11-01 | 2019-05-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, and device |
| US10805508B2 (en) | 2017-11-01 | 2020-10-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, and device |
| US10878539B2 (en) | 2017-11-01 | 2020-12-29 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image-processing method, apparatus and device |
| CN108055452A (en) * | 2017-11-01 | 2018-05-18 | 广东欧珀移动通信有限公司 | Image processing method, device and equipment |
| CN109614909A (en) * | 2018-12-04 | 2019-04-12 | 北京中科虹霸科技有限公司 | A kind of iris capturing apparatus and method for of extension acquisition distance |
| CN109510941B (en) * | 2018-12-11 | 2021-08-03 | 努比亚技术有限公司 | Shooting processing method and device and computer readable storage medium |
| CN109510941A (en) * | 2018-12-11 | 2019-03-22 | 努比亚技术有限公司 | A kind of shooting processing method, equipment and computer readable storage medium |
| CN112532856B (en) * | 2019-09-17 | 2023-10-17 | 中兴通讯股份有限公司 | Shooting method, device and system |
| CN112532856A (en) * | 2019-09-17 | 2021-03-19 | 中兴通讯股份有限公司 | Shooting method, device and system |
| CN111083438A (en) * | 2019-12-04 | 2020-04-28 | 广东康云科技有限公司 | Unmanned inspection method, system and device based on video fusion and storage medium |
| CN111127379A (en) * | 2019-12-25 | 2020-05-08 | 清华大学深圳国际研究生院 | Rendering method of light field camera 2.0 and electronic equipment |
| CN113096084A (en) * | 2021-03-31 | 2021-07-09 | 深圳百迈技术有限公司 | Visual detection method, equipment and system based on array camera imaging |
| CN115567783A (en) * | 2022-08-29 | 2023-01-03 | 荣耀终端有限公司 | Image processing method |
| CN115567783B (en) * | 2022-08-29 | 2023-10-24 | 荣耀终端有限公司 | Image processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105450931B (en) | 2019-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105450931A (en) | Imaging method and device based on array cameras, and electronic equipment | |
| CN102314683B (en) | Computational imaging method and imaging system based on nonplanar image sensor | |
| CN103824318B (en) | A kind of depth perception method of multi-cam array | |
| US10855909B2 (en) | Method and apparatus for obtaining binocular panoramic image, and storage medium | |
| CN107635129B (en) | Three-dimensional trinocular camera device and depth fusion method | |
| KR100779634B1 (en) | Virtual visual point image generating method and 3-d image display method and device | |
| CN102970548B (en) | Image depth sensing device | |
| CN106454090B (en) | Atomatic focusing method and system based on depth camera | |
| KR20170106931A (en) | Method and device for processing lightfield data | |
| DE112018001050T5 (en) | SYSTEM AND METHOD FOR VIRTUALLY ENHANCED VISUAL SIMULTANEOUS LOCALIZATION AND CARTOGRAPHY | |
| US10949700B2 (en) | Depth based image searching | |
| CN103776419B (en) | A kind of binocular distance measurement method improving measurement range | |
| CN106462956A (en) | Local adaptive histogram equalization | |
| CN107454377B (en) | A kind of algorithm and system carrying out three-dimensional imaging using camera | |
| CN104050662A (en) | Method for directly obtaining depth image through light field camera one-time imaging | |
| CN106204554A (en) | Depth of view information acquisition methods based on multiple focussing image, system and camera terminal | |
| CN108848367A (en) | A kind of method, device and mobile terminal of image procossing | |
| US11282176B2 (en) | Image refocusing | |
| CN105959593B (en) | A kind of exposure method and photographing device of photographing device | |
| CN109064505A (en) | A kind of depth estimation method extracted based on sliding window tensor | |
| EP3026631A1 (en) | Method and apparatus for estimating depth of focused plenoptic data | |
| CN110246172A (en) | A kind of the light field total focus image extraction method and system of the fusion of two kinds of Depth cues | |
| CN110458952A (en) | A kind of three-dimensional rebuilding method and device based on trinocular vision | |
| CN105791793A (en) | Image processing method and electronic device | |
| CN112507840A (en) | Man-machine hybrid enhanced small target detection and tracking method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |