CN106375662B - A kind of image pickup method based on dual camera, device and mobile terminal - Google Patents
A kind of image pickup method based on dual camera, device and mobile terminal Download PDFInfo
- Publication number
- CN106375662B CN106375662B CN201610840250.5A CN201610840250A CN106375662B CN 106375662 B CN106375662 B CN 106375662B CN 201610840250 A CN201610840250 A CN 201610840250A CN 106375662 B CN106375662 B CN 106375662B
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- foreground
- background
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000009977 dual effect Effects 0.000 title claims abstract description 27
- 230000008569 process Effects 0.000 claims description 17
- 230000015572 biosynthetic process Effects 0.000 claims description 12
- 238000003786 synthesis reaction Methods 0.000 claims description 7
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/957—Light-field or plenoptic cameras or camera modules
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention proposes a kind of image pickup method based on dual camera, device and mobile terminals, this method comprises: obtaining the image of the first camera acquisition and the image of second camera acquisition；The image to first camera acquisition and the image of second camera acquisition carry out the division of foreground area and background area respectively；Foreground area removal processing is carried out to the image of first camera acquisition, forms background image；Removal processing in background area is carried out to the image of second camera acquisition, forms foreground image；The background image and the foreground image are synthesized according to the posture of setting, form final image.The present invention can in real time, dynamically adjust the posture of foreground and background in photographed scene, operate that convenient, interest is strong, improve the shooting experience of user to the greatest extent.
Description
Technical field
The present invention relates to technical field of image processing more particularly to a kind of image pickup method based on dual camera, device and
Mobile terminal.
Background technique
With the configuration of mobile terminal and the continuous promotion of performance, occur with double preceding cameras or double rear cameras
Mobile terminal, especially field of mobile phones, most of mobile phone all have the configuration of double rear cameras.But mobile phone is using double at present
The main purpose of rear camera is and to lack the function that differentiation processing are carried out by double rear cameras to promote effect of taking pictures
Energy.User, can only be by third party's image processing software, example if you need to be adjusted processing to the foreground and background in a photo
Such as, Photoshop, in graphic detail etc..Therefore, it is impossible in real time, dynamically adjust imaging posture in background and prospect.
Summary of the invention
The main purpose of the present invention is to provide a kind of image pickup method based on dual camera, device and mobile terminal,
The posture of prospect and background in image is dynamically adjusted in shooting process.
The technical solution adopted by the present invention is that the image pickup method based on dual camera, comprising:
Obtain the image of the first camera acquisition and the image of second camera acquisition；
The image to first camera acquisition and the image of second camera acquisition carry out foreground area respectively
With the division of background area；
Foreground area removal processing is carried out to the image of first camera acquisition, forms background image；To described
The image of two cameras acquisition carries out background area removal processing, forms foreground image；
The background image and the foreground image are synthesized according to the posture of setting, form final image.
Further, the image of the image to first camera acquisition and second camera acquisition respectively
Carry out the division of foreground area and background area, comprising:
Whether judge in the image of the first camera acquisition and the image of second camera acquisition comprising personage
Region, if so, setting the personage region to image and the second camera acquisition of the first camera acquisition
Image foreground area, remaining area in the image of first camera acquisition and the image of second camera acquisition
Domain is set as background area；If it is not, each pixel then calculated in the image of the first camera acquisition is imaged to first
Head first distance value, be based on the first distance value, by first camera acquire image be divided into foreground area and
Background area, and calculate each pixel in the image of second camera acquisition to second camera second distance
Value is based on the second distance value, the image that the second camera acquires is divided into foreground area and background area.
Further, the image to first camera acquisition carries out foreground area removal processing, forms background
Image, comprising:
The content of the foreground area in the image of the first camera acquisition is deleted, and is adopted according to first camera
The content of background area in the image of collection is filled the foreground area, forms the background image of content intact.
Further, the image to second camera acquisition carries out background area removal processing, forms prospect
Image, comprising:
The content of the background area in the image of the second camera acquisition is deleted, formation only retains second camera shooting
The foreground image of the content of foreground area in the image of head acquisition.
Further, described to synthesize the background image and the foreground image according to the posture of setting, it is formed
Final image, comprising:
The foreground image is placed in the background image according to the position of setting, and to the foreground image and/
Or the background image zooms in and out adjustment and/or rotation adjustment, with shape final image.
The present invention also provides a kind of filming apparatus based on dual camera, comprising:
Module is obtained, for obtaining the image of the first camera acquisition and the image of second camera acquisition；
Division module, the image for image and second camera acquisition respectively to first camera acquisition
Carry out the division of foreground area and background area；
Processing module, the image for acquiring to first camera carry out foreground area removal processing, form background
Image；Removal processing in background area is carried out to the image of second camera acquisition, forms foreground image；
Synthesis module is formed for synthesizing the background image and the foreground image according to the posture of setting
Final image.
Further, the division module, is specifically used for:
Whether judge in the image of the first camera acquisition and the image of second camera acquisition comprising personage
Region, if so, setting the personage region to image and the second camera acquisition of the first camera acquisition
Image foreground area, remaining area in the image of first camera acquisition and the image of second camera acquisition
Domain is set as background area；If it is not, each pixel then calculated in the image of the first camera acquisition is imaged to first
Head first distance value, be based on the first distance value, by first camera acquire image be divided into foreground area and
Background area, and calculate each pixel in the image of second camera acquisition to second camera second distance
Value is based on the second distance value, the image that the second camera acquires is divided into foreground area and background area.
Further, the processing module, comprising: perspective process unit and background process unit；
The perspective process unit, the content of the foreground area in image for deleting the first camera acquisition,
And the foreground area is filled according to the content of the background area in the image of first camera acquisition, in formation
Hold complete background image；
The background process unit, the content of the background area in image for deleting the second camera acquisition,
Form the foreground image of the content of the foreground area in the image for only retaining the second camera acquisition.
Further, the synthesis module, is specifically used for:
The foreground image is placed in the background image according to the position of setting, and to the foreground image and/
Or the background image zooms in and out adjustment and/or rotation adjustment, with shape final image.
The present invention also provides a kind of mobile terminals, comprising: double preceding cameras or double rear cameras and claim 6~9
Any one of described in the filming apparatus based on dual camera.
The present invention has the beneficial effect that:
Image pickup method based on dual camera, device and mobile terminal of the present invention, user use have it is double before or
When the mobile terminal of the double rear cameras of person takes pictures or records a video, a camera generates the background painting only having in photographed scene
The background image in face, in addition camera generates the foreground image for there was only the foreground picture in photographed scene, then will be described before
Scape image is incorporated in background image in a manner of editable.End user adjusts the posture of foreground image and background image, is formed
Meet the photo or video of user's requirement.The present invention can in real time, dynamically adjust foreground and background in photographed scene
Posture, operation is convenient, interest is strong, improves the shooting experience of user to the greatest extent.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair
Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:
Fig. 1 is the flow chart of the image pickup method based on dual camera of first embodiment of the invention；
Fig. 2 is the flow chart of the image pickup method based on dual camera of second embodiment of the invention；
Fig. 3 is the composed structure schematic diagram of the filming apparatus based on dual camera of third embodiment of the invention；
Fig. 4 is the composed structure schematic diagram of the filming apparatus based on dual camera of fourth embodiment of the invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with drawings and the specific embodiments, to this
Invention is described in further detail.
The first embodiment of the present invention provides a kind of image pickup method based on dual camera, as shown in Figure 1, include with
Lower specific steps:
Step S101: the image of the first camera acquisition and the image of second camera acquisition are obtained.
First camera and second camera be a certain mobile terminal double proactive pictures after or double rear cameras.Have
The mobile terminal of double preceding cameras is that there are two front cameras for setting on the mobile terminal.Shifting with double rear cameras
Dynamic terminal is that there are two rear cameras for setting on the mobile terminal.When a certain mobile terminal is shot, lead to
It crosses the first camera and second camera and collects two images respectively.
Step S102: the image to first camera acquisition and the image of second camera acquisition carry out respectively
The division of foreground area and background area.
Prospect refer to the main body in image before close camera scenery or personage, background refer to positioned at image
In main body after, far from camera scenery.
Specifically, step S102, comprising:
Whether judge in the image of the first camera acquisition and the image of second camera acquisition comprising personage
Region, if so, setting the personage region to image and the second camera acquisition of the first camera acquisition
Image foreground area, remaining area in the image of first camera acquisition and the image of second camera acquisition
Domain is set as background area；If it is not, each pixel then calculated in the image of the first camera acquisition is imaged to first
Head first distance value, be based on the first distance value, by first camera acquire image be divided into foreground area and
Background area, and calculate each pixel in the image of second camera acquisition to second camera second distance
Value is based on the second distance value, the image that the second camera acquires is divided into foreground area and background area.
Step S103: foreground area removal processing is carried out to the image of first camera acquisition, forms background image；
Removal processing in background area is carried out to the image of second camera acquisition, forms foreground image.
Specifically, the image to first camera acquisition carries out foreground area removal processing, Background is formed
Picture, comprising:
The content of the foreground area in the image of the first camera acquisition is deleted, and is adopted according to first camera
The content of background area in the image of collection is filled the foreground area, forms the background image of content intact.
Since after the content of foreground area in the image for deleting the first camera acquisition, first camera is adopted
Foreground area in the image of collection does not have pattern and color, needs the background area in the image using first camera acquisition
The pattern and color in domain are filled foreground area, so that the picture of the background image is complete.
The image to second camera acquisition carries out background area removal processing, forms foreground image, comprising:
The content of the background area in the image of the second camera acquisition is deleted, formation only retains second camera shooting
The foreground image of the content of foreground area in the image of head acquisition.
Step S104: the background image and the foreground image are synthesized according to the posture of setting, are formed final
Image.
Specifically, step S104, comprising:
The foreground image is placed in the background image according to the position of setting, and to the foreground image and/
Or the background image zooms in and out adjustment and/or rotation adjustment, with shape final image.
The second embodiment of the present invention provides a kind of image pickup method based on dual camera, as shown in Fig. 2, include with
Lower specific steps:
Step S201: double preceding cameras or double rear cameras are carried out with the setting of screening-mode.If screening-mode is arranged
For the screening-mode for adjusting foreground and background posture, S202 is thened follow the steps, if setting common screening-mode for screening-mode,
Then conventionally shot using double preceding cameras or double rear cameras.
Mobile terminal with double preceding cameras is that there are two front cameras for setting on the mobile terminal.With double
The mobile terminal of rear camera is that there are two rear cameras for setting on the mobile terminal.
Step S202: function setting is carried out to double preceding cameras or double rear cameras.A camera is arranged to be used to form
Foreground image, another camera are used to form background image.
In the present embodiment, the first camera is provided for form the camera of background image, by second camera
It is provided for forming the camera of foreground image.
Step S203: a certain scene is shot by the double preceding cameras set or double rear cameras, is closed
In two images of a certain scene.
Step S204: respectively described two images are carried out with the division of foreground area and background area.
In general, be all in the image of user's shooting by personage in conjunction with landscape, and using personage as the main body in image,
Landscape is as the background in image.Whether the shooting based on user is accustomed to, first determine whether comprising personage region in image, if so,
Then set the personage region to the foreground area of described image, remaining region in described image is set as background area；
If it is not, then calculating the distance value of each pixel in image, the distance value is each pixel in image to acquisition institute
Described image is divided into prospect based on the distance value of each pixel in described image by the distance for stating the camera of image
Region and background area.
Further, the distance value based on each pixel in described image, is divided into prospect for described image
Region and background area, comprising:
Based on the distance value of each pixel in described image, described image is divided into multiple connected regions, Mei Gelian
The distance between each pixel in logical area difference is within the set range；
The smallest connected region of average distance value is set foreground area by the average distance value for calculating each connected region, will
Other regions in described image are set as background area.
Step S205: foreground area removal processing is carried out to an image, forms background image；To another image into
Row background area removal processing, forms foreground image.
Specifically, being arranged according to the function of being carried out in step S202 to double preceding cameras or double rear cameras, first is taken the photograph
As head acquired image is handled as follows:
Step A1: deleting the content of the foreground area in described image, when the content of the foreground area in image is deleted,
The foreground area of described image forms the region of black pattern-free.
Step A2: the profile of the background area in described image is extracted, according to the profile of the background area in described image
Module topology is carried out to the foreground area, the foreground area described in topological Contour filling is opened up so that the foreground area has
Flutter profile skeleton.
Step A3: using the content of the background area in described image, by filling algorithm and algorithm of generating layered regions, gradually
By the fills of the background area to the foreground area with topological profile skeleton, the back of content intact is ultimately formed
Scape image.
It is arranged according to the function of being carried out in step S202 to double preceding cameras or double rear cameras, second camera is adopted
The image of collection is handled as follows:
The content of the background area in described image is deleted, the foreground image for only retaining the content of foreground area is formed.
Step S206: according to the positional relationship and scale of foreground image and background image in former shooting image, by institute
Foreground image is stated to be placed in the background image.
Step S207: pose adjustment is carried out to the foreground image and background image, to form final image.
Specifically, the pose adjustment includes: the position for adjusting foreground image in background image, and to foreground image
Adjustment, rotation adjustment are zoomed in and out with background image.
The third embodiment of the present invention provides a kind of filming apparatus based on dual camera, as shown in figure 3, include with
Lower component part:
Module 301 is obtained, for obtaining the image of the first camera acquisition and the image of second camera acquisition.
Specifically, first camera and second camera are double preceding cameras or double rear camera shootings on mobile terminal
Head.It takes the mobile phone as an example, there is the mobile phone of double preceding cameras or double rear cameras when a certain scene is taken pictures and imaged, institute
It states two on mobile phone cameras and collects two images about a certain scene.
Division module 302, for respectively to first camera acquisition image and the second camera acquisition
The division of image progress foreground area and background area.
Prospect refer to the main body in image before close camera scenery or personage, background refer to positioned at image
In main body after, far from camera scenery.
Specifically, division module 302, is specifically used for
Whether judge in the image of the first camera acquisition and the image of second camera acquisition comprising personage
Region, if so, setting the personage region to image and the second camera acquisition of the first camera acquisition
Image foreground area, remaining area in the image of first camera acquisition and the image of second camera acquisition
Domain is set as background area；If it is not, each pixel then calculated in the image of the first camera acquisition is imaged to first
Head first distance value, be based on the first distance value, by first camera acquire image be divided into foreground area and
Background area, and calculate each pixel in the image of second camera acquisition to second camera second distance
Value is based on the second distance value, the image that the second camera acquires is divided into foreground area and background area.
Processing module 303, the image for acquiring to first camera carry out foreground area removal processing, form back
Scape image；Removal processing in background area is carried out to the image of second camera acquisition, forms foreground image.
Specifically, processing module 303, comprising: perspective process unit and background process unit；
The perspective process unit, the content of the foreground area in image for deleting the first camera acquisition,
And the foreground area is filled according to the content of the background area in the image of first camera acquisition, in formation
Hold complete background image；
The background process unit, the content of the background area in image for deleting the second camera acquisition,
Form the foreground image of the content of the foreground area in the image for only retaining the second camera acquisition.
Synthesis module 304, for the background image and the foreground image to be synthesized according to the posture of setting, shape
At final image.
Specifically, synthesis module 304, is specifically used for:
The foreground image is placed in the background image according to the position of setting, and to the foreground image and/
Or the background image zooms in and out adjustment and/or rotation adjustment, with shape final image.
The fourth embodiment of the present invention provides a kind of filming apparatus based on dual camera, as shown in figure 4, include with
Lower component part:
Screening-mode setup module 401, for double preceding cameras or double rear cameras to be carried out with the setting of screening-mode.If
Screening-mode is set to the screening-mode of adjustment foreground and background posture, then Trigger Function setup module 402, if mould will be shot
Formula is set as common screening-mode, then is conventionally shot using double preceding cameras or double rear cameras.
Function setup module 402, for carrying out function setting to double preceding cameras or double rear cameras.One camera shooting is set
Head is used to form foreground image, another camera is used to form background image.
In the present embodiment, the first camera is provided for form the camera of background image, by second camera
It is provided for forming the camera of foreground image.
Shooting module 403 shoots a certain scene for passing through the double preceding cameras set or double rear cameras,
Obtain two images about a certain scene.
Division module 404, for respectively described two images to be carried out with the division of foreground area and background area.
In general, be all in the image of user's shooting by personage in conjunction with landscape, and using personage as the main body in image,
Landscape is as the background in image.Whether the shooting based on user is accustomed to, first determine whether comprising personage region in image, if so,
Then set the personage region to the foreground area of described image, remaining region in described image is set as background area；
If it is not, then calculating the distance value of each pixel in image, the distance value is each pixel in image to acquisition institute
Described image is divided into foreground area based on the distance value of each pixel in image by the distance for stating the camera of image
The background area and.
Specifically, division module 404, is specifically used for:
Based on the distance value of each pixel in image, described image is divided into multiple connected regions, each connected region
In the distance between each pixel difference within the set range；
The smallest connected region of average distance value is set foreground area by the average distance value for calculating each connected region, will
Other regions in described image are set as background area.
Processing module 405 forms background image for carrying out foreground area removal processing to an image；To other one
A image carries out background area removal processing, forms foreground image.
Specifically, the processing module 405, comprising: perspective process unit and background process unit；
Function setting is carried out to double preceding cameras or double rear cameras according in function setup module 402, is taken the photograph for first
As head acquired image, the perspective process unit is specifically used for:
The content for deleting the foreground area in described image, when the content of the foreground area in image is deleted, the figure
The foreground area of picture forms the region of black pattern-free.
The profile for extracting the background area in described image, according to the profile of the background area in described image to before described
Scene area carries out module topology, the foreground area described in topological Contour filling, so that the foreground area has topological profile bone
Frame.
It, gradually will be described by filling algorithm and algorithm of generating layered regions using the content of the background area in described image
The fills of background area ultimately form the Background of content intact to the foreground area with topological profile skeleton
Picture.
Function setting is carried out to double preceding cameras or double rear cameras according in function setup module 402, is taken the photograph for second
As head acquired image, the background process unit is specifically used for:
The content of the background area in described image is deleted, the foreground image for only retaining the content of foreground area is formed.
Image synthesis module 406, for the positional relationship and ratio according to foreground image and background image in former shooting image
Example size, the foreground image is placed in the background image.
Pose adjustment module 407, for carrying out pose adjustment to the foreground image and background image, to be formed finally
Image.
Specifically, the pose adjustment includes: the position for adjusting foreground image in background image, and to foreground image
Adjustment, rotation adjustment are zoomed in and out with background image.
The fifth embodiment of the present invention, a kind of mobile terminal, comprising: double preceding cameras or double rear cameras and this hair
The filming apparatus based on dual camera introduced in bright 3rd embodiment or fourth embodiment.Movement with double preceding cameras
Terminal is that there are two front cameras for setting on the mobile terminal；Mobile terminal with double rear cameras is in the shifting
There are two rear cameras for setting in dynamic terminal.
The image pickup method based on dual camera, device and the mobile terminal introduced in the embodiment of the present invention, user use tool
When having the mobile terminal of double preceding or double rear cameras to be taken pictures or recorded a video, a camera, which generates, to be only had in photographed scene
Background frame background image, in addition camera generates the foreground image for there was only the foreground picture in photographed scene, then
The foreground image is incorporated in background image in a manner of editable.The appearance of end user adjustment foreground image and background image
State forms the photo or video for meeting user's requirement.The present invention can in real time, dynamically adjust prospect in photographed scene and
The posture of background, operation is convenient, interest is strong, improves the shooting experience of user to the greatest extent.
The above description is only an embodiment of the present invention, is not intended to restrict the invention, for those skilled in the art
For member, the invention may be variously modified and varied.All within the spirits and principles of the present invention, it is made it is any modification,
Equivalent replacement, improvement etc., should be included within scope of the presently claimed invention.
Claims (8)
1. a kind of image pickup method based on dual camera characterized by comprising
Obtain the image of the first camera acquisition and the image of second camera acquisition；
The image to first camera acquisition and the image of second camera acquisition carry out foreground area and back respectively
The division of scene area；
Foreground area removal processing is carried out to the image of first camera acquisition, forms background image；It is taken the photograph to described second
The image acquired as head carries out background area removal processing, forms foreground image；
The background image and the foreground image are synthesized according to the posture of setting, form final image；
Wherein, the image to first camera acquisition respectively and the image of second camera acquisition carry out prospect
The division in region and background area, comprising:
Judge whether in the image of the first camera acquisition and the image of second camera acquisition include personage region,
If so, setting the personage region to the image of the first camera acquisition and the image of second camera acquisition
Foreground area, remaining region setting in the image of first camera acquisition and the image of second camera acquisition
For background area；If it is not, then calculating each pixel in the image of first camera acquisition to the of the first camera
One distance value is based on the first distance value, and the image that first camera acquires is divided into foreground area and background area
Domain, and each pixel in the image that the second camera acquires is calculated to the second distance value of second camera, it is based on
The image that the second camera acquires is divided into foreground area and background area by the second distance value；
It is described to be based on the first distance value, the image that first camera acquires is divided into foreground area and background area
Domain specifically includes:
Based on the distance value of each pixel in described image, described image is divided into multiple connected regions, each connected region
In the distance between each pixel difference within the set range；
The smallest connected region of average distance value is set foreground area by the average distance value for calculating each connected region, will be described
Other regions in image are set as background area.
2. the image pickup method according to claim 1 based on dual camera, which is characterized in that described to first camera shooting
The image of head acquisition carries out foreground area removal processing, forms background image, comprising:
The content of the foreground area in the image of the first camera acquisition is deleted, and according to first camera acquisition
The content of background area in image is filled the foreground area, forms the background image of content intact.
3. the image pickup method according to claim 1 based on dual camera, which is characterized in that described to second camera shooting
The image of head acquisition carries out background area removal processing, forms foreground image, comprising:
The content of the background area in the image of the second camera acquisition is deleted, formation only retains the second camera and adopts
The foreground image of the content of foreground area in the image of collection.
4. the image pickup method according to claim 1 based on dual camera, which is characterized in that described by the background image
It is synthesized with the foreground image according to the posture of setting, forms final image, comprising:
The foreground image is placed in the background image according to the position of setting, and to the foreground image and/or institute
It states background image and zooms in and out adjustment and/or rotation adjustment, with shape final image.
5. a kind of filming apparatus based on dual camera characterized by comprising
Module is obtained, for obtaining the image of the first camera acquisition and the image of second camera acquisition；
Division module, the image for image and second camera acquisition respectively to first camera acquisition carry out
The division of foreground area and background area；
Processing module, the image for acquiring to first camera carry out foreground area removal processing, form background image；
Removal processing in background area is carried out to the image of second camera acquisition, forms foreground image；
Synthesis module is formed final for synthesizing the background image and the foreground image according to the posture of setting
Image；
Wherein, the division module, is specifically used for:
Judge whether in the image of the first camera acquisition and the image of second camera acquisition include personage region,
If so, setting the personage region to the image of the first camera acquisition and the image of second camera acquisition
Foreground area, remaining region setting in the image of first camera acquisition and the image of second camera acquisition
For background area；If it is not, then calculating each pixel in the image of first camera acquisition to the of the first camera
One distance value is based on the first distance value, and the image that first camera acquires is divided into foreground area and background area
Domain, and each pixel in the image that the second camera acquires is calculated to the second distance value of second camera, it is based on
The image that the second camera acquires is divided into foreground area and background area by the second distance value；
It is described to be based on the first distance value, the image that first camera acquires is divided into foreground area and background area
Domain specifically includes:
Based on the distance value of each pixel in described image, described image is divided into multiple connected regions, each connected region
In the distance between each pixel difference within the set range；
The smallest connected region of average distance value is set foreground area by the average distance value for calculating each connected region, will be described
Other regions in image are set as background area.
6. the filming apparatus according to claim 5 based on dual camera, which is characterized in that the processing module, comprising:
Perspective process unit and background process unit；
The perspective process unit, the content of the foreground area in image for deleting the first camera acquisition, and root
The foreground area is filled according to the content of the background area in the image of first camera acquisition, it is complete to form content
Whole background image；
The background process unit, the content of the background area in image for deleting the second camera acquisition, forms
Only retain the foreground image of the content of the foreground area in the image of the second camera acquisition.
7. the filming apparatus according to claim 5 based on dual camera, which is characterized in that the synthesis module, specifically
For:
The foreground image is placed in the background image according to the position of setting, and to the foreground image and/or institute
It states background image and zooms in and out adjustment and/or rotation adjustment, with shape final image.
8. a kind of mobile terminal characterized by comprising in double preceding cameras or double rear cameras and claim 5~7
Described in any item filming apparatus based on dual camera.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610840250.5A CN106375662B (en) | 2016-09-22 | 2016-09-22 | A kind of image pickup method based on dual camera, device and mobile terminal |
| PCT/CN2016/104069 WO2018053906A1 (en) | 2016-09-22 | 2016-10-31 | Dual camera-based shooting method and device, and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610840250.5A CN106375662B (en) | 2016-09-22 | 2016-09-22 | A kind of image pickup method based on dual camera, device and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106375662A CN106375662A (en) | 2017-02-01 |
| CN106375662B true CN106375662B (en) | 2019-04-12 |
Family
ID=57898025
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610840250.5A Active CN106375662B (en) | 2016-09-22 | 2016-09-22 | A kind of image pickup method based on dual camera, device and mobile terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106375662B (en) |
| WO (1) | WO2018053906A1 (en) |
Families Citing this family (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9979890B2 (en) | 2015-04-23 | 2018-05-22 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US10009536B2 (en) | 2016-06-12 | 2018-06-26 | Apple Inc. | Applying a simulated optical effect based on data received from multiple camera sensors |
| CN106851113A (en) * | 2017-03-30 | 2017-06-13 | 努比亚技术有限公司 | A kind of photographic method and mobile terminal based on dual camera |
| CN107133939A (en) * | 2017-04-24 | 2017-09-05 | 努比亚技术有限公司 | A kind of picture synthesis method, equipment and computer-readable recording medium |
| CN108810326B (en) * | 2017-04-27 | 2022-11-18 | 中兴通讯股份有限公司 | Photographing method and device and mobile terminal |
| DK180859B1 (en) | 2017-06-04 | 2022-05-23 | Apple Inc | USER INTERFACE CAMERA EFFECTS |
| CN109218630B (en) * | 2017-07-06 | 2022-04-12 | 腾讯科技（深圳）有限公司 | Multimedia information processing method and device, terminal and storage medium |
| CN107767430A (en) * | 2017-09-21 | 2018-03-06 | 努比亚技术有限公司 | One kind shooting processing method, terminal and computer-readable recording medium |
| CN108174088A (en) * | 2017-12-26 | 2018-06-15 | 上海展扬通信技术有限公司 | A kind of brightness adjusting method, device, terminal and computer readable storage medium |
| CN108322644A (en) * | 2018-01-18 | 2018-07-24 | 努比亚技术有限公司 | A kind of image processing method, mobile terminal and computer readable storage medium |
| US11112964B2 (en) | 2018-02-09 | 2021-09-07 | Apple Inc. | Media capture lock affordance for graphical user interface |
| US11722764B2 (en) | 2018-05-07 | 2023-08-08 | Apple Inc. | Creative camera |
| US10375313B1 (en) | 2018-05-07 | 2019-08-06 | Apple Inc. | Creative camera |
| CN108965695A (en) * | 2018-06-27 | 2018-12-07 | 努比亚技术有限公司 | A kind of image pickup method, mobile terminal and computer readable storage medium |
| US10674072B1 (en) | 2019-05-06 | 2020-06-02 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11770601B2 (en) | 2019-05-06 | 2023-09-26 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11321857B2 (en) | 2018-09-28 | 2022-05-03 | Apple Inc. | Displaying and editing images with depth information |
| US11128792B2 (en) | 2018-09-28 | 2021-09-21 | Apple Inc. | Capturing and displaying images with multiple focal planes |
| CN110012229B (en) * | 2019-04-12 | 2021-01-08 | 维沃移动通信有限公司 | Image processing method and terminal |
| CN111901479B (en) * | 2019-05-06 | 2021-05-25 | 苹果公司 | Method, electronic device and non-transitory computer-readable storage medium for displaying camera user interface |
| US11706521B2 (en) | 2019-05-06 | 2023-07-18 | Apple Inc. | User interfaces for capturing and managing visual media |
| CN110430364A (en) * | 2019-08-26 | 2019-11-08 | 武汉众果科技有限公司 | A kind of stingy figure local dynamic station figure synthetic method of taking pictures of photographing |
| CN112991242A (en) * | 2019-12-13 | 2021-06-18 | RealMe重庆移动通信有限公司 | Image processing method, image processing apparatus, storage medium, and terminal device |
| US11054973B1 (en) | 2020-06-01 | 2021-07-06 | Apple Inc. | User interfaces for managing media |
| US11212449B1 (en) | 2020-09-25 | 2021-12-28 | Apple Inc. | User interfaces for media capture and management |
| US11778339B2 (en) | 2021-04-30 | 2023-10-03 | Apple Inc. | User interfaces for altering visual media |
| US11539876B2 (en) | 2021-04-30 | 2022-12-27 | Apple Inc. | User interfaces for altering visual media |
| CN113794831B (en) * | 2021-08-13 | 2023-08-25 | 维沃移动通信（杭州）有限公司 | Video shooting method, device, electronic equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5940139A (en) * | 1996-08-07 | 1999-08-17 | Bell Communications Research, Inc. | Background extraction in a video picture |
| CN101938604A (en) * | 2009-07-02 | 2011-01-05 | 联想(北京)有限公司 | Image processing method and camera |
| CN102063610A (en) * | 2009-11-13 | 2011-05-18 | 鸿富锦精密工业（深圳）有限公司 | Image identification system and method thereof |
| CN104580910A (en) * | 2015-01-09 | 2015-04-29 | 宇龙计算机通信科技(深圳)有限公司 | Image synthesis method and system based on front camera and rear camera |
| CN105611146A (en) * | 2015-09-30 | 2016-05-25 | 宇龙计算机通信科技(深圳)有限公司 | Imaging method based on double cameras and apparatus thereof |
| CN105678696A (en) * | 2014-11-20 | 2016-06-15 | 联想(北京)有限公司 | Image acquisition method and electronic equipment |
| CN105957045A (en) * | 2016-04-29 | 2016-09-21 | 珠海市魅族科技有限公司 | Picture synthesis method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105005992B (en) * | 2015-07-07 | 2016-03-30 | 南京华捷艾米软件科技有限公司 | A kind of based on the background modeling of depth map and the method for foreground extraction |
-
2016
- 2016-09-22 CN CN201610840250.5A patent/CN106375662B/en active Active
- 2016-10-31 WO PCT/CN2016/104069 patent/WO2018053906A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5940139A (en) * | 1996-08-07 | 1999-08-17 | Bell Communications Research, Inc. | Background extraction in a video picture |
| CN101938604A (en) * | 2009-07-02 | 2011-01-05 | 联想(北京)有限公司 | Image processing method and camera |
| CN102063610A (en) * | 2009-11-13 | 2011-05-18 | 鸿富锦精密工业（深圳）有限公司 | Image identification system and method thereof |
| CN105678696A (en) * | 2014-11-20 | 2016-06-15 | 联想(北京)有限公司 | Image acquisition method and electronic equipment |
| CN104580910A (en) * | 2015-01-09 | 2015-04-29 | 宇龙计算机通信科技(深圳)有限公司 | Image synthesis method and system based on front camera and rear camera |
| CN105611146A (en) * | 2015-09-30 | 2016-05-25 | 宇龙计算机通信科技(深圳)有限公司 | Imaging method based on double cameras and apparatus thereof |
| CN105957045A (en) * | 2016-04-29 | 2016-09-21 | 珠海市魅族科技有限公司 | Picture synthesis method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018053906A1 (en) | 2018-03-29 |
| CN106375662A (en) | 2017-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106375662B (en) | A kind of image pickup method based on dual camera, device and mobile terminal | |
| TWI554936B (en) | Image processing device, image processing method and computer product program | |
| CN105100615B (en) | A kind of method for previewing of image, device and terminal | |
| CN109903217B (en) | Image deformation method and device | |
| CN105282421B (en) | A kind of mist elimination image acquisition methods, device and terminal | |
| CN103973963B (en) | Image acquisition device and image processing method thereof | |
| CN105847676A (en) | Image processing method and apparatus | |
| CN105376473A (en) | Photographing method, device and equipment | |
| CN108307120B (en) | Image shooting method and device and electronic terminal | |
| WO2015192547A1 (en) | Method for taking three-dimensional picture based on mobile terminal, and mobile terminal | |
| CN104853082B (en) | A kind of method and device for the picture that pans | |
| CN110611768B (en) | Multiple exposure photographic method and device | |
| WO2022001806A1 (en) | Image transformation method and apparatus | |
| CN106454118A (en) | Picture blurring method and mobile terminal | |
| CN106612392A (en) | Image shooting method and device based on double cameras | |
| CN107862718B (en) | 4D holographic video capture method | |
| CN105979163A (en) | Shooting method and device | |
| CN110740260A (en) | shooting method, device and computer readable storage medium | |
| CN106296789B (en) | It is a kind of to be virtually implanted the method and terminal that object shuttles in outdoor scene | |
| CN106101575B (en) | A kind of generation method, device and the mobile terminal of augmented reality photo | |
| CN113810590A (en) | Image processing method, electronic device, medium, and system | |
| CN106023073A (en) | Image splicing system | |
| CN114339042A (en) | Image processing method and device based on multiple cameras and computer readable storage medium | |
| CN106454015B (en) | The method of the image composition method and offer image of more camera lens camera modules | |
| CN114466133B (en) | Photographing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |