CN104580910A - Image synthesis method and system based on front camera and rear camera - Google Patents

Image synthesis method and system based on front camera and rear camera Download PDF

Info

Publication number
CN104580910A
CN104580910A CN201510013038.7A CN201510013038A CN104580910A CN 104580910 A CN104580910 A CN 104580910A CN 201510013038 A CN201510013038 A CN 201510013038A CN 104580910 A CN104580910 A CN 104580910A
Authority
CN
China
Prior art keywords
image
photograph
take
parameter
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510013038.7A
Other languages
Chinese (zh)
Other versions
CN104580910B (en
Inventor
詹谷
陈能
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Original Assignee
Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yulong Computer Telecommunication Scientific Shenzhen Co Ltd filed Critical Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority to CN201510013038.7A priority Critical patent/CN104580910B/en
Publication of CN104580910A publication Critical patent/CN104580910A/en
Application granted granted Critical
Publication of CN104580910B publication Critical patent/CN104580910B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention is applied to the technical field of communications, and provides an image synthesis method and system based on a front camera and a rear camera. The method comprises the steps that a front-shot image and a rear-shot image are obtained through the front camera and the rear camera respectively; a character image area is recognized and extracted from the front-shot image; the character image area is synthesized into the rear-shot image to generate target images. Therefore, image synthesis of the front camera and the rear camera can be achieved on the basis of hardware of an existing terminal device, the content of the synthesized image is more accurate and conforms to needs of a user better, and therefore interestingness and user experience of shooting operation are improved; meanwhile, more cost is saved. Better yet, before the images are synthesized, image parameters of the character image area can be adjusted and processed, the adjusted and processed character image area is closer to the quality of the rear-shot image, and therefore the image of the front camera and the image of the rear camera are fused together more naturally, and the quality of the synthesized image is improved.

Description

Based on image combining method and the system of forward and backward camera
Technical field
The present invention relates to communication technical field, particularly relate to a kind of image combining method based on forward and backward camera and system.
Background technology
In terminals such as mobile phones on the basis that hardware develops rapidly, can realize the function of forward and backward camera preview or shooting together, the view data of forward and backward camera is mainly all outputted to preview on screen by it, and preserves in the mode of What You See Is What You Get and become image.When existing forward and backward camera opens preview or shooting at the same time, the image that the image directly generated by front camera and rear camera generate carries out superposing with composograph, but because the functional parameter such as resolution, visual angle of front camera and rear camera exist notable difference, therefore in synthesized image, the image of forward and backward camera has obvious boundary, user can obviously feel be two imaging importing together, the effect showed is coarse stiff, cannot reach user and expect satisfied effect.
In summary, obviously there is inconvenience and defect in actual use in prior art, so be necessary to be improved.
Summary of the invention
For above-mentioned defect, the object of the present invention is to provide a kind of image combining method based on forward and backward camera and system, it can based on the Images uniting hardware foundation of existing terminal equipment realizing forward and backward camera, and the content of composograph more accurately and meet user's request, thus improve interest and the Consumer's Experience of shooting operation, more save cost simultaneously.Be more preferably, the present invention is before Images uniting, also the image parameter in character image region can be carried out adjustment process, make the character image region after adjusting process closer to the image quality taking the photograph image after described, so that the image of forward and backward camera more natural fusion together, promotes the quality of composograph.
To achieve these goals, the invention provides a kind of image combining method based on forward and backward camera, comprising:
Take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image;
Identify from taking the photograph image before described and extract character image region;
Described character image region synthesis is taken the photograph in image to generate target image after described.
According to image combining method of the present invention, described character image region synthesis to be comprised to taking the photograph in image after described with the step generating target image:
Determine that the binding site in image is taken the photograph in described character image region in the rear;
Described character image region synthesis is sentenced to the described binding site taking the photograph image after described and generates described target image.
According to image combining method of the present invention, described by character image region synthesis to taking the photograph after described in image also to comprise before the step generating target image:
Obtain the entirety in described character image region the first image parameter and described after take the photograph the second image parameter of the entirety of image;
Judge described after take the photograph described second image parameter of the entirety of image, and whether the first ratio between described first image parameter of the entirety in described character image region or the first difference are greater than predetermined first threshold;
If described first ratio between the two or described first difference are greater than described first threshold, then described first image parameter of the entirety in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjustment or described first difference; And/or
Obtain the marginal portion in described character image region the first image parameter and described after take the photograph the second image parameter of frame portion corresponding with the marginal portion in described character image region in image;
Judge described after take the photograph described second image parameter of frame portion corresponding with the marginal portion in described character image region in image, and whether the second ratio between described first image parameter of the described marginal portion in described character image region or the second difference are greater than predetermined Second Threshold;
If described second ratio between the two or described second difference are greater than described Second Threshold, then described first image parameter of the described marginal portion in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference.
According to image combining method of the present invention, described first image parameter and described second image parameter comprise resolution, visual angle, size, ratio, color, photosensitivity, time for exposure and/or acutance.
According to image combining method of the present invention, described obtain respectively by forward and backward camera before take the photograph image and after take the photograph the step of image after also comprise:
By take the photograph before described in multiframe image processing and tracking unit become one new before take the photograph image;
Described the past takes the photograph in image and to identify and the step extracting character image region comprises:
From described new before take the photograph image and identify and extract described character image region.
The present invention also provides a kind of image synthesis system based on forward and backward camera, comprising:
Image collection module, for take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image;
Person extraction module, for identifying from taking the photograph in image before described and extract character image region;
Image synthesis unit, for taking the photograph described character image region synthesis in image to generate target image after described.
According to image synthesis system of the present invention, described image synthesis unit comprises:
Submodule is determined in position, for determining that the binding site in image is taken the photograph in described character image region in the rear;
Images uniting submodule, generates described target image for being sentenced to the described binding site taking the photograph image after described by described character image region synthesis.
According to image synthesis system of the present invention, also comprise adjustment processing module, described adjustment processing module comprises further:
First obtains submodule, for obtain the entirety in described character image region the first image parameter and described after take the photograph the second image parameter of the entirety of image;
First judges submodule, for judge described after take the photograph described second image parameter of the entirety of image, and whether the first ratio between described first image parameter of the entirety in described character image region or the first difference are greater than predetermined first threshold;
First adjustment submodule, if when being greater than described first threshold for described first ratio between the two or described first difference, described first image parameter of the entirety in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference; And/or
Second obtains submodule, for obtain the marginal portion in described character image region the first image parameter and described after take the photograph the second image parameter of frame portion corresponding with the marginal portion in described character image region in image;
Second judges submodule, for judge described after take the photograph described second image parameter of frame portion corresponding with the marginal portion in described character image region in image, and whether the second ratio between described first image parameter of the described marginal portion in described character image region or the second difference are greater than predetermined Second Threshold;
Second adjustment submodule, if when being greater than described Second Threshold for described second ratio between the two or described second difference, then described first image parameter of the described marginal portion in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference.
According to image synthesis system of the present invention, described first image parameter and described second image parameter comprise resolution, visual angle, size, ratio, color, photosensitivity, time for exposure and/or acutance.
According to image synthesis system of the present invention, also comprise:
Before take the photograph image processing module, for take the photograph image before acquisition is described after, by take the photograph before described in multiframe image processing and tracking unit become one new before take the photograph image;
Described person extraction module, for from described new before take the photograph in image and identify and extract described character image region.
The invention provides the forward and backward technical scheme taken the photograph image and synthesize that the forward and backward camera of terminal equipment is obtained, and consider that front camera is mainly used in shooting personage content, then camera is mainly used in shooting background content, therefore take the photograph in image in the past identify and extract the character image region comprising personage's content, namely eliminate the background environment of surrounding, then by described character image region synthesis to after take the photograph in the background content of image to generate target image.Whereby, the present invention can based on the Images uniting hardware foundation of existing terminal equipment realizing forward and backward camera, and the content of composograph more accurately and meet user's request, thus improve interest and the Consumer's Experience of shooting operation, more saves cost simultaneously.Be more preferably, the present invention is before Images uniting, also the image parameter in character image region can be carried out adjustment process, make the character image region after adjusting process closer to the image quality taking the photograph image after described, so that the image of forward and backward camera more natural fusion together, promotes the quality of composograph.
Accompanying drawing explanation
Fig. 1 is the structural representation of the image synthesis system that the present invention is based on forward and backward camera;
Fig. 2 is the structural representation that the present invention is preferably based on the image synthesis system of forward and backward camera;
Fig. 3 is the flow chart of the image combining method that the present invention is based on forward and backward camera;
Fig. 4 is the flow chart based on the image combining method of forward and backward camera in first embodiment of the invention;
Fig. 5 is the method flow diagram carrying out adjusting process in second embodiment of the invention to character image region.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Fig. 1 is the structural representation of the image synthesis system that the present invention is based on forward and backward camera, described image synthesis system 100 can be applicable to mobile phone, PDA (Personal Digital Assistant, personal digital assistant), panel computer, camera etc. have in the terminal equipment of forward and backward camera, and described image synthesis system 100 at least comprises image collection module 10, person extraction module 20 and image synthesis unit 30, wherein:
Described image collection module 10, for take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image.When image preview and shooting, take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image, user wish by front take the photograph image and after take the photograph image and synthesize, wherein the content of composograph take the photograph before mainly comprising image personage's content and after take the photograph the background content of image.
Described person extraction module 20, identifies for taking the photograph in image in the past and extracts character image region.Preferably, system, according to the preview frame data of front camera, takes the photograph in image whether have character features according to before image recognition technology automatic analysis, and then identifies the profile of personage, extracts the adjustment after character image region is convenient to and/or union operation.Or user can according to the actual requirements, manually select character image region front taking the photograph image by touch command.Described character image region can comprise at least one personage's content, and described personage's content comprises head portrait, body part etc.Certain described character image region can also comprise other contents of object that user manually selects, such as animal, plant, article etc.
Described image synthesis unit 30, for by character image region synthesis to after take the photograph in image to generate target image.Take the photograph before content in described target image mainly comprises image personage's content and after take the photograph the background content of image, to meet user's actual need.
The present invention considers the use scenes of forward and backward camera and the requirement of Consumer's Experience, especially front camera, main manifestations is shooting personage, thus image recognition algorithm is adopted by person recognition out, and eliminate the background environment of surrounding, automatically identification is detected to the photographed scene of rear camera simultaneously, identify the scene of shooting, such as landscape, personage, motion, night scene etc., then the personage of front camera is dissolved into as far as possible in the image of rear camera, to the experience that user is more naturally more outstanding.The present invention uses existing hardware technology, does not make an amendment hardware and structure, therefore realizes cost lower.
Fig. 2 is the structural representation that the present invention is preferably based on the image synthesis system of forward and backward camera, described image synthesis system 100 can be applicable to mobile phone, PDA, panel computer, camera etc. and has in the terminal equipment of forward and backward camera, and described image synthesis system 100 at least comprises image collection module 10, person extraction module 20 and image synthesis unit 30, wherein:
Described image collection module 10, for take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image.
Described person extraction module 20, identifies for taking the photograph in image in the past and extracts character image region.
Described image synthesis unit 30, for by character image region synthesis to after take the photograph in image to generate target image.
Image synthesis unit 30 comprises:
Submodule 31 is determined in position, for determine character image region after take the photograph binding site in image.Preferably, system is according to the binding site taken the photograph after image recognition technology automatic analysis in image.Or user can according to the actual requirements, by touch command manually after take the photograph in image the binding site selecting image.
Images uniting submodule 32, for by described character image region synthesis to after take the photograph image binding site sentence generation target image.
Preferably, image synthesis system 100 of the present invention also can comprise:
Adjustment processing module 40, for before generation target image, first image parameter in the character image region of extraction is carried out adjustment process, the second image parameter of image is taken the photograph after making the first image parameter after adjusting process close, make the character image region after adjusting process closer to the image quality taking the photograph image after described, namely the difference of the first image parameter and the second image parameter or ratio are less than predetermined threshold value.Described first image parameter and the second image parameter comprise resolution, visual angle, size, ratio, color, photosensitivity, time for exposure and/or acutance etc.
Preferably, described adjustment processing module 40 comprises further:
First obtains submodule 41, for obtain the entirety in described character image region the first image parameter and described after take the photograph the second image parameter of the entirety of image;
First judges submodule 42, for judge described after take the photograph described second image parameter of the entirety of image, and whether the first ratio between described first image parameter of the entirety in described character image region or the first difference are greater than predetermined first threshold;
First adjustment submodule 43, if when being greater than described first threshold for described first ratio between the two or described first difference, described first image parameter of the entirety in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference; And/or
Described adjustment processing module 40 comprises further:
Second obtains submodule 44, for obtain the marginal portion in described character image region the first image parameter and described after take the photograph the second image parameter of frame portion corresponding with the marginal portion in described character image region in image;
Second judges submodule 45, for judge described after take the photograph described second image parameter of frame portion corresponding with the marginal portion in described character image region in image, and whether the second ratio between described first image parameter of the described marginal portion in described character image region or the second difference are greater than predetermined Second Threshold;
Second adjustment submodule 46, if when being greater than described Second Threshold for described second ratio between the two or described second difference, then described first image parameter of the described marginal portion in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference.
Preferably, described image synthesis system 100 also comprises:
Before take the photograph image processing module 50, for take the photograph image before acquisition is described after, by take the photograph before described in multiframe image processing and tracking unit become one new before take the photograph image, with the resolution utilizing multiframe data to improve image.
Described person extraction module 20, for from described new before take the photograph in image and identify and extract described character image region.
The present invention considers that the ultimate resolution due to front camera is generally less than the ultimate resolution of rear camera, the resolution of such as front camera is 5M, after the rate respectively taken the photograph be 13M, when differences in resolution is larger, the ratio that the image images themselves that front camera exports accounts in whole picture is just little, user seems to feel not nature, if and directly amplify, because definition pixel point is few, seem after amplification that the image quality that front camera provides is coarse, there is hazy sensations, put together still inharmonious with the image of rear camera, thus adopt here and the image of front camera is processed, it is made to possess higher pixel and resolution, main method is that before adopting, camera multiple image data merge the front camera image obtaining a larger pixel, make image quality and rear camera coupling as far as possible.
In addition, system of the present invention and user can also carry out adjustment process to the visual angle front taken the photograph, size, ratio, color, photosensitivity, time for exposure and/or acutance etc. by automatic or manual, and can carry out cutting, obtain more naturally satisfied effect with this.
Be more preferably, the present invention takes the photograph the background content of image after can also identifying and process, and avoids occurring the problems such as mistake, phenomenon as inharmonious in tone when merging image.
The invention provides a kind of image utilizing the forward and backward camera of terminal equipment, when image preview and shooting, a more natural image is synthesized in automated intelligent identification, character image before mainly identifying in camera also eliminates background, and use multiple image merge obtain similar to rear camera image image quality before take the photograph image, camera image before regulating, natural fusion is together more to allow the image of forward and backward camera, seem true nature more, completely newly to take pictures experience existing hardware basis to user.
Fig. 3 is the flow chart of the image combining method that the present invention is based on forward and backward camera, and described method can be realized by image synthesis system 100 as shown in Figure 1 or 2, and described method comprises:
Step S301, take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image.
When image preview and shooting, take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image, user wish by front take the photograph image and after take the photograph image and synthesize, wherein the content of composograph take the photograph before mainly comprising image personage's content and after take the photograph the background content of image.
Step S302, takes the photograph in image in the past and identifies and extract character image region.
Preferably, system, according to the preview frame data of front camera, takes the photograph in image whether have character features according to before image recognition technology automatic analysis, and then identifies the profile of personage, extracts the adjustment after character image region is convenient to and/or union operation.Or user can according to the actual requirements, manually select character image region front taking the photograph image by touch command.Described character image region can comprise at least one personage's content, and described personage's content comprises head portrait, body part etc.Certain described character image region can also comprise other contents of object that user manually selects, such as animal, plant, article etc.
Step S303, by character image region synthesis to after take the photograph in image to generate target image.
Take the photograph before content in described target image mainly comprises image personage's content and after take the photograph the background content of image, to meet user's actual need.
Fig. 4 is the flow chart based on the image combining method of forward and backward camera in first embodiment of the invention, and described method can be realized by image synthesis system 100 as shown in Figure 2, and described method comprises:
Step S401, take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image.
Step S402, by take the photograph before multiframe image processing and tracking unit become one new before take the photograph image.
The present invention considers that the ultimate resolution due to front camera is generally less than the ultimate resolution of rear camera, the resolution of such as front camera is 5M, after the rate respectively taken the photograph be 13M, when differences in resolution is larger, the ratio that the image images themselves that front camera exports accounts in whole picture is just little, user seems to feel not nature, if and directly amplify, because definition pixel point is few, seem after amplification that the image quality that front camera provides is coarse, there is hazy sensations, put together still inharmonious with the image of rear camera, thus adopt here and the image of front camera is processed, it is made to possess higher pixel and resolution, main method is that before adopting, camera multiple image data merge the front camera image obtaining a larger pixel, make image quality and rear camera coupling as far as possible.
In addition, system of the present invention and user can also carry out adjustment process to the visual angle front taken the photograph, size, ratio, color, photosensitivity, time for exposure and/or acutance etc. by automatic or manual, and can carry out cutting, obtain more naturally satisfied effect with this.
Be more preferably, the present invention takes the photograph the background content of image after can also identifying and process, and avoids occurring the problems such as mistake, phenomenon as inharmonious in tone when merging image.
Step S403, identifies from taking the photograph image before new and extracts character image region.
Step S404, first image parameter in the character image region of extraction is carried out adjustment process, make the first image parameter after adjusting process close to after take the photograph the second image parameter of image, namely the difference of the first image parameter and the second image parameter or ratio are less than predetermined threshold value.。
This step can make the first image parameter after adjusting process close to after take the photograph the second image parameter of image, make the character image region after adjusting process closer to the image quality taking the photograph image after described.Described first image parameter and the second image parameter comprise resolution, visual angle, size, ratio, color, photosensitivity, time for exposure and/or acutance etc.
Preferably, this step comprises further:
Obtain the entirety in described character image region the first image parameter and described after take the photograph the second image parameter of the entirety of image;
Judge described after take the photograph described second image parameter of the entirety of image, and whether the first ratio between described first image parameter of the entirety in described character image region or the first difference are greater than predetermined first threshold;
If described first ratio between the two or described first difference are greater than described first threshold, then described first image parameter of the entirety in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjustment or described first difference; And/or
Obtain the marginal portion in described character image region the first image parameter and described after take the photograph the second image parameter of frame portion corresponding with the marginal portion in described character image region in image;
Judge described after take the photograph described second image parameter of frame portion corresponding with the marginal portion in described character image region in image, and whether the second ratio between described first image parameter of the described marginal portion in described character image region or the second difference are greater than predetermined Second Threshold;
If described second ratio between the two or described second difference are greater than described Second Threshold, then described first image parameter of the described marginal portion in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference.
Step S405, determine character image region after take the photograph binding site in image.
Preferably, system is according to the binding site taken the photograph after image recognition technology automatic analysis in image.Or user can according to the actual requirements, by touch command manually after take the photograph in image the binding site selecting image.
Step S406, by character image region synthesis to after take the photograph image binding site sentence generation target image.
Forward and backward camera image synthesis simple relative to prior art, the present invention can extract effective people information in the image of the past camera, and can the background that shows at rear camera of drag and drop Anywhere, or the optimal placed location of personage when native system detects synthesis automatically, and merging image color, brightness is automatically adjusted when synthesizing, make to seem more natural and tripping.
Fig. 5 is the method flow diagram carrying out adjusting process in second embodiment of the invention to character image region, and described method can be realized by image synthesis system 100 as shown in Figure 2, and described method comprises:
Step S501, takes the photograph the second brightness Y of the entirety of image after judgement rearwith the first brightness Y of the entirety in character image region frontbetween ratio whether be greater than predetermined threshold alpha, if then directly perform step S502, otherwise perform step S503.
Step S502, if the second brightness Y rearwith the first brightness Y frontbetween ratio be greater than threshold alpha, then by the first image parameter Y in character image region frontcarry out adjustment process, and turn back to step S501.
Step S503, takes the photograph the second brightness Y of frame portion corresponding with the marginal portion in character image region in image after judgement rear_boundary, with the first brightness Y of the marginal portion in character image region front_boundarybetween ratio whether be greater than predetermined threshold value beta, then process ends if not, otherwise perform step S504.
Step S504, if the second brightness Y rear_boundarywith the first brightness Y front_boundarybetween ratio be greater than predetermined threshold value beta, then by the first brightness Y of the marginal portion in character image region front_boundarycarry out adjustment process, and turn back to step S503.
Before image processing and tracking unit, consider that the brightness due to forward and backward camera probably there are differences, often there is a side (camera) easily backlight such as outdoor, the opposing party's frontlighting, such luminance difference is larger, poor effect after image processing and tracking unit, thus before synthesis, needs to carry out adjustment process to the brightness of front taking the photograph image.After as above flow process, coupling as far as possible in the image brightness of synthesis.
In addition, because scene may be inconsistent, need to carry out some fine adjustments to the color of image, avoid the color of merging place abnormal, simultaneously, the edge of camera image carries out a series of mixing operation, comprises and optimizes edge brightness, acutance etc., make effect more natural.Also can retain the relevant information of forward and backward camera, such as resolution, photosensitivity, the information such as time for exposure simultaneously, be convenient to carry out follow-up editor and adjustment.
In sum, the invention provides the forward and backward technical scheme taken the photograph image and synthesize that the forward and backward camera of terminal equipment is obtained, and consider that front camera is mainly used in shooting personage content, then camera is mainly used in shooting background content, therefore take the photograph in image in the past identify and extract the character image region comprising personage's content, namely eliminate the background environment of surrounding, then by described character image region synthesis to after take the photograph in the background content of image to generate target image.Whereby, the present invention can based on the Images uniting hardware foundation of existing terminal equipment realizing forward and backward camera, and the content of composograph more accurately and meet user's request, thus improve interest and the Consumer's Experience of shooting operation, more saves cost simultaneously.Be more preferably, the present invention is before Images uniting, also the image parameter in character image region can be carried out adjustment process, make the character image region after adjusting process closer to the image quality taking the photograph image after described, so that the image of forward and backward camera more natural fusion together, promotes the quality of composograph.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art are when making various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection range that all should belong to the claim appended by the present invention.

Claims (10)

1. based on an image combining method for forward and backward camera, it is characterized in that, comprising:
Take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image;
Identify from taking the photograph image before described and extract character image region;
Described character image region synthesis is taken the photograph in image to generate target image after described.
2. image combining method according to claim 1, is characterized in that, is describedly comprised to taking the photograph in image after described with the step generating target image by character image region synthesis:
Determine that the binding site in image is taken the photograph in described character image region in the rear;
Described character image region synthesis is sentenced to the described binding site taking the photograph image after described and generates described target image.
3. image combining method according to claim 1 and 2, is characterized in that, described by character image region synthesis to taking the photograph after described in image also to comprise before the step generating target image:
Obtain the entirety in described character image region the first image parameter and described after take the photograph the second image parameter of the entirety of image;
Judge described after take the photograph described second image parameter of the entirety of image, and whether the first ratio between described first image parameter of the entirety in described character image region or the first difference are greater than predetermined first threshold;
If described first ratio between the two or described first difference are greater than described first threshold, then described first image parameter of the entirety in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjustment or described first difference; And/or
Obtain the marginal portion in described character image region the first image parameter and described after take the photograph the second image parameter of frame portion corresponding with the marginal portion in described character image region in image;
Judge described after take the photograph described second image parameter of frame portion corresponding with the marginal portion in described character image region in image, and whether the second ratio between described first image parameter of the described marginal portion in described character image region or the second difference are greater than predetermined Second Threshold;
If described second ratio between the two or described second difference are greater than described Second Threshold, then described first image parameter of the described marginal portion in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference.
4. image combining method according to claim 3, is characterized in that, described first image parameter and described second image parameter comprise resolution, visual angle, size, ratio, color, photosensitivity, time for exposure and/or acutance.
5. image combining method according to claim 1 and 2, is characterized in that, described obtain respectively by forward and backward camera before take the photograph image and after take the photograph the step of image after also comprise:
By take the photograph before described in multiframe image processing and tracking unit become one new before take the photograph image;
Described the past takes the photograph in image and to identify and the step extracting character image region comprises:
From described new before take the photograph image and identify and extract described character image region.
6. based on an image synthesis system for forward and backward camera, it is characterized in that, comprising:
Image collection module, for take the photograph before obtaining respectively by forward and backward camera image and after take the photograph image;
Person extraction module, for identifying from taking the photograph in image before described and extract character image region;
Image synthesis unit, for taking the photograph described character image region synthesis in image to generate target image after described.
7. image synthesis system according to claim 6, is characterized in that, described image synthesis unit comprises:
Submodule is determined in position, for determining that the binding site in image is taken the photograph in described character image region in the rear;
Images uniting submodule, generates described target image for being sentenced to the described binding site taking the photograph image after described by described character image region synthesis.
8. the image synthesis system according to claim 6 or 7, is characterized in that, described image synthesis system also comprises adjustment processing module, and described adjustment processing module comprises further:
First obtains submodule, for obtain the entirety in described character image region the first image parameter and described after take the photograph the second image parameter of the entirety of image;
First judges submodule, for judge described after take the photograph described second image parameter of the entirety of image, and whether the first ratio between described first image parameter of the entirety in described character image region or the first difference are greater than predetermined first threshold;
First adjustment submodule, if when being greater than described first threshold for described first ratio between the two or described first difference, described first image parameter of the entirety in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference; And/or
Second obtains submodule, for obtain the marginal portion in described character image region the first image parameter and described after take the photograph the second image parameter of frame portion corresponding with the marginal portion in described character image region in image;
Second judges submodule, for judge described after take the photograph described second image parameter of frame portion corresponding with the marginal portion in described character image region in image, and whether the second ratio between described first image parameter of the described marginal portion in described character image region or the second difference are greater than predetermined Second Threshold;
Second adjustment submodule, if when being greater than described Second Threshold for described second ratio between the two or described second difference, then described first image parameter of the described marginal portion in described character image region is carried out adjustment process, be less than described first threshold to make described first ratio after adjusting or described first difference.
9. image synthesis system according to claim 8, is characterized in that, described first image parameter and described second image parameter comprise resolution, visual angle, size, ratio, color, photosensitivity, time for exposure and/or acutance.
10. the image synthesis system according to claim 6 or 7, is characterized in that, described image synthesis system also comprises:
Before take the photograph image processing module, for take the photograph image before acquisition is described after, by take the photograph before described in multiframe image processing and tracking unit become one new before take the photograph image;
Described person extraction module, for from described new before take the photograph in image and identify and extract described character image region.
CN201510013038.7A 2015-01-09 2015-01-09 Image combining method based on forward and backward camera and system Expired - Fee Related CN104580910B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510013038.7A CN104580910B (en) 2015-01-09 2015-01-09 Image combining method based on forward and backward camera and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510013038.7A CN104580910B (en) 2015-01-09 2015-01-09 Image combining method based on forward and backward camera and system

Publications (2)

Publication Number Publication Date
CN104580910A true CN104580910A (en) 2015-04-29
CN104580910B CN104580910B (en) 2018-07-24

Family

ID=53096008

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510013038.7A Expired - Fee Related CN104580910B (en) 2015-01-09 2015-01-09 Image combining method based on forward and backward camera and system

Country Status (1)

Country Link
CN (1) CN104580910B (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105227837A (en) * 2015-09-24 2016-01-06 努比亚技术有限公司 A kind of image combining method and device
CN105578028A (en) * 2015-07-28 2016-05-11 宇龙计算机通信科技(深圳)有限公司 Photographing method and terminal
CN105611146A (en) * 2015-09-30 2016-05-25 宇龙计算机通信科技(深圳)有限公司 Imaging method based on double cameras and apparatus thereof
CN105635557A (en) * 2015-04-30 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Image processing method and system based on two rear cameras, and terminal
CN105957045A (en) * 2016-04-29 2016-09-21 珠海市魅族科技有限公司 Picture synthesis method and device
CN106101525A (en) * 2016-05-31 2016-11-09 北京奇虎科技有限公司 Application call dual camera carries out the method and device shot
CN106303229A (en) * 2016-08-04 2017-01-04 努比亚技术有限公司 A kind of photographic method and device
CN106375662A (en) * 2016-09-22 2017-02-01 宇龙计算机通信科技(深圳)有限公司 Photographing method and device based on double cameras, and mobile terminal
CN106454288A (en) * 2016-11-29 2017-02-22 广东欧珀移动通信有限公司 Control method, control device, imaging device and electronic device
CN106534689A (en) * 2016-11-22 2017-03-22 珠海格力电器股份有限公司 Multiple cameras-based image synthesis method and apparatus
CN106709882A (en) * 2016-12-16 2017-05-24 努比亚技术有限公司 Image fusion method and device
CN106851098A (en) * 2017-01-20 2017-06-13 努比亚技术有限公司 A kind of image processing method and mobile terminal
CN106878606A (en) * 2015-12-10 2017-06-20 北京奇虎科技有限公司 A kind of image generating method and electronic equipment based on electronic equipment
CN107231524A (en) * 2017-05-31 2017-10-03 珠海市魅族科技有限公司 Image pickup method and device, computer installation and computer-readable recording medium
CN107566761A (en) * 2017-09-30 2018-01-09 联想(北京)有限公司 A kind of image processing method and electronic equipment
EP3327666A1 (en) * 2016-11-29 2018-05-30 Guangdong OPPO Mobile Telecommunications Corp., Ltd. Control method and electronic apparatus
CN108174082A (en) * 2017-11-30 2018-06-15 维沃移动通信有限公司 The method and mobile terminal of a kind of image taking
CN109040597A (en) * 2018-08-28 2018-12-18 Oppo广东移动通信有限公司 A kind of image processing method based on multi-cam, mobile terminal and storage medium
CN109040596A (en) * 2018-08-27 2018-12-18 Oppo广东移动通信有限公司 A kind of method, mobile terminal and storage medium adjusting camera
CN109089045A (en) * 2018-09-18 2018-12-25 上海连尚网络科技有限公司 A kind of image capture method and equipment and its terminal based on multiple photographic devices
US10382709B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
US10382675B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device including a simulation true-color image
US10432905B2 (en) 2016-11-29 2019-10-01 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and apparatus for obtaining high resolution image, and electronic device for same
CN111083371A (en) * 2019-12-27 2020-04-28 维沃移动通信有限公司 Shooting method and electronic equipment
CN111200686A (en) * 2018-11-19 2020-05-26 中兴通讯股份有限公司 Photographed image synthesizing method, terminal, and computer-readable storage medium
CN111277770A (en) * 2020-01-21 2020-06-12 中国航空无线电电子研究所 Generalized airborne video processing system based on FPGA
CN112887609A (en) * 2021-01-27 2021-06-01 维沃移动通信有限公司 Shooting method, shooting device, electronic equipment and storage medium
CN113160365A (en) * 2021-02-04 2021-07-23 脸萌有限公司 Image processing method, device, equipment and computer readable storage medium
WO2023016214A1 (en) * 2021-08-12 2023-02-16 惠州Tcl云创科技有限公司 Video processing method and apparatus, and mobile terminal
CN116309918A (en) * 2023-03-31 2023-06-23 深圳市欧度利方科技有限公司 Scene synthesis method and system based on tablet personal computer

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101052100A (en) * 2007-03-29 2007-10-10 上海交通大学 Multiple exposure image intensifying method
CN102055834A (en) * 2009-10-30 2011-05-11 Tcl集团股份有限公司 Double-camera photographing method of mobile terminal
CN103647923A (en) * 2013-12-06 2014-03-19 广东欧珀移动通信有限公司 Image displaying method in video calling
CN103856617A (en) * 2012-12-03 2014-06-11 联想(北京)有限公司 Photographing method and user terminal
CN103916582A (en) * 2013-01-07 2014-07-09 华为技术有限公司 Image processing method and device
EP2770729A2 (en) * 2013-02-23 2014-08-27 Samsung Electronics Co., Ltd. Apparatus and method for synthesizing an image in a portable terminal equipped with a dual camera

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101052100A (en) * 2007-03-29 2007-10-10 上海交通大学 Multiple exposure image intensifying method
CN102055834A (en) * 2009-10-30 2011-05-11 Tcl集团股份有限公司 Double-camera photographing method of mobile terminal
CN103856617A (en) * 2012-12-03 2014-06-11 联想(北京)有限公司 Photographing method and user terminal
CN103916582A (en) * 2013-01-07 2014-07-09 华为技术有限公司 Image processing method and device
EP2770729A2 (en) * 2013-02-23 2014-08-27 Samsung Electronics Co., Ltd. Apparatus and method for synthesizing an image in a portable terminal equipped with a dual camera
CN103647923A (en) * 2013-12-06 2014-03-19 广东欧珀移动通信有限公司 Image displaying method in video calling

Cited By (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105635557A (en) * 2015-04-30 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Image processing method and system based on two rear cameras, and terminal
CN105635557B (en) * 2015-04-30 2018-10-26 宇龙计算机通信科技(深圳)有限公司 Image processing method and system based on double rear cameras, terminal
WO2017016069A1 (en) * 2015-07-28 2017-02-02 宇龙计算机通信科技(深圳)有限公司 Photographing method and terminal
CN105578028A (en) * 2015-07-28 2016-05-11 宇龙计算机通信科技(深圳)有限公司 Photographing method and terminal
CN105227837A (en) * 2015-09-24 2016-01-06 努比亚技术有限公司 A kind of image combining method and device
CN105611146A (en) * 2015-09-30 2016-05-25 宇龙计算机通信科技(深圳)有限公司 Imaging method based on double cameras and apparatus thereof
CN106878606B (en) * 2015-12-10 2021-06-18 北京奇虎科技有限公司 Image generation method based on electronic equipment and electronic equipment
CN106878606A (en) * 2015-12-10 2017-06-20 北京奇虎科技有限公司 A kind of image generating method and electronic equipment based on electronic equipment
CN105957045A (en) * 2016-04-29 2016-09-21 珠海市魅族科技有限公司 Picture synthesis method and device
CN106101525A (en) * 2016-05-31 2016-11-09 北京奇虎科技有限公司 Application call dual camera carries out the method and device shot
CN106303229A (en) * 2016-08-04 2017-01-04 努比亚技术有限公司 A kind of photographic method and device
WO2018053906A1 (en) * 2016-09-22 2018-03-29 宇龙计算机通信科技(深圳)有限公司 Dual camera-based shooting method and device, and mobile terminal
CN106375662A (en) * 2016-09-22 2017-02-01 宇龙计算机通信科技(深圳)有限公司 Photographing method and device based on double cameras, and mobile terminal
CN106375662B (en) * 2016-09-22 2019-04-12 宇龙计算机通信科技(深圳)有限公司 A kind of image pickup method based on dual camera, device and mobile terminal
CN106534689A (en) * 2016-11-22 2017-03-22 珠海格力电器股份有限公司 Multiple cameras-based image synthesis method and apparatus
US10290079B2 (en) 2016-11-29 2019-05-14 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
US10262395B2 (en) 2016-11-29 2019-04-16 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
US10382675B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device including a simulation true-color image
EP3327666A1 (en) * 2016-11-29 2018-05-30 Guangdong OPPO Mobile Telecommunications Corp., Ltd. Control method and electronic apparatus
EP3327663A1 (en) * 2016-11-29 2018-05-30 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
CN106454288B (en) * 2016-11-29 2018-01-19 广东欧珀移动通信有限公司 Control method, control device, imaging device and electronic installation
US10382709B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
CN106454288A (en) * 2016-11-29 2017-02-22 广东欧珀移动通信有限公司 Control method, control device, imaging device and electronic device
US10277803B2 (en) 2016-11-29 2019-04-30 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method and electronic apparatus
US10469736B2 (en) 2016-11-29 2019-11-05 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method and electronic apparatus
US10432905B2 (en) 2016-11-29 2019-10-01 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and apparatus for obtaining high resolution image, and electronic device for same
CN106709882A (en) * 2016-12-16 2017-05-24 努比亚技术有限公司 Image fusion method and device
CN106851098A (en) * 2017-01-20 2017-06-13 努比亚技术有限公司 A kind of image processing method and mobile terminal
CN107231524A (en) * 2017-05-31 2017-10-03 珠海市魅族科技有限公司 Image pickup method and device, computer installation and computer-readable recording medium
CN107566761B (en) * 2017-09-30 2020-08-25 联想(北京)有限公司 Image processing method and electronic equipment
CN107566761A (en) * 2017-09-30 2018-01-09 联想(北京)有限公司 A kind of image processing method and electronic equipment
CN108174082A (en) * 2017-11-30 2018-06-15 维沃移动通信有限公司 The method and mobile terminal of a kind of image taking
CN108174082B (en) * 2017-11-30 2020-07-28 维沃移动通信有限公司 Image shooting method and mobile terminal
CN109040596B (en) * 2018-08-27 2020-08-28 Oppo广东移动通信有限公司 Method for adjusting camera, mobile terminal and storage medium
CN109040596A (en) * 2018-08-27 2018-12-18 Oppo广东移动通信有限公司 A kind of method, mobile terminal and storage medium adjusting camera
CN109040597A (en) * 2018-08-28 2018-12-18 Oppo广东移动通信有限公司 A kind of image processing method based on multi-cam, mobile terminal and storage medium
CN109040597B (en) * 2018-08-28 2021-02-23 Oppo广东移动通信有限公司 Image processing method based on multiple cameras, mobile terminal and storage medium
CN109089045A (en) * 2018-09-18 2018-12-25 上海连尚网络科技有限公司 A kind of image capture method and equipment and its terminal based on multiple photographic devices
CN111200686A (en) * 2018-11-19 2020-05-26 中兴通讯股份有限公司 Photographed image synthesizing method, terminal, and computer-readable storage medium
CN111083371A (en) * 2019-12-27 2020-04-28 维沃移动通信有限公司 Shooting method and electronic equipment
CN111277770A (en) * 2020-01-21 2020-06-12 中国航空无线电电子研究所 Generalized airborne video processing system based on FPGA
CN112887609A (en) * 2021-01-27 2021-06-01 维沃移动通信有限公司 Shooting method, shooting device, electronic equipment and storage medium
CN113160365A (en) * 2021-02-04 2021-07-23 脸萌有限公司 Image processing method, device, equipment and computer readable storage medium
WO2023016214A1 (en) * 2021-08-12 2023-02-16 惠州Tcl云创科技有限公司 Video processing method and apparatus, and mobile terminal
CN116309918A (en) * 2023-03-31 2023-06-23 深圳市欧度利方科技有限公司 Scene synthesis method and system based on tablet personal computer
CN116309918B (en) * 2023-03-31 2023-12-22 深圳市欧度利方科技有限公司 Scene synthesis method and system based on tablet personal computer

Also Published As

Publication number Publication date
CN104580910B (en) 2018-07-24

Similar Documents

Publication Publication Date Title
CN104580910A (en) Image synthesis method and system based on front camera and rear camera
EP3346329B1 (en) Image processing method and apparatus
CN101998053B (en) Image processing method, image processing apparatus, and imaging apparatus
CN106131441B (en) Photographing method and device and electronic equipment
CN103856617A (en) Photographing method and user terminal
EP1800471A1 (en) Method and apparatus for processing document image captured by camera
CN105657272A (en) Terminal equipment and photographing method thereof
CN105578028A (en) Photographing method and terminal
US11297230B2 (en) Shooting method, device and computer-readable storage medium
CN109218609B (en) Image composition method and device
JP2023513726A (en) Image processing method, device, electronic device and recording medium
CN106791390B (en) Wide-angle self-timer real-time preview method and user terminal
CN113329172B (en) Shooting method and device and electronic equipment
CN112929557A (en) Shooting method, device, terminal and storage medium
CN111787224B (en) Image acquisition method, terminal device and computer-readable storage medium
CN113810590A (en) Image processing method, electronic device, medium, and system
CN111083371A (en) Shooting method and electronic equipment
CN106373139A (en) Image processing method and device
CN110868540B (en) Terminal mirror photographing method, terminal and computer readable storage medium
CN111724470A (en) Processing method and electronic equipment
CN112839166B (en) Shooting method and device and electronic equipment
CN108282622B (en) Photo shooting method and device
CN111200686A (en) Photographed image synthesizing method, terminal, and computer-readable storage medium
CN114071010A (en) Shooting method and equipment
CN114143471B (en) Image processing method, system, mobile terminal and computer readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180724

Termination date: 20220109