WO2016165488A1

WO2016165488A1 - Photo processing method and device

Info

Publication number: WO2016165488A1
Application number: PCT/CN2016/074340
Authority: WO
Inventors: 张晓亮; 杨毅
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-09-18
Filing date: 2016-02-23
Publication date: 2016-10-20
Also published as: CN106550184B; CN106550184A

Abstract

Disclosed are a photo processing method and device, said method comprising: photographing scene objects at different positions within the viewfinding range by means of a primary camera and a secondary camera, wherein the primary camera is used for taking a number N of photographs of the scene objects at different positions, and the secondary camera is used for obtaining depth of field information of the photographs within the viewfinding range, N being greater than or equal to 2; determining from the N photographs, according to a selected focal point, a photograph corresponding to said focal point; performing synthesis processing on the photograph by means of the photograph corresponding to the focal point as well as said depth of field information; thus the problem in the related art of deficiencies in photograph processing is solved, and a photograph may be synthesized according to a focal point determined by a user, improving user experience.

Description

Photo processing method and device

Technical field

The present invention relates to the field of communications, and in particular to a photo processing method and apparatus.

Background technique

There are more and more dual camera phones. At present, there are two application scenarios for the dual camera phone. One is the same camera with two cameras, which can be combined to take a higher number of pixels, and the other is two different pixels. The camera, one of which is the main camera, one is the sub camera, the main camera is used to take photos, the sub camera is used to record the depth of field, and the photo can be refocused after taking the picture. These two methods, one enhances the delicateness of the photo, and one increases the fun of taking pictures.

In the process of taking pictures, when we focus on the bright sky, the details of the clouds in the sky can be better shot, but the image quality of other surrounding environments will be darker. If we focus on the darker places around, in the sky. The details of the cloud are not captured, which is due to the automatic adjustment of the imaging algorithm.

In the prior art, when the dual camera phone is photographed, the main camera only takes one photo, and the sub camera records the depth of field, so after the shooting is completed, the photo can be refocused according to the depth information. Since the main camera only takes one photo, when the photo is refocused according to the depth of field information after the shooting is completed, the reselected focus cannot be displayed to the best state, so the desired one cannot be obtained according to the user's wishes. The photos, that is, the photos obtained are not ideal, such as bright areas may be overexposed, or dark areas are underexposed, and the ability to display details is poor.

In view of the problem that the photo processing in the related art is defective, an effective solution has not been proposed.

Summary of the invention

The embodiment of the invention provides a photo processing method and device, so as to at least solve the problem that the photo processing in the related art is defective.

According to an aspect of an embodiment of the present invention, a photo processing method includes: photographing a scene at different positions in a framing range by a main camera and a sub camera, wherein the main camera is used to photograph the different positions. N photos of the scene, the sub camera is used to obtain depth information of the photo in the framing range, wherein N is greater than or equal to 2; determining a photo corresponding to the focus from the N photos according to the selected focus; The corresponding photo and the depth of field information are combined to process the photo.

Further, photographing the scenes at different positions in the framing range by the main camera and the sub camera includes: focusing, by the main camera, the scenes at different positions in the framing range, and adjusting the aperture to take N photos, wherein The N photos are a group of photos having the same feature; the photo is taken by the sub camera, and the depth information of the photo is obtained according to the degree of clarity of the scene in the photo taken by the sub camera.

Further, focusing on the scene at different positions in the framing range by the main camera, and adjusting the aperture Taking N photos includes automatically adjusting the aperture size according to the brightness information around the focus position or adjusting the brightness of the picture area by a predetermined algorithm to take N pictures.

Further, synthesizing the photo by the photo corresponding to the focus and the depth of field information comprises: using a photo corresponding to the focus as a negative film, and taking a photo taken by the sub camera as a top film, and overlaying the upper film on the photo On the negative film, the focus of the upper part is buckled, and the image belonging to different depth of field information around the focus is blurred.

Further, after the photo is synthesized by the photo corresponding to the focus and the depth information, the method further includes: displaying the synthesized photo.

According to another aspect of the present invention, a photo processing apparatus is further provided, including: a photographing module configured to photograph a scene at different positions in a framing range by using a main camera and a sub camera, wherein the main camera is used Taking N photos of the scenes at the different positions, the sub-camera is used to obtain depth information of the photos in the framing range, wherein N is greater than or equal to 2; the determining module is set to be from the N sheets according to the selected focus The photo corresponding to the focus is determined in the photo; the synthesis processing module is configured to synthesize the photo by the photo corresponding to the focus and the depth information.

Further, the photographing module includes: a focusing unit configured to focus on a scene at different positions in the framing range by the main camera, and adjust an aperture to take N photos, wherein the N photos have the same a set of photos of the feature; an obtaining unit configured to take a photo by the sub camera, and obtain depth information of the photo according to a degree of clarity of the scene in the photo taken by the sub camera.

Further, the focusing unit includes: a focus shooting subunit configured to automatically adjust the aperture size according to the brightness information around the focus position or adjust the brightness of the photographed picture area to capture N photos by using a predetermined algorithm.

Further, the compositing processing module includes: a compositing processing unit configured to set a photo corresponding to the focus as a negative film, a photo taken by the sub camera as a top film, and a top film over the negative film, At the focus of the slice, a map is drawn, and the images belonging to different depth information positions around the focus are blurred and blurred.

Further, the device further includes: a display module configured to display the synthesized photo.

According to the embodiment of the present invention, the scenes at different positions in the framing range are photographed by the main camera and the sub-camera, wherein the main camera is used to take N photos of the scenes at the different positions, and the sub-camera is used for Obtaining depth information of a photo in the framing range, wherein N is greater than or equal to 2; determining a photo corresponding to the focus from the N photos according to the selected focus; synthesizing the photo by the photo corresponding to the focus and the depth information The problem solves the problem that the photo processing in the related art is defective, and the photo can be synthesized according to the focus determined by the user, thereby improving the user experience.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flow chart of a photo processing method according to an embodiment of the present invention;

2 is a block diagram of a photo processing apparatus according to an embodiment of the present invention;

Figure 3 is a block diagram 1 of a photo processing apparatus in accordance with a preferred embodiment of the present invention;

4 is a block diagram 2 of a photo processing apparatus in accordance with a preferred embodiment of the present invention;

Figure 5 is a block diagram 3 of a photo processing apparatus in accordance with a preferred embodiment of the present invention;

Figure 6 is a block diagram 4 of a photo processing apparatus in accordance with a preferred embodiment of the present invention;

7 is a flowchart of a method for realizing first focusing and then focusing using a dual camera according to an embodiment of the present invention;

8 is a schematic diagram of photographs taken at different distances from a camera according to an embodiment of the present invention;

9 is a schematic diagram of photo composition in accordance with an embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

An embodiment of the present invention provides a photo processing method. FIG. 1 is a flowchart of a photo processing method according to an embodiment of the present invention. As shown in FIG.

Step S102, taking a picture of a scene at different positions in the framing range by using the main camera and the sub-camera, wherein the main camera is used to capture N photos of the scene at the different positions, and the sub-camera is used to obtain the depth of field of the photo in the framing range. Information, where N is greater than or equal to 2;

Step S104, determining a photo corresponding to the focus from the N photos according to the selected focus;

Step S106, synthesizing the photo by the photo corresponding to the focus and the depth information.

Through the above steps, the main camera and the sub camera are used to take photos of different positions in the framing range, wherein the main camera is used to take N photos of the scenes at different positions, and the sub camera is used to obtain photos in the framing range. Depth of field information, wherein N is greater than or equal to 2; determining a photo corresponding to the focus from the N photos according to the selected focus; synthesizing the photo by the photo corresponding to the focus and the depth information, and solving the photo processing in the related art There is a problem of defects, and the photos can be synthesized according to the focus determined by the user, thereby improving the user experience.

Further, the photographing of the scenes at different positions in the framing range by the main camera and the sub-camera may include: focusing the scenes at different positions in the framing range by the main camera, and adjusting the aperture to take N photos, wherein the The N photos are a group of photos having the same feature; the photo is taken by the sub camera, and the depth information of the photo is obtained according to the clarity of the scene in the photo taken by the sub camera.

Further, focusing the scene at different positions in the framing range by the main camera, and adjusting the aperture to take N photos may include automatically adjusting the aperture size according to the brightness information around the focus position or adjusting the brightness of the photographed picture area by using a predetermined algorithm. N photos.

Further, the synthesizing the photo by the photo corresponding to the focus and the depth of field information may include: taking a photo corresponding to the focus as a negative film, using a photo taken by the sub camera as a top film, and overlaying the upper film on the negative film, The image of the focus of the upper part is buckled, and the image belonging to different depth information positions around the focus is blurred.

Further, after the photo is synthesized by the photo corresponding to the focus and the depth information, the synthesized photo is displayed.

The embodiment of the present invention further provides a photo processing apparatus. FIG. 2 is a block diagram of a photo processing apparatus according to an embodiment of the present invention. As shown in FIG. 2, the photographing module 22, the determining module 24, and the synthesizing processing module 26 are provided. Briefly describe each module.

The photographing module 22 is configured to photograph the scenes at different positions in the framing range by the main camera and the sub-camera, wherein the main camera is used to take N photos of the scenes at different positions, and the sub-camera is used to obtain the framing range The depth of field information of the photo, where N is greater than or equal to 2;

a determining module 24, configured to determine a photo corresponding to the focus from the N photos according to the selected focus;

The composition processing module 26 is configured to synthesize the photo by the photo corresponding to the focus and the depth information.

3 is a block diagram of a photo processing apparatus according to a preferred embodiment of the present invention. As shown in FIG. 3, the photographing module 22 includes:

The focusing unit 32 is configured to focus the scenes at different positions in the framing range by the main camera, and adjust the aperture to take N photos, wherein the N photos are a group of photos having the same feature;

The obtaining unit 34 is configured to take a photo by the sub camera, and obtain depth information of the photo according to the degree of clarity of the scene in the photo taken by the sub camera.

4 is a block diagram 2 of a photo processing apparatus according to a preferred embodiment of the present invention. As shown in FIG. 4, the focusing unit 32 includes:

The focus shooting sub-unit 42 is configured to automatically adjust the aperture size according to the brightness information around the focus position or to adjust the brightness of the photographed picture area by a predetermined algorithm to take N pictures.

FIG. 5 is a block diagram 3 of a photo processing apparatus according to a preferred embodiment of the present invention. As shown in FIG. 5, the synthesizing processing module 26 includes:

The compositing processing unit 52 is configured to set a photo corresponding to the focus as a negative film, and the photo taken by the sub camera is used as a top film, and the upper film is overlaid on the negative film, and the focus of the upper film is buckled, and the focus is surrounded by Images of different depth of field information positions are blurred and blurred.

FIG. 6 is a block diagram 4 of a photo processing apparatus according to a preferred embodiment of the present invention. As shown in FIG. 6, the apparatus further includes:

The display module 62 is arranged to display the synthesized photo.

It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing modules may be implemented by, but not limited to, the foregoing modules are located in different processors in any combination, for example, each of the foregoing. Modules are all located in the same processor; or each of the above modules is located in a different processor.

The embodiments of the present invention are further described below in conjunction with specific embodiments.

The embodiment of the invention provides a device for realizing first focusing and then focusing by using a dual camera, and realizing different aperture size automatic adjustment according to different focus positions. The device may include a dual camera, including a main camera and a sub camera, a main camera camera module, a sub camera depth calculation module, a focus image selection module, a photo display synthesis module, a display module, etc., and the functions of the modules are performed by the camera module described above. 22. The determination module 24 and the synthesis processing module 26 are implemented together, and each module is further described below.

The main camera is used for taking photos, the main camera captures pixels with high pixels, and can automatically focus, the processor automatically adjusts the aperture size according to the brightness information around the focus position or uses an algorithm to adjust the brightness of the photographed picture area;

The sub camera is used to calculate the depth of field. The sub camera is not high in shooting pixels, the shooting speed is fast, and auto focus is not available. It can quickly calculate the depth of field of different scenes.

The main camera camera module divides the shooting area into different sub-areas. For example, the shooting scene is displayed on the display screen, and the display area is divided into five areas, including upper left, upper right, lower left, lower right, and middle. In five areas, after autofocusing and adjusting the aperture of the scene in the sub-area, multiple photos are taken, and the photographed photos are saved as an associated set of pictures in the storage area of the terminal device.

a sub camera depth calculation module calculates depth field data of different scenes taken, and stores the photographed photos and the calculated depth of field data in a storage area of the terminal device;

The focus image selection module, after the user selects to refocus an area of a certain photo, the photo taken after the auto focus and the aperture is adjusted in a group of photos taken by the main camera;

The photo display synthesizing module, the photo selected by the above-mentioned focus image selection module taken by the main camera is a negative film, the photo taken by the sub camera is a top film, the buckle image at the focus of the upper film is transparent, and the image around the focus is at a different depth of field position. Do blurring and blurring, the farther away from the focus of the scene, the higher the degree of blurring;

The display module displays the image displayed by the photo display synthesis module and is displayed on the display.

The embodiment of the present invention further provides a method for realizing first focusing and then focusing by using a dual camera. FIG. 7 is a flowchart of a method for realizing first focusing and then focusing by using a dual camera according to an embodiment of the present invention, as shown in FIG. :

Step S702, the main camera and the sub camera start shooting, and the main camera automatically focuses on the scenes at different positions and adjusts the aperture to take a picture, and takes multiple photos to form a group of photos having the same characteristics, and the photos automatically generate a group of related photos. By the number identification of each photo, such as 20180520-a, 20180520-b, 20180520-c, 20180520-d, stored in the storage unit; the sub-camera takes a photo, and forms the depth of field data of the scene according to the clarity of the scene in the photo;

Step S704, the user selects to refocus the photographed photo, selects a position to refocus, and the focus image selection module retrieves a photo corresponding to the refocus position;

Step S706, the photo display synthesis module takes the photo captured by the focus image selection module as a negative film, the photo taken by the sub camera is a top film, and the upper film covers the negative film, and the buckle image becomes transparent at the focus of the upper film, and the focus is surrounded by different depth of field. The image of the position is blurred and blurred, and the farther away from the depth of field of the focus scene, the higher the degree of blurring, the more the photo will be The display module is supplied for display.

In the following, the three trees having different distances from the camera are taken as an example for further description. FIG. 8 is a schematic diagram of photographs taken at different distances from the camera according to an embodiment of the present invention. As shown in FIG. 8 , the main cameras are respectively opposite to the center. The three trees were photographed in focus, and three photos were generated. The three photos were generated as follows: focus on the distant tree, the middle and near trees are dotted with dashed lines, and only the distant trees are in focus; The middle tree is in focus, and the distant and near trees are dotted with dashed lines, only the central trees are in focus; the near trees are in focus, and the far and middle trees are dotted with dashed lines, and only the nearby trees are in focus.

FIG. 9 is a schematic diagram of photo composition according to an embodiment of the present invention. As shown in FIG. 9 , the left image is a photograph taken by the main camera, and the right image is the top data generated by the sub camera photographing, and the two images are superimposed, and the main camera photo is taken. For the negative film, the photo data of the sub camera is the upper film, the upper film covers the negative film, the upper film cuts the focus area, and the scene around the blank area is blurred to form image data for focusing the near tree, and the synthesized image is synthesized. The image is displayed on the display.

In the embodiment of the present invention, multiple photos are continuously taken, different photos are selected as the focus of focusing, and a good exposure is automatically obtained by different apertures, or a better brightness is obtained by using an algorithm, and multiple photos taken can be taken. The details of the scenes at multiple focal points are obtained. When the photograph is completed, when the user reselects a certain position in the photo as the focus, the corresponding photo can be called, and then the depth information obtained by the sub camera is used to synthesize the surrounding blurred photos.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

The foregoing embodiments of the present invention can be applied to the field of communications, and solve the problem that the photo processing in the related art is flawed, and can synthesize the photos according to the focus determined by the user, thereby improving the user experience.

Claims

A photo processing method comprising:

Taking a picture of a scene at different positions in the framing range by the main camera and the sub camera, wherein the main camera is used to capture N photos of the scene at the different positions, and the sub camera is used to obtain the depth of field of the photo in the framing range Information, where N is greater than or equal to 2;

Determining a photo corresponding to the focus from the N photos according to the selected focus;

The photo is synthesized by the photo corresponding to the focus and the depth information.
The method according to claim 1, wherein photographing the scenes at different positions in the framing range by the main camera and the sub-camera comprises:

Focusing on the scenes at different positions in the framing range by the main camera, and adjusting the aperture to take N photos, wherein the N photos are a group of photos having the same feature;

The photo is taken by the sub camera, and the depth information of the photo is obtained according to the degree of clarity of the scene in the photo taken by the sub camera.
The method according to claim 2, wherein the focusing of the scenes at different positions in the framing range by the main camera and adjusting the aperture to take N photos comprises:

The aperture size is automatically adjusted according to the brightness information around the focus position or the brightness of the photographed picture area is adjusted by a predetermined algorithm to take N pictures.
The method according to claim 1, wherein the synthesizing the photo by the photo corresponding to the focus and the depth of field information comprises:

Taking a photo corresponding to the focus as a negative film, taking a photo taken by the sub-camera as a top film, covering the upper film on the negative film, and performing a button image on the focus of the upper film, and the information about the depth of field is different. The image is blurred and blurred.
The method according to any one of claims 1 to 4, wherein after the photo is synthesized by the photo corresponding to the focus and the depth of field information, the method further comprises:

The synthesized photo is displayed.
A photo processing device comprising:

The photographing module is configured to photograph the scenes at different positions in the framing range by the main camera and the sub camera, wherein the main camera is used to take N photos of the scenes at the different positions, and the sub camera is used for obtaining a framing Depth of field information of a range of photos, where N is greater than or equal to 2;

a determining module, configured to determine a photo corresponding to the focus from the N photos according to the selected focus;

The synthesis processing module is configured to synthesize the photo by the photo corresponding to the focus and the depth information.
The apparatus according to claim 6, wherein the photographing module comprises:

a focusing unit configured to focus on a scene at different positions in the framing range by the main camera, and adjust an aperture to take N photos, wherein the N photos are a group of photos having the same feature;

The obtaining unit is configured to take a photo by the sub camera, and obtain depth information of the photo according to the degree of clarity of the scene in the photo taken by the sub camera.
The apparatus of claim 7, wherein the focusing unit comprises:

The focus shooting sub-unit is set to automatically adjust the aperture size according to the brightness information around the focus position or to adjust the brightness of the photographed picture area by a predetermined algorithm to take N photos.
The apparatus of claim 6 wherein said synthesis processing module comprises:

a synthesis processing unit configured to use a photo corresponding to the focus as a negative film, a photo taken by the sub-camera as a top film, a top cover on the negative film, and a focus image at a focus of the upper film, and a focus point The images surrounding the information positions of different depths of field are blurred and blurred.
The device according to any one of claims 6 to 9, wherein the device further comprises:

The display module is set to display the synthesized photo.