CN112995500A

CN112995500A - Shooting method, shooting device, electronic equipment and medium

Info

Publication number: CN112995500A
Application number: CN202011603696.9A
Authority: CN
Inventors: 陈喆; 杨其豪
Original assignee: Vivo Mobile Communication Hangzhou Co Ltd
Current assignee: Vivo Mobile Communication Hangzhou Co Ltd
Priority date: 2020-12-30
Filing date: 2020-12-30
Publication date: 2021-06-18
Anticipated expiration: 2040-12-30
Also published as: CN112995500B

Abstract

The application discloses a shooting method, a shooting device, electronic equipment and a shooting medium, and belongs to the technical field of shooting. The shooting method comprises the following steps: receiving a first input of a user to a first object in a first preview image under the condition that a shooting preview interface comprises the first preview image collected by a main camera; in response to the first input, displaying a second preview image in a first area associated with the first object, wherein the second preview image is a preview image of the first object acquired by a first auxiliary camera; respectively controlling the main camera and the first auxiliary camera to take frames to obtain a first image and a second image; and synthesizing the image of the first object in the second image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image. This can simplify the process of capturing an image having a special effect.

Description

Shooting method, shooting device, electronic equipment and medium

Technical Field

The application belongs to the technical field of photography, and particularly relates to a shooting method, a shooting device, electronic equipment and a shooting medium.

Background

With the development of electronic devices, the photographing function becomes a function commonly used by electronic devices. Due to the improvement of the shooting technology and the convenience in carrying of the electronic equipment, in daily life, a user can shoot images anytime and anywhere by utilizing the electronic equipment.

At present, under the condition of shooting images with special effects, the images are generally processed in a post-synthesis mode; however, the processing procedure due to post-synthesis is complicated in operation, and generally requires a professional image processing worker to complete the image synthesis process.

Therefore, in the related art, the problem that the shooting of the image with the special effect is difficult and tedious to operate exists.

Disclosure of Invention

An object of the embodiments of the present application is to provide a shooting method, an apparatus, an electronic device, and a medium, which can solve the problem in the related art that shooting of an image with a special effect is difficult and cumbersome to operate.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a shooting method, including:

receiving a first input of a user to a first object in a first preview image under the condition that a shooting preview interface comprises the first preview image collected by a main camera;

in response to the first input, displaying a second preview image in a first area associated with the first object, wherein the second preview image is a preview image of the first object acquired by a first auxiliary camera;

respectively controlling the main camera and the first auxiliary camera to take frames to obtain a first image and a second image;

and synthesizing the image of the first object in the second image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image.

In a second aspect, an embodiment of the present application provides a shooting apparatus, including:

the device comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving first input of a user on a first object in a first preview image under the condition that a shooting preview interface comprises the first preview image collected by a main camera;

the first display module is used for responding to the first input and displaying a second preview image in a first area associated with the first object, wherein the second preview image is a preview image of the first object acquired by a first auxiliary camera;

the first frame taking module is used for respectively controlling the main camera and the first auxiliary camera to take frames to obtain a first image and a second image;

and the first synthesizing module is used for synthesizing the image of the first object in the second image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, a second preview image of a first object in a first preview image is acquired, that is, a second preview image of the first object with a special effect is acquired, and an image of the first object in the second image is synthesized into the first image based on a first superimposed display effect of the first preview image and the second preview image, so as to obtain a first target image, that is, in the process of shooting the images, the image with the first superimposed display effect can be obtained, and the first target image corresponding to the image with the first superimposed display effect can be output, so that the later image processing is not needed, and the shooting process of the image with the special effect can be simplified.

Drawings

Fig. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 2 is a flowchart of a shooting method provided in an embodiment of the present application;

fig. 3a is one of operation diagrams of a shooting method provided by an embodiment of the present application;

fig. 3b is a second schematic operation diagram of the photographing method according to the embodiment of the present application;

fig. 3c is a third schematic operation diagram of the photographing method according to the embodiment of the present application;

fig. 3d is a fourth schematic operation diagram of the photographing method according to the embodiment of the present application;

fig. 3e is a fifth schematic operation diagram of the photographing method according to the embodiment of the present application;

fig. 3f is a sixth schematic operational diagram of a shooting method according to an embodiment of the present application;

fig. 3g is a seventh schematic operational diagram of a shooting method according to an embodiment of the present disclosure;

fig. 3h is an eighth schematic operation diagram of the photographing method according to the embodiment of the present application;

fig. 3i is a ninth schematic view illustrating an operation of the photographing method according to the embodiment of the present application;

fig. 3j is a tenth of an operation diagram of a photographing method provided in an embodiment of the present application;

FIG. 3k is a schematic diagram of a forward frame grabbing provided by an embodiment of the present application;

FIG. 3l is a schematic diagram of a backward frame grabbing scheme provided in an embodiment of the present application;

fig. 4 is a structural diagram of a shooting device provided in an embodiment of the present application;

FIG. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure;

fig. 6 is a second structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., a first term can be one or more than two, as opposed to at least two. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The shooting method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

For convenience in understanding, the shooting method provided by the embodiment of the application can be applied to electronic equipment, and the electronic equipment can include at least two cameras, and different cameras have different focal length parameters. As shown in fig. 1, the electronic device includes 3 cameras, specifically, a first camera 10, a second camera 20, and a third camera 30.

In one embodiment, the focus segment parameter may be used to represent a corresponding zoom factor for the camera.

For example, the focal length parameter of the first camera 10 may be 0.5 to 1 time, that is, when the first camera 10 is used for shooting, the shot object may be zoomed by 0.5 to 1 time; the focal length parameter of the second camera 20 can be 1-2 times, namely when the second camera 20 is used for shooting, the shot object can be zoomed by 1-2 times; the focal length parameter of the camera 30 III can be 2-10 times, that is, when the camera 30 III is used for shooting, the shot object can be zoomed by 2-10 times.

The shooting method provided by the embodiment of the invention can be applied to shooting scenes of images with special effects, for example, different shooting effects of the same object are shown in the images; or different photographic effects of different objects are shown in the image, etc.

In one embodiment, different shooting effects of the same object are shown in the image, and the image may include both an enlarged image of the target object and a reduced image of the target object, that is, an enlarged image and a thumbnail of the target object are combined in the image.

Referring to fig. 2, fig. 2 is a flowchart of a shooting method according to an embodiment of the present invention, and as shown in fig. 2, the shooting method includes the following steps:

step 201, receiving a first input of a user to a first object in a first preview image under the condition that a shooting preview interface comprises the first preview image collected by a main camera.

In this step, the main camera may be a camera having a first focal length parameter; the camera may also be a standard camera of the electronic device, i.e. a conventional camera, and may implement conventional image shooting, such as conventional face shooting, landscape shooting, and the like.

In this embodiment, the first object is a subject to be specially processed in the first preview image, and may be one or at least two.

The first input may be a user's selection input, press input, long press input, etc., of a first object in the first preview image.

As shown in fig. 3a, in a case that a special effect image of the first object 311 in the first preview image 31 needs to be acquired, the acquisition of the special effect image of the first object 311 may be triggered by receiving a selection operation of the first object 311 in the first preview image 31 by a user.

In one embodiment, the special effect image may be an enlarged image, a reduced image, an offset image of the first object, or an image in which the first object appears multiple times, that is, an enlarged image, a reduced image including both the first object in the special effect image, and the number of the enlarged image and the reduced image may be one or more.

Step 202, responding to the first input, and displaying a second preview image in a first area associated with the first object.

In this step, the second preview image may be a preview image of the first object captured by the first auxiliary camera of the electronic device, that is, an image with a special effect of the first object that the user wants to obtain. The first auxiliary camera can be a camera with a second focal length parameter, and the second focal length parameter is different from the first focal length parameter.

In this case, the second preview image may be displayed in a first area associated with the first object, and the second preview image may be displayed in a superimposed manner in the first area associated with the first object, where the first area may be a peripheral area of the first object in the first preview image, such as a left area, a right area, and the like of the first object.

As shown in fig. 3c, a second preview image 33 is displayed on the photographing interface, and the second preview image 33 includes only the image of the first object.

In addition, the second preview image may also be overlaid on the first object setting in the first preview image. Moreover, the user can also adjust information such as the display size, the display position, the transparency and the like of the second preview image to adjust the display effect of the second preview image.

And 203, respectively controlling the main camera and the first auxiliary camera to take frames to obtain a first image and a second image.

In this step, a first image may be selected from a first image buffer queue corresponding to the main camera, and a second image may be selected from a second image buffer queue corresponding to the first auxiliary camera.

The selection rule of the first image and the second image can be determined based on a shooting algorithm of the electronic equipment or a setting of a user. For example, the last frame of image in the buffer queue may be used as the first image, or the frame of image with the highest definition in the buffer queue may be used as the first image.

And 204, synthesizing the image of the first object in the second image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image.

In this step, the first target image has the same display effect as the first superimposed display effect; moreover, by synthesizing the image of the first object in the second image into the first image, that is, synthesizing the image of the first object with the special effect into the first image, the shooting of the image with the special effect is realized, the post-image processing is not required, and the shooting process of the image with the special effect can be simplified.

In addition, for the image contents of the first preview image and the second preview image displayed on the shooting preview interface, the first superimposed display effect displayed on the shooting preview interface can be adjusted by adjusting information such as the display size, the display position, the transparency and the like of the second preview image, that is, the display effect of the first target image can be flexibly adjusted in the shooting process.

In this way, the second preview image of the first object in the first preview image is acquired, namely the second preview image with the special effect of the first object is acquired, the image of the first object in the second image is synthesized into the first image based on the first superposition display effect of the first preview image and the second preview image, so as to obtain the first target image, namely, in the shooting process of the images, the image with the first superposition display effect can be obtained, the first target image corresponding to the image with the first superposition display effect can be output, the post-image processing is not needed, and the shooting process of the image with the special effect can be simplified.

It can be understood that, in a case that the first superimposed display effect of the first preview image and the second preview image displayed on the shooting preview interface meets the user requirement, a click operation of the shooting control by the user may be received, so as to output a first target image corresponding to the first superimposed display effect, which meets the user requirement.

Optionally, step 203 comprises: controlling the main camera to capture a first image from the tail of a first image cache queue, and controlling the first auxiliary camera to capture a second image from the tail of a second image cache queue; or controlling the sensor of the main camera to output a first image after being subjected to light sensing, and controlling the sensor of the first auxiliary camera to output a second image after being subjected to light sensing.

Optionally, step 204 comprises: matting the image of the first object from the second image to obtain an intermediate image; and synthesizing the intermediate image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image.

In this embodiment, the image of the first object may be extracted from the second image by image extraction to obtain an intermediate image, and the intermediate image is synthesized into the first image to obtain the first target image.

Wherein the intermediate image only includes the image content of the first object and does not include other contents in the second image except the image content of the first image.

Optionally, said displaying a second preview image in a first area associated with said first object in response to said first input comprises:

in response to the first input, displaying N camera identifications in a second area associated with the first object, wherein each camera identification indicates an auxiliary camera, and N is an integer greater than 1;

receiving second input of a user to a first camera mark in the N camera marks;

in response to the second input, displaying a second preview image of the first object captured by the first camera identifying the corresponding first secondary camera in the first region associated with the first object.

In this embodiment, the first input may be a selection input or a press input applied to the first object by the user, and the N camera identifiers are displayed in the second area associated with the first object by responding to the first input; so as to select the camera mark corresponding to the auxiliary camera for acquiring the second preview image from the N camera marks. Therefore, through providing a plurality of optional auxiliary cameras, a user can conveniently select the cameras with different focal length parameters to acquire images of the first object, so that the user can acquire second preview images with different multiples, and the selection of the special effect of the first object is enriched.

For example, in the case that the special effect image of the first object to be acquired is a 5 times enlarged image, a selection input to the third camera 30 in fig. 1 may be received, and a second preview image of the first object may be acquired through the third camera 30.

The mark in the invention is used for indicating characters, symbols, images and the like of information, and a control or other container can be used as a carrier for displaying information, including but not limited to character marks, symbol marks and image marks.

The second area may be an upper area or a lower area of the first object, and the camera identification may be displayed in the form of a digital icon, such as 1#, 2#, 3#, or (r), and (c).

The user can preset the association relationship between the camera identification and the camera, for example, the focal length parameter of the camera corresponding to the camera identification "1 #" or "1 ″" is set to be 0.5-1 times, the focal length parameter of the camera corresponding to the camera identification "2 #" or "2 ″" is set to be 1-2 times, and the focal length parameter of the camera corresponding to the camera identification "3 #" or "3 ″" is set to be 2-10 times.

In addition, when the user selects the corresponding camera identifier, the focal length parameter of the camera corresponding to the camera identifier may be displayed in a preset region of the camera identifier, for example, directly above the camera identifier. For example, in the case of selecting the camera identifier "1 #" or "r", the "focal length parameter is 0.5 to 1 times" may be displayed directly above the camera identifier "1 #" or "r"; under the condition that the camera mark '2 #' or '2' is selected, the 'focal length parameter is 1-2 times' can be displayed right above the camera mark '2 #' or '2'; under the condition that the camera mark 3# or the camera mark c is selected, the focal length parameter of 2-10 times can be displayed right above the camera mark 3# or the camera mark c.

Specifically, as shown in fig. 3b, in the case that a selection input for the first object 311 is received, N camera identifications may be displayed in the second area 32 associated with the first object 311.

Optionally, after displaying a second preview image in the first area associated with the first object in response to the second input, the method further comprises:

receiving a third input of a user to a second camera mark in the N camera marks;

responding to the third input, and displaying a third preview image in a third area associated with the first object, wherein the third preview image is a preview image of the first object acquired by a second auxiliary camera corresponding to the second camera identification;

respectively controlling the main camera, the first auxiliary camera and the second auxiliary camera to take frames to obtain a third image, a fourth image and a fifth image;

synthesizing the images of the first object in the fourth image and the fifth image to the third image according to a second superposition display effect of the first preview image, the second preview image and the third preview image to obtain a second target image;

the second auxiliary camera is a camera with a third focal length parameter, and the third focal length parameter is different from the second focal length parameter.

In this embodiment, a second camera identifier may also be selected, so that a second auxiliary camera corresponding to the second camera identifier is used to acquire a third preview image of the first object; therefore, the preview images with the second overlapped display effect of the first preview image, the second preview image and the third preview image can be obtained, the image effect of the preview images is effectively enriched, the user can select different auxiliary cameras to obtain the preview images with different image effects, the degree of freedom of obtaining the special image effect is improved, and the interactivity between the user and equipment in the shooting process is increased.

Further optionally, the respectively controlling the main camera, the first auxiliary camera, and the second auxiliary camera to capture frames to obtain a third image, a fourth image, and a fifth image includes:

the method comprises the steps of controlling a main camera to capture a third image from the tail of a third image cache queue, controlling a first auxiliary camera to capture a fourth image from the tail of a fourth image cache queue, and controlling a second auxiliary camera to capture a fifth image from the tail of a fifth image cache queue, wherein the third image cache queue is a queue for caching images captured by the main camera, the fourth image cache queue is a queue for caching images captured by the first auxiliary camera, and the fifth image cache queue is a queue for caching images captured by the second auxiliary camera;

or controlling the sensor of the main camera to output a third image after being subjected to light sensing, controlling the sensor of the first auxiliary camera to output a fourth image after being subjected to light sensing, and controlling the sensor of the second auxiliary camera to output a fifth image after being subjected to light sensing.

Further optionally, the synthesizing, according to a second superimposed display effect of the first preview image, the second preview image, and the third preview image, the image of the first object in the fourth image and the image of the fifth image to the third image to obtain a second target image includes:

matting the image of the first object from the fourth image to obtain a first intermediate image;

matting the image of the first object from the fifth image to obtain a second intermediate image;

and synthesizing the first intermediate image and the second intermediate image to the third image according to a second superposition display effect of the first preview image, the second preview image and the third preview image to obtain a second target image.

In this embodiment, the image of the first object can be extracted from the fourth image by image extraction to obtain a first intermediate image; and the image of the first object is extracted from the fifth image to obtain a second intermediate image, and the first intermediate image and the second intermediate image are synthesized into a third image to obtain a second target image.

Wherein the first intermediate image only includes the image content of the first object in the fourth image and does not include other contents in the fourth image except the image content of the first image; the second intermediate image includes only the image content of the first object in the fifth image and does not include other content in the fifth image than the image content of the first image.

In addition, for the image contents of the first preview image, the second preview image and the third preview image displayed on the shooting preview interface, the second superimposed display effect displayed on the shooting preview interface can be adjusted by adjusting information such as the display size, the display position and the transparency of the second preview image and adjusting information such as the display size, the display position and the transparency of the third preview image, that is, the display effect of the second target image can be flexibly adjusted in the shooting process.

In this example, since the third focal length parameter of the second auxiliary camera is different from the second focal length parameter of the first auxiliary camera, the second preview image and the third preview image with different zoom ratios can be acquired, that is, the second preview image with the first zoom factor can be acquired by the first auxiliary camera, and the second preview image with the second zoom factor can be acquired by the second auxiliary camera.

As shown in fig. 3c, a second superimposed display effect of the image of the first object in the first preview image 31, the second preview image 33 and the third preview image 34 displayed on the shooting preview interface, that is, the image of the first object in the first preview image 31, the second preview image 33 and the third preview image 34 displayed on the shooting preview interface, may achieve a display effect of gradually enlarging.

Further optionally, before the synthesizing the image of the first object in the fourth image and the fifth image to the third image according to the second superimposed display effect of the first preview image, the second preview image, and the third preview image to obtain the second target image, the method further includes:

and displaying the second preview image and the third preview image on the first preview image in a superposition manner according to a preset superposition sequence.

In this embodiment, the image contents of the second preview image and the third preview image may be displayed in a superimposed manner on the first preview image line according to a preset superimposing order, so as to flexibly adjust the superimposed display effect of the preview image displayed on the shooting preview interface.

If the overlapping sequence is the first preview image, the second preview image and the third preview image, and there is an overlapping portion between the image content of the second preview image and the image content of the third preview image, the display effect of the overlapping portion can be changed by adjusting the transparency of the overlapping portion between the second preview image and the third preview image.

Furthermore, a filter effect may also be set to add a filter effect to the corresponding image content. And because the second preview image and the third preview image are preview images of the first object acquired by different focal length parameters, different image effects can be superposed by setting different transparencies and filter effects, so that the image effect is enriched.

Optionally, in response to the first input, before the controlling the main camera and the first auxiliary camera to take frames respectively to obtain the first image and the second image after the second preview image is displayed in the first area associated with the first object, the method further includes:

receiving a fourth input to the second preview image;

updating display parameters of the second preview image in response to the fourth input, the display parameters including at least one of a display size, a display position, and a transparency.

In this embodiment, the display effect of the second preview image can be enriched by updating the display parameters of the second preview image, and the overlapping display effect of the first preview image and the second preview image can be enriched. Compared with the post-synthesis processing, the method has the advantages that the zooming and offsetting operation is carried out on the image, the definition of the image, particularly the definition of the amplified image, can be improved, and the shooting operation can be simplified.

Wherein the fourth input may be a zoom-in input, a zoom-out input, an offset input, a transparency setting input or operation, or the like.

As shown in fig. 3d, a user's enlargement input of the second preview image 33, such as a double-click operation or a double-finger enlargement operation of the second preview image 33 by the user, may be received to obtain an enlarged second preview image 33, as shown in fig. 3 e.

As shown in fig. 3f, a user's input of reducing the second preview image 33, such as a double-click operation or a double-finger reducing operation of the second preview image 33 by the user, may be received to obtain the reduced second preview image 33, as shown in fig. 3 g.

As shown in fig. 3h, an offset input of the second preview image 33 by the user, such as a moving operation or a dragging operation of the second preview image 33 by the user, may be received to obtain the offset second preview image 33, as shown in fig. 3 i.

Optionally, the displaying a second preview image in the first area associated with the first object includes:

acquiring a first target preview image acquired by the first auxiliary camera, wherein the first target preview image comprises the first object;

matting the image of the first object from the first target preview image to obtain a second preview image;

displaying the second preview image in a first area associated with the first object.

In this embodiment, a second preview image can be obtained from the acquired first target preview image in an image matting manner, and an image of the first object in the first target preview image can be scratched by removing redundant image content in the first target preview image.

In the process of matting the image of the first object, image data of a pixel region of the first object in the first target preview image may be acquired, the acquired image data corresponding to the first object is used as image data of the second preview image, and the image data is displayed in an overlapping manner in the first region associated with the first object.

Optionally, the first object comprises a first sub-object and a second sub-object;

the displaying, in response to the first input, a second preview image in a first area associated with the first object, including:

acquiring a second target preview image acquired by a first auxiliary camera, wherein the second target preview image comprises the first sub-object and the second sub-object;

matting a first sub preview image of the first sub object and a second sub preview image of the second sub object from the second target preview image;

displaying the first sub preview image in a first sub area associated with the first sub object, and displaying the second sub preview image in a second sub area associated with the second sub object;

the method further comprises, after displaying a second preview image at a first region associated with the first object in response to the first input:

respectively controlling the main camera and the first auxiliary camera to take frames to obtain a sixth image and a seventh image;

synthesizing images of the first sub-object and the second sub-object in the seventh image to the sixth image according to a third superimposed display effect of the first preview image, the first sub-preview image and the second sub-preview image to obtain a third target image;

wherein the first region comprises the first sub-region and a second sub-region.

In this embodiment, under the condition that at least two objects in the first preview image need to use the auxiliary camera with the target focal length parameter, the second target preview images of the at least two objects can be simultaneously collected by the auxiliary camera with the target focal length parameter, and corresponding images are respectively extracted from the second target preview images, so as to achieve the acquisition of the preview images of the at least two objects.

Further optionally, the respectively controlling the main camera and the first auxiliary camera to capture frames to obtain a sixth image and a seventh image includes:

the method comprises the steps that a main camera is controlled to capture a first reserved image from the tail of a sixth image cache queue, and a first auxiliary camera is controlled to capture a seventh image from the tail of a seventh image cache queue, wherein the sixth image cache queue is a queue used for caching images captured by the main camera, and the seventh image cache queue is a queue used for caching images captured by the first auxiliary camera;

or controlling the sensor of the main camera to output a sixth image after being subjected to light sensing, and controlling the sensor of the first auxiliary camera to output a seventh image after being subjected to light sensing.

Further optionally, the synthesizing, according to a third superimposed display effect of the first preview image, the first sub preview image, and the second sub preview image, an image of the first sub object and an image of the second sub object in the seventh image into the sixth image to obtain a third target image includes:

matting the image of the first sub-object from the seventh image to obtain a third intermediate image;

matting the image of the second sub-object from the seventh image to obtain a fourth intermediate image;

and synthesizing the third intermediate image and the fourth intermediate image into the sixth image according to a third superposition display effect of the first preview image, the first sub preview image and the second sub preview image to obtain a third target image.

In this embodiment, the image of the first sub-object may be extracted from the seventh image by image extraction to obtain a third intermediate image; and the image of the second sub-object is extracted from the seventh image to obtain a fourth intermediate image, and the third intermediate image and the fourth intermediate image are synthesized into a sixth image to obtain a second target image.

As shown in fig. 3j, the shooting preview interface displays a first preview image 31, the first preview image 31 includes a first object 311 and a second object 312, when both the first object 311 and the second object 312 need to acquire a preview image acquired by the auxiliary camera No. 3, a second target preview image of the first object 311 and the second object 312 can be acquired by the auxiliary camera No. 3 at the same time, and based on an image data separation technique, a third intermediate image 35 of the first object 311 and a fourth intermediate image 36 of the second object 312 are extracted from the second target preview image, and the third intermediate image 35 and the fourth intermediate image 36 are displayed on the first preview image 31 in an overlapping manner.

In addition, when at least two objects in the first preview image need to acquire images captured by the auxiliary camera having the focal length parameter, that is, when at least two objects in the first preview image need to be configured with the auxiliary camera having the focal length parameter, different auxiliary cameras may be configured for each object. Under the condition that a plurality of auxiliary cameras are distributed to an object, after a first auxiliary camera of the object is set, a first preview image collected by the first auxiliary camera is moved; and reselecting the object, and setting a second auxiliary camera of the object to acquire a second preview image acquired by the second auxiliary camera.

It should be noted that, in the present application, the camera is controlled to capture frames, and the method for capturing the image frames mainly captures the corresponding image frames from the corresponding image buffer queue, and the manner for capturing the image frames includes capturing the frames forward and capturing the frames backward.

The forward frame capturing means that after receiving shooting input, a cached image frame is taken out from the tail of an image cache queue and is processed by hardware and an algorithm to generate a corresponding picture; the backward frame capturing means that after receiving shooting input, a camera sensor outputs a last frame image after sensing light by setting parameters such as exposure of a camera, and generates a corresponding picture after processing by hardware and an algorithm.

As shown in fig. 3k, the electronic device includes a first camera 371, a second camera 372, and a third camera 373, and during shooting with these three cameras, a first image buffer queue 374 is used to buffer images captured by the first camera 371, a second image buffer queue 375 is used to buffer images captured by the second camera 372, and a third image buffer queue 376 is used to buffer images captured by the third camera 373. In the shooting process of capturing frames forwards, the buffered image frames can be taken out from the tail part of each image buffer queue, and after hardware and algorithm processing, corresponding pictures are generated. And the three frames of images output by the three cameras are superposed and synthesized during preview processing, and preview images with special superposition effects are displayed on a preview interface.

As shown in fig. 3l, the electronic device includes a first camera 381, a second camera 382, and a third camera 383, and during shooting with the three cameras, a first image buffer queue 384 is used to buffer images captured by the first camera 381, a second image buffer queue 385 is used to buffer images captured by the second camera 382, and a third image buffer queue 386 is used to buffer images captured by the third camera 383. In the shooting process of backward frame capturing, parameters such as exposure of each camera can be set, each camera sensor outputs the last frame of image after being subjected to light sensing, and a corresponding picture is generated after hardware and algorithm processing. And the three frames of images output by the three cameras are superposed and synthesized during preview processing, and preview images with special superposition effects are displayed on a preview interface.

According to the shooting method, under the condition that a first preview image is displayed on a shooting preview interface, first input of a user to a first object in the first preview image is received; in response to the first input, displaying a second preview image in a first area associated with the first object, wherein the second preview image is a preview image of the first object acquired by a first camera; outputting a target image based on image content of the first preview image and the second preview image; the first camera is a camera with a first focal length parameter. This can realize flexible adjustment of the photographing effect of the target image.

In the shooting method provided by the embodiment of the present application, the execution subject may be a shooting device, or a control module in the shooting device for executing the shooting method. The embodiment of the present application takes an example in which a shooting device executes a shooting method, and the shooting device provided in the embodiment of the present application is described.

Referring to fig. 4, fig. 4 is a structural diagram of a camera according to an embodiment of the present disclosure, and as shown in fig. 4, the camera 400 includes:

the first receiving module 401 is configured to receive a first input of a user to a first object in a first preview image when a shooting preview interface includes the first preview image acquired by a main camera;

a first display module 402, configured to, in response to the first input, display a second preview image in a first area associated with the first object, where the second preview image is a preview image of the first object acquired by a first auxiliary camera;

a first frame capturing module 403, configured to respectively control the main camera and the first auxiliary camera to capture frames to obtain a first image and a second image;

a first combining module 404, configured to combine the image of the first object in the second image into the first image according to a first superimposed display effect of the first preview image and the second preview image, so as to obtain a first target image.

Optionally, the first frame capturing module 403 is specifically configured to control the main camera to capture a first image from a tail of a first image cache queue, and control the first auxiliary camera to capture a second image from a tail of a second image cache queue, where the first image cache queue is a queue for caching images captured by the main camera, and the second image cache queue is a queue for caching images captured by the first auxiliary camera;

or, the first auxiliary camera is specifically configured to control the sensor of the main camera to output a first image after being subjected to light sensing, and control the sensor of the first auxiliary camera to output a second image after being subjected to light sensing;

the first synthesis module 404 includes:

the first matting unit is used for matting the image of the first object from the second image to obtain an intermediate image;

and the synthesis output unit is used for synthesizing the intermediate image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image.

Optionally, the main camera is a camera with a first focal length parameter, the first auxiliary camera is a camera with a second focal length parameter, and the first focal length parameter is different from the second focal length parameter.

Optionally, the first display module 402 includes:

a first display unit, configured to display, in response to the first input, N camera identifiers in a second area associated with the first object, where each camera identifier indicates one auxiliary camera, and N is an integer greater than 1;

the receiving unit is used for receiving second input of a user to a first camera mark in the N camera marks;

and a second display unit, configured to display, in response to the second input, a second preview image in the first area associated with the first object, where the second preview image is a preview image of the first object acquired by a first auxiliary camera identified by the first camera.

Optionally, the photographing apparatus 400 further includes:

the second receiving module is used for receiving third input of a user to a second camera mark in the N camera marks;

a second display module, configured to respond to the third input, display a third preview image in a third area associated with the first object, where the third preview image is a preview image of the first object acquired by a second auxiliary camera corresponding to the second camera identifier;

the second frame taking module is used for respectively controlling the main camera, the first auxiliary camera and the second auxiliary camera to take frames to obtain a third image, a fourth image and a fifth image;

a second synthesizing module, configured to synthesize the image of the first object in the fourth image and the fifth image into the third image according to a second superimposed display effect of the first preview image, the second preview image, and the third preview image, so as to obtain a second target image;

Optionally, the photographing apparatus 400 further includes:

and the third display module is used for displaying the second preview image and the third preview image on the first preview image in an overlapping manner according to a preset overlapping sequence.

Optionally, the photographing apparatus 400 further includes:

a third receiving module, configured to receive a fourth input to the second preview image;

an updating module, configured to update display parameters of the second preview image in response to the fourth input, where the display parameters include at least one of a display size, a display position, and a transparency.

Optionally, the first display module 402 includes:

a first obtaining unit, configured to obtain a first target preview image acquired by the first auxiliary camera, where the first target preview image includes the first object;

the second matting unit is used for matting the image of the first object from the first target preview image to obtain a second preview image;

and a third display unit configured to display the second preview image in a first area associated with the first object.

the first display module 402 includes:

the second acquisition unit is used for acquiring a second target preview image acquired by a first auxiliary camera, and the second target preview image comprises the first sub-object and the second sub-object;

a third matting unit, configured to matte a first sub-preview image of the first sub-object and a second sub-preview image of the second sub-object from the second target preview image;

a fourth display unit, configured to display the first sub preview image in a first sub-area associated with the first sub-object, and display the second sub preview image in a second sub-area associated with the second sub-object;

the photographing device 400 further includes:

the third frame taking module is used for respectively controlling the main camera and the first auxiliary camera to take frames to obtain a sixth image and a seventh image;

a third synthesis processing module, configured to synthesize, according to a third superimposed display effect of the first preview image, the first sub-preview image, and the second sub-preview image, the images of the first sub-object and the second sub-object in the seventh image into the sixth image, so as to obtain a third target image;

The shooting device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a Network Attached Storage (NAS), a personal computer (personal computer, PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not limited in particular.

The photographing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The shooting device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 2, and is not described here again to avoid repetition.

Optionally, as shown in fig. 5, an electronic device 500 is further provided in an embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and executable on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the foregoing shooting method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Referring to fig. 6, fig. 6 is a block diagram of an electronic device according to an embodiment of the present application, and as shown in fig. 6, the electronic device 600 includes, but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, a processor 610, and the like.

Those skilled in the art will appreciate that the electronic device 600 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 610 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The user input unit 607 is configured to receive a first input of a user to a first object in a first preview image, where the shooting preview interface includes the first preview image captured by a main camera;

a display unit 606, configured to, in response to the first input, display a second preview image in a first area associated with the first object, where the second preview image is a preview image of the first object acquired by a first auxiliary camera;

the processor 610 is configured to control the main camera and the first auxiliary camera to capture frames respectively to obtain a first image and a second image;

the processor 610 is configured to synthesize the image of the first object in the second image into the first image according to a first overlay display effect of the first preview image and the second preview image, so as to obtain a first target image.

Optionally, the processor 610 is configured to control the main camera to capture a first image from a tail of a first image cache queue, and control the first auxiliary camera to capture a second image from a tail of a second image cache queue, where the first image cache queue is a queue for caching images captured by the main camera, and the second image cache queue is a queue for caching images captured by the first auxiliary camera;

or the first auxiliary camera is used for controlling the sensor of the main camera to output a first image after being subjected to light sensing, and controlling the sensor of the first auxiliary camera to output a second image after being subjected to light sensing;

a processor 610, configured to extract an image of the first object from the second image, resulting in an intermediate image;

the processor 610 is configured to synthesize the intermediate image into the first image according to a first overlay display effect of the first preview image and the second preview image, so as to obtain a first target image.

Optionally, the display unit 606 is configured to display, in response to the first input, N camera identifiers in a second area associated with the first object, where each camera identifier indicates one auxiliary camera, and N is an integer greater than 1;

a user input unit 607, configured to receive a second input of a first camera identifier of the N camera identifiers from a user;

a display unit 606, configured to display, in response to the second input, a second preview image in the first area associated with the first object, where the second preview image is a preview image of the first object acquired by the first auxiliary camera identified by the first camera.

Optionally, the user input unit 607 is configured to receive a third input of a second camera identifier of the N camera identifiers from the user;

a display unit 606, configured to display, in response to the third input, a third preview image in a third area associated with the first object, where the third preview image is a preview image of the first object acquired by a second auxiliary camera corresponding to the second camera identifier;

the processor 610 is configured to control the main camera, the first auxiliary camera, and the second auxiliary camera to capture frames respectively to obtain a third image, a fourth image, and a fifth image;

a processor 610, configured to synthesize, according to a second overlapping display effect of the first preview image, the second preview image, and the third preview image, an image of the first object in the fourth image and the fifth image into the third image, so as to obtain a second target image;

Optionally, the display unit 606 is configured to display the second preview image and the third preview image in a preset overlapping order in an overlapping manner on the first preview image.

Optionally, a user input unit 607 for receiving a fourth input to the second preview image;

a processor 610, configured to update display parameters of the second preview image in response to the fourth input, where the display parameters include at least one of a display size, a display position, and a transparency.

Optionally, the processor 610 is configured to obtain a first target preview image acquired by the first auxiliary camera, where the first target preview image includes the first object;

a processor 610, configured to extract an image of the first object from the first target preview image to obtain a second preview image;

a display unit 606, configured to display the second preview image in the first area associated with the first object.

a processor 610, configured to obtain a second target preview image acquired by a first auxiliary camera, where the second target preview image includes the first sub-object and the second sub-object;

a processor 610, configured to scratch a first sub preview image of the first sub object and a second sub preview image of the second sub object from the second target preview image;

a display unit 606, configured to display the first sub preview image in a first sub-region associated with the first sub-object, and display the second sub preview image in a second sub-region associated with the second sub-object;

the processor 610 is configured to control the main camera and the first auxiliary camera to capture frames respectively to obtain a sixth image and a seventh image;

a processor 610, configured to synthesize, according to a third superimposed display effect of the first preview image, the first sub-preview image, and the second sub-preview image, the images of the first sub-object and the second sub-object in the seventh image into the sixth image, so as to obtain a third target image;

It is to be understood that, in the embodiment of the present application, the input Unit 604 may include a Graphics Processing Unit (GPU) 6041 and a microphone 6042, and the Graphics Processing Unit 6041 processes image data of a still picture or a video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 607 includes a touch panel 6071 and other input devices 6072. A touch panel 6071, also referred to as a touch screen. The touch panel 6071 may include two parts of a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 609 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 610 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 610.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above shooting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above shooting method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A photographing method, characterized by comprising:

2. The method of claim 1, wherein the separately controlling the main camera and the first auxiliary camera to capture frames to obtain a first image and a second image comprises:

the method comprises the steps that a main camera is controlled to capture a first image from the tail of a first image cache queue, and a first auxiliary camera is controlled to capture a second image from the tail of a second image cache queue, wherein the first image cache queue is a queue used for caching images captured by the main camera, and the second image cache queue is a queue used for caching images captured by the first auxiliary camera;

or controlling a sensor of the main camera to output a first image after being subjected to light sensing, and controlling a sensor of the first auxiliary camera to output a second image after being subjected to light sensing;

synthesizing the image of the first object in the second image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image, including:

matting the image of the first object from the second image to obtain an intermediate image;

and synthesizing the intermediate image to the first image according to the first superposition display effect of the first preview image and the second preview image to obtain a first target image.

3. The method of claim 1, wherein the primary camera is a camera having a first focal length parameter and the first secondary camera is a camera having a second focal length parameter, the first focal length parameter and the second focal length parameter being different.

4. The method of claim 1, wherein displaying a second preview image in a first area associated with the first object in response to the first input comprises:

receiving second input of a user to a first camera mark in the N camera marks;

5. The method of claim 4, wherein in response to the second input, after displaying a second preview image in the first area associated with the first object, the method further comprises:

6. The method of claim 5, wherein before the combining the images of the first object in the fourth image and the fifth image into the third image with the second overlay display effect of the first preview image, the second preview image and the third preview image to obtain the second target image, the method further comprises:

7. The method of claim 1, wherein in response to the first input, prior to the separately controlling the primary camera and the first secondary camera to frame a first image and a second image after a second preview image is displayed in the first region associated with the first object, the method further comprises:

receiving a fourth input to the second preview image;

8. The method of claim 1, wherein displaying a second preview image in the first area associated with the first object comprises:

9. The method of claim 1, wherein the first object comprises a first sub-object and a second sub-object;

10. A camera, comprising:

11. The camera according to claim 10, wherein the first frame capturing module is specifically configured to control the main camera to capture a first image from a tail of a first image buffer queue, and control the first auxiliary camera to capture a second image from a tail of a second image buffer queue, where the first image buffer queue is a queue for buffering images captured by the main camera, and the second image buffer queue is a queue for buffering images captured by the first auxiliary camera;

the first synthesis module comprises:

12. The camera of claim 10, wherein the primary camera is a camera having first focal length parameters and the first secondary camera is a camera having second focal length parameters, the first focal length parameters and the second focal length parameters being different.

13. The camera of claim 10, wherein the first display module comprises:

14. The camera of claim 13, further comprising:

15. The camera of claim 14, further comprising:

16. The camera of claim 10, further comprising:

17. The camera of claim 10, wherein the first display module comprises:

18. The photographing apparatus according to claim 10, wherein the first object includes a first sub-object and a second sub-object;

the first display module includes:

the photographing apparatus further includes:

19. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the photographing method according to any one of claims 1 to 9.

20. A readable storage medium, characterized in that the readable storage medium stores thereon a program or instructions which, when executed by a processor, implement the steps of the photographing method according to any one of claims 1 to 9.