CN113194256B

CN113194256B - Shooting method, shooting device, electronic equipment and storage medium

Info

Publication number: CN113194256B
Application number: CN202110474976.2A
Authority: CN
Inventors: 姚文玉
Original assignee: Vivo Mobile Communication Hangzhou Co Ltd
Current assignee: Vivo Mobile Communication Hangzhou Co Ltd
Priority date: 2021-04-29
Filing date: 2021-04-29
Publication date: 2023-04-25
Anticipated expiration: 2041-04-29
Also published as: CN113194256A

Abstract

The application discloses a shooting method, a shooting device, electronic equipment and a storage medium, and belongs to the technical field of shooting. The shooting method comprises the following steps: controlling a camera to shoot a first image; displaying a first image on a first shooting sub-window of a shooting preview interface, wherein the shooting preview interface comprises N sub-windows, and the N sub-windows comprise T shooting sub-windows and P recommending sub-windows; displaying a second image in a first recommendation sub-window of the shooting preview interface; generating a target image based on images displayed in the T shooting sub-windows and the P recommending sub-windows; the shooting sub-window is used for displaying a preview image and an image shot by the camera; the recommendation sub-window is used for displaying the stored images; n is an integer greater than 1, P, T is a positive integer, n=p+t.

Description

Shooting method, shooting device, electronic equipment and storage medium

Technical Field

The application belongs to the technical field of image pickup, and particularly relates to a shooting method, a shooting device, electronic equipment and a storage medium.

Background

Electronic devices with cameras such as mobile phones can shoot. Under the use scene that the content in a plurality of images is required to be displayed through one image, the plurality of images are required to be shot first and stored in an album or a certain folder, then the number and arrangement mode of the images required to be synthesized are set through software for post-processing of the image images installed on the electronic equipment, the number of the images are selected from the stored and shot images, and the images are synthesized into one image according to the arrangement mode. However, the method has the defects of complicated steps and low efficiency.

Disclosure of Invention

The embodiment of the application aims to provide a shooting method, a shooting device, electronic equipment and a storage medium, which can solve the problems of complex operation and great difficulty in the generation process of images with multi-image stitching effect.

In a first aspect, an embodiment of the present application provides a photographing method, including:

controlling a camera to shoot a first image;

displaying a first image on a first shooting sub-window of a shooting preview interface, wherein the shooting preview interface comprises N sub-windows, and the N sub-windows comprise T shooting sub-windows and P recommending sub-windows;

displaying a second image in a first recommendation sub-window of the shooting preview interface;

generating a target image based on images displayed in the T shooting sub-windows and the P recommending sub-windows;

the shooting sub-window is used for displaying a preview image and an image shot by the camera; the recommendation sub-window is used for displaying the stored images; n is an integer greater than 1, P, T is a positive integer, n=p+t.

In a second aspect, an embodiment of the present application provides a photographing apparatus, including:

the image shooting module is used for controlling the camera to shoot a first image;

the first display module is used for displaying the first image in a first shooting sub-window of a shooting preview interface, wherein the shooting preview interface comprises N sub-windows, and the N sub-windows comprise T shooting sub-windows and P recommending sub-windows;

The second display module is used for displaying a second image on the first recommendation sub-window of the shooting preview interface;

the image synthesis module is used for generating a target image based on images displayed in the T shooting sub-windows and the P recommending sub-windows;

In a third aspect, embodiments of the present application provide an electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, the program or instruction implementing the steps of the method according to the first aspect when executed by the processor.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In the embodiment of the application, the images obtained through shooting are displayed in each shooting sub-window included in the shooting preview interface, the stored images are displayed in each recommending sub-window included in the shooting preview interface, the images displayed in each sub-window are synthesized, the problem that each target image to be synthesized is not needed to be picked one by one from an album, and the images to be combined and spliced are not needed to be found is solved, the problem that the images to be combined and spliced are not needed to be found through later image processing software is solved, the images to be synthesized can be determined simply, quickly and conveniently based on the function of shooting of the electronic equipment, the generation process of the images with multiple image splicing effects can be simplified, the difficulty of the generation process of the images with the multiple image splicing effects is reduced, the function of shooting of the electronic equipment can be enriched, and the requirements of users for shooting and splicing the synthesized images are met well.

Drawings

Fig. 1 is a schematic flow chart of a shooting method provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 3 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 4 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 5 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 6 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 7 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 8 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 9 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 10 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 11 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 12 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 13 is a schematic diagram of a shooting preview interface in an embodiment of the present application;

FIG. 14 is a schematic diagram of a capture sub-window template in an embodiment of the present application;

FIG. 15 is a schematic view of a shooting preview interface in an embodiment of the present application;

fig. 16 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present application;

fig. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 18 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The shooting method, the shooting device, the electronic equipment and the storage medium provided by the embodiment of the application are described in detail through specific embodiments and application scenes thereof with reference to the accompanying drawings.

Fig. 1 is a flowchart of a photographing method according to an embodiment of the present application. The photographing method provided in the embodiment of the present application is described below with reference to fig. 1. As shown in fig. 1, the method includes:

and step 101, controlling the camera to shoot a first image.

Optionally, the photographing method provided by the embodiment of the application is suitable for photographing an image by using electronic equipment with a camera.

The electronic device described above may be implemented in various forms. For example, the electronic devices described in the embodiments of the present application may include mobile terminals such as mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), navigation devices, smart bracelets, smart handhelds, digital cameras, and the like, and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the electronic device is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present application can be applied to a fixed type terminal in addition to elements particularly used for a moving purpose.

It should be noted that, the electronic device in the embodiment of the present application may include at least one camera.

The user may input a photographing instruction for photographing an image to the electronic device as needed, control at least one camera, and photograph a first image based on set photographing parameters (including sensitivity, shutter time, focal length, white balance, etc.).

For example, in the case where the mobile phone includes one front camera and a plurality of rear cameras, the front cameras may be controlled to capture the first image by capturing instructions; any rear camera can be controlled to shoot a first image; the plurality of rear cameras may also be controlled to capture the first image.

Alternatively, the first image may be a picture or video.

For example, the first image is a picture obtained by a user taking a self-photograph, or a video of a scene taken.

Step 102, displaying a first image in a first shooting sub-window of a shooting preview interface, wherein the shooting preview interface comprises N sub-windows, and the N sub-windows comprise T shooting sub-windows and P recommending sub-windows.

Optionally, the electronic device in the embodiment of the application may include at least one screen. Wherein each screen may be a folded screen that can be folded or an unfolded screen that cannot be folded.

A shooting preview interface may be displayed on the screen.

The shot preview interface may include a plurality of sub-windows, wherein at least one sub-window is a shot sub-window and at least one sub-window is a recommended sub-window.

The plurality of sub-windows may be arranged in a target arrangement, such as a nine-square grid or a stripe pattern.

The target arrangement may be a pre-stored default arrangement or an arrangement determined based on user input. The embodiments of the present application are not limited to a specific target arrangement.

Each sub-window may display an image.

For the recommended sub-window, the image displayed by the sub-window is a stored image.

And for shooting the sub-window, the image displayed by the sub-window is obtained by calling a camera to shoot.

For the first capturing sub-window, after step 101 is performed based on the capturing sub-window, the first image may be displayed in the capturing sub-window.

Before the first image is obtained, a preview image of the camera corresponding to the shooting sub-window can be displayed in the first shooting sub-window.

Alternatively, after the first image is displayed, step 103 may be performed in case the user is satisfied with the first image.

Optionally, after displaying the first image, the electronic device may receive a fifth input for processing the first image entered by the user in case the user is not satisfied with the first image.

The fifth input may be a touch input, a voice input, a gesture input, or a key input of the user to the first image.

The electronic device may perform image processing operations such as cropping, rotating, adjusting contrast, etc. on the first image in response to the fifth input, updating the first image.

Optionally, the fifth input may further comprise an input for triggering deletion of the first image.

And the electronic equipment responds to the fifth input, deletes the first image and displays the preview image of the camera corresponding to the shooting sub-window without displaying the first image. The electronic device may re-execute step 101 to control the camera to capture the first image until a first image satisfactory to the user is obtained.

For example, as shown in fig. 2, the shooting preview interface includes 4 sub-windows: child window 201, child window 202, child window 203, and child window 204; the sub-window 202 is a first photographing sub-window, and displays a first image; the user may delete the first image by clicking on control 205 for deleting the first image. As shown in fig. 3, the first image is no longer displayed in the sub-window 202, but the preview image is displayed.

And 103, displaying a second image in the first recommendation sub-window of the shooting preview interface.

Alternatively, the second image may be a stored image determined based on the display contents in the above-described T photographing sub-windows, or a stored image selected by the user.

For the first recommendation sub-window, the second image may be displayed in the recommendation sub-window after the second image is determined.

Optionally, before step 103, a preview image or an empty image may be displayed in the first recommendation sub-window.

And 104, generating a target image based on the images displayed in the T shooting sub-windows and the P recommending sub-windows.

Optionally, after each shooting sub-window and each recommending sub-window display the images, the images displayed in the sub-windows may be combined in a stitching manner according to the target arrangement manner to generate an image. The generated image is the target image.

According to the method and the device for synthesizing the images, the images obtained through shooting are displayed in each shooting sub-window included in the shooting preview interface, the stored images are displayed in each recommending sub-window included in the shooting preview interface, the images displayed in each sub-window are synthesized, the problem that each target image to be synthesized is not needed to be picked one by one from an album, and the images to be synthesized are spliced and spliced does not exist, the problem that the appropriate images cannot be found to be spliced and spliced is solved, the images to be synthesized do not need to be processed through image processing software later, the image to be synthesized can be determined simply, quickly and conveniently based on the shooting function of the electronic device, the generation process of the images with the multi-image splicing effect can be simplified, the difficulty of the generation process of the images with the multi-image splicing effect can be reduced, the shooting function of the electronic device can be enriched, and the requirements of users on shooting and splicing the synthesized images can be met better.

Optionally, before the first recommendation sub-window of the preview interface is shot and the second image is displayed, the method further comprises: and obtaining T images of the T shooting sub-windows.

Alternatively, before step 103, images of the respective photographing sub-windows may be acquired.

Alternatively, after T images of the T photographing sub-windows are obtained, the above T images may be acquired.

Alternatively, after each image of the photographing sub-window is obtained separately, each image may be acquired in turn, thereby acquiring T images.

Determining K images matched with the image content of the T images; wherein K is a positive integer.

Alternatively, the T images may be matched with the stored images based on the contents of the images, and whether each stored image matches the contents of the T images may be determined.

Based on the matching result of whether each stored image matches the image content of the T images, K images can be determined from among the stored images that match the image content of the T images. The second image is one of the K images.

The stored image matches the image content of the T images described above, which may include, but is not limited to, at least one of the following conditions:

The correlation between the stored image and the image content of the T images meets a preset first condition;

the stored images and the light intensity variation in the T images meet a preset second condition.

Alternatively, the correlation of the content of the image satisfies a preset first condition, which may include, but is not limited to, at least one of the following conditions:

the similarity of the environments in the image is larger than a preset threshold value;

the gesture difference of the person in the image accords with a preset third condition;

the same person is included in the image.

For example, if the T images are images of different persons in the same scenic spot and a stored image is an image of a person in the scenic spot, it may be determined that the image matches the image content of the T images.

In another example, if the T images are images of various plants and a stored image is an image of an animal, it is determined that the image does not match the image content of the T images.

Optionally, after screening the stored images, the screened images can be queried based on the T images, so as to improve query efficiency.

Criteria for screening may include, but are not limited to: at least one of quality, sharpness, photographing time, and photographing place of an image.

Optionally, querying each of the screened images includes:

determining the content label of the image through an image content identification algorithm;

and matching the content labels of the T images with the content labels of the screened images, so as to determine whether the screened images are matched with the image content of the T images.

The content tag may include the type of content.

Alternatively, the types of contents may be multi-level classification. For example, the types of content may include a first class classification of landscapes, characters, animals, plants, items, and buildings; scenery may include secondary classifications of deserts, oceans, forests, lakes, rivers, canyons, and mountains; lakes may include three-level classifications of lake one, lake two, and lake three.

According to the method and the device for combining and splicing the images, the stored images are matched with the image content of the images of the shooting sub-windows, K images matched with the image content of the images of the shooting sub-windows are determined, so that one of the K images is the second image to be combined, the problem that the images of the targets to be combined are not needed to be picked one by one from an album, the problem that the images to be combined and spliced cannot be found is solved, the later image processing software is not needed, the images to be combined can be determined simply, quickly and conveniently based on the shooting function of the electronic equipment, the generation process of the images with the multi-image splicing effect can be simplified, the difficulty of the generation process of the images with the multi-image splicing effect is reduced, the shooting function of the electronic equipment can be enriched, and the requirements of users for shooting and splicing the combined images can be met better.

Optionally, after determining K images matching the image content of the T images, further includes: and determining an image with the matching degree with the image content of the T images in the K images being larger than a preset threshold value as a second image.

Optionally, the electronic device may automatically match, and determine one of the K images as the second image.

In the case where K is equal to 1 and the matching degree of the image content of the image and the T images is greater than a preset threshold, the image may be determined as the second image.

In the case where K is greater than 1 and the degree of matching of only one of the K images with the image content of the T images is greater than a preset threshold, the image may be determined as the second image.

When K is greater than 1 and the matching degree of the image content of L images and T images in the K images is greater than a preset threshold, one image of the L images may be determined as the second image. Wherein L is a positive integer, and 1<L is less than or equal to K.

The preset threshold may be set according to practical situations, for example, the preset threshold is 90%. The embodiment of the present application is not specifically limited with respect to a specific value of the preset threshold.

Optionally, determining one of the L images as the second image includes, but is not limited to, any of:

Determining any one image in the L images as a second image;

and determining one image with the largest matching degree with the image content of the T images in the L images as a second image.

According to the method and the device for determining the image content of the K images, the image, of which the matching degree with the image content of the T images is larger than the preset threshold value, is determined to be the second image, the second image can be determined more simply, rapidly and conveniently, the photographing function of the electronic device can be enriched, and the requirements of users for photographing and splicing the synthesized images are met better.

Optionally, after determining K images matching the image content of the T images, further includes: on the shooting preview interface, K images are displayed.

Alternatively, after K images are determined, the K images may be displayed in a target area in the photographing preview interface.

The target area may be part or all of the first area in which the photographing preview interface is displayed.

A first input by a user to a second image of the K images is received.

Alternatively, the user may input the first input to the electronic device based on capturing the K images displayed on the preview interface.

A first input for determining a second image. The user can select one of the K images as the second image through the first input.

Alternatively, the first input may be a touch input, a voice input, a gesture input, or a key input to one of the K images or (K-1) images, or may be the first operation.

Alternatively, the first input may be any one of the following:

a user inputs a touch to a screen (hereinafter referred to as "screen") of the electronic device. For example, the touch input may be a touch input along a direction parallel to one diagonal of a certain area of the screen, or a touch input along a direction perpendicular to a first side of a certain area of the screen, or the like.

The user inputs voice to one of the K images. For example, a first image of the K images corresponds to "1", a second image corresponds to "2", and a third image corresponds to "3". If the user inputs a "1" in voice, the electronic device may receive the voice information "1" and determine as input to the first image; if the user inputs "2" by voice, the electronic device may receive the voice message "2" and determine as input to the second image; if the user inputs "3" with speech, the electronic device may receive the speech information "3" and determine to input the third image as described above.

Gesture input by the user to a certain area of the screen. For example, if the user makes a gesture input in a first direction parallel to the plane in which the screen lies, the electronic device may determine that the gesture input is an input to a first image of the K images; if the user makes a gesture input in a second direction parallel to the plane in which the screen lies, the electronic device may determine that the gesture input is an input to a second image of the K images.

It is to be understood that each of the above listed inputs is an exemplary list, i.e., embodiments of the present application include, but are not limited to, each of the above listed inputs. In practical implementation, the input may also include any other possible input, which may be specifically determined according to practical use requirements, and embodiments of the present application are not limited.

Displaying a second image in a first recommendation sub-window of the shooting preview interface, wherein the second image comprises: in response to the first input, a second image is displayed in a first recommendation sub-window of the capture preview interface.

Optionally, the electronic device may respond to the first input after receiving the first input.

Where the first input is an input or operation of one of the K images, the electronic device may determine that image (i.e., the one selected by the user) as the second image.

In the case where the first input is an input or an operation to (K-1) of the K images, the electronic device may determine one of the K images other than the (K-1) image (i.e., one image not selected by the user) as the second image.

After the second image is determined, the second image may be displayed in a first recommendation sub-window of the capture preview interface.

For example, as shown in fig. 4, the photographing preview interface includes 3 photographing sub-windows (photographing sub-window 401, photographing sub-window 402, and photographing sub-window 403) and 1 recommending sub-window (first recommending sub-window 404); the images obtained by shooting are displayed in all the 3 shooting sub-windows; the user clicks a control 405 for triggering the AI intelligent recommendation of the second image. The electronic device screens out 4 (i.e., k=4) images matching the image contents of the 3 images from the stored images in the image library based on the 3 images of the 3 photographing sub-windows, and displays the 4 images (image 501, image 502, image 503 and image 504) on the photographing preview interface as shown in fig. 5. The user may select the image 501 as the second image through the first input. As shown in fig. 6, a second image (image 501 in fig. 5) is displayed in the first recommendation sub-window 404.

According to the embodiment of the application, based on the first input of the user, the second image is determined and displayed in the first recommendation sub-window, the second image meeting the user requirement can be determined more simply, rapidly and conveniently, the photographing function of the electronic equipment can be enriched, the requirements of the user for photographing and splicing the composite images can be better met, and the flexibility and diversity of determining the second image are improved.

Optionally, each of the T photographing sub-windows corresponds to one camera.

Alternatively, the T images displayed in the T photographing sub-windows may be obtained by photographing with different cameras. Correspondingly, each shooting sub-window corresponds to one camera respectively.

For example, in the case that the mobile phone includes one front camera and three rear cameras, a first part of the T images may be obtained by the front camera, a second part may be obtained by the first rear camera, a third part may be obtained by the second rear camera, and a fourth part may be obtained by the third rear camera; correspondingly, the shooting sub-window of the first part in the T images corresponds to the front camera, the shooting sub-window of the second part in the T images corresponds to the rear camera I, the shooting sub-window of the third part in the T images corresponds to the rear camera II, and the shooting sub-window of the fourth part in the T images corresponds to the rear camera III.

According to the embodiment of the application, the images of the reality of each shooting sub-window are shot by different cameras, so that each first image can be obtained more conveniently and efficiently, each image to be synthesized can be determined more simply, rapidly and conveniently, the requirements of shooting by a user and splicing the synthesized images are met better, and the flexibility and diversity of acquiring the first images are improved.

Optionally, the shooting method further comprises: based on the content displayed by the N sub-windows, the display position of at least one shooting sub-window in the T shooting sub-windows is updated.

Optionally, before step 104, the display position of at least one shooting sub-window may be changed based on the content displayed by the N sub-windows, so as to implement automatic arrangement of the N sub-windows.

Alternatively, the display positions of the N sub-windows and the displayed content may be input into the detection model, and the N sub-windows after updating the display position of at least one of the T photographing sub-windows may be output. Before and after the display position is updated, the content displayed by each shooting sub-window is unchanged.

The detection model is obtained by taking the display position and the display content of each sample sub-window as a training sample, taking the synthesized image obtained by rearranging the display position of each sample sub-window based on the display content of each sample sub-window by a user as a label corresponding to the training sample, and training.

The detection model can be trained by a large number of high-quality synthetic images, a set of models with the capability of automatically arranging images can be trained for several typical scenes, and the image content of the target images obtained through synthesis can be ensured to be more in line with the requirements of users.

Rearranging the display positions of the sub-windows of each sample based on the content displayed by the sub-windows of each sample may be based on, but not limited to, the following scenarios:

1. full portrait scene: according to the gesture of portrait shooting, the direction of gaze, the tone of the image and the like, for example, the images with the same gesture, consistent gaze direction and too close tone are not arranged together as much as possible, and can be diagonally arranged so as to ensure the overall coordination of the synthesized images;

2. scene of person and scene combination: the tasks and the scenery are staggered as much as possible, so that the situation that people and people are arranged together with the scenery is avoided.

According to the method and the device for displaying the target image, based on the content displayed by the N sub-windows, the display position of at least one shooting sub-window in the T shooting sub-windows is updated, and the display positions of the N sub-windows are automatically re-shot, so that the target image can be ensured to be more in line with the requirements of users, and the target image which meets the requirements of the users can be obtained more efficiently.

Optionally, the shooting method further comprises: a second input from the user to the T capture sub-windows is received.

Optionally, before step 104, if the user is not satisfied with the combined effect of the images displayed based on the arrangement of the N sub-windows, a second input may be input to the electronic device, and the rearrangement of the N sub-windows may be performed manually, so that the N sub-windows are arranged in the arrangement that is satisfied by the user.

The second input may be a touch input, a voice input, a gesture input, or a key input to at least one photographing sub-window, or may be a second operation.

In response to the second input, at least one of the T capture sub-windows is updated.

Optionally, the second input may carry information such as an identifier of at least one capturing sub-window, after receiving the second input, respond to the second input, and may perform operations such as adding, deleting, exchanging, or changing a size on the T capturing sub-windows, so as to update the at least one capturing sub-window.

According to the method and the device for achieving the target image matching, based on the second input of the user to the T shooting sub-windows, at least one shooting sub-window in the T shooting sub-windows is updated, the T shooting sub-windows are rearranged, the harmony and the aesthetic feeling of the target image can be guaranteed, the target image meeting the user requirements can be obtained more efficiently, and the flexibility and the diversity of the sub-window arrangement and the image synthesis are improved.

Optionally, updating at least one of the T photographing sub-windows includes:

exchanging display positions of at least two shooting sub-windows;

deleting at least one shooting sub-window;

at least one photographing sub-window is added.

Alternatively, the at least two photographing sub-windows may be updated by exchanging display positions of the at least two photographing sub-windows.

It should be noted that, the sizes of the photographing sub-windows may be different, and the sizes of the photographing sub-windows are also exchanged during the process of exchanging the display positions of at least two photographing sub-windows.

For example, as shown in fig. 7, the photographing preview interface includes 3 photographing sub-windows (photographing sub-window 701, photographing sub-window 702, and photographing sub-window 703) and 1 recommending sub-window (recommending sub-window 704); the second input may be used to trigger the exchange of the display positions of the photographing sub-window 702 and the photographing sub-window 703, the display positions of the photographing sub-window 701 and the recommended sub-window 704 being unchanged. The response result of the second input is shown in fig. 8. Since the photographing sub-window 702 and the photographing sub-window 703 are different in size, the photographing sub-window 702 and the photographing sub-window 703 are also exchanged in size, that is, the size of the photographing sub-window 702 after update is the size of the photographing sub-window 703 before update, and the size of the photographing sub-window 703 after update is the size of the photographing sub-window 702 before update.

The target image obtained based on the content displayed in fig. 8 is shown in fig. 9.

It will be appreciated that if the sizes of the photographing sub-window 702 and the photographing sub-window 703 are the same, the sizes of the photographing sub-window 702 and the photographing sub-window 703 are exchanged without changing the sizes of the photographing sub-window 702 and the photographing sub-window 703.

Alternatively, at least one of the T photographing sub-windows may be updated by deleting at least one photographing sub-window.

Deleting the capture sub-window may result in a change in the number of capture sub-windows, and the size of the sub-windows that have not been deleted may be redetermined based on the target rules.

Alternatively, the area covered by the deleted photographing sub-window may be allocated to several sub-windows adjacent to the deleted photographing sub-window that are not deleted.

As shown in fig. 10, a photographing sub-window 1004 among 4 sub-windows (a recommended sub-window 1001, a photographing sub-window 1002, a photographing sub-window 1003, and a photographing sub-window 1004) is selected, the photographing sub-window 1004 is deleted, an area covered by the photographing sub-window 1004 can be allocated to the photographing sub-window 1002 based on a preset target rule, and the size of the photographing sub-window 1002 is adjusted. Each sub-window after the photographing sub-window 1004 in fig. 10 is deleted is shown in fig. 11.

Alternatively, at least one of the T photographing sub-windows may be updated by adding at least one photographing sub-window.

The second input may carry information of the number of photographing sub-windows to be increased, and may also carry information of a new arrangement of each sub-window after at least one photographing sub-window is increased.

After receiving the second entry, a plurality of shooting sub-windows can be added in the shooting preview interface based on the new arrangement mode.

The number of the sub-windows is changed due to the fact that the plurality of shooting sub-windows are increased, and the size of each sub-window can be redetermined based on the new arrangement mode.

The partial areas covered by the original multiple sub-windows before the shooting sub-windows are added can be allocated to the shooting sub-windows.

For example, as shown in fig. 12, based on the 4 sub-windows (sub-window 1201, sub-window 1202, sub-window 1203, and sub-window 1204) shown in fig. 12, two photographing sub-windows (photographing sub-window 1205 and photographing sub-window 1206) are added, and the new arrangement is as shown in fig. 15. As shown in fig. 15, a partial region covered by the sub-window 1201 and a partial region covered by the sub-window 1202 are allocated to the photographing sub-window 1205, and a partial region covered by the sub-window 1203 and a partial region covered by the sub-window 1204 are allocated to the photographing sub-window 1206.

According to the embodiment of the application, the at least one shooting sub-window is updated by means of exchanging the display positions of the shooting sub-windows, deleting the at least one shooting sub-window or adding the at least one shooting sub-window, so that the shooting sub-windows can be rearranged more conveniently and efficiently, target images meeting the requirements of users can be obtained more efficiently, and the flexibility and diversity of sub-window arrangement and image synthesis are improved.

Optionally, the shooting method further comprises: a third input of the user is received.

Optionally, a third input is used to determine a number of capture sub-window templates. Several, one or more.

The third input may be a touch input, a voice input, a gesture input, or a key input, or may be a third operation.

And shooting a sub-window template for representing the values of N, T and P and the size information and the position information of each sub-window.

Based on the photographing sub-window template, the number of sub-windows, the number of photographing sub-windows, the number of recommended sub-windows, and the size and display position of each sub-window may be determined.

In response to the third input, at least one capture sub-window template is displayed.

Optionally, after receiving the third input, in response to the third input, determining a plurality of photographing sub-window templates, and displaying the plurality of photographing sub-window templates.

A fourth input from the user to a target capture sub-window template of the at least one capture sub-window template is received.

Optionally, a fourth input is used for determining a target shooting sub-window template and updating display parameters of a shooting sub-window or a recommended sub-window of the target shooting sub-window template.

The fourth input may be a touch input, a voice input, a gesture input, or a key input, or may be a fourth operation.

In response to the fourth input, display parameters of the photographing sub-window or the recommended sub-window of the target photographing sub-window template are updated.

Wherein the display parameters include at least one of: the display position of the sub-windows and the number of the sub-windows.

Optionally, after receiving the fourth input, in response to the fourth input, it may be determined that one of the at least one photographing sub-window templates is the target photographing sub-window template.

For example, as shown in fig. 14, 4 photographing sub-window templates are displayed: upper + lower, left + upper right + lower right, upper left + upper right + lower left + lower right. The user can select, through the fourth input, a photographing sub-window template of "upper left+upper right+lower left+lower right" among the 4 photographing sub-window templates shown in fig. 14 as a target photographing sub-window template, to obtain a photographing preview interface as shown in fig. 15, where the photographing preview interface includes 4 sub-windows: a shooting sub-window 1501, a shooting sub-window 1502, a shooting sub-window 1503, and a recommendation sub-window 1504.

And the fourth input also carries the updating method of the display parameters of the shooting sub-window or the recommendation sub-window of the target shooting sub-window template. After determining the target capture sub-window template, at least one of the following may be updated based on the fourth input: the display position of a shooting sub-window of the target shooting sub-window template; the number of shooting sub-windows of the target shooting sub-window template; the display position of the recommended sub-window of the target shooting sub-window template; the number of recommended sub-windows of the target shooting sub-window template.

According to the method and the device for displaying the sub-window, the at least one shooting sub-window template is displayed in response to the received third input, the shooting sub-window of the target shooting sub-window template or the display parameters of the recommended sub-window are updated in response to the received fourth input, and a user can customize the required number of the recommended sub-windows or the shooting sub-windows and the display positions based on the existing shooting sub-window template, so that the flexibility and the diversity of sub-window arrangement can be improved.

It should be noted that, in the photographing method provided in the embodiment of the present application, the execution subject may be a photographing device, or a control module for executing the photographing method in the photographing device. In the embodiment of the present application, taking an example of a photographing method performed by a photographing device, the photographing device provided in the embodiment of the present application is described.

Fig. 16 is a schematic structural diagram of a photographing device according to an embodiment of the present application. Based on the content of any of the above embodiments, as shown in fig. 16, the apparatus includes an image capturing module 1601, a first display module 1602, a second display module 1603, and an image synthesizing module 1604, wherein:

an image capturing module 1601 for controlling the camera to capture a first image;

the first display module 1602 is configured to display a first image in a first shooting sub-window of a shooting preview interface, where the shooting preview interface includes N sub-windows, and the N sub-windows include T shooting sub-windows and P recommended sub-windows;

A second display module 1603, configured to display a second image in the first recommendation sub-window of the shooting preview interface;

an image synthesis module 1604, configured to generate a target image based on images displayed in the T capturing sub-windows and the P recommendation sub-windows;

Alternatively, the image capturing module 1601, the first display module 1602, the second display module 1603, and the image synthesizing module 1604 are electrically connected in order.

The image capturing module 1601 may control at least one camera to capture a first image based on set capturing parameters (including sensitivity, shutter time, focal length, white balance, etc.).

After obtaining the first image, the first display module 1602 may display the first image in the capture sub-window.

The second display module 1603 may display the second image in the recommendation sub-window after determining the second image.

The image synthesis module 1604 may synthesize the images displayed in the sub-windows according to the target arrangement mode in a stitching mode to generate an image. The generated image is the target image.

Optionally, the photographing device further includes:

the image acquisition module is used for acquiring T images of the T shooting sub-windows;

the image matching module is used for determining K images matched with the image content of the T images;

wherein K is a positive integer.

Optionally, the photographing device further includes:

and the image determining module is used for determining an image, of the K images, with the matching degree with the image content of the T images being greater than a preset threshold value, as a second image.

Optionally, the photographing device further includes:

the third display module is used for displaying K images on the shooting preview interface;

the first input module is used for receiving first input of a user on a second image in the K images;

the second display module 1603 is configured to display a second image in response to the first input in a first recommendation sub-window of the shooting preview interface.

Optionally, the photographing device further includes:

the first arrangement module is used for updating the display position of at least one shooting sub-window in the T shooting sub-windows based on the content displayed by the N sub-windows.

Optionally, the photographing device further includes:

the first input module is used for receiving second input of the user to the T shooting sub-windows;

and the second arrangement module is used for responding to the second input and updating at least one shooting sub-window in the T shooting sub-windows.

Optionally, the second arrangement module is configured to: exchanging display positions of at least two shooting sub-windows; deleting at least one shooting sub-window; at least one photographing sub-window is added.

Optionally, the photographing device further includes:

a third input module for receiving a third input from a user;

a fourth display module for displaying at least one photographing sub-window template in response to the third input;

a fourth input module, configured to receive a fourth input from a user to a target capturing sub-window template in the at least one capturing sub-window template;

the parameter updating module is used for responding to the fourth input and updating the display parameters of the shooting sub-window or the recommended sub-window of the target shooting sub-window template; wherein the display parameters include at least one of: the display position of the sub-windows and the number of the sub-windows.

The photographing device in the embodiment of the application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a cell phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, wearable device, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook or personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device may be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.

The photographing device in the embodiment of the application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The photographing device provided in the embodiment of the present application can implement each process implemented by the embodiments of the methods of fig. 1 to 15, and in order to avoid repetition, a detailed description is omitted here.

Optionally, as shown in fig. 17, the embodiment of the present application further provides an electronic device 1700, including a processor 1701, a memory 1702, and a program or an instruction stored in the memory 1702 and capable of being executed on the processor 1701, where the program or the instruction implements each process of the above-mentioned shooting method embodiment when executed by the processor 1701, and the process can achieve the same technical effect, and for avoiding repetition, a detailed description is omitted herein.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.

The electronic device 1800 includes, but is not limited to: a radio frequency unit 1801, a network module 1802, an audio output unit 1803, an input unit 1804, a sensor 1805, a display unit 1806, a user input unit 1807, an interface unit 1808, a memory 1809, and a processor 1810.

Those skilled in the art will appreciate that the electronic device 1800 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1810 by a power management system, such as to perform functions such as managing charge, discharge, and power consumption by the power management system. The electronic device structure shown in fig. 18 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown in the drawings, or may combine some components, or may be arranged in different components, which will not be described in detail herein.

The processor 1810 is configured to control the camera to capture a first image;

a display unit 1806, configured to display a first image in a first shooting sub-window of a shooting preview interface, where the shooting preview interface includes N sub-windows, and the N sub-windows include T shooting sub-windows and P recommended sub-windows; displaying a second image in a first recommendation sub-window of the shooting preview interface;

a processor 1810 for generating a target image based on images displayed in the T photographing sub-windows and the P recommended sub-windows;

Optionally, the processor 1810 is further configured to acquire T images of T capturing sub-windows; determining K images matched with the image content of the T images; wherein K is a positive integer.

Optionally, the processor 1810 is further configured to determine, as the second image, an image with a matching degree with the image content of the T images in the K images being greater than a preset threshold.

Optionally, the display unit 1806 is further configured to display K images on the shooting preview interface;

a user input unit 1807 for receiving a first input of a second image of the K images by a user;

the display unit 1806 is further configured to display, in response to the first input, a second image in the first recommendation sub-window of the photographing preview interface.

Optionally, the processor 1810 is further configured to update a display position of at least one of the T capturing sub-windows based on the content displayed by the N sub-windows.

Optionally, the user input unit 1807 is further configured to receive a second input from the user to the T capturing sub-windows;

the processor 1810 is further configured to update at least one of the T capturing sub-windows in response to the second input.

Optionally, the processor 1810 is further configured to:

exchanging display positions of at least two shooting sub-windows;

Deleting at least one shooting sub-window;

at least one photographing sub-window is added.

Optionally, the user input unit 1807 is further configured to receive a third input from a user;

the processor 1810 is further configured to display at least one capture sub-window template in response to a third input;

a user input unit 1807, configured to receive a fourth input from a user to a target capturing sub-window template in the at least one capturing sub-window template;

the processor 1810 is further configured to update a display parameter of a shooting sub-window or a recommended sub-window of the target shooting sub-window template in response to the fourth input; wherein the display parameters include at least one of: the display position of the sub-windows and the number of the sub-windows.

It should be appreciated that in embodiments of the present application, the input unit 1804 may include a graphics processor (Graphics Processing Unit, GPU) 18041 and a microphone 18042, with the graphics processor 18041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 1806 may include a display panel 18061, which may be configured in the form of a liquid crystal display, organic light emitting diodes, or the like, for the display panel 18061. The user input unit 1807 includes a touch panel 18071 and other input devices 18072. Touch panel 18071, also referred to as a touch screen. Touch panel 18071 may include two parts, a touch detection device and a touch controller. Other input devices 18072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein. Memory 1809 may be used to store software programs as well as various data including, but not limited to, target applications and operating systems. The processor 1810 may integrate an application processor that primarily handles operating systems, user interfaces, target applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 1810.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the program or the instruction realizes each process of the above-mentioned shooting method embodiment, and the same technical effect can be achieved, so that repetition is avoided, and no redundant description is provided herein.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running a program or instructions, implementing each process of the shooting method embodiment, and achieving the same technical effect, so as to avoid repetition, and no redundant description is provided herein.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims

1. A photographing method, comprising:

controlling a camera to shoot a first image;

displaying the first image in a first shooting sub-window of a shooting preview interface, wherein the shooting preview interface comprises N sub-windows, and the N sub-windows comprise T shooting sub-windows and P recommending sub-windows; each sub-window in the T shooting sub-windows corresponds to one camera; the T images displayed in the T shooting sub-windows are shot by different cameras;

the shooting sub-window is used for displaying a preview image and an image shot by the camera; the recommendation sub-window is used for displaying the stored images; n is an integer greater than 1, P, T is a positive integer, n=p+t;

before the first recommendation sub-window of the shooting preview interface displays the second image, the method further comprises: acquiring T images of the T shooting sub-windows; determining K images matched with the image content of the T images; determining an image, of the K images, with the matching degree with the image content of the T images being greater than a preset threshold value as a second image; wherein K is a positive integer; the K images satisfy at least one of the following conditions: the correlation between the K images and the image content of the T images meets a preset first condition; the light intensity changes in the K images and the T images accord with a preset second condition.

2. The photographing method of claim 1, wherein after determining K images matching the image contents of the T images, further comprising:

displaying the K images on a shooting preview interface;

receiving a first input of a user to a second image of the K images;

the displaying the second image in the first recommendation sub-window of the shooting preview interface comprises:

and responding to the first input, and displaying a second image in a first recommendation sub-window of the shooting preview interface.

3. The photographing method of claim 1, wherein each of the T photographing sub-windows corresponds to one camera.

4. The photographing method of claim 1, further comprising:

and based on the content displayed by the N sub-windows, updating the display position of at least one shooting sub-window in the T shooting sub-windows.

5. The photographing method of claim 1, further comprising:

receiving second input of a user to the T shooting sub-windows;

and in response to the second input, updating at least one of the T photographing sub-windows.

6. The photographing method of claim 5, wherein said updating at least one of said T photographing sub-windows comprises:

exchanging display positions of at least two shooting sub-windows;

deleting at least one shooting sub-window;

at least one photographing sub-window is added.

7. The photographing method of claim 1, further comprising:

receiving a third input from the user;

displaying at least one photographing sub-window template in response to the third input;

receiving a fourth input of a user to a target shooting sub-window template in the at least one shooting sub-window template;

in response to the fourth input, updating display parameters of a shooting sub-window or a recommendation sub-window of the target shooting sub-window template;

8. A photographing apparatus, comprising:

the first display module is used for displaying the first image in a first shooting sub-window of a shooting preview interface, wherein the shooting preview interface comprises N sub-windows, and the N sub-windows comprise T shooting sub-windows and P recommending sub-windows; each sub-window in the T shooting sub-windows corresponds to one camera; the T images displayed in the T shooting sub-windows are shot by different cameras;

the photographing apparatus further includes: the image acquisition module is used for acquiring T images of the T shooting sub-windows; the image matching module is used for determining K images matched with the image content of the T images; the image determining module is used for determining an image, of the K images, with the matching degree with the image content of the T images being greater than a preset threshold value as a second image; wherein K is a positive integer; the K images satisfy at least one of the following conditions: the correlation between the K images and the image content of the T images meets a preset first condition; the light intensity changes in the K images and the T images accord with a preset second condition.

9. An electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the shooting method of any of claims 1-7.

10. A readable storage medium, wherein a program or instructions is stored on the readable storage medium, which when executed by a processor, implements the steps of the shooting method according to any one of claims 1-7.