CN114339029B

CN114339029B - Shooting method and device and electronic equipment

Info

Publication number: CN114339029B
Application number: CN202111410459.5A
Authority: CN
Inventors: 申健成
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-11-23
Filing date: 2021-11-23
Publication date: 2024-04-23
Anticipated expiration: 2041-11-23
Also published as: CN114339029A

Abstract

The application discloses a shooting method, a shooting device and electronic equipment, wherein the shooting method comprises the following steps: displaying a first window and a second window in the shooting preview interface, wherein the first window is used for displaying a first preview image, and the second window is used for displaying a second preview image; receiving a first input of a user; in response to the first input, a spherical panoramic image is displayed in the capture preview interface, the spherical panoramic image being derived based on the first preview image and the second preview image.

Description

Shooting method and device and electronic equipment

Technical Field

The application belongs to the technical field of image pickup, and particularly relates to a shooting method, a shooting device and electronic equipment.

Background

At present, when a user needs to shoot panoramic images, the user can open a panoramic shooting mode of the electronic equipment, and move the electronic equipment in parallel so that the electronic equipment shoots a plurality of images in a moving process, and splice and fuse the shot images to obtain the panoramic images.

However, when the user moves the electronic device in parallel, there may be a deviation in the moving direction of the electronic device due to the shake of the hand of the user, so that the obtained panoramic image is distorted, blurred, and the like, and thus the panoramic image shot by the electronic device has poor effect.

Disclosure of Invention

The embodiment of the application aims to provide a shooting method, a shooting device and electronic equipment, which can solve the problem that panoramic images shot by the electronic equipment are poor in effect.

In order to solve the technical problems, the application is realized as follows:

In a first aspect, an embodiment of the present application provides a photographing method, including: displaying a first window and a second window in the shooting preview interface, wherein the first window is used for displaying a first preview image, and the second window is used for displaying a second preview image; receiving a first input of a user; in response to the first input, a spherical panoramic image is displayed in the capture preview interface, the spherical panoramic image being derived based on the first preview image and the second preview image.

In a second aspect, an embodiment of the present application provides a photographing apparatus, including: the display module is used for displaying a first window and a second window in the shooting preview interface, wherein the first window is used for displaying a first preview image, and the second window is used for displaying a second preview image. And the receiving module is used for receiving the first input of the user. And the display module is also used for responding to the first input received by the receiving module and displaying a spherical panoramic image in the shooting preview interface, wherein the spherical panoramic image is obtained based on the first preview image and the second preview image.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction implementing the steps of the method according to the first aspect when executed by the processor.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor perform the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In an embodiment of the present application, the electronic device may display a first window and a second window in the photographing preview interface, wherein the first window is used for displaying a first preview image, the second window is used for displaying a second preview image, and then the electronic device may receive and respond to a first input of a user to display a spherical panoramic image in the photographing preview interface, and the spherical panoramic image is obtained based on the first preview image and the second preview image. In the scheme, the electronic equipment can directly display a plurality of preview images in the shooting preview interface, and obtain a spherical panoramic image based on the plurality of preview images so as to show images obtained by shooting by cameras with different angles to a user, namely the electronic equipment can obtain panoramic images with a plurality of angles through shooting. Therefore, the user does not need to move the electronic equipment in parallel along a straight line, so that the problem that the moving direction of the electronic equipment is deviated due to the fact that the user's hand shake possibly exists when the user moves the electronic equipment in parallel is avoided, and the panoramic image with distortion and blurring is obtained.

Drawings

Fig. 1 is a schematic diagram of a photographing method according to an embodiment of the present application;

fig. 2 is an example schematic diagram of an interface of a mobile phone according to an embodiment of the present application;

FIG. 3 is a diagram illustrating a second example of an interface of a mobile phone according to an embodiment of the present application;

FIG. 4 is a third exemplary diagram of an interface of a mobile phone according to an embodiment of the present application;

FIG. 5 is a diagram illustrating an example of an interface of a mobile phone according to an embodiment of the present application;

FIG. 6 is a diagram showing an example of an interface of a mobile phone according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present application;

Fig. 8 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

fig. 9 is a second schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type, and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The shooting method provided by the embodiment of the application is described in detail through specific embodiments and application scenes thereof with reference to the accompanying drawings.

In the embodiment of the application, the electronic device can obtain a spherical panoramic image based on preview images of a plurality of angles, and compared with the prior art, the electronic device is required to be held by a user to move in parallel along a straight line, and if the user has the shake of hands and the like in the parallel movement process, the panoramic image shot by the electronic device may be blurred or distorted. In the scheme of the application, aiming at the images shot by the cameras with a plurality of angles, the electronic equipment can directly process the images to obtain a panoramic image with a plurality of angles, so that the step of shooting the panoramic image by a user is simplified, the difficulty of shooting the panoramic image by the user is reduced, and the quality of shooting the panoramic image by the electronic equipment is improved.

The embodiment of the application provides a shooting method, and fig. 1 shows a flowchart of the shooting method provided by the embodiment of the application. As shown in fig. 1, the photographing method provided by the embodiment of the present application may include the following steps 201 and 203.

Step 201, the electronic device displays a first window and a second window in a shooting preview interface.

In the embodiment of the application, the first window is used for displaying the first preview image, and the second window is used for displaying the second preview image.

In the embodiment of the application, a user can start the camera function (such as the camera function of the shooting application program) of the electronic equipment to trigger the electronic equipment to display the shooting preview interface of the shooting application program, so that the panoramic shooting mode is selected from a plurality of shooting modes. The electronic device defaults to turn on at least two cameras (e.g., a first camera and a second camera) in the mode, the electronic device can collect images through the at least two cameras simultaneously, then display a first window and a second window in a shooting preview interface, and display a first preview image in the first window, and display a second preview image in the second window.

Optionally, in the embodiment of the present application, the first preview image is an image acquired by the first camera, and the second preview image is an image acquired by the second camera; the shooting angle of the first camera is different from the shooting angle of the second camera, or the field angle of the first camera is different from the field angle of the second camera.

Optionally, in an embodiment of the present application, the at least two cameras may include at least two of the following: rear wide-angle camera, rear main camera, front wide-angle camera, front main camera, color camera, black and white camera, tele camera, zoom camera, depth camera, micro camera, etc.

It should be noted that the shooting angles of the at least two cameras may be different; or the shooting angles of part of the at least two cameras are different. And the mutual pose relation of the at least two cameras is in a known state, and the pose relation refers to internal parameters and external parameters among the cameras when the cameras are calibrated.

Optionally, in the embodiment of the present application, the electronic device may divide the screen into two screen areas with a central axis of the screen of the electronic device as a dividing line, where each screen area displays a window (for example, a first window and a second window) respectively, so as to display a corresponding preview image in the window; or the electronic device may divide the screen into two screen areas with a diagonal line of the screen of the electronic device as a dividing line, where each screen area displays a window (e.g., a first window and a second window) respectively, so as to display a corresponding preview image in the window; or the electronic device may divide the screen into two screen areas with different preset areas, where each screen area displays a window (e.g., a first window and a second window) respectively, so as to display a corresponding preview image in the window; the method can be specifically determined according to actual use requirements, and the embodiment of the application is not limited.

Optionally, in an embodiment of the present application, the central axis of the screen may be a vertical central axis or a horizontal central axis of the screen. The diagonal of the screen may be any diagonal of the screen.

Optionally, in the embodiment of the present application, when at least two preview images are displayed, the electronic device may mark the at least two preview images respectively, so as to distinguish the cameras corresponding to each preview image.

The electronic device is described by way of example as including four cameras. The electronic equipment comprises four cameras, namely a camera A, a camera B, a camera C and a camera D. When the electronic device displays the shooting preview interface, the shooting preview interface can be equally divided into four areas in a preset mode, each area is respectively displayed with a window so as to correspondingly display an image acquired by a camera in the window, then the electronic device can mark the display window frame of the camera A with a red frame, mark the display window frame of the camera B with a green frame, mark the display window frame of the camera C with a blue frame and mark the display window frame of the camera D with a yellow frame.

Optionally, in the embodiment of the present application, the electronic device may display a name of one camera at a display position of an image acquired by each camera in the capturing preview interface, so as to prompt a user about positions of a plurality of images included in the preview image.

For example, taking an electronic device as an example of a mobile phone, as shown in fig. 2, taking a mobile phone with four cameras as an example, the mobile phone displays a shooting preview interface 10 in a panoramic shooting mode, and displays image preview windows of the four cameras, namely, a window 11, a window 12, a window 13 and a window 14, on the shooting preview interface 10 in a preset form, so as to display images acquired by the four cameras in the four image preview windows.

Optionally, in the embodiment of the present application, before the step 201, the photographing method provided in the embodiment of the present application further includes the following steps 301 and 302.

Step 301, the electronic device receives a second input of a user.

Optionally, in the embodiment of the present application, after the camera function of the electronic device is enabled, the electronic device may be in a default shooting mode, that is, a shooting preview interface in the default shooting mode is displayed, and then the user may select a shooting mode (for example, a panoramic shooting mode) from at least one shooting mode in the electronic device, so as to trigger the electronic device to display a preview interface corresponding to the one shooting mode, so that the user may perform shooting input to trigger the electronic device to perform shooting in the one shooting mode.

Optionally, in an embodiment of the present application, the at least one shooting mode includes at least one of: a sports mode, a wide-angle mode, a manual exposure mode, a night view mode, a portrait mode, a large aperture mode, a panoramic shooting mode, a time-lapse shooting mode, an underwater mode, a shutter mode, a full-automatic mode, a slow motion mode and the like.

Optionally, in the embodiment of the present application, the second input may be a click input, a long press input, or a circle selection input of the user to the panoramic shooting mode, so as to trigger the electronic device to display a shooting preview interface under a shooting preview interface corresponding to the panoramic shooting mode. The method can be specifically determined according to actual use requirements, and the embodiment of the application is not limited.

Illustratively, as shown in fig. 3, the mobile phone displays a shooting preview interface 15 of a shooting application program, and displays a "mode selection" control 16 on the shooting preview interface 15, and a user can perform click input on the mode selection control 16 to trigger the electronic device to display a window 17, and display multiple shooting modes, such as a panoramic shooting mode, a dynamic shooting mode, and the like, in the window 17, so that the user can perform click input on the panoramic shooting mode in the multiple shooting modes to trigger the electronic device to enter the panoramic shooting mode.

Step 302, the electronic device displays a shooting preview interface in response to the second input.

In the embodiment of the application, after receiving the second input of the user to the panoramic shooting mode, the electronic device displays a shooting preview interface of the panoramic shooting mode.

In the embodiment of the application, in a panoramic shooting mode, the electronic equipment is allowed to acquire images through at least two cameras.

In the embodiment of the present application, the shooting preview interface includes at least two preview images, and each preview image corresponds to one camera.

In the embodiment of the application, when the shooting preview interface is displayed, the electronic equipment can acquire images through at least two cameras at the same time so as to acquire a plurality of images (for example, a first preview image and a second preview image), so that the electronic equipment can display the first preview image and the second preview image at the same time on the shooting preview interface, and then a user can perform shooting input so as to trigger the electronic equipment to shoot through the cameras.

The shooting preview interface includes images within the angles of view of at least two cameras. The angle of view refers to the angle range in which the camera can receive an image, and may also be referred to as a field of view, in which the lens of the optical instrument is taken as the vertex, and the object image of the measured object passes through the included angle formed by the two edges of the maximum range of the lens.

In the embodiment of the application, a user can select a target shooting mode from a plurality of shooting modes of the electronic equipment so as to trigger the electronic equipment to display an image preview interface of the shooting mode, and images acquired by at least two cameras of the electronic equipment are displayed in the interface so as to show the images acquired by all the cameras of the electronic equipment in the mode to the user.

Step 202, the electronic device receives a first input from a user.

Optionally, in the embodiment of the present application, the first input may be an input of a spherical panoramic shooting control in a shooting preview interface by a user, so as to trigger the electronic device to start shooting; or the shooting input may be input of a physical key or a physical key combination of the electronic device by a user, so as to trigger the electronic device to start shooting. It should be noted that the shooting input may be any possible input, and specifically may be determined according to actual use requirements, which is not limited by the embodiment of the present application.

In step 203, the electronic device displays a spherical panoramic image in a shooting preview interface in response to the first input.

In the embodiment of the application, the spherical panoramic image is obtained based on the first preview image and the second preview image.

Optionally, in an embodiment of the present application, the spherical panoramic image includes identification information, where the identification information includes at least one of the following: shooting object information and shooting time information.

In the embodiment of the application, the electronic device can perform synthesis processing on the first preview image and the second preview image to obtain the spherical panoramic image.

Optionally, in the embodiment of the present application, the electronic device may perform a synthesis process on the first preview image and the second preview image in a preset manner to obtain a spherical panoramic image; or the electronic device may use processing parameters preset or used by the user in a history manner to perform a combination process on the first preview image and the second preview image, so as to obtain the first image.

Optionally, in the embodiment of the present application, the electronic device may perform an image registration operation and a fusion operation on the first preview image and the second preview image to obtain the first image.

Optionally, in the embodiment of the present application, the electronic device may use default parameters of the system to perform a synthesis process on at least the first preview image and the second preview image, so as to obtain a spherical panoramic image; or the electronic equipment can adopt the parameters preset by the user to synthesize the first preview image and the second preview image so as to obtain a spherical panoramic image; or the electronic device may use the shooting parameters used by the user history to perform a combination process on the first preview image and the second preview image, so as to obtain the first image.

It should be noted that, the image registration operation of the embodiment of the present application can be understood as follows: and carrying out contour restoration and three-dimensional reconstruction on the image according to the characteristic point information or the neural network information in the image through an image registration algorithm.

The fusion process of the embodiments of the present application can be understood as: and matching the feature points of the multiple images after contour restoration and three-dimensional reconstruction, and carrying out registration fusion operation according to the same matching content to obtain a spherical panoramic image.

Optionally, in the embodiment of the present application, the electronic device may perform contour restoration and stereoscopic reconstruction on the first preview image and the second preview image according to feature point information of the first preview image and the second preview image.

The feature point information refers to: information reflecting the essential characteristics of the image. The feature point information can identify a target object in the image so that an algorithm in the electronic device can complete matching of the image through matching of the feature points.

Optionally, in the embodiment of the present application, a neural network may be downloaded in advance in an electronic device, and training may be performed on the first preview image and the second preview image, for example, an original picture is input into a neural network model, so that learning processing is performed on the input original picture through the neural network model, so that contour restoration and stereoscopic reconstruction may be performed on the first preview image and the second preview image.

Optionally, in an embodiment of the present application, the feature point information may include at least one of the following: location information, pixel information, color information, character information, environment information, brightness information, exposure information, and the like.

Optionally, in the embodiment of the present application, the electronic device performs a fusion operation on the first preview image and the second preview image after contour restoration and stereoscopic reconstruction, so as to obtain the first image.

Optionally, in the embodiment of the present application, the electronic device may train the information of the first preview image and the second preview image, for example, input the first preview image and the second preview image after contour restoration and stereo reconstruction into the fusion model, so as to perform matching learning processing on the same content of the input first preview image and second preview image through the fusion model, thereby outputting the first image.

For example, the electronic device may perform fusion processing on the same region of the character information in the first preview image and the second preview image and perform image stitching, so as to obtain the first image.

Optionally, in the embodiment of the present application, the electronic device may use an optical flow algorithm to perform image matching on the first preview image and the second preview image after contour restoration and stereo reconstruction, so as to perform a fusion operation on the first preview image and the second preview image.

Optionally, in the embodiment of the present application, the electronic device performs stereo image processing on the first image according to the depth information of the first preview image and the second preview image, so as to obtain a spherical panoramic image.

The stereoscopic image processing of the first image described above means: in combination with the depth information, the second image is rendered and stitched into a spherical image, which is similar to a hologram, which can produce a panoramic effect similar to a three-dimensional (3D).

Alternatively, in one manner, the obtaining of the depth information may be a depth estimation algorithm understood based on the image content, by classifying each scene block in the image, and then estimating the depth information of the classified scenes by using an algorithm applicable to each scene.

In yet another manner, the electronic device may use a Depth estimation algorithm that is focused to bring the camera into Focus with respect to the point under test using Depth of Focus (DFF), and then determine the distance of the point under test with respect to the camera according to a lens imaging formula.

In yet another approach, the electronic device may recover the depth image by extracting artificial features of monocular visual cues for the image region based on a depth map estimation algorithm of the map model, and modeling relationships between features and depth and links between image contexts using the map model. Since the formation of a two-dimensional planar image is a projection of a three-dimensional scene, when a two-dimensional planar image is given, there may be numerous three-dimensional scenes corresponding to the two-dimensional planar image, but not all the scenes conform to human understanding, and only the scenes conforming to human understanding, the three-dimensional scenes deduced by using human priori knowledge may obtain correct depth information.

Illustratively, as shown in fig. 2 and fig. 4, the mobile phone further displays a shooting control 18 in the shooting preview interface 10, the user can input the shooting control 18, and the electronic device, in response to the shooting input of the user, performs a synthesis process on the image of the window 11, the image of the window 12, the image of the window 13 and the image of the window 14 to obtain a spherical panoramic image, and displays the spherical panoramic image in the shooting preview interface 10.

Optionally, in an embodiment of the present application, the shooting object information includes at least one of the following: shooting object distance information, name information, and position information. The photographing object distance information refers to a distance of the photographing object from the electronic device, the name information refers to a name of the photographing object, and the position information refers to a geographical position of the photographing object.

In the embodiment of the application, after the first input of the user is received, the electronic equipment can carry out multiple processing on the obtained first preview image and the obtained second preview image to obtain the spherical panoramic image without the need of the user to move the electronic equipment in parallel along a straight line, so that the phenomenon that the shot image is blurred or distorted possibly caused by hand shake when the user moves in parallel is avoided, and the electronic equipment can display the target file in a spherical center view angle or a spherical outside view angle so as to show a more stereoscopic image for the user, thus simplifying the step of shooting the panoramic image by the user, reducing the difficulty of shooting the panoramic image by the user, improving the stereoscopic effect of the panoramic image shot by the electronic equipment, simplifying the step of shooting the panoramic image by the user, reducing the difficulty of shooting the panoramic image by the user, and improving the quality of the panoramic image shot by the electronic equipment.

The embodiment of the application provides a shooting method, electronic equipment can directly display a plurality of preview images in a shooting preview interface, and a spherical panoramic image is obtained based on the preview images, so that images obtained by shooting by cameras with different angles are shown to a user, namely, the electronic equipment can obtain panoramic images with the angles through shooting. Therefore, the user does not need to carry out parallel movement on the electronic equipment along a straight line, so that the problem that the moving direction of the electronic equipment is deviated due to the fact that the user's hand shake possibly exists when the user carries out parallel movement on the electronic equipment, so that a distorted and fuzzy panoramic image is obtained is avoided.

Optionally, in the embodiment of the present application, after the step 203, the photographing method provided in the embodiment of the present application further includes the following step 401.

Step 401, the electronic device obtains a target file based on the spherical panoramic image.

In the embodiment of the application, the target file comprises at least one of the following: images, video.

According to the embodiment of the application, the electronic equipment can display the target files acquired by at least two cameras to the user based on the spherical panoramic image, so that the user can conveniently generate the target files or the target videos based on the spherical panoramic image according to the requirements, the content of the image or the video is enriched, and the interestingness is improved.

Optionally, in the embodiment of the present application, in the case that the target file includes an image, after step 401 described above, the photographing method provided in the embodiment of the present application further includes step 501 and step 504 described below.

Step 501, the electronic device receives a third input from a user to the first target area in the target file.

In the embodiment of the application, the user can perform the third input on the first target area in the target file to trigger the electronic equipment to edit the target file or display the shooting information of the target file.

Optionally, in the embodiment of the present application, the third input may be a long-press input of the user to the first target area in the target file, so as to trigger the electronic device to edit the first target area in the target file; or the third input may be input by the user to an edit control corresponding to the first target area in the target file, so as to trigger the electronic device to edit the first target area in the target file.

Optionally, in the embodiment of the present application, the third input may be a long-press input of the user to the first target area in the target file, so as to trigger the electronic device to display shooting information of the target file; or the third input may be input by the user to a control corresponding to the first target area in the target file, so as to trigger the electronic device to display shooting information of the target file.

Step 502, the electronic device displays at least one alternative image in response to a third input.

In the embodiment of the application, after receiving the third input of the user to the first target area of the target file, the electronic device displays at least one alternative image, so that the user can input the target alternative image in the at least one alternative image, and the electronic device is triggered to edit the target file according to the input of the user.

Optionally, in the embodiment of the present application, after receiving the third input of the user to the first target area of the target file, the electronic device displays at least one candidate image in a form of a floating window, and the user may perform a sliding input in the floating window to trigger the electronic device to display more candidate images.

Step 503, the electronic device receives a fourth input of a user for a target candidate image of the at least one candidate image.

In the embodiment of the application, after the electronic device displays at least one alternative image, a user can perform fourth input on a target alternative image in the at least one alternative image so as to trigger the electronic device to process a first target area of the target file.

Optionally, in the embodiment of the present application, the fourth input may be a click input (a single click input, a double click input, or a preset number of click inputs) of the target candidate image by the user, a long press input, or the like, so as to trigger the electronic device to edit the first target area according to the target candidate image.

After capturing the target file, if the user desires to edit the first target area of the target file, for example, add the image of the bead Mu Lama peak in the first target area, the user may perform edit input on the first target area image, for example, input an edit control to trigger the electronic device to display a plurality of candidate images, then the user may select an image of the bead-murmur peak from the plurality of candidate images, and perform image addition, and the electronic device performs superposition and fusion processing on the image of the bead-murmur peak and the target file in response to a fourth input of the user, so as to obtain the file demanded by the user.

In response to the fourth input, the electronic device displays a target candidate image in the first target area, step 504.

Optionally, in the embodiment of the present application, after receiving the fourth input of the user to the target candidate image in the at least one candidate image, the electronic device displays the newly added target candidate image in the first target area, or may display the target candidate image in a manner of replacing the original image of the first target area.

In the embodiment of the application, the electronic equipment can respond to the input of the user to the target file, edit the target file to display shooting information when the electronic equipment shoots the image, or obtain the image with richer effect or more in line with the requirement of the user, thus improving the interest of the user in editing the image, improving the experience of the user in editing the image, enriching the effect of the electronic equipment in processing the image, and improving the flexibility of the electronic equipment in processing the image.

Optionally, in the embodiment of the present application, in the case that the target file includes an image, after step 401 described above, the photographing method provided in the embodiment of the present application further includes step 601 and step 602 described below.

Step 601, the electronic device receives a fifth input from a user.

In the embodiment of the application, after the electronic equipment obtains the target file, the target file can be displayed in a spherical three-dimensional form, namely, the spherical three-dimensional image is displayed, and the user can input the spherical three-dimensional image to trigger the electronic equipment to display each image area of the spherical three-dimensional image, so that the user can view the image of each image area of the spherical three-dimensional image.

Optionally, in the embodiment of the present application, the fifth input may be a drag input of the user to a second target area in the target file, so as to trigger the electronic device to display each image area of the spherical stereoscopic image; or the fifth input may be a sliding input of the user to a second target area in the target file, so as to trigger the electronic device to display each image area of the spherical stereoscopic image; the fifth input may be a rotational input of a user to a second target area in the target file, so as to trigger the electronic device to display each image area of the spherical stereoscopic image; or the fifth input may be a long press input by the user to the second target area in the target file, so as to trigger the electronic device to display each image area of the spherical stereoscopic image. The method and the device can be specifically determined according to actual use requirements of users, and the embodiment of the application is not limited.

Optionally, in the embodiment of the present application, the fifth input may include a first sub-input and a second sub-input, where the first sub-input may be a click input of the user on the target file to trigger the electronic device to display the target file, and the second sub-input may be a rotation input of the user on a second target area in the target file to trigger the electronic device to display the images of the spherical stereoscopic image at various angles.

Optionally, in the embodiment of the present application, after processing the first preview image and the second preview image to obtain the target file and saving the target file to the local library, the electronic device may perform a first sub-input on the target file when browsing the image of the local library, so as to trigger the electronic device to display the target file.

Optionally, in the embodiment of the present application, the first sub-input may be a click input (for example, a single click input, a double click input, or a preset number of single click inputs) or a long press input of the user on the target file, so as to trigger the electronic device to display the target file. The method and the device can be specifically determined according to actual use requirements of users, and the embodiment of the application is not limited.

Optionally, in the embodiment of the present application, after responding to the first sub-input of the user and displaying the target file, the user may perform the second sub-input on the target file to trigger the electronic device to display the images of the angles of the target file.

Step 602, the electronic device performs a target process in response to the fifth input.

In an embodiment of the present application, the target processing includes at least one of: updating the display angle of the image corresponding to the second target area; updating the display proportion of the image corresponding to the second target area; updating the display angle of the target file; and updating the display proportion of the target file.

In the embodiment of the application, the electronic equipment responds to the fifth input of the user to the target file, and updates the display angle of the image corresponding to the second target area according to the input parameter of the fifth input, namely, the user can input the second target area in the target file to trigger the electronic equipment to rotate the image corresponding to the second target area and update the display angle of the image corresponding to the second target area; or the electronic equipment responds to the fifth input of the user to the target file, and the display proportion of the image corresponding to the second target area is updated according to the input parameter of the fifth input, namely the user can input the second target area of the target file so as to trigger the electronic equipment to enlarge or reduce the display proportion of the image corresponding to the second target area and update and display the display proportion of the image corresponding to the second target area; or the electronic equipment responds to the fifth input of the user on the target file, rotates the target file according to the input parameter of the fifth input, and updates the display angle of the target file so as to display each image area of the target file, namely each image area of the spherical stereoscopic image; or the electronic equipment responds to the fifth input of the user on the target file, and enlarges or reduces the display proportion of the target file according to the input parameter of the fifth input so as to update the display proportion of the display target file, namely the display proportion of the spherical stereoscopic image.

Optionally, in the embodiment of the present application, the input parameter of the fifth input may include an input time parameter of long-press input of the target file by the user, so that the electronic device rotates the target file according to the length of the time; or the input parameters may include a drag angle parameter of a drag input of the user to the target file, so that the electronic device rotates the target file according to the drag angle; the input parameters may include a sliding length parameter of a sliding input of the target file by the user, such that the electronic device rotates the target file according to the sliding length.

Optionally, in the embodiment of the present application, because the target file is a spherical panoramic image or a spherical panoramic video, the electronic device may rotate the target file according to input parameters of a user with a spherical viewing angle as a reference point, so as to display images of each area of the target file; or the electronic device can rotate the target file by taking any one view outside the sphere as a view reference point according to the input parameters of the user so as to display the images of the areas of the target file.

As shown in fig. 4 and 5, the mobile phone displays the target file in the image browsing interface 19 with any view angle outside the target file sphere as the view angle reference point, and the user can perform sliding input on the target file to trigger the mobile phone to display the images of the respective areas of the target file.

Optionally, in the embodiment of the present application, the electronic device may adjust a stitching manner of the first preview image and the second preview image in the target file, so as to implement a process of stitching the first preview image and the second preview image again; or the electronic device can adjust the fusion degree of the first preview image and the second preview image in the target file; or for electronic devices may add filters to the target file.

Optionally, in an embodiment of the present application, the shooting information may include at least one of the following: shooting time information of the target file, shooting place information of the target file, shooting environment information of the target file, shooting equipment information of the target file, and the like.

As shown in fig. 5 and fig. 6 (a), the mobile phone displays the target file in the image browsing interface 19, the user can perform long-press input on the target file to trigger the electronic device to enter the image editing interface 20, so that the target file enters an editable state, four images for synthesizing the target file are displayed in four areas in the image editing interface 20, and then the user can continue to input the target file in the editable state, for example, adjust the height of an object in the image, so as to obtain the target file more meeting the requirements of the user. Referring to fig. 6, as shown in (B) of fig. 6, the mobile phone displays a second target area in the image browsing interface 20, and the user may perform long press input on the second target area to trigger the mobile phone to display shooting information of a target file in the second target area, for example, to display a geographic name of "jilin changbai mountain", or to display a name of a person of a shooting object.

In this embodiment, when the target file is a video, each frame of video frame can be viewed under the condition of suspending playing, and the viewing mode is the same as that when the target file is an image.

According to the embodiment of the application, the user can check the shot target file and rotate the target file according to the input parameters of the user, so that the user can check the target file from multiple angles, the interest of checking the target file by the user is increased, the experience of checking the target file by the user is enriched, the flexibility of displaying the target file by the electronic equipment is improved, and the effect of displaying the target file by the electronic equipment is enriched.

It should be noted that, in the photographing method provided in the embodiment of the present application, the execution subject may be an electronic device, a photographing apparatus, or a control module in the photographing apparatus for executing the photographing method. In the embodiment of the application, taking an example of a shooting method executed by electronic equipment, the shooting method provided by the embodiment of the application is described.

Fig. 7 shows a schematic diagram of a possible configuration of a photographing apparatus according to an embodiment of the present application. As shown in fig. 7, the photographing device 70 may include: a display module 71, a receiving module 72.

The display module 71 is configured to display a first window and a second window in the shooting preview interface, where the first window is used to display a first preview image, and the second window is used to display a second preview image. A receiving module 72 for receiving a first input from a user. The display module 71 is further configured to display, in response to the first input received by the receiving module 72, a spherical panoramic image in the photographing preview interface, the spherical panoramic image being obtained based on the first preview image and the second preview image.

The embodiment of the application provides a shooting device, electronic equipment can directly display a plurality of preview images in a shooting preview interface, and a spherical panoramic image is obtained based on the preview images, so that images obtained by shooting by cameras with different angles are shown to a user, namely, the electronic equipment can obtain panoramic images with the angles through shooting. Therefore, the user does not need to move the electronic equipment in parallel along a straight line, so that the problem that the moving direction of the electronic equipment is deviated due to the fact that the user's hand shake possibly exists when the user moves the electronic equipment in parallel is avoided, and the panoramic image with distortion and blurring is obtained.

In a possible implementation, the receiving module 72 is further configured to receive the second input from the user before the display module 71 displays the first window and the second window in the shooting preview interface. The display module 71 is further configured to display a shooting preview interface in response to the second input received by the receiving module 72.

In one possible implementation, the first preview image is an image acquired by the first camera, and the second preview image is an image acquired by the second camera; the shooting angle of the first camera is different from the shooting angle of the second camera, or the field angle of the first camera is different from the field angle of the second camera.

In one possible implementation, the spherical panoramic image includes identification information, where the identification information includes at least one of: shooting object information and shooting time information.

In one possible implementation manner, the photographing device 70 further includes: and a processing module. The processing module is configured to obtain, based on the spherical panoramic image, a target file after the display module 71 displays the spherical panoramic image in the shooting preview interface, where the target file includes at least one of: images, video.

In a possible implementation, where the target file includes an image, the receiving module 72 is further configured to receive a third input from the user to the first target area in the target file after the processing module obtains the target file based on the spherical panoramic image. The display module 71 is further configured to display at least one alternative image in response to the third input received by the receiving module 72. The receiving module 72 is further configured to receive a fourth input from the user for a target candidate image of the at least one candidate image. The display module 71 is further configured to display a target candidate image in the first target area in response to the fourth input received by the receiving module 72.

In one possible implementation manner, in a case where the target file includes an image, the photographing device 70 further includes: and executing the module. The receiving module 72 is further configured to receive a fifth input from the user after the processing module obtains the target file based on the spherical panoramic image. An execution module for executing, in response to the fifth input received by the receiving module 72, a target process including at least one of: updating the display angle of the image corresponding to the second target area; updating the display proportion of the image corresponding to the second target area; updating the display angle of the target file; and updating the display proportion of the target file.

The shooting device in the embodiment of the application can be a device, and can also be a component, an integrated circuit or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc., and the non-mobile electronic device may be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a Television (TV), a teller machine, a self-service machine, etc., and the embodiments of the present application are not limited in particular.

The photographing device in the embodiment of the application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.

The shooting device provided by the embodiment of the application can realize each process realized by the embodiment of the method and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

Optionally, as shown in fig. 8, the embodiment of the present application further provides an electronic device 90, including a processor 91, a memory 92, and a program or an instruction stored in the memory 92 and capable of running on the processor 91, where the program or the instruction implements each process of the embodiment of the method when executed by the processor 91, and the process can achieve the same technical effect, so that repetition is avoided, and no further description is given here.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.

Fig. 9 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.

Those skilled in the art will appreciate that the electronic device 100 may further include a power source (e.g., a battery) for powering the various components, and that the power source may be logically coupled to the processor 110 via a power management system to perform functions such as managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 9 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

And a display unit 106 for displaying a first window for displaying the first preview image and a second window for displaying the second preview image in the photographing preview interface. A user input unit 107 for receiving a first input of a user. The display unit 106 is further configured to display, in response to the first input, a spherical panoramic image in the photographing preview interface, the spherical panoramic image being obtained based on the first preview image and the second preview image.

The embodiment of the application provides electronic equipment, which can directly display a plurality of preview images in a shooting preview interface, and obtain a spherical panoramic image based on the preview images so as to show images obtained by shooting a plurality of cameras with different angles to a user, namely the electronic equipment can obtain panoramic images with a plurality of angles through shooting. Therefore, the user does not need to move the electronic equipment in parallel along a straight line, so that the problem that the moving direction of the electronic equipment is deviated due to the fact that the user's hand shake possibly exists when the user moves the electronic equipment in parallel is avoided, and the panoramic image with distortion and blurring is obtained.

Optionally, in the embodiment of the present application, the user input unit 107 is further configured to receive a second input from the user before the first window and the second window are displayed in the shooting preview interface. The display unit 106 is further configured to display a shooting preview interface in response to the second input.

Optionally, in an embodiment of the present application, the processor 110 is configured to obtain, after displaying the spherical panoramic image in the preview interface, a target file based on the spherical panoramic image, where the target file includes at least one of: images, video.

Optionally, in the embodiment of the present application, in a case where the target file includes an image, the user input unit 107 is further configured to receive, after obtaining the target file based on the spherical panoramic image, a third input from the user to the first target area in the target file. The display unit 106 is further configured to display at least one alternative image in response to the third input. The user input unit 107 is further configured to receive a fourth input of a target candidate image of the at least one candidate image by a user. The display unit 106 is further configured to display a target candidate image in the first target area in response to the fourth input.

Alternatively, in the embodiment of the present application, in the case that the target file includes an image, the user input unit 107 is further configured to receive a fifth input of the user after obtaining the target file based on the spherical panoramic image. A processor 110 for performing, in response to a fifth input, a target process comprising at least one of: updating the display angle of the image corresponding to the second target area; updating the display proportion of the image corresponding to the second target area; updating the display angle of the target file; and updating the display proportion of the target file.

The electronic device provided by the embodiment of the application can realize each process realized by the embodiment of the method and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

The beneficial effects of the various implementation manners in this embodiment may be specifically referred to the beneficial effects of the corresponding implementation manners in the foregoing method embodiment, and in order to avoid repetition, the description is omitted here.

It should be appreciated that in embodiments of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g. a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein. Memory 109 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The embodiment of the application also provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the above method embodiment, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted here.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The embodiment of the application further provides a chip, which comprises a processor and a communication interface, wherein the communication interface is coupled with the processor, and the processor is used for running programs or instructions to realize the processes of the embodiment of the method, and can achieve the same technical effects, so that repetition is avoided, and the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

Claims

1. A photographing method applied to a photographing device, the method comprising:

displaying a first window and a second window in a shooting preview interface, wherein the first window is used for displaying a first preview image, and the second window is used for displaying a second preview image;

Receiving a first input of a user;

Responding to the first input, carrying out contour restoration and stereoscopic reconstruction on the first preview image and the second preview image, carrying out fusion operation on the first preview image and the second preview image after contour restoration and stereoscopic reconstruction to obtain a first image, and carrying out stereoscopic image processing on the first image to obtain a spherical panoramic image;

displaying the spherical panoramic image in the shooting preview interface;

After the spherical panoramic image is displayed in the shooting preview interface, the method further comprises:

Obtaining a target file based on the spherical panoramic image;

Receiving a third input of a user to a first target area in the target file when the target file comprises an image;

Displaying at least one alternative image in response to the third input;

Receiving a fourth input of a user to a target candidate image in at least one candidate image;

and displaying the target alternative image in the first target area in response to the fourth input.

2. The photographing method of claim 1, wherein before displaying the first window and the second window in the photographing preview interface, further comprising:

Receiving a second input from the user;

and displaying a shooting preview interface in response to the second input.

3. The photographing method of claim 1, wherein the first preview image is an image acquired by a first camera, and the second preview image is an image acquired by a second camera; the shooting angle of the first camera is different from the shooting angle of the second camera, or the view angle of the first camera is different from the view angle of the second camera.

4. The photographing method of claim 1, wherein the spherical panoramic image includes identification information therein, the identification information including at least one of: shooting object information and shooting time information.

5. The photographing method of claim 1, wherein the object file comprises at least one of: images, video.

6. A photographing apparatus, the apparatus comprising: the display module and the receiving module;

The display module is used for displaying a first window and a second window in the shooting preview interface, wherein the first window is used for displaying a first preview image, and the second window is used for displaying a second preview image;

The receiving module is used for receiving a first input of a user;

the display module is further configured to perform contour restoration and stereoscopic reconstruction on the first preview image and the second preview image in response to the first input received by the receiving module, perform fusion operation on the first preview image and the second preview image after contour restoration and stereoscopic reconstruction, obtain a first image, perform stereoscopic image processing on the first image, obtain a spherical panoramic image, and display the spherical panoramic image in the shooting preview interface;

The apparatus further comprises: a processing module;

The processing module is used for obtaining a target file based on the spherical panoramic image after the display module displays the spherical panoramic image in the shooting preview interface;

The receiving module is further configured to receive, when the target file includes an image, a third input from a user to a first target area in the target file after the processing module obtains the target file based on the spherical panoramic image;

the display module is further used for displaying at least one alternative image in response to the third input received by the receiving module;

The receiving module is further used for receiving a fourth input of a user on a target alternative image in at least one alternative image;

The display module is further configured to display the target candidate image in the first target area in response to the fourth input received by the receiving module.

7. The photographing device as claimed in claim 6, wherein,

The receiving module is further used for receiving a second input of the user before the display module displays the first window and the second window in the shooting preview interface;

And the display module is also used for responding to the second input received by the receiving module and displaying a shooting preview interface.

8. The photographing device of claim 6, wherein the first preview image is an image captured by a first camera and the second preview image is an image captured by a second camera; the shooting angle of the first camera is different from the shooting angle of the second camera, or the view angle of the first camera is different from the view angle of the second camera.

9. The photographing device of claim 6, wherein the spherical panoramic image includes identification information therein, the identification information including at least one of: shooting object information and shooting time information.

10. The photographing device of claim 6, wherein the object file comprises at least one of: images, video.

11. An electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the shooting method of any one of claims 1 to 5.