WO2021169669A1

WO2021169669A1 - Photography composition method, terminal, and storage medium

Info

Publication number: WO2021169669A1
Application number: PCT/CN2021/072503
Authority: WO
Inventors: 黄海东
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-02-28
Filing date: 2021-01-18
Publication date: 2021-09-02
Also published as: CN111277760B; CN111277760A

Abstract

Provided are a photography composition method, a terminal, and a storage medium. The method is applied to the terminal. The terminal comprises a first camera and a second camera, wherein the view angle range of the first camera is larger than the view angle range of the second camera. The method comprises: when a photography composition function is triggered, collecting a first preview image by using a first camera; displaying the first preview image on a photography preview interface, and displaying, on the first preview image, a recommended composition frame corresponding to a recommended composition image, wherein the recommended composition image is an image determined from the first preview image; and when it is detected that an image collection area corresponding to a second camera moves to the recommended composition frame, photographing the recommended composition image in the recommended composition frame by using the second camera.

Description

Photographing composition method, terminal and storage medium

Cross-references to related applications

This application is based on a Chinese patent application with an application number of 202010129110.3 and an application date of February 28, 2020, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated into this application by way of introduction.

Technical field

This application relates to the field of electronic applications, and in particular to a method, terminal, and storage medium for photographing composition.

Background technique

The composition technology in the camera technology is a relatively professional skill. Many ordinary photographers do not have the skills to shoot composition, do not know how to adjust the lens orientation or the lens orientation adjustment is inaccurate, resulting in poor visual effects of the image and low shooting intelligence. problem.

Summary of the invention

The embodiments of the present application provide a photographing composition method, a terminal, and a storage medium, which can improve the visual effect of an image and improve the intelligence of photographing.

The technical solution of this application is realized as follows:

An embodiment of the present application provides a method for photographing composition, which is applied to a terminal, the terminal includes a first camera and a second camera, the viewing angle range of the first camera is larger than the viewing angle range of the second camera, and the method includes:

When the shooting composition function is triggered, use the first camera to collect the first preview image;

Display the first preview image on the shooting preview interface, and display the recommended composition frame corresponding to the recommended composition image on the first preview image, and the recommended composition image is an image determined from the first preview image ；

When it is detected that the image capture area corresponding to the second camera moves to the suggested composition frame, the second camera is used to capture the suggested composition image in the suggested composition frame.

An embodiment of the present application provides a terminal, the terminal includes a first camera and a second camera, the first camera has a larger viewing angle range than the second camera, and the terminal includes:

The acquisition part is configured to use the first camera to acquire a first preview image when the shooting composition function is triggered;

The display part is configured to display the first preview image on the shooting preview interface, and display a suggested composition frame corresponding to the suggested composition image on the first preview image, and the suggested composition image is from the first preview image The image identified in

The photographing part is configured to use the second camera to photograph the suggested composition image in the suggested composition frame when it is detected that the image acquisition area corresponding to the second camera moves to the suggested composition frame.

An embodiment of the present application provides a terminal, which includes: a processor, a display, a memory, and a communication bus; when the processor executes an operating program stored in the memory, the method according to any one of the above is implemented.

The embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method according to any one of the above is implemented.

The embodiment of the present application provides a photographing composition method, a terminal, and a storage medium, which are applied to a terminal. The terminal includes a first camera and a second camera. The viewing angle range of the first camera is larger than the viewing angle range of the second camera. The method includes: When the shooting composition function is triggered, the first camera is used to collect the first preview image; the first preview image is displayed on the shooting preview interface, and the recommended composition frame corresponding to the recommended composition image is displayed on the first preview image. The recommended composition image is from the first preview image. An image determined in the preview image; when it is detected that the image capture area corresponding to the second camera has moved to the recommended composition frame, the second camera is used to shoot the recommended composition image in the recommended composition frame. With the above implementation scheme, since the first camera captures a wider range, the terminal uses the first camera to capture the first preview image, and uses the preset target detection model to determine from the first preview image that the capture size of the second camera is the same Therefore, the photographer can move the image capture frame of the second camera to the recommended composition frame corresponding to the recommended composition image, so that the visual effect of the captured image is good, and the intelligence of shooting is improved.

Description of the drawings

FIG. 1 is a flowchart of a method for shooting composition according to an embodiment of the application;

2 is an exemplary interface display diagram for displaying the preview frame and suggested composition frame of the main camera in the first preview image according to an embodiment of the application;

FIG. 3 is an exemplary interface display diagram of a recommended composition image taken by a main camera of a terminal according to an embodiment of the application; FIG.

FIG. 4 is a schematic flowchart of an exemplary terminal automatic composition composition provided by an embodiment of the application;

FIG. 5 is a first structural diagram of a terminal 1 provided by an embodiment of the application;

FIG. 6 is a second structural diagram of a terminal 1 provided by an embodiment of this application.

Detailed ways

Example one

The embodiment of the application provides a method for shooting composition, which is applied to a terminal. The terminal includes a first camera and a second camera. The viewing angle range of the first camera is larger than the viewing angle range of the second camera. As shown in FIG. 1, the method may include:

S101: When the shooting composition function is triggered, use the first camera to collect a first preview image.

In the embodiment of the present application, the terminal for shooting and composing may be any device with shooting and storage functions, such as tablet computers, mobile phones, personal computers (PC), notebook computers, cameras, wearable devices and other photographing devices.

In the embodiment of this application, when shooting on the terminal, the terminal is set with different shooting options, such as panoramic shooting, portrait shooting, time-lapse shooting, etc., including shooting composition options. When the user clicks on the shooting composition option, the terminal is triggered Shooting composition function, at this time, the terminal needs to determine the optimal composition strategy. First, the terminal starts the first camera, and uses the first camera to collect the first preview image.

In the embodiment of the present application, the first camera is the camera with the largest viewing angle in the terminal, and the first camera may be a wide-angle lens.

In the embodiments of the present application, the wide-angle lens is a photographic lens with a focal length shorter than a standard lens, a viewing angle larger than a standard lens, a focal length longer than a fisheye lens, and a viewing angle smaller than a fisheye lens. Wide-angle lenses are divided into two types: ordinary wide-angle lenses and ultra-wide-angle lenses, which are specifically selected according to actual conditions, and the embodiments of the present application do not make specific limitations. in. The focal length of an ordinary wide-angle lens is generally 38-24 mm, and the angle of view is 60-84 degrees; the focal length of an ultra-wide-angle lens is 20-13 mm, and the angle of view is 94-118 degrees.

It is understandable that, due to the short focal length of the wide-angle lens and the large viewing angle, the wide-angle lens can capture a larger area of scenery in a shorter shooting distance range than other lenses.

In this embodiment of the application, when the terminal uses the second camera to collect images when triggering the shooting composition function, the terminal first switches from the second camera to the first camera, and then uses the first camera to collect the first preview image.

In the embodiment of the present application, the second camera may be a standard lens, a telephoto lens, a main camera, etc. of the terminal, which is specifically selected according to actual conditions, and the embodiment of the present application does not make specific limitations.

In the embodiment of the present application, in the same shooting scene, the viewing angle range of the second camera is smaller than the viewing angle range of the second camera.

S102. Display a first preview image on the shooting preview interface, and display a suggested composition frame corresponding to the suggested composition image on the first preview image, where the suggested composition image is an image determined from the first preview image.

After the terminal uses the first camera to collect the first preview image, the terminal displays the first preview image on the shooting preview interface, and displays the recommended composition frame corresponding to the recommended composition image on the first preview image.

In the embodiment of the present application, the terminal uses a preset target detection model to determine the recommended composition image from the first preview image.

In the embodiment of this application, the terminal annotates the recommended composition training image containing the target training object from the wide-angle training image; after that, the terminal uses the wide-angle training image and the recommended composition training image in the wide-angle training image to train the initial target detection model to obtain the preset Target detection model.

In the embodiment of this application, the terminal obtains a large number of wide-angle training images, and in each wide-angle training image, annotates a recommended composition training image containing the target training object, and then the terminal uses the wide-angle training image and the recommended composition training in the wide-angle training image The image trains an improved single target detection model based on Single Shot MultiBox Detector (SSD) to obtain a preset target detection model.

In the embodiment of this application, it is recommended that the size of the composition training image is the same as the collection size of the second camera, where the ratio of the collection size of the second camera can be 16:9, 4:3, 1:1, etc., specifically The selection is made according to the actual situation. The embodiment of this application does not make specific limitations. Taking the ratio of the collection size of the second camera to 16:9 as an example, when the size of the wide-angle training image is 4000 pixels×3000 pixels, the terminal is in In the wide-angle training image, a suggested composition training image with a collection size of 2400 pixels×1350 pixels is marked, and the terminal marks a 16:9 suggested composition training image in the 4:3 wide-angle training image.

In an optional embodiment, the terminal may mark the recommended composition training images of multiple sizes in each wide-angle training image, and the preset target detection model trained from this may be suitable for shooting operations of multiple acquisition sizes. .

In this embodiment of the application, the terminal inputs the collected first preview image into the preset target detection model, and the preset target detection model returns from the first preview image a suggested composition image with the same size as the second camera's collection size. And output the suggested composition image.

In an optional embodiment, the second camera in the terminal may be a rotatable lens. After the terminal determines the recommended composition frame, the terminal rotates the second camera until the preview frame of the second camera overlaps the recommended composition frame. At this time, the image acquired by the terminal using the second camera is the recommended composition image.

In this embodiment of the application, the terminal determines the image collection area corresponding to the second camera, where the area size of the image collection area is the same as the collection size of the second camera; a preview frame corresponding to the image collection area is displayed on the first preview image.

In the embodiment of the application, as shown in FIG. 2, the terminal displays the first preview image collected by the wide-angle lens on the shooting preview interface, and marks the suggested composition frame and the preview frame of the main camera in the first preview image.

It is understandable that the terminal marking the recommended composition frame and the second camera preview frame on the first preview image can guide the user to move the terminal and then move the second camera of the terminal so that the preview frame of the second camera coincides with the recommended composition frame , The image captured by the second camera is the suggested composition image framed by the suggested composition frame.

S103: When it is detected that the image capture area corresponding to the second camera moves to the recommended composition frame, use the second camera to shoot the recommended composition image in the recommended composition frame.

After the terminal displays the first preview image and the recommended composition frame on the shooting preview interface, the terminal detects the movement displacement of the second camera. When the terminal detects that the image collection area corresponding to the second camera moves to the recommended composition frame, the terminal uses the second The camera captures the recommended composition image in the recommended frame.

In the embodiment of this application, the terminal detects the movement displacement of the second camera in real time, and maps the movement displacement of the second camera to the movement displacement of the preview frame on the first preview image, and then the terminal moves the displacement on the first preview image according to the movement displacement Move the preview box.

In this embodiment of the application, when the terminal detects that the image capture area corresponding to the second camera moves to the recommended composition image, that is, when the preview frame in the shooting preview interface overlaps with the recommended composition frame, the terminal switches from the first camera to the second camera , And use the second camera to collect the recommended composition image. After that, the terminal switches the first preview image displayed in the shooting preview interface to the recommended composition image; at this time, the user clicks the shooting button to trigger the shooting instruction of the terminal, and the terminal uses the second camera Take the recommended composition image of the shooting preview interface.

Exemplarily, as shown in FIG. 3, the terminal uses the main camera to obtain the suggested composition image in the suggested composition frame.

Exemplarily, as shown in FIG. 4, the process of the terminal automatically composing a picture during shooting includes:

1. When the automatic composition function is turned on, the terminal will switch the preview to the wide-angle lens.

2. The terminal captures the scene picture taken by the wide-angle lens, and inputs the scene picture into the recommended composition network.

3. It is recommended that the composition network output an optimal suggested composition frame and display the suggested composition frame in the scene picture of the current wide-angle preview interface.

4. The terminal displays the preview frame of the main camera in the scene picture.

5. The terminal guides the user to move the terminal so that the recommended composition frame coincides with the preview frame of the main camera.

6. When the recommended composition frame and the preview frame of the main camera overlap, the terminal switches to the main camera and displays the recommended composition image taken by the main camera in the preview interface.

It is understandable that because the wide-angle lens captures a wider range, the terminal uses the wide-angle lens to collect the first preview image, and uses the preset target detection model to determine from the first preview image a suggested composition image with the same size as the main camera's collection size. Thus, the photographer can move the image capture frame of the main camera to the recommended composition frame corresponding to the recommended composition image, so that the visual effect of the captured image is good, and the intelligence of shooting is improved.

Example two

An embodiment of the present application provides a terminal. The terminal includes a first camera and a second camera. The viewing angle range of the first camera is larger than the viewing angle range of the second camera. As shown in FIG. 5, the terminal 1 includes:

The collecting part 10 is configured to use the first camera to collect a first preview image when the shooting composition function is triggered;

The display part 11 is configured to display the first preview image on the shooting preview interface, and display a suggested composition frame corresponding to the suggested composition image on the first preview image, and the suggested composition image is from the first preview The image identified in the image;

The photographing part 12 is configured to use the second camera to photograph the suggested composition image in the suggested composition frame when it is detected that the image capture area corresponding to the second camera moves to the suggested composition frame.

Optionally, the terminal further includes: a determining part;

The determining part is configured to determine an image acquisition area corresponding to the second camera, and the area size of the image acquisition area is the same as the acquisition size of the second camera;

The display part 11 is further configured to display a preview frame corresponding to the image acquisition area on the first preview image.

Optionally, the terminal further includes: a handover part;

The switching part is configured to switch from the first camera to the second camera, and switch the first preview image displayed in the shooting preview interface to the suggested composition image;

The photographing part 12 is further configured to photograph the suggested composition image of the photographing preview interface when a photographing instruction is triggered.

Optionally, the determining part is further configured to determine the suggested composition image from the first preview image by using a preset target detection model.

Optionally, the terminal further includes: a labeling part and a training part;

The labeling part is configured to label the recommended composition training image containing the target training object from the wide-angle training image;

The training part is configured to use the wide-angle training image and the suggested composition training image in the wide-angle training image to train an initial target detection model to obtain the preset target detection model.

Optionally, the area size of the suggested composition image is the same as the collection size of the second camera, and the suggested composition image includes the target object to be photographed.

Optionally, the first camera is a wide-angle lens, and the second camera is a main camera.

An embodiment of the present application provides a terminal. The terminal includes a first camera and a second camera. The angle of view of the first camera is larger than that of the second camera. When the shooting composition function is triggered, the first camera is used to collect the first preview image. ; The first preview image is displayed on the shooting preview interface, and the recommended composition frame corresponding to the recommended composition image is displayed on the first preview image. The recommended composition image is the image determined from the first preview image; when the second camera is detected When the corresponding image capture area moves to the recommended composition frame, the second camera is used to capture the recommended composition image in the recommended composition frame. It can be seen that, in the terminal proposed in this embodiment, since the first camera captures a wider range, the terminal uses the first camera to collect the first preview image, and uses the preset target detection model to determine the first preview image from the first preview image. The two cameras capture the same recommended composition image, so the photographer can move the second camera’s image capture frame to the recommended composition frame corresponding to the recommended composition image, so that the visual effect of the captured image is good, and the shooting is improved. The intelligence.

FIG. 6 is a second schematic diagram of the composition structure of a terminal 1 provided by an embodiment of this application. In practical applications, based on the same public concept of the above-mentioned embodiment, as shown in FIG. 6, the terminal 1 of this embodiment includes: a display 13 , Processor 14, memory 15, and communication bus 16.

In the process of a specific embodiment, the above-mentioned collection part 10, shooting part 12, determining part, switching part, labeling part, training part, detecting part, and moving part may be implemented by the processor 14 located on the terminal 1, and the above-mentioned display part 11 It can be implemented by a display 13 located on the terminal 1. The processor 14 can be an Application Specific Integrated Circuit (ASIC), a digital signal processor (DSP, Digital Signal Processor), and a digital signal processing image processing device (DSPD, At least one of Digital Signal Processing Device, Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA, Field Programmable Gate Array), CPU, controller, microcontroller, and microprocessor kind. It can be understood that, for different devices, the electronic devices used to implement the above-mentioned processor functions may also be other, which is not specifically limited in this embodiment.

In the embodiment of the present application, the above-mentioned communication bus 16 is used to realize the connection and communication between the display 13, the processor 14 and the memory 15. The above-mentioned display 13 is used to display the first preview image on the shooting preview interface, and in the first The recommended composition frame corresponding to the recommended composition image is displayed on the preview image, and the recommended composition image is an image determined from the first preview image; when the processor 14 executes the operating program stored in the memory 15, the following state detection method is implemented:

When the shooting composition function is triggered, the first camera is used to collect the first preview image; when it is detected that the image collection area corresponding to the second camera has moved to the suggested composition frame, the second camera is used to shoot the suggested composition image in the suggested composition frame.

In the above method, the processor 14 is further configured to determine an image acquisition area corresponding to the second camera, and the area size of the image acquisition area is the same as the acquisition size of the second camera;

The display 13 is also used to display a preview frame corresponding to the image collection area on the first preview image.

In the above method, the processor 14 is further configured to switch from the first camera to the second camera, and switch the first preview image displayed in the shooting preview interface to the suggested composition Image; when a shooting instruction is triggered, use the second camera to shoot the suggested composition image of the shooting preview interface.

In the above method, the processor 14 is further configured to use a preset target detection model to determine the suggested composition image from the first preview image.

In the above method, the processor 14 is also used to annotate the recommended composition training image containing the target training object from the wide-angle training image; use the wide-angle training image and the recommended composition training image in the wide-angle training image to train the initial target A detection model to obtain the preset target detection model.

In the above method, the area size of the suggested composition image is the same as the collection size of the second camera, and the suggested composition image includes the target object to be photographed.

In the above method, the first camera is a wide-angle lens, and the second camera is the main camera.

The embodiment of the present application provides a storage medium on which a computer program is stored, and the above-mentioned computer-readable storage medium stores one or more programs, and the above-mentioned one or more programs can be executed by one or more processors and applied to a terminal Here, the computer program implements the shooting composition method as described in the first embodiment.

It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, It also includes other elements that are not explicitly listed, or elements inherent to the process, method, article, or device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element.

Through the description of the above implementation manners, those skilled in the art can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of the present disclosure essentially or the part that contributes to the related technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk). ) Includes several instructions to make an image display device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present disclosure.

The above are only preferred embodiments of the present application, and are not used to limit the protection scope of the present application.

Industrial applicability

Claims

A photographing composition method applied to a terminal, the terminal including a first camera and a second camera, the first camera has a larger viewing angle range than the second camera, and the method includes:

When the shooting composition function is triggered, the first camera is used to collect a first preview image;

Display the first preview image on the shooting preview interface, and display the recommended composition frame corresponding to the recommended composition image on the first preview image, and the recommended composition image is an image determined from the first preview image ；

When it is detected that the image capture area corresponding to the second camera moves to the suggested composition frame, the second camera is used to capture the suggested composition image in the suggested composition frame.
5. The method according to claim 1, wherein before said using said second camera to capture said suggested composition image in said suggested composition frame, said method further comprises:

Determining an image acquisition area corresponding to the second camera, and the area size of the image acquisition area is the same as the acquisition size of the second camera;

Displaying a preview frame corresponding to the image acquisition area on the first preview image.
3. The method according to claim 2, wherein said using said second camera to capture said suggested composition image in said suggested composition frame comprises:

Switching from the first camera to the second camera, and switching the first preview image displayed in the shooting preview interface to the suggested composition image;

When the shooting instruction is triggered, the second camera is used to shoot the suggested composition image of the shooting preview interface.
5. The method according to claim 1, wherein after the first preview image is captured by the first camera and before the first preview image is displayed on the shooting preview interface, the method further comprises:

Using a preset target detection model, the suggested composition image is determined from the first preview image.
4. The method according to claim 4, wherein before said determining said suggested composition image from said first preview image by using a preset target detection model, said method further comprises:

Annotate the recommended composition training image containing the target training object from the wide-angle training image;

Using the wide-angle training image and the suggested composition training image in the wide-angle training image, the initial target detection model is trained to obtain the preset target detection model.
The method according to any one of claims 1 to 5, wherein the area size of the suggested composition image is the same as the acquisition size of the second camera, and the suggested composition image includes the target object to be photographed.
The method according to claim 1, wherein the first camera is a wide-angle lens, and the second camera is a main camera.
A terminal, the terminal includes a first camera and a second camera, the viewing angle range of the first camera is larger than the viewing angle range of the second camera, and the terminal includes:

The acquisition part is configured to use the first camera to acquire a first preview image when the shooting composition function is triggered;

The display part is configured to display the first preview image on the shooting preview interface, and display a suggested composition frame corresponding to the suggested composition image on the first preview image, and the suggested composition image is from the first preview image The image identified in

The photographing part is configured to use the second camera to photograph the suggested composition image in the suggested composition frame when it is detected that the image acquisition area corresponding to the second camera moves to the suggested composition frame.
A terminal, the terminal comprising: a processor, a display, a memory, and a communication bus; when the processor executes an operating program stored in the memory, the method according to any one of claims 1-7 is implemented.
A storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method according to any one of claims 1-7 is realized.