WO2020020134A1

WO2020020134A1 - Photographing method and mobile terminal

Info

Publication number: WO2020020134A1
Application number: PCT/CN2019/097235
Authority: WO
Inventors: 周梦姣
Original assignee: 维沃移动通信有限公司
Priority date: 2018-07-26
Filing date: 2019-07-23
Publication date: 2020-01-30
Also published as: CN108989672B; CN108989672A

Abstract

The present disclosure provides a photographing method and a mobile terminal, said method comprising: collecting a preview image by means of a camera, and recognizing a photographed subject from the preview image; and according to the position of the photographed subject in the preview image, adjusting the position of the camera relative to the body of a mobile terminal, and/or adjusting an internal optical axis offset of the camera.

Description

Shooting method and mobile terminal

Cross-reference to related applications

This application claims the priority of Chinese Patent Application No. 201810832500.X filed in China on July 26, 2018, the entire contents of which are hereby incorporated by reference.

Technical field

The present disclosure relates to the field of communication technologies, and in particular, to a photographing method and a mobile terminal.

Background technique

In order to place the subject in a better position on the screen, at present, the subject is generally placed at a suitable position in the shooting screen by manually adjusting the shooting angle, or the stored subject is manually cropped to place the subject at A suitable location in the shooting screen. In some scenes, for example, when a mother is shooting a child, she often needs to constantly adjust the shooting angle because the child is active, so that the child's avatar can be placed in a suitable position in the shooting screen. The manual cropping method is more tedious to place the child's avatar in a suitable position in the shooting screen.

It can be seen that the manner of adjusting the position of the photographic subject in the screen in the related art is very inconvenient to use and the photographing efficiency is low.

Summary of the Invention

Some embodiments of the present disclosure provide a photographing method and a mobile terminal to solve the problem of tedious operations when the photographing method in the related art adjusts the position of a photographic subject in a screen.

To solve the above technical problems, the present disclosure is implemented as follows:

In a first aspect, some embodiments of the present disclosure provide a photographing method applied to a mobile terminal. The mobile terminal includes a mobile terminal body and a camera disposed on the mobile terminal body. The method includes:

Collecting a preview picture through the camera, and identifying a shooting subject from the preview picture;

Adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjusting the internal optical axis offset of the camera.

In a second aspect, some embodiments of the present disclosure further provide a mobile terminal, where the mobile terminal includes a mobile terminal body and a camera disposed on the mobile terminal body, including:

A shooting subject recognition module, configured to collect a preview picture through the camera, and identify a shooting subject from the preview picture;

An adjustment module is configured to adjust the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjust the internal optical axis offset of the camera.

According to a third aspect, some embodiments of the present disclosure further provide a mobile terminal including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program is processed by the processor The steps of the above-mentioned shooting method are implemented when the camera is executed.

According to a fourth aspect, some embodiments of the present disclosure further provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program implements the steps of the foregoing photographing method when executed by a processor.

In some embodiments of the present disclosure, a preview screen is collected by the camera, and a shooting subject is identified from the preview screen; and the camera is adjusted relative to the mobile terminal body according to the position of the shooting subject in the preview screen. , Or / and, adjust the internal optical axis offset of the camera, so that the mobile terminal automatically adjusts the shooting angle during shooting, and the user no longer needs to manually adjust the position of the shooting subject in the preview screen, so that the shooting process Simple and convenient, improving shooting efficiency.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions of some embodiments of the present disclosure, the drawings used in the description of some embodiments of the present disclosure will be briefly introduced below. Obviously, the drawings in the following description are only the present disclosure. For some embodiments, for those of ordinary skill in the art, other drawings can be obtained according to these drawings without paying creative labor.

FIG. 1 is one of the flowcharts of the shooting method provided by some embodiments of the present disclosure;

2 is a second flowchart of a photographing method provided by some embodiments of the present disclosure;

3 is one of the flowcharts of some steps of a photographing method provided by some embodiments of the present disclosure;

4 is a second flowchart of some steps of a photographing method provided by some embodiments of the present disclosure;

5 is a third flowchart of a photographing method provided by some embodiments of the present disclosure;

6 is one of the structural diagrams of a mobile terminal provided by some embodiments of the present disclosure;

7 is one of the structural diagrams of an adjustment module provided by some embodiments of the present disclosure;

8 is a second structural diagram of an adjustment module provided by some embodiments of the present disclosure;

9 is a third structural diagram of a photographic subject recognition module provided by some embodiments of the present disclosure;

FIG. 10 is a structural diagram of a mobile terminal according to another embodiment of the present disclosure.

detailed description

In the following, the technical solutions in some embodiments of the present disclosure will be clearly and completely described with reference to the drawings in some embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, but not all of them. example. Based on the embodiments in the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without making creative efforts fall within the protection scope of the present disclosure.

Referring to FIG. 1, FIG. 1 is one of the flowcharts of a photographing method provided by some embodiments of the present disclosure. As shown in FIG. 1, this embodiment provides a photographing method applied to a mobile terminal, where the mobile terminal includes a mobile terminal The main body and the camera provided on the main body of the mobile terminal include the following steps:

Step 101: Collect a preview image through the camera, and identify a shooting subject from the preview image.

The shooting subject is the shooting subject. In this embodiment, the shooting subject is a human face. For example, when a mother photographs a child, the child's face is the subject. When there is only one subject in the preview screen, the subject is the subject. When there are multiple subjects in the preview screen, you need to select one subject from the multiple subjects as the subject. The selection method can be set by the user manually clicking the subject in the preview screen, or it can be set automatically by the mobile terminal. For example, at this time, the mobile terminal will use the photographic subject that occupies the largest area of the preview screen as the photographic subject.

Step 102: Adjust the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjust the internal optical axis offset of the camera.

Before performing the adjustment, it is also necessary to obtain the preset subject position, which is the target position of the subject in the preview screen. In this step, the purpose of the adjustment is to position the subject in the preview screen (the position is visible (Current position) to the main position.

Specifically, the subject position may be manually specified by a user, or a suitable subject position may be selected from a preset subject position template. The main body position is a certain area in the preview screen. For example, the main body position can be located in the middle of the preview screen, upper left corner, upper right corner, etc. The shape of the main body position can be rectangular, triangular, circular, or star shape. limited.

The preview screen may include one or more candidate positions. When there is only one candidate position, the candidate position is used as the subject position. When there are multiple candidate positions, the candidate point whose center point is closest to the center point of the shooting subject is selected. The selected position is used as the subject position, or a candidate position is designated by the user as the subject position.

The lower left corner of the preview screen is used as the origin of the plane rectangular coordinate system, and other positions of the preview screen can also be used as the origin of the plane rectangular coordinate system. For example, the upper left corner or the center position of the preview screen can be selected according to actual conditions. , Will not repeat them here. Obtain the center point coordinates of the subject position and the center point coordinates of the subject in the preview screen, and calculate the horizontal and vertical distances between the center point coordinates of the subject position and the center point coordinates of the subject to adjust the camera relative to The position of the main body of the mobile terminal or / and adjusting the internal optical axis offset of the camera.

If the camera of the mobile terminal can slide in the vertical direction, after obtaining the vertical distance between the coordinates of the center point of the subject position and the coordinates of the center point of the shooting subject, adjust the camera to move in the vertical direction so that the position of the subject The distance between the ordinate of the center point coordinate and the ordinate of the center point coordinate of the subject is less than a preset vertical distance threshold. The vertical distance threshold can be set according to the actual situation, which is not limited here.

If the camera of the mobile terminal can slide in the horizontal direction, after obtaining the horizontal distance between the center point coordinates of the subject position and the center point coordinates of the shooting subject, adjust the camera to move in the horizontal direction so that the center point coordinates of the subject position The distance between the abscissa of and the abscissa of the center point of the subject is less than a preset horizontal distance threshold. The horizontal distance threshold can be set according to the actual situation and is not limited here.

In addition to adjusting the camera's sliding position in the vertical or horizontal direction to match the position of the subject in the preview screen as described above, you can also adjust the camera's internal optical axis offset to make the subject The position in the preview screen matches the position of the subject.

After obtaining the vertical distance between the center point coordinates of the subject position and the center point coordinates of the shooting subject, adjust the internal optical axis of the camera to move in the vertical direction so that the ordinate of the center point coordinates of the subject position and the shooting subject The distance between the ordinates of the center point coordinates is smaller than a preset vertical distance threshold.

After obtaining the horizontal distance between the center point coordinates of the subject position and the center point coordinates of the shooting subject, adjust the internal optical axis of the camera to move in the horizontal direction so that the abscissa of the center point coordinates of the subject position and the center of the shooting subject The distance between the abscissas of the point coordinates is less than a preset horizontal distance threshold.

Since the area occupied by the subject in the preview screen is not exactly the same as the shape and size of the area occupied by the subject position in the preview screen, in this embodiment, the subject does not need to be in the preview screen. The occupied area completely coincides with the area where the subject's position is located. Just adjust the distance between the center point coordinates of the subject and the center point coordinates of the subject position to be less than a preset distance threshold, so that the position of the subject in the preview screen and Match the subject position. The preset distance threshold can be calculated by a European formula according to the preset horizontal distance threshold and the preset vertical distance threshold.

In some embodiments of the present disclosure, the above-mentioned mobile terminal may be any mobile terminal including a camera, such as: a mobile phone, a tablet computer, a laptop computer, a personal digital assistant (PDA for short) ), Mobile Internet device (Mobile Internet Device, MID) or wearable device (Wearable Device).

In the shooting method of some embodiments of the present disclosure, a preview screen is collected by the camera, and a shooting subject is identified from the preview screen; and the camera is adjusted relative to the mobile terminal according to the position of the shooting subject in the preview screen. The position of the subject, or / and, adjusts the internal optical axis offset of the camera, so that the mobile terminal automatically adjusts the shooting angle during shooting, and the user no longer needs to manually adjust the position of the shooting subject in the preview screen, so that the shooting The process is simple and convenient, which improves the shooting efficiency.

Referring to FIG. 2, FIG. 2 is a second flowchart of a photographing method provided by some embodiments of the present disclosure. As shown in FIG. 2, this embodiment provides a photographing method. A camera is a vertically movable camera, including The following steps:

Step 201: Collect a preview image through the camera, and identify a shooting subject from the preview image.

Step 201 is the same as step 101. For details, refer to the description in step 101, and details are not described herein again.

Step 202: Adjust the camera to move in a vertical direction relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjust the internal optical axis of the camera in a horizontal direction. Offset.

Specifically, the lower left corner of the preview screen is used as the origin of the flat rectangular coordinate system, and other positions of the preview picture may also be used as the origin of the flat rectangular coordinate system. The situation is selected, and is not repeated here. Obtain the center point coordinates of the subject position and the center point coordinates of the subject in the preview screen, and calculate the horizontal and vertical distances between the center point coordinates of the subject position and the center point coordinates of the subject, if the horizontal distance is less than a preset level Distance threshold, the vertical distance is not less than the preset vertical distance threshold, indicating that the subject is matched with the subject position in the horizontal direction, and the subject is not matched with the subject position in the vertical direction. The horizontal distance between the coordinates of the center point of the position and the coordinates of the center point of the subject is adjusted. You only need to adjust the camera to move in the vertical direction so that the position of the subject in the preview screen matches the position of the subject.

If the calculated vertical distance is less than the preset vertical distance threshold and the horizontal distance is not less than the preset horizontal distance threshold, it indicates that the shooting subject matches the position of the subject in the vertical direction, and the shooting subject is not in the horizontal direction. The subject position matches. At this time, there is no need to adjust the vertical distance between the coordinates of the center point of the subject position and the coordinates of the center point of the shooting subject. You only need to adjust the horizontal offset of the internal optical axis of the camera. Match the position of the subject in the preview screen with the position of the subject.

When the horizontal and vertical distances between the center point coordinates of the subject position and the center point coordinates of the shooting subject need to be adjusted, the vertical position of the center point coordinates of the subject position can be adjusted by adjusting the camera to move in the vertical direction. The distance between the coordinate and the ordinate of the center point of the subject is less than a preset vertical distance threshold; the horizontal coordinate of the center point of the subject's position is adjusted by adjusting the horizontal offset of the internal optical axis of the camera The distance from the abscissa of the center point of the shooting subject is smaller than a preset horizontal distance threshold, so that the position of the shooting subject in the preview screen matches the position of the subject.

In the shooting method of some embodiments of the present disclosure, a preview screen is collected by the camera, and a shooting subject is identified from the preview screen; and the camera is adjusted relative to the mobile terminal according to the position of the shooting subject in the preview screen. The subject moves in the vertical direction, or / and, adjusts the offset of the internal optical axis of the camera in the horizontal direction, so that when shooting, the mobile terminal automatically adjusts the shooting angle of the camera in the vertical direction or / And automatically adjust the horizontal offset of the internal optical axis of the camera, users no longer need to manually adjust the vertical or / and horizontal position of the subject in the preview screen, which makes the shooting process simple and convenient and improves the shooting effectiveness.

Further, as shown in FIG. 3, in another embodiment of the present disclosure, step 202 includes:

Step 2021: In the case where the amplitude of the shake of the mobile terminal is greater than a preset threshold, if a preset input operation is detected, adjust the position of the camera relative to the mobile terminal body, or / and, adjust the internal optical axis of the camera Offset.

The preset threshold can be set according to the actual situation, and is not limited here. In the case where the amplitude of the jitter of the mobile terminal is greater than a preset threshold, it indicates that the position of the mobile terminal at this time is unstable, and the current position is not the final position of the shooting. At this time, the mobile terminal does not automatically adjust the position of the camera relative to the mobile terminal body, or / and, adjust the internal optical axis of the camera according to the position of the shooting subject in the preview screen and the position of the subject. However, if a preset input operation is detected, the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera is adjusted so that the position of the shooting subject in the preview screen is different from the position of the camera The subject position matches. The preset input operations include taking pictures or videos.

Step 2022: Generate an image file corresponding to the preview image collected by the camera after the adjustment.

According to a preset input operation, an image file corresponding to the preview screen is generated. If the preset input operation is taking a picture, the generated image file is a picture, and the subject in the picture matches the position of the subject; if the preset input operation is a video, the generated image file is a video, in which the subject and the subject are shot The positions match.

In this embodiment, when the shake amplitude of the mobile terminal is greater than a preset threshold and a preset input operation is detected, the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera is adjusted so that The position of the shooting subject in the preview screen matches the position of the subject, and then an image file corresponding to the preview screen is generated. In this way, the mobile terminal automatically adjusts the shooting angle when shooting, and the user no longer needs to manually adjust the position of the shooting subject in the preview screen, which makes the shooting process simple and convenient and improves the shooting efficiency.

Further, as shown in FIG. 4, in another embodiment of the present disclosure, step 202 includes:

Step 2021 ': Adjust the position of the camera relative to the main body of the mobile terminal according to the first adjustment range, or / and adjust the internal optical axis of the camera when the shake amplitude of the mobile terminal is not greater than a preset threshold Offset.

In the case where the amplitude of the jitter of the mobile terminal is not greater than a preset threshold, it indicates that the position of the mobile terminal at this time is stable, and the user may shoot at this position. At this time, the position of the camera relative to the main body of the mobile terminal is adjusted according to the first adjustment range, or / and the internal optical axis offset of the camera is adjusted so that the position of the photographic subject in the preview screen and The subject positions are matched to prepare for shooting in advance.

Step 2022 ': if a preset input operation is detected, adjust the position of the camera relative to the mobile terminal body according to the second adjustment range, or / and adjust the internal optical axis offset of the camera; wherein, the second adjustment range Less than the first adjustment.

The preset input operations include taking pictures or videos. Because the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera is adjusted to a time period when a preset input operation is detected according to the first adjustment range, the position of the mobile terminal will slightly move, and the camera The position of the camera will also be slightly moved accordingly. Therefore, after the preset input operation is detected, the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera needs to be adjusted again according to the second adjustment range. Adjustment, the second adjustment range is smaller than the first adjustment range. Adjusting the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera according to the first adjustment range in advance can improve the position or the position of the camera relative to the main body of the mobile terminal after detecting a preset input operation. / And the processing speed of the camera's internal optical axis offset.

Step 2023 ': Generate an image file corresponding to the preview image acquired after the camera adjusts according to the second adjustment range.

According to a preset input operation, an image file corresponding to a preview image acquired after the camera adjusts according to the second adjustment range is generated. If the preset input operation is taking a picture, the generated image file is a picture, and the subject in the picture matches the position of the subject; if the preset input operation is a video, the generated image file is a video, in which the subject and the subject are shot The positions match.

In this embodiment, when the shake amplitude of the mobile terminal is not greater than a preset threshold, the position of the camera relative to the mobile terminal body is adjusted according to the first adjustment range, or / and the internal optical axis offset of the camera is adjusted To match the position of the shooting subject in the preview screen with the position of the subject to prepare for shooting in advance, and if a preset input operation is detected, adjust the position of the camera relative to the mobile terminal body according to the second adjustment range or / and The internal optical axis offset of the camera, because the second adjustment range is smaller than the first adjustment range, can improve the position of the camera relative to the main body of the mobile terminal or / and the camera after the mobile terminal detects a preset input operation The speed of adjusting the internal optical axis offset to the proper position improves the user experience.

Referring to FIG. 5, FIG. 5 is a flowchart of a photographing method provided by some embodiments of the present disclosure. As shown in FIG. 5, this embodiment provides a photographing method, including:

Step 301: Process a plurality of preselected subject positions according to a deep learning algorithm to obtain the subject position of the preview picture, or use the subject position preset by the user as the subject position of the preview picture.

The user can select the subject positions of the person who is considered to be better in daily photography to obtain a plurality of pre-selected subject positions, and then process the multiple subject positions according to a deep learning algorithm to obtain a candidate position for the preview screen.

Step 302: Perform face recognition on the preview picture to obtain at least one face object. The face recognition method is used to perform face recognition on the preview picture, and at least one face object is obtained.

Step 303: In the case where one face object is obtained, use the obtained face object as a photographing subject.

When there is only one face object in the preview frame, the face object is the subject.

Step 304: When a plurality of the face objects are obtained, select one face object from the plurality of face objects as a photographing subject.

When there are multiple face objects in the preview screen, the face object that occupies the largest preview screen area among the multiple face objects may be taken as the shooting subject; or, the center point of the subject position and the center point of each face object may be obtained. , Use the face object whose center point is closest to the center point of the subject position as the shooting subject. In addition, a face object can also be manually selected by the user as a photographing subject from a plurality of face objects.

Step 305: Adjust the position of the camera relative to the mobile terminal body according to the position of the subject and the position of the shooting subject in the preview screen, or / and adjust the internal optical axis offset of the camera so that The position of the shooting subject in the preview screen matches the position of the subject.

Step 305 is the same as step 102. For details, refer to the description in step 102, and details are not described herein again.

In this embodiment, a plurality of preselected subject positions are processed according to a deep learning algorithm to obtain the subject position of the preview picture, or the subject position preset by the user is used as the subject position of the preview picture; Performing face recognition on the preview picture to obtain at least one face object; in the case of obtaining one of the face objects, using the obtained face object as a photographing subject; adjusting the camera's relative to the main body of the mobile terminal Position or / and adjust the internal optical axis offset of the camera, so that the position of the shooting subject in the preview screen matches the position of the subject. In this way, the mobile terminal automatically adjusts the shooting angle when shooting, and the user no longer needs to manually adjust the position of the shooting subject in the preview screen, which makes the shooting process simple and convenient and improves the shooting efficiency.

Referring to FIG. 6, FIG. 6 is a flowchart of a photographing method provided by some embodiments of the present disclosure. As shown in FIG. 6, this embodiment provides a mobile terminal 400. The mobile terminal 400 includes a mobile terminal body and The camera on the main body of the mobile terminal includes:

A shooting subject recognition module 401, configured to collect a preview picture through the camera, and identify a shooting subject from the preview picture;

An adjustment module 402 is configured to adjust the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjust the internal optical axis offset of the camera.

Further, the camera is a camera movable in a vertical direction;

The adjustment module 402 is specifically configured to adjust the camera to move in a vertical direction relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and, adjust the internal light of the camera The offset of the axis in the horizontal direction.

Further, as shown in FIG. 7, the adjustment module 402 includes a first adjustment sub-module 4021 and a first generation sub-module 4022.

The first adjustment sub-module 4021 is configured to adjust the position of the camera relative to the main body of the mobile terminal or / and the mobile terminal if a predetermined input operation is detected when the amplitude of the mobile terminal shakes is greater than a preset threshold. The internal optical axis offset of the camera;

The first generating sub-module 4022 is configured to generate an image file corresponding to a preview image collected by the camera after the adjustment.

Further, the adjustment module 402 includes a second adjustment sub-module 4023, a third adjustment sub-module 4024, and a second generation sub-module 4025.

Wherein, a second adjustment sub-module 4023 is configured to adjust the position of the camera relative to the main body of the mobile terminal or / and the camera according to the first adjustment amplitude when the vibration amplitude of the mobile terminal is not greater than a preset threshold. The internal optical axis offset;

A third adjustment sub-module 4024 is configured to adjust the position of the camera relative to the main body of the mobile terminal, or / and the internal optical axis offset of the camera according to the second adjustment range if a preset input operation is detected; wherein, The second adjustment range is smaller than the first adjustment range;

The second generation sub-module 4025 is configured to generate an image file corresponding to the preview image acquired after the camera adjusts according to the second adjustment range.

As shown in FIG. 8, the photographic subject recognition module 401 includes a face object acquisition sub-module 4011, a first photographic subject acquisition sub-module 4012, and a second photographic subject acquisition sub-module 4013.

The face object acquisition sub-module 4011 is configured to perform face recognition on the preview picture to obtain at least one face object;

A first shooting subject acquisition sub-module 4012, configured to use the obtained face object as a shooting subject when one of the face objects is obtained;

A second shooting subject acquisition sub-module 4013 is configured to select a face object as a shooting subject from a plurality of the face objects when a plurality of the face objects are obtained.

Further, in an embodiment of the present disclosure, the mobile terminal 400 further includes: a subject position obtaining module, the subject position obtaining module is configured to process a plurality of preselected subject positions according to a deep learning algorithm to obtain the subject position The main body position of the preview screen, or the main body position preset by the user is used as the main body position of the preview screen.

As shown in FIG. 9, the shooting subject recognition module 401 includes:

A face object acquisition sub-module 4011, configured to perform face recognition on the shooting picture to obtain at least one face object;

A first shooting subject acquisition sub-module 4012, configured to use the obtained human face object as a shooting subject when one of the human face objects is obtained;

A second shooting subject acquisition submodule 4013, configured to select a face object as a shooting subject from a plurality of the face objects in a case where a plurality of the face objects are obtained;

The adjustment module 402 is specifically configured to adjust the position of the camera relative to the mobile terminal body according to the position of the subject and the position of the shooting subject in the preview screen, or / and adjust the internal optical axis offset of the camera Measure to make the position of the shooting subject in the preview screen match the position of the subject.

The mobile terminal 400 can implement various processes implemented by the mobile terminal in the method embodiments in FIG. 1 to FIG. 5. To avoid repetition, details are not described herein again.

The mobile terminal 400 of some embodiments of the present disclosure collects a preview screen through the camera, and identifies a shooting subject from the preview screen; and adjusts the camera relative to the movement according to the position of the shooting subject in the preview screen. The position of the terminal body, or / and, adjusts the internal optical axis offset of the camera, so that the mobile terminal automatically adjusts the shooting angle during shooting, and the user no longer needs to manually adjust the position of the shooting subject in the preview screen, so that The shooting process is simple and convenient, which improves the shooting efficiency.

FIG. 10 is a schematic diagram of a hardware structure of a mobile terminal that implements various embodiments of the present disclosure. As shown in FIG. 10, the mobile terminal 500 includes, but is not limited to, a radio frequency unit 501, a network module 502, an audio output unit 503, and an input unit 504. , Sensor 505, display unit 506, user input unit 507, interface unit 508, memory 509, processor 510, power supply 511, and other components. Those skilled in the art may understand that the structure of the mobile terminal shown in FIG. 10 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or fewer components than shown in the figure, or combine some components, or different components. Layout. In some embodiments of the present disclosure, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a car terminal, a wearable device, a pedometer, and the like.

The processor 510 is configured to collect a preview screen through the camera, and identify a shooting subject from the preview screen; and adjust a position of the camera relative to the mobile terminal body according to a position of the shooting subject in the preview screen. Position, or / and, adjust the internal optical axis offset of the camera.

Optionally, the camera is a camera that is movable in a vertical direction; the processor 510 executes the adjustment of the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, Or / and, the step of adjusting an internal optical axis offset of the camera includes:

Adjusting the vertical movement of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjusting the horizontal optical axis offset of the camera .

Optionally, the processor 510 performing the steps of adjusting the position of the camera relative to the main body of the mobile terminal or / and adjusting the internal optical axis offset of the camera includes:

In the case where the amplitude of the shake of the mobile terminal is greater than a preset threshold, if a preset input operation is detected, the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera is adjusted so that The position of the shooting subject in the preview screen matches the position of the subject; generating an image file corresponding to the preview screen captured by the camera after adjustment.

When the amplitude of the shake of the mobile terminal is not greater than a preset threshold, adjusting the position of the camera relative to the main body of the mobile terminal or / and the internal optical axis offset of the camera according to the first adjustment amplitude;

If a preset input operation is detected, adjust the position of the camera relative to the mobile terminal body or / and the internal optical axis offset of the camera according to the second adjustment range; wherein the second adjustment range is smaller than the first adjustment range;

Generate an image file corresponding to the preview picture acquired after the camera adjusts according to the second adjustment range.

Optionally, before executing the steps of adjusting the position of the camera relative to the mobile terminal body, or / and adjusting the internal optical axis offset of the camera, the processor 510 executes:

Processing a plurality of preselected subject positions according to a deep learning algorithm to obtain the subject position of the preview picture, or using the subject position preset by the user as the subject position of the preview picture;

The processor 510 executing the steps of collecting a preview screen through the camera and identifying a shooting subject from the preview screen includes:

Performing face recognition on the preview picture to obtain at least one face object;

When one face object is obtained, using the obtained face object as a photographing subject;

In a case where a plurality of the face objects are obtained, one face object is selected as a photographing subject from the plurality of the face objects.

The processor 510 executes the steps of adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjusting the internal optical axis offset of the camera, including: :

Adjusting the position of the camera relative to the main body of the mobile terminal according to the position of the subject and the position of the shooting subject in the preview screen, or / and adjusting the internal optical axis offset of the camera to enable the shooting The position of the subject in the preview screen matches the position of the subject.

The mobile terminal 500 can implement various processes implemented by the mobile terminal in the foregoing embodiments. To avoid repetition, details are not described herein again.

The mobile terminal 500 of some embodiments of the present disclosure collects a preview screen through the camera, and identifies a shooting subject from the preview screen; and adjusts the camera relative to the movement according to the position of the shooting subject in the preview screen. The position of the terminal body, or / and, adjusts the internal optical axis offset of the camera, so that the mobile terminal automatically adjusts the shooting angle during shooting, and the user no longer needs to manually adjust the position of the shooting subject in the preview screen, so that The shooting process is simple and convenient, which improves the shooting efficiency.

It should be understood that, in some embodiments of the present disclosure, the radio frequency unit 501 may be used to receive and send signals during the process of transmitting and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 510; To send uplink data to the base station. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with a network and other devices through a wireless communication system.

The mobile terminal provides users with wireless broadband Internet access through the network module 502, such as helping users to send and receive email, browse web pages, and access streaming media.

The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into audio signals and output them as sound. Moreover, the audio output unit 503 may also provide audio output (for example, a call signal receiving sound, a message receiving sound, etc.) related to a specific function performed by the mobile terminal 500. The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.

The input unit 504 is used for receiving audio or video signals. The input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The graphics processor 5041 pairs images of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. Data is processed. The processed image frames may be displayed on the display unit 506. The image frames processed by the graphics processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. The microphone 5042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 501 in the case of a telephone call mode and output.

The mobile terminal 500 further includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light. The proximity sensor can close the display panel 5061 and the mobile terminal 500 when the mobile terminal 500 moves to the ear. / Or backlight. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, which can be used to identify mobile terminal attitudes (such as horizontal and vertical screen switching, related games , Magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc .; sensor 505 can also include fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, Infrared sensors, etc. are not repeated here.

The display unit 506 is configured to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061. The display panel 5061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

The user input unit 507 may be used to receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. Touch panel 5071, also known as touch screen, can collect user's touch operations on or near it (such as the user using a finger, stylus, etc. any suitable object or accessory on touch panel 5071 or near touch panel 5071 operating). The touch panel 5071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, and detects the signal caused by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into contact coordinates, and sends it To the processor 510, receive the command sent by the processor 510 and execute it. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel 5071. In addition to the touch panel 5071, the user input unit 507 may also include other input devices 5072. Specifically, other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, and details are not described herein again.

Further, the touch panel 5071 may be overlaid on the display panel 5061. After the touch panel 5071 detects a touch operation on or near the touch panel 5071, the touch panel 5071 transmits the touch operation to the processor 510 to determine the type of touch event. The type of event provides corresponding visual output on the display panel 5061. Although in FIG. 10, the touch panel 5071 and the display panel 5061 are implemented as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 5071 and the display panel 5061 can be integrated. The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 508 is an interface through which an external device is connected to the mobile terminal 500. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, and audio input / output (I / O) port, video I / O port, headphone port, and more. The interface unit 508 may be used to receive an input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 500 or may be used for the mobile terminal 500 and external Transfer data between devices.

The memory 509 can be used to store software programs and various data. The memory 509 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.), etc .; the storage data area may store data according to Data (such as audio data, phone book, etc.) created by the use of mobile phones. In addition, the memory 509 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The processor 510 is a control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, and runs or executes software programs and / or modules stored in the memory 509 and calls data stored in the memory 509 , Perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 510 may include one or more processing units; optionally, the processor 510 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and an application program, etc. The tuning processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 510.

The mobile terminal 500 may further include a power source 511 (such as a battery) for supplying power to various components. Optionally, the power source 511 may be logically connected to the processor 510 through a power management system, thereby implementing management of charging, discharging, and power consumption through the power management system. Management and other functions.

In addition, the mobile terminal 500 includes some functional modules that are not shown, and details are not described herein again.

Optionally, some embodiments of the present disclosure further provide a mobile terminal, including a processor 510, a memory 509, and a computer program stored in the memory 509 and executable on the processor 510. The computer program is processed by the processor. When 510 is executed, the processes of the foregoing shooting method embodiments are implemented, and the same technical effects can be achieved. To avoid repetition, details are not described herein again.

Some embodiments of the present disclosure further provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the processes of the foregoing shooting method embodiments are implemented, and the same Technical effects. To avoid repetition, we will not repeat them here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this article, the terms "including", "including" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, It also includes other elements not explicitly listed, or elements inherent to such a process, method, article, or device. Without more restrictions, an element limited by the sentence "including a ..." does not exclude that there are other identical elements in the process, method, article, or device that includes the element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary universal hardware platform, and of course, also by hardware, but in many cases the former is better. Implementation. Based on such an understanding, the technical solution of the present disclosure that is essentially or contributes to related technologies can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, and optical disk) ) Includes instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the embodiments of the present disclosure.

The embodiments of the present disclosure have been described above with reference to the accompanying drawings, but the present disclosure is not limited to the specific implementations described above, and the specific implementations described above are only schematic and not restrictive. Those of ordinary skill in the art at Under the inspiration of this disclosure, many forms can be made without departing from the spirit of the present disclosure and the scope of protection of the claims, which all fall within the protection of this disclosure.

Claims

A shooting method is applied to a mobile terminal. The mobile terminal includes a mobile terminal body and a camera provided on the mobile terminal body. The method includes:

Collecting a preview picture through the camera, and identifying a shooting subject from the preview picture;

Adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjusting the internal optical axis offset of the camera.
The method according to claim 1, wherein the camera is a camera movable in a vertical direction;

The step of adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and, adjusting the internal optical axis offset of the camera includes:

Adjusting the camera to move in a vertical direction relative to the main body of the mobile terminal, or / and adjusting the amount of offset of the internal optical axis of the camera in a horizontal direction.
The method according to claim 1, wherein the adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjusting the internal light of the camera Steps for axis offsets, including:

In the case where the amplitude of the shake of the mobile terminal is greater than a preset threshold, if a preset input operation is detected, adjust the position of the camera relative to the mobile terminal body, or / and, adjust the internal optical axis offset of the camera ;

Generate an image file corresponding to the preview screen captured by the camera after the adjustment.
The method according to claim 1, wherein the adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjusting the internal light of the camera Steps for axis offsets, including:

When the jitter amplitude of the mobile terminal is not greater than a preset threshold, adjusting the position of the camera relative to the mobile terminal body according to the first adjustment amplitude, or / and adjusting the internal optical axis offset of the camera;

If a preset input operation is detected, adjust the position of the camera relative to the mobile terminal body according to the second adjustment range, or / and adjust the internal optical axis offset of the camera; wherein the second adjustment range is smaller than the first adjustment Amplitude

Generate an image file corresponding to the preview picture acquired after the camera adjusts according to the second adjustment range.
The method according to claim 1, before the step of adjusting the position of the camera relative to the mobile terminal body, or / and adjusting the internal optical axis offset of the camera, further comprising:

Processing a plurality of preselected subject positions according to a deep learning algorithm to obtain the subject position of the preview picture, or using the subject position preset by the user as the subject position of the preview picture;

The step of collecting a preview picture through the camera and identifying a shooting subject from the preview picture includes:

Performing face recognition on the preview picture to obtain at least one face object;

When one face object is obtained, using the obtained face object as a photographing subject;

When a plurality of the face objects are obtained, selecting one face object from the plurality of the face objects as a shooting subject;

The step of adjusting the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and, adjusting the internal optical axis offset of the camera includes:

Adjusting the position of the camera relative to the main body of the mobile terminal according to the position of the subject and the position of the shooting subject in the preview screen, or / and adjusting the internal optical axis offset of the camera to enable the shooting The position of the subject in the preview screen matches the position of the subject.
A mobile terminal includes a mobile terminal body and a camera disposed on the mobile terminal body, including:

A shooting subject recognition module, configured to collect a preview picture through the camera, and identify a shooting subject from the preview picture;

An adjustment module is configured to adjust the position of the camera relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and adjust the internal optical axis offset of the camera.
The mobile terminal according to claim 6, wherein the camera is a camera movable in a vertical direction;

The adjustment module is specifically configured to adjust the camera to move in a vertical direction relative to the mobile terminal body according to the position of the shooting subject in the preview screen, or / and, adjust the internal optical axis of the camera Offset in the horizontal direction.
The mobile terminal according to claim 6, wherein the adjustment module comprises:

A first adjustment submodule, configured to adjust the position of the camera relative to the main body of the mobile terminal if a predetermined input operation is detected if the amplitude of the shake of the mobile terminal is greater than a preset threshold, or / and, adjust the The internal optical axis offset of the camera;

The first generating sub-module is configured to generate an image file corresponding to the preview image collected by the camera after the adjustment.
The mobile terminal according to claim 6, wherein the adjustment module comprises:

A second adjustment submodule, configured to adjust the position of the camera relative to the main body of the mobile terminal, or / and, adjust the camera according to the first adjustment range when the shake amplitude of the mobile terminal is not greater than a preset threshold The internal optical axis offset;

A third adjustment sub-module, configured to adjust the position of the camera relative to the mobile terminal body according to the second adjustment range if a preset input operation is detected, or / and adjust the internal optical axis offset of the camera; wherein, The second adjustment range is smaller than the first adjustment range;

A second generation submodule is configured to generate an image file corresponding to the preview image acquired after the camera adjusts according to the second adjustment range.
The mobile terminal according to claim 6, further comprising: a subject position acquisition module, configured to process a plurality of pre-selected subject positions according to a deep learning algorithm to obtain the subject positions of the preview picture, or preset the user The main body position of the main screen as the main body position of the preview screen;

The shooting subject recognition module includes:

A face object acquisition submodule, configured to perform face recognition on the shooting picture to obtain at least one face object;

A first shooting subject acquisition submodule, configured to use the obtained face object as a shooting subject when one of the face objects is obtained;

A second shooting subject acquisition submodule, configured to select a face object as a shooting subject from a plurality of the face objects when a plurality of the face objects are obtained;

The adjustment module is specifically configured to adjust the position of the camera relative to the mobile terminal body according to the position of the subject and the position of the shooting subject in the preview screen, or / and adjust the internal optical axis deviation of the camera The amount of movement so that the position of the shooting subject in the preview screen matches the position of the subject.
A mobile terminal includes a processor, a memory, and a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, any one of claims 1 to 5 is implemented. Steps of a shooting method.
A computer-readable storage medium having stored thereon a computer program, and when the computer program is executed by a processor, the steps of the photographing method according to any one of claims 1 to 5 are implemented.