WO2019071492A1

WO2019071492A1 - Computer readable storage medium and intelligent terminal used for focusing

Info

Publication number: WO2019071492A1
Application number: PCT/CN2017/105764
Authority: WO
Inventors: 罗坤
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-10-11
Filing date: 2017-10-11
Publication date: 2019-04-18
Also published as: CN111213362A; CN111213362B

Abstract

Provided by the present invention are a computer readable storage medium and an intelligent terminal used for focusing, wherein, when a computer program is executed by a processor: capturing a preview image by means of a lens of the computer readable storage medium; selecting at least one desired focus target in the preview image; determining among the desired focus targets the farthest desired focus target from the lens; controlling the lens to deflect toward the farthest desired focus target in order to obtain a maximum deflection angle of the lens; combining the desired focus targets into a combined focus target; receiving a focus instruction for the combined focus target; executing the focus instruction on the combined focus target on the basis of the maximum deflection angle. By using the technical solution of the present invention, it is possible to achieve multi-point focus on at least one desired focus target in the same preview image simultaneously so as to provide a clearer image and a more optimized use experience for the user.

Description

Computer readable storage medium and intelligent terminal for focusing

Technical field

The present invention relates to the field of computers, and in particular, to a computer readable storage medium and an intelligent terminal for multi-point focusing.

Background technique

Focusing technology refers to finding the lens position that makes the shooting target the clearest by moving the lens. In general, there are two types of focusing technology: 1. Active focusing, such as determining the distance of the shooting target by the distance sensing device, and then moving the lens to focus; 2. Passive focusing, searching for the clearest position of the shooting target through the lens movement, Then focus is completed. In addition, in addition to moving the lens, the focus technology has a fixed lens that moves the image plane to focus.

At present, when shooting based on a computer-readable storage medium and/or a smart terminal, the focus can be divided into auto focus and touch focus, and touch focus is also called manual focus, which means that the user manually selects the desired on the touch screen. The target of the focus is focused.

However, the existing touch focus can only select one point or one target to focus. When focusing on a distant target, the near object is blurred because it is not in the depth of field. When selecting the focus near the target, the distance is far away. The object is blurred because it is not in the depth of field. Based on the state of the art, the user cannot achieve simultaneous focusing with multiple electric shocks.

Therefore, it is required to provide a computer readable storage medium for focusing and a smart terminal, by which a user can realize multi-touch focusing by using a computer readable storage medium and an intelligent terminal, and can focus on a target in different depth ranges. Clear imaging provides users with a more optimized shooting experience.

Summary of the invention

In order to overcome the above technical deficiencies, an object of the present invention is to provide a computer readable storage medium and an intelligent terminal for focusing, by which a user can realize multi-touch focusing by using a computer readable storage medium and an intelligent terminal, which can be based on different depths. Clear imaging of the target to be focused within the range of the scene provides users with a more optimized shooting experience.

The present invention discloses a computer readable storage medium for focusing, on which is stored a computer program that, when executed by a processor, implements the following steps:

Acquiring a preview image through a lens of the computer readable storage medium;

Selecting at least one of the preview images to focus on the target;

Determining a farthest desired focus target that is farthest from the lens in the target to be focused;

Controlling the lens to deflect toward the farthest desired focus target to obtain a maximum deflection angle of the lens;

Combining the desired focus targets into a combined focus target;

Receiving a focus command for the merged focus target;

The focus instruction is executed on the merged focus target based on the maximum deflection angle.

Preferably, the step of determining the farthest target to be focused that is the farthest from the lens in the target to be focused further comprises:

Focusing on each of the desired focus targets in sequence;

Recording the number of moving steps of each of the to-be-focused targets when the lens is in focus;

Determining a distance between the target to be focused and the lens corresponding to the number of moving steps according to the number of moving steps.

Preferably, in the step of controlling the lens to be deflected toward the farthest target to obtain a maximum deflection angle of the lens, the method further includes:

Controlling the lens toward the farthest target to be deflected by a tilt actuator;

Adjusting a deflection angle of the lens to control the farthest focus target to be within a depth of field of the lens;

The adjusted deflection angle is set to the maximum deflection angle.

Preferably, the step of performing the focus instruction on the merged focus target based on the maximum deflection angle further includes:

The focus instruction is invoked on the merged focus target by a focus algorithm.

Preferably, the merged focus target is a focus area including each of the target to be focused.

The present invention further provides an intelligent terminal comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the computer program to implement the following steps:

Collecting a preview image through a lens of the smart terminal;

Selecting at least one of the preview images to focus on the target;

Combining the desired focus targets into a combined focus target;

Receiving a focus command for the merged focus target;

Focusing on each of the desired focus targets in sequence;

The adjusted deflection angle is set to the maximum deflection angle.

After adopting the above technical solution, compared with the prior art, the following beneficial effects are obtained:

The computer readable storage medium and the intelligent terminal can realize multi-touch focusing, and can provide a more optimized shooting experience for the user based on clear imaging of the target to be focused in different depth ranges.

DRAWINGS

1 is a flow chart showing a focus of a computer readable storage medium for focusing in accordance with an embodiment of the present invention;

2 is a flow chart showing a process of performing focusing on a computer readable storage medium for focusing in accordance with an embodiment of the present invention;

3 is a schematic flow chart of performing focusing on a computer readable storage medium for focusing in accordance with an embodiment of the present invention;

4 is a schematic flow chart of a processor performing focusing on a smart terminal for focusing in accordance with an embodiment of the present invention.

Detailed ways

Advantages of the present invention are further explained below in conjunction with the accompanying drawings and specific embodiments.

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects of the present disclosure as detailed in the appended claims.

The terms used in the present disclosure are for the purpose of describing particular embodiments only, and are not intended to limit the disclosure. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

The smart terminal can be implemented in various forms. For example, the terminal described in the present invention may include a smart terminal such as a mobile phone, a smart phone, a notebook computer, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, and the like, and such as Fixed terminal for digital TV, desktop computer, etc. In the following, it is assumed that the terminal is a smart terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

Referring to FIG. 1, a flow chart of performing focusing on a computer readable storage medium for focusing in accordance with an embodiment of the present invention is shown. Wherein the computer readable storage medium stores a computer program. The computer program implements the following steps when the processor performs focusing:

S001: collecting a preview image by using a lens of the computer readable storage medium;

First, the shooting module in the computer readable storage medium is activated, and the shooting module opens its built-in image acquisition sensor according to the startup instruction, and the image acquisition sensor acquires a preview image by using the lens provided in the shooting module. The preview image obtained by the lens acquisition is displayed on the screen of the computer storage medium through a display module in the computer readable storage medium.

S002: Select at least one of the preview images to focus on the target;

After the lens of the computer readable storage medium captures a preview image, the computer readable storage medium may further select the target to be focused in the image. The focus target is the focus object that the user needs to be able to clearly image. The target to be focused may be a character, an animal or a still life, or may be a certain point in an image. In this embodiment, the number of targets to be focused is not limited.

S003: determining a farthest target to be focused that is farthest from the lens in the target to be focused;

In order to perform a focus command on a target to be focused, first, the computer readable storage medium needs to first determine the relative position of all the targets to be focused, and determine the target to be focused that is farthest from the computer readable storage medium among the plurality of focus targets. The farthest desired focus target is used as a reference object for executing the focus command, thereby ensuring that all selected target objects in the preview image can have clear imaging in the same image.

S004: controlling the lens to be deflected toward the farthest target to obtain a maximum deflection angle of the lens;

According to the judgment result obtained in step S003, the computer readable storage medium automatically deflects the lens in the shooting module to the farthest target to be focused, and changes the position of the focus plane to ensure that the farthest target is in the depth of field, Get a clear image. After the deflection is completed, the deflection angle is recorded and the deflection angle is set to the maximum deflection angle.

S005: Combine the target to be combined into a combined focus target;

The computer readable storage medium establishes a plane coordinate system of an XY axis in the preview image displayed in the image preview interface, and acquires coordinate positions of the plurality of to-be-focused targets selected in step S002 in the plane coordinate system, according to each coordinate position. In the preview image, a focus area containing all the targets to be focused is defined, that is, the focus target is merged.

S006: Receive a focus instruction on the merged focus target;

After the selection of the target to be focused is completed, the user may further issue a focus instruction to the computer readable storage medium by a preset gesture or operation to control the computer readable storage medium to merge the desired target in the acquired preview image. The merged focus target performs focus. The preset gesture or operation may include: clicking a focus button, The operation interface, long press, etc. can be set or modified according to the user's personal habits.

S007: Perform the focus instruction on the merged focus target based on the maximum deflection angle.

According to the focus command, the computer readable storage medium controls the lens in the shooting module to focus the combined focus target as a whole. Among them, the lens is deflected based on the maximum deflection angle obtained in S005, and the optical axis is offset with the deflection of the lens. At the same time, the position of the object plane is also deflected, and the depth of field is widened so that the original is not on the same object plane. The target to be focused can be in the same object plane for clear imaging.

Referring to FIG. 2, a flow chart of performing focusing on a computer readable storage medium for focusing in accordance with an embodiment of the present invention is shown. In this embodiment, the step of determining the farthest target to be focused that is the farthest from the lens in the target to be focused further includes:

S301: Focusing on each of the to-be-focused targets in turn, and simultaneously recording the number of moving steps of each of the to-be-focused targets when the lens is in focus;

The computer readable storage medium selects a plurality of objects to be focused in a preview image, and the computer readable storage medium sequentially focuses on each target to be focused by changing the relative positions of the lenses to ensure clear imaging of the target to be focused. In general, the focus adopted in this embodiment continuously generates a new preview image during the focusing process. When the focus starts, the computer readable storage medium sends the preview image of the frame acquired by the lens at the initial position to the image processor (ISP) for processing, and obtains the statistical information of the preview image, and then sends the statistical information. To the focus algorithm library (which can be executed on the ISP hardware or in the driver software), the focus algorithm library calculates the distance from which direction the next lens should move according to the hardware specification and the above statistical information, and drives the lens to reach that position. Then, a new preview image is obtained at this position, and the statistical information is further calculated for the new preview image, and the next lens position is further calculated, and the above steps are repeated until the definition of the target to be focused in the preview image is gradually changed to a certain extent. , complete the focus.

S302: Determine, according to the number of moving steps, a distance between the target to be focused and the lens corresponding to the number of moving steps.

For different focus targets in the same preview image, the distance between the lens and the lens is different according to the actual position of the lens. Therefore, the number of moving steps of the lens for each target to be focused is different during the focusing process. Therefore, the relative position of the target to be focused can be determined by the number of steps of the lens during the focusing process. In this embodiment, the target to be focused with the least number of moving steps is the farthest target to be focused.

Referring to FIG. 3, a flow chart for performing focusing on a computer readable storage medium for focusing in accordance with an embodiment of the present invention is shown. In this embodiment, the step of controlling the lens to be deflected toward the farthest target to obtain a maximum deflection angle of the lens further includes:

S401: controlling, by a tilt actuator, the lens to be deflected toward the farthest target to be focused;

The computer readable storage medium controls the lens deflection in the camera module by a built-in tilt actuator to change the focus plane to ensure a clear image of a target to be focused.

S402: Adjust a deflection angle of the lens to control the farthest focus target to be within a depth of field of the lens;

The deflection angle of the lens in the shooting module is adjusted so that the farthest focus target that is in the range of depth of field before and after the object plane is within the depth of field. The depth of field range is the range of the distance between the front and back of the subject measured by the image of the camera lens or other imager leading edge that can obtain a clear image.

S403: The adjusted deflection angle is set as a maximum deflection angle.

When the tilt actuator controls the lens to deflect to a deflection angle, the farthest desired focus target can be controlled within the depth of field of the lens. After obtaining a clear image, the deflection angle is recorded, and the deflection angle is set to a maximum deflection angle. When the subsequent computer readable storage medium focuses on the merged focus target including the plurality of target to be focused, the lens is controlled to be deflected within the range of the deflection angle to integrate all the desired targets into the depth of field, thereby achieving the same preview. Multiple focus targets in the image focus and clear imaging.

In a preferred embodiment, the step of performing the focus instruction on the merged focus target based on the maximum deflection angle further includes:

The focus principle provided in step S301 is basically the same. When the focus command is executed on the merged focus target, the merged focus target is regarded as a focus target, and a new preview image is continuously generated for the change of the image sharpness of the focus target during the focus process. When the focus starts, the computer readable storage medium sends the preview image of the frame acquired by the lens at the initial position to the image processor (ISP) for processing, and obtains the statistical information of the preview image, and then sends the statistical information. To the focus algorithm library (which can be executed on the ISP hardware or in the driver software), the focus algorithm library calculates the distance from which direction the next lens should move according to the hardware specification and the above statistical information, and drives the lens to reach that position. Then, a new preview image is obtained at this position, and the new preview image is further calculated statistical information, and the next lens position is further calculated, and the above steps are repeated until the merged focus target in the preview image is gradually changed to a certain extent. , complete the focus.

4 is a schematic flowchart of performing focusing on a processor of a smart terminal according to an embodiment of the present invention. An intelligent terminal includes a memory, a processor, and a computer program stored on the memory and operable on the processor, the computer program being subjected to the following steps when the processor performs focusing:

S001': collecting a preview image by using a lens of the smart terminal;

First, the shooting module in the smart terminal is activated, and the shooting module opens its built-in image acquisition sensor according to the startup command, and the image acquisition sensor collects a preview image by using the lens provided in the shooting module. The preview image obtained by the lens acquisition is displayed on the screen of the computer storage medium through the display module in the smart terminal.

S002': selecting at least one of the preview images to focus on the target;

After the camera of the smart terminal captures a preview image, the smart terminal may further select the target to be focused in the image. The focus target is the focus object that the user needs to be able to clearly image. The target to be focused may be a character, an animal or a still life, or may be a certain point in an image. In this embodiment, the number of targets to be focused is not limited.

S003': determining a farthest target to be focused that is farthest from the lens in the target to be focused;

In order to execute the focus command on the target to be focused, firstly, the smart terminal needs to first determine the relative position of all the targets to be focused, and determine the target to be focused that is farthest from the smart terminal among the plurality of focus targets, and the farthest focus is desired. The target serves as a reference for the execution of the focus command, ensuring that all selected in-focus targets in the preview image have clear imaging in the same image.

S004': controlling the lens to be deflected toward the farthest target to obtain a maximum deflection angle of the lens;

According to the judgment result obtained in step S003', the smart terminal automatically deflects the lens in the shooting module to the farthest target to be focused, and changes the position of the focus plane to ensure that the farthest target is in the depth of field to obtain a Clear imaging. After the deflection is completed, the deflection angle is recorded and the deflection angle is set to the maximum deflection angle.

S005': combining the target to be focused into a combined focus target;

The intelligent terminal establishes a plane coordinate system of the XY axis in the preview image displayed in the image preview interface, and acquires coordinate positions of the plurality of selected focus targets in the plane coordinate system selected in step S002', and preview images according to the respective coordinate positions. The middle of the focus area containing all the targets to be focused is the combined focus target.

S006': receiving a focus instruction for the merged focus target;

After the selection of the target to be focused is completed, the user can further issue a focus command to the smart terminal through a preset gesture or operation to control the smart terminal to perform focusing on the merged focus target formed by combining the desired target in the acquired preview image. . The preset gesture or operation may include: clicking a focus button, a swipe operation interface, a long press, etc., which may be set or modified according to the user's personal habits.

S007': executing the focus instruction on the merged focus target based on the maximum deflection angle.

According to the focus command, the smart terminal controls the lens in the shooting module to focus the combined focus target as a whole. Wherein, the lens is deflected based on the maximum deflection angle obtained in S005', and the optical axis is offset with the deflection of the lens. At the same time, the position of the object plane is also deflected, and the depth of field is widened so that the original is not on the same object plane. Multiple targets to be focused can be in the same object plane for clear imaging.

In a preferred embodiment, the step of determining the farthest target to be focused that is farthest from the lens in the target to be focused further includes:

S301': sequentially focusing on each of the to-be-focused targets, and simultaneously recording the number of moving steps of each of the to-focus targets when the lens is in focus;

After the smart terminal selects multiple target to be focused in one preview image, the smart terminal sequentially focuses on each target to be focused by changing the relative position of the lens to ensure that the image to be focused is clear. In general, the focus mode employed in this embodiment continuously generates a new preview image during the focusing process. When the focus starts, the smart terminal sends the preview image of the frame acquired by the lens at the initial position to the image processor (ISP) for processing, and obtains the statistical information of the preview image, and then sends the statistical information to the focusing algorithm. The library (which can be executed on the ISP hardware or in the driver software), the focus algorithm library calculates the distance from which direction the next lens should move according to the hardware specification and the above statistical information, and drives the lens to reach that position; This position gets a new preview image, and further calculates the statistical information for the new preview image, further calculates the position of the next lens, and repeats the above steps until the definition of the target to be focused in the preview image gradually becomes a certain degree, and the focus is completed. .

S302': determining a distance between the target to be focused and the lens corresponding to the number of moving steps according to the number of moving steps.

In a preferred embodiment, the step of controlling the lens to deflect toward the farthest target to obtain the maximum deflection angle of the lens further includes:

S401': controlling, by a tilt actuator, the lens to be deflected toward the farthest target to be focused;

The smart terminal controls the lens deflection in the camera module by the built-in tilt actuator to change the focus plane to ensure a clear image of the target to be focused.

S402': adjusting a deflection angle of the lens to control the farthest focus target to be within a depth of field of the lens;

S403': The adjusted deflection angle is set to a maximum deflection angle.

When the tilt actuator controls the lens to deflect to a deflection angle, the farthest desired focus target can be controlled within the depth of field of the lens. After obtaining a clear image, the deflection angle is recorded, and the deflection angle is set to a maximum deflection angle. Then, when the following smart terminal focuses on the merged focus target including the plurality of target to be focused, the lens is controlled to be deflected within the range of the deflection angle, so that all the targets to be focused are included in the depth of field range, thereby achieving the same preview image. Multiple focus targets and clear imaging.

The focus principle provided in step S301' is basically the same. When the focus command is executed on the merged focus target, the merged focus target is regarded as a focus target, and a new preview image is continuously generated for the change of the image sharpness of the focus target during the focus process. When the focus starts, the smart terminal sends the preview image of the frame acquired by the lens at the initial position to the image processor (ISP) for processing, and obtains the statistical information of the preview image, and then sends the statistical information to the focusing algorithm. The library (which can be executed on the ISP hardware or in the driver software), the focus algorithm library calculates the distance from which direction the next lens should move according to the hardware specification and the above statistical information, and drives the lens to reach that position; This position gets a new preview image, and then the statistics are further calculated for the new preview image. Further calculate the position of the next lens, and repeat the above steps until the resolution of the merged focus target in the preview image is gradually changed to a certain level to complete the focus.

The computer readable storage medium and the intelligent terminal provided by the invention can realize multi-point focusing on at least one target in the same preview image to provide a clearer image, thereby providing a more optimized image for the user. Use experience.

It should be noted that the embodiments of the present invention are preferred embodiments, and are not intended to limit the scope of the present invention. Any one skilled in the art may use the above-disclosed technical contents to change or modify the equivalent embodiments. Any modification or equivalent changes and modifications of the above embodiments in accordance with the technical spirit of the present invention are still within the scope of the technical solutions of the present invention.

Claims

A computer readable storage medium for focusing, on which is stored a computer program, characterized in that

The computer program is executed by the processor to implement the following steps:

Acquiring a preview image through a lens of the computer readable storage medium;

Selecting at least one of the preview images to focus on the target;

Determining a farthest desired focus target that is farthest from the lens in the target to be focused;

Controlling the lens to deflect toward the farthest desired focus target to obtain a maximum deflection angle of the lens;

Combining the desired focus targets into a combined focus target;

Receiving a focus command for the merged focus target;

The focus instruction is executed on the merged focus target based on the maximum deflection angle.
The computer readable storage medium of claim 1 wherein:

The step of determining the farthest target to be focused that is the farthest from the lens in the target to be focused further includes:

Focusing on each of the desired focus targets in sequence;

Recording the number of moving steps of each of the to-be-focused targets when the lens is in focus;

Determining a distance between the target to be focused and the lens corresponding to the number of moving steps according to the number of moving steps.
The computer readable storage medium of claim 1 wherein:

The step of controlling the lens to be deflected toward the farthest target to obtain a maximum deflection angle of the lens further includes:

Controlling the lens toward the farthest target to be deflected by a tilt actuator;

Adjusting a deflection angle of the lens to control the farthest focus target to be within a depth of field of the lens;

The adjusted deflection angle is set to the maximum deflection angle.
The computer readable storage medium of claim 1 wherein:

And the step of performing the focus instruction on the merged focus target based on the maximum deflection angle, further comprising:

The focus instruction is invoked on the merged focus target by a focus algorithm.
A computer readable storage medium according to any one of claims 1 to 4, wherein

The merged focus target is a focus area including each of the target to be focused.
An intelligent terminal includes a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein

The processor implements the following steps when executing the computer program:

Collecting a preview image through a lens of the smart terminal;

Selecting at least one of the preview images to focus on the target;

Determining a farthest desired focus target that is farthest from the lens in the target to be focused;

Controlling the lens to deflect toward the farthest desired focus target to obtain a maximum deflection angle of the lens;

Combining the desired focus targets into a combined focus target;

Receiving a focus command for the merged focus target;

The focus instruction is executed on the merged focus target based on the maximum deflection angle.
The intelligent terminal of claim 6 wherein:

The step of determining the farthest target to be focused that is the farthest from the lens in the target to be focused further includes:

Focusing on each of the desired focus targets in sequence;

Recording the number of moving steps of each of the to-be-focused targets when the lens is in focus;

Determining a distance between the target to be focused and the lens corresponding to the number of moving steps according to the number of moving steps.
The intelligent terminal of claim 6 wherein:

The step of controlling the lens to be deflected toward the farthest target to obtain a maximum deflection angle of the lens further includes:

Controlling the lens toward the farthest target to be deflected by a tilt actuator;

Adjusting a deflection angle of the lens to control the farthest focus target to be within a depth of field of the lens;

The adjusted deflection angle is set to the maximum deflection angle.
The intelligent terminal of claim 6 wherein:

And the step of performing the focus instruction on the merged focus target based on the maximum deflection angle, further comprising:

The focus instruction is invoked on the merged focus target by a focus algorithm.
The intelligent terminal according to any one of claims 6 to 9, wherein

The merged focus target is a focus area including each of the target to be focused.