WO2021102961A1

WO2021102961A1 - Focusing method for photographing apparatus, image processing device, and storage medium

Info

Publication number: WO2021102961A1
Application number: PCT/CN2019/122109
Authority: WO
Inventors: 韩守谦
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2019-11-29
Filing date: 2019-11-29
Publication date: 2021-06-03

Abstract

A focusing method for a photographing apparatus, an image processing device and a storage medium. Said method comprises: controlling a photographing apparatus to acquire a preview image (S101); determining an initial focusing area of the preview image (S102); and if the initial focusing area does not satisfy a contrast detection auto focus condition, expanding the initial focusing area to obtain a candidate focusing area, and performing, according to the candidate focusing area, contrast detection auto focus processing on the photographing apparatus (S103). By means of said method, the focusing success rate of the photographing apparatus can be improved.

Description

Focusing method of photographing device, image processing equipment and storage medium

Technical field

The present invention relates to the field of communication technology, in particular to a focusing method, image processing equipment and storage medium of a photographing device.

Background technique

When using a photographing device to take an image, the indispensable step in order to obtain a clear image is focusing. The so-called focusing refers to the process of changing the distance and distance of the object through the focusing motor of the photographing device to make the image of the object clear. Currently commonly used focusing methods include Contrast Detection Auto Focus (CDAF) (or called Contrast Focus), as the name implies, contrast focusing is based on contrast detection for focusing. Specifically, the contrast focusing is based on the assumption that the contrast of adjacent pixels is the largest after the focusing is successful. In practical applications, when focusing on low-contrast objects (such as white clouds, white walls, etc.) based on CDAF, it may be easy for the contrast difference between the pixels on the object to be small, resulting in focus failure and resulting in the captured image Not clear. Therefore, how to improve the success rate of focusing on the camera during image shooting has become a hot issue of research.

Summary of the invention

The embodiment of the present invention provides a focusing method, image processing equipment and storage medium of a photographing device, which can improve the focusing success rate of the photographing device.

In a first aspect, an embodiment of the present invention provides a focusing method of a photographing device, which is characterized in that it includes:

Control the camera to obtain the preview image;

Determining the initial focus area of the preview image;

If the initial focus area does not meet the contrast focus condition, the initial focus area is expanded to obtain a candidate focus area, and the photographing device is subjected to contrast focus processing according to the candidate focus area.

In a second aspect, an embodiment of the present invention provides an image processing device, which is characterized in that it includes a memory and a processor;

The memory is used to store program code;

The processor is used to call program code, and when the program code is executed, it is used to perform the following operations:

Control the camera to obtain the preview image;

Determining the initial focus area of the preview image;

Correspondingly, an embodiment of the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, the computer program includes program instructions, and the program instructions are When executing, the processor is caused to execute the focusing method of the photographing device of the first aspect.

The embodiment of the present invention controls the camera to acquire the preview image and determine the initial focus area of the preview image when the camera is in focus; if the initial focus area does not meet the contrast and focus conditions, the initial focus area is expanded to obtain the candidate focus area, Further performing contrast focusing processing on the photographing device according to the candidate focus area, which realizes that when the initial focusing area does not meet the contrast focusing condition, the focusing processing is performed on the photographing device in a larger range, which can improve the focus success rate.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the embodiments. Obviously, the drawings in the following description are only some of the present invention. Embodiments, for those of ordinary skill in the art, without creative work, other drawings can be obtained based on these drawings.

FIG. 1 is a schematic flowchart of a focusing method of a photographing device according to an embodiment of the present invention;

2a is a schematic diagram of obtaining an initial focus area of a preview image according to an embodiment of the present invention;

FIG. 2b is another schematic diagram of obtaining an initial focus area of a preview image according to an embodiment of the present invention;

2c is another schematic diagram of obtaining an initial focus area of a preview image according to an embodiment of the present invention;

3 is a schematic diagram of the relationship between the adjustment position of the focus motor, the preview image, and the initial focus reference value according to an embodiment of the present invention;

4 is a schematic flowchart of another focusing method of a photographing device according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of determining a first block adjacent to an initial focus area according to an embodiment of the present invention;

Fig. 6a is a schematic diagram of determining the weight value of each block according to an embodiment of the present invention;

6b is another schematic diagram of determining the weight value of each block provided by an embodiment of the present invention;

Fig. 7 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Focusing is the process of focusing the object light in the shooting scene on the photosensitive area of the image sensor surface in the center of the lens of the shooting device through the refraction of the optical lens of the shooting device to make the exposed image clearer. If the focus is not good, the shooting will be obtained. The image will appear blurry. The embodiment of the present invention provides a focusing solution for a shooting device, which can be applied to a single smart focus AF-s and multiple continuous focus AF of a variety of shooting devices (such as digital cameras, drone cameras, and handheld pan-tilt cameras) -c application scenarios. Since the current contrast focus CDAF is to count the contrast of the user's focus area (that is, the initial focus area), if the contrast of the focus object in the initial focus area is very low, such as white clouds, white walls, etc., the contrast difference of the focus object may not be large , It is easy to cause focus failure. In order to solve this problem, the embodiment of the present invention proposes a focusing scheme for a photographing device based on contrast focusing. When it is detected that the contrast of the focus object in the initial focus area is not much different, the initial focus area is expanded to obtain the candidate focus area. Enlarge the focus target area and calculate the contrast difference of the focus target in a larger range, which can improve the focus success rate.

For example, if the user focuses on a white wall (that is, the focus object included in the initial focus area is a white wall), since the contrast of the white wall is not very different, it may be difficult to focus. If the embodiment of the present invention is used at this time, the white wall is detected. When the wall is a low-contrast object or it is detected that the initial focus area does not meet the contrast and focus conditions, expand the initial focus area to obtain a candidate focus area. The candidate focus area can contain more focus objects, such as sockets, lights, stickers, etc. on a white wall. The contrast of the focus objects is quite different. Based on these focus objects, the contrast focus can be assisted to improve the focus success rate.

The focusing scheme of the photographing device provided by the embodiment of the present invention may specifically include: controlling the photographing device to obtain a preview image; determining the initial focus area of the preview image; if the initial focus area does not meet the contrast and focus conditions, expanding the initial focus A candidate focus area is obtained from the area, and contrast focus processing is performed on the photographing device according to the candidate focus area. When the initial focus area does not meet the contrast and focus conditions, the camera can focus on the camera in a larger range, which can improve the focus success rate.

Based on the above-mentioned focusing solution of the photographing device, an embodiment of the present invention provides a focusing method of the photographing device. 1 is a schematic flowchart of a focusing method of a photographing device according to an embodiment of the present invention. The focusing method shown in FIG. 1 may be executed by an image processing device, and specifically may be executed by a processor of the image processing device, as shown in FIG. The focusing method includes the following steps:

Step S101: Control the photographing device to obtain a preview image.

Wherein, the photographing device may be any photographing device that can be used to photograph images, such as a digital camera, a drone camera, a handheld pan-tilt camera, and a mobile phone camera. The preview image is obtained by shooting an object in the shooting scene by the shooting device, and the preview image may be understood as an image used to focus the shooting device, based on the preview image and the focusing method provided by the embodiment of the present invention After performing the focusing processing for the camera, the camera is controlled to take photos of the objects in the shooting scene. At this time, the image obtained by shooting may be the image finally output to the user for viewing.

From the foregoing, it can be seen that the focusing method provided by the embodiment of the present invention is based on contrast focusing. The so-called contrast focusing is also called contrast focusing. It is the most basic focusing algorithm at present. In the specific implementation, the focusing motor can be adjusted in different ways by moving the focusing motor. A series of preview images corresponding to the positions, and then focus processing is performed according to the acquired preview images. Based on this, the preview image in step S101 is acquired by the photographing device when the focus motor is at each adjustment position, that is, the number of preview images is multiple.

Step S102: Determine the initial focus area of the preview image.

Wherein, the preview image is any one of a plurality of preview images. In one embodiment, the initial focus area of the preview image may be determined according to the operation position at which the user inputs an operation instruction to the photographing device and the preset size and shape information of the initial focus area. In specific implementation, the user can specify an operating position by clicking, double-clicking, or long-pressing the camera or the physical button on the camera. The image processing device selects an area with a preset size and a preset shape centered on the operating position. The initial focus area of the preview image. For example, the shape of the initial focus area set by the image processing device for the camera is a rectangle with a preset size. After the user determines the operating position on the camera, the image processing device selects a rectangular area of the preset size with the operating position as the center. The initial focus area of the preview image.

For example, referring to FIG. 2a is a schematic diagram of determining the initial focus area corresponding to a preview image provided by an embodiment of the present invention. Assuming that the image processing device presets the size of the initial focus area as a rectangle with length A and width B, the user An operation position C is designated by a click operation, and the image processing device takes the operation position C as the center, finds a rectangle 201 with a length A and a width B, and uses the rectangle 201 as the initial focus area of the preview image.

In another embodiment, the initial focus area of the preview image may be determined according to the user's operation instruction to the shooting device and the blocks included in the preview image. It should be understood that during image processing, in order to facilitate processing and improve processing efficiency, the image is usually divided into blocks, and corresponding processing is performed for each block. In the embodiment of the present invention, the initial focus area of the preview image is determined At this time, the preview image can also be divided into multiple blocks, and the initial focus area is determined according to the user's operation instructions and the blocks included in the preview image. In specific implementation, if the operation position corresponding to the user's operation instruction falls on the middle position of a block, the block (the subsequent block is referred to as the associated block related to the initial focus area) can be determined as the preview image Initial focus area; if the operation position corresponding to the user's operation instruction falls in a non-middle position of a block, the initial focus area will be determined according to the block and the other one or more blocks closest to the operation position (here The mentioned blocks can all be referred to as the associated blocks related to the initial focus area). Optionally, the size and shape information of the initial focus area can be preset. When the initial focus area is determined according to the block and another block or blocks closest to the operating position, the operating position can be the center , Respectively intercept a part of the above several blocks to form the initial focus area of the preview image,

For example, referring to FIGS. 2b and 2c, which are another schematic diagrams of obtaining the initial focus area of a preview image provided by an embodiment of the present invention, it is assumed that the image processing device divides the preview image into multiple blocks, and each block It is an AxB rectangle. The size and shape of the initial focus area are set in advance to be the same as the size and shape of a block. If the operating position input by the user is located at the D position shown in FIG. 2b, it can be seen that the operating position is located in the middle of the block 202, and the image processing device can use the block 202 as the initial focus area of the preview image. If the operation position input by the user is located at the position E of the block 202 shown in FIG. 2c, the initial focus area can be determined according to the block 202 and the block 203 with the closest operation position. In a specific implementation, the position E can be operated as the center, and a part of the block 202 and the block 203 can be respectively intercepted to form the initial focus area.

In other embodiments, the image processing device may automatically set an initial focus area for the preview image according to the objects in the shooting scene. For example, after the image processing device divides the preview image into multiple blocks, select one or more blocks in the middle of the preview image to form the initial focus area, or select several blocks with representative meaning in the image (such as blocks including people). ) As the initial focus area.

Step S103: If the initial focus area does not meet the contrast focus condition, the initial focus area is expanded to obtain a candidate focus area, and the camera device is subjected to contrast focus processing according to the candidate focus area.

In one embodiment, the initial focus area meeting the contrast and focus condition may mean that the multiple initial focus reference values corresponding to the initial focus area satisfy the reference value condition indicated by the contrast condition, and the multiple initial focus reference values satisfy the reference value condition indicated by the contrast condition. It may include one or more of the following: there is a peak among multiple initial focus reference values, each initial focus reference value is greater than the reference threshold, or there are a certain number of initial focus reference values greater than the reference threshold, and the difference between the maximum value and the minimum value is greater than the difference Value threshold. Wherein, the multiple initial focus reference values corresponding to the initial focus area can also be referred to as the AF statistical value (also called the contrast value, or the result of the AF evaluation function), which is obtained by calculating the reference value of the initial focus area of each preview image of.

In specific implementation, generally FIR filter, IIR filter and Sobel edge detection operator can be used to calculate the reference value of the initial focus area of each preview image. The following uses Sobel edge detection operator as an example to introduce how to calculate each The initial focus reference value corresponding to the initial focus area of the preview object. Assuming that the size of the preview image acquired by the camera is 4096x3040, the preview image is divided into 32x32, and the preview image is equally divided into 1024 blocks, each block size is 128x95; to obtain the associated blocks related to the initial focus area, and then use Sobel The edge detection operator performs edge detection processing on the associated blocks to obtain the sum of squares of each associated block; further, obtains the weight corresponding to each associated block, and compares the sum of squares of each associated block to the corresponding associated area The weights corresponding to the blocks are multiplied and added, and the result obtained is the initial focus reference value corresponding to the initial focus area of the preview image.

Among them, the weight corresponding to each associated block can be determined according to the distance between each associated block and the operating position. The closer the distance to the operating position, the greater the weight corresponding to the associated block, and the weight corresponding to each associated block The sum is equal to 1. For example, in Figure 2b, the associated block related to the initial focus area is only block 202, and the weight of block 202 is equal to 1. In Figure 2c, the associated block related to the initial focus area includes block 202 and block 203, and The distance between the block 202 and the operating position is closer, so the weight of the block 202 can be set to be greater than the weight of the block 203, and the sum of the weight of the block 202 and the weight of the block 203 is equal to one.

According to the above method, the initial focus reference value of the initial focus area corresponding to each preview image can be calculated. From the foregoing, it can be seen that each preview image is taken by the camera when the focus motor is at each adjustment position. Therefore, the initial focus area The corresponding multiple initial focus reference values essentially refer to the corresponding initial focus reference values when the focus motor is located at each adjustment position. For ease of understanding, refer to FIG. 3, which is a schematic diagram of the relationship between the adjustment position, the preview image, and the initial focus reference value of a focus motor according to an embodiment of the present invention. In Figure 3, 301 represents the camera, and 302 represents the shooting scene. Assuming that the adjustment position of the focus motor includes position 1, position 2, and position 3. When the focus motor is in a new adjustment position, the camera is controlled to obtain a preview image , So preview image 1, preview image 2, and preview image 3 can be obtained. The initial focus area of each preview image is the same, which is a rectangle with length A and width B. Then the image processing device calculates the initial focus reference value of the initial focus area corresponding to each preview image according to the above method, and obtains the initial focus reference value 1, the initial focus reference value 2, and the initial focus reference value 3. These three initial focus reference values are called Is the initial focus reference value corresponding to the initial focus area.

In the embodiment of the present invention, step S103 may include the following two embodiments:

The first type: After the initial focus area is obtained, it can be judged whether the initial focus area meets the contrast and focus conditions. When the initial focus area meets the contrast and focus conditions, the camera is subjected to contrast focus processing according to the initial focus area; When the area does not meet the contrast and focus conditions, the initial focus area is expanded to obtain a candidate focus area, and the camera device is subjected to contrast focus processing according to the candidate focus area. In this way, if the initial focus area meets the contrast and focus conditions, the step of expanding the initial focus area to obtain a candidate focus area may not be performed, which can save part of the power consumption of the image processing device.

The second type: After the initial focus area is obtained, the initial focus area can be expanded to obtain the candidate focus area, and then the camera is focused on the camera according to the initial focus area and the candidate focus area. In this way, after the camera fails to focus on the camera based on the initial focus area, the step of obtaining the candidate focus area can be omitted, and the camera can continue to focus on the camera based on the candidate focus area, which saves the time spent on focus processing. Improve focusing efficiency. In practical applications, any of the above-mentioned focusing processing procedures can be selected for focusing processing as required, which is not limited in the embodiment of the present invention.

Wherein, the implementation manner of performing contrast focusing processing on the photographing device according to the candidate focus area may be: finding a target position of the focus motor according to the candidate focus reference value corresponding to the candidate focus area of each preview image, and when the focus motor is at At this target position, the camera can take a clearer image. How to perform contrast focusing processing on the shooting device according to the candidate focus area will be described in detail in the following embodiments.

Based on the above-mentioned focusing method of a photographing device, an embodiment of the present invention also provides another focusing method of a photographing device. Refer to FIG. 4, which is a schematic flowchart of another focusing method of a photographing device provided by this embodiment. The focusing method shown in FIG. 4 may be executed by an image processing device, and specifically may be executed by a processor of the image processing device. The focusing method shown in FIG. 4 may include the following steps:

Step S401: Control the photographing device to obtain a plurality of preview images, each of which is obtained when the focus motor is in an adjustment position.

Step S402: Determine the initial focus area of each preview image.

In an embodiment, for some feasible implementation manners included in step S401 and step S402, reference may be made to the description of the relevant steps in the embodiment shown in FIG. 1, which will not be repeated here.

Step S403: Detect whether the focus object corresponding to the initial focus area needs a preset type of shooting object with multiple focus areas for focusing processing.

In one embodiment, after the initial focus area of the preview image is determined, it can be detected whether the focus object corresponding to the initial focus area is a preset type of shooting object that requires multiple focus areas for focus processing; if so, trigger If the initial focus area does not meet the contrast and focus conditions, then expand the initial focus area to obtain a candidate focus area, and perform contrast focus processing on the photographing device according to the candidate focus area; if not, based on the initial focus area The focus area performs focus processing on the photographing device. Among them, the preset type of shooting objects can be summarized based on historical shooting experience, or can be specified by the user, such as white clouds, white walls, and so on.

In this way, if the focus object corresponding to the initial focus area is a subject that does not require multiple focus areas for focusing, step S403-Step S405 may not be executed, and the object processing can be performed on the camera according to the initial focus area; When the focus object in the focus area needs to be focused in multiple focus areas, step S403 to step S405 are executed again, which can effectively save the power consumption of the image processing device and improve the focus processing efficiency.

Step S404, if yes, if the initial focus area does not meet the contrast focus condition, the initial focus area is expanded to obtain a candidate focus area, and the candidate focus area includes the first candidate focus area and the second candidate focus area.

In an embodiment, the candidate focus area may include a first candidate focus area, and the implementation manner of expanding the initial focus area to obtain the candidate focus area may be: partition the preview image to obtain multiple blocks, and obtain The weight value of each block; based on the weight value of at least one first block adjacent to the initial focus area, a first target block is determined in the at least one first block, and the first The weight value of the target block is greater than the weight values of other blocks in the at least one first block; the first candidate focus area is obtained according to the first target block and the initial focus area. Wherein, the number of the first target block may be one or more, and obtaining the first candidate focus area according to the first target block and the initial focus area may be the combination of the first target block and the initial focus area They are combined together to form the first candidate focus area.

In one embodiment, the number of the first target block may be at least one, and the number of the first target block may be based on the number of blocks of the initial focus area and the number of blocks of the first candidate focus area by the image processing device. definite. In a specific implementation, the image processing device can set the number of blocks in the first candidate focus area when the initial focus area is expanded once (also referred to as expanding the initial focus area by one level) to obtain the first candidate focus area, and then The number of first target blocks is determined according to the number of blocks in the first candidate focus area and the number of blocks in the initial focus area. For example, the image processing device sets the initial focus area to include 1x1 blocks, and performs an expansion process on the initial focus area to get the first candidate focus area to include 3x3 blocks, then the number of first target blocks should be 9-1=8 .

In an embodiment, if the number of the first target block is one, the implementation manner for determining the first target block in the at least one first block may be: selecting from the at least one first block The first block with the largest weight value is used as the first target block; if the number of first target blocks is at least two, the implementation of determining the first target block in the at least one first block is : Sort each first block in at least one first block in ascending order of weight value, and select the first block with the same number as the first target block from front to back in the first block after the arrangement. Block, the selected first block is used as the first target block.

In one embodiment, the at least one first block adjacent to the initial focus area may include a directly adjacent block directly adjacent to the initial focus area and an indirect adjacent area indirectly adjacent to the initial focus area. Among them, if there is no other block between a block and the edge block of the initial focus area (this situation can be referred to as the adjacent step size is 0), then the block is called the immediate adjacent area of the initial focus area Block; if there are other blocks between a block and the edge block of the initial focus area (in this case, the adjacent step is equal to the number of other blocks, for example, there are 2 other blocks, then the adjacent step 2), the block is called an indirect adjacent block of the initial focus area. For example, as shown in Figure 5, 501 represents a preview image, the preview image includes multiple blocks, suppose 502 represents the initial focus area, the initial focus area is composed of 3x3 blocks, block A and block B are two located in For the block at the edge of the initial focus area, there are no other blocks between the block C and the block A, and the two blocks are directly adjacent, then the block C is called the directly adjacent block of the initial focus area. If there is a block C between block D and block A, block D can be called an indirect adjacent block of the initial focus area. Similarly, block E and block F are also called initial focus The indirect adjacent block of the area.

Based on the above, the at least one first block adjacent to the initial focus area may refer to the remaining blocks in the preview image excluding the blocks included in the initial focus area, which are adjacent to the initial focus area within a certain adjacent step. For blocks, the specific adjacent step length may be determined according to the number and shape of blocks included in the first candidate focus area set by the image processing device, and the number and shape of blocks included in the initial focus area. For example, if the number of blocks included in the initial focus area is 1x1, the shape is rectangular, and the number of blocks included in the first candidate focus area is 3x3, and the shape is rectangular, the adjacent step length can be set to 0-1, that is to say A block with an adjacent step length of 0 and an adjacent step length of 1 between the edge block of the initial focus area is determined as the first block adjacent to the initial focus area.

In one embodiment, in the above process of determining the first candidate focus area, the block division of the preview image may be performed by the image processing device calling the AF stat module for auto-focus statistics, and the AF stat module may perform the preview image on the preview image by default. The division rule of the block division, the division rule may include the window size used for the block division, the size of each block after division, and so on.

In an embodiment, the weight value of each block in the preview image may be set according to the position of the initial focus area in the preview image and the image composition rule. It should be understood that the objects in the shooting scene include the shooting subject and the shooting background. Users often pay more attention to the shooting subject when shooting with the shooting device. The image composition rules may include ensuring that the shooting subject is located in the center of the captured image as much as possible. To ensure that the subject in the captured image is clearer, the initial focus area can be expanded as far as possible to the area where the subject exists (that is, the center of the image) to obtain the candidate focus area, so as to facilitate the focus processing of the camera based on the candidate focus area Later, the subject in the image captured by the camera is clearer.

Based on the above description, in order to achieve the above purpose, after the weight value of each block is set according to the position in the initial focus area and the image composition rule, the weight value of each block satisfies the following: The weight value of the block at the edge position of the preview image is smaller than the weight value of the block at the non-edge position of the preview image, the weight value of each block and the distance between the corresponding block and the center of the preview image Into a negative correlation. In other words, the closer to the center of the preview image, the greater the weight value of the block. For example, the user's operating position is the upper left corner of the preview image, and considering the image composition rules, the edge is often not within the user's attention range, and a smaller weight value can be set for the edge block on the preview image.

For example, referring to Figure 6a is a schematic diagram of determining the weight value of a block provided by an embodiment of the present invention. 601 represents a preview image, assuming that the initial focus area is 602, and 603 represents the center of the preview image, and the preview image is divided into 25 areas. Blocks, the following takes the block A, block B, block C and block D included in the 25 blocks as examples to illustrate the setting of the weight value for each block according to the position of the initial focus area in the preview image and the image composition rules After that, the relationship between the weight value of each block. Since block A and block B are located at the non-edge position of the preview image, block C and block D are located at the edge position of the preview image, so based on the above, the weight values of block C and block D are both smaller than the block The weight value of B is also less than the weight value of block A; in addition, as can be seen from Figure 6a, the distance between block C and the center of the preview image is less than the distance between block D and the center of the preview image, based on the weight value and distance The distance between the center of the preview image is negatively correlated, and the weight value of block C is greater than the weight value of block D. Similarly, the distance between the block A and the center of the preview image is less than the distance between the block B and the center of the preview image, so the weight value of the block A is greater than the weight value of the block B. Based on this, block A, block B, block C, and block D in the descending order of weight value are: weight value of block A> weight value of block B> weight value of block C> The weight value of block D.

In other embodiments, the weight value of each block in the preview image may also be set based on the semantic segmentation data of the preview image and the position of the initial focus area in the preview image. In specific implementation, the weight value is set for each block according to the following conditions: the weight value of the block having the same semantics as the initial focus area is greater than the weight value of the block having different semantics from the initial focus area, and The weight value of each block and the distance between the corresponding block and the center of the initial focus area are negatively correlated. It should be understood that the initial focus area is determined according to the operation instructions entered by the user, and the operation position where the user enters the operation instructions should be where there is an object of interest to the user. If the data is segmented according to semantics, it will be a block with the same semantics as the initial focus area. Setting a higher weight can ensure that when expanding the initial focus area, the first choice is to add blocks with the same semantics as the initial focus area to the initial focus area to obtain the candidate focus area. In this way, users can still be retained in the candidate focus area Objects of interest, in turn, can ensure that images satisfactory to the user are captured, and improve user experience.

For example, referring to Figure 6b is another schematic diagram of determining the weight value of a block provided by an embodiment of the present invention. 604 represents a preview image, assuming that the initial focus area is 605, and 606 represents the center of the initial focus area, assuming that the preview image is divided into 25 blocks, the following takes block A, block B, and block C as examples to illustrate the weight of each block after the weight value is set for each block according to the semantic segmentation data of the preview image and the position of the initial focus area The size relationship between. From the initial focus area, it can be seen that the object that the user may be interested in is a person. Block A and Block B are the blocks on the person, that is, Block A and Block B are blocks with the same semantics as the initial focus area. Therefore, the weight values of block A and block B are both greater than the weight value of block C; in addition, the distance between block A and the center of the initial focus area is less than the distance between block B and the center of the initial focus area, based on the weight of the above block The value is negatively correlated with the distance between the corresponding block and the center of the initial focus area. It can be seen that the weight value of block A is greater than the weight value of block B. Based on the above, the relationship between the weight values of block A, block B, and block C is: the weight value of block A>the weight value of block B>the weight value of block C.

In an embodiment, the candidate focus area may include a second candidate focus area in addition to the first candidate focus area. In specific implementation, if the candidate focus area further includes a second candidate focus area, expanding the initial focus area to obtain the candidate focus area further includes: based on a weight value of at least one second block adjacent to the first candidate focus area , Determining a second target block in the at least one second block, and the weight value of the second target block is greater than the weight value of other blocks in the at least one second block; The target block and the first candidate focus area are obtained to obtain the second candidate focus area, and the second candidate focus area is composed of the second target block and the first candidate focus area.

The number of the second target block may be at least one, and the number of the second target block may be determined by the image processing device according to the number of blocks of the first candidate focus area and the number of blocks of the second candidate focus area. . In a specific implementation, the image processing device may set the number of blocks of the first candidate focus area when the first candidate focus area is obtained by performing an expansion process on the initial focus area (also referred to as expanding the initial focus area by one level); and Set, continue to expand the first candidate focus area to obtain the second candidate focus area, the number of blocks in the second candidate focus area; then according to the number of blocks in the first candidate focus area and the blocks in the second candidate focus area The quantity determines the quantity of the second target block. For example, if the image processing device sets the first candidate focus area to include 3x3 blocks and the second candidate focus area to include 5x5 blocks, the number of second target blocks should be 25-9=16.

In one embodiment, based on the foregoing introduction of at least one block adjacent to the initial focus area, the at least one second block adjacent to the first candidate focus area may include a block directly adjacent to the first candidate focus area. The adjacent direct adjacent block and the indirect adjacent block indirectly adjacent to the first candidate focus area. In other words, the at least one second block adjacent to the first candidate focus area refers to the remaining blocks in the preview image excluding the blocks in the first candidate focus area that are in a certain step adjacent to the first candidate focus area. Neighboring blocks within the long. The specific size of the adjacent step may be determined according to the number and shape of the blocks included in the first candidate focus area set by the image processing device, and the number and shape of the blocks included in the second candidate focus area set by the image processing device.

It should be understood that the larger the number of candidate focus areas and the larger the size of the candidate focus areas, the higher the focus success rate when focusing on the camera. However, due to the different product forms of different camera devices, the size of the field of view is different. The number of candidate focus areas obtained by expanding the initial focus area is different due to different modes and different block division rules. For some shooting devices, it may be affected by the angle of view or working mode. The initial focus area can be expanded by two stages to obtain the first candidate focus area and the second candidate focus area; for some shooting devices, it may only It is allowed to expand the initial focus area by one level to obtain the first candidate focus area. Therefore, in order to accurately expand the initial focus area to obtain the candidate focus area, after each expansion of the initial focus area to obtain the first candidate focus area, it can be determined whether the camera meets the conditions for continuing expansion. The focus area is expanded to obtain the second candidate focus area.

In one embodiment, based on the weight value of at least one second block adjacent to the first candidate focus area, before determining the second target block in the at least one second block, the method further includes: determining Whether the ratio between the number of blocks included in the first candidate focus area and the number of blocks included in the preview image is less than a preset ratio; The step of determining the second target block in the at least one second block is the weight value of the adjacent at least one second block. For example, suppose that when the camera divides the preview image into 15x15 blocks, if the initial focus area is 3x3=9, the first candidate focus area is 5x5=25 by expanding the initial focus area. At this time, the first candidate focus area is 5x5=25. The ratio of the number of blocks in the candidate focus area to the number of blocks in the preview image is 25/225 = 11%. If the preset ratio is set to be equal to or less than 11%, such as 10%, it is determined that the current camera is not suitable for continuing to focus on the initial focus area. expand. For another example, in the above example, if the preview image is divided into 32x32 blocks, the ratio of the number of blocks in the first candidate focus area to the number of blocks in the preview image is 25/1024=2.4%, 2.4% is less than the above prediction If the ratio is set, the initial focus area can be continuously expanded to obtain the second candidate focus area.

In other embodiments, based on the weight value of at least one second block adjacent to the first candidate focus area, before the second target block is determined in the at least one second block, the method further includes : Determine the working mode in the process of controlling the photographing device to obtain the preview image; if the working mode is a preset mode, trigger the execution of the at least one first focus area adjacent to the first candidate focus area. The weight value of the two blocks, the step of determining the second target block in the at least one second block. Among them, the preset working mode includes a dual-lens mode. If the working mode of the shooting device is a dual-lens mode, the initial focus area can be expanded more times to obtain more candidate focus areas, and even the entire preview image can be expanded.

Step S405: Perform contrast and focus processing on the camera according to the candidate focus area.

In one embodiment, the candidate focus area includes a first candidate focus area and a second candidate focus area, and the performing contrast focus processing on the shooting device according to the candidate focus area includes: if the first candidate focus area satisfies all According to the contrast and focus condition, perform contrast and focus processing on the photographing device according to the first candidate focus area to obtain the target position of the focus motor; if the first candidate focus area does not meet the contrast and focus condition, then Performing contrast focusing processing on the photographing device according to the second candidate focus area to obtain the target position of the focusing motor.

Wherein, the first candidate focus area meeting the contrast and focus condition may mean that the multiple first focus reference values corresponding to the first candidate focus area satisfy the reference value condition indicated by the contrast and focus condition, that is, none of the multiple first focus reference values There are multiple peaks, each of the first focus reference values is greater than a preset value or there are a certain number of first focus reference values that are greater than the reference threshold, and the difference between the maximum value and the minimum value is greater than the difference threshold. Among them, the multiple first focus reference values corresponding to the first candidate focus area are obtained by calculating the reference value of the first candidate focus area of each preview image. For the specific calculation method, refer to the calculation of the initial focus reference value in the embodiment of FIG. 1 The method is not repeated here.

In an embodiment, the performing contrast focusing processing on the photographing device according to the first candidate focus area to obtain the target position of the focusing motor includes: acquiring the target from the plurality of first focus reference values Focus reference value, and obtain a target preview image corresponding to the target focus reference value from the plurality of preview images; determine the adjustment position of the focus motor when the target preview image is taken as the focus motor target location. Wherein, the target focus reference value refers to the maximum value of a plurality of first focus reference values.

In one embodiment, after the target position of the focus motor is obtained, it is determined that the focusing of the shooting device is completed, and then the shooting device is controlled to shoot when the focus motor is at the target position when the image is captured, so that a clearer image can be obtained.

In the embodiment of the present invention, the shooting device is controlled to acquire multiple preview images, and the initial focus area of each preview image is determined; in the case where it is determined that the focus object in the initial focus area is a preset type of shooting object, if the initial focus is determined If the area does not meet the contrast and focus condition, the initial focus area is expanded to obtain the first candidate focus area and the second candidate focus area, and the photographing device is further subjected to contrast focus processing according to the first candidate focus area and the second candidate focus area The steps can save the power consumption of the terminal. In addition, it is realized that when the initial focus area does not meet the contrast and focus conditions, the camera can be focused on one or more larger ranges, which can improve the focus success rate.

Based on the foregoing method embodiments, the embodiments of the present invention also provide an image processing device, which may include a photographing device, may also be included in the photographing device, or be other equipment independent of the photographing device. Referring to FIG. 7, which is a schematic structural diagram of an image processing device provided by an embodiment of the present invention, the image processing device shown in FIG. 7 may at least include a processor 701 and a memory 702, and a bus 703 can be used between the processor 701 and the memory 702. Phase connection.

In one embodiment, a program code is stored in the memory 702, and the processor 701 calls the program code. When the program code is executed, it is used to perform the following operations: control the camera to obtain the preview image; determine the initial focus area of the preview image If the initial focus area does not meet the contrast and focus conditions, then expand the initial focus area to obtain a candidate focus area, and perform contrast focus processing on the photographing device according to the candidate focus area.

In one embodiment, the candidate focus area includes a first candidate focus area, and when the processor 701 is used to obtain the candidate focus area of the preview image, perform the following operations: divide the preview image into blocks Obtain multiple blocks, and obtain the weight value of each block; based on the weight value of at least one first block adjacent to the initial focus area, determine a first target in the at least one first block Block, the weight value of the first target block is greater than the weight value of other blocks in the at least one first block; according to the first target block and the initial focus area, the first Candidate focus area, the first candidate focus area is composed of the first target block and the initial focus area.

In one embodiment, the candidate focus area further includes a second candidate focus area, and when the processor 701 is used to obtain the candidate focus area of the preview image, perform the following operations: The weight value of at least one second block adjacent to the region, a second target block is determined in the at least one second block, and the weight value of the second target block is greater than the at least one second block Weight values of other blocks in the middle; according to the second target block and the first candidate focus area, the second candidate focus area is obtained, and the second candidate focus area is composed of the second target block and The first candidate focus area composition.

In an embodiment, the processor 701 is further configured to determine whether the ratio between the number of blocks included in the first candidate focus area and the number of blocks included in the preview image is less than a preset ratio; if so, , Triggering the execution of the step of determining a second target block in the at least one second block based on the weight value of the at least one second block adjacent to the first candidate focus area.

In an embodiment, the processor 701 is further configured to: determine a working mode in the process of controlling the camera to obtain the preview image; if the working mode is a preset mode, trigger the execution of the The step of determining a second target block in the at least one second block with a weight value of at least one second block adjacent to the first candidate focus area.

In one embodiment, the preset mode includes a dual lens mode.

In an embodiment, the weight value of each block is set based on the position of the initial focus area in the preview image and the image composition rule; wherein, the plurality of blocks are located in the preview image. The weight value of the block at the edge of the image is smaller than the weight value of the block at the non-edge position of the preview image, and the weight value of each block is negatively related to the distance between the corresponding block and the center of the preview image .

In an embodiment, the weight value of each block is set based on the semantic segmentation data and the position of the initial focus area in the preview image; wherein, the weight value of the initial focus area is the same as that of the initial focus area. The weight value of a semantic block is greater than the weight value of a block having semantics different from the initial focus area, and the weight value of each block and the distance between the corresponding block and the center of the initial focus area are negative Related.

In one embodiment, the processor 701 performs the following operations when performing contrast focusing processing on the photographing device according to the candidate focus area: if the first candidate focus area satisfies the contrast focus condition, Then, perform contrast focusing processing on the photographing device according to the first candidate focus area to obtain the target position of the focus motor; if the first candidate focus area does not meet the contrast and focus conditions, then according to the second candidate focus area The candidate focus area performs contrast focus processing on the shooting device to obtain the target position of the focus motor.

In one embodiment, during the focusing process, the focus motor corresponds to a plurality of adjustment positions, and the preview image is acquired by the photographing device when the focus motor is in each adjustment position.

In one embodiment, the processor 701 is further configured to: perform reference value calculation on the initial focus area of each preview image to obtain multiple initial focus reference values corresponding to the initial focus area; If the initial focus reference value does not meet the reference value condition indicated by the focus contrast condition, it is determined that the initial focus area does not meet the contrast focus condition.

In one embodiment, the processor 701 is further configured to store a plurality of initial focus reference values corresponding to the initial focus area, a plurality of first focus reference values corresponding to the first candidate focus area, and the first focus area. A plurality of second focus reference values corresponding to two candidate focus areas, where the first focus reference value is obtained by performing reference value calculation on the first candidate focus area of each preview image, and the second focus reference The value is obtained by performing reference value calculation on the second candidate focus area of each preview image.

In one embodiment, when the processor 701 performs contrast focusing processing on the photographing device according to the first candidate focus area to obtain the target position of the focusing motor, the processor 701 performs the following operations: Acquire a target focus reference value from a focus reference value, and acquire a target preview image corresponding to the target focus reference value from the plurality of preview images; the adjustment position of the focus motor when the target preview image is taken Determined as the target position of the focus motor.

In one embodiment, the processor 701 is further configured to: detect whether the focus object corresponding to the initial focus area is a preset type of shooting object that requires multiple focus areas for focus processing; if so, trigger the execution of the acquisition The step of previewing the candidate focus area of the image; if not, perform focus processing on the photographing device based on the initial focus area.

The embodiment of the present invention controls the camera to acquire the preview image and determines the initial focus area of the preview image when the camera is focused; if the initial focus area does not meet the contrast and focus conditions, the initial focus area is expanded to obtain the candidate focus area, Further, performing contrast focusing processing on the photographing device according to the candidate focus area, realizes that when the initial focusing area does not meet the contrast focusing condition, the focusing processing is performed on the photographing device in a larger range, which can improve the focus success rate.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

The above-disclosed are only some embodiments of the present invention, which of course cannot be used to limit the scope of rights of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims

A focusing method of a photographing device, characterized in that it comprises:

Control the camera to obtain the preview image;

Determining the initial focus area of the preview image;

If the initial focus area does not meet the contrast focus condition, the initial focus area is expanded to obtain a candidate focus area, and the photographing device is subjected to contrast focus processing according to the candidate focus area.
The method according to claim 1, wherein the candidate focus area comprises a first candidate focus area, and the expanding the initial focus area to obtain the candidate focus area comprises:

Dividing the preview image into blocks to obtain multiple blocks, and obtaining a weight value of each block;

Based on the weight value of at least one first block adjacent to the initial focus area, a first target block is determined in the at least one first block, and the weight value of the first target block is greater than the weight value of the first target block. At least one weight value of other blocks in the first block;

The first candidate focus area is obtained according to the first target block and the initial focus area, and the first candidate focus area is composed of the first target block and the initial focus area.
3. The method of claim 2, wherein the candidate focus area further comprises a second candidate focus area, and said expanding the initial focus area to obtain the candidate focus area further comprises:

Based on the weight value of at least one second block adjacent to the first candidate focus area, a second target block is determined in the at least one second block, and the weight value of the second target block is greater than Weight values of other blocks in the at least one second block;

According to the second target block and the first candidate focus area, the second candidate focus area is obtained, and the second candidate focus area is composed of the second target block and the first candidate focus area .
The method according to claim 3, wherein the determining the second block in the at least one second block based on the weight value of the at least one second block adjacent to the first candidate focus area Before the target block, it also includes:

Determining whether the ratio between the number of blocks included in the first candidate focus area and the number of blocks included in the preview image is less than a preset ratio;

If yes, trigger execution of the step of determining a second target block in the at least one second block based on the weight value of the at least one second block adjacent to the first candidate focus area.
The method according to claim 3, wherein the determining the second block in the at least one second block based on the weight value of the at least one second block adjacent to the first candidate focus area Before the target block, it also includes:

Determining the working mode in the process of controlling the photographing device to acquire the preview image;

If the working mode is the preset mode, triggering the execution of the determination based on the weight value of at least one second block adjacent to the first candidate focus area in the at least one second block The steps of the target block.
The method of claim 5, wherein the preset mode includes a dual-lens mode.
3. The method of claim 2, wherein the weight value of each block is set based on the position of the initial focus area in the preview image and image composition rules;

Wherein, the weight value of the block located at the edge position of the preview image among the plurality of blocks is smaller than the weight value of the block located at the non-edge position of the preview image, and the weight value of each block and the corresponding The distance between the block and the center of the preview image is negatively correlated.
3. The method of claim 2, wherein the weight value of each block is set based on the semantic segmentation data of the preview image and the position of the initial focus area in the preview image;

Wherein, the weight value of the block having the same semantics as the initial focus area is greater than the weight value of the block having different semantics from the initial focus area, and the weight value of each block and the corresponding block are the same as those of the initial focus area. The distance of the center of the initial focus area is negatively correlated.
The method of claim 3, wherein the performing contrast focusing processing on the photographing device according to the candidate focus area comprises:

If the first candidate focus area satisfies the contrast focus condition, performing contrast focus processing on the photographing device according to the first candidate focus area to obtain the target position of the focus motor;

If the first candidate focus area does not satisfy the contrast and focus condition, then perform contrast focus processing on the photographing device according to the second candidate focus area to obtain the target position of the focus motor.
The method of claim 9, wherein during the focusing process, the focus motor corresponds to a plurality of adjustment positions, and the preview image is obtained by the photographing device when the focus motor is at each adjustment position Arrived.
The method of claim 10, wherein the method further comprises:

Performing reference value calculation on the initial focus area of each preview image to obtain multiple initial focus reference values corresponding to the initial focus area;

If the multiple initial focus reference values do not meet the reference value condition indicated by the focus contrast condition, it is determined that the initial focus area does not meet the contrast focus condition.
The method according to claim 11, wherein before the determining that the initial focus area does not satisfy the contrast and focus condition, the method further comprises:

Store multiple initial focus reference values corresponding to the initial focus area, multiple first focus reference values corresponding to the first candidate focus area, and multiple second focus reference values corresponding to the second candidate focus area, so The first focus reference value is obtained by reference value calculation of the first candidate focus area of each preview image, and the second focus reference value is the second candidate focus area of each preview image The focus area is calculated by reference value.
The method of claim 12, wherein the performing contrast focusing processing on the photographing device according to the first candidate focus area to obtain the target position of the focusing motor comprises:

Acquiring a target focus reference value from the plurality of first focus reference values, and acquiring a target preview image corresponding to the target focus reference value from the plurality of preview images;

The adjustment position of the focus motor when the target preview image is taken is determined as the target position of the focus motor.
8. The method according to claim 1, wherein after the determining the initial focus area of the preview image, the method further comprises:

Detecting whether the focus object corresponding to the initial focus area is a preset type of shooting object that requires multiple focus areas to perform focus processing;

If yes, trigger execution of the step of expanding the initial focus area to obtain a candidate focus area if the initial focus area does not meet the contrast focus condition, and perform contrast focus processing on the photographing device according to the candidate focus area;

If not, performing focusing processing on the photographing device based on the initial focusing area.
An image processing device, which is characterized in that it comprises a memory and a processor:

The memory is used to store program code;

The processor is configured to call the program code, and when the program code is executed, it is configured to perform the following operations:

Control the camera to obtain the preview image;

Determining the initial focus area of the preview image;

If the initial focus area does not meet the contrast focus condition, the initial focus area is expanded to obtain a candidate focus area, and the photographing device is subjected to contrast focus processing according to the candidate focus area.
15. The image processing device according to claim 15, wherein the candidate focus area comprises a first candidate focus area, and the processor performs the following operations when used to obtain the candidate focus area of the preview image:

Dividing the preview image into blocks to obtain multiple blocks, and obtaining a weight value of each block;

Based on the weight value of at least one first block adjacent to the initial focus area, a first target block is determined in the at least one first block, and the weight value of the first target block is greater than the weight value of the first target block. At least one weight value of other blocks in the first block;

The first candidate focus area is obtained according to the first target block and the initial focus area, and the first candidate focus area is composed of the first target block and the initial focus area.
15. The image processing device of claim 16, wherein the candidate focus area further comprises a second candidate focus area, and the processor performs the following operations when used to obtain the candidate focus area of the preview image:

Based on the weight value of at least one second block adjacent to the first candidate focus area, a second target block is determined in the at least one second block, and the weight value of the second target block is greater than Weight values of other blocks in the at least one second block;

According to the second target block and the first candidate focus area, the second candidate focus area is obtained, and the second candidate focus area is composed of the second target block and the first candidate focus area .
18. The image processing device of claim 17, wherein the processor is further configured to:

Determine whether the ratio between the number of blocks included in the first candidate focus area and the number of blocks included in the preview image is less than a preset ratio; The step of determining the second target block in the at least one second block for the weight value of at least one adjacent second block.
18. The image processing device of claim 17, wherein the processor is further configured to:

Determining the working mode in the process of controlling the photographing device to acquire the preview image;

If the working mode is the preset mode, triggering the execution of the determination based on the weight value of at least one second block adjacent to the first candidate focus area in the at least one second block The steps of the target block.
19. The image processing device of claim 19, wherein the preset mode comprises a dual-lens mode.
The image processing device according to claim 16, wherein the weight value of each block is set based on the position of the initial focus area in the preview image and the image composition rule; wherein, the The weight value of the block located at the edge position of the preview image among the plurality of blocks is smaller than the weight value of the block located at the non-edge position of the preview image, the weight value of each block and the corresponding block and all The distance between the center of the preview image is negatively correlated.
16. The image processing device of claim 16, wherein the weight value of each block is set based on the semantic segmentation data and the position of the initial focus area in the preview image;

Wherein, the weight value of the block having the same semantics as the initial focus area is greater than the weight value of the block having different semantics from the initial focus area, and the weight value of each block and the corresponding block There is a negative correlation with the distance from the center of the initial focus area.
18. The image processing device according to claim 17, wherein the processor performs the following operations when performing contrast focusing processing on the photographing device according to the candidate focus area:

If the first candidate focus area satisfies the contrast focus condition, performing contrast focus processing on the photographing device according to the first candidate focus area to obtain the target position of the focus motor;

If the first candidate focus area does not satisfy the contrast and focus condition, then perform contrast focus processing on the photographing device according to the second candidate focus area to obtain the target position of the focus motor.
The image processing device according to claim 23, wherein, during the focusing process, the focus motor corresponds to a plurality of adjustment positions, and the preview image shows that the photographing device is at each adjustment position of the focus motor. Obtained at the time.
The image processing device according to claim 24, wherein the processor is further configured to:

Performing reference value calculation on the initial focus area of each preview image to obtain multiple initial focus reference values corresponding to the initial focus area;

If the multiple initial focus reference values do not meet the reference value condition indicated by the focus contrast condition, it is determined that the initial focus area does not meet the contrast focus condition.
The image processing device according to claim 25, wherein the processor is further configured to:

Store multiple initial focus reference values corresponding to the initial focus area, multiple first focus reference values corresponding to the first candidate focus area, and multiple second focus reference values corresponding to the second candidate focus area, so The first focus reference value is obtained by reference value calculation of the first candidate focus area of each preview image, and the second focus reference value is the second candidate focus area of each preview image The focus area is calculated by reference value.
The image processing device according to claim 26, wherein the processor performs the following when performing contrast focusing processing on the photographing device according to the first candidate focus area to obtain the target position of the focusing motor operating:

Acquiring a target focus reference value from the plurality of first focus reference values, and acquiring a target preview image corresponding to the target focus reference value from the plurality of preview images;

The adjustment position of the focus motor when the target preview image is taken is determined as the target position of the focus motor.
15. The image processing device according to claim 15, wherein the processor is further configured to:

Detecting whether the focus object corresponding to the initial focus area is a preset type of shooting object that requires multiple focus areas for focusing processing;

If yes, trigger execution of the step of expanding the initial focus area to obtain a candidate focus area if the initial focus area does not meet the contrast focus condition, and perform contrast focus processing on the photographing device according to the candidate focus area;

If not, performing focusing processing on the photographing device based on the initial focusing area.
A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program includes program instructions that, when executed by a processor, cause the processor to execute The focusing method of the photographing device described in claim 1-14.