JP6604760B2 - Image processing apparatus, control method therefor, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, a control method therefor, and a program, and more particularly, to an image processing apparatus that performs manual focus, a control method therefor, and a program.

  2. Description of the Related Art When performing manual focus, a camera is known as an image processing apparatus having a peaking function for performing specific display only on a focused area (hereinafter referred to as “focused area”) in a captured image. In the camera, an image taken on an LCD monitor provided in the camera is displayed, and when the peaking function is used, the outline of the subject included in the in-focus area in the image displayed on the LCD monitor is a specific color, for example, , Displayed in red. Thereby, the user can easily specify the focus area in the displayed image. When the peaking function is used, auxiliary information for assisting manual focus operation is also displayed on the LCD monitor. For example, when the focus lens is moved in a predetermined direction from the position of the focus lens at the time of shooting, a region where the sharpness increases because the focus approaches the subject and a region where the sharpness decreases because the focus moves away from the subject are mutually connected. Displayed in different specific colors. Thus, the user can easily determine an appropriate moving direction of the focus lens when focusing on a desired area different from the in-focus area. The auxiliary information is displayed based on the difference between the image captured by the focus lens at a predetermined position and the image captured by moving the focus lens from the predetermined position (see, for example, Patent Document 1).

JP 2009-165031 A

  However, in the technique of Patent Document 1, it is necessary to move the focus lens in order to display auxiliary information, and a certain time is required until the auxiliary information is displayed.

  An object of the present invention is to provide an image processing apparatus capable of displaying auxiliary information for assisting a manual focus operation without requiring a certain time, a control method therefor, and a program.

In order to achieve the above object, the image processing apparatus of the present invention, the specific image processing means for extracting an outline portion of the object from the captured image, a focus area that is focused in the captured image a first specifying means, a second specifying means for specifying a non-focus area which is not focused in the captured image, calculating means for calculating the distance information of the focusing area, the out-of-focus region comprising a determination unit configured to determine a defocus amount of the non-focused region based on a result of an imaging plane phase difference detection, and a display control means for controlling the display of the captured image, the calculation unit, the The distance information of the out-of-focus area is calculated based on the distance information of the in-focus area and the defocus amount, and the display control means is a contour portion extracted by the image processing means, and is the non-focus area. distance before Kigoase area Te smell Said contour portion contained in the first out-of-focus region with a larger distance information from information controls to display in the first specific display, a contour extracted by the image processing unit unfocused and controls to display the outline portion included in the second out-of-focus region with a smaller distance information from the distance information of the focused region in the first specific display different from the second specific display in the region, the Controlling the contour portion extracted by the image processing means to be displayed in a third specific display different from the first specific display and the second specific display. It is characterized by.

  According to the present invention, it is possible to display auxiliary information that assists the manual focus operation without requiring a certain time.

1 is a block diagram schematically showing a configuration of a camera as an image processing apparatus according to an embodiment of the present invention. It is a flowchart which shows the procedure of the specific display process performed with the camera in FIG. FIG. 3 is a diagram for explaining an image displayed on the display unit in FIG. 1, FIG. 3A shows a positional relationship between the camera and each subject, and FIG. 3B is an example of an image displayed on the display unit. Indicates. It is a figure for demonstrating the main outline part and subcontour part set by the specific display process of FIG. 5A and 5B are diagrams for explaining an image displayed on the display unit in FIG. 1, FIG. 5A shows an example of an image displayed on the display unit, and FIG. 5B is a positional relationship between the camera and each subject. Indicates. FIGS. 6A and 6B are diagrams for explaining a phase difference detectable region in the camera of FIG. 1, FIG. 6A shows an example of a line-like phase difference detectable region, and FIG. 5B is a rectangular phase difference detection; An example of a possible area is shown. It is a flowchart which shows the procedure of the modification of the specific display process of FIG. It is a flowchart which shows the procedure of the modification of the specific display process of FIG. FIGS. 8A and 8B are diagrams for explaining an image based on image information data generated by the imaging signal processing unit of FIG. 1. FIG. 8A shows the positional relationship between the camera and each subject, and FIG. An example of the image based on data is shown. FIG. 8 is a conceptual diagram of a sub-contour part set in the specific display process of FIGS. 7A and 7B.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram schematically showing a configuration of a camera 100 as an image processing apparatus according to an embodiment of the present invention.

  In FIG. 1, a camera 100 includes an imaging optical system 101, an imaging optical system operation unit 102, an imaging unit 103, an imaging signal processing unit 104, a display unit 105 (display unit), an operation unit 106, a CPU 107, a ROM 108, a RAM 109, and a memory. A slot 110 is provided. The imaging optical system operation unit 102, the imaging signal processing unit 104, the display unit 105, the operation unit 106, the CPU 107, the ROM 108, the RAM 109, and the memory slot 110 are connected to each other via a system bus 112. The imaging optical system 101 is connected to the imaging optical system operation unit 102 and the imaging unit 103, and the imaging unit 103 is connected to the imaging signal processing unit 104.

  The camera 100 has a peaking function that is used when the user adjusts the focus on the subject with manual focus, and displays various auxiliary information for assisting the manual focus operation on the display unit 105 using the peaking function. The imaging optical system 101 is a lens group including a zoom lens, a focus lens, and the like (not shown). In the present embodiment, the focus lens is adjusted by moving the position of the focus lens. The imaging optical system operation unit 102 receives a control signal instructing operation of various lenses from the CPU 107, and controls the positions of various lens groups provided in the imaging optical system 101 based on the received control signals.

  The imaging unit 103 includes a pixel region that performs photoelectric conversion processing on received light, and a plurality of pixels are arranged in the pixel region, and a light beam that has passed through the imaging optical system 101 by each pixel is photoelectrically converted into an electrical analog image signal. To do. In addition to image forming pixels that photoelectrically convert analog image signals for forming images, the imaging unit 103 includes phase difference detection pixels that photoelectrically convert analog image signals for performing image plane phase difference detection. ing. Based on the phase difference between the analog image signal photoelectrically converted by the image forming pixel and the analog image signal photoelectrically converted by the detection pixel, a defocus amount for each subject is detected. The phase difference detection pixels are arranged in the whole pixel region or a part of the pixel region. In this embodiment, as an example, a case where the phase difference detection pixels are arranged in the whole pixel region will be described. The imaging unit 103 converts the photoelectrically converted analog image signal into a digital image signal, and outputs the converted digital image signal to the imaging signal processing unit 104.

  The imaging signal processing unit 104 converts the digital image signal output from the imaging unit 103 to generate image information data. Further, the imaging signal processing unit 104 calculates a defocus amount for correcting a focus shift with respect to each subject based on the detected focus shift amount with respect to each subject. The calculated defocus amount is stored in the RAM 109. The display unit 105 displays various images and various setting menus. In the present embodiment, the display unit 105 displays various images based on the image information data generated by the imaging signal processing unit 104. Further, the display unit 105 displays, for example, a specific display indicated by a broken line in FIG. 5A described later as auxiliary information for assisting the manual focus operation by the peaking function.

  FIG. 2 is a flowchart showing the procedure of the specific display process executed by the camera 100 in FIG.

  The processing in FIG. 2 is performed by the CPU 107 executing various programs stored in the ROM 108. Further, it is assumed that the processing in FIG. 2 is executed at regular intervals, and each specific display in FIG. 5A to be described later is updated based on the execution result.

  Here, when the user uses the camera 100 to photograph the subjects 301 to 303 in the direction along the optical axis 300 as shown in FIG. 3A, the peaking function is set and the manual focus operation is performed. When the subject 301 is focused by the manual focus operation, the image 304 in FIG. 3B is displayed on the display unit 105. In the image 304, a specific display indicating that the subject 301 is in focus is displayed on the subject 301 as indicated by a broken line in FIG. After that, when the user performs a manual focus operation so that the subject 301 is focused on the subject 302, auxiliary information that can specify whether the subject 302 exists in front of or behind the subject 301 is displayed. Then, the user can easily adjust the focus on the subject 302 using the auxiliary information. As such auxiliary information, in a conventional camera, for example, information based on a difference between an image captured by a focus lens at a predetermined position and an image captured by moving the focus lens from the predetermined position is displayed. . In this case, there is a problem that it is necessary to move the focus lens, and it takes a certain time until the auxiliary information is displayed.

  Correspondingly, in the present embodiment, distance information of a focused main contour portion described later and a defocus amount of each sub-contour portion described later that is not focused are calculated. Based on the distance information of the main contour portion and the defocus amount of each sub contour portion, distance information of each sub contour portion described later is calculated. Further, in each sub-contour part, the first sub-contour part having distance information larger than the distance information of the main contour part identifies the first sub-contour part (hereinafter referred to as “first sub-contour specific display”). "). Further, the second sub-contour portion having distance information smaller than the distance information of the main contour portion is different from the first sub-contour specification display, and a specific display for specifying the second sub-contour portion (hereinafter referred to as “second "Sub-contour specific display").

  In FIG. 2, first, the CPU 107 analyzes a frequency component included in the image information data generated by the imaging signal processing unit 104, and extracts a contour portion that occupies a part of the contour of each subject in the image based on the image information data. (Step S201). In the present embodiment, the CPU 107 extracts a high frequency component equal to or higher than a predetermined frequency from the frequency components included in the image information data as a contour portion. The contour is displayed more clearly as the frequency increases. Hereinafter, the sharpness of the contour part will be described as the degree of contour. Further, the CPU 107 sets a contour direction corresponding to the contour of each subject in each extracted contour portion. Next, the CPU 107 classifies the extracted contour portion based on the contour degree (step S202). In step S202, classification is performed based on a preset first threshold value and second threshold value. The first threshold value corresponds to the contour degree of the focused contour portion (in-focus area), and the second threshold value corresponds to the sharpness contour degree that is not focused but can be recognized as a contour by the user.

  In step S202, the CPU 107 identifies a contour portion having a contour degree equal to or greater than the first threshold as a focused contour portion (step S203) (first identifying means). Thereafter, the CPU 107 sets the contour portion as a main contour portion indicating that it is a focused contour portion, and determines whether or not the classification processing of all the extracted contour portions has been completed (step S205).

  In step S202, the CPU 107 sets a contour portion (out-of-focus region) where the contour degree is equal to or greater than the second threshold and less than the first threshold (step S204) (second focus). Specific means). Thereafter, the CPU 107 sets the contour portion as a sub-contour portion indicating that the contour portion is not focused but is a clear contour portion that the user can recognize as the contour, and the process proceeds to step S205.

  Furthermore, in step S202, the CPU 107 specifies a contour portion having a contour degree less than the second threshold as a contour portion that is not focused (second specifying means), but any of the main contour portion and the sub-contour portion. Also, the process proceeds to step S205 without setting. That is, in the present embodiment, only the contour portion having the contour degree equal to or higher than the second threshold value is extracted from the contour portions extracted from the image information data, and the extracted contour portion is as shown in FIG. In addition, it is set to either the main contour portion or the sub contour portion using the first threshold value.

  As a result of the determination in step S205, when the classification process for any of the extracted contour portions is not completed, the CPU 107 returns to the process in step S202. On the other hand, as a result of the determination in step S205, when the classification processing of all the extracted contour portions is completed, the CPU 107 displays the main contour portion in the main contour specifying display (step S206). Specifically, the CPU 107 displays the main contour portion in, for example, red as the main contour specifying display (for example, display of the subject 501 indicated by a broken line in FIG. 5A).

  Next, the CPU 107 calculates the distance information of the main contour portion based on the position of the focus lens included in the imaging optical system 101, for example, the distance 502 from the camera 100 in FIG. 5B to the subject 501 corresponding to the main contour portion. Calculate (step S207) (calculation means). Next, the CPU 107 determines the set defocus amount of each sub-contour part (step S208) (determination means). Next, the CPU 107 calculates distance information of each sub-contour portion based on the calculated distance information of the main contour portion and the defocus amount of each sub-contour portion (step S209) (calculation means). The distance information of each sub-contour part is, for example, distances 505 and 506 from the camera 100 in FIG. 5B to the subjects 503 and 504 corresponding to the sub-contour part. That is, in the present embodiment, the CPU 107 can calculate the distance information of each sub-contour part without moving the focus lens or the like included in the imaging optical system 101. In the present embodiment, the case where the processes of steps S207 to S209 are performed after the process of step S206 has been described. However, steps S207 to S209 may be performed before the process of step S210 described later is performed. For example, the processing in steps S207 to S209 may be performed when the contour portion of each subject is extracted in step S201. Alternatively, the processes of steps S207 to S209 may be performed in advance, and the respective calculation results may be stored in the ROM 108, and the stored calculation results may be used in the process of step S210 described later.

  Next, the CPU 107 determines whether or not the distance information of each sub-contour portion is larger than the distance information of the main contour portion for all sub-contour portions (step S210).

  As a result of the determination in step S210, when the distance information of the sub contour portion is larger than the distance information of the main contour portion, the CPU 107 sets the sub contour portion having the distance information larger than the distance information of the main contour portion as the first sub contour portion. Set. For example, in FIG. 5B, a contour portion indicating the subject 504 having a distance 506 larger than the distance 502 of the subject 501 is set as the first sub-contour portion. Thereafter, the CPU 107 displays the first sub-contour part in the first sub-contour specifying display (step S211). Specifically, the CPU 107 displays the first sub-contour portion in, for example, blue (for example, display of the subject 504 indicated by a two-dot chain line in FIG. 5A). Next, the CPU 107 proceeds to the process of step S213.

  When the distance information of the sub contour portion is smaller than the distance information of the main contour portion as a result of the determination in step S210, the CPU 107 sets the sub contour portion having distance information smaller than the distance information of the main contour portion as the second sub contour portion. Set. For example, in FIG. 5B, a subject 503 having a distance 505 smaller than the distance 502 of the subject 501 is set as the second sub-contour part. Thereafter, the CPU 107 displays the second sub-contour part in the second sub-contour specifying display (step S212). Specifically, the CPU 107 displays the second sub-contour portion in, for example, yellow (for example, display of the subject 503 indicated by a one-dot chain line in FIG. 5A). That is, in the present embodiment, the main contour specifying display, the first sub-contour specifying display, and the second sub-contour specifying display are displayed in different specific colors. Next, the CPU 107 determines whether or not the determination process for all the sub-contour portions has been completed (step S213).

  As a result of the determination in step S213, when the determination process for any sub-contour part is not completed, the CPU 107 returns to the process in step S210. On the other hand, when the determination processing for all the sub-contour portions is completed as a result of the determination in step S213, the CPU 107 ends this processing.

  According to the process of FIG. 2 described above, the distance information of each sub-contour part is calculated based on the distance information of the main contour part and the defocus amount of each sub-contour part. Therefore, it is possible to acquire distance information of each sub-contour part without moving the focus lens included in the imaging optical system 101 or the like. As a result, it can be determined without taking a certain time whether the sub-contour portion indicating the subject 503 corresponds to the first sub-contour portion or the second sub-contour portion.

  In addition, according to the processing of FIG. 2, the first sub-contour part is displayed with the first sub-contour specifying display, and the second sub-contour part is displayed with the second sub-contour specifying display. Here, the user determines whether the sub-contour part indicating the subject 503 is displayed in either the first sub-contour specification display or the second sub-contour specification display, thereby determining the distance of the sub-contour part. Whether the information is smaller or larger than the distance information of the main contour portion can be determined. That is, the first sub-contour specifying display and the second sub-contour specifying display are nothing but auxiliary information for assisting the manual focus operation.

  According to the processing in FIG. 2, it can be determined without taking a certain time whether the sub-contour portion indicating the subject 503 corresponds to the first sub-contour portion or the second sub-contour portion. Therefore, the camera 100 can perform the first sub-contour specifying display and the second sub-contour specifying display corresponding to the auxiliary information without requiring a certain time.

  In the process of FIG. 2 described above, the main contour portion is displayed in a main contour specifying display having a different color from the first sub contour specifying display and the second sub contour specifying display. As a result, the contour of the subject focused by the user can be easily specified, and thus the user can easily determine whether or not the subject desired by the user is focused.

  Although the present invention has been described above by using the embodiment, the present invention is not limited to the above-described embodiment.

  For example, the main contour specifying display, the first sub-contour specifying display, and the second sub-contour specifying display are different types of specific types of lines including broken lines, one-dot chain lines, two-dot chain lines, and different specific intervals. It may be blinking. Also in this case, the user can reliably specify the main contour portion, the first sub-contour portion, and the second sub-contour portion, so that the user can specify the main contour portion, the first sub-contour portion, and the first sub-contour portion, and It is possible to prevent mistaking each of the two sub-contour portions.

  In the present embodiment, the present invention is not limited to the case where the phase difference detection pixels are arranged in the entire pixel region of the imaging unit 103, and the case where the phase difference detection pixels are arranged in a part of the pixel region. There may be. In this case, in the image based on the generated image information data, the distance information of the sub-contour part is calculated only in the phase difference detectable region that can be detected by the arranged phase difference detection pixels. The phase difference detectable region is, for example, each hatched line-shaped partial region including the partial region 601 in FIG. 6A and each hatched rectangular partial region including the partial region 602 in FIG. is there. That is, there is a possibility that the distance information of the sub-contour portions other than the partial areas indicated by the oblique lines in FIGS. 6A and 6B is lost, and as a result, the auxiliary information cannot be displayed.

  Correspondingly, in this embodiment, when there is no distance information of the sub-contour part, the distance information of the sub-contour part with distance information in the image based on the image information data is close to the sub-contour part with distance information, This is used as distance information of the sub-contour part without distance information. The sub-contour part without distance information and the sub-contour part with distance information will be described later.

  7A and 7B are flowcharts showing the procedure of a modification of the specific display process of FIG.

  The processing in FIGS. 7A and 7B is performed by the CPU 107 executing various programs stored in the ROM 108. 7A and 7B are executed at regular intervals, and it is assumed that each specific display in FIG. 8A described later is updated based on the execution result.

  7A and 7B, first, the CPU 107 executes processing similar to steps S201 to S209 in FIG. Next, the CPU 107 determines whether there is distance information of all the set sub-contour portions (step S701).

  As a result of the determination in step S701, when there is distance information of all the set sub-contour portions, the CPU 107 performs the same processing as that in steps S210 to S213 in FIG. 2 and ends this processing. On the other hand, as a result of the determination in step S701, when there is no distance information of any set sub-contour part, the CPU 107 performs a determination process. Specifically, the CPU 107 determines whether or not there is a sub-contour part having distance information in the vicinity of the sub-contour part having no distance information in the image based on the image information data (step S702). Hereinafter, the sub-contour part having distance information will be described as a sub-contour part with distance information, and the sub-contour part without distance information will be described as a sub-contour part without distance information.

  As a result of the determination in step S702, when one sub-contour part with distance information exists in the vicinity of the sub-contour part without distance information, the CPU 107 displays the distance information of the sub-contour part with distance information nearby without the distance information. Is used as distance information (step S703). Next, the CPU 107 proceeds to the process of step S210 in FIG.

  As a result of the determination in step S702, when there are a plurality of sub-contour parts with distance information in the vicinity of the sub-contour part without distance information, the CPU 107 determines whether all the distance information of the plurality of sub-contour parts with distance information matches. It is determined whether or not (step S704). For example, as shown in FIG. 8A, in the image 800 in FIG. 8B including the subjects 801 and 802 having different distance information from the camera 100, the region 803 includes only the outline of the subject 801. All the distance information of the sub-contour part with a plurality of distance information matches. On the other hand, the area 804 includes the contour portion of the subject 801 and the contour portion of the subject 802 having distance information different from that of the subject 801, so that the distance information of any of the plurality of sub-contour portions with distance information does not match.

  As a result of the determination in step S704, when all the distance information of the plurality of sub-contour parts with distance information match, the CPU 107 proceeds to the process of step S703. On the other hand, as a result of the determination in step S704, when any one of the distance information of the plurality of distance information sub-contour portions does not match, the CPU 107 performs a selection process. Specifically, the CPU 107 selects distance information of the sub-contour part with distance information in the contour direction closest to the contour direction of the sub-contour part without distance information among the plurality of distance information of the sub-contour part with distance information. For example, in the sub-contour portion 901 without distance information and the sub-contour portions 902, 903, and 904 with distance information in which the contour directions indicated by the arrows in FIG. 9 are set, the CPU 107 displays the sub-contour portions 902, 903, and 904 with distance information. The distance information of the sub-contour part 902 with distance information closest to the contour direction of the sub-contour part 901 without distance information is selected as the distance information of the sub-contour part 901 without distance information. In the present embodiment, the distance information with the largest number of matching distance information may be selected from among the distance information of the plurality of sub-contour parts with distance information. Thereafter, the CPU 107 uses the selected distance information as the sub-contour distance information of the sub-contour part without distance information (step S705). Next, the CPU 107 proceeds to the process of step S210.

  As a result of the determination in step S702, when there is no sub-contour part with distance information in the vicinity of the sub-contour part without distance information, the CPU 107 cancels the setting of the sub-contour part for the sub-contour part without distance information, and step S213. Proceed to the process.

  In the processing of FIGS. 7A and 7B described above, when there is no distance information of the sub-contour part, the distance information of the sub-contour part with distance information close to the sub-contour part without distance information in the image based on the generated image information data Is used as the distance information of the sub-contour part without distance information. Thereby, even if the distance information of some sub-contour parts in the image is not calculated, the distance information of all the sub-contour parts constituting the image can be acquired. As a result, for example, auxiliary information can be reliably displayed even if distance information of some sub-contour portions does not exist.

  7A and 7B described above, when the contour direction is set for all the sub-contour parts and the distance information of the sub-contour parts with a plurality of distance information is different from each other, the sub-contour parts with a plurality of distance information are provided. The distance information of the sub-contour part with distance information in which the contour direction closest to the contour direction set in the sub-contour part without distance information is set is used as the distance information of the sub-contour part without distance information. As a result, the image includes a contour similar to the contour of the sub-contour portion without distance information even if the plurality of sub-contour portions with distance information adjacent to the sub-contour portion without distance information have different distance information. Since the distance information of the sub-contour part with the distance information is selected, it is possible to prevent the distance information of the sub-contour part with the distance information having a different tendency from being used as the distance information of the sub-contour part without the distance information, It is possible to improve the reliability of the distance information of the sub-contour part without distance information.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read the program. It can also be realized by processing executed in the above. The present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100 Camera 104 Imaging signal processing unit 105 Display unit 107 CPU

Claims (8)

Image processing means for extracting an outline portion of the object from the captured image,
A first specifying means for specifying the focused focus regions in the captured image,
Second specifying means for specifying a non-focus area which is not focused in the captured image,
Calculating means for calculating distance information of the in-focus area;
Determining means for determining a defocus amount of the out-of-focus region based on the out-of-focus of an imaging plane phase difference detection area result,
And display control means for controlling the display of the captured image,
The calculating means calculates distance information of the out-of-focus area based on the distance information of the in-focus area and the defocus amount;
Wherein the display control unit, included in the first out-of-focus region with a larger distance information from the distance information before Kigoase region Te wherein a contour extracted unfocused region odor by the image processing unit A second contour control is performed to display the contour portion in the first specific display, and the contour portion is extracted by the image processing means and has distance information smaller than the distance information of the in-focus region in the out-of-focus region. The contour portion included in the non-focused area is controlled to be displayed in a second specific display different from the first specific display, and is the contour extracted by the image processing means, An image processing apparatus that controls to display a contour portion included in a third specific display different from the first specific display and the second specific display . The first specific display, the second specific display, and the third specific display, the image processing apparatus according to claim 1, characterized in that a display with a different specific color to each other. The first specific display, the second specific display, and the third specific display, the image processing apparatus according to claim 1 or 2, wherein it is a display of different specific types of lines to each other. The said 1st specific display, the said 2nd specific display, and the said 3rd specific display are the displays by blinking of a specific space | interval different from each other, The Claim 1 thru | or 3 characterized by the above-mentioned. The image processing apparatus described. If the distance information of the partial region occupied a portion of the captured image does not exist, the distance information of another partial region adjacent to the partial region in the captured image as the distance information of the partial region the image processing apparatus according to any one of claims 1 to 4, characterized in that use. In the partial region, a contour direction is set based on a contour portion included in the partial region and extracted by the image processing unit ,
A plurality of the other partial areas exist, and a contour direction is set in each of the plurality of other partial areas based on a contour part included in the partial area and extracted by the image processing unit. And
When the distance information of the plurality of other partial areas is different from each other, the contour direction closest to the contour direction set to the partial area is set among the distance information of the plurality of other partial areas. 6. The image processing apparatus according to claim 5 , wherein the distance information of the partial area is used as the distance information of the partial area. An image processing step of extracting the contour of the object from the captured image,
A first specifying step of specifying a focused focal regions in the captured image,
A second specifying step of specifying a non-focus area which is not focused in the captured image,
A calculation step of calculating distance information of the in-focus area;
A determination step of determining a defocus amount of the out-of-focus region based on the out-of-focus of an imaging plane phase difference detection area result,
And a display control step of displaying the captured image,
The calculating step calculates distance information of the out-of-focus area based on the distance information of the in-focus area and the defocus amount;
The display control step is included in the first out-of-focus region with a larger distance information from the distance information before Kigoase area the image processing a contour extracted in step Te said out-of-focus regions smell A second contour control is performed to display the contour portion in the first specific display, and the contour portion is extracted in the image processing step and has distance information smaller than the distance information of the in-focus region in the out-of-focus region. The contour portion included in the out-of-focus region is controlled to be displayed in a second specific display different from the first specific display, and is the contour portion extracted in the image processing step. A control method for an image processing apparatus, comprising: controlling a contour portion included in a third specific display different from the first specific display and the second specific display . A program for executing a control method for images processing device to the computer,
The control method of the image processing apparatus is:
An image processing step of extracting a contour portion of each subject from the captured image;
A first specifying step of specifying a focused focal regions in the captured image,
A second specifying step of specifying a non-focus area which is not focused in the captured image,
A calculation step of calculating distance information of the in-focus area;
A determination step of determining a defocus amount of the out-of-focus region based on the out-of-focus of an imaging plane phase difference detection area result,
And a display control step of displaying the captured image,
The calculating step calculates distance information of the out-of-focus area based on the distance information of the in-focus area and the defocus amount;
The display control step is included in the first out-of-focus region with a larger distance information from the distance information before Kigoase area the image processing a contour extracted in step Te said out-of-focus regions smell A second contour control is performed to display the contour portion in the first specific display, and the contour portion is extracted in the image processing step and has distance information smaller than the distance information of the in-focus region in the out-of-focus region. The contour portion included in the out-of-focus region is controlled to be displayed in a second specific display different from the first specific display, and is the contour portion extracted in the image processing step. The program which controls to display the outline part contained in the 3rd specific display different from the 1st specific display and the 2nd specific display .