JP2016208396A - Image processing system, control method of the same, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system capable of securely taking a moving image whose focus is varying.SOLUTION: A camera 100 sets a position of a focus lens 104, which does not focus at a main subject area 301, at an imaging start position and sets a main subject focus position at a moving destination position of the focus lens 104. The imaging start position is set on the basis of distant information of each subject.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing apparatus, a control method thereof, and a program, and more particularly, to an image processing apparatus capable of capturing a moving image, a control method thereof, and a program.

  There is known a digital camera as an image processing apparatus capable of shooting a moving image of a short shooting time set by a user, for example, several seconds. Special effects such as fast-forward and rewind may be added to the captured moving image in order to emphasize the movement of the subject. As a technique for adding a special effect, for example, when a digital camera shoots a moving image including a plurality of subjects, an area indicating a main subject (hereinafter referred to as a “main subject area”) and the main subject area. There are known techniques for setting areas indicating sub-subjects having a large difference in depth (hereinafter referred to as “sub-subject areas”). In this technique, the sub-subject area is first focused and shooting is started, the focus is gradually shifted from the sub-subject area to the main subject area, and finally the focus is adjusted to the main subject area (for example, Patent Document 1). reference). This changes the focus so that the display of the sub-subject area changes from a clear display that is in focus to an unclear display that is out of focus, and the display of the main object area changes from an unclear display to a clear display. It is possible to acquire a moving image.

JP 2010-286752 A

  However, when the technique of Patent Document 1 is used to shoot a moving image in which only a sub-subject area having a small depth difference with respect to the main subject area is present, the main subject area is also moved when the sub-subject area is first focused. Almost in focus. Therefore, even if the focus is gradually shifted from the sub subject area to the main subject area, the display of the sub subject area and the display of the main subject area remain almost clear, and it is not possible to shoot a moving image in which the focus changes. .

  An object of the present invention is to provide an image processing apparatus, a control method therefor, and a program that can reliably capture a moving image that changes focus.

  In order to achieve the above object, an image processing apparatus of the present invention is an image processing apparatus that performs moving image shooting of a plurality of subjects including a main subject by moving the position of a focus lens to focus the plurality of subjects. Distance information acquisition means for acquiring distance information, lens position setting means for setting each of a focus start position of the focus lens and a movement destination position of the focus lens that moves the focus lens during the moving image shooting; Moving image shooting means for moving image shooting while moving the focus lens from the shooting start position to the movement destination position, and the lens position setting means sets the position of the focus lens focused on the main subject to the movement destination And the main subject based on the distance information of the main subject and the distance information of the other subject. The position of the focus lens where the focus is not fit and sets the imaging start position.

  According to the present invention, it is possible to reliably shoot a moving image whose focus changes.

1 is a block diagram schematically showing a configuration of a camera as an image forming apparatus according to an embodiment of the present invention. It is a flowchart which shows the procedure of the special effect moving image shooting process performed with the camera of FIG. It is a figure which shows an example of the image data image | photographed with the camera of FIG. It is a flowchart which shows the procedure of the classification | category process of step S206 in FIG. It is a flowchart which shows the procedure of a focus change moving image | photographing process of step S209 in FIG. It is a flowchart which shows the procedure of the modification of the special effect moving image shooting process of FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  In this embodiment, the case where the present invention is applied to a camera as an image processing apparatus will be described. However, the application destination of the present invention is not limited to the camera, and may be an image processing apparatus that can adjust the focus while performing moving image shooting. The present invention can be applied.

  FIG. 1 is a block diagram schematically showing a configuration of a camera 100 as an image forming apparatus according to an embodiment of the present invention.

  In FIG. 1, a camera 100 includes a photographing lens 101, a shutter 102, an AE processing unit 103, a focus lens 104, a motor 105, an AF processing unit 106, an image sensor 107, an A / D conversion unit 108, an image processing unit 109, and a format. A conversion unit 110 is provided. The camera 100 also includes a DRAM 111, an external recording I / F 112, a system control unit 113, a VRAM 114, an image display unit 115, and an operation unit 116. The system control unit 113 is connected to the AE processing unit 103, the AF processing unit 106, the image processing unit 109, the DRAM 111, the image display unit 115, and the operation unit 116, respectively. The shutter 102 is connected to the AE processing unit 103, and the motor 105 is connected to the focus lens 104 and the AF processing unit 106, respectively. The image sensor 107 is connected to an A / D converter 108, the A / D converter 108 is connected to an image processor 109, and the image processor 109 is connected to a format converter 110. The DRAM 111 is connected to the format conversion unit 110, the external recording I / F 112, and the VRAM 114, and the VRAM 114 is connected to the image display unit 115.

  The camera 100 can shoot a moving image having a set shooting time, for example, a few seconds, and can add a special effect that emphasizes the subject and the movement of the subject to the moving image. In the present embodiment, in order to add an effect of enhancing the subject, for example, a moving image that gradually focuses on the main subject is taken.

  The taking lens 101 includes a zoom mechanism, and the shutter 102 has a diaphragm function. The AE processing unit 103 controls the shutter 102 to control the amount of light transmitted from the photographing lens 101. The focus lens 104 can be moved by driving a motor 105. The AF processing unit 106 controls the motor 105 to move the position of the focus lens 104. In the camera 100, the focus of the subject is adjusted by moving the position of the focus lens 104. Further, the AF processing unit 106 analyzes the contrast of the image data based on the image data acquired from the system control unit 113 and the like, and calculates an AF evaluation value indicating the strength of contrast in the image data based on the analysis result. To do. A high AF evaluation value indicates that the contrast of the image data is strong, and a low AF evaluation value indicates that the contrast of the image data is weak. The image sensor 107 receives the light transmitted through the focus lens 104 and photoelectrically converts the received light into an electrical analog signal. In the present embodiment, the image sensor 107 is an image sensor compatible with the image plane phase difference method, and the camera 100 acquires subject image information having different phases using the image sensor 107, and the acquired phases are different. The subject distance can be measured using the subject image information.

  The A / D converter 108 converts the analog signal photoelectrically converted by the image sensor 107 into a digital signal. The image processing unit 109 generates image data based on the digital signal converted by the A / D conversion unit 108, determines an area using an edge component included in the generated image data, and detects each subject area. . In the present embodiment, a main subject area and a sub-subject area are detected from each photographed subject. The format conversion unit 110 converts the image data generated by the image processing unit 109 into a format that can be read by the AF processing unit 106 or the like. The DRAM 111 is a high-speed built-in memory, and the external recording I / F 112 performs data communication with various external recording media such as a memory card. The system control unit 113 includes a CPU (not shown) and a storage unit that stores various programs that can be executed by the CPU. The system control unit 113 performs overall control of each component connected to the system control unit 113 by the CPU executing various programs stored in the storage unit. The VRAM 114 stores display data necessary for performing various displays on the image display unit 115. The image display unit 115 displays various screens based on the display data stored in the VRAM 114, for example, moving images being shot and various setting screens. The operation unit 116 includes various operation buttons, and performs various settings of the camera 100 and various shooting operations.

  FIG. 2 is a flowchart showing a procedure of special effect moving image shooting processing executed by the camera 100 in FIG.

  The processing in FIG. 2 is performed by the system control unit 113 executing various programs, and it is assumed that a moving image of the subject is shot.

  In FIG. 2, first, the system control unit 113 determines whether or not all the photographed subjects are stationary (step S201).

  As a result of the determination in step S201, when any one of the photographed subjects is not stationary, the system control unit 113 adds special effects such as fast-forward and reverse movement suitable for the moving subject to the moving image being photographed. It decides to give (step S202). Thereafter, the system control unit 113 ends the process after executing the process of step S202.

  As a result of the determination in step S201, when all photographed subjects are stationary, the system control unit 113 divides the photographed image data into equal intervals as shown in FIG. A distance map is generated by calculating distance information for each divided region. Thereafter, the system control unit 113 acquires distance information of each subject from the generated distance map (step S203) (distance information acquisition means). The distance map includes distance information between the camera 100 and each subject, and the distance information is calculated based on, for example, AF evaluation values calculated by the AF processing unit 106 and various information used in the image plane phase difference method.

  Next, the system control unit 113 sets the main subject area 301 among the divided areas of the generated distance map (step S204). In the present embodiment, for example, among the divided areas of the distance map, a divided area that is located near the center of the distance map and includes a face and the divided area adjacent to the divided area are set as the main subject area 301. To do. Next, the system control unit 113 sets the sub-subject area 302 among the divided areas of the generated distance map (step S205). In step S <b> 205, the system control unit 113 sets a divided area or the like corresponding to the background in the sub subject area 302. For example, the sub-subject area 302 is set to a sub-area including a sub-area including a subject where the same distance information continues for a predetermined range or more, a sub-area including a subject farthest from the camera 100, and a sub-area adjacent to the sub-area. . Next, the system control unit 113 performs a classification process shown in FIG. 4 to be described later (step S206). In the classification process, the system control unit 113 determines the position of the focus lens 104 (hereinafter referred to as “sub-subject focus position”) that focuses on the sub-subject region 302 (hereinafter referred to as “photo-capture position”). It is classified as either “available or unavailable” in the “starting position”. Next, the system control unit 113 determines whether or not the sub subject focus position is available (step S207).

  As a result of the determination in step S207, when the sub-subject focus position is available, the system control unit 113 sets the sub-subject focus position as the shooting start position (step S208) (lens position setting means). Next, the system control unit 113 performs a focus change movie shooting process of FIG. 5 to be described later (step S209), moves a position of the focus lens 104 to shoot a movie that changes the focus, and ends this process. .

  As a result of the determination in step S207, when the sub subject focus position cannot be used, the system control unit 113 determines whether or not the main subject focus position is in the vicinity of the boundary position that is the boundary of the movable region of the focus lens 104. Is discriminated (step S210). In the following description, the position of the focus lens 104 that focuses on the main subject area 301 is the main subject focus position, and the boundary position that is the boundary of the movable area of the focus lens 104 is the movement boundary position of the focus lens 104. . For example, the case where the main subject focus position is in the vicinity of the movement boundary position of the focus lens 104 is a landscape as shown in FIG. In this case, the distance information of the main subject area is almost infinite.

  As a result of the determination in step S210, when the main subject focus position is in the vicinity of the movement boundary position of the focus lens 104, the system control unit 113 sets the shooting start position based on the movement boundary position of the focus lens 104 (step S211). . Specifically, the system control unit 113 moves the focus lens 104 along the optical axis in a direction that is inside the movable region, that is, a direction away from the moving boundary position, so that the main subject region 301 cannot be focused. Is set as the photographing start position (lens position setting means). Accordingly, the system control unit 113 can reliably set the photographing start position to the position of the movable region of the focus lens 104. In step S211, the position of the focus lens 104 that focuses on the other subject area where the difference in depth from the main subject area 301 is a predetermined threshold value is set as the position at which the main subject area 301 is out of focus. The In the present embodiment, the predetermined threshold is 10 depths or more, but the threshold can be set as appropriate. In the following description, the position of the focus lens 104 that focuses on another subject region in which the difference in depth from the main subject region has a predetermined threshold is assumed to be another subject focus position. Next, the system control unit 113 performs the process of step S209 and ends this process.

  As a result of the determination in step S210, when the main subject focus position is not in the vicinity of the movement boundary position of the focus lens 104, the system control unit 113 sets another subject focus position as a shooting start position (step S212) (lens position setting). means). That is, in the present embodiment, the position of the focus lens 104 that is out of focus with the main subject area 301 is always set as the shooting start position. Next, the system control unit 113 performs the process of step S209 and ends this process.

  In the process of FIG. 2, in step S205, a divided area including a face having a predetermined ratio with respect to the face size included in the main subject area 301, specifically, a face other than a face having a size of 1/4 to 1/5 or less. It is also possible to detect (detecting means) and set a sub-subject area from the detected divided areas.

  FIG. 4 is a flowchart showing the procedure of the classification process in step S206 in FIG.

  In FIG. 4, first, the system control unit 113 calculates the main subject focus position (step S401). After that, the system control unit 113 sets the calculated main subject focus position to the position of the focus lens 104 that is used in the focus change movie shooting process of FIG. 5 (to be described later) (hereinafter referred to as “movement destination position”). (Lens position setting means). Next, the system control unit 113 calculates the sub subject focus position (step S402). In steps S401 and S402, for example, the main subject focus position and sub-subject position based on the average value of the distance information of the main subject region 301 and the distance information of the sub-subject region 302 and the AF evaluation value calculated by the AF processing unit 106. The subject focus position is calculated. Next, the system control unit 113 calculates the amount of movement of the focus lens 104 based on the difference between the main subject focus position and the sub subject focus position (step S403). Next, the system control unit 113 calculates the moving speed of the focus lens 104 based on the calculated moving amount of the focus lens 104 and a preset shooting time (hereinafter referred to as “shooting setting time”) (step S404). ). The shooting setting time (execution time) is preset by the user (execution time setting means). In this embodiment, in order to emphasize the main subject, after focusing on the main subject region 301, shooting is performed without moving the position of the focus lens 104 for a predetermined time. Therefore, in step S404, the moving speed of the focus lens 104 is calculated based on a time excluding a predetermined time during which the position of the focus lens 104 is not moved from the moving amount of the focus lens 104 and the shooting setting time. Next, the system control unit 113 exceeds the calculated maximum moving speed at which the focus lens 104 can move (hereinafter referred to as “the maximum moving speed of the focus lens 104”). It is determined whether or not there is (step S405). The maximum moving speed of the focus lens 104 is a driving limit speed of the motor 105 that moves the focus lens 104.

  As a result of the determination in step S405, when the moving speed of the focus lens 104 exceeds the maximum moving speed, the system control unit 113 determines that the interval between the sub subject focus position and the main subject focus position is too long. Thereafter, the system control unit 113 determines whether or not the moving speed of the focus lens 104 can be adjusted by changing the aperture value (step S406). The aperture value is used to adjust the depth of field indicating the depth range in which each subject is in focus, and to adjust the amount of movement of the focus lens 104. For example, if an aperture value larger than the set aperture value is set, the interval between the sub subject focus position and the main subject focus position can be shortened, and the focus lens 104 is moved from the sub subject focus position to the main subject focus position. The moving amount becomes smaller. Thereby, the moving speed of the focus lens 104 can be made slower than the moving speed of the focus lens 104 calculated in step S404. In step S406, for example, when the aperture value larger than the set aperture value is set and the movement amount of the focus lens 104 can be adjusted to a movement amount that does not exceed the maximum movement speed, the movement speed of the focus lens 104 is adjusted. It is determined that it is possible. On the other hand, if the moving amount of the focus lens 104 cannot be adjusted to a moving amount that does not exceed the maximum moving speed even if an aperture value that is larger than the set aperture value is set, the moving speed of the focus lens 104 cannot be adjusted. It is determined that

  As a result of the determination in step S406, when the moving speed of the focus lens 104 cannot be adjusted, the system control unit 113 determines that the sub subject focus position cannot be set to the position of the focus lens 104 at the start of shooting. Thereafter, the system control unit 113 classifies the sub-subject focus position as unusable (step S407), and performs the processing after step S207 in FIG.

  As a result of the determination in step S406, when the moving speed of the focus lens 104 can be adjusted, the system control unit 113 selects an aperture value to be changed (hereinafter referred to as “changed aperture value”). Next, the system control unit 113 stores the selected changed aperture value in the DRAM 111 or the like (step S408), and calculates the movement amount of the main subject focus position and the sub subject focus position when the changed aperture value is set (step S408). S409). Next, the system control unit 113 calculates the amount of movement of the focus lens 104 (step S410), classifies the sub subject focus position as usable (step S411), and performs the processing after step S207 in FIG.

  As a result of the determination in step S405, when the moving speed of the focus lens 104 does not exceed the maximum moving speed, the system control unit 113 determines whether or not the main subject area 301 is greater than or equal to a predetermined depth difference from the sub subject area 302. A determination is made (step S412). The predetermined depth indicates a depth at which the sub subject area 302 is not in focus at the focus position of the main subject and is sufficiently blurred. In the present embodiment, the predetermined depth is 10 depths or more.

  As a result of the determination in step S412, when the main subject area 301 is not greater than the predetermined depth difference from the sub subject area 302, the system control unit 113 determines whether the depths of the main subject area 301 and the sub subject area 302 can be adjusted. Is discriminated (step S413). In step S413, for example, when the aperture value smaller than the set aperture value is set and the depths of the main subject region 301 and the sub subject region 302 can be adjusted to a predetermined depth difference or more, the main subject region 301 and the sub subject It is determined that the depth of the region 302 can be adjusted. On the other hand, if the depths of the main subject region 301 and the sub subject region 302 cannot be adjusted to a predetermined depth difference or more even if an aperture value smaller than the set aperture value is set, the main subject region 301 and the sub subject region 302 It is determined that the depth cannot be adjusted.

  If the depth of the main subject region 301 and the sub subject region 302 can be adjusted as a result of the determination in step S413, the changed aperture value is stored in the DRAM 111 or the like (step S414), and the processing after step S411 is performed.

  As a result of the determination in step S413, when the depths of the main subject region 301 and the sub subject region 302 cannot be adjusted, the system control unit 113 performs the processing from step S407.

  As a result of the determination in step S412, when the main subject region 301 is greater than or equal to a predetermined depth difference from the sub-subject region 302, the system control unit 113 performs the processing from step S411.

  FIG. 5 is a flowchart showing the procedure of the focus change movie shooting process in step S209 in FIG.

  In FIG. 5, first, the system control unit 113 determines whether or not to change the aperture value setting (step S501). In the present embodiment, for example, when a changed aperture value is stored in the DRAM 111 or the like, the system control unit 113 determines to change the aperture value setting. On the other hand, when the changed aperture value is not stored in the DRAM 111 or the like, the system control unit 113 determines that the aperture value setting is not changed.

  As a result of the determination in step S501, when changing the aperture value setting, the system control unit 113 sets the changed aperture value stored in the DRAM 111 or the like (step S502). Next, the system control unit 113 moves the focus lens 104 to the shooting start position set in any of steps S208, S211 and S212 (step S503). For example, when the sub subject focus position is the shooting start position, a moving image in which the sub subject area 302 becomes clear and the main subject area 301 becomes unclear as shown in FIG. 3B is taken. Next, the system control unit 113 starts shooting a moving image (step S504), and moves the focus lens 104 from the shooting start position to the destination position (step S505). As a result, the sub-subject area 302 changes from a clear display (for example, FIG. 3C) to an unclear display (for example, FIG. 3D), and the main subject area 301 has a non-clear display (for example, FIG. 3). A moving image that changes from (c)) to a clear display (for example, FIG. 3D) is taken. Next, in order to emphasize the main subject, the system control unit 113 performs photographing for a predetermined time while maintaining the position of the focus lens 104 at the main subject focus position (step S506). In the present embodiment, the predetermined time is about 1 second. Next, the system control unit 113 completes photographing (step S507), and ends this processing.

  2, 4, and 5, the position of the focus lens 104 that does not focus on the main subject region 301 is set as the shooting start position, and the main subject focus position becomes the movement destination position of the focus lens 104. Is set. Further, the shooting start position is set based on the distance information of each subject. As a result, the position of the focus lens 104 that focuses on another subject area having distance information with a small difference from the distance information of the main subject area is prevented from being set as the shooting start position, and the moving picture is started from the start of moving picture shooting. It is possible to prevent the subject area from being focused. As a result, it is possible to reliably shoot a moving image in which the focus of the focus lens 104 changes such that the main subject area changes from being out of focus to being in focus.

  2, 4, and 5, the position of the focus lens 104 where the difference in depth from the main subject region 301 is equal to or greater than the threshold is set as the shooting start position. Accordingly, it is possible to reliably prevent the main subject from being focused from the start of moving image shooting.

  2, 4, and 5, after focusing on the main subject area 301, photographing is performed without moving the position of the focus lens 104 for a predetermined time. As a result, it is possible to lengthen the time for focusing on the main subject area in the moving image, thereby obtaining a moving image in which the main subject is emphasized.

  In addition, according to the processing of FIGS. 2, 4, and 5, when the main subject is not focused at the sub subject focus position, the sub subject focus position is set as the shooting start position. As a result, the shooting start position can be easily set without using the distance information of the main subject area and the distance information of other subject areas, and thus the moving image in which the focus lens 104 is in focus can be easily changed. Can get to.

  Although the present invention has been described above by using the embodiment, the present invention is not limited to the above-described embodiment.

  For example, as shown in FIG. 6 to be described later, the user may set each of the main subject area 301 and the sub-subject area 302 (subject area setting means).

  FIG. 6 is a flowchart showing the procedure of a modified example of the special effect moving image shooting process of FIG.

  The processing in FIG. 6 is performed when the system control unit 113 executes various programs, and presupposes a case where a moving image of a subject is shot.

  In FIG. 6, first, the system control unit 113 executes the same process as in step S <b> 201 of FIG. 2.

  As a result of the determination in step S201, when any one of the photographed subjects is not stationary, the system control unit 113 notifies the user that the subject cannot be set (step S601). The process returns to step S201.

  As a result of the determination in step S201, when all the photographed subjects are stationary, the system control unit 113 determines whether or not the main subject region 301 has been selected by the user (step S602). Thereafter, when the main subject region 301 is selected (YES in step S602), the system control unit 113 determines whether or not the sub subject region 302 has been selected (step S603). In the present embodiment, in the image displayed on the image display unit 115, the areas selected by the user are set as the main subject area 301 and the sub subject area 302, respectively. Thereafter, when the sub-subject area 302 is selected (YES in step S603), the system control unit 113 executes the processes of steps S206 and S207 in FIG.

  As a result of the determination in step S207, when the sub-subject focus position cannot be used, the system control unit 113 can select whether the user can again set the sub-subject region 302 on the image display unit 115. Is displayed. Thereafter, the system control unit 113 determines whether or not to set the sub-subject area 302 again based on the user's selection (step S604).

  When it is determined in step S604 that the sub-subject area 302 is set again, the system control unit 113 returns to step S603. On the other hand, when it is determined in step S604 that the setting of the sub-subject area 302 is not performed again, the system control unit 113 executes the processes after step S210 in FIG. 2 and ends this process.

  As a result of the determination in step S207, when the sub-subject focus position is available, the system control unit 113 executes the processing after step S208 in FIG. 2 and ends this processing.

  According to the processing of FIG. 6, since each of the main subject area 301 and the sub-subject area 302 is set by the user, the convenience for the user when obtaining a moving image in which the focus lens 104 changes in focus is improved. be able to.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100 Camera 104 Focus Lens 113 System Control Unit 301 Main Subject Area 302 Sub-Subject Area

Claims (10)

In an image processing apparatus that moves a focus lens to focus, and shoots a plurality of subjects including a main subject,
Distance information acquisition means for acquiring distance information of the plurality of subjects;
Lens position setting means for setting each of the focus lens moving start position and the moving position of the focus lens for moving the focus lens during execution of the moving image shooting;
Moving image shooting means for moving image shooting while moving the focus lens from the shooting start position to the destination position;
The lens position setting means sets the position of the focus lens that focuses on the main subject as the movement destination position, and focuses on the main subject based on the distance information of the main subject and the distance information of other subjects. An image processing apparatus, wherein a position of a focus lens that does not match is set as the shooting start position. A threshold for a difference in depth between the main subject and the position of each focus lens is defined,
The image processing apparatus according to claim 1, wherein the lens position setting unit sets a position of the focus lens at which a difference between the main subject and the depth is equal to or greater than the threshold as the photographing start position. The focus lens has a maximum moving speed that can be moved,
The lens position setting means sets a position of the focus lens at which the moving speed of the focus lens at the time of moving image shooting does not exceed a maximum moving speed and the focus on the main subject is not focused as the shooting start position. The image processing apparatus according to claim 1 or 2, wherein A movable area of the focus lens is defined,
The lens position setting means sets a position of a focus lens that does not exceed a movable region of the focus lens and does not focus on the main subject as the shooting start position. The image processing apparatus according to any one of 1 to 3. An execution time setting means for setting an execution time of the moving image shooting;
The moving image photographing means moves the focus lens from the destination position for a time excluding the time required for the focus lens to move from the photographing start position to the destination position from the set execution time. 5. The image processing apparatus according to claim 1, wherein the moving image shooting is performed without the image processing. The plurality of subjects include sub-subjects different from the main subject,
The lens position setting means sets the position of the focus lens focused on the sub subject as the shooting start position when the main subject is not focused at the position of the focus lens focused on the sub subject. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. Detection means for detecting each of a main subject area indicating the main subject and a sub-subject area indicating the sub-subject;
When the main subject region includes a face, the detection unit detects, as the sub subject region, a region other than a face smaller than a predetermined ratio with respect to the size of the face included in the main subject region. The image processing apparatus according to claim 6.   The image processing apparatus according to claim 6, further comprising subject area setting means capable of setting each of the main subject and the sub-subject by a user. A method of controlling an image processing apparatus that moves a focus lens to focus and shoot a plurality of subjects including a main subject.
A distance information acquisition step of acquiring distance information of the plurality of subjects;
A lens position setting step for setting each of a focus start position of the focus lens and a movement destination position of the focus lens for moving the focus lens during the moving image shooting;
A moving image shooting step of moving image shooting while moving the focus lens from the shooting start position to the destination position;
The lens position setting step sets the position of the focus lens focused on the main subject as the movement destination position, and focuses on the main subject based on the distance information of the main subject and the distance information of the other subjects. A control method for an image processing apparatus, wherein a position of a focus lens that does not match is set as the shooting start position. In a program for causing a computer to execute a control method of an image processing apparatus that moves a focus lens to focus and moves a plurality of subjects including a main subject.
The control method of the image processing apparatus is:
A distance information acquisition step of acquiring distance information of the plurality of subjects;
A lens position setting step for setting each of a focus start position of the focus lens and a movement destination position of the focus lens for moving the focus lens during the moving image shooting;
A moving image shooting step of moving image shooting while moving the focus lens from the shooting start position to the destination position;
The lens position setting step sets the position of the focus lens focused on the main subject as the movement destination position, and focuses on the main subject based on the distance information of the main subject and the distance information of the other subjects. A position of a focus lens that does not match is set as the shooting start position.