JP2009055125A - Imaging apparatus and its control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus which can judge the background and an object appropriately without requiring special hardware or complicated processing or operations, and to provide its control method. <P>SOLUTION: The imaging apparatus comprises a ranging means for acquiring distance information by measuring a distance to an object for every predetermined region in the angle of field, a first processing means for judging a main object region by using the distance information and separating the main object region, a second processing means for judging the main object region by using information other than the distance information and separating the main object region, a distance information judgment means for judging whether the distance information sufficient for the first processing means is obtained or not, and a processing switching means for separating the main object region by the first processing means when sufficient distance information is obtained based on the judgment of the distance information judgment means and separating the main object region by the second processing means when it is not obtained. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing device, an image processing method, an imaging device, and a control method for the imaging device, and in particular, appropriately determines a background and a subject without requiring special hardware or complicated processing or operation. The present invention relates to an imaging apparatus capable of controlling the imaging apparatus and a method for controlling the imaging apparatus.

  An image pickup device used in a compact digital camera is smaller than an image pickup device used in a single-lens reflex camera or a silver salt film. Therefore, the focal length of a shooting optical system necessary for shooting an image with the same angle of view is short.

  When the focal length is short, the depth of field becomes deep even if the F number of the photographing optical system is the same. On the other hand, if the F number can be reduced in proportion to the shortening of the focal length, the depth of field can be reduced. However, it is necessary to enlarge the photographing optical system, and the size and cost are reduced. Will increase.

For this reason, when a picture is taken with a compact digital camera, a relatively wide distance range is in focus.
This is also an advantage in that an image with less blur can be obtained when shooting images of the same brightness, but when shooting images where background blur is important, such as portraits, even the background On the contrary, it becomes clear and becomes a disadvantage.

  In order to solve the above inconveniences, for example, Patent Documents 1 to 5 propose a camera that measures or estimates distance information, performs image processing based on the information, determines a background and a subject, and blurs the background. ing.

  However, the apparatuses described in Patent Documents 1 to 5 do not consider the case where the distance information is not sufficiently obtained, and therefore the brightness of the subject or the background is not appropriate, or the contrast of the subject or the background is not appropriate. Is not sufficient, there is a problem that the background and subject are erroneously subjected to an improper blurring process.

JP 2000-259823 A JP 2003-283902 A JP 2005-136480 A JP 2005-229198 A JP 9-318870 A

  Accordingly, the present invention has been made in view of the above situation, and an imaging apparatus capable of appropriately determining a background and a subject without requiring special hardware or complicated processing or operation. It is another object of the present invention to provide an imaging device control method for an imaging device.

  In order to solve the above problems, an image processing apparatus, an image processing method, an imaging apparatus, and an imaging apparatus control method according to the present invention specifically have the technical features described in the following (1) to (14). Have.

(1): a distance measuring means for measuring distance to a subject for each predetermined area within an angle of view to obtain distance information; a main subject area is determined using the distance information; and a main subject area is separated. A first processing unit, a second processing unit that determines a main subject region using information other than the distance information, and separates the main subject region; and sufficient distance information is obtained for the first processing unit. A distance information determination means for determining whether or not the image has been received, and when sufficient distance information is obtained based on the determination of the distance information determination means, the first processing means separates the main subject area and An image processing apparatus comprising: a process switching unit that separates a main subject region by the second processing unit when accurate distance information cannot be obtained.
According to the configuration described in (1) above, the means for determining the main subject area is automatically switched according to the result of distance measurement, so that a sufficient distance measurement result cannot be obtained. In addition, an appropriate region determination result can be obtained.

(2): The image processing apparatus according to (1), wherein the first processing unit has fewer external input operations than the second processing unit.
According to the configuration described in the above (2), the operation step when a sufficient distance measurement result is obtained is configured to be reduced. Therefore, the convenience described in the above (1) is not greatly impaired. The effect based on a structure can be enjoyed.

(3): In the image processing apparatus according to (1), the second processing unit determines a main subject area using a rectangular coordinate position surrounding the main subject.
According to the configuration described in (3) above, since the area of the main subject is determined by specifying the rectangular coordinates, the area can be determined without requiring special hardware or complicated operations. Can do.

(4): In the image processing apparatus according to (1), the distance information determination unit is configured to perform determination based on the number of regions in which distance measurement can be performed.
According to the configuration described in (4) above, the configuration is such that the area determination processing means is switched depending on the number of areas for which distance measurement can be performed, so that special hardware and complicated processing are required. Without changing the processing means.
There is an effect.

(5): The image processing apparatus according to (1) includes a blur processing unit that performs blur processing on a portion other than the main subject after the main subject is determined by the first processing unit or the second processing unit. An image processing apparatus characterized by this.
The configuration described in (5) above is suitable for a configuration in which it is necessary to reliably determine a region because it is configured to perform blurring processing on portions other than the main subject. Compared to other processing, It has a big effect.

(6): An image pickup device for picking up an image of an object, an image pickup lens for forming an image of the object on the image pickup device, a moving means for moving the image pickup lens to adjust the focus, and a predetermined area in the image. An imaging apparatus comprising: a degree-of-focus determination unit that determines a degree of focus; and the image processing apparatus according to any one of (1) to (5) above, wherein the degree-of-focus determination unit includes: The degree of focus for each lens movement position is obtained, the maximum degree of focus lens position at which the degree of focus is maximum is determined, and the distance measuring means determines the predetermined degree in the image from the maximum degree of focus lens position. It is an imaging apparatus characterized in that the distance information is obtained by measuring a distance to a subject in each region.
According to the configuration described in (6) above, the distance information is measured by the focusing operation performed at the time of normal shooting, so that it is not necessary to increase special hardware or processing time. Distance information can be obtained.

(7): A digital still camera comprising the image processing apparatus according to any one of (1) to (5) above.
According to the configuration described in (7) above, the configuration described in (1) to (5) is configured to be applied to a digital still camera, so that the image processing is performed on limited resources. It has a great effect compared to other devices.

(8) The imaging apparatus according to (6), wherein the imaging apparatus is a digital still camera.

(9): A distance measuring step of measuring distance to a subject for each predetermined area within the angle of view to acquire distance information, a distance information determining step of determining the distance information, and a determination of the distance information determining step And a processing step of separating the main subject region based on the first processing step of determining the main subject region using the distance information. And a second processing step for determining a main subject region using information other than the distance information, and a processing for switching between the first processing step and the second processing step based on the determination in the distance information determination step. A switching step, wherein the distance information determining step determines whether sufficient distance information is obtained for the first processing step, and the processing switching step is a step of the distance information determining step. Sufficient distance based on judgment Switch to the first processing step if the broadcast is obtained, which is when sufficient distance information is not obtained image processing method, characterized in that switching to the second processing step.
According to the configuration described in (9) above, since the process of determining the main subject area is automatically switched according to the distance measurement result, a sufficient distance measurement result cannot be obtained. In addition, an appropriate region determination result can be obtained.

(10): The image processing method according to (9), wherein the first processing method has fewer external input operations than the second processing method.
According to the configuration described in (10) above, since the operation steps when a sufficient distance measurement result is obtained are configured, the convenience described in (9) above is not greatly impaired. The effect based on a structure can be enjoyed.

(11): In the image processing method according to (9), in the second processing step, a main subject area is determined using a rectangular coordinate position surrounding the main subject. is there.
According to the configuration described in (11) above, since the area of the main subject is determined by specifying the rectangular coordinates, the area can be determined without requiring special hardware or complicated operations. Can do.

(12): In the image processing method according to (9), the distance information determination step is performed based on the number of regions in which distance measurement can be performed.
According to the configuration described in (12) above, it is configured to switch the area determination processing process depending on the number of areas for which distance measurement can be performed, so that special hardware and complicated processing are required. The processing steps can be switched without

(13): In the image processing method according to (9), a blur processing step of performing blur processing on a portion other than the main subject after determining the main subject in the first processing step or the second processing step. It is an image processing method characterized by comprising.
The configuration described in (13) above is suitable for a configuration in which it is necessary to reliably determine a region because it is configured to perform blurring processing on a portion other than the main subject. Compared to other processing, It has a big effect.

(14): Focus adjustment step for adjusting the focus by moving the image pickup lens to determine the focus degree for each predetermined area in the image; and subject image formed on the image pickup device by the image pickup lens An imaging process comprising: an imaging process for imaging an image, and the image processing method according to any one of (9) to (13) above, wherein the in-focus degree determination process includes: The focus degree for each moving position is obtained, the maximum focus degree lens position at which the focus degree is maximized is determined, and the distance measuring step is performed for each predetermined region within the angle of view from the maximum focus degree lens position. A method for controlling an image pickup apparatus, comprising: measuring a distance to a subject of the camera to acquire the distance information.
According to the configuration described in (14) above, the distance information is measured by the focusing operation performed at the time of normal photographing, so that it is not necessary to increase special hardware or processing time. Distance information can be obtained.

  According to the present invention, it is possible to provide an imaging apparatus and an imaging apparatus control method for the imaging apparatus that can appropriately determine the background and the subject without requiring special hardware or complicated processing or operation. Can be provided.

Embodiments of the present invention will be described below.
The embodiments described below are preferred embodiments of the present invention, and thus various technically preferable limitations are given. However, the scope of the present invention is particularly limited in the following description. Unless otherwise stated, the present invention is not limited to these embodiments.

FIG. 1 is a schematic diagram illustrating a configuration of an imaging apparatus according to an embodiment of the present invention and a configuration of connected devices of the imaging apparatus.
The digital still apparatus 1 includes a system control unit 2, an imaging unit 3, an image processing unit 4, a display control unit 5, an LCD 6, a recording medium interface unit 7, a hard key interface unit 9, and a communication interface unit 10, and includes a recording medium. 8 is detachable and can be connected to the PC 11 via USB.

  The system control unit 2 is provided to control the entire digital still apparatus 1 and includes a CPU, a NAND flash memory, an SDRAM, a timer, and the like.

  The imaging unit 3 is provided for imaging and includes an optical system component (lens and lens driving motor), a CCD, a CCD driving circuit, an A / D converter, and the like.

  The image processing unit 4 performs various image processing on the image signal obtained by the imaging unit 3 and controls the CCD driving timing and the lens driving motor to perform zooming, focusing, exposure adjustment, etc. And an image processing DSP (digital signal processor), a RAM, and the like, which are provided for compressing and expanding images.

  The display control unit 5 performs signal processing for displaying the image signal obtained by the imaging unit 3 and processed by the image processing unit 4 on the LCD 5, and generates various graphic images for the user interface to generate the LCD. A D / A converter, an on-screen display controller, and the like are provided for display.

  The LCD 6 is a liquid crystal display device LCD (liquid crystal display) provided for displaying an image and displaying a graphic for a user interface.

  The recording media interface unit 7 includes a memory card controller or the like provided for interface with the recording media.

  The hard key interface unit 9 includes a sub CPU and the like that are provided for detecting the state of a user interface such as a key and a dial (not shown) and for controlling main power to the main CPU.

  The communication interface unit 10 includes a communication controller that is provided to connect the USB and perform data communication.

  The recording medium 8 is a memory card such as a flash memory provided for storing a compressed image signal and various information associated with the image, and is a recording medium that can be attached to and detached from the digital still camera device 1.

  The PC 11 is a personal computer that can connect the digital still camera device 1 via USB, transfer an image from the digital still camera device 1 and play it back, and perform various settings on the digital still camera device 1.

First, the startup operation of the conventional imaging device will be described.
When the user presses a power button (not shown), the hard key interface unit 9 turns on the power supply to the main CPU.

  The main CPU in the system control unit 2 starts access (program execution) from the boot unit of the NAND flash memory, and transfers program data to the SDRAM by the boot program.

  When the transfer to the SDRAM is completed, the program execution pointer (program counter) is moved to the transferred program on the SDRAM, and thereafter, the startup process is started by the program on the SDRAM.

  The startup processing includes OS (operating system) initialization, lens barrel extension processing, recording media initialization processing, and the like.

The lens barrel feeding process is performed by applying a pulse signal to the lens driving motor of the imaging unit 3 at predetermined intervals (2 mS) via the image processing unit 4.
In the initialization process of the recording medium, the power and clock are supplied to the recording medium 8 via the recording medium interface unit 7 and then an initialization command is issued to the recording medium 8. The actual initialization process is performed in the recording medium 8, and the system control unit 2 polls the status of the recording medium 8 at intervals of 10 mS in order to detect the completion.

Next, the operation during shooting will be described.
Prior to shooting, the user operates various keys and dials (not shown) to determine the shooting mode (high image quality mode, low image quality mode, etc.).
The user's operation content is discriminated by the system control unit 2 through the hard key interface unit 9, and the system control unit 2 generates a guidance graphic to the display control unit 5 according to the operation, and prompts the user to perform the next operation.

When the photographing mode is determined, the system control unit 2 sets processing parameters corresponding to the mode in the image processing unit 4.
Alternatively, the user operates a zoom lever (not shown) to determine the angle of view (composition).

  The user's operation content is discriminated by the system control unit 2 through the hard key interface unit 9, and the system control unit 2 controls the imaging unit 3 according to the operation to drive the lens.

  In accordance with control from the image processing unit 4, the imaging unit 3 starts an imaging operation for displaying a monitoring image prior to actual shooting.

  The imaged data is continuously sent to the image processing unit 4, which performs processing such as color space conversion, gamma correction, and white balance adjustment, and then sends the image data to the display control unit 5.

  The display control unit 5 processes the image data and displays it on the LCD 6, and presents the imaging state to the user.

  When a release button (not shown) is pressed, the operation is discriminated by the system control unit 2 through the hard key interface unit 9 as in the mode setting.

  The imaging unit 3 performs focus adjustment in accordance with control from the image processing unit 4, and then sends the captured image to the image processing unit 4. The image processing unit 4 performs image processing and compression processing according to the shooting mode.

The system control unit 2 reads the compressed image data, adds header information, and then writes 8 into the recording medium through the recording medium interface unit 7.
This completes a series of shooting operations.

(First embodiment)
Subsequently, as a first embodiment of the control method of the imaging apparatus according to the present invention, an example in which the blurring process is performed on the background portion other than the main subject at the time of shooting will be described.
FIG. 2 shows an operation flow of the first embodiment in the control method of the imaging apparatus according to the present invention. This flow shows the operation when the above-described release button is pressed.
When the release button is pressed, the system control unit 2 controls the image processing unit 4 and the imaging unit 3 to perform a CCDAF scanning operation (step 01-001).
The imaging unit 3 and the image processing unit 4 perform focusing and image capture according to the above-described procedure (step 01-002).
Subsequently, the system control unit 2 calculates the distance for each position of each image (step 01-003).

Hereinafter, description will be made with reference to an explanatory diagram illustrating a control method of the imaging apparatus according to the present invention illustrated in FIG. 3.
In FIG. 3A, 100 indicates the angle of view of the captured image, and 101 indicates one AF evaluation value area.
As shown in FIG. 3, the AF evaluation value area is a small area that is equally divided within the angle of view, and the AF evaluation value for each area (integrated value of the contrast of the image in the area) by CCDAF scanning. Is obtained.

The system control unit 2 analyzes the AF evaluation value for each lens position obtained by CCDAF scanning for each area based on a predetermined algorithm, and determines the lens driving position corresponding to the peak position of the AF evaluation value. To do.
Further, the system control unit 2 converts the driving position of the lens from the current zoom position into distance information for each area.

Here, the AF evaluation value is obtained by calculating the HPF in the horizontal direction for each pixel in the area and adding the obtained results.
As the HPF coefficient, for example, a value such as ki = {− 1, −2, 6, −2, −1} is used.

  k0 is a coefficient to be multiplied by the pixel of the pixel in the horizontal direction-2 of the target pixel, k1 is a coefficient to be multiplied to the pixel of the pixel of interest in the horizontal direction-1 coordinate, k3 is a coefficient to be multiplied by the target pixel, A coefficient to be multiplied by a pixel having a coordinate in the horizontal direction + 1 of the target pixel, and k5 is a coefficient to be multiplied by a pixel having a coordinate in the horizontal direction + 2 of the target pixel.

  In order to acquire distance information from the AF evaluation value, it is obtained by the following equations (1) and (2) based on the Gaussian imaging equation.

1 / a + 1 / b = 1 / f Formula (1)
a = b · f / (b−f) (2)
(Here, a is the distance from the lens to the subject, b is the distance from the lens to the image sensor, and f is the focal length of the lens.)

In the present invention, the distance a from the lens to the subject is distance information to be obtained.
Further, the focal length f of the lens is uniquely obtained from the zoom position at the time of photographing, and the distance b from the lens to the image sensor is uniquely obtained from the driving position of the focus lens from which the peak of the AF evaluation value is obtained.
If no peak exceeding a predetermined amount appears in the AF evaluation value, an abnormal value (= −1) is set in the distance information of the area.
As described above, it is possible to obtain distance information for each AF evaluation value area 101 of the entire region within the angle of view 100.

  Here, the system control unit 2 compares the obtained distance information of all the areas and counts the number n of areas having a normal value (≠ −1). The main subject area is determined using the distance information described in (Step 01-004).

  As the predetermined number N, for example, a value such as 230 corresponding to 90% of an area of 16 × 16 = 256 is used.

In FIG. 3A, the hatched area is the AF area 102 focused by AF.
The system control unit 2 determines the area closest to the AF evaluation value area at the center of the screen as the AF area, and further determines the block equidistant from the AF area as the main subject block.

  In FIG. 3B, the main subject block 103 is indicated by diagonal lines. However, the main subject block 103 is an area including the AF area 102.

  The system control unit 2 determines the main subject area based on the obtained information on the main subject block 103 and the captured image (step 01-005). In this process, a region having an arbitrary shape including the main subject block 103 is determined by conventional image processing (contour extraction).

In FIG. 3C, the main subject area 104 is shown.
The image processing unit 4 sequentially performs main subject image extraction processing, background image blurring processing, and composition processing based on the information of the main subject region 104 (step 01-009).

  FIG. 3D shows a captured image 105, a main subject 106, an extracted main subject image 107, a background image 108, a blurred background image 109, and a composite image 110, respectively.

In the main subject extraction process, the main subject is extracted by separating the image along the main subject region 104. As a result, the captured image 105 is separated into the main subject image 107 and the background image 108.
In the background image blurring process, a spatial filter is applied to the background image 108 to generate a blurred background image 109.

  The spatial filter calculates a filter coefficient (k (ix, iy)) for the input image (In (x, y)) using the following equation (3) to obtain an output image (Out (x, y)).

In: Input image Out: Output image k: Filter coefficient fs: Filter size (7 in this embodiment)

An example of the filter coefficient is shown in FIG.
Returning to step 01-004, the operation when the number n of areas having normal values (≠ −1) is less than the predetermined number N will be described.

The distance information becomes an abnormal value (= −1) when the peak exceeding a predetermined amount does not appear in the evaluation value as described above.
This occurs when the contrast of the subject in the area is low, or the exposure is not appropriate and blackout or whiteout occurs. In the example of FIG. 4, it is likely to occur at a portion marked with a cross in the figure.

  The system control unit 2 controls the display control unit 5 to display a captured image and displays a rectangular frame for designating a main subject as shown in FIG. 5 (step 01-006).

The user performs a key operation so that the frame display surrounds the target subject, and the system control unit changes the position and size of the frame display according to the key operation and repeats the redisplay.
When the user performs an operation for determining the frame, the system control unit 2 calculates a coordinate value on the image corresponding to the coordinates of the frame display at that time, and uses the rectangular coordinate position described below as a main subject. The area is determined (step 01-006).

The system control unit 2 performs area division as shown in FIG. 6 by image processing. This is done by grouping each pixel according to the color and brightness of the image.
The system control unit 2 determines an area inside the designated rectangular coordinates as a main subject area (step 01-008).

The main subject image extraction process, background image blurring process, and composition process are as described above.
The system control unit 2 controls the image processing unit 4 to compress the combined image, reads the compressed image data, adds header information, and writes 8 to the recording medium through the recording medium interface unit 7.
At this time, the obtained distance information is added to the header information.

(Second Embodiment)
Subsequently, as a second embodiment of the present invention, an example in which a blurring process is performed on a background portion other than the main subject during reproduction will be described.
FIG. 7 shows an operation flow of the second embodiment in the control method of the imaging apparatus according to the present invention. This flow shows the operation when the blurring process is selected by the user's operation during image reproduction.

  The system control unit 2 reads the assigned distance information from the header information of the image file being reproduced (step 02-001).

When there is no distance information (step 02-002), or when the number n of normal areas (≠ −1) is less than a predetermined number N (step 02-003), the main subject is a rectangular frame. The area is determined (step 02-005 to 007).
However, the determination method of the main subject area using the rectangular frame is an example, and other main subject area determination methods may be used, and the main subject area may be determined by measuring the distance to the subject for each predetermined area within the angle of view. A determination method for determining a main subject region from distance information other than the obtained distance information may be used.

  On the other hand, if the number n of areas having distance information and a normal value (≠ −1) is equal to or greater than a predetermined number N, the main subject region is determined using the distance information (step 02-004). .

  The main subject image extraction process, background image blurring process, and composition process are the same as those in the first embodiment (step 02-008).

  The system control unit 2 controls the image processing unit 4 to compress the combined image, reads the compressed image data, adds header information, and writes 8 to the recording medium through the recording medium interface unit 7.

  In the present embodiment, an example in which the main subject region is determined without using any distance information when sufficient distance information cannot be obtained has been described, but the obtained distance information is taken into account. There may be.

  In the present embodiment, an example in which the main subject region is determined using information other than the distance information (rectangular coordinate position) when sufficient distance information cannot be obtained has been described. The distance information acquisition unit may be activated.

  As described above, according to the first embodiment and the second embodiment of the imaging apparatus and the imaging apparatus control method according to the present invention, no special hardware, complicated processing, or operation is required. In addition, it is possible to appropriately determine the background and the subject.

It is the schematic which shows the structure in one Embodiment of the imaging device which concerns on this invention, and the structure of the connection apparatus of an imaging device. It is a block diagram which shows the operation | movement flow of 1st Embodiment in the control method of the imaging device which concerns on this invention. It is explanatory drawing explaining the control method of the imaging device which concerns on this invention. It is explanatory drawing explaining the part which shows the abnormal value of distance information in the control method of the imaging device which concerns on this invention. It is explanatory drawing explaining the rectangular frame display for designating the main subject area in the control method of the imaging device concerning the present invention. It is explanatory drawing explaining the area division | segmentation in the control method of the imaging device which concerns on this invention. It is a block diagram which shows the operation | movement flow of 2nd Embodiment in the control method of the imaging device which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital still camera apparatus 2 System control part 3 Imaging part 4 Image processing part 5 Display control part 6 LCD
7 Recording media interface unit 8 Recording media 9 Hard key interface unit 10 Communication interface unit 11 PC

Claims (14)

A distance measuring means for measuring distance to a subject for each predetermined area within an angle of view and acquiring distance information;
First processing means for determining a main subject area using the distance information and separating the main subject area;
Second processing means for determining a main subject area using information other than the distance information and separating the main subject area;
Distance information determination means for determining whether sufficient distance information has been obtained for the first processing means;
Based on the determination of the distance information determination means,
When sufficient distance information is obtained, the main subject area is separated by the first processing means,
An image processing apparatus, comprising: a process switching unit that separates a main subject area by the second processing unit when sufficient distance information is not obtained. The image processing apparatus according to claim 1.
The image processing apparatus according to claim 1, wherein the first processing unit has fewer external input operations than the second processing unit. The image processing apparatus according to claim 1.
The image processing apparatus according to claim 2, wherein the second processing means determines a main subject area using a rectangular coordinate position surrounding the main subject. The image processing apparatus according to claim 1.
The distance information determining means is determined based on the number of areas in which ranging can be performed. The image processing apparatus according to claim 1.
An image processing apparatus comprising blur processing means for performing blur processing on a portion other than the main subject after the main processing object is determined by the first processing means or the second processing means. An image sensor for imaging a subject;
An imaging lens for forming a subject image on the imaging device;
A moving means for adjusting the focus by moving the imaging lens; a focusing degree determining means for determining a focusing degree for each predetermined region in the image;
An image processing apparatus comprising: the image processing apparatus according to any one of claims 1 to 5;
The focusing degree determination means obtains a focusing degree for each moving position of the lens, determines a focusing degree maximum lens position at which the focusing degree is maximum,
The distance measuring means acquires the distance information by measuring a distance from the maximum focus degree lens position to a subject for each predetermined region in the image.   A digital still camera comprising the image processing apparatus according to claim 1.   The imaging apparatus according to claim 6, wherein the imaging apparatus is a digital still camera. A distance measuring step of measuring distance to a subject for each predetermined area within the angle of view and obtaining distance information;
A distance information determination step of determining the distance information;
A processing step of determining a main subject region based on the determination in the distance information determination step and separating the main subject region,
The processing step includes a first processing step of determining a main subject region using the distance information;
A second processing step of determining a main subject area using information other than the distance information;
A process switching step of switching between the first processing step and the second processing step based on the determination of the distance information determination step;
The distance information determination step determines whether sufficient distance information is obtained for the first processing step,
The process switching step is based on the determination in the distance information determination step.
If sufficient distance information is obtained, switch to the first processing step,
An image processing method characterized by switching to the second processing step when sufficient distance information is not obtained. The image processing method according to claim 9,
The image processing method according to claim 1, wherein the first processing method has fewer external input operations than the second processing method. The image processing method according to claim 9.
The second processing step is characterized in that a main subject area is determined using a rectangular coordinate position surrounding the main subject. The image processing method according to claim 9.
The image processing method according to claim 1, wherein the distance information determining step determines based on the number of areas in which ranging can be performed. The image processing method according to claim 9.
An image processing method comprising: a blurring process step of blurring a portion other than the main subject after determining a main subject in the first processing step or the second processing step. A focus degree determination step of performing focus adjustment by moving the imaging lens and determining a focus degree for each predetermined region in the image;
An imaging step of imaging a subject by forming a subject image on an image sensor with the imaging lens;
An image processing method according to any one of claims 9 to 13, comprising:
The focusing degree determination step obtains a focusing degree for each moving position of the imaging lens, determines a focusing degree maximum lens position at which the focusing degree is maximum,
In the distance measuring step, the distance information is acquired by measuring a distance from the maximum focus degree lens position to a subject for each predetermined region within an angle of view.