JP6548141B2 - Image detection apparatus, image detection method and image detection program - Google Patents

Description

  The present invention relates to an image detection range setting apparatus for setting a detection range of image deterioration in an image, an image detection range setting method, an image detection range setting program, and an image detection apparatus for detecting image deterioration in an image.

  It is known that when an object including a high frequency component equal to or higher than the pixel pitch of the imaging device is imaged, moiré such as false color (color moiré) occurs and the photographed image is degraded. Therefore, various techniques have been proposed for removing this kind of false color. For example, Patent Document 1 describes a specific configuration of an imaging device capable of detecting a false color generated in a captured image.

  The imaging device described in Patent Document 1 captures an in-focus subject, and then captures an out-of-focus subject. In the out-of-focus photographed image, the contrast of the subject is lowered and the high frequency component is reduced, so that the false color generated in the in-focus photographed image is also reduced. Therefore, the imaging device described in Patent Document 1 divides each photographed image in the in-focus state and the out-of-focus state into a plurality of blocks, and calculates the difference value of the color difference signal for each divided block. A large block is detected as a block having a false color.

JP, 2011-109496, A

  As described above, in the imaging device described in Patent Document 1, in order to detect a false color, the difference value of the color difference signal is calculated over the entire area of the image. Therefore, it is pointed out that it takes time to detect a false color.

  The present invention has been made in view of the above circumstances, and an object of the present invention is an image detection range setting apparatus, an image detection range setting method, and an image detection range suitable for suppressing time taken to detect image deterioration. It is providing a setting program and an image detection device.

  An image detection range setting apparatus according to an embodiment of the present invention detects in-focus area detection means for detecting at least one in-focus area based on focusing information in an image, and a detection range of image degradation occurring in an image. And a detection range setting unit configured to set a predetermined range based on each focusing region detected by the focusing region detecting unit.

  According to an embodiment of the present invention, the detection range of the image degradation is not set to the entire image, but is set to a predetermined range based on the in-focus region where the possibility of the image degradation is high. Therefore, the detection processing speed of the image deterioration is improved while the detection accuracy of the image deterioration is maintained.

  Further, in one embodiment of the present invention, the detection range of the image degradation includes, for example, a reference focusing area and a predetermined peripheral area surrounding the focusing area.

  In addition, the image detection range setting device according to one embodiment of the present invention includes operation means for receiving an operation of a scanner, and detection range changing means for changing a detection range of image deterioration according to the received operation of the operator. It is good also as composition.

  In one embodiment of the present invention, the detection range changing means may change the size of the detection range according to the operation of the operator with respect to the center of the reference focusing region or the center of the detection range. .

  Further, in one embodiment of the present invention, the shape of the detection range of the image degradation maintains a similar shape before and after the change of the size by the detection range changing means, for example.

  In addition, the image detection range setting device according to an embodiment of the present invention may be configured to include index display means for displaying an index indicating the size of the detection range of the image degradation. The index display means changes the display of the index, for example, according to the change in the size of the detection range of the image deterioration.

  An image detection apparatus according to an embodiment of the present invention includes the above-described image detection range setting apparatus, and an image detection unit that detects image deterioration in a detection range set by the image detection range setting apparatus.

  In one embodiment of the present invention, the image detection unit may be configured to acquire at least one pair of images having different imaging conditions and to detect image deterioration in the detection range based on the acquired paired images. Good.

  Further, in one embodiment of the present invention, the image detection means determines the in-focus area where the same subject appears between the pair of images, and a detection range based on the in-focus area where the determined same subject appears It is good also as composition which performs detection of image degradation based on a picture which serves as a pair.

  In one embodiment of the present invention, the image detection means may be configured to perform predetermined threshold determination based on the paired images and to detect image degradation based on the result of the threshold determination. In this configuration, the threshold may be changeable according to the operation of the operator.

  The image detection range setting method according to one embodiment of the present invention includes the steps of detecting at least one in-focus area based on focusing information in the image, and detecting a detection range of image degradation occurring in the image. And a detection range setting step of setting a predetermined range based on each of the focused regions.

  An image detection range setting program according to an embodiment of the present invention is for causing a computer to execute the above-described image detection range setting method.

  According to one embodiment of the present invention, an image detection range setting device, an image detection range setting method, an image detection range setting program, and an image detection device are provided that are suitable for suppressing the time taken to detect image deterioration.

It is a block diagram showing composition of an imaging device of an embodiment of the present invention. FIG. 1 is a view schematically showing the configuration of an image shake correction apparatus provided in a photographing apparatus according to an embodiment of the present invention. FIG. 1 is a view schematically showing the configuration of an image shake correction apparatus provided in a photographing apparatus according to an embodiment of the present invention. It is a figure which helps explanation of LPF drive in an embodiment of the present invention. It is a figure which shows the false color detection flow by the system controller in embodiment of this invention. It is a figure regarding the to-be-photographed object in embodiment of this invention. It is a figure regarding the to-be-photographed object in embodiment of this invention. FIG. 5 is a diagram illustrating color difference signals plotted in a color space according to an embodiment of the present invention. FIG. 9 (a) shows a subject to be photographed in the embodiment of the present invention, and FIG. 9 (b) and FIG. 9 (c) show a live view displayed on the display screen of the LCD of the photographing apparatus. )). It is a figure which shows the false color detection object pixel used as the object of false color detection in embodiment of this invention.

  Hereinafter, a photographing apparatus according to an embodiment of the present invention will be described with reference to the drawings. In the following, a digital single lens reflex camera will be described as an embodiment of the present invention. The photographing apparatus is not limited to a digital single-lens reflex camera, and, for example, a mirrorless single-lens camera, a compact digital camera, a video camera, a camcorder, a tablet terminal, a personal handy phone system (PHS), a smartphone, a feature phone, a portable game machine, etc. , And may be replaced by another form of device having a photographing function.

[Configuration of Entire Imaging Device 1]
FIG. 1 is a block diagram showing the configuration of the imaging device 1 of the present embodiment. As shown in FIG. 1, the imaging apparatus 1 includes a system controller 100, an operation unit 102, a drive circuit 104, an imaging lens 106, an aperture 108, a shutter 110, an image blur correction device 112, a signal processing circuit 114, and an image processing engine 116. , Buffer memory 118, card interface 120, LCD (Liquid Crystal Display) control circuit 122, LCD 124, ROM (Read Only Memory) 126, gyro sensor 128, acceleration sensor 130, geomagnetic sensor 132 and GPS (Global Positioning System) sensor 134 Is equipped. Although the photographing lens 106 has a plurality of lenses, it is shown in FIG. 1 as a single lens for the sake of convenience. Also, the same direction as the optical axis AX of the imaging lens 106 is defined as the Z-axis direction, and the two axial directions orthogonal to the Z-axis direction and orthogonal to each other are the X-axis direction (horizontal direction) and the Y-axis direction (vertical direction) Define as

  The operation unit 102 includes various switches necessary for the user to operate the photographing apparatus 1 such as a power switch, a release switch, and a photographing mode switch. When the user operates the power switch, power is supplied from the battery (not shown) to various circuits of the photographing apparatus 1 through the power supply line.

  The system controller 100 includes a central processing unit (CPU) and a digital signal processor (DSP). After supplying power, the system controller 100 accesses the ROM 126, reads out a control program, loads it into a work area (not shown), and executes the loaded control program, thereby controlling the entire photographing apparatus 1.

  When the release switch is operated, the system controller 100, for example, calculates a photometric value calculated based on an image captured by the solid-state imaging device 112a (see FIG. 2 described later) or an exposure meter incorporated in the imaging device 1 The diaphragm 108 and the shutter 110 are drive-controlled via the drive circuit 104 so as to obtain a proper exposure based on the photometric value measured at (not shown). More specifically, drive control of the aperture stop 108 and the shutter 110 is performed based on an AE function designated by a shooting mode switch, such as a program AE (Automatic Exposure), a shutter priority AE, an aperture priority AE. The system controller 100 also performs AF (Autofocus) control in combination with AE control. An active method, a phase difference detection method, an image plane phase difference detection method, a contrast detection method or the like is applied to the AF control. Further, as the AF mode, there are a multi-point distance measurement mode using a plurality of distance measurement areas, a full screen distance measurement mode based on distance information of the full screen, and the like. The system controller 100 drives and controls the photographing lens 106 via the drive circuit 104 based on the AF result, and adjusts the focus of the photographing lens 106. The configuration and control of this type of AE and AF are well known, so detailed description thereof will be omitted.

  2 and 3 schematically show the structure of the image shake correction apparatus 112. As shown in FIG. As shown in FIGS. 2 and 3, the image shake correction apparatus 112 includes a solid-state imaging device 112 a. A light flux from the subject passes through the photographing lens 106, the diaphragm 108, and the shutter 110, and is received by the light receiving surface 112aa of the solid-state imaging device 112a. The light receiving surface 112 aa of the solid-state imaging device 112 a is an XY plane including the X axis and the Y axis. The solid-state imaging device 112 a is a single-plate color CCD (Charge Coupled Device) image sensor having a color filter of a Bayer-type pixel arrangement as a transmission wavelength selection device. The solid-state imaging device 112a accumulates an optical image formed by each pixel on the light receiving surface 112aa as an electric charge according to the light amount, and generates image signals of R (Red), G (Green), and B (Blue). Output. The solid-state imaging device 112 a may be replaced with a complementary metal oxide semiconductor (CMOS) image sensor or another type of imaging device as well as the CCD image sensor. The solid-state imaging device 112a may also be equipped with a complementary color filter, or as long as any color filter is arranged for each pixel, it is a filter having a periodic color arrangement such as a Bayer arrangement. There is no need.

  The signal processing circuit 114 performs predetermined signal processing such as clamping and demosaicing (color interpolation) on an image signal input from the solid-state imaging device 112 a and outputs the processed signal to the image processing engine 116. The image processing engine 116 performs predetermined signal processing such as matrix operation, Y / C separation, white balance and the like on the image signal input from the signal processing circuit 114 to generate a luminance signal Y and color difference signals Cb and Cr. Compress in a predetermined format such as JPEG (Joint Photographic Experts Group). The buffer memory 118 is used as a temporary storage place of processing data when the processing by the image processing engine 116 is performed. Further, the storage format of the captured image is not limited to the JPEG format, and may be a RAW format in which only minimal image processing (for example, clamping) is performed.

  A memory card 200 is removably inserted into the card slot of the card interface 120.

  The image processing engine 116 can communicate with the memory card 200 via the card interface 120. The image processing engine 116 stores the generated compressed image signal (captured image data) in the memory card 200 (or a built-in memory (not shown) provided in the imaging device 1).

  Further, the image processing engine 116 buffers the generated luminance signal Y and color difference signals Cb and Cr in a frame memory (not shown) on a frame basis. The image processing engine 116 sweeps out the buffered signal from each frame memory at a predetermined timing, converts it into a video signal of a predetermined format, and outputs the video signal to the LCD control circuit 122. The LCD control circuit 122 modulates and controls the liquid crystal based on the image signal input from the image processing engine 116. Thereby, the photographed image of the subject is displayed on the display screen of the LCD 124. The user can view through the display screen of the LCD 124 a real-time live view (live view) photographed at an appropriate brightness and focus based on the AE control and the AF control.

  When the user performs a reproduction operation of a photographed image, the image processing engine 116 reads the photographed image data designated by the operation from the memory card 200 or the built-in memory and converts it into an image signal of a predetermined format. Output to When the LCD control circuit 122 modulates and controls the liquid crystal based on the image signal input from the image processing engine 116, a photographed image of the subject is displayed on the display screen of the LCD 124.

[Description of Driving of Shake Correction Member]
The image shake correction device 112 drives the shake correction member. In the present embodiment, the shake correction member is the solid-state imaging device 112a. The shake correction member is not limited to the solid-state imaging device 112a, but is physically moved with respect to the optical axis AX, such as a part of lenses included in the imaging lens 106, to thereby receive the light receiving surface 112aa of the solid-state imaging device 112a. It may be another configuration capable of shifting the incident position of the object image on the upper side, or may be a combination of these and two or more members of the solid-state imaging device 112a.

  The image shake correction device 112 not only slightly drives (vibrates) the shake correction member in a plane orthogonal to the optical axis AX (i.e., in the XY plane) in order to correct the image shake, but the subject image has a pixel pitch The shake correction member is finely driven in a plane orthogonal to the optical axis AX so that an optical low pass filter (LPF: Low Pass Filter) effect (reduction of moiré such as false color) due to division is obtained (minute Rotate). Hereinafter, for convenience of explanation, driving the shake correction member by image shake correction is referred to as “image shake correction driving”, and driving the shake correction member so as to obtain the same effect as the optical LPF. It is described as "drive".

(Description of image stabilization drive)
The gyro sensor 128 is a sensor that detects information for controlling the image blur correction. Specifically, the gyro sensor 128 detects an angular velocity around two axes (around the X axis, around the Y axis) applied to the imaging device 1 and detects the detected angular velocity around the two axes in the XY plane (in other words, a solid It is output to the system controller 100 as a shake detection signal indicating a shake of the light receiving surface 112aa of the image sensor 112a.

  As shown in FIGS. 2 and 3, the image shake correction device 112 includes a fixed support substrate 112 b fixed to a structure such as a chassis provided in the imaging device 1. The fixed support substrate 112 b slidably supports a movable stage 112 c on which the solid-state imaging device 112 a is mounted.

Magnets M _YR , M _YL , M _XD , and M _XU are attached on the surface of the fixed support substrate 112 b facing the movable stage 112 c. Further, yokes Y _YR , Y _YL , Y _XD , and Y _{XU that} are magnetic bodies are attached to the fixed support substrate 112 b. The yokes Y _YR , Y _YL , Y _XD and Y _XU respectively extend from the fixed support substrate 112 b to the position facing the magnets M _YR , M _YL , M _XD and M _XU by turning around the movable stage 112 c, A magnetic circuit is formed between the magnets M _YR , M _YL , M _XD and M _XU . In addition, drive coils C _YR , C _YL , C _XD , and C _XU are attached to the movable stage 112 c. When the drive coils C _YR , C _YL , C _XD , and C _XU receive a current in the magnetic field of the magnetic circuit, a driving force is generated. The movable stage 112 c (solid-state imaging device 112 a) is finely driven in the XY plane with respect to the fixed support substrate 112 b by the generated driving force.

Corresponding magnets, yokes and drive coils constitute a voice coil motor. Hereinafter, reference numerals for convenience, the magnet _{M YR,} reference numeral _{VCM YR} to the voice coil motor consisting of a yoke _{Y YR} and the driving coil _{C YR,} magnet _{M YL,} the voice coil motor consisting of a yoke _{Y YL} and the driving coil _{C YL} A voice coil motor with VCM _YL attached, a voice coil motor consisting of a magnet M _XD , a yoke Y _XD and a drive coil C _XD with a code VCM _XD , a voice coil motor consisting of a magnet M _XU , a yoke Y _XU and a drive coil C _XU To the symbol VCM _XU .

The voice coil motors VCM _YR , VCM _YL , VCM _XD , and VCM _XU (drive coils C _YR , C _YL , C _XD , C _XU ) are driven by PWM (Pulse Width Modulation) under the control of the system controller 100. The voice coil motors VCM _YR and VCM _YL are arranged below the solid-state imaging device 112 a at predetermined intervals in the horizontal direction (X-axis direction), and the voice coil motors VCM _XD and VCM _XU are They are disposed side by side of the solid-state imaging device 112a and arranged at predetermined intervals in the vertical direction (Y-axis direction).

Hall elements H _YR , H _YL , H _XD , and H _XU are attached to the fixed support substrate 112b at positions near the drive coils C _YR , C _YL , C _XD , and C _XU , respectively. The Hall elements H _YR , H _YL , H _XD , and H _XU detect the magnetic force of the magnets M _YR , M _YL , M _XD , and M _XU , respectively, and position of the movable stage 112 c (solid-state image sensor 112 a) in the XY plane. Is outputted to the system controller 100. Specifically, Y-axis position and the inclination of the movable stage 112c by the Hall elements _{H YR} and _{H YL} (solid-state imaging device 112a) (rotation) is detected, the movable stage 112c (solid-state image pickup by the Hall elements _{H XD} and _{H XU} The position in the X-axis direction and the tilt (rotation) of the element 112a) are detected.

The system controller 100 incorporates a driver IC for a voice coil motor. The system controller 100 calculates the rated power (permissible power) of the driver IC based on the shake detection signal output from the gyro sensor 128 and the position detection signal output from the Hall elements H _YR , H _YL , H _XD and H _XU. Calculate the duty ratio so that the balance of the current flowing to each voice coil motor VCM _YR , VCM _YL , VCM _XD , VCM _XU (Driving coils C _YR , C _YL , C _XD , C _XU ) within the range not exceeding Do. The system controller 100 _supplies a drive current to each voice coil motor VCM _YR , VCM _YL , VCM _XD , and VCM _XU with the calculated duty ratio, and drives the solid-state imaging element 112 a for image blur correction. Thereby, the image blur on the light receiving surface 112aa of the solid state imaging device 112a is corrected while the solid state imaging device 112a is held at a prescribed position against gravity, disturbance, etc. (in other words, on the light receiving surface 112aa The position of the solid-state imaging device 112a is adjusted so that the incident position of the subject image at the above does not shake.

(Description about LPF drive)
Next, the LPF driving will be described. In the present embodiment, the image shake correction device 112 _applies a predetermined drive current to the voice coil motors VCM _YR , VCM _YL , VCM _XD , and VCM _XU , thereby providing a predetermined drive current for one exposure period in the XY plane. The movable stage 112c (solid-state imaging device 112a) is driven so as to draw the locus of the object image to be incident on a plurality of pixels of different detection colors (R, G or B) of the solid-state imaging device 112a. Thereby, the same effect as the optical LPF is obtained.

  FIG. 4A and FIG. 4B are diagrams to help explain the LPF driving. As shown in the figure, a plurality of pixels PIX are arranged in a matrix at a predetermined pixel pitch P on the light receiving surface 112aa of the solid-state imaging device 112a. For convenience of explanation, each pixel PIX in the same figure is assigned a code (one of R, G, and B) corresponding to the filter color disposed on the front surface.

  FIG. 4A shows an example in which the solid-state imaging device 112a is driven so as to draw a square locus centered on the optical axis AX. This square locus can be, for example, a square closed path whose one side is the pixel pitch P of the solid-state imaging device 112a. In the example of FIG. 4A, the solid-state imaging device 112a is driven so as to form a square path alternately in units of one pixel pitch P in the X-axis direction and the Y-axis direction.

  FIG. 4B shows an example in which the solid-state imaging device 112a is driven so as to draw a rotationally symmetrical circular locus centered on the optical axis AX. This circular locus can be, for example, a circular closed path having a radius r which is √2 / 2 times the pixel pitch P of the solid-state imaging device 112a.

  The information of the drive locus including the pixel pitch P is stored in advance in the internal memory of the system controller 100 or the ROM 126.

  As illustrated in FIG. 4A (or FIG. 4B), during the exposure period, the solid-state imaging device 112a is driven so as to draw a predetermined square locus (or circular locus) based on the information of the drive locus. Then, the subject image is uniformly incident on four color filters R, G, B, G (four (two rows and two columns) pixels PIX). Thereby, the same effect as the optical LPF is obtained. That is, since the subject image incident on any color filter (pixel PIX) is always incident on the color filter (pixel PIX) in its periphery, the same effect as when the object image passes through an optical LPF is also obtained. (Reduction of moiré such as false color) is obtained.

  Note that the user can switch on / off of the image blur correction drive and the LPF drive by operating the operation unit 102.

[Description about false color detection]
Next, a method of detecting a false color which is a kind of moire generated in a photographed image in the present embodiment will be described. FIG. 5 shows the false color detection flow executed by the system controller 100. The false color detection flow shown in FIG. 5 is started, for example, when the release switch is pressed.

[S11 (determination of state) in FIG. 5]
In the main processing step S11, it is determined whether the photographing device 1 is in a stationary state. For example, when the amplitude of a signal component having a predetermined frequency or more in the shake detection signal input from the gyro sensor 128 falls within a certain threshold continuously for a certain period, it is determined to be stationary. As the stationary state of the imaging device 1, typically, the imaging device 1 is fixed to a tripod. The posture of the imaging device 1 including the stationary state may be detected using information output from other sensors such as the acceleration sensor 130, the geomagnetic sensor 132, and the GPS sensor 134 instead of the gyro sensor 128. Also, in order to improve detection accuracy, for example, sensor fusion technology may be applied, and information output from these sensors may be used in combination.

  When the photographing apparatus 1 is not in a stationary state, such as in a hand-held photographing state under a low shutter speed setting, false colors are unlikely to occur in the first place due to blurring of the object due to camera shake (or object blurring). Therefore, in the present embodiment, the false color in the photographed image is detected only when it is determined that the photographing device 1 is in the stationary state (that is, the false color is likely to be generated) (S11: YES). The processing step S12 (shooting of the first image) and the subsequent steps are performed to achieve this. When the imaging device 1 is not in a stationary state, the processing load on the system controller 100 is reduced since the processing step S12 (shooting of the first image) and the subsequent steps are not performed. The photographer may be notified, for example, through the display screen of the LCD 124 that the process step S12 (shooting of the first image) and the subsequent steps will not be executed. If it is desired to place emphasis on the detection of false colors in the photographed image, processing step S12 (shooting of the first image) and subsequent steps may be executed regardless of whether or not the photographing device 1 is in a stationary state. In this case, the photographer may be notified, for example, through the display screen of the LCD 124 or the like that the process step S12 (shooting of the first image) and the subsequent steps will be performed. Further, the determination threshold of the stationary state may be changed according to the shutter speed set in the imaging device 1.

[S12 in FIG. 5 (shooting of the first image)]
FIG. 9A shows the entire subject to be photographed. 6 (a) and 7 (a) are a part of the subject shown in FIG. 9 (a) (for example, wrinkles of clothes worn by a person), and different parts are enlarged. FIG. The subject shown in FIG. 6A is an oblique stripe pattern in which light and dark appear alternately at the same pitch as the pixel pitch P of the pixel PIX of the solid-state imaging device 112a, and the subject shown in FIG. It is a vertical stripe pattern in which light and dark appear alternately at the same pitch as P. For convenience of explanation, a 6 × 6 square subject surrounded by a thick solid line among the subjects shown in FIG. 6A is referred to as “obliquely striped subject 6a”, and a thick solid line among the subjects shown in FIG. 7A. An object of 6 × 6 squares surrounded by and is referred to as “vertical stripe object 7 a”.

  In the main processing step S12, a subject image (first image) is photographed with proper brightness and focus based on AE control and AF control. Here, it is assumed that both the diagonally striped subject 6a and the vertically striped subject 7a are in focus.

  FIGS. 6B and 7B schematically show the diagonally striped object 6a and the vertically striped object 7a taken into each pixel PIX of the solid-state image pickup device 112a, and the light receiving surface 112aa of the solid-state image pickup device 112a. Is a front view of the subject from the subject side. In FIG. 6B and FIG. 7B, in the same manner as FIG. 4, each pixel PIX is given a code (one of R, G, and B) corresponding to the filter color disposed on the front surface. . In each of FIGS. 6 (b) and 7 (b), a black pixel PIX indicates that a dark portion of a stripe pattern has been taken, and a white pixel PIX has a bright portion of a stripe pattern. Indicates that. Further, for the convenience of description, the addresses (numbers 1 to 8 and reference numerals 1 to 4) of the pixels are given to each of FIGS. 6 (b) and 7 (b). Strictly speaking, due to the imaging action of the photographing lens 106, the subject is imaged on the solid-state imaging device 112a in a state in which the top, bottom, left, and right are reversed. As an example, the upper left corner portion of the “obliquely striped object 6 a” is imaged as a lower right corner portion on the solid-state imaging device 112 a. However, in the present embodiment, in order to avoid the explanation being complicated, the portion at the upper left corner of the “obliquely striped subject 6 a” is described as corresponding to the portion at the upper left corner of FIG.

[S13 in FIG. 5 (storage of first focus area information)]
FIG. 9B illustrates a live view displayed on the display screen of the LCD 124 at the time of shooting of the first image in process step S12 (shooting of the first image). When capturing the first image, the system controller 100 can determine that the area is in focus (focus area, eg, depth of field) based on the AF result (focus information in the image). The range in which the image is included is detected, and the detected in-focus area (symbols FA1 to FA7 in the example of FIG. 9B) is displayed on the live view by OSD (On Screen Display). In the present processing step S13, information on the in-focus area at the time of photographing of the first image (hereinafter referred to as "first in-focus area information") is stored, for example, in the internal memory of the system controller 100.

[S14 in FIG. 5 (shift of solid-state imaging device 112a)]
In the main processing step S14, the movable stage 112c is driven, and the solid-state imaging device 112a is shifted rightward (in the direction of the arrowhead in the X axis in FIG. 6) by a distance of one pixel.

[S15 in FIG. 5 (shooting of the second image)]
Also in the main processing step S15, the subject image (second image) is shot based on the AE control and the AF control at the time of shooting the first image. After completion of shooting of the second image, the photographer may be notified that the false color detection process using the first image and the second image is to be started.

  6 (c) and 7 (c) are respectively the same as FIGS. 6 (b) and 7 (b), and show an oblique stripe object 6a and a vertical stripe object taken in by each pixel PIX of the solid-state imaging device 112a. 7a is schematically shown. As shown in FIGS. 6 and 7, (b) and (c), the incident position of the subject image on the light receiving surface 112aa of the solid-state imaging device 112a is determined by the processing step S14 (shifting of the solid-state imaging device 112a). In accordance with the shift amount of the solid-state imaging element 112a in (1), it is shifted by a distance of one pixel in the left direction on the light receiving surface 112aa.

  It should be noted that the imaging conditions in the present processing step S15 are the same as those in the imaging in the processing step S12 (the imaging of the first image) except that the solid-state imaging device 112a is shifted to the right by a distance of one pixel. It is the same. Therefore, the second image is substantially obtained by photographing a range shifted to the right by one pixel with respect to the first image. As can be seen from FIGS. 6 and 7 (b) and (c), in the second image, the subject is shifted leftward by a distance of one pixel with respect to the first image as a whole. It is photographed.

[S16 in FIG. 5 (storage of second focus area information)]
FIG. 9C illustrates a live view displayed on the display screen of the LCD 124 at the time of shooting of the second image in processing step S15 (shooting of the second image). The system controller 100 detects the in-focus area based on the AF result (in-focus information in the image) at the time of capturing the second image, and the detected in-focus area (in the example of FIG. Display FA1 'to FA7') on the live view by OSD. In the present processing step S16, information of the in-focus area at the time of shooting of the second image (hereinafter referred to as "second in-focus area information") is stored, for example, in the internal memory of the system controller 100.

  The above-described signal processing (clamping) is also applied to any image signal of the first image photographed in the processing step S12 (photographing of the first image) and the second image photographed in the processing step S15 (photographing of the second image). , Demosaicing, matrix calculation, Y / C separation, white balance, etc., and converted into a luminance signal Y and color difference signals Cb and Cr. Hereinafter, for the convenience of description, the color difference signal (Cb, Cr) of the first image photographed in processing step S12 (shooting of the first image) is referred to as “first color difference signal”, and processing step S15 (second image) The color difference signal (Cb, Cr) of the second image photographed in photographing) is referred to as "second color difference signal". In addition, “the target pixel” refers to at least a pixel of each image after the demosaicing processing.

[S17 in FIG. 5 (electrical LPF processing)]
In the present embodiment, although the details will be described later, occurrence of a false color is detected based on the signal difference value between the first color difference signal and the second color difference signal and the signal addition value. However, at an edge portion with high contrast, the signal difference value between the first color difference signal and the second color difference signal may be large even if no false color is generated. In this case, there is a possibility that the false color is erroneously detected at the edge portion. Further, although the details will be described later, the first color difference signal and the second color difference signal used for the calculation of the signal difference value and the signal addition value are color difference signals of the pixels that capture the same subject image. Due to the shift of the solid-state imaging device 112a by the shift of the imaging device 112a), demosaicing processing is performed using pixels with different addresses. Therefore, although the first color difference signal and the second color difference signal are color difference signals of pixels that capture the same subject image, color information may be slightly different. Therefore, in the main processing step S17, the LPF processing is performed on the image signal (luminance signal Y, color difference signals Cb and Cr). Since the image is blurred by the LPF processing, false detection of false color at an edge portion can be suppressed and an error in color information between the first color difference signal and the second color difference signal can be suppressed.

[S18 (address conversion) in FIG. 5]
In the main processing step S18, shooting is performed in processing step S15 (shooting of the second image) so that the same subject image is processed as if it were incident on the pixel of the same address in order to improve detection accuracy of false color. The address of each pixel constituting the second image is the shift amount of the solid-state image sensor 112a (in other words, the object image on the light receiving surface 112aa of the solid-state image sensor 112a in the processing step S14 (shift of the solid-state image sensor 112a) In accordance with the shift amount of the incident position of

  As an example, the address (c, 2) of the pixel PIXb in FIG. 6C is the same as the pixel located when one pixel is shifted rightward according to the shift amount of the incident position of the object image, ie, the pixel PIXb. The image is converted to the same address (d, 2) as the pixel PIXa (see FIG. 6B) for capturing an image of the subject.

[S19 in FIG. 5 (pairing of focusing area)]
In the main processing step S19, based on the first and second focusing area information, the focusing area at the time of shooting of the first image in the processing step S12 (shooting of the first image) (here, FIG. 9 (b) Focusing areas FA1 to FA7) and focusing areas at the time of shooting of the second image in the processing step S15 (shooting of the second image) (here, focusing area FA1 ′ shown in FIG. 9C). A pairing with ~ FA7 ') is performed. Specifically, the in-focus area where the common (identical) subject image appears is determined between the in-focus areas FA1 to FA7 and the in-focus areas FA1 ′ to FA7 ′, and the in-focus area where the determined common subject image appears Focal areas are paired with each other. More specifically, a pair of focusing areas including a predetermined number or more of pixels in which a common subject image appears between focusing areas is paired as a focusing area where the same subject image appears.

  In the examples of FIGS. 9B and 9C, the focusing areas FA1 and FA1 ′ are paired, the focusing areas FA2 and FA2 ′ are paired, and the focusing areas FA3 and FA3 ′ are paired The focusing areas FA4 and FA4 'are paired, and the focusing areas FA5 and FA5' are paired.

[S20 in FIG. 5 (setting of false color detection target pixel)]
In the main processing step S20, a pixel to be subjected to false color detection (hereinafter referred to as "false color detection target pixel") is set based on the pairing result in the processing step S19 (pairing of the focusing area). . FIG. 10 illustrates a false color detection target pixel. In FIG. 10, the dashed rectangular area is the in-focus area, and the solid rectangular area surrounding the in-focus area is the false color detection range for detecting a false color. The pixels included in the false color detection range are false color detection target pixels. That is, in the example of FIG. 10, each pixel in each of the focusing areas FA1 to FA5 paired with the focusing areas FA1 ′ to FA5 ′ in the processing step S19 (pairing of focusing areas) and each focusing area FA1. A predetermined number of peripheral pixels (hereinafter, referred to as "false color detection target pixels of the first image") surrounding ~ FA 5 and pixels of the second image having the same address as the false color detection target pixels of the first image (hereinafter, “The false color detection target pixel of the second image” is set as the false color detection target pixel.

  In general, the in-focus object has high contrast and often contains high frequency components. Therefore, false colors are likely to occur in an in-focus object. On the other hand, the out-of-focus subject has low contrast and few objects including high frequency components. Therefore, false colors are less likely to occur in an out-of-focus subject. Therefore, in the present processing step S20, the false color detection target pixels are not all effective pixels, and the focus area is narrowed to a focus area where false colors are likely to occur and pixels in the periphery thereof. As a result, the processing speed of false color detection is improved while the false color detection accuracy is maintained.

  In the in-focus area where a common (identical) subject image does not appear with the in-focus area at the time of shooting the other image (that is, the in-focus area not paired), the in-focus state is It is likely to be changing. A subject appearing in such a focusing area is highly likely to be captured in a state where the image is blurred at the time of capturing the other image. Therefore, in each pixel in such an in-focus area, the signal difference value between the first color difference signal and the second color difference signal becomes large even if false color is not generated, and false color is erroneously generated. There is a risk of being detected. Therefore, in the present processing step S20, each pixel in such a focusing area is excluded from the false color detection target pixel. This improves the false color detection accuracy.

  Note that the user can change the shape or size of the false color detection range based on each in-focus area or finely adjust the position by operating the operation unit 102. Exemplarily, the false color detection range is only sized while keeping the shape (being similar shape) with respect to the center of the reference focusing area or the center of the false color detection range according to the operation by the user Is changed. Also, the false color detection range may be changed in size so as to preferentially expand toward the inside of the display screen of the LCD 124 while maintaining the shape. Further, the predetermined range located closer to the center of the display screen (or image) of the LCD 124 may be always set to the false color detection range regardless of whether it is the in-focus area or not. Also, the false color detection range corresponding to the in-focus area including the subject near the center of the display screen (or image) of the LCD 124 is preferentially expanded relative to other false color detection ranges (enlargement with respect to the operation amount The size may be changed (after the rate is set larger than other false color detection ranges). In addition, the false color detection range is changed in size (after the enlargement ratio to the operation amount is set to be larger) so that the area corresponding to the in-focus area including the subject closer in distance is preferentially expanded. It is also good.

  The false color is detected over a wide range as the false color detection range is expanded, the false color detection accuracy is improved, and as the false color detection range is narrowed, the number of false color detection target pixels is decreased. The processing speed of detection is improved. As shown in each of FIGS. 9 and 10, a frame size adjustment bar B1 is displayed by OSD in the live view. The display of the frame size adjustment bar B1 changes in accordance with the change operation amount of the false color detection range by the user (size of the false color detection range). The user can grasp, through the frame size adjustment bar B1, whether the size of the current false color detection range is large (ie, emphasis on detection accuracy) or small (ie, emphasis on detection speed).

[S21 in FIG. 5 (calculation of difference value of color difference signal)]
The diagonally striped subjects 6a and the vertically striped subjects 7a include high frequency components having the same pitch as the pixel pitch P of the pixels PIX of the solid-state imaging device 112a. Therefore, when the image signals of the diagonally striped subject 6a and the vertically striped subject 7a are demosaiced in processing step S12 (shooting of the first image) and processing step S15 (shooting of the second image), false color occurs.

  Specifically, in the example of FIG. 6B, the luminance of the pixel PIX of the G component is high, and the luminance of the pixel PIX of the R and B components is low. Therefore, the G component is dominant in the color information of each pixel PIX after the demosaicing processing, and a false color of green is generated in the diagonally striped object 6a. On the other hand, in the example of FIG. 6C, contrary to the example of FIG. 6B, the luminance of the pixel PIX of the R and B components is high, and the luminance of the pixel PIX of the G component is low. Therefore, the R and B components dominate the color information of each pixel PIX after the demosaicing processing, and a purple false color occurs in the diagonally striped object 6a.

  Further, in the example of FIG. 7B, the luminance of the pixel PIX of the B component is high, and the luminance of the pixel PIX of the R component is low. Therefore, the color information of each pixel PIX after the demosaicing processing becomes a color mixture component of B and G, and a false color of an intermediate color of blue and green (for example, a color near the center of cyan color) is generated. On the other hand, in the example of FIG. 7C, contrary to the example of FIG. 7B, the luminance of the pixel PIX of the R component is high, and the luminance of the pixel PIX of the B component is low. Therefore, the color information of each pixel PIX after the demosaicing processing becomes a color mixture component of R and G, and a false color of intermediate color between red and green (near the center of orange) is generated.

FIG. 8 shows a color space defined by two axes of Cb and Cr. In FIG. 8, reference numeral 6 b is a plot corresponding to the false color of green generated in the target pixel in the example of FIG. 6 (b), and reference 6 c is purple generated in the target pixel in the example of FIG. 7b is a plot corresponding to an intermediate false color between blue and green occurring at the pixel of interest in the example of FIG. 7B, and a symbol 7c is a plot corresponding to FIG. It is a plot corresponding to the false color of the middle color of red and green which generate | occur | produces in an attention pixel in the example of c). The following shows coordinate information of each plot. The origin O is coordinates (0, 0).
Plot 6b: (Cb, Cr) = (-M, -N)
Plot 6c: (Cb, Cr) = (M, N)
Plot 7b: (Cb, Cr) = (M ', -N')
Plot 7c: (Cb, Cr) = (− M ′ + α, N ′ + β)
However, M, N, M ', N', α, β are all positive numbers.

  As shown in FIG. 8, in the present embodiment, the false color itself generated when capturing an object image of a high frequency component comparable to the pixel pitch P of the pixel PIX of the solid-state imaging device 112 a is the light receiving surface 112 aa. The position (target pixel) where a false color is generated is detected using the change by shifting the incident position of the object image in the upper part. More specifically, it is determined that a portion where the color information possessed by the first color difference signal and the second color difference signal have a complementary color relationship with each other is a portion where a false color is generated in the target pixel where the subject image of the high frequency component is captured. It is detected.

  In the present embodiment, in order to obtain the above complementary color relationship, the incident position of the subject image on the light receiving surface 112aa is shifted by one pixel to the left (horizontal pixel alignment direction) (the solid-state imaging element 112a (In the right direction), but the present invention is not limited thereto. The shift direction may be, for example, right direction (horizontal pixel alignment direction), or upward (vertical pixel alignment direction), downward (vertical pixel alignment direction), upper right And other directions according to the pixel arrangement, such as the lower right, upper left, lower left diagonal directions (directions forming 45 degrees with each horizontal and vertical alignment direction), or may be used in combination . The shift distance may be, for example, a distance for another odd pixel such as 3 pixels, 5 pixels, etc., and a half pixel or a half pixel plus an odd pixel (e.g. 5 pixels, 2.5 pixels, etc.) (ie, n pixels or (m + 0.5) pixels (where n = odd natural number, m = 0 or odd natural number) It is possible to select according to the accuracy of the mechanism to shift drive. Further, the shift distance may be a distance other than an even number of pixels and its vicinity (for example, 1.9 to 2.1 pixels or the like) depending on a subject to be photographed and a photographing condition. Even when the incident position of the subject image on the light receiving surface 112aa is shifted by these amounts (direction and distance), the first color difference signal in the target pixel for which the subject image of the high frequency component is captured (false color occurs) Since the color information possessed by the second color difference signal and the color information possessed by the second color difference signal are complementary to each other, generation of a false color can be detected.

In the main processing step S21, a difference value (Cb) between the first color difference signal and the second color difference signal for each false color detection target pixel having the same address set in the processing step S20 (setting of the false color detection target pixel). _sub and Cr _sub ) are calculated. Specifically, in the present processing step S21, Cb and Cr of the first color difference signal are defined as Cb1 and Cr1, respectively, and Cb and Cr of the second color difference signal having the same address are defined as Cb2 and Cr2, respectively. Then, the difference value (Cb _sub , Cr _sub ) is calculated by the following equation.
Cb _sub = Cb 1 -Cb 2
Cr _sub = Cr 1 -Cr 2

[S22 in FIG. 5 (calculation of first distance information)]
In the main processing step S22, in the color space of the first color difference signal and the second color difference signal for each false color detection target pixel having the same address set in the processing step S20 (setting of the false color detection target pixel). distance (first distance information Saturation_ _sub) is calculated by the following equation.
Saturation_ _sub = ((Cb _sub ² + Cr _sub ² )

The first distance information Saturation_ _sub are each an example of each plot pair of FIG. 8 (plot 6b and plot 6c, plots 7b and plot ^{7c), 2√ (M 2 +} N 2), √ {(- 2M '+ α) It becomes ² + (2N '+ beta) ² }.

As understood from the positional relationship of each plot pair of FIG. 8, as the color information with the first color difference signal and a second color difference signal is strong complementary relationship first distance information Saturation_ _sub increases, first color difference signal and the color information having the second color difference signal is not (for example similar hue) in complementary relationship as the first distance information Saturation_ _sub decreases. That is, the first distance information Saturation_ _sub ideally if false color occurrence region is zero, the larger the false color occurrence region in which false color is generated strongly.

[S23 in FIG. 5 (calculation of addition value of color difference signal)]
In the main processing step S23, an added value (Cb) of the first color difference signal and the second color difference signal for each false color detection target pixel having the same address set in the processing step S20 (setting of the false color detection target pixel). ' _add , _Cr'add ) is calculated.

Specifically, in the present processing step S23, temporary addition values (Cb _add , Cr _add ) are calculated by the following equation.
Cb _add = Cb1 + Cb2
Cr _add = Cr1 + Cr2

Next, the mean value (Cb _mean , Cr _mean ) of the provisional addition value is calculated by the following equation.
Cb _mean = Cb _add / 2
Cr _mean = Cr _add / 2

Then, the added value _{(Cb 'add, Cr' add} ) is calculated by the following equation.
_{Cb 'add} = Cb _{add -Cb mean}
Cr ' _add = Cr _add -Cr _mean

[S24 in FIG. 5 (calculation of second distance information)]
In the process step S24, the processing step S20 address is the same false color detection target each pixel is set at (false-color detection target pixel setting), based on the addition value _{(Cb 'add, Cr' add} ) color second distance information Saturation_ _{the add} is calculated by the following equation in space.
Saturation_ _add = ((Cb ' _add ² + Cr' _add ² )

Second distance information Saturation_ _{the add} each example of each plot pair of FIG. 8 (plot 6b and plot 6c, plots 7b and plot 7c), zero, and ^{√ (α 2 + β 2)} .

Here, the first and second color difference signals change under the influence of the light source at the time of image shooting, the exposure condition, the white balance, and the like. However, first, since the second respective color difference signals varies in the same way, mutual relative distance in the color space (i.e., the first distance information Saturation_ _sub) changes little.

On the other hand, the second distance information Saturation_ _{the add,} the first, second light source for the respective color difference signal imaging, exposure conditions, the changes relative to the position of the origin O of the color space under the influence of such as white balance , Changes greatly. Therefore, in the process step S23 (calculation of the sum of the color difference signal), the second distance information Saturation_ _{the add} provisional sum value _{(Cb add, Cr} add) without operation immediately using, relative to the origin O by the impact Additive value (Cb ' _add , Cr' _add ) to offset or reduce the change in position (to bring the midpoint of the first color difference signal and the second color difference signal away from the origin O closer to the origin O due to the above effect) Is calculated.

As understood from the positional relationship between each pair of plots in FIG. 8, when the color information possessed by the first color difference signal and the second color difference signal is in a complementary color relationship, the signs of the respective colors are opposite to each other. _'add, Cr' _add) is decreased, the second distance information Saturation_ _{the add} decreases. The second distance information Saturation_ to _add becomes smaller as is strong complementary relationship, the zero ideally. On the other hand, if the color information possessed by the first color difference signal and the second color difference signal does not have a complementary color relationship (for example, similar hues), the sign of each other will be the same, so the added value (Cb ' _add , Cr' _add) and increases, the second distance information Saturation_ _{the add} increases. That is, the second distance information Saturation_ _{the add} is larger if false color occurrence region decreases if false color occurrence region.

[S25 in FIG. 5 (calculation of difference value of luminance signal)]
For convenience of explanation, the luminance signal Y of the first image taken in process step S12 (shooting of the first image) is referred to as “first brightness signal”, and it is shot in process step S15 (shooting of the second image) The luminance signal Y of the second image is referred to as a "second luminance signal". In the main processing step S25, the difference value Y _diff between the first luminance signal and the second luminance signal for each false color detection target pixel having the same address set in the processing step S20 (setting of the false color detection target pixel). Is calculated. Specifically, in the main processing step S25, when the first luminance signal is defined as Y1 and the second luminance signal is defined as Y2, the difference value Y _diff is calculated according to the following equation.
Y _diff = | Y1-Y2 |

[S26 in FIG. 5 (judgment of false color occurrence area)]
In the main processing step S26, it is determined whether or not the address set in the processing step S20 (setting of false color detection target pixel) is a false color generation region for each same false color detection target pixel. Specifically, when all of the following conditions (1) to (3) are satisfied, it is determined that the pixel is a false color generation region.

Condition (1)
As described above, since the color information having the first color difference signal the larger the first distance information Saturation_ _sub and the second color difference signal is strong complementary relationship, it is likely the pixel is false color occurrence region . Therefore, the condition (1) is defined as follows.
Condition (1): Saturation_ _sub ≧ threshold T1

Condition (2)
As described above, since the color information having the second distance information Saturation_ first color difference signal the more _add small and the second color difference signal is strong complementary relationship, it is likely the pixel is false color occurrence region . Therefore, the condition (2) is defined as follows.
Condition (2): Saturation_ _add ≦ threshold T2

Consider the case where a large image blur occurs in only one of the first image taken in process step S12 (shooting of the first image) and the second image taken in process step S15 (shooting of the second image) . In this case, the difference between the first color difference signal and the second color difference signal becomes large, and false color may be erroneously detected. Therefore, the condition (3) is defined as follows.
Condition (3): Y _diff ≦ threshold T 3

That is, when the difference value Y _diff is larger than the threshold value T 3, the false color is not detected for the pixel because there is a possibility of the above erroneous detection (the pixel is processed as not being a false color generation region). ).

  Condition (1) and condition (2) are conditions for directly determining whether the pixel is a false color generation region. Therefore, in another embodiment, when at least one of the condition (1) and the condition (2) is satisfied, it may be determined that the pixel is a false color generation region.

  Also, the user can change the false color detection sensitivity by operating the operation unit 102 to change the settings of the threshold values T1 to T3. As shown in FIGS. 9 and 10, the detection sensitivity adjustment bar B2 is displayed on the live view by the OSD. The display of the detection sensitivity adjustment bar B2 changes in accordance with the setting change contents of the threshold values T1 to T3 by the user. The user can grasp the present false color detection sensitivity through the detection sensitivity adjustment bar B2.

[S27 in FIG. 5 (false color detection)]
In the main processing step S27, the presence or absence of a false color is detected. For example, the number of pixels determined as the false color generation area in the processing step S26 (determination of the false color generation area) (or the ratio of pixels determined as the false color generation area to the total number of effective pixels) is predetermined. If it is more than the threshold, the detection result of false color is present (S27: YES), and if the number of pixels (or the ratio) is less than a predetermined threshold, the detection result of false color absence is obtained (S27: NO) .

[S28 in FIG. 5 (storage of photographed image)]
The present process step S28 is executed when a detection result indicating no false color is obtained in the process step S27 (detection of false color) (S27: NO). In the main processing step S28, a false color is not detected in the first image photographed in the processing step S12 (photographing of the first image) and the second image photographed in the processing step S15 (photographing of the second image) At least one of them is stored in the memory card 200 (or a built-in memory (not shown) provided in the photographing apparatus 1). At this time, the photographer may be notified that the photographing operation has been completed. In particular, when the photographer is notified in the processing step S15 (shooting of the second image) that the false color detection process using the first image and the second image is to be started, the shooting operation is completed I tell the photographer. Thereby, the photographer can proceed to the next operation, for example, changing the state (setting) of the photographing apparatus 1.

[S29 in FIG. 5 (imaging under LPF drive)]
This processing step S29 is executed when the detection result that false color is present is obtained in processing step S27 (detection of false color) (S27: YES). In the main processing step S29, a false color is detected in the first image photographed in the processing step S12 (photographing of the first image) and the second image photographed in the processing step S15 (photographing of the second image) Therefore, the LPF drive is performed. When imaging under LPF driving has already been performed, the drive cycle (rotation cycle) or drive of the solid-state imaging element 112a is performed so that a stronger optical LPF effect (reduction of moiré such as false color) can be obtained. The amplitude (turning radius) is adjusted. That is, it is changed to more advantageous imaging conditions for reducing false color. Then, imaging of the subject (shooting of a third image) is performed. That is, when the false color is detected, the third image is taken. Therefore, when the photographer is notified that the false color detection process is to be started in processing step S15 (shooting of the second image), the photographer is in the state of the shooting apparatus 1 until shooting of the third image is completed. (Setting) can be maintained.

  According to the present embodiment, the false color detection target pixels are narrowed down not to all the effective pixels but to the in-focus area where false colors are likely to occur and pixels in the periphery thereof. As a result, the processing speed of false color detection is improved while the false color detection accuracy is maintained. Further, according to the present embodiment, when the subject image having a high frequency component equal to or more than the pixel pitch P is captured by shifting the incident position of the subject image on the light receiving surface 112aa of the solid-state imaging device 112a. Different false colors (false colors that are complementary to each other) are generated, and an image having a large difference is generated. Because an image with a large difference is used for false color detection, false color is accurately detected.

  The above is a description of an exemplary embodiment of the present invention. Embodiments of the present invention are not limited to those described above, and various modifications are possible within the scope of the technical idea of the present invention. For example, contents obtained by appropriately combining the embodiments explicitly illustrated in the specification or the obvious embodiments are also included in the embodiments of the present application.

  In the above embodiment, false color removal is optically performed on the entire image by executing the LPF driving, but the present invention is not limited to this. False colors may be removed using image processing. In the case of image processing, the false color can be removed not only in the entire image but locally (for example, for each pixel determined to be a false color generation region). In addition, if information indicating a false color generation area is stored in association with the first image (second image), the operator can perform false color correction manually even if another terminal (such as a computer) performs manual false color correction, The false color generation area can be easily found based on the information. Therefore, the trouble of searching for the false color generation area from the whole image is reduced.

  In the above embodiment, false color detection target pixels are set based on the focusing areas FA1 to FA5 at the time of shooting of the first image in the processing step S12 (shooting of the first image), but the present invention Not exclusively. For example, the false color detection target pixel may be set based on the focusing areas FA1 'to FA5' at the time of shooting of the second image in the processing step S15 (shooting of the second image).

  Further, in the above embodiment, not only each pixel in the paired focusing area but also a predetermined number of peripheral pixels surrounding the focusing area are set as false color detection target pixels. Not limited to. For example, only each pixel in the paired focusing area may be set as a false color detection target pixel.

Reference Signs List 1 imaging apparatus 100 system controller 102 operation unit 104 drive circuit 106 imaging lens 108 aperture 110 shutter 112 image blur correction device 112a solid-state image sensor 112aa light-receiving surface 112b (of solid-state image sensor) fixed support substrate 112c movable stage 114 signal processing circuit 116 image Processing engine 118 Buffer memory 120 Card interface 122 LCD control circuit 124 LCD
126 ROM
128 Gyro Sensor 200 Memory Card C _YR , C _YL , C _XD , C _XU Driving Coil H _YR , H _YL , H _XD , H _XU Hall Elements M _YR , M _YL , M _XD , M _XU Magnet PIX Pixel VCM _YR , VCM _YL , VCM _XD , VCM _XU voice coil motor Y _YR , Y _YL , Y _XD , Y _XU yoke

Claims (10)

Focusing area detection means for detecting at least one focusing area based on focusing information in the image;
Detection range setting means for setting a detection range of image deterioration occurring in the image to a predetermined range based on each of the detected focusing regions;
Image detection means for detecting image deterioration in the set detection range;
Equipped with
The image detection means
Acquire at least one pair of images with different imaging conditions,
Detecting image degradation in the detection range based on the acquired paired images ;
Image detection device . The detection range is
The reference focusing area and the peripheral area of the focusing area
The image detection device according to claim 1. Operation receiving means for receiving an operator's operation;
Detection range changing means for changing the detection range according to the operation of the accepted operator;
Equipped with
The image detection apparatus according to claim 1. The detection range changing means is
The size of the detection range is changed according to the operation with respect to the center of the reference focusing region or the center of the detection range.
The image detection device according to claim 3. The shape of the detection range is
Maintain similar shape before and after the change of the size by the detection range changing means,
The image detection apparatus according to claim 4. An indicator display means for displaying an indicator indicating the size of the detection range;
The indicator display means
The display of the indicator is changed according to the change of the size of the detection range,
The image detection apparatus according to claim 4 or 5. The image detection means
The in-focus area where the same subject appears between the paired images is determined;
The image degradation is detected based on the pair of images with respect to a detection range based on the in-focus area where the determined same subject appears.
The image detection apparatus according to any one of claims 1 to 6 . The image detection means
Performing a predetermined threshold determination based on the pair of images;
The image deterioration is detected based on the result of the threshold determination,
The threshold used for the threshold determination is
The setting can be changed according to the operation of the operator,
The image detection apparatus according to any one of claims 1 to 7 . Detecting at least one focus area based on focus information in the image;
A detection range setting step of setting a detection range of image degradation occurring in the image to a predetermined range based on each of the detected focusing regions;
An image detection step of detecting image deterioration in the set detection range;
Including
At the image detection stage,
Acquire at least one pair of images with different imaging conditions,
Detecting image degradation in the detection range based on the acquired paired images;
Image detection method. The image detection program for making a computer perform the image detection method of Claim 9 .

Images