JP2016144103A - Image detection range setting device, image detection range setting method, image detection range setting program and image detection apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image detection range setting device that suppresses the time required for detecting image deterioration.SOLUTION: A first image is captured and a range in which the image is focused is detected based on an AF result S12. Focusing area information is stored S13. A movable stage is driven and a solid-state imaging device is shifted S14. A second image is captured S14 and focusing area information is stored S16. Focusing areas in which a common subject image is captured in the first image and the second image are paired and based on a result of the pairing S19, a false color detection object pixel is set. A differential value of a color difference signal between the first image and the second image is calculated S21, and a distance within a color space is calculated S22. An addition value of the color difference signal is calculated S23, and a distance in the color space is calculated S24. A differential value of a luminance signal is calculated S25. The distance of the color difference signal differential value, the distance of the color difference signal addition value and the distance of the luminance signal differential value are used to determine whether it is a false color generation region S26. The presence/absence of a false color is detected S27.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an image detection range setting device that sets an image degradation detection range in an image, an image detection range setting method, an image detection range setting program, and an image detection device that detects image degradation in an image.

  It is known that when a subject including a high frequency component equal to or higher than the pixel pitch of the image sensor is picked up, moire such as false color (color moire) is generated and the captured image is deteriorated. Therefore, various techniques for removing this type of false color have been proposed. For example, Patent Document 1 describes a specific configuration of a photographing apparatus capable of detecting a false color generated in a photographed image.

  The imaging device described in Patent Document 1 captures an in-focus subject, and then captures an out-of-focus subject. In the out-of-focus photographed image, the contrast of the subject is reduced and high-frequency components are reduced, so that the false color generated in the in-focus photographed image is also reduced. Therefore, the imaging device described in Patent Document 1 divides each captured image in the in-focus state and the out-of-focus state into a plurality of blocks, calculates a difference value of the color difference signal for each of the divided blocks, and calculates the difference value. A large block is detected as a block in which a false color is generated.

JP 2011-109496 A

  As described above, in the photographing apparatus described in Patent Literature 1, in order to detect a false color, the difference value of the color difference signal is calculated over the entire area of the image. Therefore, it is pointed out that it takes time to detect false colors.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image detection range setting device, an image detection range setting method, and an image detection range that are suitable for reducing the time taken to detect image degradation. To provide a setting program and an image detection apparatus.

  An image detection range setting device according to an embodiment of the present invention includes a focus area detection unit that detects at least one focus area based on focus information in an image, and a detection range of image degradation that occurs in the image. Detection range setting means for setting a predetermined range with reference to each focus area detected by the focus area detection means.

  According to one embodiment of the present invention, the detection range of image degradation is set not to the entire image area but to a predetermined range based on a focused area where image degradation is likely to occur. Therefore, the detection processing speed of image deterioration is improved while maintaining the detection accuracy of image deterioration.

  In one embodiment of the present invention, the image degradation detection range includes, for example, a reference focusing area and a predetermined peripheral area surrounding the focusing area.

  In addition, an image detection range setting device according to an embodiment of the present invention includes an operation unit that accepts an operation of a scanner, and a detection range change unit that changes the detection range of image degradation according to the accepted operation of the operator. It is good also as a structure.

  In one embodiment of the present invention, the detection range changing means may be configured to change the size of the detection range in accordance with the operation of the operator with respect to the center of the reference focus area or the center of the detection range. .

  Further, in one embodiment of the present invention, the shape of the image degradation detection range maintains a similar shape before and after the size change by the detection range changing unit, for example.

  In addition, the image detection range setting device according to an embodiment of the present invention may be configured to include an index display unit that displays an index indicating the size of the image degradation detection range. The index display means changes the display of the index according to, for example, a change in the size of the image degradation detection range.

  An image detection apparatus according to an embodiment of the present invention includes the above-described image detection range setting device and an image detection unit that detects image deterioration in the detection range set by the image detection range setting device.

  In one embodiment of the present invention, the image detection unit may acquire at least a pair of images having different imaging conditions and detect image deterioration in a detection range based on the acquired paired images. Good.

  In one embodiment of the present invention, the image detection unit determines a focus area where the same subject is captured between the pair of images, and a detection range based on the determined focus area where the same subject is captured. It is good also as a structure which detects the image degradation based on the image which becomes a pair about.

  In one embodiment of the present invention, the image detection unit may be configured to perform a predetermined threshold determination based on a pair of images and to detect image degradation based on a result of the threshold determination. In this configuration, the threshold value may be changeable according to the operation of the operator.

  An image detection range setting method according to an embodiment of the present invention includes a step of detecting at least one focus area based on focus information in an image, and a detection range of image degradation occurring in the image. And a detection range setting step for setting a predetermined range with each focused area as a reference.

  An image detection range setting program according to an embodiment of the present invention is for causing a computer to execute the above-described image detection range setting method.

  According to an embodiment of the present invention, there are provided an image detection range setting device, an image detection range setting method, an image detection range setting program, and an image detection device that are suitable for reducing the time taken to detect image degradation.

It is a block diagram which shows the structure of the imaging device of embodiment of this invention. 1 is a diagram schematically illustrating a configuration of an image shake correction apparatus provided in an imaging apparatus according to an embodiment of the present invention. 1 is a diagram schematically illustrating a configuration of an image shake correction apparatus provided in an imaging apparatus according to an embodiment of the present invention. It is a figure which assists description of the LPF drive in embodiment of this invention. It is a figure which shows the false color detection flow by the system controller in embodiment of this invention. It is a figure regarding the to-be-photographed object image | photographed in embodiment of this invention. It is a figure regarding the to-be-photographed object image | photographed in embodiment of this invention. It is a figure which shows each color difference signal plotted in the color space of embodiment of this invention. FIG. 9A shows a subject to be photographed in the embodiment of the present invention (FIG. 9A), and FIG. 9B and FIG. 9C show a live view displayed on a display screen of an LCD provided in the photographing apparatus. )). It is a figure which shows the false color detection object pixel used as the object of false color detection in embodiment of this invention.

  Hereinafter, a photographing apparatus according to an embodiment of the present invention will be described with reference to the drawings. In the following, a digital single lens reflex camera will be described as an embodiment of the present invention. Note that the photographing apparatus is not limited to a digital single lens reflex camera, but includes, for example, a mirrorless single lens camera, a compact digital camera, a video camera, a camcorder, a tablet terminal, a PHS (Personal Handy phone System), a smartphone, a feature phone, a portable game machine, and the like. The apparatus may be replaced with another type of apparatus having a photographing function.

[Configuration of the entire photographing apparatus 1]
FIG. 1 is a block diagram showing a configuration of the photographing apparatus 1 of the present embodiment. As shown in FIG. 1, the photographing apparatus 1 includes a system controller 100, an operation unit 102, a drive circuit 104, a photographing lens 106, a diaphragm 108, a shutter 110, an image shake correction device 112, a signal processing circuit 114, and an image processing engine 116. , Buffer memory 118, card interface 120, LCD (Liquid Crystal Display) control circuit 122, LCD 124, ROM (Read Only Memory) 126, gyro sensor 128, acceleration sensor 130, geomagnetic sensor 132, and GPS (Global Positioning System) sensor 134 It has. Although the photographing lens 106 has a plurality of lenses, it is shown as a single lens for convenience in FIG. Further, the same direction as the optical axis AX of the photographing lens 106 is defined as the Z-axis direction, and the two axial directions orthogonal to the Z-axis direction and orthogonal to each other are the X-axis direction (horizontal direction) and the Y-axis direction (vertical direction), respectively. It is defined as

  The operation unit 102 includes various switches necessary for the user to operate the photographing apparatus 1, such as a power switch, a release switch, and a photographing mode switch. When the user operates the power switch, power is supplied from the battery (not shown) to the various circuits of the photographing apparatus 1 through the power line.

  The system controller 100 includes a CPU (Central Processing Unit) and a DSP (Digital Signal Processor). After supplying power, the system controller 100 accesses the ROM 126, reads out a control program, loads it into a work area (not shown), and executes the loaded control program to control the entire photographing apparatus 1.

  When the release switch is operated, the system controller 100 detects, for example, a photometric value calculated based on an image captured by a solid-state imaging device 112a (see FIG. 2 described later) or an exposure meter built in the photographing apparatus 1. The diaphragm 108 and the shutter 110 are driven and controlled via the drive circuit 104 so that proper exposure is obtained based on the photometric value measured in (not shown). More specifically, drive control of the aperture 108 and the shutter 110 is performed based on an AE function designated by a shooting mode switch such as a program AE (Automatic Exposure), shutter priority AE, aperture priority AE, and the like. Further, the system controller 100 performs AF (Autofocus) control together with AE control. For AF control, an active method, a phase difference detection method, an image plane phase difference detection method, a contrast detection method, or the like is applied. The AF mode includes a multi-point distance measurement mode using a plurality of distance measurement areas, a full-screen distance measurement mode based on distance information on the entire screen, and the like. The system controller 100 controls driving of the photographing lens 106 via the driving circuit 104 based on the AF result, and adjusts the focus of the photographing lens 106. Since the configuration and control of this type of AE and AF are well known, detailed description thereof is omitted here.

  2 and 3 are diagrams schematically showing a configuration of the image blur correction device 112. FIG. As shown in FIGS. 2 and 3, the image blur correction device 112 includes a solid-state image sensor 112a. The light beam from the subject passes through the photographing lens 106, the diaphragm 108, and the shutter 110, and is received by the light receiving surface 112aa of the solid-state imaging device 112a. Note that the light receiving surface 112aa of the solid-state imaging device 112a is an XY plane including the X axis and the Y axis. The solid-state imaging device 112a is a single-plate color CCD (Charge Coupled Device) image sensor having a color filter with a Bayer pixel arrangement as a transmission wavelength selection device. The solid-state imaging device 112a accumulates an optical image formed by each pixel on the light receiving surface 112aa as a charge corresponding to the amount of light, and generates R (Red), G (Green), and B (Blue) image signals. Output. Note that the solid-state imaging device 112a is not limited to a CCD image sensor, and may be replaced with a complementary metal oxide semiconductor (CMOS) image sensor or other types of imaging devices. The solid-state imaging device 112a may be a filter having a complementary color filter, or a filter having a periodic color arrangement such as a Bayer arrangement if any color filter is arranged for each pixel. There is no need.

  The signal processing circuit 114 performs predetermined signal processing such as clamping and demosaicing (color interpolation) on the image signal input from the solid-state imaging device 112 a and outputs the processed signal to the image processing engine 116. The image processing engine 116 performs predetermined signal processing such as matrix operation, Y / C separation, and white balance on the image signal input from the signal processing circuit 114 to generate a luminance signal Y and color difference signals Cb and Cr. , And compressed in a predetermined format such as JPEG (Joint Photographic Experts Group). The buffer memory 118 is used as a temporary storage location for processing data when the image processing engine 116 executes processing. The captured image storage format is not limited to the JPEG format, and may be a RAW format in which minimal image processing (for example, clamping) is performed.

  A memory card 200 is detachably inserted into a card slot of the card interface 120.

  The image processing engine 116 can communicate with the memory card 200 via the card interface 120. The image processing engine 116 stores the generated compressed image signal (captured image data) in the memory card 200 (or a built-in memory (not shown) provided in the image capturing apparatus 1).

  Further, the image processing engine 116 buffers the generated luminance signal Y and color difference signals Cb and Cr in a frame memory (not shown) in units of frames. The image processing engine 116 sweeps the buffered signal from each frame memory at a predetermined timing, converts it into a video signal of a predetermined format, and outputs it to the LCD control circuit 122. The LCD control circuit 122 modulates and controls the liquid crystal based on the image signal input from the image processing engine 116. Thereby, the photographed image of the subject is displayed on the display screen of the LCD 124. The user can view through a display screen of the LCD 124 a real-time through image (live view) captured with appropriate brightness and focus based on AE control and AF control.

  When the user performs a reproduction operation of the photographed image, the image processing engine 116 reads the photographed image data designated by the operation from the memory card 200 or the built-in memory, converts it into an image signal of a predetermined format, and the LCD control circuit 122. Output to. The LCD control circuit 122 performs modulation control on the liquid crystal based on the image signal input from the image processing engine 116, so that a captured image of the subject is displayed on the display screen of the LCD 124.

[Explanation regarding the drive of the shake correction member]
The image shake correction device 112 drives a shake correction member. In the present embodiment, the shake correction member is the solid-state image sensor 112a. Note that the shake correction member is not limited to the solid-state image sensor 112a, but is partially moved with respect to the optical axis AX, such as a part of lenses included in the photographing lens 106, so that the light-receiving surface 112aa of the solid-state image sensor 112a. Another configuration capable of shifting the incident position of the subject image above may be used, or a configuration in which two or more members of these and the solid-state imaging device 112a are combined may be used.

  The image blur correction device 112 not only slightly drives (vibrates) the blur correction member in a plane orthogonal to the optical axis AX (that is, in the XY plane) in order to correct the image blur. The shake correction member is driven minutely in a plane orthogonal to the optical axis AX so that an optical low pass filter (LPF) effect (reduction of moiré such as false color) can be obtained. Rotate). Hereinafter, for convenience of description, driving the shake correction member with image shake correction is referred to as “image shake correction drive”, and driving the shake correction member so as to obtain the same effect as an optical LPF is referred to as “LPF”. "Drive".

(Explanation on image blur correction drive)
The gyro sensor 128 is a sensor that detects information for controlling image blur correction. Specifically, the gyro sensor 128 detects angular velocities around the two axes (around the X axis and around the Y axis) applied to the imaging apparatus 1, and the detected angular velocities around the two axes are within the XY plane (in other words, a solid state This is output to the system controller 100 as a shake detection signal indicating the shake of the light receiving surface 112aa of the image sensor 112a.

  As shown in FIGS. 2 and 3, the image blur correction device 112 includes a fixed support substrate 112 b fixed to a structure such as a chassis included in the photographing device 1. The fixed support substrate 112b slidably supports the movable stage 112c on which the solid-state imaging device 112a is mounted.

Magnets M _YR , M _YL , M _XD , and M _XU are attached on the surface of the fixed support substrate 112 b facing the movable stage 112 c. In addition, yokes Y _YR , Y _YL , Y _XD , and Y _{XU that} are magnetic bodies are attached to the fixed support substrate 112b. The yokes Y _YR , Y _YL , Y _XD , and Y _XU each have a shape that extends from the fixed support substrate 112 b to the position facing the magnets M _YR , M _YL , M _XD , and M _XU around the movable stage 112 c, A magnetic circuit is formed between the magnets M _YR , M _YL , M _XD , and M _XU . In addition, driving coils C _YR , C _YL , C _XD , and C _XU are attached to the movable stage 112c. When the driving coils C _YR , C _YL , C _XD , and C _XU receive a current in the magnetic field of the magnetic circuit, a driving force is generated. The movable stage 112c (solid-state imaging device 112a) is minutely driven in the XY plane with respect to the fixed support substrate 112b by the generated driving force.

Corresponding magnets, yokes and driving coils constitute a voice coil motor. Hereinafter, for the sake of convenience, a reference numeral VCM _YR is given to a voice coil motor made up of a magnet M _YR , a yoke Y _YR and a driving coil C _YR , and a voice coil motor made up of a magnet M _YL , a yoke Y _YL and a driving coil C _YL is called up. given the VCM _YL, a voice coil motor reference numeral _{VCM XD} magnet _{M XD,} the voice coil motor consisting of a yoke _{Y XD} and the driving coil _{C XD,} consisting of the magnet _{M XU,} yoke _{Y XU} and the driving coil _{C XU} The symbol VCM _XU is appended.

Each voice coil motor VCM _YR , VCM _YL , VCM _XD , VCM _XU (driving coils C _YR , C _YL , C _XD , C _XU ) is PWM (Pulse Width Modulation) driven under the control of the system controller 100. The voice coil motors VCM _YR and VCM _YL are arranged below the solid-state image sensor 112a and arranged side by side with a predetermined interval in the horizontal direction (X-axis direction). The voice coil motors VCM _XD and VCM _XU are On the side of the solid-state image sensor 112a, they are arranged side by side with a predetermined interval in the vertical direction (Y-axis direction).

Hall elements H _YR , H _YL , H _XD , and H _XU are attached to the positions near the driving coils C _YR , C _YL , C _XD , and C _XU on the fixed support substrate 112b. The Hall elements H _YR , H _YL , H _XD , and H _XU detect the magnetic _forces of the magnets M _YR , M _YL , M _XD , and M _XU , respectively, and the position of the movable stage 112 c (solid-state imaging element 112 a) in the XY plane. Is output to the system controller 100. Specifically, the Y-axis direction position and tilt (rotation) of the movable stage 112c (solid-state imaging device 112a) are detected by the Hall elements H _YR and H _YL , and the movable stage 112c (solid-state imaging) is detected by the Hall elements H _XD and H _XU. The X-axis direction position and inclination (rotation) of the element 112a) are detected.

The system controller 100 includes a driver IC for a voice coil motor. The system controller 100 determines the rated power (allowable power) of the driver IC based on the shake detection signal output from the gyro sensor 128 and the position detection signal output from the Hall elements H _YR , H _YL , H _XD , and H _XU. Calculate the duty ratio so as not to disturb the balance of the currents flowing through the voice coil motors VCM _YR , VCM _YL , VCM _XD , VCM _XU (drive coils C _YR , C _YL , C _XD , C _XU ) within the range not exceeding To do. The system controller 100 sends a drive current to each of the voice coil motors VCM _YR , VCM _YL , VCM _XD , and VCM _XU with the calculated duty ratio to drive the solid-state imaging device 112 a with image blur correction. As a result, the image blur on the light receiving surface 112aa of the solid-state image sensor 112a is corrected while the solid-state image sensor 112a is held at a predetermined position against gravity, disturbance, or the like (in other words, on the light receiving surface 112aa). The position of the solid-state imaging device 112a is adjusted so that the incident position of the subject image does not fluctuate.

(Explanation regarding LPF drive)
Next, the LPF driving will be described. In the present embodiment, the image blur correction device 112 causes a predetermined drive current to flow through the voice coil motors VCM _YR , VCM _YL , VCM _XD , and VCM _XU , so that the image shake correction device 112 is predetermined in the XY plane for one exposure period. The movable stage 112c (solid-state image sensor 112a) is driven so as to draw a trajectory, and the subject image is incident on a plurality of pixels having different detection colors (R, G, or B) of the solid-state image sensor 112a. Thereby, the same effect as an optical LPF can be obtained.

  4 (a) and 4 (b) are diagrams for assisting the description of the LPF drive. As shown in the figure, on the light receiving surface 112aa of the solid-state imaging device 112a, a plurality of pixels PIX are arranged in a matrix at a predetermined pixel pitch P. For convenience of explanation, each pixel PIX in the figure is given a reference (any one of R, G, and B) corresponding to the filter color arranged on the front surface.

  FIG. 4A shows an example in which the solid-state imaging device 112a is driven so as to draw a square locus centered on the optical axis AX. For example, the square locus can be a square closed path with the pixel pitch P of the solid-state imaging element 112a as one side. In the example of FIG. 4A, the solid-state imaging device 112a is driven so as to form a square path alternately in units of one pixel pitch P in the X-axis direction and the Y-axis direction.

  FIG. 4B shows an example in which the solid-state imaging device 112a is driven to draw a rotationally symmetric circular locus centering on the optical axis AX. This circular locus can be a closed circular path having a radius r of √2 / 2 times the pixel pitch P of the solid-state image sensor 112a, for example.

  Note that information on the driving locus including the pixel pitch P is stored in advance in the internal memory of the system controller 100 or the ROM 126.

  As illustrated in FIG. 4A (or FIG. 4B), during the exposure period, the solid-state imaging device 112a is driven to draw a predetermined square locus (or circular locus) based on the information of the drive locus. Then, the subject image is uniformly incident on the four color filters R, G, B, and G (four (two rows and two columns) pixels PIX). Thereby, an effect equivalent to that of an optical LPF can be obtained. In other words, since the subject image incident on any color filter (pixel PIX) is necessarily incident on the surrounding color filter (pixel PIX), the same effect as when the subject image passes through the optical LPF. (Reduction of moiré such as false color) is obtained.

  Note that the user can switch on / off of image blur correction driving and LPF driving by operating the operation unit 102.

[Explanation about false color detection]
Next, a method for detecting a false color, which is a kind of moire, that occurs in a captured image in the present embodiment will be described. FIG. 5 shows a false color detection flow executed by the system controller 100. The false color detection flow shown in FIG. 5 is started when the release switch is pressed, for example.

[S11 in FIG. 5 (state determination)]
In this processing step S11, it is determined whether or not the photographing apparatus 1 is in a stationary state. Illustratively, when the amplitude of a signal component having a frequency equal to or higher than a certain frequency among the vibration detection signals input from the gyro sensor 128 is within a certain threshold continuously for a certain period, it is determined to be in a stationary state. A typical example of the stationary state of the photographing apparatus 1 is a state in which the photographing apparatus 1 is fixed to a tripod. Note that the posture of the photographing apparatus 1 including the stationary state may be detected using information output from other sensors such as the acceleration sensor 130, the geomagnetic sensor 132, and the GPS sensor 134 instead of the gyro sensor 128. In order to improve the detection accuracy, for example, sensor fusion technology may be applied so that information output from these sensors may be used in combination.

  When the photographing apparatus 1 is not in a stationary state, such as a hand-held photographing state with a low shutter speed setting, a false color is unlikely to occur in the first place due to blurring of the subject due to camera shake (or subject shake). Therefore, in this embodiment, only when it is determined that the photographing apparatus 1 is in a stationary state (that is, in a state in which false color is likely to occur) (S11: YES), the false color in the photographed image is detected. Therefore, processing step S12 (photographing of the first image) and subsequent steps are executed. When the photographing apparatus 1 is not in a stationary state, the processing load of the system controller 100 is reduced because the processing step S12 (first image photographing) and subsequent steps are not executed. The photographer may be notified, for example, via the display screen of the LCD 124 that the processing step S12 (photographing the first image) and subsequent steps are not executed. Note that, when it is important to detect the false color in the photographed image, the processing step S12 (photographing the first image) and subsequent steps may be executed regardless of whether or not the photographing apparatus 1 is in a stationary state. In this case, the photographer may be notified through the display screen of the LCD 124 that the processing step S12 (photographing the first image) and subsequent steps are executed. Further, the determination threshold value for the still state may be changed according to the shutter speed set in the photographing apparatus 1.

[S12 in FIG. 5 (capturing the first image)]
FIG. 9A shows the entire subject to be photographed. 6 (a) and 7 (a) are a part of the subject shown in FIG. 9 (a) (for example, wrinkles of clothes worn by a person), each of which is enlarged. FIG. The subject shown in FIG. 6A is an oblique stripe pattern in which light and dark appear alternately at the same pitch as the pixel pitch P of the pixel PIX of the solid-state image sensor 112a. The subject shown in FIG. It is a vertical stripe pattern in which light and dark appear alternately at the same pitch as P. For convenience of explanation, a 6 × 6 square subject surrounded by a thick solid line among the subjects shown in FIG. 6A is referred to as “obliquely striped subject 6a”, and a thick solid line among the subjects shown in FIG. 7A. The subject of 6 × 6 square surrounded by is denoted as “vertical stripe subject 7a”.

  In this processing step S12, a subject image (first image) is taken with appropriate brightness and focus based on AE control and AF control. Here, it is assumed that both the diagonally striped subject 6a and the vertically striped subject 7a are in focus.

  FIGS. 6B and 7B are diagrams schematically showing the oblique stripe subject 6a and the vertical stripe subject 7a taken into each pixel PIX of the solid-state image sensor 112a, respectively, and the light receiving surface 112aa of the solid-state image sensor 112a. Is a front view from the subject side. In FIG. 6B and FIG. 7B, as in FIG. 4, each pixel PIX is assigned a code (any one of R, G, and B) corresponding to the filter color arranged on the front surface. . In each of FIGS. 6B and 7B, the black pixel PIX indicates that the dark portion of the striped pattern has been captured, and the white pixel PIX has captured the bright portion of the striped pattern. It shows that. For convenience of explanation, pixel addresses (numerals 1 to 8, symbols 1 to 1) are attached to the diagrams of FIGS. 6B and 7B. Strictly speaking, the subject is imaged on the solid-state imaging device 112a by the imaging action of the photographic lens 106 in a state where the subject is turned upside down. As an example, the upper left corner portion of the “obliquely striped subject 6a” forms an image as the lower right corner portion on the solid-state imaging device 112a. However, in this embodiment, in order to avoid complication of explanation, the upper left corner portion of the “obliquely striped subject 6a” is described as corresponding to the upper left corner portion of FIG.

[S13 in FIG. 5 (saving first focus area information)]
FIG. 9B illustrates a live view displayed on the display screen of the LCD 124 when the first image is captured in the processing step S12 (capturing the first image). The system controller 100 is a range that can be regarded as in focus on the basis of the AF result (focus information in the image) when the first image is captured. And the detected focus area (in the example of FIG. 9B, symbols FA1 to FA7) is displayed on the live view by OSD (On Screen Display). In this processing step S13, information on the focus area at the time of shooting the first image (hereinafter referred to as “first focus area information”) is stored in the internal memory of the system controller 100, for example.

[S14 in FIG. 5 (shift of the solid-state imaging device 112a)]
In this processing step S14, the movable stage 112c is driven, and the solid-state imaging device 112a is shifted rightward (the direction of the arrow on the X axis in FIG. 6) by a distance of one pixel.

[S15 in FIG. 5 (Taking Second Image)]
Also in this processing step S15, the subject image (second image) is captured based on the AE control and AF control at the time of capturing the first image. After the second image is captured, the photographer may be notified that the false color detection process using the first image and the second image is to be started.

  6 (c) and 7 (c) are similar to FIGS. 6 (b) and 7 (b), respectively, and the diagonally striped subject 6a and the vertically striped subject captured by each pixel PIX of the solid-state imaging device 112a. 7a is shown schematically. As shown in FIGS. 6B and 7B, the incident position of the subject image on the light receiving surface 112aa of the solid-state image sensor 112a is determined by processing step S14 (shift of the solid-state image sensor 112a). Is shifted by a distance corresponding to one pixel in the left direction on the light receiving surface 112aa.

  In addition, the shooting conditions in this processing step S15 are other than that the solid-state imaging device 112a is shifted to the right by a distance of one pixel with respect to the shooting in the processing step S12 (first image shooting). Are the same. For this reason, the second image is substantially a photograph of a range shifted to the right by one pixel with respect to the first image. As can be seen from FIGS. 6B and 7B, in the second image, the subject is shifted to the left by a distance of one pixel as a whole with respect to the first image. It is reflected.

[S16 in FIG. 5 (saving second focus area information)]
FIG. 9C illustrates a live view displayed on the display screen of the LCD 124 when the second image is captured in the processing step S15 (second image capturing). The system controller 100 detects the in-focus area based on the AF result (in-focus information in the image) at the time of capturing the second image, and in the example of FIG. FA1 ′ to FA7 ′) are displayed on the live view by OSD. In this processing step S16, information on the in-focus area at the time of shooting the second image (hereinafter referred to as “second in-focus area information”) is stored in the internal memory of the system controller 100, for example.

  The signal processing (clamping) of the first image taken in the processing step S12 (photographing the first image) and the second image taken in the processing step S15 (photographing the second image) are both described above. , Demosaic, matrix calculation, Y / C separation, white balance, etc.), and converted into a luminance signal Y and color difference signals Cb, Cr. Hereinafter, for convenience of explanation, the color difference signals (Cb, Cr) of the first image captured in the processing step S12 (capturing the first image) will be referred to as “first color difference signals”, and the processing step S15 (the second image of the second image). The color difference signals (Cb, Cr) of the second image taken in (shooting) are referred to as “second color difference signals”. The “target pixel” refers to a pixel of each image after at least demosaic processing.

[S17 in FIG. 5 (electrical LPF processing)]
In the present embodiment, although described in detail later, the occurrence of false colors is detected based on the signal difference value or signal addition value between the first color difference signal and the second color difference signal. However, at the edge portion with high contrast, the signal difference value between the first color difference signal and the second color difference signal may be large even if a false color is not generated. In this case, there is a risk of false detection that a false color has occurred in the edge portion. As will be described in detail later, the first color difference signal and the second color difference signal used for the calculation of the signal difference value and the signal addition value are the color difference signals of the pixels that capture the same subject image. Due to the fact that the solid-state image sensor 112a is shifted by the shift of the image sensor 112a), demosaic processing is performed using pixels having different addresses. For this reason, the first color difference signal and the second color difference signal may be slightly different in color information even though they are color difference signals of pixels that capture the same subject image. Therefore, in this processing step S17, LPF processing is performed on the image signal (luminance signal Y, color difference signals Cb, Cr). By blurring the image by the LPF processing, false detection of false colors at the edge portion is suppressed, and errors in color information between the first color difference signal and the second color difference signal are suppressed.

[S18 in FIG. 5 (address conversion)]
In this processing step S18, in order to improve the false color detection accuracy, the image is captured in processing step S15 (second image capturing) so that the same subject image is processed as being incident on the pixel having the same address. The address of each pixel constituting the second image is the shift amount of the solid-state image sensor 112a in processing step S14 (shift of the solid-state image sensor 112a) (in other words, the subject image on the light receiving surface 112aa of the solid-state image sensor 112a). Of the incident position).

  As an example, the address (c, 2) of the pixel PIXb in FIG. 6C is the same as the pixel that is located when the pixel PIXb is shifted by one pixel in the right direction according to the shift amount of the incident position of the subject image, that is, the pixel PIXb. Is converted to the same address (d, 2) as the pixel PIXa (see FIG. 6B) for capturing the subject image.

[S19 in FIG. 5 (Pairing the in-focus area)]
In this processing step S19, based on the first and second focusing area information, the focusing area at the time of shooting the first image in the processing step S12 (shooting the first image) (here, FIG. 9B). ) And the focusing area at the time of shooting the second image in the processing step S15 (shooting the second image) (here, the focusing area FA1 ′ shown in FIG. 9C). To FA7 ′). Specifically, an in-focus area in which a common (identical) subject image is captured between the in-focus areas FA1 to FA7 and the in-focus areas FA1 ′ to FA7 ′ is determined, and the determined common subject image is captured. The focal areas are paired. More specifically, a pair of in-focus areas including a predetermined number or more of pixels in which a common subject image is captured between the in-focus areas is paired as a focus area in which the same subject image is captured.

  In the example of FIGS. 9B and 9C, the focusing areas FA1 and FA1 ′ are paired, the focusing areas FA2 and FA2 ′ are paired, and the focusing areas FA3 and FA3 ′ are paired. The focusing areas FA4 and FA4 ′ are paired, and the focusing areas FA5 and FA5 ′ are paired.

[S20 in FIG. 5 (setting of false color detection target pixel)]
In this processing step S20, a pixel to be subjected to false color detection (hereinafter referred to as “false color detection target pixel”) is set based on the pairing result in processing step S19 (pairing of the in-focus area). . FIG. 10 illustrates a false color detection target pixel. In FIG. 10, a broken-line rectangular area is a focusing area, and a solid-line rectangular area surrounding the focusing area is a false color detection range in which a false color is detected. Pixels included in this false color detection range are false color detection target pixels. That is, in the example of FIG. 10, each pixel in the focusing areas FA1 to FA5 and each focusing area FA1 paired with the focusing areas FA1 ′ to FA5 ′ in the processing step S19 (pairing of the focusing area). A predetermined number of peripheral pixels (hereinafter referred to as “false-color detection target pixels of the first image”) surrounding the FA 5, and pixels (hereinafter referred to as “false-color detection target pixels of the first image” in the second image). "Described as a false color detection target pixel of the second image") is set as the false color detection target pixel.

  In general, in-focus subjects often have high contrast and contain high frequency components. Therefore, false colors are likely to occur in a focused subject. On the other hand, subjects that are out of focus have low contrast and few high frequency components. Therefore, a false color is unlikely to occur in an out-of-focus subject. Therefore, in the present processing step S20, the false color detection target pixels are not all effective pixels, but are narrowed down to the in-focus area and the surrounding pixels where the false color is highly likely to occur. As a result, the false color detection processing speed is improved while the false color detection accuracy is maintained.

  In the in-focus area where the same (same) subject image is not captured with the other in-focus area (that is, the in-focus area that has not been paired), the in-focus state is the same as in the other image shooting. It is likely that it has changed. There is a high possibility that the subject in such an in-focus area is imaged in a state where the image is shaken when the other image is captured. Therefore, in each pixel in such an in-focus area, the signal difference value between the first color difference signal and the second color difference signal becomes large even if no false color has occurred, and it is erroneously assumed that a false color has occurred. There is a risk of detection. Therefore, in this processing step S20, each pixel in such an in-focus area is excluded from the false color detection target pixels. This improves the false color detection accuracy.

  Note that the user can change the shape and size of the false color detection range based on each focus area and finely adjust the position by operating the operation unit 102. Illustratively, the false color detection range is only the size while maintaining the shape (maintaining a similar shape) with respect to the center of the reference focus area or the center of the false color detection range according to the operation by the user. Is changed. Further, the size of the false color detection range may be changed so as to preferentially expand toward the inside of the display screen of the LCD 124 while maintaining the shape. In addition, the predetermined range located near the center of the display screen (or image) of the LCD 124 may be always set to a false color detection range regardless of whether or not it is an in-focus area. Further, the false color detection range corresponding to the in-focus area including the subject near the center of the display screen (or image) of the LCD 124 is preferentially enlarged with respect to other false color detection ranges (enlargement with respect to the operation amount). The size may be changed (with the rate set larger than the other false color detection range). In addition, the size of the false color detection range is changed so that the area corresponding to the in-focus area including the subject close to the distance is preferentially enlarged (after the enlargement ratio with respect to the operation amount is set large). Also good.

  As the false color detection range is expanded, false colors are detected over a wide range, so the false color detection accuracy is improved. As the false color detection range is narrowed, the number of false color detection target pixels is reduced. The detection processing speed is improved. As shown in FIGS. 9 and 10, a frame size adjustment bar B <b> 1 is displayed as an OSD in the live view. The display of the frame size adjustment bar B1 changes according to the amount of change operation of the false color detection range by the user (size of the false color detection range). The user can grasp through the frame size adjustment bar B1 whether the current false color detection range is large (that is, detection accuracy is important) or small (that is, detection speed is important).

[S21 in FIG. 5 (Calculation of Difference Value of Color Difference Signal)]
The oblique stripe subject 6a and the vertical stripe subject 7a include a high-frequency component having the same pitch as the pixel pitch P of the pixel PIX of the solid-state image sensor 112a. Therefore, when the image signals of the diagonally striped subject 6a and the vertically striped subject 7a are demosaiced in the processing step S12 (first image capturing) and the processing step S15 (second image capturing), a false color is generated.

  Specifically, in the example of FIG. 6B, the luminance of the G component pixel PIX is high, and the luminance of the R and B component pixels PIX is low. Therefore, the G component is dominant in the color information of each pixel PIX after the demosaic process, and a green false color is generated in the diagonally striped subject 6a. On the other hand, in the example of FIG. 6C, the luminance of the R and B component pixels PIX is high and the luminance of the G component pixel PIX is low, contrary to the example of FIG. 6B. Therefore, the R and B components are dominant in the color information of each pixel PIX after the demosaic process, and a purple false color is generated in the diagonally striped subject 6a.

  In the example of FIG. 7B, the luminance of the B component pixel PIX is high and the luminance of the R component pixel PIX is low. Therefore, the color information of each pixel PIX after the demosaic processing becomes a mixed color component of B and G, and a false color of an intermediate color between blue and green (for example, a color near the cyan color center) is generated. On the other hand, in the example of FIG. 7C, the luminance of the R component pixel PIX is high and the luminance of the B component pixel PIX is low, contrary to the example of FIG. 7B. Therefore, the color information of each pixel PIX after the demosaic processing becomes a mixed color component of R and G, and a false color of an intermediate color between red and green (a color near the orange center) is generated.

FIG. 8 shows a color space defined by two axes of Cb and Cr. In FIG. 8, reference numeral 6b is a plot corresponding to the green false color generated at the target pixel in the example of FIG. 6B, and reference numeral 6c is a purple color generated at the target pixel in the example of FIG. 6C. 7b is a plot corresponding to a false color of an intermediate color between blue and green generated in the target pixel in the example of FIG. 7B, and reference numeral 7c is a plot corresponding to FIG. It is a plot corresponding to the false color of the intermediate color of red and green generated in the target pixel in the example of c). The following shows the coordinate information of each plot. The origin O is the coordinates (0, 0).
Plot 6b: (Cb, Cr) = (− M, −N)
Plot 6c: (Cb, Cr) = (M, N)
Plot 7b: (Cb, Cr) = (M ′, −N ′)
Plot 7c: (Cb, Cr) = (− M ′ + α, N ′ + β)
However, all of M, N, M ′, N ′, α, and β are positive numbers.

  As shown in FIG. 8, in the present embodiment, the false color itself that is generated when a subject image having a high frequency component equivalent to the pixel pitch P of the pixel PIX of the solid-state image sensor 112a is captured is the light receiving surface 112aa. A portion (a pixel of interest) where a false color is generated is detected by utilizing the change by shifting the incident position of the subject image above. More specifically, in a pixel of interest in which a high-frequency component subject image is captured, a portion in which the color information of the first color difference signal and the second color difference signal has a complementary color relationship is determined to be a portion where a false color is generated. It is detected.

  In the present embodiment, in order to obtain the above complementary color relationship, the incident position of the subject image on the light receiving surface 112aa is shifted by one pixel in the left direction (horizontal pixel arrangement direction) (the solid-state imaging device 112a is shifted from the subject image). However, the present invention is not limited to this. For example, the shift direction may be the right direction (horizontal pixel arrangement direction), or the upper direction (vertical pixel arrangement direction), the lower direction (vertical pixel arrangement direction), or the upper right direction. , Lower right, upper left, lower left diagonal directions (directions forming 45 degrees with respect to horizontal and vertical arrangement directions), or other directions according to the pixel arrangement may be used together. . In addition, the shift distance may be, for example, a distance corresponding to another odd pixel such as 3 pixels or 5 pixels, or a half pixel or a half pixel plus an odd pixel (for example, 1.. 5 pixels, 2.5 pixels, etc.) (ie, n pixels or (m + 0.5) pixels (where n = odd natural number, m = 0 or odd natural number) However, it can be selected according to the accuracy of the mechanism for shift driving. Further, the shift distance may be a distance other than the even number of pixels and the vicinity thereof (for example, 1.9 to 2.1 pixels) depending on the subject to be photographed and the photographing conditions. Even when the incident position of the subject image on the light receiving surface 112aa is shifted by these amounts (direction and distance), the first color difference signal is obtained at the target pixel in which the subject image of the high frequency component is captured (false color is generated). Since the color information of the second color difference signal and the second color difference signal are complementary to each other, the occurrence of false color can be detected.

In this processing step S21, the difference value (Cb) between the first color difference signal and the second color difference signal for each false color detection target pixel having the same address set in processing step S20 (setting of the false color detection target pixel). _sub , Cr _sub ) is calculated. Specifically, in this processing step S21, Cb and Cr of the first color difference signal are defined as Cb1 and Cr1, respectively, and Cb and Cr of the second color difference signal of the same address are defined as Cb2 and Cr2, respectively. In addition, the difference value (Cb _sub , Cr _sub ) is calculated by the following equation.
Cb _sub = Cb1-Cb2
Cr _sub = Cr1-Cr2

[S22 in FIG. 5 (Calculation of First Distance Information)]
In this processing step S22, for each false color detection target pixel having the same address set in processing step S20 (false color detection target pixel setting), within the color space of the first color difference signal and the second color difference signal. distance (first distance information Saturation_ _sub) is calculated by the following equation.
^{_{Saturation_ sub = √ (Cb sub 2}} + Cr sub 2)

The first distance information Saturation_ _sub are each an example of each plot pair of FIG. 8 (plot 6b and plot 6c, plots 7b and plot ^{7c), 2√ (M 2 +} N 2), √ {(- 2M '+ α) ² + (2N ′ + β) ² }.

As understood from the positional relationship of each plot pair of FIG. 8, as the color information with the first color difference signal and a second color difference signal is strong complementary relationship first distance information Saturation_ _sub increases, first color difference signal and the color information having the second color difference signal is not (for example similar hue) in complementary relationship as the first distance information Saturation_ _sub decreases. That is, the first distance information Saturation_ _sub ideally if false color occurrence region is zero, the larger the false color occurrence region in which false color is generated strongly.

[S23 in FIG. 5 (Calculation of Addition Value of Color Difference Signal)]
In this processing step S23, for each false color detection target pixel having the same address set in processing step S20 (false color detection target pixel setting), an added value (Cb) of the first color difference signal and the second color difference signal. ' _add , _Cr'add ) is calculated.

Specifically, in this processing step S23, provisional addition values (Cb _add , Cr _add ) are calculated by the following equations.
Cb _add = Cb1 + Cb2
Cr _add = Cr1 + Cr2

Next, the average value (Cb _mean , Cr _mean ) of the provisional addition values is calculated by the following equation.
Cb _mean = Cb _add / 2
Cr _mean = Cr _add / 2

Next, the added value (Cb ′ _add , Cr ′ _add ) is calculated by the following equation.
Cb ′ _add = Cb _add −Cb _mean
Cr ′ _add = Cr _add −Cr _mean

[S24 in FIG. 5 (calculation of second distance information)]
In this processing step S24, for each false color detection target pixel having the same address set in processing step S20 (false color detection target pixel setting), the color is determined based on the added value (Cb ′ _add , Cr ′ _add ). second distance information Saturation_ _{the add} is calculated by the following equation in space.
_{Saturation_ add = √ (Cb 'add} 2 + Cr' add 2)

Second distance information Saturation_ _{the add} each example of each plot pair of FIG. 8 (plot 6b and plot 6c, plots 7b and plot 7c), zero, and ^{√ (α 2 + β 2)} .

Here, the first and second color difference signals change under the influence of the light source, the exposure condition, the white balance and the like at the time of image capturing. However, first, since the second respective color difference signals varies in the same way, mutual relative distance in the color space (i.e., the first distance information Saturation_ _sub) changes little.

On the other hand, the second distance information Saturation_ _{the add,} the first, second light source for the respective color difference signal imaging, exposure conditions, the changes relative to the position of the origin O of the color space under the influence of such as white balance , Change a lot. Therefore, in the process step S23 (calculation of the sum of the color difference signal), the second distance information Saturation_ _{the add} provisional sum value _{(Cb add, Cr} add) without operation immediately using, relative to the origin O by the impact In order to cancel or reduce the change in position (to make the midpoint between the first color difference signal and the second color difference signal far from the origin O closer to the origin O due to the above influence), the added values (Cb ′ _add , Cr ′ _add) ) Is calculated.

As can be understood from the positional relationship between each pair of plots in FIG. 8, when the color information of the first color difference signal and the second color difference signal has a complementary color relationship, the signs are opposite to each other, so that the added value (Cb _'add, Cr' _add) is decreased, the second distance information Saturation_ _{the add} decreases. The second distance information Saturation_ to _add becomes smaller as is strong complementary relationship, the zero ideally. On the other hand, when the color information of the first color difference signal and the second color difference signal is not in a complementary color relationship (for example, the same hue), the signs are the same, so the added values (Cb ′ _add , Cr ′) _add) and increases, the second distance information Saturation_ _{the add} increases. That is, the second distance information Saturation_ _{the add} is larger if false color occurrence region decreases if false color occurrence region.

[S25 in FIG. 5 (Calculation of Difference Value of Luminance Signal)]
For convenience of explanation, the luminance signal Y of the first image taken in the processing step S12 (photographing the first image) will be referred to as “first luminance signal” and taken in the processing step S15 (photographing the second image). The luminance signal Y of the second image is referred to as “second luminance signal”. In this processing step S25, for each false color detection target pixel having the same address set in processing step S20 (false color detection target pixel setting), the difference value Y _diff between the first luminance signal and the second luminance signal. Is calculated. Specifically, in this processing step S25, when the first luminance signal is defined as Y1 and the second luminance signal is defined as Y2, the difference value Y _diff is calculated by the following equation.
Y _diff = | Y1-Y2 |

[S26 in FIG. 5 (Determination of False Color Generation Area)]
In this processing step S26, it is determined whether or not the address set in the processing step S20 (false color detection target pixel setting) is a false color generation region for each false color detection target pixel. Specifically, when all of the following conditions (1) to (3) are satisfied, it is determined that the pixel is a false color generation region.

・ Condition (1)
As described above, since the color information having the first color difference signal the larger the first distance information Saturation_ _sub and the second color difference signal is strong complementary relationship, it is likely the pixel is false color occurrence region . Therefore, condition (1) is defined as follows.
Condition (1): Saturation_ _sub ≧ threshold T1

・ Condition (2)
As described above, since the color information having the second distance information Saturation_ first color difference signal the more _add small and the second color difference signal is strong complementary relationship, it is likely the pixel is false color occurrence region . Therefore, condition (2) is defined as follows.
Condition (2): Saturation_ _add ≦ threshold T2

Consider a case in which a large image blur occurs in only one of the first image taken in the processing step S12 (photographing the first image) and the second image taken in the processing step S15 (photographing the second image). . In this case, the difference between the first color difference signal and the second color difference signal becomes large, and there is a possibility that a false color is erroneously detected. Therefore, the condition (3) is defined as follows.
Condition (3): Y _diff ≦ threshold value T3

That is, when the difference value Y _diff is larger than the threshold value T3, there is a risk of the above-described erroneous detection, so that the false color is not detected for the pixel (the pixel is processed as not being a false color generation region). )

  Condition (1) and condition (2) are conditions for directly determining whether or not the pixel is a false color generation region. Therefore, in another embodiment, when at least one of the condition (1) and the condition (2) is satisfied, the pixel may be determined to be a false color generation region.

  Further, the user can change the false color detection sensitivity by operating the operation unit 102 to change the settings of the threshold values T1 to T3. As shown in FIGS. 9 and 10, the detection sensitivity adjustment bar B <b> 2 is displayed in OSD in the live view. The display of the detection sensitivity adjustment bar B2 changes according to the setting change contents of the threshold values T1 to T3 by the user. The user can grasp the current false color detection sensitivity through the detection sensitivity adjustment bar B2.

[S27 in FIG. 5 (false color detection)]
In this processing step S27, the presence or absence of a false color is detected. Illustratively, the number of pixels determined as a false color generation region in processing step S26 (determination of the false color generation region) (or the ratio of the pixels determined as the false color generation region out of the total number of effective pixels) is predetermined. When it is equal to or greater than the threshold value, a detection result that there is a false color is obtained (S27: YES), and when the number of pixels (or ratio) is less than a predetermined threshold value, a detection result that there is no false color is obtained (S27: NO). .

[S28 in FIG. 5 (saving of photographed image)]
This process step S28 is executed when a detection result indicating no false color is obtained in process step S27 (detection of false color) (S27: NO). In this processing step S28, no false color is detected for the first image taken in processing step S12 (photographing the first image) and the second image taken in processing step S15 (photographing the second image). For example, at least one of them is stored in the memory card 200 (or a built-in memory (not shown) provided in the photographing apparatus 1). At this point, the photographer may be notified that the shooting operation has been completed. In particular, if the photographer is informed that the false color detection process using the first image and the second image is started in the processing step S15 (second image shooting), the shooting operation is completed. Communicate to the photographer. As a result, the photographer can proceed to the next work, for example, change of the state (setting) of the photographing apparatus 1.

[S29 in FIG. 5 (Image pickup under LPF drive)]
This processing step S29 is executed when a detection result indicating that there is a false color is obtained in processing step S27 (detection of false color) (S27: YES). In this processing step S29, false colors were detected for the first image taken in processing step S12 (photographing the first image) and the second image taken in processing step S15 (photographing the second image). Therefore, the LPF drive is executed. When imaging under LPF driving has already been performed, the driving cycle (rotation cycle) and driving of the solid-state imaging device 112a are obtained so that a stronger optical LPF effect (reduction of moire such as false colors) can be obtained. The amplitude (rotation radius) is adjusted. That is, it is changed to a more advantageous shooting condition for reducing false colors. Then, the subject is imaged (third image is captured). That is, when a false color is detected, the third image is captured. Therefore, when the photographer is notified that the false color detection process is to be started in the processing step S15 (second image capturing), the photographer is in a state of the image capturing device 1 until the third image capturing is completed. (Setting) can be maintained.

  According to the present embodiment, the false color detection target pixels are narrowed down to not only all the effective pixels but also the in-focus area where the false color is highly likely to occur and the surrounding pixels. As a result, the false color detection processing speed is improved while the false color detection accuracy is maintained. Further, according to the present embodiment, when a subject image having a high frequency component equal to or higher than the pixel pitch P is captured by shifting the incident position of the subject image on the light receiving surface 112aa of the solid-state imaging device 112a. Different false colors (false colors that are complementary to each other) are generated, and an image with a large difference is generated. Since an image having a large difference is used for detecting the false color, the false color is detected with high accuracy.

  The above is the description of the exemplary embodiments of the present invention. Embodiments of the present invention are not limited to those described above, and various modifications are possible within the scope of the technical idea of the present invention. For example, the embodiment of the present application also includes an embodiment that is exemplarily specified in the specification or a combination of obvious embodiments and the like as appropriate.

  In the above embodiment, the false color is optically removed from the entire image by executing the LPF drive, but the present invention is not limited to this. False colors may be removed using image processing. In the case of image processing, the false color can be removed not only in the entire image but also locally (for example, for each pixel determined to be a false color generation region). In addition, if information indicating the false color generation area is stored in association with the first image (second image), even if the false color correction is manually performed by another terminal (such as a computer), A false color generation region can be easily found based on the information. Therefore, the trouble of searching for the false color generation area from the entire image is reduced.

  In the above embodiment, the false color detection target pixels are set with reference to the focusing areas FA1 to FA5 at the time of shooting the first image in the processing step S12 (shooting the first image). Not exclusively. For example, the false color detection target pixel may be set with reference to the focusing areas FA1 'to FA5' when the second image is captured in the processing step S15 (second image capturing).

  In the above embodiment, not only each pixel in the paired focusing area but also a predetermined number of surrounding pixels surrounding the focusing area are set as false color detection target pixels. Not limited to. For example, only each pixel in the paired focusing area may be set as a false color detection target pixel.

DESCRIPTION OF SYMBOLS 1 Image pick-up device 100 System controller 102 Operation part 104 Drive circuit 106 Shooting lens 108 Aperture 110 Shutter 112 Image blur correction device 112a Solid-state image sensor 112aa Light-receiving surface 112b (of solid-state image sensor) Fixed support substrate 112c Movable stage 114 Signal processing circuit 116 Image Processing engine 118 Buffer memory 120 Card interface 122 LCD control circuit 124 LCD
126 ROM
128 Gyro sensor 200 Memory card C _YR , C _YL , C _XD , C _XU driving coil H _YR , H _YL , H _XD , H _XU Hall element M _YR , M _YL , M _XD , M _XU magnet PIX pixel VCM _YR , VCM _YL , VCM _XD , VCM _XU voice coil motor _YYR , _YYL , _YXD , _YXU yoke

Claims (12)

Focusing area detecting means for detecting at least one focusing area based on focusing information in the image;
Detection range setting means for setting a detection range of image degradation occurring in the image to a predetermined range based on each detected focus area;
Comprising
Image detection range setting device. The detection range is
Consists of the reference focusing area and the surrounding area of the focusing area,
The image detection range setting device according to claim 1. Operation accepting means for accepting the operation of the operator;
Detection range changing means for changing the detection range in accordance with an accepted operator's operation;
Comprising
The image detection range setting device according to claim 1 or 2. The detection range changing means includes
The size of the detection range is changed according to the operation with respect to the center of the reference focusing area or the center of the detection range,
The image detection range setting device according to claim 3. The shape of the detection range is
Maintain a similar shape before and after the size change by the detection range changing means,
The image detection range setting device according to claim 4. Comprising an index display means for displaying an index indicating the size of the detection range;
The indicator display means includes
Changing the display of the indicator according to the change in the size of the detection range,
The image detection range setting device according to claim 4 or 5. The image detection range setting device according to any one of claims 1 to 6,
Image detection means for detecting image deterioration in the detection range set by the image detection range setting device;
Comprising
Image detection device. The image detecting means includes
Acquire at least a pair of images with different imaging conditions,
Detecting image degradation in the detection range based on the acquired paired images;
The image detection apparatus according to claim 7. The image detecting means includes
Determine the in-focus area where the same subject appears between the pair of images,
Detecting image degradation based on the paired images with respect to a detection range based on a focused area in which the determined same subject is captured;
The image detection apparatus according to claim 8. The image detecting means includes
Perform a predetermined threshold determination based on the paired images,
Image degradation is detected based on the threshold determination result,
The threshold is
The setting can be changed according to the operation of the operator.
The image detection apparatus according to claim 8 or 9. Detecting at least one in-focus region based on in-focus information in the image;
A detection range setting step for setting a detection range of image degradation occurring in the image to a predetermined range based on each detected focus area;
including,
Image detection range setting method.   An image detection range setting program for causing a computer to execute the image detection range setting method according to claim 11.

Images