JP5885464B2 - Imaging apparatus, control method thereof, and program - Google Patents

Description

  The present invention relates to an imaging apparatus suitable for performing defective pixel correction, a control method thereof, and a program.

  In an image sensor such as a CCD sensor or a CMOS sensor included in a digital camera, a defective pixel having a level different from that of a normal light receiving unit exists in some pixels. This defective pixel appears as a so-called scratch at the time of recording or displaying, and contributes to deterioration of image quality performance. By correcting this defective pixel using, for example, image information of a peripheral non-defective part, it is possible to prevent deterioration in image quality performance. The position of the defective pixel is detected mainly during the manufacturing process of the digital camera, and the position information is stored in a memory such as a flash ROM provided in the camera. Then, based on the stored position information of the defective pixel, the defective pixel is corrected for each photographing.

  However, it has been found that some defective pixels occur after a digital camera is shipped as a product. In this way, a defect that occurs after product shipment is dealt with by, for example, the user bringing the product into a service center, or depending on the product, executing a program that performs a defect detection operation by the user.

  Patent Document 1 describes an imaging device that stores the date and time of defect detection performed together with foreign object detection and executes defect detection processing when a predetermined time or more has elapsed since the previous time. According to this imaging apparatus, since defective pixel detection is performed periodically, there is a merit that the defective pixel does not remain in the captured image after a new defective pixel is generated.

JP 2007-208743 A

  However, in the above-described conventional example, correction can be performed on an image captured after executing defective pixel detection. However, after a new defective pixel is generated, a period until a next defective pixel is detected. There has been a problem that correction cannot be performed on a photographed image.

  The present invention has been made in view of the above-described problem, and enables defective pixel correction to be performed on an image shot during a period until a new defective pixel is detected after a new defective pixel is generated. With the goal.

Imaging apparatus of the present invention includes an imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, a recording medium pre-outs image data as an image file with the shooting date and time and recording means for recording, based on the previous SL image data, storing the defective pixel detecting means for detecting a defective pixel of the imaging device, the information of new defective pixel detected by the defective pixel detecting means with the detection time And a defective pixel correction unit that corrects output data of the new defective pixel included in image data recorded as an image file on the recording medium, based on the information on the new defective pixel, and the recording medium the new image from the image files recorded, shooting date than the last defective pixel detection date by the defective pixel detecting means fa Extract the Le, if the number of extracted image files is small, the output data of the new defective pixel included in the image data of the extracted image files the defective pixel correction means controlled so as to correct, extracted Control means for selectively controlling the output data of the new defective pixel included in the image data of the extracted image file so that the defective pixel correction means does not correct the image data when the number of image files obtained is large; It is provided with.

  According to the present invention, it is possible to perform defective pixel correction on an image taken during a period until a new defective pixel is detected after a new defective pixel is generated.

It is a block diagram which shows the structure of the digital camera which concerns on 1st Embodiment. It is a flowchart which shows the defective pixel correction sequence with respect to the defective pixel detection and picked-up image in 1st Embodiment. It is a flowchart which shows the detail of a defective pixel detection. It is a flowchart which shows the detail of defect pixel correction | amendment. It is a figure which shows an example of the file name in a recording medium, and imaging | photography date. It is a figure which shows an example of defective pixel data. It is a flowchart which shows the defective pixel detection and the defective pixel data addition sequence with respect to the image | photographed image in 2nd Embodiment. It is a flowchart which shows the defective pixel correction sequence with respect to the defective pixel detection and picked-up image in 3rd Embodiment.

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.
<First Embodiment>
FIG. 1 is a diagram illustrating a configuration of a digital camera according to the first embodiment. In FIG. 1, reference numeral 100 denotes a digital camera. Reference numeral 10 denotes a photographing lens. Reference numeral 12 denotes a mechanical shutter having an aperture function. An image sensor 14 outputs an image signal by photoelectric conversion. Reference numeral 16 denotes an A / D converter that converts an analog signal output from the image sensor 14 into a digital signal.

  A timing generation circuit 18 is controlled by the memory control circuit 22 and the system control circuit 50, and supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26. In addition to the mechanical shutter 12, the accumulation time can be controlled as an electronic shutter by controlling the reset timing of the image sensor 14 by the timing generation circuit 18 and can be used for moving image shooting and the like.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22. Further, an electronic zoom function is realized by performing image cutting and scaling processing by the image processing circuit 20. The image processing circuit 20 performs predetermined calculation processing using the captured image data, and the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the obtained calculation result. TTL AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed. Further, the image processing circuit 20 performs predetermined calculation processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained calculation result.

  A memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32. The data of the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is directly passed through the memory control circuit 22. It is.

  Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, 28 denotes an image display unit comprising a TFT LCD, and the display image data written in the image display memory 24 is passed through the D / A converter 26. Displayed by the image display unit 28. If the image data captured using the image display unit 28 is sequentially displayed, the electronic viewfinder function can be realized. The image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the digital camera 100 can be significantly reduced. it can.

  Reference numeral 30 denotes a memory for storing captured still images and moving image data, and has a sufficient storage capacity for storing a predetermined number of still images and a predetermined time of moving images. This makes it possible to write a large amount of images to the memory 30 at high speed even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot. The memory 30 can also be used as a work area for the system control circuit 50.

  A compression / decompression circuit 32 compresses the image signal according to, for example, the JPEG (Joint Photographic Experts Group) standard using orthogonal transformation, and decompresses the compressed image to the original data. The image stored in the memory 30 is read, compression processing or decompression processing is performed, and the processed data is written in the memory 30.

  An exposure control unit 40 controls the mechanical shutter 12 having an aperture function, and has a flash light control function in cooperation with the flash 48. A distance measuring control unit 42 controls focusing of the photographing lens 10. A zoom control unit 44 controls zooming of the photographing lens 10. A barrier control unit 46 controls the operation of the barrier 102. A flash 48 has an AF auxiliary light projecting function and a flash light control function. The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing circuit 20, the system control circuit 50 performs the exposure control unit 40 and the distance measurement. The controller 42 is controlled.

  A system control circuit 50 controls the entire digital camera 100. A memory 52 stores constants, variables, programs, and the like for operating the system control circuit 50.

  Reference numeral 54 denotes a display unit such as a liquid crystal display device or a speaker that displays an operation state, a message, and the like using characters, images, sounds, and the like in accordance with execution of a program in the system control circuit 50. The display unit 54 is installed at an easily visible position near the operation unit of the digital camera 100, and is configured by a combination of, for example, an LCD, an LED, and a sounding element. In addition, the display unit 54 is partially installed in the optical viewfinder 104. Among the display contents of the display unit 54, what is displayed on the LCD or the like includes single shot / continuous shooting display, self-timer display, compression rate display, number of recorded pixels, number of recorded pixels, number of remaining images that can be captured, shutter There are speed display, aperture value display, exposure compensation display, flash display, red-eye reduction display, macro shooting display, and the like. Further, a buzzer setting display, a battery remaining amount display, an error display, an information display with a multi-digit number, an attachment / detachment state display of the recording media 200 and 210, a communication I / F operation display, and the like are possible. Further, among the display contents of the display unit 54, what is displayed in the optical viewfinder 104 includes in-focus display, camera shake warning display, flash charge display, shutter speed display, aperture value display, exposure correction display, and the like.

  Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, such as a flash ROM. The nonvolatile memory 56 stores, in addition to firmware for controlling the entire camera, defective pixel data (defective pixel position information, defective pixel signal level) detected at the factory before product shipment. Based on the position information of the defective pixel stored here, it is possible to correct the defective pixel for each photographing.

Reference numerals 60, 62, 64, 66, 70, and 72 denote operation means for inputting various operation instructions of the system control circuit 50. One or a plurality of switches, dials, touch panels, pointing by line-of-sight detection, voice recognition devices, etc. Consists of
Here, a specific description of these operating means will be given.
Reference numeral 60 denotes a mode dial switch, which includes power-off, automatic shooting mode, shooting mode, panoramic shooting mode, moving image shooting mode, playback mode, multi-screen playback / erase mode, PC (personal computer) connection mode, TV reception mode, etc. The function mode can be switched and set.
Reference numeral 62 denotes a shutter switch SW1, which is turned ON during the operation of the shutter button, and instructs to start operations such as AF processing, AE processing, AWB processing, and EF processing.
Reference numeral 64 denotes a shutter switch SW2, which is turned on when the operation of the shutter button is completed, and instructs the start of a series of processing operations including exposure processing, development processing, and recording processing. In the exposure process, the image data is written into the memory 30 through the signal read from the image sensor 14 via the A / D converter 16 and the memory control circuit 22. The development process is performed by using an operation in the image processing circuit 20 or the memory control circuit 22, reads image data from the memory 30, and compresses it by the compression / decompression circuit 32. In the recording process, image data is written to the recording medium 200 or 210.
Reference numeral 66 denotes a display changeover switch, which can change the display of the image display unit 28. With this function, when photographing is performed using the optical viewfinder 104, it is possible to save power by cutting off the current supply to the image display unit 28 including a TFT LCD or the like.
An operation unit 70 includes various buttons, a touch panel, and the like, and includes a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, and the like. Also, menu movement + (plus) button, menu movement-(minus) button, playback image movement + (plus) button, playback image-(minus) button, shooting image selection button, exposure compensation button, date / time setting button, etc. There is also.
A zoom switch 72 is used by the user to give an instruction to change the magnification of the captured image. The zoom switch includes a tele switch that changes the captured field angle to the telephoto side and a wide switch that changes the wide angle side. By using the zoom switch 72, the zoom control unit 44 is instructed to change the imaging field angle of the photographing lens 10 and becomes a trigger for performing an optical zoom operation. In addition, it also serves as a trigger for electronic change of the imaging angle of view by image cutting by the image processing circuit 20 or pixel interpolation processing.
Reference numeral 74 denotes a subject detection unit, which includes an element for detecting the subject. A case where a face is detected as a subject is also conceivable.

  A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is attached, the type of battery, and the remaining battery level. Further, the DC-DC converter is controlled based on the detection result and the instruction of the system control circuit 50, and a necessary voltage is supplied to each part including the recording medium for a necessary period. 82 is a connector, 84 is a connector, 86 is a primary battery such as an alkaline battery or lithium battery, a secondary battery such as a NiCd battery, NiMH battery or Li battery, an AC adapter, or the like.

  Reference numerals 90 and 94 denote interfaces with recording media such as memory cards and hard disks, and reference numerals 92 and 96 denote connectors for connecting to recording media such as memory cards and hard disks. In the present embodiment, it is assumed that there are two interfaces and connectors for attaching the recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or a plurality of systems, any number of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard. The interface and the connector may be configured using an SD card, a CF (Compact Flash (registered trademark)) card, or the like. Further, the interfaces 90 and 94, and the connectors 92 and 96 can be configured by using ones conforming to a standard such as a PCMCIA card or a CF card. That is, by connecting various communication cards such as LAN cards, modem cards, USB cards, IEEE 1394 cards, SCSI cards, PHS and other communication cards, image data and images can be exchanged with other computers and peripheral devices such as printers. Management information attached to the data can be transferred.

  Reference numeral 102 denotes a barrier serving as a protection unit, which covers the imaging unit including the lens 10 of the digital camera 100 to prevent the imaging unit from being soiled or damaged. Reference numeral 104 denotes an optical viewfinder, which can take an image using only the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are installed.

  A communication unit 110 has various communication functions such as USB, IEEE 1394, LAN, and wireless communication. Reference numeral 112 denotes a connector for connecting the digital camera 100 to another device by the communication unit 110 or an antenna in the case of wireless communication.

  Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface 204 with the digital camera 100, and a connector 206 for connecting with the digital camera 100. Reference numeral 210 denotes a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 composed of a semiconductor memory, a magnetic disk, and the like, an interface 214 with the digital camera 100, and a connector 216 for connecting with the digital camera 100.

Hereinafter, the defective pixel detection and correction after product shipment in the digital camera 100 according to the present embodiment will be specifically described.
(Detection and correction of defective pixels after product shipment)
As defective pixel detection and correction timing after product shipment, for example, the following 1-3 may be considered.
1. When specified by the user.
2. When a predetermined time has passed since the previous detection date.
3. When the camera is turned on (or off).

  1. Then, defective pixel detection is performed by selecting and executing a defective pixel detection item as one of the menu items displayed when the menu button included in the operation unit 70 is pressed. 2. And 3. Then, since the defective pixel detection is automatically executed on the camera side, it is possible to correct a newly generated defective pixel without the user being aware of it.

  FIG. 2 is a flow chart showing a defective pixel detection and defective pixel correction sequence for a photographed image, which is performed at any of the above timings in the digital camera 100 according to the present embodiment. First, defective pixel detection is performed in order to detect a defective pixel newly generated from the previous defective pixel detection time to the present, that is, a new defective pixel (step S201). Details of the defective pixel detection in step S201 will be described later.

  Next, it is determined whether or not a new defective pixel has occurred (step S202). If it has not occurred, no correction is necessary, and the processing is terminated. If a new defective pixel has occurred in step S202, new defective pixel data stored in the nonvolatile memory 56 is acquired (step S203).

  Next, the image files recorded in the recording media 200 and 210 are searched based on the date and time information (step S204). If the image file is older than the previous defective pixel detection date and time, the defective pixel correction is not performed and the process proceeds to step S206. . If the image file is newer than the previous defective pixel detection date and time in step S204, the process proceeds to step S205, and defective pixel correction is performed based on the defective pixel data acquired in step S203. Details of the defective pixel correction in step S205 will be described later.

  In step S206, it is determined whether or not all image files have been searched. If completed, the process ends. If not completed yet, the process returns to step S204 to continue the process.

(Defective pixel detection)
FIG. 3 is a flowchart showing details of defective pixel detection in step S201 of FIG. The defective pixel detection can be performed by a method similar to that conventionally performed. That is, an image pickup signal in a light-shielded state is taken and defective pixel determination is performed based on the signal level. First, shooting condition settings for detection shooting are performed (step S301). For example, in order to block light, the mechanical shutter 12 is set to a closed state, and the shutter speed, sensitivity, and the like are set to values suitable for detection. Since defective pixels are highly temperature-dependent, depending on the case, an operation that accompanies a temperature rise is executed, and a temperature rise wait is performed.

  Next, an image is taken (step S302), and raw data (hereinafter referred to as RAW data) obtained from the image sensor 14 through the A / D converter 16 is stored in the memory 30. Next, while sequentially reading the RAW data (step S303), it is determined whether the image level is higher than a predetermined threshold (step S304).

  If the image level is higher than the predetermined threshold value in step S304, it is determined by comparing the position information of the defective pixel whether or not it is the same as the defective pixel already registered in the defective pixel data area of the nonvolatile memory 56. (Step S305). If none of the defective pixel data corresponds to a new defective pixel, the new defective pixel data (position information of the new defective pixel, signal level of the new defective pixel) is used as the defective pixel data area of the nonvolatile memory 56. (Step S306).

  On the other hand, if the image level is not higher than the predetermined threshold in step S304, it is determined that there is no defect, and the process proceeds to step S307. If it is already registered in the defective pixel data area of the nonvolatile memory 56 in step S305, it is determined that the pixel is not a new defective pixel, and the process proceeds to step S307. In step S307, it is checked whether or not the comparison has been completed for all the pixels of the photographed image. If not yet completed, the process returns to step S303. If the comparison has been completed for all the pixels, this process ends.

(Defective pixel correction)
FIG. 4 is a flowchart showing details of the defective pixel correction in step S205 of FIG. First, the image processing circuit 20 reads out defective pixel data for use when performing defective pixel correction (step S401). The defective pixel data is stored in the nonvolatile memory 56, and the defective pixel data actually used in the defective pixel correction after photographing is read out.

  The system control circuit 50 designates defective pixel data to be used according to the photographing conditions (step S402), and then reads information indicating the position (address) of the defective pixel described in the defective pixel data (step S403). Next, the system control circuit 50 reads captured image data of the same color pixel adjacent to the pixel for which the defective pixel address is specified in step S403 (step S404).

  Next, the system control circuit 50 calculates the correction amount of the pixel from the value of the adjacent pixel obtained in step S404 (step S405). Next, the system control circuit 50 writes the correction amount of the pixel calculated in step S405 at the address in the memory 30 (step S406). The pixel correction process is thus completed. Next, the system control circuit 50 determines whether or not all defective pixel corrections of the defective pixels described in the designated defective pixel data have been completed (step S407), and if not completed yet, returns to step S403. Then, the next defective pixel address is read. If all defective pixel correction processes are completed in step S407, the process ends.

(Application example of defective pixel detection and correction to image file in recording medium)
Hereinafter, in the first embodiment, detection and correction of defective pixels when the file names and shooting dates / times in the recording media 200 and 210 are as shown in FIG. 5 will be described in detail. FIG. 5 is a diagram illustrating an example of a file name and shooting date / time in a recording medium, and FIG. 6 is a diagram illustrating an example of defective pixel data.

  Assuming that the defective pixel detection interval is a 7-day interval, the previous defective pixel detection date is June 17, 2009 (hereinafter referred to as the year / month / day), and the current defective pixel detection date is 2009/6/24. Suppose there is. Further, it is assumed that a new defective pixel occurs on 2009/6/19 after product shipment. In this case, images taken after 2009/6/19, that is, IMG_0003.JPG, IMG_0004.RAW, IMG_0005.RAW, and IMG_0005.JPG are recorded in a state where the new defective pixels are not corrected. . Note that IMG_0005.RAW and IMG_0005.JPG are recorded in the same subject in the same timing and in a plurality of different recording formats.

  The defective pixel detection sequence shown in the flowchart of FIG. 2 and the defective pixel correction sequence for the photographed image are executed. In this case, since IMG_0001.JPG has a shooting date and time older than the previous defective pixel detection date and time, it is not a target image for defective pixel correction. On the other hand, since IMG_0003.JPG, IMG_0004.RAW, IMG_0005.RAW, and IMG_0005.JPG have newer shooting dates and times than the previous defective pixel detection date and time, they become target images for defective pixel correction. Also, since IMG_0002.RAW was recorded before the date and time of occurrence of the new defective pixel (2009/6/19), it is originally not necessary to correct the defective pixel, but the correct mixing time of the new defective pixel is not necessary. It is difficult to specify. Thus, in the present embodiment, defective pixel correction is performed on all images captured between the previous defective pixel detection date (2009/6/17) and the current detection date (2009/6/24). Is going. That is, IMG_0002.RAW is also a target image for defective pixel correction. It should be noted that the pixel at the coordinates (X = 1502, Y = 622) of the IMG — 0002.RAW image, which originally does not require correction of defective pixels, is replaced with the result of interpolation calculation from surrounding pixels. However, since the number of defective pixels after product shipment is generally sufficiently small compared to scratches detected before product shipment, even if correction is performed by interpolation from surrounding pixels, the effect on image quality is affected. Is insignificant.

  FIG. 6 shows defective pixel data stored in the nonvolatile memory 56. The defective pixel indicates the defective pixel number, the coordinates (X, Y) indicating the position of the defective pixel, and the signal level of the defective pixel. Consists of level and defective pixel detection date and time. D1, D2, and D3 are defective pixel data detected by defective pixel detection of 2009/5/7 before product shipment, and D4n is detected by defective pixel detection of 2009/6/24 after product shipment. Defective pixel data. Although not present in FIG. 5, for images taken after 2009/6/24, new defective pixel data D4n is added in the nonvolatile memory of the camera as shown in FIG. By using the defective pixel data D4n, it is possible to perform defective pixel correction including new defective pixels at the time of photographing.

  As described above, image data having a shooting date and time that is newer than the previous defective pixel detection date and time is extracted, and defective pixel correction is performed on the image data based on information on the new defective pixel. It is possible to perform defective pixel correction on an image taken during a period from when a defective pixel is generated until the next defective pixel is detected.

<Second Embodiment>
In the present embodiment, defective pixel correction is not performed when a new defective pixel is detected, but new defective pixel data is recorded as incidental information in an image file. The configuration and basic processing operations of the digital camera 100 are the same as those in the first embodiment, and the following description will focus on differences from the first embodiment.

  FIG. 7 is a flowchart illustrating a defective pixel detection and defective pixel data addition sequence for a photographed image in the present embodiment. Step S701 to step S704 and step S706 in the figure are the same as step S201 to step S204 and step S206 of FIG.

  In the first embodiment, defective pixel correction is performed when a new defective pixel is detected. In this embodiment, defective pixel correction is not performed, and new defective pixel data is added as header information of an image file in step S705. For the image file to which the new defective pixel data is added, for example, at the time of reproduction, a method of presenting the existence to the user and allowing the user to select whether or not to perform the defective pixel correction can be performed.

  As described above, according to the present embodiment, even when a large amount of image files exist in the recording medium, since the defective pixel correction is not performed, the processing can be completed in a relatively short time. Further, it is possible to prevent the defective pixel correction based on the new defective pixel data from being uniformly performed even on an image taken before the new defective pixel is generated.

<Third Embodiment>
In this embodiment, when searching for an image file, whether or not to perform defective pixel correction is determined according to the recording format of the image. The configuration and basic processing operations of the digital camera 100 are the same as those in the first embodiment, and the following description will focus on differences from the first embodiment.

  FIG. 8 is a flowchart illustrating a defective pixel detection sequence and a defective pixel correction sequence for a captured image in the present embodiment. First, defective pixel detection is performed in order to detect a defective pixel newly generated from the previous defective pixel detection time to the present, that is, a new defective pixel (step S801). Details of the defective pixel detection are the same as those in the first embodiment.

  Next, it is determined whether or not a new defective pixel has occurred (step S802). If it has not occurred, no correction is necessary, and the processing is terminated. If a new defective pixel has occurred in step S802, new defective pixel data stored in the nonvolatile memory 56 is acquired (step S803).

  Next, the image files recorded in the recording media 200 and 210 are searched based on the date and time information (step S804). If the image file is older than the previous defective pixel detection date and time, the defective pixel correction is not performed and the process proceeds to step S809. . If the image file is newer than the previous defective pixel detection date and time in step S804, the recording format of the image file is checked (step S805). As a result, if the data is RAW data, the process proceeds to step S806, where defective pixel correction is performed based on the new defective pixel data acquired in step S803, and recording is performed on the recording media 200 and 210. If the details of the defective pixel correction are not RAW data in step S804, the defective pixel correction is not performed and the process proceeds to step S809.

  After performing defective pixel correction in step S806, it is determined whether there is an image simultaneously recorded in JPEG format together with RAW (step S807). If a JPEG simultaneous recording image exists, the process proceeds to step S808. In step S808, a RAW data subjected to defective pixel correction is developed and compressed to generate a JPEG file, which is replaced with the pre-correction JPEG file in the recording media 200 and 210. If there is no JPEG simultaneous recording image in step S807, the process proceeds to step S809.

  In step S809, it is determined whether or not all image files have been searched. If completed, the process ends. If it has not been completed, the process returns to step S804 and continues.

(Application example of defective pixel detection and correction to image file in recording medium)
Hereinafter, in the third embodiment, detailed description will be given of defective pixel detection and correction when the file names and shooting dates and times in the recording media 200 and 210 are as shown in FIG.

  Assuming that the defective pixel detection interval is a 7-day interval, the previous defective pixel detection date is June 17, 2009 (hereinafter referred to as the year / month / day), and the current defective pixel detection date is 2009/6/24. Suppose there is. Further, it is assumed that a new defective pixel occurs on 2009/6/19 after product shipment. In this case, images taken after 2009/6/19, that is, IMG_0003.JPG, IMG_0004.RAW, IMG_0005.RAW, and IMG_0005.JPG are recorded in a state where the new defective pixels are not corrected. . Note that IMG_0005.RAW and IMG_0005.JPG are recorded in the same subject in the same timing and in a plurality of different recording formats.

  The defective pixel detection sequence shown in the flowchart of FIG. 8 and the defective pixel correction sequence for the captured image are executed. In this case, since IMG_0001.JPG has a shooting date and time older than the previous defective pixel detection date and time, it is not a target image for defective pixel correction. IMG_0002.RAW is an image taken before the occurrence date and time of a new defective pixel, but is a RAW file that is newer than the previous defective pixel detection date and time, and is therefore a target image for defective pixel correction. Although IMG_0003.JPG is newer than the previous defective pixel detection date and time, it is a single JPEG file, so it is not a target image for defective pixel correction. Since IMG_0004.RAW and IMG_0005.RAW are RAW files that are newer than the previous defective pixel detection date and time, they are the target images for defective pixel correction. IMG_0005.JPG is recorded simultaneously with IMG_0005.RAW. Therefore, by performing development and compression using the corrected IMG — 0005.RAW, a JPEG file that has been subjected to defective pixel correction is created and replaced with the original JPEG file.

  As described above, in the present embodiment, when the recorded image format is JPEG after development and compression, control is performed so that defective pixel correction is not performed even when there is a high possibility that a new defective pixel has occurred. It has become. This is because in the case of defective pixel correction for the developed image, filter processing and enlargement / reduction processing are included, so even if the defect is only one pixel, the effect spreads to several peripheral pixels and cannot be completely corrected. Because. If simultaneous recording of RAW and JPEG is performed, it is possible to correct JPEG correctly by performing RAW defect correction and then developing and compressing again.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined. In the first embodiment, defective pixel correction is performed when a defective pixel is detected. In the second embodiment, defective pixel correction is not performed when a defective pixel is detected, and defective pixel data is added to the image file. It is also possible to use a combination of these. For example, when searching for an image file after detecting a defective pixel, it is possible to select whether correction is performed on the spot or defective pixel data is added to the image file according to the number of image files corresponding to the date and time information. You may make it perform to. For example, if the number of corresponding image files is large, the time required for processing can be greatly shortened by not performing correction.

  In addition, when the image file is searched after detecting the defective pixel, by checking the signal level of the new defective pixel and its surrounding pixels based on the new defective pixel data for the image corresponding to the date and time information, It is also possible to narrow down the correction target image by checking the presence or absence of defective pixels from the captured image. In this way, it is possible to prevent the image recorded before the new defective pixel is generated from being corrected.

<Other embodiments>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

10: photographing lens, 12: shutter, 14: image sensor, 16: A / D converter, 18: timing generation circuit, 20: image processing circuit, 22: memory control circuit, 24: image display memory, 26: D / A converter, 28: image display unit, 30: memory, 32: compression / expansion circuit, 40: exposure control unit, 42: distance measurement control unit, 44: zoom control unit, 46: barrier control unit, 48: flash, 50: System control circuit, 52: Memory, 54: Display unit, 56: Non-volatile memory, 100: Digital camera, 200: Recording medium, 210: Recording medium

Claims (11)

An image sensor that outputs an image signal by photoelectric conversion;
Image processing means for generating image data based on the image signal;
Recording means for recording on a recording medium as an image file before Kiga image data together with the shooting date and time,
Based on the previous SL image data, and defective pixel detecting means for detecting a defective pixel of the imaging element,
Storage means for storing information on the new defective pixels detected by the defective pixel detection means together with the detection date and time;
Defective pixel correction means for correcting output data of the new defective pixel included in image data recorded as an image file on the recording medium based on the information of the new defective pixel;
From among the image files recorded on the recording medium, when the shooting date and time to extract a new image file than the previous defective pixel detection date by the defective pixel detecting means, the number of extracted image files is small, The output data of the new defective pixel included in the image data of the extracted image file is controlled so that the defective pixel correction unit corrects, and when the number of extracted image files is large, the extracted image file Control means for selectively controlling the output data of the new defective pixels included in the image data so that the defective pixel correction means does not correct the output data;
An imaging apparatus comprising: When the image data recorded as an image file in the recording means is RAW data obtained by the image sensor and image data obtained by developing the RAW data,
In addition to performing defective pixel correction on the RAW data based on the information on the new defective pixel, image data obtained by developing the RAW data subjected to the defective pixel correction is created and recorded in the recording unit. The imaging apparatus according to claim 1. Wherein from among the image data recorded as a recording unit image file, the photographing date and time to extract a new image file from the previous defective pixel detection date, based on further the new defective pixel information of an image to perform defective pixel correction The imaging apparatus according to claim 1, wherein data is narrowed down. An image sensor that outputs an image signal by photoelectric conversion;
Image processing means for generating image data based on the image signal;
Recording means for recording on a recording medium as an image file before Kiga image data together with the shooting date and time,
Based on the previous SL image data, and defective pixel detecting means for detecting a defective pixel of the imaging element,
Storage means for storing information on the new defective pixels detected by the defective pixel detection means together with the detection date and time;
Defective pixel information adding means for adding information on the new defective pixel to the image file recorded on the recording medium;
From among the image files recorded on the recording medium, when the shooting date and time to extract a new image file than the previous defective pixel detection date by the defective pixel detecting means, the number of extracted image files is large, The defective pixel information adding unit controls the extracted image file so that the information on the new defective pixel is added. When the number of extracted image files is small, the new defective pixel is included in the extracted image file. Control means for selectively controlling the defective pixel information adding means so as not to add the information,
An imaging apparatus comprising: An image sensor that outputs an image signal by photoelectric conversion;
Image processing means for generating image data based on the image signal;
Recording means for recording on a recording medium as an image file before Kiga image data together with the shooting date and time,
Based on the previous SL image data, and defective pixel detecting means for detecting a defective pixel of the imaging element,
Storage means for storing information on the new defective pixels detected by the defective pixel detection means together with the detection date and time;
Defective pixel correction means for correcting output data of the new defective pixel included in image data recorded as an image file on the recording medium based on the information of the new defective pixel;
Defective pixel information adding means for adding information on the new defective pixel to the image file recorded on the recording medium;
From among the image files recorded on the recording medium, when the shooting date and time to extract a new image file than the previous defective pixel detection date by the defective pixel detecting means, the number of extracted image files is small, The output data of the new defective pixel included in the image data of the extracted image file is controlled so that the defective pixel correction unit corrects, and when the number of extracted image files is large, the extracted image file Control means for selectively controlling the defective pixel information adding means to add information on the new defective pixel to
An imaging apparatus comprising: Imaging with an imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, and recording means for recording the pre-outs image data on a recording medium together with the shooting date and time An apparatus control method comprising:
Based on the previous SL image data, and the defective pixel detection step of detecting a defective pixel of the imaging element,
A storage step of storing information on the new defective pixel detected by the defective pixel detection step together with its detection date and time in a storage means;
A defective pixel correction step of correcting output data of the new defective pixel included in image data recorded as an image file on the recording medium based on the information of the new defective pixel;
Wherein from among the image files recorded on the recording medium, when the shooting date and time to extract a new image file than the defective pixel detection time of the last due to the defective pixel detection step, the number of extracted image files is small, Control is performed so that the output data of the new defective pixel included in the image data of the extracted image file is corrected in the defective pixel correction step, and when the number of extracted image files is large, the extracted image file A control step of selectively controlling the output data of the new defective pixel included in the image data of the image data so as not to be corrected in the defective pixel correction step;
A method for controlling an imaging apparatus, comprising: An imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, the pre-outs image data together with the shooting date and time and recording means for recording on a recording medium as an image file A control method for an imaging apparatus provided with
Based on the previous SL image data, and the defective pixel detection step of detecting a defective pixel of the imaging element,
A storage step of storing information on the new defective pixel detected by the defective pixel detection step together with its detection date and time in a storage means;
A defective pixel information adding step of adding information of the new defective pixel to the image file recorded on the recording medium;
From among the image files recorded on the recording medium, when the shooting date and time to extract a new image file than the defective pixel detection time of the last due to the defective pixel detection step, the number of extracted image files is large, The new defective pixel information is controlled to be added to the extracted image file in the defective pixel information adding step. When the number of extracted image files is small, the new defective pixel is added to the extracted image file. A control step of selectively controlling not to add the defective pixel information in the defective pixel information adding step;
A method for controlling an imaging apparatus, comprising: An imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, the pre-outs image data together with the shooting date and time and recording means for recording on a recording medium as an image file A control method for an imaging apparatus provided with
Based on the previous SL image data, and the defective pixel detection step of detecting a defective pixel of the imaging element,
A storage step of storing information on the new defective pixel detected by the defective pixel detection step together with its detection date and time in a storage means;
A defective pixel correction step of correcting output data of the new defective pixel included in image data recorded as an image file on the recording medium based on the information of the new defective pixel;
A defective pixel information adding step of adding information of the new defective pixel to the image file recorded on the recording medium;
Wherein from among the image files recorded on the recording medium, when the shooting date and time to extract a new image file than the defective pixel detection time of the last due to the defective pixel detection step, the number of extracted image files is small, Control is performed so that the output data of the new defective pixel included in the image data of the extracted image file is corrected in the defective pixel correction step, and when the number of extracted image files is large, the extracted image file A control step of selectively controlling the new defective pixel information to be added in the defective pixel information adding step;
A method for controlling an imaging apparatus, comprising: Imaging with an imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, and recording means for recording the pre-outs image data on a recording medium together with the shooting date and time A program for controlling a device,
Based on the previous SL image data, a process of detecting a defective pixel of the imaging element,
A process of storing information on a new defective pixel detected by the process of detecting the defective pixel in a storage unit together with the detection date and time;
A defective pixel correction process for correcting output data of the new defective pixel included in image data recorded as an image file on the recording medium based on the information on the new defective pixel;
From among the image files recorded on the recording medium, the photographing date and time to extract a new image file than the previous defective pixel detection date and time by the processing of detecting the defective pixel, when the number of extracted image files is less In addition, the output data of the new defective pixel included in the image data of the extracted image file is controlled to be corrected by the defective pixel correction process, and the extracted data is extracted when the number of extracted image files is large. A process of selectively controlling the output data of the new defective pixel included in the image data of the image file so as not to be corrected by the defective pixel correction process;
A program that causes a computer to execute. An imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, the pre-outs image data together with the shooting date and time and recording means for recording on a recording medium as an image file A program for controlling an imaging device provided,
Based on the previous SL image data, a process of detecting a defective pixel of the imaging element,
A process of storing information on a new defective pixel detected by the process of detecting the defective pixel in a storage unit together with the detection date and time;
A defective pixel information addition process for adding information on the new defective pixel to the image file recorded on the recording medium;
From among the image files recorded on the recording medium, the photographing date and time to extract a new image file than the previous defective pixel detection date and time by the processing of detecting the defective pixel, when the number of extracted image files are often In addition, when the number of extracted image files is small, the new defective pixel information is controlled to be added to the extracted image file by the defective pixel information adding process. A process of selectively controlling not to add information of defective pixels in the defective pixel information addition process;
A program that causes a computer to execute. An imaging device that outputs an image signal by photoelectric conversion, an image processing means for generating image data based on the image signal, the pre-outs image data together with the shooting date and time and recording means for recording on a recording medium as an image file A program for controlling an imaging device provided,
Based on the previous SL image data, a process of detecting a defective pixel of the imaging element,
A process of storing information on a new defective pixel detected by the process of detecting the defective pixel in a storage unit together with the detection date and time;
A defective pixel correction process for correcting output data of the new defective pixel included in image data recorded as an image file on the recording medium based on the information on the new defective pixel;
A defective pixel information addition process for adding information on the new defective pixel to the image file recorded on the recording medium;
From among the image data recorded on the recording medium, the photographing date and time to extract a new image file than the previous defective pixel detection date and time by the processing of detecting the defective pixel, when the number of extracted image files is less In addition, the output data of the new defective pixel included in the image data of the extracted image file is controlled to be corrected by the defective pixel correction process, and the extracted data is extracted when the number of extracted image files is large. A process of selectively controlling the information of the new defective pixel to be added to the image file by the defective pixel information adding process;
A program that causes a computer to execute.

Images