JP2005051697A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide imaging apparatus preventing deterioration in image quality without damaging operability as much as possible in accordance with setting sensitivity even though fixed pattern noise of a sensor fluctuates by an environmental condition such as ambient temperature to photograph a dark image for generating the fluctuation correction data. <P>SOLUTION: In the imaging apparatus that requires a dark fixed pattern noise correction value different in each sensitivity, when dark image data is required by an environmental condition such as ambient temperature at photographing, an image range to be used is changed to capture dark in accordance with set sensitivity, and a projection operation is performed to generate a one-dimensional dark fixed pattern noise correction value. Then, in development processing, dark fixed pattern noise correction using this correction data is performed. Also, in adjustment in a factory, it is possible to shorten a time by changing a range for each sensitivity. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an imaging device that captures, for example, still images and moving images.

  Conventionally, as this type of imaging device, there has already been an imaging device such as an electronic camera that records and reproduces still images and moving images captured by a solid-state imaging device such as a CCD or CMOS, using a memory card having a solid-state memory element as a recording medium. It is commercially available.

  In this electronic camera, by selecting a shooting mode, single-shot shooting for shooting one frame each time the shutter button is pressed and continuous shooting for continuous shooting while pressing the shutter button are performed. Can be switched.

  When imaging using a solid-state imaging device such as a CCD or CMOS, the dark image data read after charge accumulation is performed in the same manner as in the main photographing without exposing the imaging device, and the charge is obtained with the imaging device exposed. Two-dimensional dark fixed pattern noise correction processing can be performed by performing arithmetic processing using the actual captured image data read out after accumulation.

This makes it possible to correct high quality images by correcting the captured image data against image quality degradation caused by two-dimensional dark fixed pattern noise such as dark current noise generated by the image sensor and pixel defects due to minute flaws inherent to the image sensor. Obtainable.
JP 2001-326851 A

  In addition to image quality degradation due to two-dimensional dark fixed pattern noise such as dark current noise generated by the image sensor and pixel defects due to micro scratches inherent to the image sensor, there is mainly circuit noise of the signal readout circuit. The two-dimensional dark fixed pattern noise described above and the circuit noise were not separated. Here, the circuit system noise is a one-dimensional dark fixed pattern noise as a dark offset generated due to voltage non-uniformity or element variation due to a resistance component of the power supply line in the sensor. In the two-dimensional dark fixed pattern noise, dark current is caused and tends to increase as the charge accumulation time and the temperature of the image sensor rise. That is, one-dimensional dark fixed pattern noise becomes a dominant factor of image degradation when the charge accumulation time is short, or at room temperature or low temperature below that.

  Also, the dark fixed pattern may be different when the sensitivity is switched.

  To achieve the above object, a first imaging mode in which imaging is performed in a non-exposure state to obtain first image data, and a second imaging mode in which imaging is performed in an exposure state to obtain second image data, And correction data for generating correction data for correcting the second image data obtained in the second imaging mode from the first image data obtained in the first imaging mode. And a correction unit, wherein the correction data is generated by changing a predetermined range of the first image data in accordance with a sensitivity setting for shooting.

  The reason why the predetermined range is necessary as data is that it is necessary to average in order to eliminate the influence of random noise.

  In this case, since the amount of random noise differs depending on the sensitivity, the data required to generate the correction data may be reduced if the sensitivity is low.

  Driving means for driving a first imaging mode in which imaging is performed in a non-exposure state to obtain first image data; and a second imaging mode in which imaging is performed in an exposure state to obtain second image data; Correction data generating means for generating correction data for correcting the second image data obtained in the second imaging mode from the first image data obtained in the first imaging mode, The correction data is generated by changing the number of acquisition times of the first image data in accordance with the sensitivity setting for shooting.

  The purpose of taking an image when creating correction data is to remove random noise by averaging.

  If random noise remains in the correction data, it becomes noticeable as noise on the line when the main image is corrected.

Here, the magnitude of the random noise has a correlation with the ISO setting value. That is, if the sensitivity is doubled, the circuit noise and the like are also doubled.
The present invention pays attention to this point, and since the random noise is low at low sensitivity, the amount of data to be averaged is reduced, thereby shortening the time for preparing the correction data.

  In particular, it is very effective to create correction data under the same conditions at the time of shooting, but the generation time of correction data becomes a release time lag and the like, which is uncomfortable and also misses a shooting opportunity.

  In the imaging apparatus of the present invention, it is possible to correct appropriately according to sensitivity.

  Embodiments of an imaging apparatus, an imaging method, a program, and a storage medium of the present invention will be described with reference to the drawings. The imaging apparatus of this embodiment is applied to an electronic camera.

  FIG. 1 is a block diagram illustrating a configuration of an electronic camera according to an embodiment. In the figure, reference numeral 100 denotes an image processing apparatus. Reference numeral 12 denotes a shutter having a diaphragm function for controlling the exposure amount of the image sensor 14. An image sensor 14 converts an optical image into an electric signal.

  The light beam incident on the photographing lens 310 in the lens unit 300 forms an optical image on the image sensor 14 guided by the single-lens reflex system through the diaphragm 312, the lens mounts 306 and 106, the mirror 130, and the shutter 12.

  Reference numeral 16 denotes an A / D converter that converts an analog signal output from the image sensor 14 into a digital signal. A timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16 and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22. The image processing circuit 20 performs predetermined calculation processing using image data taken as necessary, and the system control circuit 50 controls the exposure (shutter) control unit 40 and the distance measurement control unit 42 based on the obtained calculation result. TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash dimming) processing for control are performed. The image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

  In the present embodiment, since the distance measurement control unit 42 and the photometry control unit 46 are provided exclusively, the system control circuit 50 uses the distance measurement control unit 42 and the photometry control unit 46 to perform AF (autofocus) processing. , AE (automatic exposure) processing and EF (flash dimming) processing are performed, and the image processing circuit 20 is used for AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash dimming) processing. It is good also as a structure which does not perform each process.

  Further, the AF (auto focus) process, the AE (automatic exposure) process, and the EF (flash dimming) process are performed using the distance measurement control unit 42 and the photometry control unit 46, and the image processing circuit 20 is used. The AF (autofocus) process, the AE (automatic exposure) process, and the EF (flash dimming) process may be performed.

  A memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32.

  Data from the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22 or directly via the memory control circuit 22.

  Reference numeral 24 is an image display memory, and 26 is a D / A converter. Reference numeral 28 denotes an image display unit comprising a TFT type LCD. The display image data written in the image display memory 24 is displayed on the image display unit 28 via the D / A converter 26. When the captured image data is sequentially displayed on the image display unit 28, an electronic viewfinder function can be realized. Further, the image display unit 28 can arbitrarily turn on / off the display in accordance with an instruction from the system control circuit 50. When the display is turned off, the power consumption of the image processing apparatus 100 can be greatly reduced. Can do.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a sufficient storage capacity to store a predetermined number of still images and a predetermined time of moving images. Therefore, even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area for the system control circuit 50.

  A compression / decompression circuit 32 compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the memory 30, performs compression processing or decompression processing, and stores the processed data in the memory 30. Write to.

  Reference numeral 40 denotes a shutter control unit that controls the shutter 12 in cooperation with an aperture control unit 340 that controls the aperture 312 based on photometric information from the photometry control unit 46. Reference numeral 42 denotes a distance measurement control unit for performing AF (autofocus) processing. A light beam incident on the photographing lens 310 in the lens unit 300 is used to stop the aperture 312, lens mounts 306 and 106, the mirror 130, and a distance measurement sub-mirror (see FIG. The in-focus state of the image formed as an optical image is measured by entering with a single-lens reflex system via a not-shown).

  A thermometer 44 detects the ambient temperature in the photographing environment. When the thermometer is in the image sensor (sensor) 14, it is possible to predict the dark current of the sensor more accurately.

  Reference numeral 46 denotes a photometric control unit for performing AE (automatic exposure) processing. The light beam incident on the photographing lens 310 in the lens unit 300 is converted into an aperture 312, lens mounts 306 and 106, a mirror 130, and a photometric sub-mirror (not shown). The exposure state of the image formed as an optical image is measured. The photometry control unit 46 also has an EF (flash dimming) processing function in cooperation with the flash unit 48. A flash unit 48 has an AF auxiliary light projecting function and a flash light control function.

  As described above, based on the calculation result calculated by the image processing circuit 20 using the image data picked up by the image pickup device 14, the system control circuit 50 includes the exposure (shutter) control unit 40, the aperture control unit 340, It is possible to perform exposure control and AF (autofocus) control using the video TTL system for the distance measurement control unit 342.

  Further, AF (autofocus) control may be performed using a measurement result obtained by the distance measurement control unit 42 and a calculation result obtained by calculating the image data captured by the image sensor 14 by the image processing circuit 20. Further, exposure control may be performed using the measurement result obtained by the photometry control unit 46 and the calculation result obtained by calculating the image data captured by the image sensor 14 by the image processing circuit 20.

  Reference numeral 50 denotes a system control circuit that controls the entire image processing apparatus 100 and incorporates a known CPU and the like. Reference numeral 52 denotes a memory for storing constants, variables, programs, and the like for operating the system control circuit 50. Reference numeral 54 denotes a display unit having a liquid crystal display device, a speaker, and the like for displaying an operation state and a message with characters, images, voices, and the like in accordance with execution of a program in the system control circuit 50. An operation unit of the image processing device 100 It is installed at one or a plurality of places that are easily visible in the vicinity. The display unit 54 is configured by a combination of an LCD, an LED, a sound generating element, and the like. Some functions of the display unit 54 are provided in the optical viewfinder 104.

  Among the display contents of the display unit 54, what is displayed on the LCD or the like includes single shot / continuous shooting display, self-timer display, compression rate display, number of recorded pixels, number of recorded pixels, number of remaining images that can be captured, shutter Speed display, Aperture value display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Clock battery level display, Battery level display, Error display, Multi-digit number information display and recording There are an attachment / detachment state display of the media 200 and 210, an attachment / detachment state display of the lens unit 300, a communication I / F operation display, a date / time display, and a display showing a connection state with an external computer.

  Among the display contents of the display unit 54, what is displayed in the optical finder 104 includes in-focus display, shooting preparation completion display, camera shake warning display, flash charge display, flash charge completion display, shutter speed display, aperture value. Display, exposure compensation display, recording medium writing operation display, and the like.

  Furthermore, among the display contents of the display unit 54, what is displayed on the LED or the like includes, for example, in-focus display, shooting preparation completion display, camera shake warning display, flash charge display, flash charge completion display, recording medium writing operation display, Macro shooting setting notification display, secondary battery charge display, etc.

  Among the display contents of the display unit 54, what is displayed on a lamp or the like includes, for example, a self-timer notification lamp. This self-timer notification lamp may be shared with AF auxiliary light.

  Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory storing a program and the like to be described later, and an EEPROM or the like is used as the nonvolatile memory. The nonvolatile memory 56 stores various parameters, setting values such as ISO sensitivity, and setting modes.

  Here, as a cause of generation of the one-dimensional dark fixed pattern noise, there is a large difference (variation) in the readout path where the signal of the pixel unit reaches the final output stage when the signal is read out from the circuit system of the image sensor. FIG. 2 is a diagram showing mixing of fixed pattern noise in the horizontal and vertical directions. The fixed pattern noise in the horizontal direction depends on the difference between the readout path of the vertical line a and the readout path of the vertical line b in the figure. Also, the fixed pattern noise in the vertical direction depends on the difference between the readout path of the horizontal line c and the readout path of the horizontal line d in the figure. For example, as shown in FIG. 2, in the case of an image sensor in which each horizontal line shares a readout circuit and noise that is mixed when transferring the signal of each horizontal line to the common readout circuit due to circuit layout or the like, Fixed pattern noise in the vertical direction is small and does not need to be corrected. In an imaging apparatus using such an imaging element, one-dimensional dark fixed pattern noise can be removed by correcting the main image using one-dimensional correction data in the horizontal direction. Of course, the horizontal direction and the vertical direction may be interchanged.

  Reference numerals 60, 62, 64, 66, 68 and 70 are operation units for inputting various operation instructions of the system control circuit 50, and include one or a plurality of switches, dials, touch panels, pointing by line-of-sight detection, voice recognition devices, and the like. Composed of a combination. Details of these operation units are shown below.

  Reference numeral 60 denotes a mode dial switch, which is an automatic shooting mode, program shooting mode, shutter speed priority shooting mode, aperture priority shooting mode, manual shooting mode, depth of focus priority (depth) shooting mode, portrait shooting mode, landscape shooting mode, and close-up shooting. Each function shooting mode such as a shooting mode, a sports shooting mode, a night view shooting mode, and a panoramic shooting mode can be switched and set.

  A shutter switch (SW1) 62 is turned on during the operation of a shutter button (not shown), and AF (auto focus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, EF (flash adjustment). Instructs the start of operation such as light processing.

  Reference numeral 64 denotes a shutter switch (SW2), which is turned on when the operation of a shutter button (not shown) is completed. The shutter switch (SW2) 64 is an exposure process for writing image data into the memory 30 via the A / D converter 16 and the memory control circuit 22 through the signal read from the image sensor 12, the image processing circuit 20 and the memory control circuit 22. The development processing using the calculation in the above, the image data is read from the memory 30, compressed by the compression / decompression circuit 32, and the start of a series of processing operations such as recording processing for writing the image data to the recording media 200 and 201 is instructed.

  Reference numeral 66 denotes a playback switch, which instructs to start a playback operation for reading an image shot in the shooting mode state from the memory 30 or the recording medium 200 or 210 and displaying it on the image display unit 28.

  Reference numeral 68 denotes a single / continuous shooting switch. When the shutter switch SW2 is pressed, a single shooting mode in which one frame is shot to be in a standby state, and shooting is continuously performed while the shutter switch SW2 is being pressed. The continuous shooting mode can be set.

  Reference numeral 69 denotes an ISO sensitivity setting switch, which can set the ISO sensitivity by changing the gain setting in the image sensor 14 or the image processing circuit 20.

  Reference numeral 70 denotes an operation unit composed of various buttons, a touch panel, etc., a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, menu movement + (plus ) Button, menu shift-(minus) button, playback image shift + (plus) button, playback image-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, panorama mode shooting and playback A selection / switch button for setting selection and switching of various functions at the time of execution, a determination / execution button for setting determination and execution of various functions at the time of shooting and playback in panoramic mode, etc. Image display ON / OFF switch to set ON / OFF, image taken immediately after shooting Quick review ON / OFF switch for setting the quick review function for automatically reproducing data, for selecting the compression rate of JPEG compression, or for selecting the CCD RAW mode for digitizing the image sensor signal and recording it on a recording medium Auto-focus operation starts when pressing the shutter switch SW1, a playback switch that can set each function mode, such as a compression mode switch, playback mode, multi-screen playback / erase mode, and PC connection mode. In this case, there is an AF mode setting switch that can set a one-shot AF mode that keeps the in-focus state and a servo AF mode that keeps the autofocus operation continuously while pressing the shutter switch SW1.

  Further, the functions of the plus button and the minus button can be selected more easily with numerical values and functions by providing a rotary dial switch.

  Reference numeral 72 denotes a power switch, which can be set to switch between power-on and power-off modes of the image processing apparatus 100. In addition, the power on and power off settings of various accessory devices such as the lens unit 300, the external strobe, and the recording media 200 and 210 connected to the image processing apparatus 100 can be switched.

  Reference numeral 80 denotes a power control unit, which includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, detects whether or not a battery is installed, the type of battery, and the remaining battery level. The DC-DC converter is controlled based on the detection result and the instruction of the system control circuit 50, and a necessary voltage is supplied to each part including the recording medium for a necessary period.

  Reference numerals 82 and 84 denote connectors, 86 denotes a primary battery such as an alkaline battery or lithium battery, a secondary battery such as a NiCd battery, NiMH battery, or Li battery, an AC adapter, or the like.

  90 and 94 are interfaces with a recording medium such as a memory card or a hard disk, 92 and 96 are connectors for connecting to a recording medium such as a memory card or a hard disk, and 98 is a recording medium 200 or 210 attached to the connectors 92 or 96. It is a recording medium attachment / detachment detection unit that detects whether or not the recording medium is present.

  In this embodiment, two interfaces and connectors for attaching the recording medium are provided. However, a single or an arbitrary number of interfaces and connectors for attaching the recording medium may be provided. Further, as interfaces and connectors of different standards, those conforming to standards such as PCMCIA cards and CF (Compact Flash (registered trademark)) cards may be used.

  Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using a standard conforming to a PCMCIA card or a CF (Compact Flash (registered trademark)) card, a LAN card, a modem card, a USB card, and an IEEE 1394 card are used. By connecting various communication cards such as communication cards such as P1284 card, SCSI card, PHS, etc., image data and management information attached to the image data are mutually transferred between peripheral devices such as other computers and printers. Is possible.

  Reference numeral 104 denotes an optical viewfinder, which guides a light beam incident on the photographing lens 310 through an aperture 312, lens mounts 306 and 106, and mirrors 130 and 132 by a single-lens reflex system, and forms an optical image for display. Is possible. Accordingly, it is possible to perform shooting using only the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. Further, in the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are provided.

  A communication unit 110 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication. Reference numeral 112 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110 or an antenna for performing wireless communication.

  Reference numeral 120 denotes an interface for connecting the image processing apparatus 100 to the lens unit 300 in the lens mount 106. A connector 122 electrically connects the image processing apparatus 100 to the lens unit 300. A lens attachment / detachment detection unit 124 detects whether the lens unit 300 is attached to the lens mount 106 and / or the connector 122.

  The connector 122 transmits control signals, status signals, data signals, and the like between the image processing apparatus 100 and the lens unit 300, and also has a function of supplying currents of various voltages. Further, the connector 122 may be configured to transmit not only electrical communication but also optical communication, voice communication, and the like.

  Reference numerals 130 and 132 denote mirrors that guide light rays incident on the photographing lens 310 to the optical viewfinder 104 by a single-lens reflex system. The mirror 132 may be either a quick return mirror or a half mirror.

  Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, and the like, an interface 204 with the image processing apparatus 100, and a connector 206 for connecting with the image processing apparatus 100. Reference numeral 210 denotes a recording medium such as a memory card or a hard disk, similar to the recording medium 200. The recording medium 210 includes a recording unit 212 composed of a semiconductor memory, a magnetic disk, or the like, an interface 214 with the image processing apparatus 100, and a connector 216 for connecting with the image processing apparatus 100.

  Reference numeral 300 denotes an interchangeable lens type lens unit. A lens mount 306 mechanically couples the lens unit 300 to the image processing apparatus 100. The lens mount 306 includes various functions for electrically connecting the lens unit 300 to the image processing apparatus 100.

  Reference numeral 310 denotes a photographing lens, and 312 denotes an aperture. Reference numeral 320 denotes an interface for connecting the lens unit 300 to the image processing apparatus 100 in the lens mount 306. A connector 322 electrically connects the lens unit 300 to the image processing apparatus 100.

  The connector 322 has a function of transmitting a control signal, a status signal, a data signal, and the like between the image processing apparatus 100 and the lens unit 300 and supplying various currents or supplying currents. The connector 322 may be configured to transmit not only an electrical signal but also an optical signal, an audio signal, and the like.

  Reference numeral 340 denotes an aperture control unit that controls the aperture 312 in cooperation with the shutter control unit 40 that controls the shutter 12 based on photometric information from the photometry control unit 46. A distance measurement control unit 342 controls focusing of the photographing lens 310. A zoom control unit 344 controls zooming of the photographing lens 310. A lens system control circuit 350 controls the entire lens unit 300. The lens system control circuit 350 includes identification information such as a memory and an identification number unique to the lens unit 300, management information, function information such as an open aperture value, a minimum aperture value, and a focal length. It also has a non-volatile memory function for holding current and past set values.

  The operation of the electronic camera having the above configuration will be described. 3, 4, and 5 are flowcharts illustrating a shooting operation processing procedure of the image processing apparatus 100. This processing program is stored in a storage medium such as the nonvolatile memory 56, loaded into the memory 52, and executed by the CPU in the system control circuit 50.

  Upon power-on such as battery replacement, the system control circuit 50 initializes flags, control variables, and the like, and performs necessary initial settings for each part of the image processing apparatus 100 (step S101). Then, the dark capture flag is set to 0 (step S102). The system control unit 50 determines the setting position of the power switch 72, and determines whether or not the power switch 72 is set to power OFF (step S103).

  When the power switch 72 is set to power OFF, the display of each display unit is changed to the end state, and necessary parameters, setting values, and setting modes including flags and control variables are recorded in the nonvolatile memory 56. After performing a predetermined end process such as shutting off unnecessary power of each part of the image processing apparatus 100 including the image display unit 28 by the power control unit 80 (step S104), the dark capture flag is set to 0 (step S105). ), The process returns to step S102.

  On the other hand, if the power switch 72 is set to ON, the system control circuit 50 determines whether the remaining capacity of the power source 86 such as a battery and the operation status are problematic in the operation of the image processing apparatus 100 by the power control unit 80. Is determined (step S106). If it is determined that there is a problem, a predetermined warning is given to the display unit 54 by displaying an image or outputting a sound (step S110), and then the process returns to step S103.

  On the other hand, when it is determined that there is no problem with the power supply 86, the system control circuit 50 determines the setting position of the mode dial switch 60 and determines whether or not the mode dial switch 60 is set to the shooting mode (step S107). ). When the mode dial switch 60 is set to another mode, the system control circuit 50 executes processing according to the selected mode (step S109), and returns to the processing of step S103 after execution.

  On the other hand, when the mode dial switch 60 is set to the shooting mode, it is determined whether or not the recording media 200 and 201 are attached, the management information of the image data recorded on the recording media 200 and 201 is acquired, and the recording is performed. It is determined whether or not the operation state of the mediums 200 and 201 has a problem in the operation of the image processing apparatus 100, particularly the recording / reproducing operation of the image data with respect to the recording medium (step S108). If it is determined that there is a problem, a predetermined warning is given by displaying an image or outputting sound on the display unit 54 (step S110), and then the process returns to step S102.

  On the other hand, when it is determined in step S108 that there is no problem, the system control circuit 50 checks the selection state of the single / continuous shooting switch 68 for selecting single shooting / continuous shooting (step S111). If single shooting is selected, the single / continuous shooting flag is set to single shooting (step S112). If continuous shooting is selected, the single / continuous shooting flag is set to continuous shooting (step S112). Step S113). In the single shooting / continuous shooting switch 68, when the shutter switch SW2 is pressed, a single shooting mode in which one frame is shot to be in a standby state, and continuous shooting is performed while the shutter switch SW2 is pressed. It is possible to switch the mode arbitrarily. The state of the single / continuous shooting flag is stored in the internal memory of the system control circuit 50 or the memory 52.

  Then, the setting state of the dark capture flag is checked (step S114). If the dark capture flag is 0, the dark capture flag is set to 1 (step S115), and after dark capture for correction value generation is performed (step S116), the sensor of the dark image sensor is damaged. Correction is performed (step S132). At this time, correction is performed using another flaw correction data that corrects only a flaw that is the same as or larger than the flaw correction data of the captured image in step S133.

  Thereafter, a correction value for one-dimensional dark fixed pattern noise is generated (step S117). As a method of creating this one-dimensional dark fixed pattern noise correction data, for example, a method of obtaining data for one horizontal line by projecting an image obtained by performing dark photographing in the vertical direction can be considered. If projection is performed in the horizontal direction, data for one vertical line is obtained. The reason for correcting only large scratches in the dark scratch correction in step S132 is that small scratches are rounded when a projection operation is performed. In addition, the size of the dark image to be captured does not necessarily need to capture the entire screen because the projection calculation is performed, and it is clear that the minimum size is not affected by random noise when the projection calculation is performed.

  The one-dimensional correction data is repeatedly developed in the predetermined area of the memory 30 by the same number of lines as the actual image in the vertical direction (step S118). The dark capture process will be described later. When the dark capture flag is 1, the dark capture processing is not performed and the process proceeds to step 120.

  The system control circuit 50 displays various setting states of the image processing apparatus 100 using images and sounds using the display unit 54 (step S119). Here, when the image display switch of the image display unit 28 is ON, various setting states of the image processing apparatus 100 may be displayed by an image or sound using the image display unit 28.

  It is determined whether or not the shutter switch SW1 is pressed (step S120). If the shutter switch SW1 is not pressed, the process returns to step S103. On the other hand, when the shutter switch SW1 is pressed, the system control circuit 50 performs a distance measurement process to focus the photographing lens 310 on the subject, and performs a light measurement process to determine an aperture value and a shutter speed. Photometric processing is performed (step S121). In the photometric process, the flash is set if necessary. Details of the distance measurement / photometry processing will be described later.

  Then, it is determined whether or not the shutter switch SW2 is pressed (step S122). If the shutter switch SW2 is not pressed, it is determined whether or not the shutter switch SW1 is released (step S123), and the shutter switch SW1. Steps S122 and S123 are repeated until is released or the shutter switch SW2 is pressed. If the shutter switch SW1 is released in step S123, the process proceeds to step S103.

  On the other hand, when the shutter switch SW2 is pressed in step S122, the system control circuit 50 determines whether or not the memory 30 has an image storage buffer area in which captured image data can be stored (step S124). If it is determined that there is no area where new image data can be stored in the image storage buffer area of the memory 30, a predetermined warning is given to the display unit 54 by displaying an image or outputting sound (step S125). The process returns to step S103.

  For example, immediately after performing the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30, the first image to be read from the memory 30 and written to the storage media 200, 210 is still the storage media 200, 210. This is a case where a single blank area cannot be secured in the image storage buffer area of the memory 30.

  Note that when the captured image data is compressed and stored in the image storage buffer area of the memory 30, the area that can be stored in consideration of the fact that the amount of compressed image data varies depending on the compression mode setting. Is in the image storage buffer area of the memory 30, it is determined in the process of step S124.

  On the other hand, if it is determined in step S124 that there is an image storage buffer area capable of storing the image data captured in the memory 30, the system control circuit 50 reads out the imaging signal that has been captured and accumulated for a predetermined time from the imaging device 14, and The photographed image data is written in a predetermined area of the memory 30 via the A / D converter 16, the image processing circuit 20 and the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22. An imaging process is executed (step S126). Details of this photographing process will be described later.

  When the photographing process in step S126 is completed, the process proceeds to step S133. In order to prevent the image quality from being affected by pixel flaws in the sensor in the development process, flaws in pixel units are corrected for the captured image (step S133).

  The system control circuit 50 reads a part of image data written in a predetermined area of the memory 30 via the memory control circuit 22 and performs WB (white balance) integration calculation processing, OB (optical) necessary for development processing. Black) Integral calculation processing is performed, and the calculation result is stored in the internal memory or the memory 52 of the system control circuit 50.

  Then, the system control circuit 50 uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to read the captured image data written in a predetermined area of the memory 30 and reads the internal memory or the memory 52 of the system control circuit 50. Are used to perform various development processes including an AWB (auto white balance) process, a gamma conversion process, and a color conversion process (step S127).

  In the development processing, dark correction calculation processing is also performed by performing subtraction processing using the one-dimensional dark fixed pattern noise correction data developed in step S118.

  FIG. 5 is a diagram showing a difference between correction of the main image using conventional blacking and one-dimensional dark fixed pattern noise correction data.

  As described above, when the correction calculation processing is performed using the one-dimensional dark fixed pattern noise correction data, it is possible to correct the image quality deterioration due to the horizontal dark current noise and the fixed pattern noise generated in the image sensor 14. .

  The system control circuit 50 reads out the image data written in a predetermined area of the memory 30, performs image compression processing according to the set mode by the compression / decompression circuit 32, and free images in the image storage buffer area of the memory 30. The image data that has been shot and finished a series of processing is written in the portion (step S128).

  Then, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30, and a recording medium such as a memory card or a compact flash (R) card via the interfaces 90 and 94 and the connectors 92 and 96. A recording process for writing the image data read out to 200 and 210 is started (step S129). This recording start process is performed on the image data every time new image data that has been shot and finished a series of processes is newly written in the empty image portion of the image storage buffer area of the memory 30.

  Note that while the image data is being written to the recording media 200 and 201, a recording medium writing operation display such as blinking an LED is performed on the display unit 54 to indicate that the writing operation is being performed.

  Further, the system control circuit 50 determines whether or not the shutter switch SW1 is pressed (step S130). If the shutter switch SW1 is released, the process returns to step S103. On the other hand, when the shutter switch SW1 is pressed, the state of the single / continuous shooting flag stored in the internal memory of the system control circuit 50 or the memory 52 is determined (step S131), and single shooting is set. If it is, the process returns to step S130, and the current process is repeated until the shutter switch SW1 is released. On the other hand, if continuous shooting has been set, in order to perform continuous shooting, the process returns to step S122 to prepare for the next shooting. As a result, a series of processing relating to photographing is completed.

  FIG. 6 is a flowchart showing the distance measurement / photometry processing procedure in step S121. In the distance measurement / photometry processing, the exchange of various signals between the system control circuit 50 and the aperture control unit 340 or the distance measurement control unit 342 includes an interface 120, a connector 122, a connector 322, an interface 320, and a lens system control circuit 350. Is done through.

  The system control circuit 50 starts an AF (autofocus) process using the image sensor 14, the distance measurement control unit 42, and the distance measurement control unit 342 (step S201).

  The system control circuit 50 causes the light beam incident on the photographing lens 310 to enter the distance measurement control unit 42 via the aperture 312, the lens mounts 306 and 106, the mirror 130, and the distance measurement sub-mirror (not shown). Then, the focusing state of the image formed as an optical image is determined, and ranging control is performed while driving the photographic lens 310 using the ranging control unit 342 until ranging (AF) is determined to be in focus. The AF control for detecting the in-focus state using the unit 42 is executed (steps S202 and S203).

  When ranging (AF) is determined to be in focus in step S203, the system control circuit 50 determines a focused distance point from a plurality of distance measurement points on the shooting screen, and the determined distance measurement point. Ranging data and / or setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52 together with the data (step S204).

  Subsequently, the system control circuit 50 starts an AE (automatic exposure) process using the photometry control unit 46 (step S205). The system control circuit 50 causes the light beam incident on the photographing lens 310 to enter the photometric control unit 46 via the aperture 312, the lens mounts 306 and 106, the mirrors 130 and 132, and a photometric lens (not shown). Then, the exposure state of the image formed as an optical image is measured, and photometric processing is performed using the exposure (shutter) control unit 40 until it is determined that the exposure (AE) is appropriate (steps S206 and S207).

  If it is determined in step S207 that the exposure (AE) is appropriate, the system control circuit 50 stores the photometric data and / or setting parameters in the internal memory of the system control circuit 50 or the memory 52 (step S207A).

  The system control circuit 50 determines the aperture value (Av value) and the shutter speed (Tv value) according to the exposure (AE) result detected in the photometric process in step S206 and the shooting mode set by the mode dial switch 60. Is determined.

  Here, according to the determined shutter speed (Tv value), the system control circuit 50 determines the charge accumulation time of the image sensor 14, and performs the photographing process and the dark capturing process with the determined same charge accumulation time. Do.

  Based on the measurement data obtained by the photometric processing in step S206, the system control circuit 50 determines whether or not flashing is necessary (step S208). If flashing is necessary, the flash flag is set and charging is completed. The flash unit 48 is charged until this is done (steps S209 and S210). Then, when the charging of the flash unit 48 is completed, this process is terminated and the process returns to the main process.

  FIG. 8 is a flowchart showing the photographing processing procedure in step S126. In this photographing process, various signals are exchanged between the system control circuit 50 and the aperture control unit 340 or the distance measurement control unit 342 via the interface 120, the connector 122, the connector 322, the interface 320, and the lens system control circuit 350. Done.

  The system control circuit 50 moves the mirror 130 to the mirror up position by a mirror driving unit (not shown) (step S301), and according to the photometric data stored in the internal memory of the system control circuit 50 or the memory 52, the aperture control unit The diaphragm 312 is driven to a predetermined diaphragm value by 340 (step S302).

  After performing the charge clear operation of the image sensor 14 (step S303), the system control circuit 50 starts charge accumulation of the image sensor 14 (step S304), and opens the shutter 12 by the shutter control unit 40 (step S305). Exposure of the image sensor 14 is started (step S306).

  Then, it is determined whether or not the flash unit 48 is necessary based on the flash flag (step S307), and if necessary, the flash unit 48 is caused to emit light (step S308).

  The system control circuit 50 waits for the exposure of the image sensor 14 according to the photometric data (step S309), and when the exposure ends, the shutter control unit 40 closes the shutter 12 (step S310) and ends the exposure of the image sensor 14. .

  The system control circuit 50 drives the aperture 312 to the open aperture value by the aperture controller 340 (step S311), and moves the mirror 130 to the mirror down position by the mirror driver (not shown) (step S312).

  It is determined whether or not the set charge accumulation time has elapsed (step S313). If the set charge accumulation time has elapsed, the system control circuit 50 finishes the charge accumulation of the image sensor 14 (step S314), and then performs imaging. A charge signal is read out from the element 14, and a predetermined area of the memory 30 through the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 through the memory control circuit 22. The photographed image data is written in (Step S315). When the series of processes is completed, the present process is terminated and the process returns to the main process.

  FIG. 8 is a flowchart showing the dark capture processing procedure in step S116. After performing the charge clear operation of the image sensor 14 (step S401), the system control circuit 50 starts charge accumulation of the image sensor 14 with the shutter 12 closed (step S402).

  It is determined whether or not a predetermined charge accumulation time that has been set has elapsed (step S403). When the charge accumulation time has elapsed, the system control circuit 50 reads the charge signal from the image sensor 14 after completing the charge accumulation of the image sensor 14 (step S404), and the A / D converter 16, the image processing circuit 20, Image data (dark image data) is written into a predetermined area of the memory 30 via the memory control circuit 22 or directly from the A / D converter 16 via the memory control circuit 22 (step S405). The dark image data is used when the development process is performed in a state where the shooting process is executed first and the shot image data is read from the image sensor 14 and written in the memory 30.

  By performing development processing using this dark capture data, the captured image data can be corrected for image quality degradation such as dark current noise generated in the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. Is possible. Thereafter, this process is terminated and the process returns to the main process.

  The above is the description of the embodiments of the present invention. However, the present invention is not limited to the configurations of these embodiments, and the functions shown in the claims or the functions of the configurations of the embodiments are included. Any configuration that can be achieved is applicable.

  For example, in the above embodiment, when horizontal dark shading correction is performed, correction data is expanded in the memory 30. However, without performing this expansion processing, correction is performed sequentially from the main image while capturing image data from the image sensor 14. It is also possible to correct so that the data is subtracted.

  In the present embodiment, the one-dimensional dark fixed pattern noise correction data expansion process (S118) is performed when the camera is turned on. However, the correction data is expanded after the shutter switch SW1 is pressed. It may be.

  Further, although the correction data is one-dimensional data in the horizontal direction, it may be one-dimensional data or two-dimensional data in the vertical direction. Further, as shown in FIG. 9, both the horizontal and vertical one-dimensional data are stored in the correction data development process (S118), even if it is not the entire two-dimensional image data. When developing the dimension data, the one-dimensional dark fixed pattern noise in both the horizontal and vertical directions can be corrected by adjusting the correction amount for each line using the one-dimensional data in the vertical direction. FIG. 12 is a diagram showing correction of the main image using one-dimensional data in both the vertical and horizontal directions. In this case, the vertical direction is not stored as one-dimensional correction data, but is stored as a mathematical formula. When developing the one-dimensional data in the horizontal direction, the vertical direction is applied by applying this mathematical formula. The original dark fixed pattern noise may be corrected.

  Further, in the above embodiment, the case of switching between single shooting / continuous shooting using the single shooting / continuous shooting switch 68 has been shown, but switching between single shooting / continuous shooting according to the operation mode selection in the mode dial 60. It is good also as composition which performs.

  In the above-described embodiment, the case where the charge accumulation time of the main photographing process and the charge accumulation time of the dark capturing process are made equal is shown. However, as long as sufficient data for correcting the dark current noise and the like is obtained. The charge accumulation time may be different.

  Further, in the present embodiment, the case where the photographing operation is performed by moving the mirror 130 between the mirror up position and the mirror down position has been described. However, the mirror 130 is configured as a half mirror so that the photographing operation is performed without moving. May be.

  Furthermore, the recording media 200 and 210 are not only memory cards such as PCMCIA cards and compact flash (R), hard disks, etc., but also phases such as micro DAT, magneto-optical disks, optical disks such as CD-R and CD-RW, and DVDs. It may be composed of a changeable optical disk or the like. Furthermore, the recording media 200 and 210 may be composite media in which a memory card and a hard disk are integrated. In this case, a part of the composite medium may be detachable.

  In the above embodiment, the recording media 200 and 210 are separated from the image processing apparatus 100 and can be arbitrarily connected. However, any or all of the recording media remain fixed to the image processing apparatus 100. There may be. Further, the image processing apparatus 100 may be configured such that a single or a plurality of recording media 200 and 210 can be connected.

  It goes without saying that the present invention can also be applied to a case where the present invention is achieved by supplying software program codes for realizing the functions of the above-described embodiments to a system or apparatus. In this case, the program code itself realizes the novel function of the present invention, and the program itself and the storage medium storing the program constitute the present invention.

  In the above embodiment, the program codes shown in the flowcharts of FIGS. 3 to 4, 6 to 7, and 8 are stored in a ROM that is a storage medium. The storage medium for supplying the program code is not limited to the ROM, and for example, a flexible disk, a hard disk, a nonvolatile memory card, or the like can be used.

FIG. 10 is a flowchart in the adjustment mode of the present embodiment.
This is to obtain a good image by providing correction data for each ISO in advance in the imaging apparatus.
In S201, the sensitivity of the imaging apparatus is set to ISO1600.
In S202, a dark image that is not exposed while the shutter is closed is captured on the entire screen.
In S203, correction data is created by mapping from the data of the entire screen captured in S202.
In S204, the sensitivity of the imaging apparatus is set to ISO800.
In S205, the data of the ¼ screen of the dark image is captured as in S202.
In S206, correction data is created by mapping from the 1/4 screen data captured in S205.

Here, the reason why the correction data may be 1/4 with respect to the sensitivity is that the reduction of random noise due to averaging is effective at the square root.
In S207, the sensitivity of the imaging apparatus is set to ISO400.
In S208, 1/16 screen data of a dark image is captured as in S202.
In S209, correction data is created by mapping from the 1/16 screen data captured in S208.
In S210, the sensitivity of the imaging apparatus is set to ISO200.
In S211, as in S202, 1/64 screen data of a dark image is captured.
In S212, correction data is created by mapping from the 1/64 screen data captured in S211.
In S213, the sensitivity of the imaging apparatus is set to ISO100.
In S214, as in S202, 1/64 screen data of a dark image is captured.
In S215, correction data is created by mapping from the 1/64 screen data captured in S214.

  Here, the reason why ISO 100 and 200 are made the same as the 1/64 screen is that if there are too few scratched pixels or the like that are not random noise, they are easily affected.

Moreover, it is because there is no problem because it is sufficiently short in time.
In S216, the obtained ISO correction data is recorded in the nonvolatile memory.

  FIG. 11 is a flowchart for creating correction data when the imaging apparatus is turned on.

  This is effective when the correction data is different when shooting at a temperature different from the factory adjustment.

  S301 to S315 are the same as S201 to S215 of FIG.

  Similarly, it may be just before or just after shooting.

  FIG. 12 shows another embodiment of the present invention, which creates ISO correction data set immediately before shooting.

  Since the conditions are the closest at the time of actual image shooting, a good image can be obtained.

  The correction data may be created every time, but here, the correction data is used with the assumption that the change in the condition is small if the correction data is within a predetermined time.

Also, since it is just before shooting, correction data for all ISOs is not generated, but correction data is generated only for ISOs to be shot.
In step S401, the ISO setting value of the imaging apparatus is captured.
In S402, it is determined whether the ISO correction data has already been created. If there is, the process proceeds to S408, and if not, the process proceeds to S403.
In S403, a dark image in a range necessary for setting ISO is captured.
In S404, correction data is created from the dark image obtained in S403.
In S405, correction data is recorded. The date created at this time is also recorded at the same time.
In S406, the actual image is captured and the main image is captured.
In step S407, the main image in step S406 is corrected using the correction data.
After it is determined in S402 that the correction data has been created, it is determined when the correction data has been created, and if it is within a predetermined time from the present time, the process proceeds to S406 and the main image is taken.

  On the other hand, if the predetermined period is exceeded, the process proceeds to S403 to regenerate correction data.

  Here, the predetermined time is a time when one shooting scene is expected to continue.

  Further, the temperature data may be recorded and judged.

  FIG. 13 shows an example of a dark image range necessary for creating correction data for each ISO.

  In this example, horizontal correction data is created by mapping in the vertical direction.

  ISO 1600 uses the full screen, ISO 800 uses the upper 1/4 screen, and ISO 400 uses the upper 1/16 screen. Here, horizontal is required, but the same applies to vertical. Further, the range and location are not limited to this.

FIG. 14 shows an embodiment in which two-dimensional correction data is acquired.
The number of image captures corresponding to the ISO set in S501 is set. For example, the number of sheets is set such that one is ISO 100, two are ISO 200, and four are ISO 400.
In S502, one screen of a dark image is captured.
In S503, it is determined whether the number set in S501 has been reached. If not, the process proceeds to S502, and if it has not, the process proceeds to S504.
In S504, the dark images taken in are averaged to create two-dimensional correction data.

It is a block diagram which shows the structure of the electronic camera in embodiment. It is a figure which shows mixing of the fixed pattern noise in a horizontal and vertical direction. 3 is a flowchart illustrating a shooting operation processing procedure of the image processing apparatus 100. FIG. 4 is a flowchart illustrating a photographing operation processing procedure of the image processing apparatus 100 continued from FIG. It is a figure which shows correction | amendment of this image by black drawing or horizontal dark shading correction data. It is a flowchart which shows the ranging / photometry processing procedure in step S114. It is a flowchart which shows the imaging | photography process sequence in step S128. It is a flowchart which shows the dark taking-in process procedure in step S116. It is a figure which shows correction | amendment of this image using the one-dimensional data of the vertical and horizontal directions. Flow chart in adjustment mode Flow chart at power on Flow chart during shooting Other flowcharts for shooting Other flowcharts for shooting

Explanation of symbols

14 Image sensor 44 Thermometer 50 System control circuit 56 Non-volatile memory 60 Mode dial 62 Shutter switch SW1
64 Shutter switch SW2
69 ISO sensitivity setting switch 100 Image processing apparatus

Claims (8)

Driving means for driving a first imaging mode in which imaging is performed in a non-exposure state to obtain first image data, and a second imaging mode in which imaging is performed in an exposure state to obtain second image data;
Correction data generating means for generating correction data for correcting the second image data obtained in the second imaging mode from the first image data obtained in the first imaging mode, The correction data is generated by changing a predetermined range of the first image data in accordance with a sensitivity setting for shooting.   The imaging apparatus according to claim 1, wherein the correction data is generated for each sensitivity during adjustment.   The imaging apparatus according to claim 1, wherein the correction data is generated when the imaging apparatus is powered on.   2. The imaging apparatus according to claim 1, wherein the generation of the correction data is performed only for the sensitivity set immediately before or immediately after shooting of the imaging apparatus.   5. The correction data according to any one of claims 1 to 4, wherein when the correction data is obtained before a predetermined period, the correction data already obtained is used without newly taking in the correction data. An imaging apparatus characterized by the above.   6. The imaging apparatus according to claim 5, wherein the predetermined period is a power-on period.   The imaging apparatus according to claim 1, wherein the correction data is in the same range where the sensitivity is lower than a predetermined sensitivity. Driving means for driving a first imaging mode in which imaging is performed in a non-exposure state to obtain first image data, and a second imaging mode in which imaging is performed in an exposure state to obtain second image data;
Correction data generating means for generating correction data for correcting the second image data obtained in the second imaging mode from the first image data obtained in the first imaging mode; The data is generated by changing the number of acquisition times of the first image data according to the sensitivity setting for photographing.

Images